Advice, please?
Locked
 
|
Good Morning~ I have a question regarding z-scores: I have a database consisting of 121 subjects, each of whom was interviewed by 4 different interviewers: 3 individuals and 1 panel (consisting of a variety of 4-8 individuals) on 4 different dates -- the 3 individuals remained the same on the 4 dates, but the panels varied in terms of who sat on them. Each interviewer (and panel) graded each interaction on a 4-point scale (A-D). My question is this: is it valid to simply calculate a z score on the average of the 4 raw scores / grades each subject received? -- OR
Best, Jennifer Jennifer Doyle, M.A.
I'm not an outlier; I just haven't found my distribution yet! -- Ronan M. Conroy, Lecturer in Biostatistics, Royal College of Surgeons of Ireland Believe those who are seeking the truth, Doubt those who find it. -- Andre Gide The information transmitted in this email is intended only for the person or entity to which it is addressed. It may contain privileged or confidential material. Any review, retransmission, dissemination, or other use of this information by other than the intended recipient is prohibited. If you receive this email in error, please contact the sender and delete the material from any computer. The information in this e-mail is intended only for the person to whom it is addressed. If you believe this e-mail was sent to you in error and the e-mail contains patient information, please contact the Partners Compliance HelpLine at http://www.partners.org/complianceline . If the e-mail was sent to you in error but does not contain patient information, please contact the sender and properly dispose of the e-mail. |
|
|
You can use an average score, but you should compute the inter-rater reliability.
On Tue, Jan 10, 2012 at 9:53 AM, Doyle, Jennifer [via SPSSX Discussion] <[hidden email]> wrote:
-- Lori Andersen Ph.D. student, Educational Policy, Planning & Leadership College of William & Mary Williamsburg, VA |
|
|
In reply to this post by Doyle, Jennifer
I think that I’d just average the four scores and z-score that average. Gene Maguin From: SPSSX(r) Discussion [mailto:[hidden email]] On Behalf Of Doyle, Jennifer Good Morning~ I have a question regarding z-scores: I have a database consisting of 121 subjects, each of whom was interviewed by 4 different interviewers: 3 individuals and 1 panel (consisting of a variety of 4-8 individuals) on 4 different dates -- the 3 individuals remained the same on the 4 dates, but the panels varied in terms of who sat on them. Each interviewer (and panel) graded each interaction on a 4-point scale (A-D). My question is this: is it valid to simply calculate a z score on the average of the 4 raw scores / grades each subject received? -- OR Best, Jennifer Jennifer Doyle, M.A. I'm not an outlier; I just haven't found my distribution yet! -- Ronan M. Conroy, Lecturer in Biostatistics, Royal College of Surgeons of Ireland Believe those who are seeking the truth, Doubt those who find it. -- Andre Gide The information transmitted in this email is intended only for the person or entity to which it is addressed. It may contain privileged or confidential material. Any review, retransmission, dissemination, or other use of this information by other than the intended recipient is prohibited. If you receive this email in error, please contact the sender and delete the material from any computer.
|
|
|
In reply to this post by Doyle, Jennifer
Jennifer,
I deal with a similar problem when it comes to evaluating fellowship candidates in our dept. (OB?GYN). What I do is get an adjusted score by calculating the average rating given by each rater for the candidates they evaluate. I then divide each candidates score by the mean for the rater that evaluated them and then I average these adjusted scores. This corrects for biases of different raters in evaluating the candidates. Our raw scores have a maximum value of 100 pts.
|
| Free forum by Nabble | Edit this page |