Posted by
Talma on
Jan 20, 2018; 12:52pm
URL: http://spssx-discussion.165.s1.nabble.com/interrater-reliabillity-but-for-any-pair-of-raters-tp5735428.html
Dear list members,
I suspect I have a somewhat unusual questions - specifically, for a number
of categorical judgements (on a scale with judgements 1, 2, 3 or 4), I have
data from 30 judges (j1, j2, j3 etc.).
Judges are in the columns and judgements in rows.
My task is to calculate an interrater reliability for any pair of the 30
judges. So this makes n*(n-1)/2 = 30*(29)/2 = 435 interrater coefficients,
one for each dyad of raters.
For any dyadic interrater coefficient, I could use e.g. the kappa
coefficient available in the SPSS crosstabs procedure.
But how could I tell SPSS to repeat the procedure for each combination of
the 30 judges? So that ultimately, I receive as many kappa coefficients as
there are pairwise comparisons (=435, in this example)? I would be very
grateful for your suggestions how to implement such an automated procedure?
Many thanks...Talma
--
Sent from:
http://spssx-discussion.1045642.n5.nabble.com/=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD