Posted by
bdates on
Jan 21, 2018; 8:24pm
URL: http://spssx-discussion.165.s1.nabble.com/interrater-reliabillity-but-for-any-pair-of-raters-tp5735428p5735436.html
Talma,
Before you abandon David's code, he inserted the OMS section to provide a file to average the pair-wise kappa's. If you want to calculate the overall kappa in addition to the pairwise kappa's, then pasting and inserting syntax for kappa from the built-in kappa analysis after !End Define will do the trick. This will be a whole lot easier than for me to adapt my syntax.
Brian
________________________________________
From: Talma Claviger [
[hidden email]]
Sent: Sunday, January 21, 2018 2:55 PM
To:
[hidden email]; Dates, Brian
Subject: AW: interrater reliabillity - but for any pair of raters?
Dear all,
many thanks for your time + efforts! Because I am a bit slow I adapting the output management system (=SPSS novice, using it for the first time:) ) to David's syntax; I would also be interested in the matrix code Brian referred to?
Best,
Talma
Gesendet von Outlook<
http://aka.ms/weboutlook>
________________________________
Von: SPSSX(r) Discussion <
[hidden email]> im Auftrag von Dates, Brian <
[hidden email]>
Gesendet: Sonntag, 21. Januar 2018 18:57
An:
[hidden email]
Betreff: Re: interrater reliabillity - but for any pair of raters?
This looks great. My syntax has all the matrix stuff to calculate Fleiss, so it wouldn't be as elegant as this, in which the OP just needs to figure out how to insert the OMS. I hope the OP from earlier this week is reading this thread, too. It's exactly what he wanted to do.
My one concern is that the ordinal nature of the responses, or at least what looks ordinal, calls for the ICC rather than Fleiss. But that's not really our issue.
Brian
________________________________________
From: SPSSX(r) Discussion [
[hidden email]] on behalf of David Marso [
[hidden email]]
Sent: Saturday, January 20, 2018 9:04 PM
To:
[hidden email]
Subject: Re: interrater reliabillity - but for any pair of raters?
Macro with nested !DO and CROSSTABS in body. Use OMS to capture output. AGGREGATE to get average. Or maybe Brian will post a link to his MATRIX program.
UNTESTED. I'm on my phone...
DEFINE ! AllPairsKappa( raters !CMDEND)
!LET !CPY = !raters
!DO ! j1 !IN ( !raters)
!LET ! CPY= !TAIL( !CPY)
!DO !j2 !IN (!CPY)
CROSSTABS TABLES !j1 BY !j2 /STATISTICS KAPPA.
!DOEND
!DOEND
!ENDDEFINE.
SET UP OMS..RTFM FOR THAT...
!AllPairsKappa raters= j1 j2 j3 ..... j30.
=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD