This looks great. My syntax has all the matrix stuff to calculate Fleiss, so it wouldn't be as elegant as this, in which the OP just needs to figure out how to insert the OMS. I hope the OP from earlier this week is reading this thread,
too. It's exactly what he wanted to do.
My one concern is that the ordinal nature of the responses, or at least what looks ordinal, calls for the ICC rather than Fleiss. But that's not really our issue.
Brian
________________________________________
From: SPSSX(r) Discussion [
[hidden email]] on behalf of David Marso [
[hidden email]]
Sent: Saturday, January 20, 2018 9:04 PM
To:
[hidden email]
Subject: Re: interrater reliabillity - but for any pair of raters?
Macro with nested !DO and CROSSTABS in body. Use OMS to capture output. AGGREGATE to get average. Or maybe Brian will post a link to his MATRIX program.
UNTESTED. I'm on my phone...
DEFINE ! AllPairsKappa( raters !CMDEND)
!LET !CPY = !raters
!DO ! j1 !IN ( !raters)
!LET ! CPY= !TAIL( !CPY)
!DO !j2 !IN (!CPY)
CROSSTABS TABLES !j1 BY !j2 /STATISTICS KAPPA.
!DOEND
!DOEND
!ENDDEFINE.
SET UP OMS..RTFM FOR THAT...
!AllPairsKappa raters= j1 j2 j3 ..... j30.
=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD