Posted by
bdates on
Nov 16, 2011; 3:23pm
URL: http://spssx-discussion.165.s1.nabble.com/Fleiss-Kappa-Macro-for-SPSS-tp4994433p4998106.html
Good point, Bruce. I assumed that the categories were not ordered and
>2, so sent the syntax. But there's ample evidence that once categories
are ordered the ICC provides the best solution.
Brian
-----Original Message-----
From: SPSSX(r) Discussion [mailto:
[hidden email]] On Behalf Of
Bruce Weaver
Sent: Wednesday, November 16, 2011 9:43 AM
To:
[hidden email]
Subject: Re: Fleiss Kappa Macro for SPSS
Kristina, I don't think you've said how many categories are available
for
raters. If the categories are ordered, or if there are only two
categories,
you could compute the the most common form of intraclass correlation,
which
is equivalent to weighted kappa (with quadratic weights). The following
is
from a newsgroup post I made (to comp.soft-sys.stat.spss) back in 2002.
--- start of old post ---
The following is from Norman & Streiner (2000), Biostatistics: The Bare
Essentials:
------------------------------------------------------
RELATION BETWEEN KAPPA AND THE INTRACLASS CORRELATION
One reason why Cicchetti was fighting a losing battle is
that the weighted kappa using quadratic weights has a
very general property--it is mathematically (i.e.,
exactly) equal to the ICC. (p. 221)
------------------------------------------------------
There are several varieties of ICC. The one Norman & Streiner are
describing is this one (p. 100 in their book, 2nd Ed):
MS_subj - MS_residual
ICC = ----------------------------
MS(subj) + (k-1)*MS_residual
--- end of old post ---
HTH.
Kristina Georgiou wrote:
>
> Brian,
>
> I am not sure if the adaptations of the Cohen's Kappa you mention
below
> for multi-raters would be more suitable than Fleiss' Kappa. Is there
some
> reason why I should research these other analysis options for
inter-rater
> reliability instead of Fleiss Kappa? If not then could you please send
> through the macro for Fleiss Kappa and any instructions that will
assist
> me in getting the macro to run in the latest version of SPSS.
>
> Thanks
>
> Kristina
>
>
>
> __________________________________
> Kristina,
>
> I have a macro for Fleiss' kappa. I also have macros for multi-rater
> adaptations of Cohen's kappa if you're interested. Light's kappa
> averages the two-rater Cohen's kappa. Hubert's kappa averages the
> two-rater error terms but uses the overall proportion of agreement.
> Hubert's kappa has been reinvented by several others - Conger (1980),
> Davies and Fleiss (1982), Berry & Mielke (1988), Komagata (2002), and
> Artstein and Poesio (2008). Let me know, and I can send the Fleiss
> macro with directions.
>
> Brian
>
> -----Original Message-----
> From: SPSSX(r) Discussion [mailto:[hidden email]] On Behalf Of
> Kristina Georgiou
> Sent: Tuesday, November 15, 2011 9:37 AM
> To: [hidden email]
> Subject: [NEWSENDER] - Fleiss Kappa Macro for SPSS - Message is from
an
> unknown sender
>
> I am needing to use Fleiss' Kappa analysis in SPSS so that I can
> calculate
> the inter-rater reliability where there are more than 2 judges.
>
> I believe that I will need a macro file to be able to perform this
> analysis
> in SPSS is this correct? IF so does anyone have a file.
>
> Any help would be appreciated.
>
> Thanks
>
> Kristina Georgiou
> Research Student
>
> --
> View this message in context:
>
http://spssx-discussion.1045642.n5.nabble.com/Fleiss-Kappa-Macro-for-SPS
> S-tp4994433p4994433.html
> Sent from the SPSSX Discussion mailing list archive at Nabble.com.
>
> =====================
> To manage your subscription to SPSSX-L, send a message to
> [hidden email] (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD
>
> =====================
> To manage your subscription to SPSSX-L, send a message to
> [hidden email] (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD
>
-----
--
Bruce Weaver
[hidden email]
http://sites.google.com/a/lakeheadu.ca/bweaver/"When all else fails, RTFM."
NOTE: My Hotmail account is not monitored regularly.
To send me an e-mail, please use the address shown above.
--
View this message in context:
http://spssx-discussion.1045642.n5.nabble.com/Fleiss-Kappa-Macro-for-SPSS-tp4994433p4997918.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.
=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD