Posted by
bdates on
Oct 10, 2017; 2:38am
URL: http://spssx-discussion.165.s1.nabble.com/SPSS-Python-Extension-for-Fleiss-Kappa-tp5734963p5734987.html
Jon,
Thanks. I'll contact the appropriate folks and get back to the list.
B
________________________________________
From: Jon Peck [
[hidden email]]
Sent: Monday, October 09, 2017 6:44 PM
To: Dates, Brian
Cc: SPSS List
Subject: Re: [SPSSX-L] SPSS Python Extension for Fleiss Kappa
The author of the Fleiss extension said...
I don't own Fleiss et al. (2003), but in that book the individual category standard errors are given that differ from the earlier formula cited by Brian Dates. What I'm doing matches what Stata does (see, e.g., Examples 6 and 7 at
https://www.stata.com/manuals13/rkappa.pdf). Here's another more recent program or script for this that also uses the same SEs:
https://www.mathworks.com/matlabcentral/fileexchange/15426-fleiss-es-kappa?focused=5144134&tab=function. In the latter case you can see only one SE listed, the same for each category. In the Stata examples they don't list the SE, but you can easily see from the values of the category kappa values and the Z values that the SEs are all the same.
On Mon, Oct 9, 2017 at 3:07 PM, Dates, Brian <
[hidden email]<mailto:
[hidden email]>> wrote:
Thanks, Bruce. I've sent an email to him. He mentions Gwet in his acknowledgments, so it'll be interesting what Gwet says about all of this.
Brian
________________________________________
From: SPSSX(r) Discussion [
[hidden email]<mailto:
[hidden email]>] on behalf of Bruce Weaver [
[hidden email]<mailto:
[hidden email]>]
Sent: Monday, October 09, 2017 4:45 PM
To:
[hidden email]<mailto:
[hidden email]>
Subject: Re: SPSS Python Extension for Fleiss Kappa
Hi Brian. The author of kappaetc can be reached via the e-mail address at
the bottom of that text file I uploaded. You could always ask him directly
what method(s) he used.
Cheers,
Bruce
bdates wrote
> Bruce,
>
> Thanks for this. I'm wondering what formulae they're using for category
> SE's. I'm going to check with other sources and get back to you. This is
> certainly a conundrum. We have multiple results from multiple sources. I
> didn't send this along, but I also used the application from
> RealStatistics in Excel and got the same results as my syntax and that of
> Gwet's SAS solution. I'm using the updated 1979 computation for the
> kappa's and standard errors. Maybe they're using the 1971 version.
>
> Brian
>
>
> ________________________________________
> From: SPSSX(r) Discussion [
> SPSSX-L@.UGA
> ] on behalf of Bruce Weaver [
> bruce.weaver@
> ]
> Sent: Monday, October 09, 2017 2:23 PM
> To:
> SPSSX-L@.UGA
> Subject: Re: SPSS Python Extension for Fleiss Kappa
>
> Thanks Brian. I don't know if this will helpful to you or not, but I've
> uploaded (in Nabble) a text file containing results from some analyses
> carried out using kappaetc, a user-written program for Stata.
> Unfortunately, kappaetc does not report a kappa for each category
> separately. But with a little programming, I was able to obtain those.
> But
> the way I did it yielded the same SE for every category, and it matched
> the
> value shown by the Python extension command for SPSS.
>
> Below my output, I appended the help file info for kappaetc (including a
> reference list), in case it is helpful to you.
>
> Cheers,
> Bruce
>
> Fleiss_kappa_problem.txt
> <
http://spssx-discussion.1045642.n5.nabble.com/file/t7186/Fleiss_kappa_problem.txt>>
>
> bdates wrote
>> I'm uploading a Word document with the results of my syntax, Kilem Gwet's
>> SAS
>> macro, and the SPSS Python extension, in that order. I'm also uploading
>> an
>> SPSS data file with the raw data. Notice the Standard Error column in the
>> Python extension solution. All values are the same.
>>
>> Brian Fleiss_kappa_Discrepancies.docx
>> <
http://spssx-discussion.1045642.n5.nabble.com/file/t47633/Fleiss_kappa_Discrepancies.docx>>> irr_test_data.sav
>> <
http://spssx-discussion.1045642.n5.nabble.com/file/t47633/irr_test_data.sav>>>
>>
>>
>> --
>> Sent from:
http://spssx-discussion.1045642.n5.nabble.com/>>
>> =====================
>> To manage your subscription to SPSSX-L, send a message to
>
>> LISTSERV@.UGA
>
>> (not to SPSSX-L), with no body text except the
>> command. To leave the list, send the command
>> SIGNOFF SPSSX-L
>> For a list of commands to manage subscriptions, send the command
>> INFO REFCARD
>
>
>
>
>
> -----
> --
> Bruce Weaver
> bweaver@
> LISTSERV@.UGA
> (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD
>
> =====================
> To manage your subscription to SPSSX-L, send a message to
> LISTSERV@.UGA
> (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD
-----
--
Bruce Weaver
[hidden email]<mailto:
[hidden email]>
http://sites.google.com/a/lakeheadu.ca/bweaver/"When all else fails, RTFM."
NOTE: My Hotmail account is not monitored regularly.
To send me an e-mail, please use the address shown above.
--
Sent from:
http://spssx-discussion.1045642.n5.nabble.com/=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email]<mailto:
[hidden email]> (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email]<mailto:
[hidden email]> (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
--
Jon K Peck
[hidden email]<mailto:
[hidden email]>
=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD