Re: SPSS Python Extension for Fleiss Kappa

Posted by Bruce Weaver on Oct 09, 2017; 8:45pm
URL: http://spssx-discussion.165.s1.nabble.com/SPSS-Python-Extension-for-Fleiss-Kappa-tp5734963p5734981.html

Hi Brian.  The author of kappaetc can be reached via the e-mail address at
the bottom of that text file I uploaded.  You could always ask him directly
what method(s) he used.  

Cheers,
Bruce



bdates wrote

> Bruce,
>
> Thanks for this. I'm wondering what formulae they're using for category
> SE's. I'm going to check with other sources and get back to you. This is
> certainly a conundrum. We have multiple results from multiple sources. I
> didn't send this along, but I also used the application from
> RealStatistics in Excel and got the same results as my syntax and that of
> Gwet's SAS solution. I'm using the updated 1979 computation for the
> kappa's and standard errors. Maybe they're using the 1971 version.
>
> Brian
>
>
> ________________________________________
> From: SPSSX(r) Discussion [

> SPSSX-L@.UGA

> ] on behalf of Bruce Weaver [

> bruce.weaver@

> ]
> Sent: Monday, October 09, 2017 2:23 PM
> To:

> SPSSX-L@.UGA

> Subject: Re: SPSS Python Extension for Fleiss Kappa
>
> Thanks Brian.  I don't know if this will helpful to you or not, but I've
> uploaded (in Nabble) a text file containing results from some analyses
> carried out using kappaetc, a user-written program for Stata.
> Unfortunately, kappaetc does not report a kappa for each category
> separately.  But with a little programming, I was able to obtain those.
> But
> the way I did it yielded the same SE for every category, and it matched
> the
> value shown by the Python extension command for SPSS.
>
> Below my output, I appended the help file info for kappaetc (including a
> reference list), in case it is helpful to you.
>
> Cheers,
> Bruce
>
> Fleiss_kappa_problem.txt
> <http://spssx-discussion.1045642.n5.nabble.com/file/t7186/Fleiss_kappa_problem.txt>
>
>
> bdates wrote
>> I'm uploading a Word document with the results of my syntax, Kilem Gwet's
>> SAS
>> macro, and the SPSS Python extension, in that order. I'm also uploading
>> an
>> SPSS data file with the raw data. Notice the Standard Error column in the
>> Python extension solution. All values are the same.
>>
>> Brian Fleiss_kappa_Discrepancies.docx
>> <http://spssx-discussion.1045642.n5.nabble.com/file/t47633/Fleiss_kappa_Discrepancies.docx>
>> irr_test_data.sav
>> <http://spssx-discussion.1045642.n5.nabble.com/file/t47633/irr_test_data.sav>
>>
>>
>>
>> --
>> Sent from: http://spssx-discussion.1045642.n5.nabble.com/
>>
>> =====================
>> To manage your subscription to SPSSX-L, send a message to
>
>> LISTSERV@.UGA
>
>>  (not to SPSSX-L), with no body text except the
>> command. To leave the list, send the command
>> SIGNOFF SPSSX-L
>> For a list of commands to manage subscriptions, send the command
>> INFO REFCARD
>
>
>
>
>
> -----
> --
> Bruce Weaver

> bweaver@

> http://sites.google.com/a/lakeheadu.ca/bweaver/
>
> "When all else fails, RTFM."
>
> NOTE: My Hotmail account is not monitored regularly.
> To send me an e-mail, please use the address shown above.
>
> --
> Sent from: http://spssx-discussion.1045642.n5.nabble.com/
>
> =====================
> To manage your subscription to SPSSX-L, send a message to

> LISTSERV@.UGA

>  (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD
>
> =====================
> To manage your subscription to SPSSX-L, send a message to

> LISTSERV@.UGA

>  (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD





-----
--
Bruce Weaver
[hidden email]
http://sites.google.com/a/lakeheadu.ca/bweaver/

"When all else fails, RTFM."

NOTE: My Hotmail account is not monitored regularly.
To send me an e-mail, please use the address shown above.

--
Sent from: http://spssx-discussion.1045642.n5.nabble.com/

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD