Re: SPSS Python Extension for Fleiss Kappa

Posted by bdates on Oct 09, 2017; 7:31pm
URL: http://spssx-discussion.165.s1.nabble.com/SPSS-Python-Extension-for-Fleiss-Kappa-tp5734963p5734980.html

Bruce,

Thanks for this. I'm wondering what formulae they're using for category SE's. I'm going to check with other sources and get back to you. This is certainly a conundrum. We have multiple results from multiple sources. I didn't send this along, but I also used the application from RealStatistics in Excel and got the same results as my syntax and that of Gwet's SAS solution. I'm using the updated 1979 computation for the kappa's and standard errors. Maybe they're using the 1971 version.

Brian


________________________________________
From: SPSSX(r) Discussion [[hidden email]] on behalf of Bruce Weaver [[hidden email]]
Sent: Monday, October 09, 2017 2:23 PM
To: [hidden email]
Subject: Re: SPSS Python Extension for Fleiss Kappa

Thanks Brian.  I don't know if this will helpful to you or not, but I've
uploaded (in Nabble) a text file containing results from some analyses
carried out using kappaetc, a user-written program for Stata.
Unfortunately, kappaetc does not report a kappa for each category
separately.  But with a little programming, I was able to obtain those.  But
the way I did it yielded the same SE for every category, and it matched the
value shown by the Python extension command for SPSS.

Below my output, I appended the help file info for kappaetc (including a
reference list), in case it is helpful to you.

Cheers,
Bruce

Fleiss_kappa_problem.txt
<http://spssx-discussion.1045642.n5.nabble.com/file/t7186/Fleiss_kappa_problem.txt>


bdates wrote

> I'm uploading a Word document with the results of my syntax, Kilem Gwet's
> SAS
> macro, and the SPSS Python extension, in that order. I'm also uploading an
> SPSS data file with the raw data. Notice the Standard Error column in the
> Python extension solution. All values are the same.
>
> Brian Fleiss_kappa_Discrepancies.docx
> &lt;http://spssx-discussion.1045642.n5.nabble.com/file/t47633/Fleiss_kappa_Discrepancies.docx&gt;
> irr_test_data.sav
> &lt;http://spssx-discussion.1045642.n5.nabble.com/file/t47633/irr_test_data.sav&gt;
>
>
>
> --
> Sent from: http://spssx-discussion.1045642.n5.nabble.com/
>
> =====================
> To manage your subscription to SPSSX-L, send a message to

> LISTSERV@.UGA

>  (not to SPSSX-L), with no body text except the
> command. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD





-----
--
Bruce Weaver
[hidden email]
http://sites.google.com/a/lakeheadu.ca/bweaver/

"When all else fails, RTFM."

NOTE: My Hotmail account is not monitored regularly.
To send me an e-mail, please use the address shown above.

--
Sent from: http://spssx-discussion.1045642.n5.nabble.com/

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD