Posted by
daniel klein on
Oct 20, 2017; 9:25am
URL: http://spssx-discussion.165.s1.nabble.com/SPSS-Python-Extension-for-Fleiss-Kappa-tp5734963p5735027.html
Brian's comment concerning the advantages of Krippendorff's alpha might not
be quite accurate. Although the original author implies that his coefficient
is somehow superior to others in the literature, Gwet (2011, 2014) shows
that (i) Krippendorff's alpha can be computed in a very similar fashion to
other coefficients and (ii) other coefficients can be modified to handle
ordinal, interval, ratio (, circular, bipoloar, ...) ratings, just like
Krippendorff's alpha can. The method for handling missing data can also be
extended to other coefficients. Details are given in Gwet (2014) and are
implemented in -kappaetc- for Stata (code is completely open source).
I would be interested in details about the "Krippendorf macros" that Art
Kendall mentions, especially with respect to complex designs.
Best
Daniel
Gwet, K. L. (2014). Handbook of Inter-Rater Reliability. Gaithersburg, MD:
Advanced Analytics, LLC.
Gwet, K. L. (2011). On The Krippendorff’s Alpha Coefficient. Manuscript
submitted for publication in Communication Methods and Measures (August
2011).
https://www.researchgate.net/publication/267823285_On_Krippendorff's_Alpha_Coefficient--
Sent from:
http://spssx-discussion.1045642.n5.nabble.com/=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD