WEIGHTED KAPPA command in v27

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

WEIGHTED KAPPA command in v27

Bruce Weaver
Administrator
Hello all.  I still have v26, but noticed that v27 has a WEIGHTED KAPPA
command.  The CRITERIA sub-command has two options: LINEAR (the default) and
QUADRATIC.  

I have three comments.

1.  I think it would help users if the documentation pointed out that the
linear weights are also (and maybe more commonly?) known as
Cicchetti-Allison weights.

2. Given that quadratic weights are (by far?) more commonly used, I would
have made QUADRATIC the default setting.  (However, a quick glance at the
Warrens 2013 article shown in the references below makes me think that I may
need to take another look at the pros & cons of the two weighting systems.)  

3. It would be nice to have an option for user-defined weights, and another
option to treat the variable as nominal.  (The latter would allow one to do
all Cohen's kappa computations with the one command.)  

Cheers,
Bruce


References

Cicchetti, D. V., & Allison, T. (1971). A new procedure for assessing
reliability of scoring EEG sleep recordings. American Journal of EEG
Technology, 11(3), 101-110.

Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the
intraclass correlation coefficient as measures of reliability. Educational
and psychological measurement, 33(3), 613-619

Warrens, M. J. (2013). Cohen’s weighted kappa with additive weights.
Advances in Data Analysis and Classification, 7(1), 41-55.
http://matthijswarrens.nl/pubs/2013/Warrens_2013_ADAC_7_41_55.pdf

https://www.datanovia.com/en/lessons/weighted-kappa-in-r-for-two-ordinal-variables/




-----
--
Bruce Weaver
[hidden email]
http://sites.google.com/a/lakeheadu.ca/bweaver/

"When all else fails, RTFM."

NOTE: My Hotmail account is not monitored regularly.
To send me an e-mail, please use the address shown above.

--
Sent from: http://spssx-discussion.1045642.n5.nabble.com/

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
--
Bruce Weaver
bweaver@lakeheadu.ca
http://sites.google.com/a/lakeheadu.ca/bweaver/

"When all else fails, RTFM."

PLEASE NOTE THE FOLLOWING: 
1. My Hotmail account is not monitored regularly. To send me an e-mail, please use the address shown above.
2. The SPSSX Discussion forum on Nabble is no longer linked to the SPSSX-L listserv administered by UGA (https://listserv.uga.edu/).