Re: Fleiss Kappa (Inter-rater reliability questions)
Posted by
Ryan on
Jan 09, 2013; 10:31pm
URL: http://spssx-discussion.165.s1.nabble.com/Fleiss-Kappa-Inter-rater-reliability-questions-tp5717299p5717308.html
You might consider adding Krippendorff's alpha as a custom dialog to SPSS:
Search for KALPHA on the website linked above and download the kalpha.spd file.
The documentation for KALPHA is here:
Ryan
On Wed, Jan 9, 2013 at 3:24 PM, BAM86
<[hidden email]> wrote:
Hi all,
I am conducting research and need some help with doing the Fleiss Kappa
analysis.
First and foremost let me give a bit of a layout of the study. We have a
sample of 75 students in the social sciences who were asked to categorize
potential items for a new measure based on descriptions of 2 theoretical
constructs. This was meant to be a preliminary check to help with construct
validity and take it a step beyond just the research team validating items
initially.
The items are supposed to characterize coping behaviours following romantic
loss. The constructs are loss-oriented coping and restoration-oriented
coping, however, we also gave the option for participants to say potential
items were both types of coping behaviour or something else altogether
(basically an 'other' option).
Therefore we have 75 participants categorizing items into one of 4
categories. We want to have some measure of the inter-rater reliability of
all these participants though. My understanding is that Fleiss Kappa would
be an appropriate tool for this purpose, however, if anyone is aware of
other statistics which may be a better fit for our model then please let me
know.
I also need to the syntax for the Fleiss Kappa statistic if anyone has it
available. Thanks in advance for any help people can provide.
--
View this message in context: http://spssx-discussion.1045642.n5.nabble.com/Fleiss-Kappa-Inter-rater-reliability-questions-tp5717299.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.
=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD