Which test?

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Which test?

Karl Koch
Hello group,

I have performed a simple experiment (and got the data). Now it is time to find out if the results are stat. significant. I would prefer a non-parametric test since less assumptions are required to hold.

I have one IV (system) with two possible categories (system A and system B). My null hypothesis is that both systems cause the same effect on participants. The outcome variable are a number of relevance ratings (on a 6 point scale S={1,2,3,4,5,6}) from users that used system A and a number of relevance ratings from the same users that used system B. The number of relevance ratings users did was up to them and can be different for system A and system B. An extract of the data looks like this:

User   System   Rating
1      A        2
1      A        1
1      A        3
1      B        4
1      B        6
2      B        5
2      B        6
2      A        2
2      A        1
2      B        6
...


It is important to point out that half of the users have first used System A and then system B to solve the task. The other half of the users have done the opposed order.

Since both systems have been counterbalanced, I would assume that the Mann-Whitney test should be my choice.

However, I also have used the same people on the test and that would formally ask for a Wilcoxon Matched Pairs Test.

I would like to know what the experts here think about that.

Best Regards,
Karl
--


Der GMX SmartSurfer hilft bis zu 70% Ihrer Onlinekosten zu sparen!
Ideal für Modem und ISDN: http://www.gmx.net/de/go/smartsurfer