Re: Appropriate statistical analyses

Posted by Maguin, Eugene on Jan 03, 2012; 4:02pm
URL: http://spssx-discussion.165.s1.nabble.com/Appropriate-statistical-analyses-tp5111855p5117270.html

Mehdi,

 

I think we need more information about the design because I’m not sure whether L1 and Level are between or within factors. The questions would be 1) was there one rater or multiple raters. 2) If multiple raters, how were raters assigned to scripts (or scripts to raters). For instance, did all raters rate all scripts or did each rater rate non-overlapping sets of scripts. 3) If multiple raters rated each script what happened to the multiple ratings. Were they averaged, for instance? 4)Were there 9 sets of 30 test takers such that each set of 30 test takers corresponds to a different combination of L1 and Level.

 

Turning to the DVs. Are Word Frequency, Syntactic complexity, and Cohesion continuous enough to be considered continuous or are they ordinal categorical?

 

Gene Maguin

 

From: SPSSX(r) Discussion [mailto:[hidden email]] On Behalf Of Mehdi Riazi
Sent: Saturday, December 31, 2011 3:05 AM
To: [hidden email]
Subject: Appropriate statistical analyses

 

Dear all,

Wish you all a healthy 2012. I appreciate your comments for the appropriate analyses for the following data set.

270 written scripts by test takers across three L1 backgrounds: A, B, & C are rated by trained and experienced raters at levels of 5, 6 & 7 as presented in the followig table.

	L1
Level	A	B	C
5	30	30	30
6	30	30	30
7	30	30	30

To check the validity of the ratings we've analysed the scripts using some textual features such as Word Frequency, Syntactic complexity, and Cohesion. We now want to find out:

1) Is there a sig. difference between the scripts belonging to levels 5, 6, & 7 in terms of any of the three text features (WF, SC, and Cohesion)?

2) Is there a sig. difference between the scripts at the same level (5, e.g.) across the three L1s (A, B, & C) in terms of the three text features?

3) Is there a sig. difference between the scripts at the three levels (5, 6, 7) for each L1 (A, B, & C)?

 

Any suggetions for appropriate statistical anslyses to answer these RQs is much appreciated.

Regards;
Mehdi

--
Mehdi Riazi, PhD
Associate Professor & Director HDR

Department of Linguistics
Faculty of Human Sciences
Macquarie University NSW 2109

Room: C5A 575
Phone: [phone]
Fax: [phone]
www.ling.mq.edu.au