How data entry for TURF analysis

classic Classic list List threaded Threaded
21 messages Options
12
FRP
Reply | Threaded
Open this post in threaded view
|

How data entry for TURF analysis

FRP
Hello all,
i am currently writing my master thesis at the university of plymouth (UK) and need advise how to make the data entry in spss for TURF analysis. Has anybody an example how to do it? I already downloaded and installed the spssinc_turf.

I have 5 flavors and approximately 100 subjects.

Thanks for your help...
FRP
Reply | Threaded
Open this post in threaded view
|

Re: How data entry for TURF analysis

FRP
ah yes...i use spss 18 and cant find anything in the current book of spss 18...
Reply | Threaded
Open this post in threaded view
|

Re: How data entry for TURF analysis

Maurice Vergeer
follow this link to install an spss extention to do TURF analysis:
https://www.ibm.com/developerworks/mydeveloperworks/groups/service/html/communityview?communityUuid=ab16c38e-2f7b-4912-a47e-85682d124d32


On Tue, Jul 26, 2011 at 5:33 PM, FRP <[hidden email]> wrote:
ah yes...i use spss 18 and cant find anything in the current book of spss
18...

--
View this message in context: http://spssx-discussion.1045642.n5.nabble.com/How-data-entry-for-TURF-analysis-tp4635246p4635267.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD



--
___________________________________________________________________
Maurice Vergeer
Department of communication, Radboud University  (www.ru.nl)
PO Box 9104, NL-6500 HE Nijmegen, The Netherlands

Visiting Professor Yeungnam University, Gyeongsan, South Korea

Recent publications:
-Vergeer, M., Eisinga, R. & Franses, Ph.H. (forthcoming). Supply and demand effects in television viewing. A time series analysis. Communications - The European Journal of Communication Research.
-Vergeer, M. Lim, Y.S. Park, H.W. (forthcoming). Mediated Relations: New Methods to study Online Social Capital. Asian Journal of Communication.
-Vergeer, M., Hermans, L., & Sams, S. (forthcoming). Online social networks and micro-blogging in political campaigning: The exploration of a new campaign tool and a new campaign style. Party Politics.
-Pleijter, A., Hermans, L. & Vergeer, M. (forthcoming). Journalists and journalism in the Netherlands. In D. Weaver & L. Willnat, The Global Journalist in the 21st Century. London: Routledge.

Webspace
www.mauricevergeer.nl
http://blog.mauricevergeer.nl/
www.journalisteninhetdigitaletijdperk.nl
maurice.vergeer (skype)
___________________________________________________________________





Reply | Threaded
Open this post in threaded view
|

Re: How data entry for TURF analysis

Jon K Peck
In reply to this post by FRP
Each flavor is a variable, for which you presumably have a rating on some scale, say 1 to 5.
So each of your 100 rows data would have five variables, one for each flavor.  Then just use the TURF dialog box to specify the analysis, including the cut point for a positive rating.

Jon Peck
Senior Software Engineer, IBM
[hidden email]
new phone: 720-342-5621




From:        FRP <[hidden email]>
To:        [hidden email]
Date:        07/26/2011 09:35 AM
Subject:        [SPSSX-L] How data entry for TURF analysis
Sent by:        "SPSSX(r) Discussion" <[hidden email]>




Hello all,
i am currently writing my master thesis at the university of plymouth (UK)
and need advise how to make the data entry in spss for TURF analysis. Has
anybody an example how to do it? I already downloaded and installed the
spssinc_turf.

I have 5 flavors and approximately 100 subjects.

Thanks for your help...

--
View this message in context:
http://spssx-discussion.1045642.n5.nabble.com/How-data-entry-for-TURF-analysis-tp4635246p4635246.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD

FRP
Reply | Threaded
Open this post in threaded view
|

Re: How data entry for TURF analysis

FRP
In reply to this post by Maurice Vergeer
Hello,
which extension do you mean. I already installed the SPSSINC_TURF. But how I have to put the data into spss....?
Reply | Threaded
Open this post in threaded view
|

Re: How data entry for TURF analysis

Maurice Vergeer
dear FRP,

I wasn't aware you already installed it.
sorry, I'm no expert in this field. I just happen to bump into the extension, but have no experience with it.

Maurice

On Tue, Jul 26, 2011 at 6:34 PM, FRP <[hidden email]> wrote:
Hello,
which extension do you mean. I already installed the SPSSINC_TURF. But how I
have to put the data into spss....?

--
View this message in context: http://spssx-discussion.1045642.n5.nabble.com/How-data-entry-for-TURF-analysis-tp4635246p4635472.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD



--
___________________________________________________________________
Maurice Vergeer
Department of communication, Radboud University  (www.ru.nl)
PO Box 9104, NL-6500 HE Nijmegen, The Netherlands

Visiting Professor Yeungnam University, Gyeongsan, South Korea

Recent publications:
-Vergeer, M., Eisinga, R. & Franses, Ph.H. (forthcoming). Supply and demand effects in television viewing. A time series analysis. Communications - The European Journal of Communication Research.
-Vergeer, M. Lim, Y.S. Park, H.W. (forthcoming). Mediated Relations: New Methods to study Online Social Capital. Asian Journal of Communication.
-Vergeer, M., Hermans, L., & Sams, S. (forthcoming). Online social networks and micro-blogging in political campaigning: The exploration of a new campaign tool and a new campaign style. Party Politics.
-Pleijter, A., Hermans, L. & Vergeer, M. (forthcoming). Journalists and journalism in the Netherlands. In D. Weaver & L. Willnat, The Global Journalist in the 21st Century. London: Routledge.

Webspace
www.mauricevergeer.nl
http://blog.mauricevergeer.nl/
www.journalisteninhetdigitaletijdperk.nl
maurice.vergeer (skype)
___________________________________________________________________





FRP
Reply | Threaded
Open this post in threaded view
|

Re: How data entry for TURF analysis

FRP
In reply to this post by Jon K Peck
Hello Jon,
i am honoured to get an answer of you.

do you have a kind of example file which u can provide me?
...problem is i am absolutely new on spss and have no clue how to do anything...do you know a kind of tutorial page or sth like this? ...I have the acutal version of the spss 18 book...

best regards,

FRP
Reply | Threaded
Open this post in threaded view
|

Re: How data entry for TURF analysis

John F Hall
In reply to this post by FRP
Have a look at the SPSS tutorials in Block 1 on my site.

http://surveyresearch.weebly.com/block-1-from-questionnaire-to-spss-saved-fi
le.html

The tutorials assume data in *.txt format, but the logic and process are the
same.  You can either enter data direct (in Data View) or read them in from
Excel etc. using the GET DATA command (Click on help > syntax reference
guide and see page 839)


John F Hall

[hidden email]
www.surveyresearch.weebly.com






-----Original Message-----
From: SPSSX(r) Discussion [mailto:[hidden email]] On Behalf Of FRP
Sent: 26 July 2011 17:34
To: [hidden email]
Subject: Re: How data entry for TURF analysis

ah yes...i use spss 18 and cant find anything in the current book of spss
18...

--
View this message in context:
http://spssx-discussion.1045642.n5.nabble.com/How-data-entry-for-TURF-analys
is-tp4635246p4635267.html
Sent from the SPSSX Discussion mailing list archive at Nabble.com.

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
Reply | Threaded
Open this post in threaded view
|

Re: How data entry for TURF analysis

John F Hall
In reply to this post by FRP

Have look at Pre-course survey of interests and experience

On the page http://surveyresearch.weebly.com/data-sets.html

 

There downloadable examples of a short questionnaire, a related data transfer sheet, the raw data set (in *.txt format) and three SPSS setup jobs to read raw data, add variable labels and then add value labels.  Each setup job creates a saved file.  There are links to all files on the page.

 

The main menu has a page for SPSS Intros and Tutorials with links to useful resources.

 

 

John F Hall

 

[hidden email]

www.surveyresearch.weebly.com

 

 

 

 

 

-----Original Message-----
From: SPSSX(r) Discussion [mailto:[hidden email]] On Behalf Of FRP
Sent: 26 July 2011 18:53
To: [hidden email]
Subject: Re: How data entry for TURF analysis

 

Hello Jon,

i am honoured to get an answer of you.

 

do you have a kind of example file which u can provide me?

...problem is i am absolutely new on spss and have no clue how to do

anything...do you know a kind of tutorial page or sth like this? ...I have

the acutal version of the spss 18 book...

 

best regards,

 

FRP

 

--

View this message in context: http://spssx-discussion.1045642.n5.nabble.com/How-data-entry-for-TURF-analysis-tp4635246p4635542.html

Sent from the SPSSX Discussion mailing list archive at Nabble.com.

 

=====================

To manage your subscription to SPSSX-L, send a message to

[hidden email] (not to SPSSX-L), with no body text except the

command. To leave the list, send the command

SIGNOFF SPSSX-L

For a list of commands to manage subscriptions, send the command

INFO REFCARD

FRP
Reply | Threaded
Open this post in threaded view
|

Re: How data entry for TURF analysis

FRP
Hello,
thanks to all the quick responses...

TY very much...
Reply | Threaded
Open this post in threaded view
|

Trouble contacting SPSS support via e-mail

King Douglas
In reply to this post by FRP
REPOSTING THIS WITH CORRECTED SUBJECT LINE

SPSS (IBM) is being hard to get.  In the old days, I used to get very prompt responses (for licenses, for instance) from [hidden email].

However, I'm recently getting no response from what appears to be their new e-mail address, [hidden email].

Any suggestions?

King Douglas
American Airlines Customer Research

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
Reply | Threaded
Open this post in threaded view
|

Reread - How can I create a case using reread?

Roberts, Michael-2
Good Morning List,

I am trying to build cases out of a file but am not very familiar with the reread function, so would appreciate any help with building cases out of raw data files with the following format:

Data are text files with variable length records - not all fields are included in each record. Fields are delimited by the hex equivalent of '1C' and sometimes fields are followed by delimited comments, so they may appear as fields as well. There does not appear to be any pattern as to where the comments appear, except they are preceded by "FY" or "FQ" and have commas, hyphens, and periods interspersed throughout.  Each record begins with a hex equivalent of '2' and ends with '3' (non printing characters); I can modify these, that is not a problem.

I have tried doing this using Input Program, but lack of familiarity with "reread", my result is not applicable to the different files having different formats - very limited!

Here is what I would like know: How would I go about looping through each record, building a case up, unless I find the comment, then reread past the comment, continue to build the case until I reach the end of the record, then reread in order to put the comment at the end of the case I am building?

TIA
Mike

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
Reply | Threaded
Open this post in threaded view
|

Re: Reread - How can I create a case using reread?

Maguin, Eugene
Robert,

I think it would be very helpful to all of us if you would post either sample
data or example (made-up but structurally the same) data, along with detailed
processing instructions. It's just too hard to visualize correctly otherwise.
However, given what you have said, in so far as i understand it, i wonder if
python will be more powerful (I assume that it can used to read a file into an
spss structure). That said, as near as i remember the reread command, it can be
used to reread the current line and, i think, the documentation (CSR not the
online version) clearly illustrates that point. It seems that you want to reread
more than the current line. A possible alternative is to read the file as text
records. Maybe each line in the input file would correspond to a spss record.
Depending on many things, you might be able to use standard spss syntax functions
to take apart a record and reassemble it correctly structured. Again, and if you
wind up going this route, i'll just bet anything that python is far more powerful
than syntax.

All that is speculation. Please post sample/example data.

Gene Maguin



On Mon 08/01/11 12:29 PM , "Roberts, Michael" [hidden email]
sent:

> Good Morning List,
>
> I am trying to build cases out of a file but am not very familiar with the
> reread function, so would appreciate any help with building cases out of
> raw data files with the following format:
> Data are text files with variable length records - not all fields are
> included in each record. Fields are delimited by the hex equivalent of '1C'
> and sometimes fields are followed by delimited comments, so they may appear
> as fields as well. There does not appear to be any pattern as to where the
> comments appear, except they are preceded by "FY" or
> "FQ" and have commas, hyphens, and periods interspersed
> throughout.  Each record begins with a hex equivalent of '2' and ends with
> '3' (non printing characters); I can modify these, that is not a
> problem.
> I have tried doing this using Input Program, but lack of familiarity with
> "reread", my result is not applicable to the different files
> having different formats - very limited!
> Here is what I would like know: How would I go about looping through each
> record, building a case up, unless I find the comment, then reread past the
> comment, continue to build the case until I reach the end of the record,
> then reread in order to put the comment at the end of the case I am
> building?
> TIA
> Mike
>
> =====================
> To manage your subscription to SPSSX-L, send a message to
> LIS
> [hidden email] (not to SPSSX-L), with no body text except
> thecommand. To leave the list, send the command
> SIGNOFF SPSSX-L
> For a list of commands to manage subscriptions, send the command
> INFO REFCARD
>
>
>
>
>

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
Reply | Threaded
Open this post in threaded view
|

Re: Reread - How can I create a case using reread?

Rich Ulrich
In reply to this post by Roberts, Michael-2
Why is there a need to do a re-read?

Read what you have as String and put the parts into a new set of variables,
placing the comments in the last variable if that is what you want;
and ignore the variables that you initially read in.  Why not?

You can apply a formatted read to any substring, if you want the
numeric translations.  That seems neater than generating a
complex format  on the fly, for re-read (if that is even possible).

When you Save File, delete the original text variable.

--
Rich Ulrich

> Date: Mon, 1 Aug 2011 12:29:05 -0400

> From: [hidden email]
> Subject: Reread - How can I create a case using reread?
> To: [hidden email]
>
> Good Morning List,
>
> I am trying to build cases out of a file but am not very familiar with the reread function, so would appreciate any help with building cases out of raw data files with the following format:
>
> Data are text files with variable length records - not all fields are included in each record. Fields are delimited by the hex equivalent of '1C' and sometimes fields are followed by delimited comments, so they may appear as fields as well. There does not appear to be any pattern as to where the comments appear, except they are preceded by "FY" or "FQ" and have commas, hyphens, and periods interspersed throughout. Each record begins with a hex equivalent of '2' and ends with '3' (non printing characters); I can modify these, that is not a problem.
>
> I have tried doing this using Input Program, but lack of familiarity with "reread", my result is not applicable to the different files having different formats - very limited!
>
> Here is what I would like know: How would I go about looping through each record, building a case up, unless I find the comment, then reread past the comment, continue to build the case until I reach the end of the record, then reread in order to put the comment at the end of the case I am building?
>


Reply | Threaded
Open this post in threaded view
|

Re: Reread - How can I create a case using reread?

Jon K Peck
REREAD is really intended for cases where there are varying record formats, and once the record type is identified, typically via a field that in the same columns for each type, you can reread that record using the appropriate DATA LIST specifications.  It doesn't sound like that is the case here.  How do you know which field is which?  Do you just split the record on hex 1C values?  Hex 1C is the ascii "file separator" character?

Just splitting the data at each x1C value would be very simple with a little Python, but it seems that you still wouldn't know which field is which.  And is each field surrounded by 1C values, or is there just one at each field boundary?  How would you declare the width of these string variables?

Jon Peck
Senior Software Engineer, IBM
[hidden email]
new phone: 720-342-5621




From:        Rich Ulrich <[hidden email]>
To:        [hidden email]
Date:        08/01/2011 07:50 PM
Subject:        Re: [SPSSX-L] Reread - How can I create a case using reread?
Sent by:        "SPSSX(r) Discussion" <[hidden email]>




Why is there a need to do a re-read?

Read what you have as String and put the parts into a new set of variables,
placing the comments in the last variable if that is what you want;
and ignore the variables that you initially read in.  Why not?

You can apply a formatted read to any substring, if you want the
numeric translations.  That seems neater than generating a
complex format  on the fly, for re-read (if that is even possible).

When you Save File, delete the original text variable.

--
Rich Ulrich

> Date: Mon, 1 Aug 2011 12:29:05 -0400
> From: [hidden email]
> Subject: Reread - How can I create a case using reread?
> To: [hidden email]
>
> Good Morning List,
>
> I am trying to build cases out of a file but am not very familiar with the reread function, so would appreciate any help with building cases out of raw data files with the following format:
>
> Data are text files with variable length records - not all fields are included in each record. Fields are delimited by the hex equivalent of '1C' and sometimes fields are followed by delimited comments, so they may appear as fields as well. There does not appear to be any pattern as to where the comments appear, except they are preceded by "FY" or "FQ" and have commas, hyphens, and periods interspersed throughout. Each record begins with a hex equivalent of '2' and ends with '3' (non printing characters); I can modify these, that is not a problem.
>
> I have tried doing this using Input Program, but lack of familiarity with "reread", my result is not applicable to the different files having different formats - very limited!
>
> Here is what I would like know: How would I go about looping through each record, building a case up, unless I find the comment, then reread past the comment, continue to build the case until I reach the end of the record, then reread in order to put the comment at the end of the case I am building?
>


Reply | Threaded
Open this post in threaded view
|

Brown-Forsythe Issue in ANOVA

Jarrod Teo-2
In reply to this post by Rich Ulrich

Hi,

I have some queries on Brown-Forsythe.

Query 1

I have an issue with ANOVA. One of my categories is having a 0 variance. Hence SPSS could not calculate the Brown-Forsythe's Statistics. The Levene Statistics showed that the homogeneity of variance was not met and hence F Statistics could not be use. I have checked and found out that the reason why one of my categories is having a 0 variance is because no respondents fell under this category. My instinct is to remove this category and perform an ANOVA again with K-1 categories. Is this a correct approach?

Query 2

My case happened because one category has 0 respondent in it and this caused the 0 variance issue. However I would like to also check if anyone had this similar issue before but under the following condition. (I kind of doubt the possibility of a 0 variance with all the categories ! having at least one respondents though.)
  1. All categories have respondents in them.
  2. At least one of the categories have 0 variance and caused SPSS unable to calculate Brown-Forsythe's Statistics. 
  3. Lastly, the work around for this situation.

Thanks.
Dorraj Oet
Reply | Threaded
Open this post in threaded view
|

Re: Reread - How can I create a case using reread?

Roberts, Michael-2
In reply to this post by Jon K Peck
Jon (and everyone else who replied with suggestions),

I have a few hundred files formatted as I described, and each one of them is different since some data elements that are included are optional while others are required.  I might add that these data are from different sources hence the difficulty with standardizing the data.

That said, these are NCPDP data files, and while I can work with one or two files (I did just that!), it would be ridiculously time consuming for me to work with each file inidividually. Anyway, I was hoping to cut down the grunge work by using some of the excellent automating syntax from Raynald's website (processing all files in folders etc.).

To answer your question - only the first four or five fields are aligned - the rest may or may not align, and from what I have read, the reread function seems to be the best bet to resolve this problem, although I would be happy for any efficient method :)

Also, the "1C" hex value (file separator) separates each field (boundary), so it is not a problem to separate the fields. The difficulty is in getting them to align in SPSS correctly.  I failed to mention that each field is preceded by a "segment identifier" such as AMx, AMxx, Fx, Fxx, etc.  However, these identifiers are only included if the data value itself is also included in the record. Therefore I felt that the reread function would be useful in building the case based on some kind of looping algorithm(?)

Finally, my apologies for not including any sample data - I will rectify that shortly, and thank you to all who have given this a little thought.

Here is what i tried first, but it failed on the very next file I tried it on!  Clunky and impossible to do for a few hundred files.


DATA LIST FILE= 'C:\DOCUMENTS AND SETTINGS\mike r\DESKTOP\HUM_20110216_20101201.txt' records=10 /

VAR1 VAR2 VAR3 VAR4 VAR5 VAR6 VAR7 VAR8 VAR9 VAR10 VAR11 VAR12 VAR13 VAR14 VAR15 VAR16 VAR17 VAR18 VAR19 VAR20 VAR21 VAR22 VAR23

VAR24,VAR25,VAR26,VAR27,VAR28,VAR29,VAR30,VAR31,VAR32,VAR33,VAR34,VAR35,VAR36,VAR37,VAR38,VAR39,VAR40,VAR41,VAR42,VAR43,VAR44

(/,1x,A11,A9,A2,A13,A10,A5,A8,A6,A4,1x,1x,A4,1x,A2,A8,1x,A3,1x,A2, A32, A4, 1x,A2,A10,1x,A2,A10,1x,1x,1x,A4,1x,A3,1x,A2,A7,1x,A4,1x,A2,A19,1x,A2,A10,1x,

A4,1x,A5,1x,A3,1x,A3,1x,A2,A8,1x,A3,2x,A4,1x,A2,A8,1x,A2,A8,2x,A4,1x,A4,1x,A12,1x).



TIA

Mike

________________________________
From: SPSSX(r) Discussion [[hidden email]] On Behalf Of Jon K Peck [[hidden email]]
Sent: Monday, August 01, 2011 10:09 PM
To: [hidden email]
Subject: Re: Reread - How can I create a case using reread?

REREAD is really intended for cases where there are varying record formats, and once the record type is identified, typically via a field that in the same columns for each type, you can reread that record using the appropriate DATA LIST specifications.  It doesn't sound like that is the case here.  How do you know which field is which?  Do you just split the record on hex 1C values?  Hex 1C is the ascii "file separator" character?

Just splitting the data at each x1C value would be very simple with a little Python, but it seems that you still wouldn't know which field is which.  And is each field surrounded by 1C values, or is there just one at each field boundary?  How would you declare the width of these string variables?

Jon Peck
Senior Software Engineer, IBM
[hidden email]
new phone: 720-342-5621




From:        Rich Ulrich <[hidden email]>
To:        [hidden email]
Date:        08/01/2011 07:50 PM
Subject:        Re: [SPSSX-L] Reread - How can I create a case using reread?
Sent by:        "SPSSX(r) Discussion" <[hidden email]>
________________________________



Why is there a need to do a re-read?

Read what you have as String and put the parts into a new set of variables,
placing the comments in the last variable if that is what you want;
and ignore the variables that you initially read in.  Why not?

You can apply a formatted read to any substring, if you want the
numeric translations.  That seems neater than generating a
complex format  on the fly, for re-read (if that is even possible).

When you Save File, delete the original text variable.

--
Rich Ulrich

> Date: Mon, 1 Aug 2011 12:29:05 -0400
> From: [hidden email]
> Subject: Reread - How can I create a case using reread?
> To: [hidden email]
>
> Good Morning List,
>
> I am trying to build cases out of a file but am not very familiar with the reread function, so would appreciate any help with building cases out of raw data files with the following format:
>
> Data are text files with variable length records - not all fields are included in each record. Fields are delimited by the hex equivalent of '1C' and sometimes fields are followed by delimited comments, so they may appear as fields as well. There does not appear to be any pattern as to where the comments appear, except they are preceded by "FY" or "FQ" and have commas, hyphens, and periods interspersed throughout. Each record begins with a hex equivalent of '2' and ends with '3' (non printing characters); I can modify these, that is not a problem.
>
> I have tried doing this using Input Program, but lack of familiarity with "reread", my result is not applicable to the different files having different formats - very limited!
>
> Here is what I would like know: How would I go about looping through each record, building a case up, unless I find the comment, then reread past the comment, continue to build the case until I reach the end of the record, then reread in order to put the comment at the end of the case I am building?
>

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD
Reply | Threaded
Open this post in threaded view
|

Re: Brown-Forsythe Issue in ANOVA

Rich Ulrich
In reply to this post by Jarrod Teo-2
For a computation formula, see
  http://en.wikipedia.org/wiki/Brown%E2%80%93Forsythe_test

Having zero cases is a design problem.   Does SPSS not drop the
missing category for you?  - Sure, drop the zero category.

The denominator is a double summation, so there is no reason for
any division by zero - that can prevent some statistics, some times.
Is the program *saying* there is a zero cell, preventing the statistic?

Saying that "F statistics could not be used" is a mis-statement, as a
generality.  The simple ANOVA tests are rather robust.

I think it was Frederick Lord who exaggerated, saying something like,
 "Using a variance test to check the validity of a t-test is like using a
canoe to check the water conditions for the safety of a liner."
That's especially true when Ns are equal, as in designed experiments.
(He wrote that in the 1950s or so, back when most data was of that kind.)

Generally, homogeneity testing is useful for moderate size samples -
ANOVA is especially robust when the Ns are large, and the
variance test at the usual nominal level will reject far too often.
And the tests have almost no power when the Ns are small.


 - More about the testing -
Sources that I read a dozen years ago, concerning the Levene test
and Student's t-test, seemed persuasive in arguing that one should
never "condition" your choice of the two t-tests on the outcome of
the variance test.  (What to do instead was less consistent.)  I believe
that applies elsewhere. 

Unequal variance may bias the result in either direction, depending on
whether the large-variance group has the large N or small N. 

As a practical matter, you should scan your data, and learn about
how it is generated; surprisingly often, dirty data needs correcting.
After that, I've avoided variance problems by using some natural
transformation, most often log or square root.

Otherwise, if you have reason to expect unequal variances, you
should expect to correct for it unless it turns out to be small enough
to ignore.

Hope this helps.

--
Rich Ulrich



Date: Tue, 2 Aug 2011 03:45:47 +0000
From: [hidden email]
Subject: Brown-Forsythe Issue in ANOVA
To: [hidden email]


Hi,

I have some queries on Brown-Forsythe.

Query 1

I have an issue with ANOVA. One of my categories is having a 0 variance. Hence SPSS could not calculate the Brown-Forsythe's Statistics. The Levene Statistics showed that the homogeneity of variance was not met and hence F Statistics could not be use. I have checked and found out that the reason why one of my categories is having a 0 variance is because no respondents fell under this category. My instinct is to remove this category and perform an ANOVA again with K-1 categories. Is this a correct approach?

Query 2

My case happened because one category has 0 respondent in it and this caused the 0 variance issue. However I would like to also check if anyone had this similar issue before but under the following condition. (I kind of doubt the possibility of a 0 variance with all the categories ! having at least one respondents though.)
  1. All categories have respondents in them.
  2. At least one of the categories have 0 variance and caused SPSS unable to calculate Brown-Forsythe's Statistics. 
  3. Lastly, the work around for this situation.

Thanks.
Dorraj Oet
Reply | Threaded
Open this post in threaded view
|

Re: Brown-Forsythe Issue in ANOVA

Bruce Weaver
Administrator
The version of that quote I know is another George Box classic.

"To make the preliminary test on variances is rather like
putting to sea in a rowing boat to find out whether
conditions are sufficiently calm for an ocean liner to
leave port!"

Box G. E. P. (1953) Non-normality and tests on variances.
Biometrika 40, 318–35.



Rich Ulrich-2 wrote
For a computation formula, see
  http://en.wikipedia.org/wiki/Brown%E2%80%93Forsythe_test


Having zero cases is a design problem.   Does SPSS not drop the

missing category for you?  - Sure, drop the zero category.

The denominator is a double summation, so there is no reason for
any division by zero - that can prevent some statistics, some times.
Is the program *saying* there is a zero cell, preventing the statistic?

Saying that "F statistics could not be used" is a mis-statement, as a
generality.  The simple ANOVA tests are rather robust.

I think it was Frederick Lord who exaggerated, saying something like,
 "Using a variance test to check the validity of a t-test is like using a
canoe to check the water conditions for the safety of a liner."
That's especially true when Ns are equal, as in designed experiments.
(He wrote that in the 1950s or so, back when most data was of that kind.)

Generally, homogeneity testing is useful for moderate size samples -
ANOVA is especially robust when the Ns are large, and the
variance test at the usual nominal level will reject far too often.
And the tests have almost no power when the Ns are small.


 - More about the testing -
Sources that I read a dozen years ago, concerning the Levene test
and Student's t-test, seemed persuasive in arguing that one should
never "condition" your choice of the two t-tests on the outcome of
the variance test.  (What to do instead was less consistent.)  I believe
that applies elsewhere.  

Unequal variance may bias the result in either direction, depending on
whether the large-variance group has the large N or small N.  

As a practical matter, you should scan your data, and learn about
how it is generated; surprisingly often, dirty data needs correcting.
After that, I've avoided variance problems by using some natural
transformation, most often log or square root.

Otherwise, if you have reason to expect unequal variances, you
should expect to correct for it unless it turns out to be small enough
to ignore.

Hope this helps.

--
Rich Ulrich


Date: Tue, 2 Aug 2011 03:45:47 +0000
From: [hidden email]
Subject: Brown-Forsythe Issue in ANOVA
To: [hidden email]









Hi,
I have some queries on Brown-Forsythe.
Query 1
I have an issue with ANOVA. One of my categories is having a 0 variance. Hence SPSS could not calculate the Brown-Forsythe's Statistics. The Levene Statistics showed that the homogeneity of variance was not met and hence F Statistics could not be use. I have checked and found out that the reason why one of my categories is having a 0 variance is because no respondents fell under this category. My instinct is to remove this category and perform an ANOVA again with K-1 categories. Is this a correct approach?
Query 2
My case happened because one category has 0 respondent in it and this caused the 0 variance issue. However I would like to also check if anyone had this similar issue before but under the following condition. (I kind of doubt the possibility of a 0 variance with all the categories !
 having at least one respondents though.)All categories have respondents in them.At least one of the categories have 0 variance and caused SPSS unable to calculate Brown-Forsythe's Statistics. Lastly, the work around for this situation.
Thanks.Dorraj Oet
--
Bruce Weaver
bweaver@lakeheadu.ca
http://sites.google.com/a/lakeheadu.ca/bweaver/

"When all else fails, RTFM."

PLEASE NOTE THE FOLLOWING: 
1. My Hotmail account is not monitored regularly. To send me an e-mail, please use the address shown above.
2. The SPSSX Discussion forum on Nabble is no longer linked to the SPSSX-L listserv administered by UGA (https://listserv.uga.edu/).
Reply | Threaded
Open this post in threaded view
|

Re: Brown-Forsythe Issue in ANOVA

Rich Ulrich
Thanks.  I'll try to remember it right, next time.

That's probably why I couldn't find it when searching for
Frederick Lord and canoe.

> Date: Tue, 2 Aug 2011 06:35:08 -0700

> From: [hidden email]
> Subject: Re: Brown-Forsythe Issue in ANOVA
> To: [hidden email]
>
> The version of that quote I know is another George Box classic.
>
> "To make the preliminary test on variances is rather like
> putting to sea in a rowing boat to find out whether
> conditions are sufficiently calm for an ocean liner to
> leave port!"
>
> Box G. E. P. (1953) Non-normality and tests on variances.
> Biometrika 40, 318–35.
>

--
Rich Ulrich
12