Re: how to get overall F-test for GLM ANOVA analysis?

Posted by Rich Ulrich on Mar 04, 2021; 1:28am
URL: http://spssx-discussion.165.s1.nabble.com/how-to-get-overall-F-test-for-GLM-ANOVA-analysis-tp5740241p5740247.html

The first thing to note is that if you are controlling for multiple

tests, you want to be specific about HYPOTHESES involved in

the particular F's.  In particular, I think you want to focus on

some MAIN hypothesis, not on the several between- and within-

factors that are there and confuse matters. (Sex or age often

account for large amounts of variance while being of no "real"

interest at all.  If that is the case, you don't want those tests.)

Personally, I tried to convince PIs to nail down no more than

about 3 "tests" that should tell them, Yes/No, "We found something."

Other partitions of variance are for "control" or for secondary

hypotheses, and the F's may be interesting but they are not crucial.

My preferred way of combining "similar" hypotheses is to construct

a composite score, and do testing on that.  For dissimilar hypotheses,

fairly unrelated, doing Bonferroni correction works about as well as

anything ... if you can't convince people that each of the tests deserve

a full 5%-alpha for consideration.

Does it make sense - to you - to control for "multiple testing" in some

version of what the reviewer suggests?  The comment, "adjusting the

p-values," makes me think he is suggesting some version of Bonferroni.

--

Rich Ulrich

---

From: SPSSX(r) Discussion <[hidden email]> on behalf of Zdaniuk, Bozena <[hidden email]>
Sent: Wednesday, March 3, 2021 6:25 PM
To: [hidden email] <[hidden email]>
Subject: Re: how to get overall F-test for GLM ANOVA analysis?

 

Hello Bruce and Others,
We conducted 5 mixed effect ANOVAS (2 within-sb factors and one btw-sb factor) and 4 RM ANOVAS (2 within-sb factors). The reviewer has asked that we control for multiple ANOVA testing by adjusting the p-values of the 'general F-test' for each ANOVA rather than adjusting the main effect or interaction effect p-values. I have searched the internet for hours and the only thing I found was someone on the stats.stackexchange talking about adjusting for multiple ANOVAS by first adjusting the 'overall F-tests" (https://stats.stackexchange.com/questions/373829/adjusting-p-values-for-multiple-anovas) but not explaining what they meant by that. In response to that message, someone further interpreted such a test as "the whole model variance compared to the null model variance" which sounds to me very much like the F-test for regression model.
This is all I have found so far...
Any thoughts on whether it's possible to get such 'general' F-test for ANOVAS? Or is the reviewer's request misguided?
Thanks so much!
Bozena

-----Original Message-----
From: SPSSX(r) Discussion <[hidden email]> On Behalf Of Bruce Weaver
Sent: March 2, 2021 7:19 PM
To: [hidden email]
Subject: Re: how to get overall F-test for GLM ANOVA analysis?

[CAUTION: Non-UBC Email]

When you say repeated measures ANOVA, do you mean that there are repeated measures factors only, or do you include so-called mixed designs in which there is at least one between-Ss factor and at least one within-Ss factor? 

Also, can you direct us to any textbooks or articles that show an overall test of the type you have in mind? 

Thanks for clarifying. 



Zdaniuk, Bozena-3 wrote
> Hello everyone,
> Is there a way to get the overall F-test of the model significance
> (equivalent to the one produced in Regression) for a Repeated Measures
> ANOVA performed using GLM in SPSS?
> Cheers,
> Bozena
>
> =====================
> To manage your subscription to SPSSX-L, send a message to

> LISTSERV@.UGA

>  (not to SPSSX-L), with no body text except the command. To leave the
> list, send the command SIGNOFF SPSSX-L For a list of commands to
> manage subscriptions, send the command INFO REFCARD





-----
--
Bruce Weaver
[hidden email]
http://sites.google.com/a/lakeheadu.ca/bweaver/

"When all else fails, RTFM."

NOTE: My Hotmail account is not monitored regularly.
To send me an e-mail, please use the address shown above.

--
Sent from: http://spssx-discussion.1045642.n5.nabble.com/

=====================
To manage your subscription to SPSSX-L, send a message to [hidden email] (not to SPSSX-L), with no body text except the command. To leave the list, send the command SIGNOFF SPSSX-L For a list of commands to manage subscriptions, send the command INFO REFCARD

=====================
To manage your subscription to SPSSX-L, send a message to
[hidden email] (not to SPSSX-L), with no body text except the
command. To leave the list, send the command
SIGNOFF SPSSX-L
For a list of commands to manage subscriptions, send the command
INFO REFCARD

===================== To manage your subscription to SPSSX-L, send a message to [hidden email] (not to SPSSX-L), with no body text except the command. To leave the list, send the command SIGNOFF SPSSX-L For a list of commands to manage subscriptions, send the command INFO REFCARD