Two-Way Analysis of Variance

advertisement
Preparing to Present Your Summary of a Two-WayFactorial
ANOVA
The factorial ANOVA for you example may have two or more factors
(classification variables). Professor Karl wants you to focus in on only two of the
factors. Here I shall simply refer to the two factors as “A” and “B.”
You should prepare an A x B table of cell means and calculate the
marginal means. There may or not be such a table in your article. You may
have to estimate the cell means from a plot. If the statistical presentation in your
article is so poor that you are unable to do this, find another article.
When I call on you, you should be prepared to, with little delay, explain
what A and B are, what the scores are, and whether the main effect of A, the
main effect of B, and/or the interaction are statistically significant. You should be
prepared to give supporting statistics – F, degrees of freedom, and p. If reported,
you should share estimates of magnitude of effect for each of these three effects.
Then you should use the table of cell means to describe each of the significant
effects.
Be prepared to criticize the statistical presentation, if it fell short of
adequate. Were estimates of effect size provided? Were they accompanied by
confidence intervals? If the interaction was significant, were simple main effects
analyzed?
Past Examples of Independent Samples Factorial ANOVA
Published Example of Factorial ANOVA

López-Aumatell, R., Martínez-Membrives, E., Vicens-Costa, E., Cañete,
T., Blázquez, G., Mont-Cardona, C., & ... Fernández-Teruel, A. (2011).
Effects of environmental and physiological covariates on sex differences in
unconditioned and conditioned anxiety and fear in a large sample of
genetically heterogeneous (N/Nih-HS) rats. Behavioral and Brain
Functions, 7(48).
This journal is an “Open-Access” journal. Such journals are published
strictly online. The authors must pay a fee to have their manuscript published.
The fee may be small ($200) or large ($2,000 or more). The publisher has
relatively few expenses – just need to create the pdf and post it on a web server,
so the temptation is for all sorts of scam artists to set up shop publishing bogus
open access journals. I get several solicitations a week from such scammers,
inviting me to publish my work for a fee. While there are likely exceptions, one
should generally expect that articles published in open access journals are not of
high quality. The article summarized here is no exception to that rule.
The authors tested rats in an elevated zero- maze (ZM). The maze,
similar to that described by Shepherd et al [20] comprised an annular platform
(105 cm diameter; 10 cm width) made of black opaque plywood and 65 cm
above the ground level. It had two open sections (quadrants) and two enclosed
ones (with walls 40 cm height). The subject was placed in an enclosed section
facing the wall. The apparatus was situated in a black testing room, dimly
illuminated (approximately 50 lux at the level of the apparatus) with red
fluorescent light, and the behaviour was videotaped and measured outside
the(ZM-LAT), time spent in the open sections (ZM-T), number of entries in the
open sections (ZM-E), number of stretched attend postures (ZM-SAP) and
number of defecation boluses (ZM-D) were measured for 5 minutes
There were 5 levels of rat color: white, brown, black, brown spotted and
black spotted.
The interaction between color and sex was significant, F(4, ?) = 2.4, p <
.05.
Notice that the authors did not report the degrees of freedom, did not give
exact p values, and gave no strength of effect estimates. Each analysis was
based on 284 or fewer rats. Total degrees of freedom were 283 or fewer. For
each effect, the denominator degrees of freedom were less than 283. The
authors reported that the F of 2.4 was significant. The critical value of F on 4 and
200 degrees of freedom is 2.42; on 4 and 500 degrees of freedom it is 2.39. The
p is not much less than .05.
You can see the interaction in the plot above. Black bars are for
male rats, white for female rats. For every color, the male rats were more
fearful (entered fewer open sections in the maze) than the female rats, but
the magnitude of the sex difference varied across colors. That is, the
interaction is monotonic.
The authors reported having used the Duncan range test to make
multiple comparisons. I have not heard of this test in many years. It
became obsolete many years ago.

Bente, G., Feist, A., & Elder, S. (1996). Person perception effects of
computer-simulated male and female head movement. Journal of
Nonverbal Behavior, 20, 213-228.

The participants were student observers recruited from an introductory
course for psychology majors at the University of Cologne. Sixteen
female and 16 male undergraduate psychology students with a mean age
of 27.9 (SD = 7.7) took part in the study.

Observers were shown computer-simulated sequences of male and
female head movement and were asked to rate their impressions of the
computer actors on the screen. The independent factors were (1) sex of
observer and (2) sex of movement origin. The dependent variable
measured impressions of the computer actors on the screen.
Measurement of the observers' impressions of the computer-simulated
actors was based on a 27-item, seven-point, bipolar, adjective checklist
recently developed for use in media research. Were there 27 dependent
variables or were the 27 items used to compute some smaller number of
scale scores?

This was an experimental study because the independent variables were
manipulated (the sex of movement origin was switched in different
conditions). Quasi-experimental actually. One IV was manipulated
(gender of origin), but the other was not (gender of the observer).

The analysis showed male behavior in general was perceived as more
active and mobile, whether observed by men or women. The gender of
observer was significant only on rating the material exciting or boring- men
found it more boring.
Author’s statements:
The sex of observer factor revealed significant results for only one
item: boring or exciting, F(1, 28) = 5.67, p < .05. The male observers rated
the stimulus material as more boring than the female observers did (M = 0.34, SD = 0.88 for male observers; M = -0.01, SD = 0.78 for female
observers).
The effects of the sex of movement origin were the most important with
respect to our research questions. The data show that male head
movement was rated as significantly more active, F(1, 27) = 60.64, p <
.001, more mobile, F(1, 27) = 70.71, p < .001, more open, F(1, 28) = 14.24,
p < .001, and more compassionate, F(1, 28) = 20.80, p < .001, than female
head movement.
There were no significant two-way interactions between sex of observer
and sex of movement origin.
Karl’s Comments
It looks like the authors actually did 27 two-way ANOVAs. With three tests
of significance in each ANOVA, that is 3 x 27 = 81 tests. I assume the
usual .05 criterion of significance was employed, especially since one
effect is reported as significant at “p < .05” -- note that the authors fail to
give exact p values. If the truth were that there are no effects of any of the
variables studied here, one would expect in 81 tests to obtain .05(81) = 4
significant results, each of which would be a Type I error. The authors
report 5 significant effects, an outcome that would not be very surprising to
a person who believed that the variables studied do, in fact, have no
effects at all in the population.
Download