1) In a lanned study, here is a known population with a normal

advertisement
1) In a planned study, here is a known population with a normal distribution, pop
mean = 50, pop standard dev = 5. What is the predicted (standardized) effects
size (d) if the researchers predict that those given an experimental treatment
have a mean of
a) 50

 null 50  50
d  treatment

 0 ; this is no effect

5
b) 52

 null 52  50
d  treatment

 0.4 ; this is a small effect

5
c) 54

 null 54  50
d  treatment

 0.8 ; this is a large effect

5
d) 56

 null 56  50
d  treatment

 1.2 ; this is a large effect

5
e) 47

 null 47  50
d  treatment

 0.6 ; this is medium (negative) effect

5
For each part, also indicate whether the effect is approximately small, medium,
or large.
2) For each of the following studies, make a chart of the four possible correct
and incorrect decisions, and explain what each would mean.
a) A study of whether increasing the amount of recess time improves
school children's in-class behavior.
Reject H0
Fail to reject
H0
H0 is true
Incorrectly concluding that
increasing recess time does
improve children’s in-class
behavior, when it really
doesn’t
Correctly concluding that
increasing recess time does
not improve children’s in-class
behavior, when it really
doesn’t
H0 is false
Correctly concluding that
increasing recess time does
improve children’s in-class
behavior, when it really does
Incorrectly concluding that
increasing recess time does
not improve children’s in-class
behavior, when it really does
b) A study of whether color-blind individuals can distinguish gray shades
better than the population at large.
Reject H0
Fail to reject
H0
H0 is true
Incorrectly concluding that
color blind individuals can
distinguish gray shades better
than the general population,
when they really can’t
Correctly concluding that color
blind individuals can not
distinguish gray shades better
than the general population,
when they really can’t
H0 is false
Correctly concluding that color
blind individuals can
distinguish gray shades better
than the general population,
when they really can
Incorrectly concluding that
color blind individuals can not
distinguish gray shades better
than the general population,
when they really can
c) A study comparing individuals who have ever been in psychotherapy to
the general public to see if they are more tolerant of other people's upsets
than is the general population.
Reject H0
Fail to reject
H0
H0 is true
Incorrectly concluding that
individuals who have been in
psychotherapy are more
tolerant of others, when they
really aren’t
Correctly concluding that
individuals who have been in
psychotherapy are not more
tolerant of others, when they
really aren’t
H0 is false
Correctly concluding that
individuals who have been in
psychotherapy are more
tolerant of others, when they
really are
Incorrectly concluding that
individuals who have been in
psychotherapy are not more
tolerant of others, when they
really are
3) Here is information about several possible versions of a planned experiment.
Figure effect size and power for each; sketch the distributions involved, showing
the area for alpha, beta and power (Assume all populations have a normal
distribution). (I haven’t included sketches because that takes a lot longer to do
in the digital realm)
Population
A
Mean
90
Std dev
4
Predicted
Mean
treatment
91
n
alpha-level
1 or 2
tailed
100
0.05
1
B
C
D
E
F
90
90
90
90
90
4
2
4
4
4
92
91
91
91
91
100
100
16
100
100
0.05
0.05
0.05
0.01
0.05
1
1
1
1
2
NOTE: These problems use distributions of sample means rather than just
populations to compute these answers. This means that you’ll need to use the
standard error rather than the population standard deviation in the compuations
of statistical power.

 null 91  90

 0.25 ; this is a small effect
a) d  treatment

4
 critical Z for  = 0.05 & 1-tailed test is 1.645
 convert this z-score into a raw score (using the information from the
null distribution)
  90  90.66
X  Z  X    1.645  4

100 
 convert this raw score into a z-score (using the information from the
treatment distribution)
X   90.66  91
Z

 0.85
4
X
100
 using the unit normal table look up the area under the curve in the tail
for that z-score: z(-0.85) = 0.1977 = 
 Power = 1- = 1 – 0.1977 = 0.8123 or 81.23%
treatment  null 92  90

 0.50 ; this is a medium effect

4
 critical Z for  = 0.05 & 1-tailed test is 1.645
 convert this z-score into a raw score (using the information from the
null distribution)
  90  90.66
X  Z  X    1.645  4

100 
 convert this raw score into a z-score (using the information from the
treatment distribution)
X   90.66  92
Z

 3.35
4
X
100
 using the unit normal table look up the area under the curve in the tail
for that z-score: z(-3.35) < 0.001
 1977 = 
 Power = 1- = 1 – 0.001 = 0.999 or approximately 100%
b) d 
treatment  null 91  90

 0.50 ; this is a medium effect

2
 critical Z for  = 0.05 & 1-tailed test is 1.645
 convert this z-score into a raw score (using the information from the
null distribution)
  90  90.33
X  Z  X    1.645  2

100 
 convert this raw score into a z-score (using the information from the
treatment distribution)
X   90.66  91
Z

 1.7
2
X
100
 using the unit normal table look up the area under the curve in the tail
for that z-score: z(-1.7) = 0.0446
 1977 = 
 Power = 1- = 1 – 0.0446 = 0.9554 or 95.54%
c) d 
treatment  null 91  90

 0.25 ; this is a small effect

4
 critical Z for  = 0.05 & 1-tailed test is 1.645
 convert this z-score into a raw score (using the information from the
null distribution)
  90  91.65
X  Z  X    1.645  4

16 
 convert this raw score into a z-score (using the information from the
treatment distribution)
X   90.66  91
Z

 0.34
4
X
16
 using the unit normal table look up the area under the curve in the tail
for that z-score: z(-0.34) = 0.3669
 1977 = 
 Power = 1- = 1 – 0.3669 = 0.6331 or 63.31%
d) d 
treatment  null 91  90

 0.25 ; this is a small effect

4
 critical Z for  = 0.01 & 1-tailed test is 2.33
 convert this z-score into a raw score (using the information from the
null distribution)
  90  90.93
X  Z  X    2.33 4

100 
 convert this raw score into a z-score (using the information from the
treatment distribution)
e) d 
X
90.93  91
 0.175
4
X
100
 using the unit normal table look up the area under the curve in the tail
for that z-score: z(-0.175) = 0.4286
 1977 = 
 Power = 1- = 1 – 0.4286 = 0.5714 or 57.14%
Z

treatment  null 91  90

 0.25 ; this is a small effect

4
 critical Z for  = 0.05 & 2-tailed test is ±1.96
 convert this z-score into a raw score (using the information from the
null distribution)
  90  90.78
X  Z  X    1.96  4

100 
 convert this raw score into a z-score (using the information from the
treatment distribution)
X   90.78  91
Z

 0.55
4
X
f) d 
100
 using the unit normal table look up the area under the curve in the tail
for that z-score: z(-0.55) = 0.2912
 1977 = 
 Power = 1- = 1 – 0.2912 = 0.7088 or 70.88%
4) On a particular memory task in which words are learned in a random order, it
is known that people can recall a mean of 11 words with a standard deviation of
4, and the distribution follows a normal curve. A cognitive psychologist, to test a
particular theory, modifies that task so that the words are presented in a way in
which words that have a related meaning are presented together. The cognitive
psychologist predicts that under these conditions, people will recall so many
more words that there will be a large effect size. She plans to test this with a
sample of 20 people, using the alpha level = 0.01 and a two tailed test.
a) What is the power of this study?
 she is expecting a large effect size, so we will assume Cohen’s d = 0.8

 null
d  treatment
 treatment  d    null  0.8 4   11  14.2

 critical Z for  = 0.01 & 2-tailed test is ±2.58
 convert this z-score into a raw score (using the information from the
null distribution)
  11  13.31
X  Z  X    2.58  4

20 
 convert this raw score into a z-score (using the information from the
treatment distribution)
X   13.31  14.2 2.68
Z


 1.00
4
X
0.89
20
 using the unit normal table look up the area under the curve in the tail
for that z-score: z(-1.00) = 0.1587
 1977 = 
 Power = 1- = 1 – 0.1587 = 0.8413 or 84.13%
b) Sketch the distributions involved, showing the area for alpha, beta, and
power.
(I haven’t included sketches because that takes a lot longer to do in the
digital realm)
c) Explain your answer to someone who understands hypothesis testing
involving means of samples but has never learned about effect size or
power.
Using her experience with the research area, the researcher expects to
have a large effect. Using this expectation, she is able to predict the
approximate raw score mean of the treatment group. Using this
information (and information about the population standard deviation and
the number of participants in her sample), she was able to predict the
likelihood of being able to detect an effect of that size if it is present.
Download