+
Chapter 4: Designing Studies
Section 4.3
Using Studies Wisely
The Practice of Statistics, 4th edition – For AP*
STARNES, YATES, MOORE
+
Chapter 4
Designing Studies
 4.1
Samples and Surveys
 4.2
Experiments
 4.3
Using Studies Wisely
+ Section 4.3
Using Studies Wisely
Learning Objectives
After this section, you should be able to…

DESCRIBE the challenges of establishing causation

DEFINE the scope of inference

DESCRIBE data ethics in designing studies
of Inference
Well-designed experiments randomly assign individuals to
treatment groups. However, most experiments don’t select
experimental units at random from the larger population. That
limits such experiments to inference about cause and effect.
Observational studies don’t randomly assign individuals to
groups, which rules out inference about cause and effect.
Observational studies that use random sampling can make
inferences about the population.
Using Studies Wisely
What type of inference can be made from a particular study?
The answer depends on the design of the study.
+
 Scope
Example – Silence is Golden

Select
Get
all athe
random
students
sample
in your
of AP
students
Statistics
fromclass
your to
school
participate
to participate
in a
study.
in
aastudy.
study.
Ask
Randomly
them
Randomly
Thenwhether
divide
assign
assign
them
half
or not
half
of
into
the
they
of
two
students
the
study
groups
students
with
toaslisten
music
in
to Design
listen
toonmusic
and
to1.music
divide
while
them into
studying
while
studying
for
two
the
groups
for
entire
the based
entire
semester
semester
on their
and answer
have
and the
have
toremaining
this
thequestion.
remaining
half abstain
half
 With
random
selection,
results
of the study can be applied
from
abstain
listening
from
listen
to music
to music
whilethe
while
studying.
studying.
 to
With
theno
entire
random
population
selection,
– inthe
thisresults
case, of
allthe
thestudy
students
should
in the
be
 With
applied
school.
no only
random
random
Withto
selection,
nothe
selection,
random
AP Statistics
the
assignment,
the
results
results
students
of the
however,
of the
study
in the
study
can
study.
weshould
should
be applied
With
be
not
no
random
conclude
applied
to
the entire
only
assignment,
anything
population
to the AP
about
we
Statistics
–should
cause
in this and
not
case,
students
conclude
effect.
all the
in All
the
students
anything
we
study.
can at
conclude
about
With
this
cause
is
random
school.
that students
and
assignment,
With
effect.
random
at All
thishowever,
we
assignment,
school
can conclude
who
we can
listen
we can
conclude
istothat
conclude
music
APthat
Statistics
while
that
there
studying
there
is a is
students
have
cause-and-effect
a
cause-and-effect
lower
who
GPAs
listen
relationship
than
relationship
to music
those while
who
between
between
do
studying
not
listening
listening
listen
have
totomusic
lower
to
music
music
GPAs
while
while
while
than those
studying.
studying
and
We
who
GPA,
GPA
don’t
do for
not
but
know
all
listen
only
the
why
for
students
totheir
the
music
AP
GPAs
at
while
Statistics
the
are
studying.
school.
lower,
students
however.
Wewho
don’t
why and
took
part we
in the
can’t
study.
apply these results to any larger group of
students.
Using Studies Wisely
Many students insist that they study better when listening to
music. A teacher doubts this claim and suspects that listening
to music actually hurts academic performance. What can we
conclude for each design?
+
 Alterate
Challenges of Establishing Causation
Lack of realism can limit our ability to apply the conclusions of an
experiment to the settings of greatest interest.
In some cases it isn’t practical or ethical to do an experiment.
Consider these questions:



Does texting while driving increase the risk of having an accident?
Does going to church regularly help people live longer?
Does smoking cause lung cancer?
It is sometimes possible to build a strong case for causation in
the absence of experiments by considering data from
observational studies.
Using Studies Wisely
A well-designed experiment tells us that changes in the
explanatory variable cause changes in the response variable.
+
 The
Challenges of Establishing Causation





The association is strong.
The association is consistent.
Larger values of the explanatory variable are associated with
stronger responses.
The alleged cause precedes the effect in time.
The alleged cause is plausible.
Discuss how each of these criteria apply
to the observational studies of the
relationship between smoking and lung
cancer.
Using Studies Wisely
When we can’t do an experiment, we can use the following
criteria for establishing causation.
+
 The
Ethics
•
Basic Data Ethics
All planned studies must be reviewed in advance by an
institutional review board charged with protecting the safety
and well-being of the subjects.
•
All individuals who are subjects in a study must give their
informed consent before data are collected.
•
All individual data must be kept confidential. Only statistical
summaries for groups of subjects may be made public.
Using Studies Wisely
Complex issues of data ethics arise when we collect data from
people. Here are some basic standards of data ethics that
must be obeyed by all studies that gather data from human
subjects, both observational studies and experiments.
+
 Data
+
Section 4.3
Using Studies Wisely
Summary
In this section, we learned that…

Inference about the population requires that the individuals taking part in a
study be randomly selected from the larger population. A well-designed
experiment that randomly assigns treatments to experimental units allows
inference about cause-and-effect.

Lack of realism in an experiment can prevent us from generalizing its results.

In the absence of an experiment, good evidence of causation requires a strong
association that appears consistently in many studies, a clear explanation for the
alleged causal link, and careful examination of possible lurking variables.

Studies involving humans must be screened in advance by an institutional
review board. All participants must give their informed consent, and any
information about the individuals must be kept confidential.
+
Looking Ahead…
In the next Chapter…
We’ll learn how to apply the mathematics of chance as
a basis for inference.
We’ll learn about
Randomness and Probability
Simulations
Probability Rules
Conditional Probability and Independence