Fraenkelch16 - 2SummersReadings

advertisement
Fraenkel- Chapter 16 (Pages 363-388)
Causal-Comparative Research
I. Causal-Comparative Research (What is it?) (p363-364)
 Investigators attempt to determine the cause or consequences of
differences that already exist between or among groups of
individuals
 Seeks to identify associations among variables
 “Because both the effects and alleged cause(s) have already
occurred, causal-comparative research is also sometimes
referred to as ex post facto (after the fact) research.
 Begins with a noted difference between two groups (such as
ethnicity), then aims to look for possible causes, or consequences
of this difference (p386)
 Sometimes ethical constraints prevent variable from being
manipulated (ex. studying the effects of a new diet on young
children)
 Different types of causal-comparative research (364)
1) Exploring the effects (dep. variables) caused by membership in
a given group
Question: What differences in abilities are caused by gender?
Research hypothesis: Females have a greater amt. of
linguistic ability than males
2) Exploration of causes (independent variable)
Question: What causes individuals to join a gang?
Research hypothesis: Individuals who are members of gangs
have more aggressive personalities than individuals
who are not members of gangs
3) Exploration of the consequences (dep. variable) of an
intervention
Question: How do students taught by inquiry method react to
propaganda?
Research Hypothesis: Students who were taught by the
inquiry method are more critical of propaganda than
are those who were taught by the lecture method.


Causal-Comparative method- frequently used to study the
difference between males and females
Limitations on this type of research: lack of control over
threats to internal validity, relationships can be identified but
causation cannot be fully established
II. Similarities and Differences between Causal-Comparative and
Correlational Research (p365)







Both examples of associational research
Both seek to explore relationships among variables
Both attempt to explain a phenomena of interest
When relationships are identified they are often studied at a later
time by means of experimental research
Difference: casual-comparative typically compares two or more
groups of subjects, correlational investigations requires a score on
each variable for each subject
Difference: Correlational investigates 2 (or more) quantitative
variables, whereas causal-compar. Involve at least 1 categorical
variable (group membership)
Difference: Correlational-analyzes data using scatterplots and
correlation coefficients, causal-compar. Compares averages and
uses crossbreak tables
III. Similarities and Differences between Causal-Comparative and
Experimental Research (365)
 In experimental – the group membership variable is manipulated, in
causal-comparative the group differences already exist
 Both: typically require at least 1 categorical variable (group
membership)
 Both: Compare group performances (average scores) to determine
relationships
 Difference: Experimental- independent variable is manipulated,
causal-compar no manipulation takes place
 Causal comparative- likely to provide weaker evidence for
causation than experimental research
IV. Steps Involved in Causal-Comparative Research (p.366-367)
 Step One: Problem Formulation
- identify and define the particular phenomena of interest
- Consider possible causes for it, or consequences of, phenomena
- Then possible causes are usu. incorporated into a precise
statement of the research problem
- Several alternative hypothesis can be tested- should be basis for
identifying the variables on which the comparison groups are to
be contrasted
- “Shotgun approach”: a large number of measures are
administered simply because they seem interesting or are
available (This much like the “shot gun wedding” is not a
preferred method)
 Step Two: Sample
-


Most important task in selecting a sample is to define carefully
the characteristics to be studied and select groups that differ in
this characteristic
- Very important to select groups that are homogeneous with
regard to at least some important variables
- Once the defined groups have been selected, they can be
matched on one or more variables- this process controls certain
variables thereby eliminating any group differences on these
variables
Step Three: Instrumentation
-There are no limits on the types of instruments that may be used
Step Four: Design
-involves selecting 2 or more groups that differ on a particular
variable of interest and comparing them on another variable or
variables
- No manipulation involved
- Groups different in one of two ways: (1) One group either
possesses a characteristic (criterion) that the other does not,
(2)The groups differ on known characteristics
- See p367 Figure 16.1- Illustrates the basic design
V. Threats to Internal Validity in Causal-Comparative Research (367-369)
 Two weakness: (1) lack of randomization (2) inability to manipulate
an independent variable
 Random assignments of groups is not possible, since groups are
already formed
 Manipulation of indep. variable is not possible because groups
have already been exposed to indep. variable
 Subject Characteristics: (368)
-Possibility of subject selection bias is a major threat
- researchers attempt to reduce this by:
1) matching subjects on a related variable(ex. students might
be matched based on GPA in a study of attitudes),
2) creating homogeneous subgroups(ex. researcher could
seek to find two groups that have similar GPAs- 3.5 GPA
or above or divide groups in low, middle, and high GPA
subgroups and then compare each subgroup –low
gpa with another low gpa group etc),
3) Statistical Matching: adjusts scores on posttest for initial
differences on some other variable that is assumed to
be related to performance on dep. variable
 Other Threats: locations, instrumentation, loss of subjects

Type Three Studies- subject to implementation, history, maturation,
attitude of subjects, regression and testing threats
VI. Evaluating Threats to Internal Validity in Casual- Comparative Studies
 Step One: Ask: What specific factors either are known to affect or
may logically be expected to affect the variable on which groups
are being compared?
 Step Two: Ask: What is likelihood of the comparison groups differing
on each of these factors?
 Step Three: Evaluate the threats on the basis of how likely they are
to have an effect, and plan to control for them.
 See Pages 369-370: for a detailed example of how threats to
subject characteristics, morality, location, and instrumentation are
evaluated in detail
VII. Data Analysis (370-372)
 First step- construct frequency polygons
 Then calculate the mean and standard deviation of each group if
the variables are quantitative
 Most common used test: t-test for differences between means
 When two or more groups are used an analysis of covariance is
particularly useful in causal-comparative studies because
researcher cannot always match the comparison groups on all
relevant variables other than the ones of primary interest
 Analysis of Covariance: provides a way to match groups “after the
fact” on such variables as age, socioeconomic status, aptitude etc.
 The results of causal-comparative studies should always be
interpreted with caution, because they are good at identify
relationships between variables but they do not prove cause and
effect
 Two ways to strengthen interpretability of causal-comparative
studies: (1) alternative hypothesis should be formulated and
investigated whenever possible (2) if dependent variables involved
are categorical the relationship among all variables in the study
should be examined using discriminant function analysis (discuss in
ch 15)
 Most powerful way to check possible causes identified is to perform
an experiment
VIII. Associations Between Categorical Variables (p372)
 Both crossbreak and contingency coefficients can be used to
investigate possible associations between categorical variables,
although predictions from cross break tables are not precise.

Fortunately, there are very few questions of interest in education
that involved 2 categorical variables
IX. An Example of Casual-Comparative Research (373-386)
 Pages 373-384 includes a research report on personal, social, and
family characteristics of angry students for your reading pleasure!
 Page 384-386: includes analysis of the study
 Here is the cliff notes version of the study:
 Purpose of study: Collect descriptive data on personal, family, peer,
and school factors associated with students manifesting angerrelated problems at school to examine the factors promoting high
levels of anger and hostility in youth and the impact of anger and
hostility upon social, behavioral, and academic functioning
 Participants: 24 high-anger elementary age students indentified
based on teacher-ratings and standardized assessments & equal
number of low-anger students who served as comparison sample,
both groups drawn from 12 elementary schools in Honolulu,HI
 Instrumentation: The BASC (Behavioral Assessment System for
Children) Aggression Subscales were used to measure teacher’s
perceptions of students’ physical and verbal aggression, SelfPerception Profiles for Children (SPP) were completed by students
 Procedure: Fifth and Sixth Grade Teachers in 12 elementary schools
were asked to nominate as many students as they wished who fit
criteria for “low” and “high” anger at school, all schools also
administered the Multidimensional School Anger Inventory, all 48
students in study were individually interviewed, completed the BASC
and SPP, teachers were interviewed, and parents were interviewed,
coding of students and likert scales were used to facilitated analysis
of qualitative data
 Results/Discussion: In general, appeared that cumulative positive
and negative experience at home, in school, and with peers have
a major impact on frequency and intensity of anger experienced at
school. (Pages 376-380- will elaborate in great detail on findings if
you are interested)
 Implications for School Counselors (page 381)
 Limitations of Study and Future Directions (382)
 Analysis of Study (page 384-386)
Download