Developments (last 20 years)




Increasing interest in and advocacy for
mixed methods
Evolving understanding of what is mixed
methods research
Developing designs and innovative
techniques
“The emergence of mixed methods as a third
methodological movement in the social and behavioral
sciences began during the 1980’s.” (Tashakkori &
Teddlie, 2003: 697)
1
Development of NIH guidelines (1999)
“Combining qualitative and quantitative
methods has gained broad appeal in
public health research.” (1999)
- Mentioned several
approaches for combining
qualitative and
quantitative research
- Advanced considerations for deciding
what model to use (literature
available, prior studies,
realistic design, expertise)
- Suggested to describe each
method thoroughly
2
Mixed Methods
Research
14+ books on mixed methods
research
have been written
since 1988
3
A New
Journal
Journals
Devoted to
Mixed
Methods:
Fieldwork
Quality and
Quantity
Mixed
Method
Approaches
Editors: John W. Creswell
and Abbas Tashakkori
Managing Editor: Vicki L.
Plano Clark
Email: vpc@unlserve.unl.edu
4
Conferences



Mixed Methods Conference, Cambridge,
England, July 21-24, 2008
Proposed mixed methods conference,
Sydney, Australia, 2009
Discipline conferences with mixed methods
papers
5
Critics (Creswell, 2007)

Is there a post-positivist leaning to mixed methods?
 Howe, K. R. (2004). A critique of experimentalism. Qualitative Inquiry,
10, 42-61.
 Giddings, L. S. (2006). Mixed-methods research: Positivism dressed in
drag? Journal of Research in Nursing, 11(3), 195-2003.
 Holmes, C. A. (2007). Mixed(up) methods, methodology and interpretive
frameworks. Contributed paper for the Mixed Methods Conference,
Cambridge, University, July 10-12, 2006.

What are the limits for mixed methods research?
 Sale, J. E. M., Lohfeld, L. H., Brazil, K. (2002). Revisiting the
quantitative-qualitative debate: Implications for mixed-methods
research. Quality and Quantity, 36, 43-53.
 Leahey, E. (2007). Convergence and confidentiality? Limits to the
implementation of mixed methodology. Social Science Research, 36,
149-158.

Is there a dominant discourse in mixed methods research?
• Freshwater, D. (2007). Reading mixed methods research: Contexts for
criticism. Journal of Mixed Methods Research, 1(2), 134-146.
6
Mixed methods is not that different
from other methods
Identifying a research problem
Reviewing the literature
Identifying a purpose
and stating questions
Collecting data
Analyzing and interpreting data
Reporting and evaluating the study
7
Mixed Methods within Designs
Ethnography
Qual ----- Quan
Case Study Research
Qual----- Quan
Narrative research
Qual-----Quan
Experimental
research
Qual---- Quan
8
What is this Method Called?










Multi-method
Triangulation
Integrated
Combined
Quantitative and qualitative methods
Multi-methodology
Mixed methodology
Mixed-method
Mixed research
Mixed methods
9
Mixing (How)
Converge data:
Qual
Results
Quan
Connect data:
Qual
Quan
Results
Embed the data:
Quan data
Qual data
10
Mixing – Why?










Validity – to corroborate quan and qual data
Offset – offset weaknesses of quan and qual and draw on strengths
Completeness – more comprehensive account that qual or quan alone
Process – quan provides outcomes; qual, the processes
Explanation – qual can explain quan results or vice-versa
Unexpected results – surprising results from one, other explains
Instrument development – qual employed to design instrument
Credibility – both approaches enhance integrity of findings
Context – qual provides context; quan provides general.
Utility – more useful to practitioners
11
Purist Stance
Smith &
Heshusius,
(1986)
“Incompatibility thesis”
“The contention of this
paper is that the claim of
compatibility, let alone one
of synthesis, cannot be
sustained.” (p. 4)
12
“Single” Paradigm Stance

Pragmatism (Tashakkori & Teddlie, 2003)
 Focus on research question
 What “works,” consequences
 Multiple methods – large toolkit

Transformative (Mertens, 2003)
 Transform lives of underrepresented, marginalized groups
 Incorporate this focus into all phases of research
13
Developing Designs and Innovative
Techniques
Key Developments






Notation
Typologies
Diagrams of procedures
Complex evaluation models
Reconceptualizing designs
Emergence of innovations in procedures
 Unusual blends
 Methodological issues
 Data analysis techniques
 Presentation techniques
14
Preliminary Design Considerations (Morse,
1991)
Approach
Type
Purpose
Limitations
Resolutions
QUAL + quan
Simultaneous
Enrich description
of sample
Qualitative sample
Utilize normative
data for
comparison of
results
QUAL
Sequential
Test emerging H,
determine
distribution of
phenomenon in
population
Qualitative sample
Draw adequate
random sample
from same
population
QUAN + qual
Simultaneous
To describe part of
phenomena that
cannot be
quantified
Quantitative
sample
Select appropriate
theoretical sample
from random
sample
QUAN
Sequential
To examine
unexpected
results
Quantitative
sample
Select appropriate
theoretical sample
from random
15
sample
quan
qual
Parsimonious Designs (Creswell & Plano Clark, 2007)
Concurrent Mixed Methods Designs
Triangulation Design
QUAN
Data &
Results
Interpretation
QUAL
Data &
Results
Embedded Design
QUAN
Pre-test
Data &
Results
Intervention
qual
Process
QUAN
Post-test
Data &
Results
Interpretation
16
Sequential Designs Mixed Methods Designs
Explanatory Design
QUAN
Data &
Results
Following up
qual
Data &
Results
Interpretation
Exploratory Design
QUAL
Data &
Results
Building to
quan
Data &
Results
Interpretation
Sequential Embedded Design
Beforeintervention
qual
QUAN
Intervention
Trial
Afterintervention
qual
Interpretation
17
Example of
A Diagram
18
Complex Mixed Methods
Evaluation Designs
(Nastasi, Hitchcock,
Sarkar, Burkholder,
Varjas & Jayasena, 2007)
Study of mental health
interventions for youth
in Sri Lanka