Integrative mixed-methods research: A workshop.

advertisement
P154
Theory, Methods and Applications
Felipe González Castro, M.S.W., Ph.D., Professor
Department of Psychology and Southwest Interdisciplinary Research Center
Arizona State University,
&
Tanya Nieri, Ph.D., Assistant Professor
Department of Sociology, University of California Riverside
Presentation at the Hispanic Health Disparities Research Center, University of Texas at El Paso,
August 14, 2009, El Paso, TX
I
Purpose of This Workshop
* The purpose of this workshop is to introduce and
illustrate an Integrative Mixed-Methods (IMM)
approach, and to allow participants to utilize this
approach in their own research.
* This includes:
* Introducing conceptual, methodological, and
applied issues
* Understanding the strategy for integrating
qualitative and quantitative evidence (data)
* Discussing and illustrating data analytic and
interpretive approaches
* Describing and illustrating the IMM
methodology including practice exercises
Overview of Workshop Objectives
1. To provide a framework for understanding the IMM
approach
2. To review issues in the conceptualization and
measurement under the IMM approach
3. To examine research design and implementation
issues
4. To offer interactive question-and-answer periods to
discuss issues in the application of the IMM
approach.
5. To present practice exercises in the use of the IMM
methodology.
Strengths of Quantitative and Qualitative Approaches
* Qualitative
* Rich details of a phenomenon under
study
* Contextualization
* Meaning and interpretation
* Quantitative
* Valid and reliable measurement
* Assessment of strength of associations
* Group comparisons
* Hypothesis testing
Advantages of Mixed-Methods Approaches
* Aims of general mixed-methods approaches
are to obtain “the best of both worlds” by
using both qualitative and quantitative
procedures within a single study (Bryman,
2007).
* Limitations of quantitative only studies
* Measurement decontextualizes
evidence
* Results may be precise, but nevertheless
lacking in explanatory power.
Bryman, A. (2007). Barriers to integrating quantitative and qualitative research. Journal of Mixed Methods
Research, 1, 8-22.
Limitations of Qualitative and Quantitative Approaches
* Limitations of qualitative only studies
* Difficulties in integration across cases
* Cannot examine strength of associations
among variables
* Conclusions are suggestive, not
confirmatory
* Small sample sizes greatly limit
generalizability and applicability.
* Limitations of sequential mixed-methods
designs
* (Bryman, 2007)
Bryman, A. (2007). Barriers to integrating quantitative and qualitative research. Journal of Mixed Methods
Research, 1, 8-22.
Advantages of Mixed-Methods Approaches
* Integrative Mixed-Methods aims to be a “best
combination” design
* Strength of confirmatory results derived from
the quantitative analyses
* Deep-structure explanatory descriptions from
analysis of the qualitative text narratives
* Offers a concurrent and integrative
methodology for rigorous analyses that aim to
attain, “the best of both methodologies: An
integrative QUAL+QUANT design (Castro,
Kellison, Boyd & Kopak, under review).
Castro, F. G., Kellison, J., Boyd, S., Kopak, A. (under review). A methodology for conducting integrative
mixed-methods research and data analyses.
Specific Gains from the IMM Approach
* Allows greater authenticity in the study of culture,
cultural nuances
* Facilitates a “deep-structure” study of complex
constructs
* Acculturation: A complex process of culture
change
* Traditionalism: Core cultural orientations and
values that persist across time
* Cultural Gender Roles: Machismo,
Marianismo
* Cultural Identity: Mexican, Mexican American,
Puerto Rican conceptions and feelings about
that identity.
Specific Gains from the IMM Approach
* Allows process analysis of
developmental sequences
* Short-term coping processes
* Longer-term developmental effects
* Allows analysis of complex emotional
states
* Ambivalence: The mixed emotion
* Complex emotional states: Depression
with anger vs. depression with anxiety
Specific Gains from the IMM Approach
*
Allows discovery of new aspects not previously identified
*
Can recontextualize results of quantitative analyses
adding depth of meaning
* Recontextualization “relates results of data
analyses to their original context and lends depth
of interpretation to the quantitatively derived
results.” (Castro et al., under review; Castro &
Coe, 2007).
*
Storylines: Allow deep-structure analysis of quantitative
results by generating a descriptive story from the
narratives of specific cases
* The text narratives of contrasting groups of cases
can used to develop storylines.
II
Major Assumptions
1. Broad conception of measurement
(“integrative qual-quant” approach): Two
forms of research evidence
2. Focusing the method- Format of the focus
question
3. Independence of observations/cases: A
“Focus Group of One.” Unit of analysis is
individual case.
Creswell, J. W., Plano Clark, V. L., Gutmann M. L., & Hanson W. E. (2003). Advances in mixed methods
research designs. In A. Tashakkori & C. Teddle (Eds.), Handbook of mixed methods in social and
behavioral research (pp. 209-240). Thousand Oaks, CA: Sage.
Major Assumptions
4. Recurring themes exposed independently
reflect consensual “cultural expressions”
(beliefs, perceptions, attitudes, values) that
exist within a local community
5. Rigor is essential in qualitative (and
quantitative) design and analyses
6. “Concurrent Qual-Quant Design” allows
transfer across evidence domains
Creswell, J. W., Plano Clark, V. L., Gutmann M. L., & Hanson W. E. (2003). Advances in mixed methods
research designs. In A. Tashakkori & C. Teddle (Eds.), Handbook of mixed methods in social and
behavioral research (pp. 209-240). Thousand Oaks, CA: Sage.
Conceptual Framework for IMM Research
Castro, F. G., & Coe, K. (2007). Traditions and alcohol use: A mixed-methods analysis. Cultural Diversity
and Ethnic Minority Psychology13. 269-284. ,
Conceptual Framework for IMM Research
7. Parallelism between qualitative and
quantitative
* “The greater the quantitative-qualitative
parallelism incorporated a-priori into a study
design, the easier it will be to transform and
transfer the textual and numeric forms of
evidence.” (Castro et al., under review).
8. Unified conceptualization of information as
research evidence with verbal and numeric
forms
Castro, F. G., Kellison, J., Boyd, S., Kopak, A. (under review). A methodology for conducting integrative
mixed-methods research and data analyses.
Conceptual Framework for IMM Research
* Focus on a core construct, e.g.,
traditionalism or machismo
* Six stages of an IMM research study
* Can examine relationships among variables,
e.g., convergent and discriminant validity of
constructs, both for those quantitatively
measured (scales) and those qualitatively
constructed (thematic variables) (Castro et
al., under review).
Castro, F. G., Kellison, J., Boyd, S., Kopak, A. (under review). A methodology for conducting integrative
mixed-methods research and data analyses.
Limitations of the IMM Method
*
Newly generated thematic variables are sample
specific
*
The quality of probing influences narrative production
and depth
*
Face validity of the constructed thematic variables; are
they valid beyond face validity, e.g., construct validity?
*
Focus question approach suited to some, but not all,
research questions
*
IMM is an emerging and evolving methodology with
some issues still being addressed and resolved.
Deep Structure in Cultural Research
*
“Culture” is a complex entity with many conceptions
and definitions (Baldwin & Lindsey, 1994).
*
Scientific research that effectively addresses cultural
issues must recognize the complexity of culture, and
conduct a “deep structure” approach (Resnicow,
Braithwaite, Ahluwalia, & Butler, 2000) to the study of
cultural effects and cultural contexts.
*
How can we integrate quantitative and qualitative
evidence and methods into an integrative
methodology that also constitutes sound science?
* Baldwin, J.R., & Lindsley, S.L. (1994). Conceptualizations of culture. Tempe, AZ: Arizona State
University.
* Resnicow, K., Soler, R., Braithwaite, R. L., Ahluwalia, J. S. & Butler, J. (2000). Cultural sensitivity in
substance use prevention. Journal of Community Psychology, 28, 271-290.
Aims in Deep Structure Cultural Research
* To generate recurring thematic content derived
inductively across cases, and from open-ended
responses to one or more focus questions
(group-related thematic categories).
* In a “focus group of one,” each focus question
introduces a topic area, e.g., “What is a real
macho like? A real macho is: ________,
which allows rich responses to that question.
* Independent interviews (independent data points)
allow the statistical analysis of inductively
constructed thematic variables.
Explanatory Power and Process Analysis
* Simple “cultural indicators” e.g.,
race/ethnicity (Hispanic/Latino, nonHispanic white, Black) even in large
sample epidemiologic studies may offer
high “predictive power” (power to
detect or relate) but often yields low
“explanatory power.”
* The meaning of a statistically-significant
association may be limited.
Ecological Contexts
* Context :
1. refers to “…surrounding conditions that
can affect a specific process or outcome
(Castro, Shaibi & Boehm-Smith, 2009,
p. 91).
2. refers to “conditional effects… a health
outcome is dependent on the particular
level of a specific or controlling
condition that affects the outcome.”
3. characteristics or conditions “can temper
or even modify the meaning of [an] event.”
Castro, F. G., Shaibi, G. Q., & Boehn-Smith, E. (2009). Ecodevelopmental contexts for preventing type 2
diabetes in Latino and other racial/ethnic minority populations. Journal of Behavioral Medicine, 32, 89-105.
Ecodevelopmental Model
* Sociocultural contexts are
“surrounding” macro-level
environmental influences that can
influence or otherwise modify the
meaning of a micro-level event (an
event at the biological, personal, or
familial levels).
An Ecodevelopmental Temporal Effects Model
Castro, F. G., Shaibi, G. Q., & Boehn-Smith, E. (2009). Ecodevelopmental contexts for preventing type 2
diabetes in Latino and other racial/ethnic minority populations. Journal of Behavioral Medicine, 32, 89-105.
An Ecodevelopmental Temporal Effects Model
Castro, F. G., Shaibi, G. Q., & Boehn-Smith, E. (2009). Ecodevelopmental contexts for preventing type 2
diabetes in Latino and other racial/ethnic minority populations. Journal of Behavioral Medicine, 32, 89-105.
Aims of the Integrative Mixed Methods Approach
* In addition to generating specific
confirmatory results, the integrative
mixed-methods approach aims to
generate results rich in explanatory
power:
A more complete explanation of:
* A complex construct
* A sociocultural process
* Complex interaction effects
Castro, F. G., Kellison, J., Boyd, S., Kopak, A. (under review). A methodology for conducting integrative
mixed-methods research and data analyses.
Assumptions and Approach
* The mixed-methods approach (Creswell et al,
2003; Hansen et al, 2005) can be more
informative in identifying person x situation
aspects of health (Creswell et al., 2003; Hansen
et al., 2005).
* As applied to health research, the mixed methods
approach can uncover previously undetected
thematic patterns that exist within special
populations.
* Creswell, J. W., Clark, V. L. P., Gutmann, M. L., & Hanson, W. E. (2003). Advanced mixed methods
research designs. In A. Tashakkori & C. Teddle (Eds.), Handbook of mixed methods in social and
behavioral research (pp. 209-241). Thousand Oaks, CA: Sage.
* Hansen, W. E., Creswell, J. W., Clark, V. L. P., Petaka, K. S., & Creswell, J. D. (2005). Mixed
methods research designs in counseling psychology. Journal of Counseling Psychology, 52, 224-235.
Starting with an Appreciation for Culture
* Value of cultural factors as an important in
scientific research, especially with special
populations.
* Devaluing cultural factors promotes culturallyshallow research.
* Incorporating cultural factors from the beginning; at
the stage of research conceptualization and
design.
* Need rigor in both the design and implementation
of qualitative and quantitative aspects of the
research study.
Machismo & Marianismo: Complex Cultural Constructs
* Machismo - A traditional Latino gender role
orientation that emphasizes male
dominance and privilege as a proper form
of male conduct.
* Marianismo - A traditional Latino female
role orientation that emphasizes motherly
nurturance, and the demure and pure
identity of a virgin (Virgin Mary) as a proper
form of female conduct (Paniagua, 1998).
Paniagua, F. A. (1998). Assessing and treating culturally diverse clients: A practical guide (2n ed).
Thousand Oaks, CA: Sage.
III
Design Guidelines
* Parallelism in a unified conceptualization of
research evidence as numeric and text narrative
formats.
* Explicitly integrative design; emphasizes the
linkage and interchange of qualitative and
quantitative data (Bryman, 2007).
* Purposive sampling; sample size ranging from 40
to 200.
* Concurrent (QUAL+QUANT) design (not
sequential).
Bryman, A. (2007). Barriers to integrating quantitative and qualitative research. Journal of Mixed Methods
Research, 1, 8-22.
Parallel Design Elements
* Qualitative: Clear and specific focus
questions aid in generating specific and
informative narrative content that is obtained via
individual open-ended interviews.
* Quantitative: A sound choice of measured
variables allows the measurement of
complementary scaled variables.
* This allows the conduct of convergent and
discriminant validity (statistical
triangulation) using planned correlational
analyses.
Balancing Specificity with Rich Complexity
* Quantitative measured variables (scales)
generate specific scores but may be shallow
in content.
* Qualitative responses (thematic categories)
may be rich in content, but may be nonspecific.
* The integrative mixed methods approach aims
to attain the best of both approaches under a
unified, rigorous and informative
methodology.
Rigor in Design and Implementation
* Individual focus question interviews, and thus
independence of observations/cases, allows
statistical analysis of data.
* Can evaluate the strength of association
among measured variables (from scales) and
among thematic variables (constructed from
thematic text analysis).
* Statistical triangulation can be conducted
from correlational analyses of measured
variables and thematic variables.
Six Steps in the IMM Approach
1. Create focus question and conduct
interviews (COLLECTION)
2. Extract response codes from interview
transcripts (CONVERSION)
3. Create thematic categories – “families”
(CONVERSION)
4. Assign axial codes to create thematic
variables (CONVERSION)
5. Conduct integrative data analysis
(ANALYSIS)
6. Create storylines – recontextualize
(INTERPRETATION)
Conceptual Framework for IMM Research
Castro, F. G., & Coe, K. (2007). Traditions and alcohol use: A mixed-methods analysis. Cultural Diversity
and Ethnic Minority Psychology13. 269-284. ,
Focus Questions - Machismo Beliefs and Identity
Who You Are and Where You are Going:
PLATICA - HISPANIC LEADERS
(Version 12a, ENGL 4-11-06)
IDNo. ____________
Today’s Date: _____________
Start Time: ________
Please answer these questions honestly on how you feel and what you think. The best answers are
those which tell exactly what you think and feel.
III. Gender Identity
3a. Male and Female Traits. Within the Latino/Hispanic cultures and in other parts of
the world, men are often described as being “manly” or “macho” and women are
often described as being “feminine.”
1a.
Please tell me what a real “macho” man is like (their traits or characteristics).
Tell me more.
1b.
How much do you identify with this form of being macho?
2.
Now, please tell me what a woman is like who is very “feminine” or
“motherly.” Tell me more.
Step 1. Focus Questions
* Are brief, personalized, and prompt a specific and
“focused” response.
* Can be framed in a sentence completion format:
“How do you think about (conceptualize)
acculturation as it occurs among Latino
populations?
1a. “Acculturation is: ___________.
1b. “Acculturation” is best studied by: _______.
* Must be designed based on a theoretical
orientation or conceptual framework, and must
be clearly constructed to aid in generating
interpretable responses.
Step 1. Focus Questions
* A well constructed focus question
introduces a topic area, and
prompts clear and specific
responses, while also allowing a
diversity of responses whereby
this, “allows the voices of the
participants to be heard.”
Text Analysis Flow Chart
Overview of the Text Analysis Flow Chart
1. Response narratives ( Ri )
* Participants’ complete or full responses to the
focus question.
2. Response codes ( Cj )
* Specific portion of the participants’ responses to the
focus question.
3. Thematic categories - “Families” ( Fk )
* Sets of response codes that have a common
meaning; coded as mentioned=1, not=0.
4. Thematic variables ( Vl )
* Axial coded thematic categories that are converted
into numeric data.
Some Points Regarding Transcription
Transcription Procedures
1. Access the transcription template file.
2. Transcriptions:
A. Do not type out the main interviewer probes.
B. Do type the additional probing questions used by the
interviewers.
C. Use “P:” and “I:” to indicate whether the participant or
interviewer are the speakers.
D. Go for meaning over exact words and utterances, while still
capturing the main message expressed by the participant.
E. Notation you may need:
a. If you can’t decipher a word or phrase at all, use: [unclear].
b. If you have an important comment or observation to make
about an event occurring within the tape, please indicate
your comment within brackets, for example: [The participant
cries at this point].
3. If you encounter problems or some notable issues, please add these
comments to your weekly report of progress.
About Atlas.ti
*
Atlas.ti is a multi-purpose qualitative analysis program
that, “helps you uncover the complex phenomena hidden
in your data.” (Atlas.ti, 2009).
*
Analysis capabilities include:
* Text search tool with search and retrieve functions
* Interactive boxes allowing “drag and drop”
* Automatic and interactive forms of coding
* A “family manager” for creating and managing
thematic categories (families)
* A filter tool to select subsets of text information
* Export capabilities to SPSS, Excel, and for other
programs
*
Web link: http://www.atlasti.com/
http://www.atlasti.com/quicktour.html
Step 2. Response Codes
*
A response code is linked to the participant’s Case ID
Number.
*
[T599] A macho is a man who protects his family from
harm and also provides for them.
*
A response code is the specific answer (a quotation
excerpt) to the focus question, as contrasted with:
* incidental comments or statements that do not directly
answer the focus question
* a label that summarizes the content of the response
*
Each case can have zero, one, two, three or more
response codes.
Step 2. Response Codes – Types of Codes
* Atlas.ti offers three basic types of coding:
* Open Coding - codes highlighted text and
allows adding to it a descriptive label
* Code by List - Uses previously created
codes in coding a new set of text
* Code in Vivo (In Vivo Coding) - Selected
text is registered as a “quotation” and used
as a “code,” thus capturing a specific
statement as given by a respondent.
Step 2. Response Codes
* In-vivo coding of responses to focus question:
* Two independent coders identify specific
thematic response codes to the focus
question producing inductively identified
relevant responses .
* List of responses is compared across
raters (inter-rater reliability) and finalized via
comparison and consensual
agreement.
* A final listing is attained of thematic
response codes to the focus question.
Step 3. Thematic Categories
* The thematic response codes are
organized into the smallest number of
distinct thematic categories
(“families” in Atlas.ti).
* Inductive “bottom-up” or “inside
out” coding is drawn directly from
participants’ thematic response codes
* “Participants’ voices are heard.”
Step 3. Thematic Categories
* The aim is to generate “strong
families:” families having with a large
number (or percentage) of
responses/cases that mention that
theme
* Strong families have over 20% of all
cases mentioning that theme, and
ideally responses range from 30% to
70%.
Atlas.ti Response Code Listing
Listing of Response Codes
Code Family: 1b. “How much do you identify with this form of being
_____________________________________________________________
HU:
Master Machismo Codes 1a
File:
[I:\1-MY FILES\a-PRESENTATIONS\P154 - Integrative Mixed-Methods Wor...\
Master Machismo Codes 1a.hpr5]
Edited by:
Super
Date/Time: 08/11/09 11:34:58 AM
_____________________________________________________________
Created: 04/07/09 05:58:57 PM (Super)
Codes (33):
[T508: I think I would fit the Hispanic, or the Mexican’s description of macho [family orientated]]
[T510
[T510
[T510
[T510
[T510
macho?”
A lot]
Especially within the family]
I think it is a part of my identity of being an encourager]
I try to promote that within my family]
Yes, I identify with that totally]
[T513 As the oldest one, I had certain responsibilities in terms of looking out for your brothers and sisters and
your mom]
[T517 I’m macho in the way that I define macho [honorable, responsible, respectful toward women, courageous]]
[T531 From a correct way, very definitely.]
[T531 I feel that I provide for my family, and my kids,]
[T531 Meet your responsibilities, don’t hang out in the bar drinking beer]
[T532 I strive to be macho in that sense, providing for my family.]
[T533 Cares about his family]
[T533 More of a gentleman, than macho]
Families
Description
Machismo
Identity
Developmental
identity: Negative
to positive
Exemplar Response
How do you relate to this form of being macho?
Developmental trajectory
that starts out with negative
traits and then grows into
positive traits.
“You kind of have to as a young kid growing up. You believe that myth of
macho, you act that way. Then you see the light and realize you don’t have to
be, that’s me.”
Denies negative
traitsa
“I am not that way [negative traits] at all.”
Denies positive
traitsa
“I don’t have any of those, I fight, drink, and I don’t care. It’s easy for a man.”
Identifies as a
man/male roles
Does not identify as macho,
but more of a man—male
traditions and roles
(gentlemen)
“I like being a man, I wouldn’t say macho, I like cars and taking care of my
girl.”
Family oriented
Support, care, and protect
the family
“I work hard and take care of my responsibilities; my family is everything to
me.”
Both positive &
negative traitsa
“I know I have my moments, but for the most part I am this guy [positive
traits].”
Control/domination
“I’ve been tough and dominating, I like to be the boss.”
a
Respectful/egalitari
an toward women
Shares household
responsibilities with wife
and is respectful
“I let her lead too and I don’t mind doing housework, I don’t disrespect her
either.”
Situational
assertiveness/aggr
ession
Times when you have to
be aggressive (e.g. prison,
emergencies, protect
others)
“Sometimes you have to be aggressive; like in a fire you can’t get a
consensus. You have to yell and make people get out.”
Tries to control
negative traitsa
“I try not to be a macho [tough guy], but there are times when I let my guard
down and I can hold grudges forever.”
Step 4. Axial Coding to Create Thematic Variables
* Axial coding dimensionalizes the thematic
category
* Axial coding is a Grounded Theory
technique (Strauss & Corbin, 1990).
* Converts a thematic category (0= not
mentioned, 1= mentioned) to a thematic
variable (0,1,2,3).
* Frequency Axial Codes: (0= no mention, 1= 1
mention, 2= 2 mentions, 3= 3 or more
mentions).
Strauss, A. & Corbin, J. (1990). Basics of qualitative research: Grounded theory procedures and
techniques. Newbury Park, CA: Sage.
Step 4. Axial Coding to Create Thematic Variables
* Intensity Axial Codes:
0 =not mentioned,
1 = suggested mention,
2 = solid mention,
3 = emphatic mention).
* From the actual narratives or codes within
each category, identify example narratives or
codes that can be used as anchor codes to
guide the ratings of all other narratives.
Strauss, A. & Corbin, J. (1990). Basics of qualitative research: Grounded theory procedures and techniques.
Newbury Park, CA: Sage.
Step 4. Axial Coding to Create Thematic Variables
* Exemplar anchor codes:
Example: “Physically controlling and
abusive” family
1 = suggested mention
* “He tries to tell his family what to do”
2 = solid mention
* “He is aggressive with his family.”
3 = emphatic mention
* “He is very aggressive and
intimidates the entire family.”
A Case-Theme Axial Coding Matrix for Machismo
Controlling
Positive &
Negative
Controls
Negative
Situational
Aggression
Respectful
Family
Oriented
501
0
1
1
1
0
0
503
0
0
3
0
0
0
504
1
1
0
0
0
0
506
1
3
0
1
1
0
507
2
0
1
0
0
0
508
2
0
0
0
0
0
512
2
1
0
0
3
0
513
0
2
0
0
0
0
514
0
0
0
3
0
2
515
0
0
0
1
0
0
“
“
“
“
“
“
“
523
2
0
0
0
0
0
533
2
0
1
0
0
0
534
0
1
1
0
0
0
536
0
1
0
0
0
0
540
0
1
0
0
0
0
Text Analysis Flow Chart
Step 5. Mixed-Methods Data Analyses
* Frequencies to examine distributional
properties of the thematic variables
(Skew and kurtosis).
* Exploratory Factor Analysis
* Identified underlying structure of the
set of thematic variables
* The thematic variables loading on
each factor can create factor
scores (factor variables) for
subsequent multivariate analyses.
Factor Analysis of the Machismo Thematic Variables
Variable
Factor 1a Factor 2b
Controlling and dominating
.79
Has both positive and negative
.74
Tries to control negative traits
.68
Situational aggression, assertiveness,
control
.64
Developmental: Once negative now
positive
.48
Denies negative traits
-.44
-.37
Respectful/Egalitarian toward women
.75
Denies positive traits
-.65
Identifies as a man/male role
.39
Family oriented
.37
Kellison, J. G. (2009). The role of machismo in the resilience of Hispanic males. Master’s Thesis,
Arizona State University. Tempe, AZ: Author.
Step 5. Mixed-Methods Data Analyses (continued)
* Correlational Analyses
* Associations between and across
variable types (thematic variables with
scaled variables)
* Hierarchical Model Regression Analyses
* Measured variables and thematic
variables as predictors of key dependent
variable
* Can use thematic variable factor scores
as predictors.
Step 5. Mixed-Methods Data Analyses (continued)
Descriptive statistics and zero-order correlations for identity variables.
Variable
1
2
3
4
5
6
7
8
1. Control identitya (Factor Score I)
2. Caballero identitya (Factor Score II)
-.15
3. Positive machismo attitudes:
Family orientedab
.20
-.03
4. Negative machismo attitudes:
Stereotypical controlc
-.03
-.04
-.32*
5. Incomea
.05
.26
.04
.39**
6. Clinical resilience ratingsa
.10
.29*
.01
.36**
.56**
7. CD-RISC resiliencea
.04
.29*
.30*
-.21
.40**
.52**
8. Life satisfactiona
.01
.12
-.32*
.52**
.61**
.79**
4.22
.42
1.94
.50
11.0
4.89
3.58
1.54
3.95
.59
.41**
M
SD
0.00
1.00
0.00
1.00
3.70
.76
Note. Variables included here are those for thematic machismo identity, Rollins-Castro Multidimensional Machismo Inventory,
machismo attitudes, income, resilience, and life satisfaction; N = 52. aHigher scores indicate higher levels of the construct;
bHigher scores indicate greater family orientation; cHigher scores indicate greater stereotypical control. *p < .05; **p < .01.
Predictors of Life Satisfaction
B
SE
β
.08
.02
.52***
Income
.07
.02
.47**
Family oriented measured attitudes
.12
.23
.07
Stereotypical dominant measured attitudes
-.18
.21
-.12
Income
.06
.02
.38**
Family oriented measured attitudes
.12
.23
.07
Stereotypical dominant measured attitudes
-.21
.21
-.14
Controlling/Assertive (Control Identity)
.02
.09
.03
Caballerismo/Gentleman
(Caballero Identity)
.24
.09
.31*
Regression step
Step 1
Income
Step 2
Step 3
Note. N = 52. R2 = .27 for Step 1; R2 = .02 for Step 2; and R2 = .09 for Step 3. *p < .05; **p < .01;
***p < .001.
Step 6. Recontextualizing and Storylines
* Features integration of results, with final
storyline, based on text narratives and
quotes to add depth to results generated
from correlational, regression, or other
multivariate analyses.
* Aim: To capture group’s collective story in
response to a specific issue by examining
quotes from cases loading high and low
on identified key variables.
Step 6. Recontextualizing and Storylines
* Analysis of Contrasting Groups
* Adaptive (High Resilience) cases
* Maladaptive (Low Resilience)
cases.
* Or cases high and low on an
outcome variable, e.g., Life
Satisfaction scale
* The contrasting set of narratives
capture group differences in
responses to the focus question.
Step 6. Recontextualizing and Storylines
* Examine thematic responses for
cases from each group and develop a
storyline for each
* Then compare and contrast
extreme group cases to create
storylines and to draw conclusions
on the influences of a key variable
on group-related patterns of
response.
Step 6. Recontextualizing and Storylines
* Example:
* High/positive: “For me it’s like acting
like a gentleman.”
* Low/negative: “I’m lazy, I’m selfish,
I have a short fuse.”
Storyline Analysis of Extreme Group Cases
Storylines of Participants’ Five Highest Life Satisfaction to Five Lowest Life Satisfaction Responses.
Case Number
Life Satisfaction
Score
Quoted Statement for Machismo Beliefs
Quoted Statement for Machismo Identities
T533
2.17
“He doesn’t abuse his wife,” “takes care and
provides for his family.”
“I care about my family,” “For me it’s acting
like a gentleman”
T547
1.57
“They need to respect women,” “Respect,
support, and protect family.”
“I’m respectful of women,” “I never bring
shame to the family”
T564
1.50
“Being strong and supporting the family”
“I do my best to take care of my family”
T743
1.48
“They beat women and are not sensitive—
too macho to tear up.”
“I treat women with respect and don’t beat
them.”
T771
1.42
“A hard worker bring home bacon, but like
women to stay home and serve him.”
“I bring home money and make sure there
is food on the table”
T504
-.75
“Self-absorbed male who thinks of himself
first,” “Provides and protects the family.”
“I try not to identify with the negative at all.”
T788
-.76
“takes care of family,” “cares for his kids,”
“do anything it takes to protect/survive.”
“I’m not fully macho yet.”
T586
-.80
“maintains the household and supports the
family,” “controlling,” “goes drinking.”
“I identify with being both a tyrant and
supporting my family”
T507
-1.02
“A person who doesn’t self-reflect.”
“I’m aggressive when it comes to play in
certain situations, I was very competitive in
sports.”
T812
-1.04
“Badass, wears a mask, he is fake.”
“I feel like a badass.”
Highest
Lowest
V
Exercises on Thematic Analysis of Evidence
*
Purpose: To illustrate the use of an integrative
mixed methods approach for identifying thematic
content and its response codes from open-ended
responses to a specific focus question
*
Task: Using worksheets, identify thematic response
codes and then categories (cluster) into Thematic
Categories
*
Consider what patterns may emerge which after
axial coding, could generate a set of thematic
variables, usable in correlational and regression model
analyses
*
Consider the storyline that might emerge from
the overall analysis of these responses
Exercises on Thematic Analysis of Evidence
Exercise on Thematic Analysis
* There are three steps in thematic coding that
converts verbal evidence into numeric evidence
within the integrative mixed-methods approach,
as illustrated by this Thematic Text Analysis: A
Flow Chart.
* The four forms of verbal evidence are:
(1) Responses to the focus question,
(2) Thematic response codes identified
from the response narratives
(3) Created thematic categories, and
(4) Thematic variables generated via
the process of axial coding.
Exercise # 1
Exercise # 1. Creating a Focus Question
Your Research Study
PLATICA - FOCUS QUESITONS
(Version 1a, ENGL 8-14-09)
IDNo. ________
Today’s Date: _________
Start Time: ________
Please answer these questions honestly on how you feel and what
you think. The best answers are those which tell exactly what
you think and feel.
I. Ethnic Identity
1. Ethnic or Cultural Identity. Many people in America can claim a
certain ethnic, cultural or familial heritage. This heritage affects how
people see and identity themselves, that is, their “ethnic or cultural
identity.”
1a.
1b.
2.
Exercise # 2
Exercise #2 - Creating “Families” - Thematic Codes
Response Codes Listed by Case ID
[T502 I have been in fights…but I have always won]
[T504 I’ve tried to work to cast aside a lot of that inherited culture
that a lot of Mexican men have.]
[T506 I try, [chuckles]]
[T506 I identify with it and try to conform to it [controlling,
stereotypical macho].]
[T506 I try to be caring and feeling across gender, and racial and
ethnic lines]
[T507 I mean it comes in when you have to use the certain traits of
being macho.]
[T507 It comes into play with myself.]
[T507 I was very competitive in sports.]
[T510 I think it is a part of my identity of being an encourager]
[T510 Yes, I identify with that [a gentleman] totally]
(Continues)
Exercise # 3
Exercise on Thematic Analysis - Step 3
* Step 3. Axial Coding
* Reliably dimensionalizes each thematic
category
* Converts a thematic category into a
thematic variable.
* The thematic variable can then operate
as a variable within correlational and
other multivariate analyses.
* Allows the encoding of nuances or
shades of meaning to the developing
Exercise on Thematic Analysis - Step 3
* Intensity Axial Coding:
0 = No Mention - not indicated in
any way,
1 = Suggested Mention - hints of the
theme,
2 = Basic Mention - a single
mention
3 = Elaborated Mention - a mention
with repetition and elaboration.
* Frequency Axial Coding - Number of
mentions (0 to 3)
Exercise # 4
Correlations: Belief and Identity Thematic Variables
Variable
1
2
3
4
1. Nurturing beliefa
2. Abusive beliefa
-.08
3. Control identitya
-.02
.06
4. Caballero identitya
.15
.19
-.15
-.03
1.01
1.02
1.01
0.00
1.00
M
SD
0.00
1.00
Types of Integrative Data Analyses
* Analysis of distributional properties (skew, kurtosis)
* Factor analysis
* Correlation analysis
* Between thematic variables
* Between measured variables
* Thematic variables with measured variable
* Convergent and discriminant validity
* Regression analysis
* Group comparisons
Exercise # 5
Storyline Analysis of Extreme Group Cases
Storylines of Participants’ Five Highest Life Satisfaction to Five Lowest Life Satisfaction Responses.
Case Number
Life Satisfaction
Score
Quoted Statement for Machismo Beliefs
Quoted Statement for Machismo Identities
T533
2.17
“He doesn’t abuse his wife,” “takes care and
provides for his family.”
“I care about my family,” “For me it’s acting
like a gentleman”
T547
1.57
“They need to respect women,” “Respect,
support, and protect family.”
“I’m respectful of women,” “I never bring
shame to the family”
T564
1.50
“Being strong and supporting the family”
“I do my best to take care of my family”
T743
1.48
“They beat women and are not sensitive—
too macho to tear up.”
“I treat women with respect and don’t beat
them.”
T771
1.42
“A hard worker bring home bacon, but like
women to stay home and serve him.”
“I bring home money and make sure there
is food on the table”
T504
-.75
“Self-absorbed male who thinks of himself
first,” “Provides and protects the family.”
“I try not to identify with the negative at all.”
T788
-.76
“takes care of family,” “cares for his kids,”
“do anything it takes to protect/survive.”
“I’m not fully macho yet.”
T586
-.80
“maintains the household and supports the
family,” “controlling,” “goes drinking.”
“I identify with being both a tyrant and
supporting my family”
T507
-1.02
“A person who doesn’t self-reflect.”
“I’m aggressive when it comes to play in
certain situations, I was very competitive in
sports.”
T812
-1.04
“Badass, wears a mask, he is fake.”
“I feel like a badass.”
Highest
Lowest
Deep Structure Analyses from the Storylines
* What are the emerging themes distilled from the
texts examined?
* The Storyline
* What patterns emerge from the overview
analysis of the various thematic categories
that emerged?
* Put another way, what are these participants
telling us in their answers to the focus
question?
* How do extreme groups differ and what is each
group’s respective story?
* How do these storylines answer the study’s
research question?
VI
Download