Research and Assessment Techniques - Focus

advertisement
Research and Assessment
Techniques: Focus Groups
Your Name
Your Institution
Date
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Overview
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Outcomes
1. Compare focus group approach with other
2.
3.
4.
5.
approaches
Plan a focus group session
Develop a focus group discussion guide
Facilitate a focus group
Analyze focus group results
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Icebreaker
Using the “When and When Not to Use Focus
Group Interviews” checklist, select in which
items a focus group should be used.
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Purpose and Use
A focus group is used to:
Understand the range of opinions, feelings,
ideas, thoughts or behaviors among a group
of people with similar characteristics or
interests.
A focus group is not used to:
Build consensus, resolve conflict or
understand what people with divergent
experiences believe on a wide range of topics.
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Other Qualitative Approaches
• Delphi Method
• Brainstorming
• Survey Research
• Interactive Qualitative Analysis (IQA)
• Nominal Group Technique (NGT)
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Focus Group Characteristics
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Primary Characteristics
•
Moderator’s Role
•
•
Size and Composition
•
•
•
Non-directive; facilitates discussion, probes to
understand details and nuances of comments
3-6 sessions of 5-12 participants each
Homogeneous groups
Focused Discussions
•
•
Questions are open-ended and sequenced
Guided questions with spontaneous probing
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Focus Group Components
1. Determine the purpose
2. Formulate the research question
3. Identify the participant characteristics
4. Identify who and how the information will be
used
5. Develop the discussion guide
6. Schedule sessions and recruit participants
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
The Planning Guide
Action Research
SLO Assessment
• What is the question the
• What is the SLO you want to
•
•
•
•
research will help answer?
What is the research
assumption or hypothesis?
What specific traits or
characteristics are needed
in the population?
Who will use the
information?
How will the information be
used?
assess?
• What is the SLO criteria?
• Which segment of the
population is the SLO
targeting?
• Will the information be
shared with your
colleagues?
• How will the information be
used?
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Interactive Activity
Develop a Guide: Use the “Focus Group
Planning” template to develop a Planning
Guide for your focus group research or
assessment.
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
The Discussion Guide
•
Question Routing
•
•
•
•
•
•
Easy beginning
Sequencing
General before specific
Positive before negative
Uncued before cued
Categories of Questions
•
•
•
•
•
Opening questions
Introductory questions
Transition questions
Key questions
Closing questions
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Question Categories
•
Opening
•
•
•
Introduction
•
•
•
Purpose of the focus group and ground rules
Tell us your name and how many semesters
you’ve attended the college
How did you learn about this class or service?
How often or when do you go to class or use this
service?
Transition
•
Think back to when you took your first class or
first used the service. What was your impression?
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Question Categories
•
Key Questions
•
•
•
•
What was particularly helpful?
What was particularly frustrating or not helpful?
How has your learning experience changed as a
result of this class or service?
Closing
•
•
What advice would you give to improve this class
or service?
Is there anything I missed that you would like to
add?
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Writing Good Questions
•
•
•
•
•
Be conversational and informal
Avoid jargon; use language participants will
know
Be clear and concise; eliminate questions
with multiple questions in one (barreling)
Ask open-ended questions but avoid “why”
so as not to appear judgmental or
disapproving
Phrase questions to allow participants to
respond based on experience: “think back”
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Interactive Activity
Develop a discussion guide using one of the
sample research or SLO topics in the Planning
Guide, or one you’ve created.
Follow the general routing and category of
questions:
1.
2.
3.
4.
5.
Opening
Introduction
Transition
Key Questions
Closing
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Activities to Engage Participants
•
•
•
•
•
•
Listing items
Rating items
Picture/card sorting
Drawing pictures
Imagining/visualizing
Developing a campaign
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Facilitating the Focus Group
•
Necessary Skills and Preparation
•
•
•
•
Have a friendly, inviting, non-judgmental attitude
Practice active listening; resist personal views
Know the subject matter, the environment and the
discussion guide
Essential Techniques
•
•
•
Pause
Probe
Acknowledge verbally and non-verbally
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Interactive Activity
Ask the person next to you a focused question
and use the following three techniques to
practice interviewing:
1.
2.
3.
Five second pause
Probe for further explanation, examples or details
Acknowledge without agreement or disagreement
either verbally or non-verbally
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Analyzing the Results
•
•
Review the Purpose
Content Analysis Process
1.
2.
3.
4.
5.
6.
Review the comments/transcripts
Extract the major themes or concepts
Group comments by major themes
Identify key descriptors within themes
Summarize the themes using the descriptors
Add your conclusions and recommendations
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Content Analysis Sample
Themes
Descriptors
• Quality of Instructor
• Helpful instructors
• Available when I need them
• Knowledgeable
• Concerned with my success
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Interactive Activity
Conduct a content analysis by extracting
themes and descriptors from the sample
focus group interview results and summarize
the results.
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
References
•
•
Focus Groups, Krueger and Casey
Interactive Qualitative Analysis, Northcutt
and McCoy
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
The BRIC Initiative
BRIC:
http://www.rpgroup.org/projects/BRIC.html
The RP Group:
http://www.rpgroup.org/
Contact:
Rob Johnstone
Project Director, rjohnstone@rpgroup.org
Priyadarshini Chaplot
Project Coordinator, pchaplot@rpgroup.org
Bridging Research, Information and Culture
An Initiative of the Research and Planning Group for California Community Colleges
Download