Educational Research: Qualitative Research Methods EDU 8603 Educational Research Richard M. Jacobs, OSA, Ph.D. Qualitative research... Commonly called “interpretive research” …its methods rely heavily on “thick” verbal descriptions of a particular social context being studied Is useful for describing or answering questions about particular, localized occurrences or contexts and the perspectives of a participant group toward events, beliefs, or practices …a helpful process for exploring a complex research area about which little is known Illuminates the “invisibility of everyday life” …by making the familiar strange, more examined, and better understood Qualitative methods... historical research grounded theory ethnography phenomenology case study symbolic interaction ethology action research ethnomethodology historical research …studies available data to study, understand, and interpret past events ethnography …studies cultural patterns and perspectives of participants in their natural settings case study …examines the characteristics of a particular entity, phenomenon, or person ethology …compares the origins, characteristics, and culture of different societies ethnomethodology …studies how people make sense of their everyday activities in order to behave in socially accepted ways grounded theory …investigates how inductively-derived theory about phenomenon is grounded in the data of a particular setting phenomenology …considers how the experience of particular participants exhibits a unique perspective symbolic interaction …investigates how people construct meaning and shared perspectives by interacting with others action research …teacher-initiated, school-based research used to improve the practitioner’s practice by doing or changing something Generally speaking, qualitative researchers…. …spend a great deal of time in the settings being studied (fieldwork) …rely on themselves as the main instrument of data collection (subjectivity; intersubjectivity) …analyze data using interpretative lenses …employ expressive language and voice in descriptions and explanations …seek depth of perspective through ongoing analysis (i.e., “waves of data”) …judged in terms of believability, trustworthiness, coherence, and the logic underlying researcher’s interpretations The general characteristics of qualitative research... Data sources are real-world situations Data are descriptive Emphasizes a holistic approach (processes and outcomes) Data analysis is inductive Describes the meaning(s) of research finding(s) from the perspective of the research participants Uses inductive reasoning… …involves developing generalizations from a limited number of specific observations or experiences …highly dependent on the number and representativeness of the specific observations used to make the generalization • Issues in qualitative research... a. gaining entry b. contacting potential research participants c. selecting participants d. enhancing validity and reducing bias e. leaving the field a. gaining entry... access is very much dependent upon the researcher’s personal characteristics and how others perceive the researcher may require considerable negotiation and compromise with a gatekeeper trust is earned, not given b. contacting participants... gaining access dealing with gatekeeper(s) issues of building trust and ensuring confidentiality and anonymity c. selecting participants... the goal is to get the deepest possible understanding of the setting being studied requires identifying participants who can provide information about the particular topic and setting being studied is fraught with difficulties in identifying and selecting an appropriate number of participants who can provide useful information about the particular topic and setting being studied utilizes purposive sampling types of purposive sampling… …maximum variation …homogeneous …critical case …theory-based …(dis)confirming case …snowball (chain) …extreme (deviant) case …typical case …intensity …politically important case …random purposeful …stratified purposeful …criterion …opportunistic …combination (mixed) …convenience two general guidelines: the number of participants is sufficient when… …the extent to which the selected participants represent the range of potential participants in the setting …the point at which the data gathered begins to be redundant (“data saturation”) The threats to validity in qualitative studies... observer bias… …invalid information resulting from the perspective the researcher brings to the study and imposes upon it observer effects… …the impact of the observer’s participation on the setting or the participants being studied d. strategies to enhance validity and to reduce bias... extend the time for observing the setting include more participants to make the study more representative focus upon building participant trust in order to access more detailed and honest data identify biases and preferences, seek them out by asking others work with another researcher and compare field notes and impressions from independent observations after observations are completed, offer participants an opportunity to validate accuracy of the verbatims journalize one’s own reflections, concerns, and uncertainties during the study and refer to them when examining the data carefully examine unusual or contradictory results for explanations (“outliers”) utilize a variety of data sources to confirm one another to corroborate participant information (“triangulation”) e. leaving the field… The question is when and how to exit …the bonds formed with study participants complicate leaving the setting …time constraints …when the amount of accessible data is sufficient The basic steps of qualitative research... 1. Write a tentative research proposal 2. Intensive participation in a field setting 3. Collect detailed data from field activities 4. Synthesize and interpret the meanings of the field data 5. Write the research report 1. The qualitative research proposal... defines area of study identifies setting or context of study specifies the kinds of data to be collected describes methods to be used provides the researcher’s rationale for undertaking the study identifies the study’s potential contribution(s) 2. Intensive participation in a field setting... participation: as a participant (“participant observer”) or nonparticipant approach to participation: overt or covert requires experiencing the situation from the perspective of both an observer and a participant 3. Collecting and analyzing data... primary tools include observations and interviews but can also include personal and official documents, photographs, recordings, drawings, emails, and informal conversations multiple data sources are normative the researcher records descriptive as well as reflective notes about what one has seen, heard, experienced, and thought about a during an observation session regarding field notes… …put aside assumptions, experience context first …see phenomena through participants’ perspective …write up notes immediately following an observation …detail is critical: include date, site, time, and topic on every set of field notes; leave wide margins for writing impressions; use only one side of a page of paper; draw diagram of site (if necessary) …list key words first, then outline one’s observations …keep the descriptive and reflective sections separate …use memos to record hunches, questions, and insights after each observation …number the lines or paragraphs for easy access regarding interviews… …the purpose is to explore and to probe the interviewee’s responses in order to gather in-depth data …the interviewer inquires into the interviewees’ attitudes, interests, feelings, concerns, and values as these relate to the context being studied …meaning is jointly constructed between the interviewer and the interviewee; meaning is not just a construction on the part of the interviewee …be alert for openings in responses to probe more deeply, starting with mundane questions and gradually easing into more sensitive and more complex questions …interview data collection techniques include taking notes during the interview, writing notes after the interview, or tape recording and transcribing the interview (the transcript is a “verbatim”) Interview do’s and don’ts... Do listen more and talk less Do follow up on what is not clear and probe more deeply into what is revealed Don’t use leading questions; do use open-ended questions (“probes”) Don’t interrupt; do wait Do keep interviewee(s) focused Do ask for concrete details Do tolerate silence and space between interviewee’s responses; do allow the interviewee time to think Don’t be judgmental about or react to an interviewee’s opinions, views, or beliefs Don’t engage in debate with an interviewee Do record everything the interviewee says and note impressions of interviewee’s nonverbal behavior 4. Synthesis and interpretation of the meanings of field data... a formidable task because data are thick and deep as well as voluminous and unorganized (“field notes”) involves a systematic and iterative process of searching, categorizing, and integrating data (“managing data”) understanding emerges as data are integrated Analyzing field data… data pieces data categories data patterns • four-step iterative process of data management... a. reading and memoing to become familiar with data and to identify main themes b. examining data to develop detailed descriptions of the setting, participants, and activities c. classifying the data, including categorization, coding, and grouping into thematic units d. interpreting and synthesizing the organized data into general conclusions or understandings Involves working with field notes… …deconstructing data into pieces …reconstructing the data pieces into categories …identifying patterns for understanding, synthesis, and interpretation • Criteria suitable for qualitative data analysis... a. credibility or plausibility b. transferability c. including a methods section credibility or plausibility …to demonstrate that the study was conducted in such a manner as to ensure that the subject was accurately identified and described transferability …to demonstrate that the results of the study are generalizable to others in the original research context or to contexts beyond the original study including a methods section …to provide an in-depth description of the processes and methods used in the study • Strategies for analyzing qualitative data... a. constant comparison method b. negative case and discrepant data methods c. analytic induction constant comparison method …compares new evidence to prior evidence to identify similarities and differences between observations negative case and discrepant data methods …the search for contradictory, variant, or disconfirming data within the body of data collected that provides an alternative perspective on an emerging category or pattern analytic induction …a process concerned with developing and testing a theory in order to generalize a study’s findings 5. Writing the research report... provide a setting where the data were collected identify characters who provide information describe the social action in which the characters are engaged offers an interpretation of what the social action means to the characters offers an interpretation of what the social action means to the characters follow all APA Publication Manual guidelines Mini-Quiz… True and false… …Qualitative research methods are rooted in the disciplines of sociology, anthropology, and history rather than in mathematics. True True and false… …The central focus of qualitative research is to provide understanding of a social setting or activity from the perspective of the research participants True True and false… …Empathic neutrality requires a researcher to include one’s personal experience and empathic insight as part of the relevant data True True and false… …An interviewer constructs the meaning of the content of an interview False True and false… …One of the first issues in qualitative research is to gain entry to a site True True and false… …One indicator that an adequate number of participants has been selected is the extent to which the selected participants represent the range of potential participants in the setting True True and false… …Purposive sampling strategies are especially useful in qualitative research True True and false… …A qualitative researcher should be wary of potential participants who are extremely eager to be included in the study True True and false… …A covert participant observer participates as well as collects data during an observation session True True and false… …Each observation session has its unique focus and interactions but is guided by a protocol or list of issues that frame the observation True True and false… …In qualitative research, data analysis begins as the researcher initiates data management False True and false… …An interviewer will almost always meet face-to-face with an interviewee while some observers will not. True True and false… …Transcripts are the field notes of an interview session True True and false… …Data analysis and interpretation are based on induction as the qualitative researcher discovers patterns emerging from the data and makes sense of them True True and false… …There are no predefined variables to focus qualitative analysis of the data True True and false… …Credibility or plausibility demonstrates that the study was conducted in such a manner that the subject was accurately identified and described True True and false… …The process of analyzing qualitative research data follows a sequential four-step process False True and false… …The ability of the researcher to induce or construct meaning from the data greatly influences the duration and quality of the data analysis True True and false… …Implicitly or explicitly, a researcher interprets data whenever the researcher uses a conceptual basis or understanding to cluster a variety of data pieces into a category True Fill in the blank… …Studying real-world situations as they unfold naturally; nonmanipulative, unobtrusive, and noncontrolling; open to whatever emerges due to a lack of predetermined constraints on outcomes naturalistic inquiry Fill in the blank… …Immersion in the details and specifics of the data to discover important categories, dimensions, and interrelationships; begins by exploring genuinely open questions rather than testing theoretically derived hypotheses inductive analysis Fill in the blank… …The entire phenomenon is understood as a complex system more than the sum of its parts; the focus is upon complex interdependencies not meaningfully reduced to a few discrete variables and linear, cause-effect relationships holistic perspective Fill in the blank… …A detailed, thick description; inquiry in depth; direct quotations capturing people’s personal perspectives and experiences qualitative data Fill in the blank… …Attention to process; assumes change is constant and ongoing whether the focus is upon an individual or an entire culture dynamic systems Fill in the blank… …The first level of qualitative inquiry requires the researcher to be true to, respectful of, and to capture the essential details of the individual context being studied unique case orientation Fill in the blank… …To place findings in a social, historical, and temporal context; dubious about the possibility or meaningfulness of generalizations across time and space context sensitivity Fill in the blank… …The researcher’s passion is understanding the world in all its complexity, not proving something, not advocating, not advancing personal agendas, but understanding empathic neutrality Fill in the blank… …The researcher resides in the study context but disguises his or her identity from the other participants covert participation Fill in the blank… …The researcher’s openness to adapting one’s research as understanding deepens and/or situations change; the willingness to pursue new paths of discovery as they emerge design flexibility Fill in the blank… …The point at which the researcher begins to hear similar thoughts, perspectives, and responses from more or all of the participants data saturation Fill in the blank… …Providing information to a participant about the nature and purpose of the study informed consent Fill in the blank… …The process of qualitative data collection fieldwork Fill in the blank… …The observer’s record about what has been seen, heard, experienced, and thought about during an observation session field notes Fill in the blank… …Evolving data analysis involves a form of thinking on paper through which the researcher describes one’s mental explorations of ideas, themes, hunches, and reflections about the research topic memo writing Fill in the blank… …An extensive, descriptive, and lucid report of the researcher’s observations, partially influenced by what the researcher sees but mainly by the detail and language the researcher uses in constructing the report thick description Fill in the blank… …An purposeful interaction, usually between two people, focused upon one person attempting to access information from another person interview Fill in the blank… …The word-for-word transcript of an interview session verbatim Fill in the blank… …Unusual or contradictory results from an observation or interview outlier Fill in the blank… …The point at which the data gathered becomes redundant data saturation Fill in the blank… …Creating and organizing qualitative data collected during the study data management Fill in the blank… …The process of recording the researcher’s initial thoughts and early impressions of the data memoing Fill in the blank… …The process where the qualitative researcher provides an accurate depiction of the settings and events that took place in it which yields an understanding of the context in which the study took place description Fill in the blank… …The process of breaking down the data into smaller units, determining the import of the units, and organizing the units together again in an interpreted form classifying Fill in the blank… …A qualitative method for classifying data where the researcher begins with a preliminary hypothesis and continuously refines it until there are no examples of the revised hypothesis not being upheld analytic induction Fill in the blank… …A form of cross-validation that seeks regularities in the data by comparing different participants, settings, and methods to identify recurring results triangulation Analogies… content : method as characteristics of a single person or phenomenon : _______________ case study Analogies… content : method as a group’s cultural patterns and perspectives : _______________ ethnography Analogies… content : method as the link between a group’s everyday activities and its social structure : _______________ ethnomethodology Analogies… content : method as the link between participants’ perspectives and social science theory : _______________ grounded theory Analogies… content : method as the meanings and perspectives gained by interactions : _______________ symbolic interactionism Analogies… content : method as How participants experience a variety of things : _______________ phenomenology Analogies… content : method as A change in student learning : _______________ action research Analogies… quantitative : qualitative as population : _______________ setting Analogies… quantitative : qualitative as generalizability : _______________ transferability This module has focused on... qualitative research methods …which describe or answer questions about particular, localized occurrences or contexts and the perspectives of a participant group toward events, beliefs, or practices The next module will focus on... action research ...teacher-initiated, school-based research used to improve the practitioner’s practice by doing or changing something