Coding and Analysis NEXT SESSION: READ WELLER AND ROMNEY IN READING PACKET Learning Objectives –describe progress in group projects –note steps in developing a semi-structured interview –describe guidelines for computer coding of interview text –describe the steps in performing analysis Lectures Increasingly less important as you learn from doing the work and I have less to 'teach' you Learning from other students who are doing their projects becomes an important component Exercises in class expose you to ideas and concepts Interviewing HAND IN Exercise talk about –Open ended questions you used? –Probes –What worked well? –What didn't work so well? –Non-verbal aspects? –Field notes ("scrap," expanded, TA comments) --your group project and what you have learned Qualitative Research Question to address or interest in something Preliminary steps often to form hypothesis –(formative research) Further study Collection of DATA (field work) –Observation, interviews, other work depending on what you discover DATA analysis –Coding (putting identifiers on what you found) –Looking for themes (main ideas) –Putting it all together (what you learned) Report ANALYSIS THEMES Terminology terminology in qualitative research is not consistent, so describe what you do, and when you use terms, give their meanings ethnography, field methods, qualitative research, participant observation, case study, naturalistic methods, responsive evaluation, needs assessment are used interchangeably by many Complexity of qualitative inquiry can have multi-site, multi-method studies we look at many methods, separately, letting you try to integrate them in your exercises Semi-structured interview from a series of interviews, will know most of the questions that need to be answered, but can’t predict the answer –Blood donors--spontaneous, privacy, altruism –University Police--security, emotionless –Big Time study hall--desire for a noisy environment Semi-structured interview prepare a list of short questions as prompts try and let the interview be conversational, rather than questionnaire format Semi-structured interview –questions should address only one aspect of a topic, otherwise you may confuse yourself and the informant –explore the domain of the topic and list in sensible order, everything you want to know, then construct question stems to cover the domain •DON'T GET STUCK IN TERM: domain Semi-structured interview –pretest with a colleague, record the session and ask the colleague to think out loud so that any confusion is recorded, and the nature of the confusion is clear –revise, then pretest with a participant –revise many questions can be leading, what is your general opinion of the US health care system what about the professionals, the doctors and nurses with whom you interacted, tell me about them many questions can be leading, asking about what types of topics were on the informational sheet handed out “you mentioned earlier about the nurses not talking to you unless you asked them a question. Did you ask any specific questions?” “what kind of accent does he have?” Homeless youth in SF •Part Obs: June-Sept. 1997, Castro District, San Francisco key informant, Phase I informant interviews (#9) , preliminary analysis •Phase II Semi-structured interviews (#11) – wanted more females & <18, newly on street went to Haight-Ashbury •additional participant observation Interviews lasted 2-3 hours, with 1 to 1.5 hours tape recorded Student projects: –EXAMPLES of semi-structured questions you might consider? Codes (abbreviation or symbol applied to a segment of words, or paragraph in order to classify it) Types of codes numeric, Outline of Cultural Materials (OCM) memnonic, Words, Function of codes: organization retrieval assembly reduction usefulness Cultural theme Morris Opler (1945) defined it as: "a postulate or position, declared or implied, and usually controlling behavior or stimulating activity, which is tacitly approved or openly promoted in society" Function of codes: Choose and flag themes so you can clump relevant strips from different reports –Spradley reading on themes is very good (reading package) Identify field encounter Identify informant characteristics Coding and ANALYSIS A very good device for analysis Also could just search text for words –bamboo in Nepal Codes can relate to: terminology/definitions methods/data collection –ways of asking questions –non-verbal responses STUDENT EXAMPLES Observed behavior Student examples of codes what was expected but not observed –Newar nose piercing Process of coding EITHER Create a small list of codes prior to fieldwork •forces you to tie research questions or conceptual interests directly to data •be ready to redefine or discard codes when they look inapplicable, overbuilt, empirically illfitting, or overly abstract OR: wait for field notes to suggest more emic/empiric labels –code expanded field notes as you go, or right after Keeping Track of Data –serial number for each note, then date, place, name of informant (use encrypting codes for places & informant names & keep code book of names & locations physically separately from field notes) –dates: 980126, 020423, 050419 WHERE TO PUT THE CODE? Penciled in margin for you now, but in large projects, computers handled this in various ways –COLOR HIGHLIGHTER Log book of codes is essential –Re-assign –Others to use who code the data –May have two people independently code the expanded field notes Coding Field Notes –Hard work, do it right after the activity –CODING IS REALLY ANALYSIS, (Bernard), once you have coded, you will have done much of the analysis Guidelines for coding for computer code more abstract concepts than descriptive info (after collect data) limit to <50 codes make codes stand out (bold, brackets, special symbols, *, #, { [ ) Icons signifying relationship, like folder in Mac or Windows, Trash Can, Hourglass Macros HIDDEN TEXT (especially if have two people independently code) or track changes Glossary to the codes for ease of reading Alphabetize (eating habits) –TAm morning –Tev evening –TNt middle of night –TPm afternoon place a thematic glossary as well, helps you organize your codes –Body posture suggesting reaction to 'soap' –Terminology used to refer to tan types Data Analysis search for patterns in data & for the ideas that help to explain the existence of these patterns a great deal of analysis happens when you think of how to present your data, that will be covered in session 13 (computers), 14 (presenting) and more in session 16 and 17 (latter with Helene Starks) Analysis Begins before you start the qualitative research, continues throughout the effort, unlike many quantitative studies develop ideas and test them against your observations, modify ideas as you gather more material and reflect on it Analysis outlining program (MORE) for the Macintosh, most valuable software for me Inspiration Software, Inc. –http://www.inspiration.com/home.cfm – sales@inspiration.com – 800-877-4292 or (503)297-3004 Analysis be very self critical, ask colleagues, informants, to review balance between seeking emic perspective, documenting folk analyses, but remain skeptical, don’t be afraid to develop and state preliminary ideas Analysis Question whether or not to be too grounded in the literature, and influenced by it, so consider keeping your reading at arms length Qualitative Data Analysis Process: Generic Style •Review Notes ---------> Coding IS COMPREHENSION •Coding ---------> Search and Extraction IS SYNTHESIZING •Search and Extraction ---------> Pattern Identification IS THEORIZING (Sorting phase of analysis) •Pattern Identification ---------> Summarization IS GENERALIZING Summary Semi-structured interviews can help understand cultural elements once you have done some observation and interview work Coding is the first step in analysis Levels of Analysis defining & describing items, making empirical statements about objects & phenomena meaning & meaning interactions, tracing interconnections with items & patterns patterns, grouping items & making linkages Levels of Analysis Grand vs mid-range theory (domain analysis) ask questions of data at different levels •emic-etic •macro-micro CONTAC T SUMMARY FORM Contact type: Visit Phone ___________________ ___________________ (with whom) Site: Contact date: Today' s date: Written by: ________________ ________________ ________________ ________________ 1. What were the main issues or themes that struck you in this contact? 2. Summarizre the information you got (or failed to get) on each of the target questions you had for this contact? Question Information 3. Anthing else that struck you as salient, interesting, illuminating or important in this contact? 4. What new (or remaining) target questions do you have in considering the next contact with this site? Type of contact: CONTACT SUMMARY FORM WITH CODED THEMES Mtg. _______________ ___________________ _____________ place date Phone ______________ ___________________ _____________ with whom, by whom place date SITE ______________ Coder ______________ Date coded __________ Inf. Int. _____________ ___________________ _____________ with whom, by whom place date 1. Pick out the most salient points in the contact. Number in order on this sheet and note page number on which point appears. Number point in text of write-up. Attach theme or aspect to each point in CAPITALS. Invent themes where no existing ones apply and asterisk those. Comment may also be included in double parentheses. PAGE SALIENT POINTS THEMES/ASPECTS DOCUMENT SUMMARY FORM Name or description of document: Event or contact, if any, with which document is associated: Significance or importance of document: Brief summary of contents: IF DOCUMENT IS CENTRAL OR CRUCIAL TO A PARTICULAR CONTACT (e.g. a meeting agenda, newspaper clipping discussed in an interview) make a copy and include with write up. Otherwise put in document file. Site: Document: Date received or picked up: ____________ ____________ ____________ Cycle of data --->analysis/interpretation---> data •monitor & report your own thought processes as much as possible (keep info on decision you make about coding & extracting patterns), ie keep a log book Cycle of data --->analysis/interpretation---> data •much of what you develop stems from your own basic perspectives, what kind of person you are, and your experience in the research area Body Ritual Among the Nacirema • Analytic Foci • Selecting indigenous (emic) or investigatorgenerated concepts & typologies (etic) –often use both Analytic Foci ••••••- chronological key events, settings, people processes issues Analytic Foci: Chronological •Series of events: Analytic Foci: Key events Analytic Foci: settings, •places, sites, locations, then cross-setting analysis •how does behavior change in different sites, why? Analytic Foci: People •people (within or across cases), Analytic Foci: Processs •control, recruitment, decision making, socialization, communication, etc. Analytic Foci: issues Specialized approaches for analyzing qualitative data •TAXONOMIC •CONTENT Specialized approaches: •COMPONENTIAL analysis to distinguish items within a domain Specialized Approaches •EXPLANATORY & ETHNOMEDICAL MODELS •DECISION-MAKING •EVENT STRUCTURE Process of Data Analysis • Review notes periodically, code, search & extract chunks of material, look for patterns & summarize • Bernard’s “intra-ocular percussion test” • Text management programs Constant Validity Check •find out why informants disagree about important things •check informants reports of behavior or of environmental conditions against more objective evidence •be open to negative evidence, ie that doesn’t support your theory –may be an opportunity Constant Validity Check • seek out alternative explanations from informants, colleagues, etc. • try to fit extreme cases into your theory, & if they don’t fit, don’t be too quick to throw them out • triangulation of qualitative data • switch from emic to etic perspectives INTERPRETATIONS VALIDITY •Open to negative or contradictory evidence •Look for a range of interpretations •Brain storm with others to get their suggestions of interpretations, there can be many •Extreme cases (whether or not to discard) Next Class •FORMAL METHODS EXERCISE NOTE TAKING / FIELD REPORTS •Paraphrasing •Quotes ( Hidden text) •Non-verbal cues •Decision on leaving material out: is this detail relevant to the purpose of inquiry? jottings (can be anywhere) •what you write down at the time •dairy •personal •log •day to day activity NOTE TAKING / FIELD REPORTS •describe what happened & your interpretation of what happened, with descriptions full enough so another person can read it & make their own interpretations •OK to speculate but call it such, or you will later be confused as to what you observed and what was your interpretation •Expanded field notes as distinct from interview description in exercise •Keep a journal of your work (Hugh Swift) Backup and security •how many back up their files regularly? •how do they do it? BACKUP strategies Frequency •daily for important stuff •weekly for incremental back up •monthly for global back up •set programs to save automatically every 5 minutes BACKUP strategies •computer floppy disk, tape, external hard drive, CD-RW •Photocopy, photograph pages even •off site - my fire experience Carry valuable data with you, and don’t check in luggage •if you carry data with you in a new and unaccustomed way, you are more likely to misplace it