Barbara J. Risman Professor and Head Dept. of Sociology, University of Illinois at Chicago President of the Board of Directors, Council on Contemporary Families Vice-President Elect, American Sociological Association President-Elect, Southern Sociological Society Co-Editor: Gender Lens Series, Rowman & Littlefied Past Editor, Contemporary Sociology Nov 2014 University of Trento Data Collection Data Analysis Monday Tuesday Wednesday Thursday Writing Friday Introductions Defining Method Versus Design, Epistemology, Methodology Types of Qualitative Research Constructing Interview Schedules Interview Techniques Theory Practice Exercise Something about me Something about you Why do you want to do research? Your current Project Epistemology Method Data Collection Methodology Theory of Knowledge Application of Epistemology to Method Research Design requires: Theory/Question Sampling Strategy Method Methodology Epistemology Methodology Data Collection Data Management Data Analysis Writing Results Beyond our Scope Epistemology Research Design Theory/Question Sampling Interviews Ethnography Open ended Structured Participant Observation Observation Archival Research- another course! Historical documents Literary Documents Websites Others? Constructing an Interview Guide Two hours maximum Topical <----------------> Structured From General to Specific/difficult/personal Pilot Interviews- 4 or 5 Questions make sense Interesting data? Key Point: Not a Survey Interview guide is a GUIDE Focus on Respondent’s Story Let it wander if necessary Team Projects Vs. Individual Research Establish good partnership Record Verbatim vivid speech Nuances and complexities of speech Relax and focus on interviewee Drawbacks: transcription time Pay Attention to body cues Withhold judgment Avoid Leading Questions Probe, Probe, Probe, Probe – Details, concrete Fieldnotes necessary TOO Transcriptions Verbatim or Selective Interviewer or Paid Help Fieldnotes Body language notes inserted into text Reflexivity statement for each interview interview emotions and thoughts Role Playing Volunteers Interviewer/Interviewee Dyadic Role Practice Playing Volunteers Tell me a little bit about your family: how many family members you have, and their relationship to you. You may include anyone whom you consider to be a family member, whether related by blood or marriage or not related. Did your family change over time, that is, who you lived with? If so, how? Where were your parents born? What country or countries are they citizens of? Were you raised in a religion? If so, what one? (If self and/or parents born outside the US) When did you/your parents move to the United States? What were the circumstances that brought you here? (Ask for each parent/guardian) What is the highest level of education your (mom/dad/other) completed? Is your (mom/dad/other) working now? (If so) What does s/he do? What other jobs have they had in the past? Data Collection Data Analysis Monday Tuesday Wednesday Thursday Writing Friday Ethics of Research Fieldnotes How and Why Practice Exercise Covert/Overt Status When to disclose project? Is deception ever ethical? Considerations Likelihood of Harm Prospect of Benefit Theoretical Important Legal Requirements Confidentiality Guarantee anonymity Confidentiality unnecessary when public behavior Ethnography Insider vs. outsider Are researchers ever really insiders? Immersion Participant Observation Grasp what others experience as meaningful Key informants and/or participants Time in field over when “saturation” occurs Adopt a Learner Role- “help me understand” Analysis goes beyond beliefs of participants Go beyond giving “voice” Use body as video-recorder Perception and Interpretation Involved Transform events into words Involves choosing what to write about How to frame Inseparability of Methods and Findings What ethnographer finds inherently connected with how Jot notes to help memory (if unobtrusive) Record as close to occurrence as possible Jotting notes Pro: Can prod memory Con: Can distract from staying in the moment Notes must document own activities Record as close to Occurrence as possible Memories fade fast To produce vivid fieldnotes Avoid generalizations- give details Jot down sensory details Maintain detached observational attitude Ethnography Withhold judgement Stay detached emotionally Provide analysis Participatory Working with community Change-oriented Research is secondary Action Research Interviews/observations: targeted Fieldnotes have different function: activism Must Choose Epistemology /Stay the Course 4 person teams Go to sites that I have identified Spend 15 minutes observing social world Data Collection Data Analysis Monday Tuesday Wednesday Thursday Writing Friday Coding Techniques Definitions Cycles Atlas Ti- getting started Open it up- Exercises Open Coding Organization Perseverance Deal well with ambiguity Flexibility Creativity Rigorously Ethical Extensive Vocabulary Differences from a Quantitative Research? Definition Word/short phrase summarizes attribute of data Heuristic= to discover Method matters Grounded Theory - Open coding Theoretically Driven - Use code sheet Cycles of a code of coding Iterative from specific to categorical Theory to discovery to theory again... Individual Versus Collaborative Projects What do you take into account when choosing a doctor? Raw Data Someone I really trust… Pleasant disposition and friendly Usually I ask my friends if… they have anyone doctor that they like and if they could recommend The doctor better have a legit degree! Board certification is impt, esp if I’m looking for a specialist Focused Coding Theoretical Coding Internal Validation External Validation subjective External Validation objective Search Process for health care provider involves internal and external validation. Involves subjective and objective aspects First Cycle Coding Attribute Exploratory Descriptive Second Cycle Coding Conceptual focus From specific to general categories Emotive/Values Hypothesis /Theoretical Coding Iterative and start all over again.. Theming the Data Download free version www.atlasti.com/download or open it on your classroom computer. Hermeneutic Units (HU) – Main Atlas work file; acts like a “basket” Objects – items you put in the basket, such as: Primary Documents (P-Docs or PD’s) Text, image, audio, or video Quotations Codes (& Code Families) Memos Download the transcript files (exercise 1) to your desktop. Put them all in one folder. Creating an HU Open Atlas, select ProjectNew Hermeneutic Unit Importing P-Docs Many ways, but easiest is ProjectAdd Document(s)Add Documents Find them on desktop, select all, and hit OPEN Will get message files “successfully converted” Hit “OK” Double check by hitting Pdoc manager button Applying Existing Codes Highlight selection in P-Doc Select third code button on left toolbar and choose from existing code list Managing Codes Open Code Manager by double-clicking the word “codes” next to drop-down code list Codes are listed with two numbers {#-#} that represent their groundedness and density Groundedness – How frequently a code occurs in data Density – How interconnected a code is with other codes [no. of codes a chosen code is linked to; think network] These measures gain importance when revising codes/doing focused coding Codes are denoted by yellow diamond symbol Creating New Codes Your own label Highlight selection in P-Doc Select the first code button on left toolbar (looks like yellow diamond in middle of text) Type in the code label(s) you want to apply to selection “In Vivo” codes (name comes from quote itself) Highlight selection in P-Doc Select second code button on left toolbar Coded selections become “quotations” Codes appear to the immediate right of the quotation Writing Memos Use memos to jot analytical ideas and/or to document decision-making process Select “Memos” “Create Free Memo” from toolbar atop HU screen Name the Memo something intuitive and include the date somewhere Generating Output Output documents can organize quotes in readable and intuitive format for use in revising or writing-up We will explain this more as we go along Download the 5 transcript files (exercise 1) to your desktop. Put them all in one folder. Creating an HU Open Atlas, select ProjectNew Hermeneutic Unit Importing P-Docs Many ways, but easiest is ProjectAdd Document(s)Add Documents Left hand column, hit desktop, select exercise 1 folder, select all, and hit OPEN Will get message files “successfully converted” Hit “OK” Double check by hitting Pdoc manager button 1. 2. Looking at the Cindy Lauper transcript, use the “Edit””Search” function to search for the word “gender” (line 348) Highlight this paragraph, then use the “create a new code” icon to apply the following codes: “gender,” “friendship,” & “school” [Be sure to hit “add another code” so they stay distinct codes] Then click ok 3. 4. 5. Use the P-Doc drop-down menu to select the Eugene Martin transcript Repeat the Editsearch for the word gender Find the THIRD occurrence, then highlight the paragraph and code it as “gender,” “patriarchy,” & “religion” (HINT: You will have to add the new codes with one icon but use the “apply existing codes” icon for gender) 6. 7. 8. Use the P-Doc drop-down menu to select the Ramona Connell transcript Repeat the Editsearch for the word gender Find the first occurrence, then highlight the paragraph and code it as “gender,” “career,” & “kids” (HINT: You will have to add the new codes with one icon but use the “apply existing codes” icon for gender) 9. 10. 11. 12. Open the Codes on the top tool bar, then open code manager window You should see that the code “gender” has the values {3-0} beside it, meaning it has a frequency of 3 and therefore the highest groundedness of our codes so far Highlight the gender code and select “Output”“Quotations for Selected Code(s)” from the toolbar above; click “Okay” Reviewing the quotes associated with “gender,” we see that we might be conflating different aspects of gender. Let’s recode those items to be more specific… [you may close the code manager ] 13. 14. 15. First, let’s note our thoughts in a memo. Select “Memos”“Create Free Memo” from the toolbar at the top of the HU interface. Name the Memo “Gender Coding (date)” with today’s date. We may use it later. In the memo editor, type “after reviewing the gender quotes, I have decided to recode these to reflect more specific operations” [close memo manager window] 16. 17. 18. 19. Go to code manager again (codes -> code manager). In the code manager, double click on the “gender” code. A small window should pop up with the applicable quotations. Click on the first quote. The P-Doc viewer should now show the quote in context (should be from the Cindy Lauper doc). In code manager, click the “create new item” icon in the upper left of toolbar (looks like card with spark behind it) and name a new code “Gender vs. Sex” Click on the “Gender vs. Sex” code in the code list and drag it to where the “gender” code appears to the right of the quote in the P-Doc viewer. The new code should have replaced the old one. 20. 21. 22. 23. Create 2 more new codes the same way “Gender Ideology” & “Gender Identities” Find the next quote already associated with “gender” (from Eugene Martin) and drag and drop the “Gender Ideology” code to replace “gender” Find the final quote associated with “gender” (by double clicking on the “gender” code) and drag and drop the “Gender Identities” code to replace “Gender” We have now recoded the gender quotes to be more specific, and we’ve retained the gender code in case new gender-related quotations arise WELL DONE! Open Read the file for “Salem Bee” the transcript and create codes that “emerge” from the data Tuesday Data Collection Data Analysis Monday Tuesday Wednesday Thursday Writing Friday Review of Data Collection Theoretically Driven Coding From Coding to Analysis Analytic memos Theoretical Coding Attribute Coding Sex Race Immigrant Status Creating Families Intersectionality (if time permits) Download all 10 transcripts under “exercise 3” onto desktop. Keep them in 1 folder Repeat the same steps in exercise 1 Creating an HU Open Atlas, select ProjectNew Hermeneutic Unit Importing P-Docs ProjectAdd Document(s)Add Documents Find them on desktop, select all, and hit OPEN Will get message files “successfully converted” Hit “OK” Double check by hitting Pdoc manager button Structured Coding Exercise Gendered Beliefs liberal Conservative Unclear/Neutral Code all 10 interviews Create these 3 “new” codes Use them over and over again These are the attributes for demographic data on the sample you have downloaded You will use these attributes to create “Families” for Analysis Respondent Names Race Sex Immigrant Status Benny Goodman asian man 2nd gen Jonathan Poem asian man 2nd gen Bill Cornell asian man 2nd gen Nancy Anderson asian woman 1st gen Amy Lahey asian woman 2nd gen Mark Rose white man Native-born Peter Steele white man Native-born Martha Brodowski white woman 1st gen Brook Mullen Ramona Connell white white woman woman Native-born 2nd gen Family Think of it as grouping your p-docs into meaningful categories Just Codes follow me here Click “p-docs” button Go to Documents Go to “Families” Click “Open Families Manager” Just follow me here Click icon (spark card) to create new family Name new family “women” In the field “primary documents not in family”, choose pdocs that are women and click the left arrow Step 1 Click “p-docs” button Go to Documents Go to “Families” Click “Open Families Manager” Step 2 Click icon (spark card) to create new family Name new family “white” In the field “primary documents not in family”, choose pdocs that are white and click the left arrow Step 3 Double check by clicking once on “white” family in pdoc manager The right column will show you all the pdocs associated with being white Now you try Create an “asian” family Create a “male” family Create a “female” family If you have time, create the families for immigrant status Now we will use families to help with our analysis women vs. men Step 1: On your main HU, click “Analysis”, followed by “query tools” Step 2 Click scope Step 3 Under primary doc families, click “male” In “candidate quotations in query”, you are able to preview of the quotations and primary documents and codes Then ok Step 4 Choose the codes that you are interested in In this example, I choose “beliefs_liberal” Click “beliefs_liberal” Click the printer icon and click “full content” And choose “editor” and click ok Now you will see an output with all the quotations by men about their liberal gender beliefs Now you’ll try to generate an output with all the quotations by women about their liberal gender beliefs Discussion: compare and contrast how men and women differ about their liberal gender beliefs Super Families Code E.g. Race + Gender Think of it as families code that are intersecting Are there racial differences between and among the sexes? Step 1 P-Doc Manager Click Documents Click “Families” then click “Open Family Manager” Click Families then click “Open Super Family Tool” Step 2 Choose Asian and Men to create your superfamily Double Click on each category and they will appear in “Query Field” Note: The manual cautions against using more than 2 families to create super families Step 3 There are 4 symbols (they are called operators) on the left (hovering your mouse cursor over them will reveal what they are); click the 3rd operator In your query, you will see that you have you have asked Atlas Ti to combine both Asian and Men families Click “Create Super Family” and name “Asian Men” You will see a new super family called Asian Men created and it will be in red In the field below “create super family button”, you can double check if there are 3 asian men pdocs Close all the windows You will use super families as “filters” next On your main HU, click “Analysis”, followed by “query tools” Click scope on the bottom of the “query tool page” By selecting Asian Men, you are asking Atlas Ti to limit the subsequent analysis to only this superfamily You can even double-check your work here Click ok brings you back to query tool page Now, I want to see all the quotations by Asian Men about their liberal gender beliefs Under codes, I clicked “beliefs_liberal” and then click the printer icon Choose “full “content” and select “editor” Compare across identity groups White men versus asian men Black women versus white women Or Dutch women versus American women Or Indonesian college educated versus Dutch college educated Etc...allow complicated intersectional analyses On to more discussion of analysis Researcher’s Conversation with yourself (and advisor?) Any time idea strikes, write a memo From journal entry Coding to Analysis Document/reflect on codes Emergent themes Testing or formulating theory Reflexivity important Draw diagrams if useful Reiterative - invent new codes Talk shop regularly with other “experts” Join a Writing Group As you do the analysis.... From concrete to conceptual The Touch Test Codes to Themes Excavate the Top Three Themes Excavate top Three (or four) themes Write about ONE at a time Create an outline of major points/evidence If hard to start- begin with the conclusion Talk shop regularly - with other “experts” Join a writing group Data Collection Data Analysis Monday Tuesday Wednesday Thursday Writing Friday Getting Started Ritual and Magic (What are you afraid of?) To Accountability and Routine The Spew Draft For your eyes only From Spew to Manuscript Content to Structure Infrastructure – Plan and Execute Writing Matters Sharing our Rituals Magic or Function? Procrastination? Fear? Satisfaction? CREATE ROUTINE Accountability To Self To Others- Writing Groups What’s Your Question Why Worth Studying Major Contribution The analysis/findings Answer the “What” and “Why” questions (write for 5 min) Spew Ideas Draft for your current research (5 min) I. Introduction/Frame Roadmap II. Signficance Literature Review/Theory Transition to YOUR work III. Methodology/Epistemology Standpoint Reflexivity Findings- Evidence Discussion Limitations Conclusions The architecture of your paper The roadmap Literature Schema Review: Impose an Organizational Intellectual Debate Development Over Time Inconsistency in Findings Include literature from country where journal is published International comparative review often useful Theoretical/Conceptual Frame of the Article Transition Smoothly from Literature Review Provide Justification for Analysis to Follow Sample/Data Measurement Standpoint Analytic and epistemology Issues Technique Reflexivity Hypotheses ( unusual for qualitative) Present Evidence Technical Presentation Qualitative Data show don’t tell Provide evidence- quotes but also counts Don’t be afraid to give percentages Acknowledge, analyze outliers Interpret that Evidence What Does it Mean Relate Back to Literature Review Focus on One Major “story” line Key Findings Summary Theoretical/Conceptual Admit Contribution Weaknesses in your project Do not stress them Never end with them Summary Implications Why important? Policy? Future Work Necessary Substance Know your argument Infra-structure Roadmap: Reader must be able to follow you Evidence NOW Elegance or WRITING matters... Paragraph structure Word choice Grammar WHAT/HOW/WHY STRATEGY PARAGRAPH Every sentence has a function What’s the Main Point? How Do you support it? Why is it Important? Be passionate about your topic Prefer simple words Restrict usage of complicated terminology and jargon. Use words to express ideas, not to impress Sentences: Every word should be justifiable Avoid long and complicated sentences! Always provide concrete examples. Abstract concepts difficult to understand without examples. Avoid the Passive Voice Papers can not “do” anything. People can. Active/Passive Voice The entrance exam was failed by over one-third of the applicants Over one-third of the applicants failed the entrance exam OR: The brakes were slammed on by her as the car sped downhill. She slammed on the brakes as the car sped downhill. Sexist or Biased Language Mankind Humanity, people, human beings The common man Ordinary people Recast in the plural Use one, your or (sparingly) he or she Concise: words and phrases to avoid