WinS for Girls: Advocacy and Capacity Building for MHM in WinS Module 8: Recording, Managing and Collecting Data Photo credit: Gauthami Penakalapati WinS for Girls Module 8: Data Management Queues to Participate Throughout the course you will see: Questions in Red When there are questions in red, we pause from the course lecture so all can participate and add responses or ideas in the chat window Questions in Green When there are questions in green, we will not pause from the course lecture, but all are still welcome to add responses or ideas in the chat window WinS for Girls 2 WinS for Girls Module 8: Data Management Module 7 Review In Module 7, we reviewed the following points: We recommend you include: •IDIs with girls •FGDs with girls •KIIs with teachers and administrators •Schools facility observations Triangulation is used in research to gain different perspectives of the same topic With our current tools, • KIIs with administrators on facilities are mainly closed questions • KIIs with teachers can be more open • School observations are a more quantitative method (making this mixed methods) FGDs with Mothers, Boys, and Fathers can be developed and included. •It is advised that these are created after some initial data collection with girls and teachers to help direct the inquiry. WinS for Girls 3 WinS for Girls Module 8: Data Management Learning Objectives At the end of the session participants should be able to: 1.Understand types of demographic information to collect from participants. 2.Understand strategies for recording, transcribing and translating data 3.Understand key tips for managing data. WinS for Girls 4 WinS for Girls Module 8: Data Management Module Source Material Material for this module adapted from: 1. McLellan, E., MacQueen, K. M., & Neidig, J. L. (2003). Beyond the qualitative interview: Data preparation and transcription. Field Methods, 15(1), 63-84. 1. Hennink, M. M., Hutter, I., & Bailey, A. (2011). Qualitative Research Methods. Thousand Oaks, CA: SAGE Publications. Resources can be found on Blackboard (website information at end of presentation) WinS for Girls 5 WinS for Girls Module 8: Data Management Demographic Information We want to collect information about all participants so that we can report on who we talked with. Figure 1. UNICEF country offices engaged in assessment of menstrual hygiene management in schools You can fill out a demographic information sheet for each person involved in the IDIs, KIIs, FGDs. We will share a version with you. For more information on the assessment findings, see the individual country reports at www.unicef.org/wash/schools. WinS for Girls 6 WinS for Girls Module 8: Data Management Demographic Information Key Information to Collect In the 4 country study, we obtained information on the following (if students): Figure 1. UNICEF country offices engaged in assessment of menstrual hygiene management in schools •Age •Grade •Language spoken at home •Age at menstruation •Number of siblings •Number of sisters at home In some areas we collected information on participants’ •Religion For more information on the assessment findings, see the individual country reports at www.unicef.org/wash/schools. •Access to media/cell phone What might be other important information to collect from participants? How may this information change for KIIs? FGDs with Mothers? Boys? WinS for Girls 7 WinS for Girls Module 8: Data Management Recording Obtaining an accurate record of an interview or FGDs is critical. Interviews and Focus Group Discussions are usually recorded in two ways: 1.Tape/ digital recorder 2.Notes from a note-taker Today we will discuss both methods and their importance to your work… WinS for Girls Photo credit: Gauthami Penakalapati 8 WinS for Girls Module 8: Data Management Recording • When conducting qualitative research, ideally each interview or focus group discussion will be digitally recorded. Recording is the ‘Gold Standard’ Photo credit:DiRado-Owens, TCi http://blogs.cornell.edu/agricultureandnutrition/category/data-collection-training/ WinS for Girls 9 WinS for Girls Module 8: Data Management Recording • When conducting qualitative research, ideally each interview or focus group discussion will be digitally recorded. • This provides a verbatim record of the topics discussed and increases data quality. • However, before recording the interview or focus group discussion, The intent to record should be clearly stated in the introduction and in the assent or consent form. Photo credit:DiRado-Owens, TCi http://blogs.cornell.edu/agricultureandnutrition/category/data-collection-training/ The participant must understand the intention to record and must agree to allow it. WinS for Girls 10 WinS for Girls Module 8: Data Management Recording and Permission Permission • Ensure consent from all participants before recording • Explain why you are recording the discussion or interview • Stress the importance of accurate information • Explain that confidentiality will be protected • Invite questions Photo credit: https://www.flickr.com/photos/ictph_india/4926565168/ WinS for Girls 11 WinS for Girls Module 8: Data Management Recording and Permission Permission • If consent is not given for recording, you will have to decide what to do: Find a different person to interview If a person does not agree, you may want to simply find a new person to interview. Take rigorous notes instead of recording If the person will participate, but refuses to be recorded, you may elect to take notes instead. Photo credit: DiRado-Owens, TCi http://blogs.cornell.edu/agricultureandnutrition/category/data-collection-training/ However, note taking requires rigorous work and training. If you are will not record and will only be note taking, you should have one team member interview and the other just take notes. WinS for Girls 12 WinS for Girls Module 8: Data Management Recording To record or not to record… During the pilot phase, you should see how participants react to recording in general. It may be easier to stick with one method (recording vs. no recording) if possible as you will need to report how you captured data for each data collection activity. If most participants are accepting of recording, you may want to record all participants and thus only seek out participants who are willing to be recorded. Photo credit: DiRado-Owens, TCi http://blogs.cornell.edu/agricultureandnutrition/category/data-collection-training/ If most participants seem to refuse recording, -you may want to elect to not record from outset. -you may want to record those who are willing. WinS for Girls 13 WinS for Girls Module 8: Data Management Recording Logistics • Check batteries and power before the interview • Ideally, you should record the activity with two recording devices, in case of malfunction • Put the recording device in a central location • Make sure to leave the recoding device on even after the formal part of the interview is over-the best information may come at the end! • When the interview is over, upload the recording onto a hard drive or computer and erase the file from the recording device. WinS for Girls 14 WinS for Girls Module 8: Data Management Recording Recording Devices: • Cassette tape • Digital • Recording Device • Smart phone • IPod with microphone • Computer • Considerations • Memory • Ease of use • Access to consistent • Microphones WinS for Girls 15 WinS for Girls Module 8: Data Management Note-taking Note-Taking • Notes are data. • They are taken even when a recorder is being used! http://www.acaps.org/en/deployments/yemen WinS for Girls 16 WinS for Girls Module 8: Data Management Note-taking Key aim of Note-taking is to: • Record the main issues raised Useful for reviewing main points at the end of the day with research team. Hard to do with just a recorder. http://www.acaps.org/en/deployments/yemen WinS for Girls 17 WinS for Girls Module 8: Data Management Note-taking Key aim of Note-taking is to: • Record the main issues raised • Reconstruct the main flow of discussion Even when there is a recording, will want to take notes about who is speaking in an FGD. Can later match with the recording and transcript. http://www.acaps.org/en/deployments/yemen Allows you to see who is saying what, if there are consistent ideas raised by one person, if one person is dominating conversation, if some people do not speak at all. WinS for Girls 18 WinS for Girls Module 8: Data Management Note-taking Key aim of Note-taking is to: • Record the main issues raised • Reconstruct the main flow of discussion • Capture key quotes verbatim as possible, especially if no recording used Especially if no recording is captured, the notetaker should aim to capture some key ideas verbatim. http://www.acaps.org/en/deployments/yemen Can be then cited as actual statements from the participant when reporting. WinS for Girls 19 WinS for Girls Module 8: Data Management Note-taking Key aim of Note-taking is to: • Record the main issues raised • Reconstruct the main flow of discussion • Capture key quotes verbatim as possible, especially if no recording used Note-takers must develop an objective record of the discussion http://www.acaps.org/en/deployments/yemen Training imperative to teach best methods. Need people who can write fast, listen to new ideas while writing thoughts already said. WinS for Girls 20 WinS for Girls Module 8: Data Management Note-taking Key aim of Note-taking is to: • Record the main issues raised • Reconstruct the main flow of discussion • Capture key quotes verbatim as possible, especially if no recording used Note-takers must develop an objective record of the discussion http://www.acaps.org/en/deployments/yemen If no recording, note-takers may bias the data. Note-takers are selecting what information to capture in the notes, they need to be sure to capture all ideas. WinS for Girls 21 WinS for Girls Module 8: Data Management Note-takers Note-takers need to be trained to capture all information: • Retain colloquial language • Record body language and non verbal signals (sighs, extended silences) • Record group interactions as appropriate (giggling, etc.) • Clearly label notes (who is speaking) • Include notes on interruptions (if someone comes into room) http://www.acaps.org/en/deployments/yemen Note-takers should remind the facilitator of any issues overlooked during the discussion WinS for Girls 22 WinS for Girls Module 8: Data Management Note-takers Research Team Composition by Activity IDI • If recording: Interviewer • If NOT recording: Interviewer PLUS note-taker If no additional note-taker, note-taking by interviewer may distract participant, interrupt flow of interview, and make the interview take more time. FGD • If recording: Interviewer PLUS note-taker http://www.acaps.org/en/deployments/yemen Even when recording, note-taker is vital. Note taker records who is speaking to add detail to transcript. • If NOT recording: Interviewer PLUS 2 note-takers FGDs are harder to capture with notes. Two note takers should be involved to help capture notes. WinS for Girls 23 WinS for Girls Module 8: Data Management Transcription What is a transcript? A written record of the interview or focus group discussion Verbatim Transcription (Gold standard) • Exact, word-for-word replica of the interview • Captures true speech o Include slang terms, incomplete sentences, fragments • Aspects of speech that convey meaning and understanding o “uhmm,” “aha,” “ahh,” laughter, pauses, groans, sighs •Speakers should be identified Moderator, participant Sources for Slides: Qualitative Research Methods (2011) Hennink, Hutter, Bailey WinS for Girls 24 WinS for Girls Module 8: Data Management Transcription Also contains record of the interview from the note-taker/observer What might be included from the note taker’s perspective? Sources for Slides: Qualitative Research Methods (2011) Hennink, Hutter, Bailey WinS for Girls 25 WinS for Girls Module 8: Data Management Transcription Also contains record of the interview from the note-taker/observer • Includes participant interactions • Body language, gestures and facial expressions • If possible, should identify who said what within a Focus Group Discussion • Can be linked with demographic information to provide age, religion etc., which may in turn allow for deeper analysis Sources for Slides: Qualitative Research Methods (2011) Hennink, Hutter, Bailey WinS for Girls 26 WinS for Girls Module 8: Data Management Transcription Timing of Data Transcription During Data Collection Strengths Limitations Adjust questions Longer period of field work Interviewer reflection May need to adjust field logistics Clarification and follow-up Identify saturation Guide further field work After Data Collection Strengths Limitations Shorter period of field work Difficult to follow-up Difficult to identify saturation WinS for Girls 27 WinS for Girls Module 8: Data Management Transcription Logistics Time Consuming • 1 IDI can take a full day to transcribe • 1 FGD may take several days to transcribe • Requires spot-checking and review Can be LONG • 1 transcript may be 30 or more pages • FGDs over 100 pages If analyzing in language of transcription, should type transcript If translating after transcribing, can transcribe free-hand Need to have file to analyze in word document format WinS for Girls 28 WinS for Girls Module 8: Data Management Transcription Logistics De-Identification • Remove any identifying information mentioned by the participant • Names of individuals, companies, employers, etc. • Should not be able to pinpoint an individual by reading data Example: I always walk to school down Colquitt Ave with my friend Gloria and then we go to Ms. Anderson’s 5th grade class. What information should be removed? WinS for Girls 29 WinS for Girls Module 8: Data Management Transcription Logistics De-Identification • Remove any identifying information mentioned by the participant • Names of individuals, companies, employers, etc. • Should not be able to pinpoint an individual by reading data Example: I always walk to school down [street] with my friend [name] and then we go to [teacher’s name] 5th grade class. Put placeholders in place of information removed in bracket format [XXXX]. WinS for Girls 30 WinS for Girls Module 8: Data Management Transcription Logistics De-Identification • Remove any identifying information mentioned by the participant • Names of individuals, companies, employers, etc. • Should not be able to pinpoint an individual by reading data • Protect privacy and confidentiality of: • Participants • Other individuals mentioned by participants WinS for Girls 31 WinS for Girls Module 8: Data Management Transcription Logistics Cleaning • Label the data appropriately • Study population_method of collection_# • Example: Girls_FGD_6 WinS for Girls 32 WinS for Girls Module 8: Data Management Transcription Transcription Label At the top of every transcript: Topic: MHM in WinS in Schools Identifier code: Girls_FGD_3 (Participant_Method_Schoolnumber) Interviewer: Bethany Caruso Note-taker: Anna Ellis Date conducted: March 5th 2015 Location: School 3 Language: Spanish Number or participants: 6 Time of activity: 96:35 (minutes: seconds) Additional related data: Before/after activity sheet, photos of the activity sheet, ideal latrines Date transcription completed: March 8th Transcription completed by: Anna Ellis Date transcription reviewed: March 9th Transcription reviewed by: Bethany Caruso Date translation completed: March 12th Translation completed by: Candace Girod Date translation reviewed by: Anna Ellis Date Recording destroyed: March 20th?? WinS for Girls 33 WinS for Girls Module 8: Data Management Transcription Transcription Key The following symbols can be used as notation: Ellipses: Short pause … Two ellipses: Long pause …… Double parenthesis: transcriber’s comments((something fell to the floor)) Some talk was inaudible or unintelligible ((inaudible: 00:35-01:22)) For the noted recording time, silence ((extended silence: 00:35-01:22)) For the noted recording time, laughter ((laughter: 00:35-01:22)) For the noted recording time, phone ringing ((phone ringing: 00:35-01:22)) Dash: indicates an unfinished word Underlined word: emphasis on word word Time stamps Add the time of the recording every 3 minutes or when there is a silence, interruption, something inaudible. If there are issues with the translation, this helps us return to the recording and find the place where it was recorded easily. You can just put the time in parenthesis (minute: seconds). WinS for Girls 34 WinS for Girls Module 8: Data Management Transcription Transcription Key The following symbols can be used as notation: Ellipses: Short pause Two ellipses: Long pause Double parenthesis: transcriber’s comments Some talk was inaudible or unintelligible For the noted recording time, silence For the noted recording time, laughter For the noted recording time, phone ringing Dash: indicates an unfinished word Underlined word: emphasis on word … …… ((something fell to the floor)) ((inaudible: 00:35-01:22)) ((extended silence: 00:35-01:22)) ((laughter: 00:35-01:22)) ((phone ringing: 00:35-01:22)) word Example: Interviewer: What words do you use to describe menstruation? …… P1: We say ‘over the moon’. ALL: ((laughter: 00:35-01:22)) WinS for Girls 35 WinS for Girls Module 8: Data Management Transcription Software We will talk about software you can download for a free 14 day trial called ExpressScribe (http://www.nch.com.au/scribe/). There is a big download button, but that gets you only a short trial for a pro version. In a small paragraph next to it, you can see how to get the free version. This is great and easy to use. Get Express Scribe Free The free version supports common audio formats, including wav, mp3, wma and dct. Download the free version of Express Scribe here. You can always upgrade to the professional version for proprietary format support, including ds2 and mvf. Using this software, you can change the speed of the recordings so you can listen to them at a slower pace. This way, you will not need to stop and start the recordings as frequently. WinS for Girls 36 WinS for Girls Module 8: Data Management Transcription Software Directions Using this software, you can change the speed of the recordings so you can listen to them at a slower pace. This way, you will not need to stop and start the recordings as frequently. Directions for uploading a file: Open ExpressScribe. Select FileLoad Dictation FilesSelect fileload Directions for reducing background noise Highlight selected file Select File Special Audio ProcessesBackground Noise Reduction Directions for playing and adjusting speed Select file to listen to. Click Play. Above play button, there is a dial. Move dial to indicate speed. Directions for playing with intermittent pauses Select file to listen to. Select Control Play (with pases) Directions for playing at a specific time Select file to listen to. Select Control Jump to time WinS for Girls 37 WinS for Girls Module 8: Data Management Transcription Transcription Review •Transcripts should be reviewed for quality •Someone on the research team should listen to the recording while reading the transcript to note any errors •If the person who did the interview did not transcribe, this person should do the review WinS for Girls 38 WinS for Girls Module 8: Data Management Translation WinS for Girls Image: http://www.firsttranslation.net/images/img/translation.jpg 39 WinS for Girls Module 8: Data Management Translation Translation •Translation should be completed if the research team conducted the activities in a different language than that which will be used for analysis WinS for Girls 40 WinS for Girls Module 8: Data Management Translation Sequential Translation Step 1: Full transcription in the language of the interview - De-identified, reviewed Step 2: Translate the full transcript into English - Should be reviewed Strengths Limitations Will have 2 transcripts of same interview Time-consuming Retains original language Less error and loss of detail WinS for Girls 41 WinS for Girls Module 8: Data Management Translation Example Transcript from Kenya. Original language and English translation on same page. You can see where students were speaking partly in English and partly in Luo. WinS for Girls 42 WinS for Girls Module 8: Data Management Translation Tips for Translation •Important to have someone fluent in language used •Translate the conversation as is (verbatim) •Translate for meaning, not literal translation •Maintain words in the vernacular when appropriate and create ‘dictionary’ of terms Example: P6: In Hindu culture you can’t light the puja lamp at home until 7 days. You can’t go to the temple, or to God’s place. You can’t perform any rituals. You can’t touch anything or participate in any puja or festivities at home or elsewhere during that time. (54:32) Puja- Religious blessing, ritual We keep this word as is since it explains/ describes something very specific to the culture. 43 WinS for Girls Module 8: Data Management Data Management WinS for Girls Image: http://www.library.gatech.edu/research-data/sites/library.gatech.edu.research-data/files/images/whatisdigitalpreservation_hvaderdigitalbevaring_digitalpreservation.png 44 WinS for Girls Module 8: Data Management Data Management Protected storage of recordings • It is important when developing your research protocol, to identify how you will protect the storage of recordings. • In the 4 country study, we kept recordings on an external hard drive. • The external hard drive was kept in a locked file cabinet when not in use to protect privacy • We suggest having a double back-up (2 hard drives, locked computer, etc.) WinS for Girls 45 WinS for Girls Module 8: Data Management Data Management Protected storage of personal information/consent forms •Demographic information and consent forms should be collected from each participant •This information should be kept in a protected space (when on school grounds with head researcher; otherwise, in a locked file cabinet or container) •Demographic information should be entered into excel database as soon as possible. WinS for Girls 46 WinS for Girls Module 8: Data Management Data Management Protected storage of transcripts •During transcription process, files may be kept on a computer •Ideally this computer should only be used by members of the research team. •All files should be password protected WinS for Girls 47 WinS for Girls Module 8: Data Management Data Management Password Protection 1. In a Word file, select the File option in the top left hand corner WinS for Girls 48 WinS for Girls Module 8: Data Management Data Management Password Protection 2. Select the Protect Document option in the left-hand corner 3. A dropdown menu will follow; select encrypt document WinS for Girls 49 WinS for Girls Module 8: Data Management Data Management Password Protection 4. An Encrypt Document Box will pop up; enter your password into the box. Make sure you have already recorded your password in a safe place. WinS for Girls 50 WinS for Girls Module 8: Data Management Data Management Password Protection 5. A Confirm Password will pop up; re-enter your password into the box. This will ensure that you are using the same password. WinS for Girls 51 WinS for Girls Module 8: Data Management Data Management Password Protection 6. When you next open the document, a box will pop up asking you to enter the password. Enter it and press OK. 7. This should be done with all documents that contain sensitive information. WinS for Girls 52 WinS for Girls Module 8: Data Management Data Management Data Management File File Name Interviewer Participant Method Time started Time ended (FGD/IDI/KII) WinS for Girls Recorder Recorder File 53 WinS for Girls Module 8: Data Management Data Management Data Management File Transcriptionist Total Date Transcription Transcript Time Started Date Transcript Expected Completed Date Date Translation Transcript Translationist Expected Completed Completed WinS for Girls Date Translation Completed 54 WinS for Girls Module 8: Data Management Data Management Destruction of recordings Destruction of recordings required by Ethics Review. Recordings should be destroyed ONLY when all analyses complete. You may have a question about a translation during analysis and will want to go back to the recording for verification. WinS for Girls 55 WinS for Girls Module 8: Data Management Summary 1. If possible, research activities should be recorded by a digital/ tape recorder and recorded focus group discussions should also have a note-taker present. 2. Transcription should ideally be completed as soon as possible after the research activities. 3. Transcription should be verbatim, and include additional information from the notetaker’s perspective, such as nonverbal cues, gestures, etc. 4. Sequential translation (translating after a full transcription) should be completed if analysis will be conducted in a different language than research activities. 5. Data should be protected at all stages, during data collection, transcription and translation and after the completion of research activities. WinS for Girls 56 WinS for Girls Module 8: Data Management Templates and Tools Document Name File Name Template for Data Collection Plan Module_8_form_1 Key Informant Interview Database School Observation Survey Database Demographic information spreadsheet Time Estimation of Activities and Transcription Description This is a template for managing recorded data Module_8_form_2 Template for recording data from Key Informant Interviews. Module_8_form_3 Template for recording data from School Observation Surveys Module_8_form_8 Module_8_form_4 Transcription Template Module_8_form_5 Translation Guidance Module_8_form_6 Transcription Guidance Module_8_form_7 Template for recording demographic information about focus group participants This is a table estimating the time it will take to transcribe activities based on the Emory team's experience. This document is a template that lists all of the details that should be recorded about each activity transcript. It also contains a key with abbreviations and symbols that may be helpful to use throughout the transcript. This document gives instructions on proper ways to translate recordings with examples This document gives instructions on proper ways to transcribe recordings and suggestions for structure WinS for Girls 57