Focus Group Training Conducting Focus Groups with Visitors who Are Blind/Low Vision © 2011 Museum of Science, Boston, Research and Evaluation Department and Art Beyond Sight, New York City 1 Focus group purpose To gather information that can inform the development of pilot programs that meet the needs and interests of visitors who are blind or have low vision To provide professional development for museum professionals 2 Why conduct evaluations It is a critical element in… Creating responsive institutions Acknowledging diversity Promoting self-directed learning Testing our assumptions Proving our worth Improving our efforts 3 Focus groups as evaluation tool Helpful for learning about visitor interests Identify broad themes and trends Encourage discussions Not useful for quantifying responses Not useful for closed-ended questions 4 Focus group logistics Take IRB online course on research with human subjects (if needed) Recruit focus group participants Have participants complete a pre-focus group survey Prepare participant consent forms Arrange accessible space and test your recording equipment Arrange to have one or two note takers 5 IRB online course We advise the person leading the focus group museum to go the National Institutes of Health (NIH) Training site (link below) and take the training on research with human subjects. It is not legally required for people running focus groups for their own information, but is if the results are to be shared outside the institution. Should you and/or any partners you have re the focus group want to publish information about the outcomes, it would be good to have all bases covered. If you’ve run focus groups before, you or the person who runs them has probably taken this online training. http://phrp.nihtraining.com/users/login.php Recruitment Adults who are blind/have different types of low vision Adults who are interested in culture (art and architecture, history, the sciences) Individuals with diverse experiences Museum-going habits Professions/interests Disability (blind and low vision) People with disabilities – not service providers 7 Recruitment sources Colleagues – ask if staff at the museum or on its Board have relatives or friends with vision loss National Federation of the Blind: Contact your state chapter for referral to members in your area American Council for the Blind: Another national membership group Lighthouse and other service organizations in your area Blinded Veterans Association or local veterans organizations Senior centers, state libraries for the blind Release form When participants arrive for the focus group, ask them to sign a release form (see sample provided). If possible, have this form available in braille and large print. If this is not possible, read the form and use a signature guide or ask if you may position the person’s hand on the signature line. Recruitment and pre-focus group survey tips You need a minimum of 8 people with vision loss at the focus group. Because of transportation difficulties for people who cannot drive, expect lastminute cancellations. Thus, consider inviting 10 or 12 people. Ask participants if, generally, they are accompanied on museum visits by a family member/sighted guide. If yes, invite that person to the focus group, too. Just be sure to indicate in your notes and transcript which statements were made by a companion. Get the pre-focus group survey (see sample provided) from all participants before the day of the event. It could be done by email, or via a short phone interview. Space, audio recording Let participants know where the restrooms are (give precise directions) and, if you have coffee, tea, water and any snacks available, let them know where they are in the room. Check recording equipment to ensure that all participants can be heard. Make a little seating chart (map) for yourself to refer to, if necessary, so you can address participants by name – helpful for when the tape is being transcribed and also for people who cannot see to know who is speaking. Taking notes Designate a note-taker(s) Develop a participant key for note takers, too, i.e., map of the table re participants Note who says what during the conversation; also note non-verbal interaction (e.g., nodding by group) Do not paraphrase: Record exact words and phrases Record the questions and the responses 12 Asking questions Use the protocol as a guide, not a script Start with required questions Probe and ask clarifying questions Make sure all voices are heard Record names during introductions and use names to encourage responses Encourage positive and negative responses Use a round-robin technique if necessary 13 Asking questions — probing Probes are questions you ask to learn more about statements already made Strong probes are open-ended “Tell me more about that” Weak probes are… Leading – point toward a “correct” answer Closed-ended – limits the response 14 Asking questions — listening Note participant comments you would like to learn more about Refer back to participant statements Pause and allow time for silence Do not correct participants Do not provide information about the museum (until the end) 15 Asking questions — clarifying Effective listening helps you to ask clarifying questions: “You mentioned that your last visit to the museum was uncomfortable. What made the visit uncomfortable?” “I’d like to go back for a moment to something you mentioned earlier, how you said you like experiences that are hands-on. Could you tell me more about what you think of when you say ‘hands-on’?” 16 What we hope to learn What are the elements of a museum education experience that are important for visitors who are blind/have low vision? What kinds of experiences will encourage repeat visits? What kinds of experiences might discourage future visits? 17 Focus group protocol Divided into three sections Welcome and introduction Current museum experiences Future museum experiences Open-ended questions Closed-ended questions can be asked on a survey Required and optional questions 18 Personalizing the protocol You can… Make slight changes to question wording Add one or two new questions Write your own program descriptions Provide museum information at the END 19 Probing Probing elicits deeper responses Strong probes… Are open-ended Directly connect to the participants response Encourage explanation and elaboration Weak probes… Are closed-ended Make assumptions 20 Probing What questions might you ask in response to the following statement: Q: Do you go to museums often? A: Not anymore. I used to. I used to basically live in them. When I traveled I always spent all my time in museums. 21 Example probes Stronger probes What changed for you that you no longer go? What could a museum do to make you want to visit again? What did you enjoy about your visits? Weaker probes Does this make you angry? Would you visit if a museum was free? Probing What questions might you ask in response to the following statement: A: I like an art museum to show me something I've never seen before or to see things in a new way. 23 Example probes Stronger probes Tell me more. Would you mind sharing an example with the group? Weaker probes Is this because you go to museums to learn something? Do tactile experiences help you to see things in a different way? Practice run If possible, have a few colleagues serve as “participants” in a run-through of the focus group. This will give you an idea of how much time you can give to each section of the protocol. (The focus group should be under two hours, including time spent getting consent forms signed.) It will help you develop effective prompts. It will also provide practice for your note taker(s). in writing down exact quotes rather than paraphrasing responses. 25