Field Resources This document is intended to provide an overview of the various field resources available to support you throughout a Voice of the Customer (VOC) project. Some companies can provide many of these services as a bundle. The advantage is having one project manager or contact to guide you through the phases. However, there may be cases when you want to use a variety of different suppliers. Resource Types: The grid below outlines the most important resources associated with each phase of the VOC process. Resource / Phase Central Location Facilities RECRUIT, INTERVIEW ANALYZE PRIORITIZE X X Call Centers X X X Sample Providers X X X Panels X Programming Providers X Finding Resources: The following sources may help you find research partners: - Quirks.com Greenbook.org Impulsesurvey.com Qualitative Research Consultants Association (QRCA) -- www.qrca.org Referrals from colleagues who have used great partners. Word of mouth is often the best source. Contact us if you need help finding a freelance research partner. © Applied Marketing Science, Inc 1 Qualitative Resources CENTRAL LOCATION FACILITIES A central location facility is primarily used for conducting face to face interviews (often called IDIs, indepth interviews, or one-on-one interviews) and focus groups. Benefits of a Central Location Facility: - Central location that is optimized for gathering respondents for viewing One way mirror or closed circuit viewing of the groups for non-invasive, live observations Neutral / unidentified location Can accommodate 4-12 clients for viewing (please inform the facility when booking about how many colleagues will attend so they can reserve an appropriately sized room) Respondents in the area tend to recognize the facility’s name from communicating with them in the past or having a friend who has participated. This gives the facility credibility during recruitment Capabilities and Services: - - Recruiting respondents from their own database or with a list provided. Audio and video recording (stationary, or operator-assisted upon request) Live streaming to allow those not onsite to view the interviews. While another company provides the streaming service (e.g., FocusVision or proprietary), the facility has contracted for their equipment so they can setup the live streaming for you upon request. Client and respondent meals of your choice can be delivered by the facility to the respondents and to you in the backroom Transcriptions are available upon request or you can collect the recordings and send them to an external transcriptionist for a lesser fee. Moderation is not typically offered by a facility but some do have moderators for hire or can refer you to an experienced moderator. (See moderator section) Printing and copies can be made by the host at the facility and this can save you time and hassle in bringing materials with you. Incentives are typically distributed by the facility at the end of the interviews as the respondents leave. Send a check for the incentives to the facility a week prior to the groups. Some facilities charge processing or distribution fees. There are also times when it may not be necessary or beneficial to use a facility: - Budget can be an issue as the facility rental fees and all the other extras add up quickly. © Applied Marketing Science, Inc 2 - - Distance can be an issue for respondents if they are scattered far away from the facility. Remember to conduct interviews in locations that are convenient for respondents to maximize the likelihood of participation. National reach may be an important objective for your study. If you are trying to recruit just a few people per region or state to speak with, going to many (5+) facilities around the country can be time consuming, expensive, and logistically difficult. In this case it may be best to see if alternatives are feasible for this project. Alternatives to facilities: - - - - Hotel meeting rooms can work well but there are a few challenges to keep in mind: o Meeting rooms are not set up for interviews this purpose and hotels may not be familiar with the needs of market researchers. Be very clear in your communication with their staff to ensure they understand exactly what you need. o You may need to adjust the room to your liking, setup your own recording, and a closed circuit camera that feeds into another room used for viewing, or set up live streaming. o Need to act as the host for these respondents or hire one since you won’t have one like in the facilities. This means giving them clear direction for getting to the hotel and room, looking out for them as they check in, offering them refreshments, having them sign any confidentiality agreement, and paying their incentive once the interview is completed. o Not knowing the size or layout of the room can bring up issues since they are not designed for focus groups or interviews. This can be even more challenging when you need an additional room for client viewing. Be sure to ask for these details and envision the type of setup you’ll need for your project. Interviews held at the respondent’s place of work or the moderator’s offices may work well in some circumstances. However, keep in mind some of the logistics mentioned above and be sure that the respondent has permission from their employer for your arrival and possible video recording. It is helpful to ask the respondent ahead of time about the layout of their office, because if they are located in a cubicle or central space, it could interrupt your interview, release confidential topics, or affect your recording. Coffee shops, restaurants, or other public locations can be great neutral territory for conducting interviews. However, these locations can get crowded and have quite a bit of background noise and offer no privacy and would be unacceptable for confidential topics. Further, you will have to check in the location ahead of time to see if they allow video recording if you need that. It’s recommended to give them business for using their space and to do avoid any disruption with their normal business. Additionally, as with some of the other methods mentioned above, the host logistics apply. Telephone is a great alternative for cost savings and when dealing with a wide geographic group if video recording is not necessary and there is little to no stimulus that the respondent will need to react to. While this may also be better for sensitive or confidential topics, it can be more challenging to build rapport than in-person. © Applied Marketing Science, Inc 3 CALL CENTERS Most facilities have a call center or work with an external one to recruit for their groups and/or IDIs. Most facilities, but not all, will even recruit respondents to meet and interview outside of their facility. However, since they prefer to have you use their facility, there are cases when they won’t. If this is the case or you need a national reach (some facility chains can be limited to a database within their network), call centers are available as a standalone or a resource within a larger research company. It is especially important to seek out the right call center for difficult recruits. Some call centers specialize in B2B vs. B2C recruiting arrange their calling hours according to availability of their target audience. Here are some things to consider when finding the right call center to partner with: - - - - - - Are you trying to reach high level or difficult to reach professionals? It is important to speak with the call center you are bidding with for a project and understand their familiarity with your target audience. A proactive call center that can get referrals, navigate through challenging gatekeepers, and conduct research to support a lead is very important on difficult recruits. How much time do you have for fieldwork? Whenever telephone work is involved, it takes longer than it would online. Whether the call center is recruiting respondents to participate in an interview at a later time or they are doing interviews on the spot, this phone work will take time. Please plan at least 2-4 weeks for any telephone work. Tougher audiences or larger sample sizes can take longer. Review timing expectations with the call center so they can plan accordingly or recommend a more feasible timeline. Are the hours they call during the best for the target audience? Is the call center accommodating the time zone of the respondents? Many call centers will charge per recruit not complete. That means they may recruit 100 people to your survey but if only 50 of them complete it, you will still need to pay for the 100 recruited plus any more that you need to reach your final 100. Call centers can usually advise on how many people they need to recruit to reach the desired number of completes. What languages do they speak? Make sure that the call centers you use can accommodate all the languages of your study. Who is paying the incentive? Confirm with the call center if they will collect the respondent’s information to pay the incentive or if you need to do this. Keep an eye out for fees as they will usually charge processing fees. How will they deliver the final data? Whether they need to send over results of how the calling went, answers to the survey questions, or anything else, be sure to specify the format you want it in. How much sample do you have? The amount of sample available to you will change the call center's strategy. The less sample you have the more precious each piece is, so they will need to © Applied Marketing Science, Inc 4 - - carefully track conversations they have with potential respondents, when to follow up with them, who they are being referred to, and more. Do you want to observe the interviewing quality? It is your option to request that the call center send you recordings of their calls and interviews. This can be helpful for you to understand if you can improve the survey. Reading your written survey to yourself is one thing but hearing an actual interviewer with the respondent can offer great insight. Does the call center offer other services as well? Bundling services tends to save money. If you find a call center that can also do your programming, buy sample for you, and do other things that you need for the research study, they might be able to offer you a discount for doing everything through them. SAMPLE PROVIDERS While many of your partners can arrange to purchase sample for you and they may even have bulk price breaks, there will still be times when it is advantageous to purchase your own sample: - Calling or sending email invitations internally Want to personally manage the sample list and set priorities for different numbers Want to use the sample purchased with multiple vendors/partners Want to purchase sample from multiple sources and de-duplicate the lists against each other Only need to buy a small number of targeted sample Here are some additional considerations when looking for a sample provider: - - - Minimums: Many sample companies have minimums that can range from $500-$2,500 and even if you only need a small amount of sample you will be required to pay this amount. Email Addresses: Almost all sample companies will sell you a list of phone numbers but not many will sell email addresses. Sample companies tend to rent email addresses meaning you can provide the email invitation and the sample company will send that to the email list you purchase for a charge per email and a charge per completed interview. Unadvertised sample providers: Whether you are trying to reach a difficult audience or you want to buy a sample list with email addresses that you can use yourself or use again in the future, associations or publications can be a good alternative. Consider reaching out to associations and publications established specifically for your target audience and see if they have opt-in lists that you can buy or rent. Information to Request: It is important to find out all of the information that will be included per sample piece. There is a big difference between calling a company and asking for the owner and calling a company and asking by name to speak with the owner. Generally speaking, the more contact information that is available, the better your chances of reaching them. Here are some items that can be included in the sample that should be confirmed: Company Name, Company Main Phone Number, Company Main Email Address, Contact Person Name, Contact © Applied Marketing Science, Inc 5 - Person Title, Contact Person Direct Phone Number, Contact Person Email Address, Company Revenue, Number of Employee, Headquarter Location and Additional Locations Sample Amounts: The more difficult it is to reach your target audience the more sample you will need. Please be sure to order enough sample to accommodate the number of completes that you will need. Most sample providers should be able to help you calculate the list size needed for the desired number of completes. MODERATOR SERVICES Most research companies will have their own moderators or can recommend a moderator. Otherwise, utilizing LinkedIn or speaking with a trusted colleague can be the best way to find a qualified moderator, especially since there are many freelance moderators in the industry. When looking for a moderator, keep in mind: - - - Distance from your office and the location of the research is important to think about since you will likely have to pay their travel expenses. Type of focus group techniques they specialize in is helpful to know. While most will not have a problem doing VOC interviews, some may need to be briefed on the technique in order to conduct the interviews. Audiences they specialize in (e.g., children, CEOs, doctors, etc.) may not be an issue with the average group but please keep in mind that some audiences, such as children need special attention, accommodations, or interviewing techniques. Will they be appropriate for the interviewing audience? For example, if the topic is a sensitive one for women, having a man moderate could prevent openness and opportunity to build rapport. INTERNATIONAL RESEARCH International recruiting requires a lot of outsourcing due to distance, language, and custom barriers. The advice presented so far can apply to international work as well but due to the additional barriers, it is recommended to find a trusted partner that can help manage international work. Here are some benefits from a partner to consider when doing international work: - - They already have their own trusted partners around the world which can save you time from reaching out to each country or region individually. They know cultural customs, local holidays, and understand how people will respond to the survey content and can advise on any changes that would help with recruiting or clear responses during the interviews. Translations can be setup by them directly. © Applied Marketing Science, Inc 6 - - They can arrange simultaneous translation in whichever languages you need during the interviews themselves then they can accommodate having the interviews translated for transcription. They know moderators who work in the native language and can communicate project details with them. Some partners will be very accommodating to the point where if you travel to the study location, they can meet you and offer their help as a guide in a region that is new to you © Applied Marketing Science, Inc 7 Quantitative Resources PANELS These are companies that have established a relationship with people online. While some panels are invitation only and they seek out potential respondents once the person has been validated as real, others advertise about their panel and new members can join by visiting the company website. Either way, these panels have an established respondent base who they profile regularly and maintain a connection with. There are many panels out there but you’ll notice that a few players are used widely in the industry due to the vast amount of people registered on the panel. When seeking out a panel to partner with, here are some key factors to discuss and consider: - - - - - Do you need a domestic or international reach? There are panels for respondents all around the world. There are plenty of choices for panels in the US but keep in mind that some of these can meet your international survey needs as well. Some markets may require using a local panel but, whenever possible, try to use as few panels as possible. What are you expecting from the project manager? Panels do not only work during typical business hours. Because respondents look for their survey opportunities during various times of the day, it is common to send out invitations to panelists in the evening and on weekends. To accommodate this, please be sure your project manager can provide evening and weekend coverage. Further, set clear expectations of what you need from them ahead of time in terms of speed or frequency of communication and updates. How large is the panel? The size of the panel may be important but not always. A large panel is great for finding respondents in general so if you want to speak with a lot of people and you have few screening criteria (e.g., women aged 18+ who buy jewelry) this is your best bet for low costs and a quick turnaround. When you are trying to reach a difficult audience it is important to understand how large their panel is and if they have enough of the type of people you are looking for. A panel can be vast but if they don’t have the type of people you need to speak with, it’s irrelevant. What industries does the panel specialize in? A small panel can work just fine if they have your target audience. Some panels specialize in particular consumer types or professional industries. There are panels that are exclusive to the healthcare industry or Hispanic consumers. They build credibility over time with their panel members and learn the best techniques to accommodate that particular group. Finding a panel that is an expert in your target audience will reduce costs and timing and they can offer advice on how your survey can better speak to that audience. Is your target audience available online? There still are audiences that have little to no online presence. Think about a construction worker who is out on site all day and never sits at a computer desk. He may be reachable once he gets home and signs on his computer but if this isn’t something he does each night, it will be difficult for him to be reached online to complete a © Applied Marketing Science, Inc 8 - - - - survey. If you are doing research with people who have visual impairments, it would be best to call them for an interview than to ensure they have the right technology to complete an online survey. Consider any challenges to reaching your target audience online and getting them to sit at the computer for your survey’s allotted time. Are you click-balancing? Especially when surveying the general population, to ensure statistically valid data, many market researchers ensure that they have a balanced population entering the survey. This means that the group of people in the survey should represent your target universe or population. For example, if the U.S. has 51% women, of all the people you are inviting to your survey, you want 51% of them to be women. Do you know your incidence? Incidence is important to understand for costing and feasibility purposes. If you survey 100 people and only 5 of them qualify to take your survey then your incidence is 5%. If you know that your incidence is 5% and you need 100 people to take the survey but the panel only has 200 of those type of people, then you know the project will not be feasible because at that incidence the most amount of completed surveys you could get would be 10. The higher the incidence, the lower the cost. Usually a partner can help you determine your incidence. Some panels will even offer incidence check services. How quickly can they field? Incidence also affects fielding times as well as the size of the panel. A high incidence study with a large panel can field very quickly, in a matter of days or hours. However, a lower incidence, a tougher target, or a smaller panel can lead to needing longer field times. Communicate with your partner on the expectations so that you can build this in to your overall timetable. Is the incentive included in the cost per interview or an additional charge? Many panel companies will give you a CPI (Cost per Interview) or CPC (Cost per Complete) and this will include the cost of them to pay the respondent an incentive. However, since this is not always the case, be sure to ask the panel how incentives are handled and if you need to budget them additionally. CALL CENTERS There are certain circumstances where it may be beneficial to use a call center to conduct your research for a variety of reasons: - Target audience does not work at a computer Target audience is difficult to reach by email Target audience is busy or not engaged online and needs someone to motivate them to take the survey Visual impairments Need for rapport, explanations, probing Even if your survey is best completed online, you can utilize a call center to recruit your respondents to the survey link. This way the respondents can be reached by phone to ensure they have the information © Applied Marketing Science, Inc 9 to participate then they can complete the survey online in their own time. The call center can follow up with respondents to remind them to complete the survey. Sometimes this is the extra nudge people need. Please keep in mind that you will be charged per recruit rather than per complete. This can add up quickly since you may need to recruit three people just to get one person to complete the survey. All notes from the qualitative section about call centers will apply to quantitative fielding as well. SAMPLE PROVIDERS When doing a quantitative study, often times a panel is used and they will provide the sample. In cases where they need more or you are using a call center for the study due to low online presence, you may need to purchase your own sample. All notes from the qualitative section about sample providers will apply to quantitative fielding as well. PROGRAMMING PROVIDERS Many partners will have this service available and you can bundle with other services provided by that company or you can find an independent programmer. Here are some important questions to ask when working with a programming provider, especially if someone from a different company will handle the fieldwork: - - What software are you using to program the survey? There are many types of software available for programming and while some are proprietary, there are standard ones in the industry that many companies use. Depending on the complexity of your survey, some programs have limitations that may not work for you. Understand what type of survey you are having programmed before choosing a provider and have a draft ready for the potential provider to review before signing on with them. Who is responsible for testing and finalization? Even though a great programmer will test the survey thoroughly and have someone else test their work, it is important for you to test the survey yourself because: o It’s helpful to have another set of eyes outside of the person who programmed the script. Depending on how complicated the survey is, it will need a lot of testing to ensure all potential answer patterns are error free and are returning the right data. o The programmer is going to follow your instructions exactly. If you make an error such as screening out all women in your survey instructions but you meant to only speak with women, the programmer is not going to realize that objective and will just program the script to your exact specifications, even if you made an error. o Reviewing a survey in a word doc is very different from reviewing it in true survey form. You may notice issues with the flow or the questions may not be as clear or elegant once laid out in the planned program on screen. Be sure to take the survey © Applied Marketing Science, Inc 10 several times from the perspective of the respondent. Envision that you are one of the respondents taking this survey so that you can look for any areas of confusion, confirm how long it takes to complete, or even places where taking the survey is cumbersome or hard on the eyes. The better experience the respondent has while taking the survey, the more valid the answers and the higher the response rate. For any other questions or advice related to fieldwork logistics and resources, please reach out to AMS’s Manager of Field Operations, Angela Holloway, at aholloway@ams-inc.com or (781) 250-6336. © Applied Marketing Science, Inc 11