Research Process Slide 1 Welcome to this presentation about stages of the research process. This particular PowerPoint presentation is more to provide you with an outline and less to provide you with verbiage from me. Slide 2 (No Audio) Slide 3 The important issue to grasp from these first few slides is that research is a multi-stage process that is somewhat cyclical. The stages can occur concurrently; they may occur as first, second, third, and back to first, so the linkages are both forwards and backwards. Research is a multistage process and each stage relates to the other stages in a meaningful way. Slide 4 (No Audio) Slide 5 The first stage is “Problem Definition.” It should be pretty obvious, at this stage of your undergraduate education, that if you can’t define the problem properly, then it will be impossible to find the appropriate solution. Slide 6 (No Audio) “The formulation of the problem is often more essential than its solution.” –Albert Einstein Slide 7 As future businesspeople, it is important for you to understand that the problem is not always obvious, often because the cause of the problem is not readily apparent. Hence, the “Iceberg Principle”: the dangerous parts of the problem may not be obvious. It is the job of both the manager and the marketing researcher to identify the appropriate problem despite this possibility. Slide 8 Fortunately, there is a basic process by which problems can be defined and this flow diagram illustrates that process. The first step a good researcher will take is to ascertain the decision maker’s objectives. What does the decision maker want to do or need to do? The second step is to discuss the problem with managers in sufficient depth so that subsequent research can follow from this rich background information. The third step is to isolate or identify the problem as opposed to the symptoms. The next step is to determine the unit of analysis—households, mutual customers, organizations—so that who will be evaluated is identified. The fifth step is to determine what information we should gather from or about those units. The last step is to identify the research questions objectives. Part of the course project often assigned for an inclass marketing research course is writing a brief research proposal. When I require my students to conduct such studies, that proposal is dominated by two things: identification of a research problem and a list of questions associated with that problem. Page | 1 Slide 9 Marketing managers may have very different, yet very reasonable objectives. The example I have here is immediate versus long-run increase in sales or profits. Clearly, the goals of that research might all change markedly based on whether a short-term or a long-term increase is sought, the nature of the manager’s needs, and the type of study that might be done. Regardless, whatever those objectives may be, the managerial goals must be expressed in measureable terms. Otherwise, it’s impossible to assess whether or not the results are favorable or unfavorable. Slide 10 As I mentioned in the first lecture, a good researcher will avail him or herself of existing managerial expertise and try to understand the background for the current research problem. Fortunately, middle and upper managers love to talk about their work. For whatever the reason, sometimes it’s an opportunity to brag or share their situation with someone else that is informed and is interested. Regardless, middle and upper managers are not shy about providing as much background as a researcher would need to effectively conduct the necessary marketing research. Slide 11 Also consistent with what I mentioned during the first lecture, a good marketing researcher will help a manager to structure and to understand the true problem. Often, managers are so caught up with the symptoms that they don’t understand the disease. This slide illustrates how those symptoms can be confusing. As a result, the manager may be unaware of the true problem. Slide 12 Still thinking in terms of the problem definition process, which is the first stage of the overall research process, what we should be concerned about is the unit of analysis. As I said before, this could be individuals, households, and organizations. Without understanding the appropriate unit of analysis, it’s impossible to draw the appropriate sample or conduct the appropriate type of analyses. In many studies, family rather than the individual is the appropriate unit of analysis. This may be true of consumption studies. Marketers have long been interested in family dynamics and decision making for the purchase of consumer durables. What is the dynamic between spouses in selecting an automobile or a home? Without a sound understanding of that process, marketers are flying blind as far as providing the best possible product. Slide 13 The fifth step in the problem definition process is to determine the relevant variables. In this case, we must assume that we are trying to determine variables that are measurable in some way. The list in terms of types—categorical, continuous, dependent, and independent—will be discussed in subsequent lectures. Categorical just means categories or nominal (naming) or putting people into groups; market segments, for example. Continuous is more of interest to physicists than marketers, who typically deal with discrete data. Yet, we often deal with ordinaland interval-scaled variables. Dependent and independent variables deal with the focus of the study. As the words indicate, dependent variables depend on the values of the independent variable. What we’re often looking for here are forecasting models meant to predict the value of a dependent variable by looking at a series of associated and reflective independent variables. We might want to predict home-buying behavior during the next quarter or the next year by Page | 2 looking at the things that are related to future home-buying behavior, such as growth in disposable income, growth in investment income, and consumer sentiment. Slide 14 Finally, the last stage in the problem definition process is to convert or translate the marketing problem into researchable objectives. Those of you in an in-class version of MKTG 310 will conduct a marketing research study this semester will need to write a proposal that includes a research problem—which is the marketing problem—and associated research questions. This translates into the research objectives. Slide 15 The next three slides provide examples of research problems and associated researchable questions. Slide 16 (No Audio) Slide 17 (No Audio) Slide 18 Here’s a list of basic questions that marketing researchers would ask in trying to define the research problem. Certainly, researchers would want to know the purpose of the study. Researchers would try to ascertain how much is already known because there is no reason to re-invent the wheel, especially when that re-invention will be costly to the manager soliciting the study. Researchers would be interested in additional background information that might be unavailable to the manager and need to assess how that information could be acquired. Researchers would want to ascertain what needs to be measured and how it will be measured. Are we looking at conducting survey research or are we going to do something like a focus group? These are the kinds of techniques we’ll discuss throughout these lectures. If we are talking about information that has already been collected, what we call secondary data, can it be made available? Sometimes that information has been collected by the company itself, but the accountants may be reluctant to rearrange it so that the marketing manager can use it for decision making. There even may be issues about whether or not the research should be conducted, either because it’s of insufficient value or ethically problematic. As researchers must develop a problem definition, they’ll want to express it in the most rigorous terms—something called a hypothesis. Slide 19 A hypothesis is a formal, testable statement that can be refuted by empirical data. Managers may have all sorts of hunches or guesses or beliefs about how their markets work, but a hypothesis is a formal statement of a belief or hunch that can be tested rigorously by market research. Slide 20 Often, exploratory research is a necessary prelude to developing hypotheses. It’s possible that the marketing researcher may not understand the underlying process sufficiently to develop a formalized, testable statement, in which case exploratory research is a preliminary step. Different types of exploratory research include reviews of secondary data, conducting pilot studies, doing in-depth interviews with people who have requisite experience, and case studies. Page | 3 Slide 21 Perhaps this slide best depicts the role of hypotheses in the research process. We start with a purpose, which helps to generate some research questions that are informed by exploratory research, managerial experience, and basic marketing theory. All of these go into developing formalized hypotheses that then can be tested through marketing research. Slide 22 We are finally finished with that first stage of the research process, which is defining the problem. Now we are onto the second stage, which is to develop the research design. The research design is basically the master plan for the research that will follow. This specifies the research method as the basic methods that the researcher will use to conduct the necessary study. Slide 23 Here’s just a sample of some basic questions researchers need to ask in attempting to formulate basic research designs. They need to understand the types of questions that need answering and whether or not the type of answer is the result of conducting a descriptive study, which for our purposes we’ll call a questionnaire, or a causal type study, which we’ll call an experiment. I’ll broach both of those topics in the next lecture. A researcher would need to understand the source of the data for conducting that research and whether or not it’s possible to get the answers that are needed by merely asking people. Often, we discover that people are unaware of their reasons for doing things or are incapable to responding meaningfully to questions that we might pose to them regarding their preferences or opinions. So it’s possible that merely asking people will be insufficient or it may also be that we prefer not to ask them. They may be unable to give us accurate answers and we may be able to ascertain what we need to know without asking or bothering people to fill out a questionnaire or to respond to our phone inquiries. A researcher would need to know how quickly management needs the information. Again, marketing research can be good, it can be fast, it can be cheap, but it can only be two out of those three simultaneously. If the information is required quickly, then the expense will rise markedly for an adequate quality research study. If a survey is required, a researcher would certainly need to know how the questions need to be worded. There are all sorts of tricks of the trade in designing good surveys. One final question that a researcher might think about, in terms of research design, is if an experiment is to be conducted, then what is the experimental manipulation? What will the researcher ask one group of people to respond to and how will he or she compare that response to a group of people who receive something else to respond to? Slide 24 Here’s a more comprehensive list of the basic questions a marketing researcher might ask when planning the design of a marketing research study. Slide 25 Step three is selecting the sample for the research. Often, what we’re looking at in marketing research is a sample of individual customers, but other times the sample could be households, Page | 4 companies, or municipalities. Regardless, the next step is to identify the unit of analysis and to identify a sample that will have elements consistent with that unit of analysis. Slide 26 Here’s a list of basic questions that I’ll address during my lectures on sampling and the sample design. As a prelude to those lectures, here’s a list of those basic questions: Who or what is the source of the data? Can the target population be identified? (Target population here means population of interest.) Is it necessary to draw a sample? Instead, is it possible to query everyone in the population (in which case we’re talking about a census)? Many of the questions regarding sample size are related to accuracy and the way in which the sample is drawn from a larger population. In many commercial studies, researchers are required to use commercially available lists, and those lists sometimes are incredibly flawed. I was forced to use one list in a study of people who recently moved, and that list included people who hadn’t moved in 57 years. After doing a careful analysis of this $4000.00 sample, I discovered I would have been as well off contacting people randomly via telephone. In that particular case, the sample was poor because the list from which I drew potential respondents was poor. Researchers also may need to assess whether or not a probability, or scientific sample, is necessary. For some research purposes, convenience sampling—a type of non-probability sample—is much less costly and might be appropriate. It’s possible that only a local sample is needed or a regional sample, as opposed to a national sample, and that might affect the methodology used. For example, if I need to draw a national sample and I’m concerned about cost, then I probably want to collect respondent data via mail. For a local sample, I can use telephone or other methods. A national or international sample, for example, might be much better conducted by the Internet. Knowing something about the scope of the sample would be useful. The size of the sample is clearly important, if for nothing else, to keep data collection costs within budget. From my experiences as a consultant, I can tell you that data collection cost is a large share of total study cost. Finally, the research must decide on the sampling unit. Slide 27 (No Audio) Step #4: Data Gathering Stage Slide 28 The fourth stage is collecting the data. In this domain, here are some basic answers I, as a researcher, would need. I’d want to know who is responsible for gathering data. If it’s an independent field service, then I’d like some control over the way in which interviewers queried respondents, either by telephone or by mail. I certainly, if I’ve been given a time horizon for the completion of the study, would like to know how long the data collection folks need to collect the data, because if they take longer than I planned, then I’d have less time to analyze the data and write a report. I’d be concerned about the level of supervision that’s required. For example, telephone surveys typically are fielded by data collection services that have supervisors monitoring calls out of phone banks. Supervision in this case is fairly straightforward. For personal interviews, the level of supervision may be vastly different, so I’d be concerned about the research company verifying that at least ten or fifteen percent of interviews were conducted as indicated by the field service workers. The final answer here might entail the basic procedures that the data collection folks will follow. Page | 5 Slide 29 (No Audio) Step #5: Data Processing and Analysis Slide 30 Step five concerns the technical questions about data processing and analysis. How will the data be edited and coded? Extensive expertise is required if we’re dealing with open-ended questions. Alternatively, if we’re looking at the entry of responses to close-ended questions— the type of questions that are scaled 1 to 6 or 1 to 7—then minimal expertise is required. How will the data be categorized? My ability to analyze data depends on the way I can group it. If you’re conducting a research project for this course, then you might like to know what kind of statistical software will be used. I recommend for your class project, if you need to complete one for this course, that you use SPSS, although you could force spreadsheet software like Excel to do the necessary analyses. The nature of the data could be qualitative, in which case we might be looking at people’s openended and rambling responses to questions. If we’re looking at close-ended data, which I’ve indicated is much easier and more straightforward to analyze, then we might be concerned about the number of different responses that would need to be considered simultaneously. Although somewhat beyond the scope of this course, marketing researchers often need to look at the effect of multiple variables on a single variable they are trying to predict. Slide 31 The value of a research study is only as good as the weakest link in the chain of the process that I’ve outlined throughout this lecture. Even the best conceived and best conducted study will be useless if the results of that study are not meaningfully presented to management, so that it can be used effectively to make the best possible decisions. Slide 32 It’s always a good idea to understand your audience if you’re going to make a presentation, so as a researcher responsible for the report writing and presentation, I would want to understand these kind of issues. Who is going to read my report? That’s critical because that determines the level of technical expertise I assume in writing it. If specific recommendations are requested, then I know I’m responsible for making them and I need to include them and justify them in my report. If I’m merely providing information that managers will use to draw their own conclusions, then perhaps my providing recommendations is unnecessary. If presentations are required, as part of the budgeting process, I might want to know to whom those presentations will be made, how many I need to make, and where I need to make them. Finally, I might want to know about a preferred format for my report. The degree to which it should be formal or informal may depend on corporate culture and the need to please the manager(s) who ordered the study. The less I understand such preferences and constraints, the more unlikely I’ll submit the kind of report for which the manager(s) intended to pay. Slide 33 In guaranteeing that the most useable report is created, it would be helpful for both the researcher and the manager to see tables of dummy results. If I, as the researcher, can provide those dummy tables to managers, then they can provide me with feedback about how helpful that particular set of tables would be to their decision-making process. Page | 6 Slide 34 Before beginning a study, both the manager and researcher might ask these final, checklist-type questions to confirm the wisdom of conducting that study. Both the researcher and the manager might want to confirm the cost of the study, as that’s a critical component to its value. Studies inherently require different times to complete and both the manager and the researcher would need to confirm that the timeframe for completion is acceptable. If outside help is needed, both the manager and researcher would need to identify that outside help and make certain it’s accessible. The manager and researcher must confirm that the research they plan to conduct will address the research objectives. Finally, given budgetary and other concerns, both the researcher and the manager must confirm the starting date for the research and that the date is commensurate with the decision-making needs of the manager. Slide 35 Here’s another more detailed checklist. In this case, this checklist was designed for postresearch assessment. Slide 36 To recap the marketing research process entails the following six steps, which are confronted iteratively. First is identifying the problem. Second is specifying the required information. Third is designing the data collection methodology. Fourth is managing and implementing the data collection process. Fifth is analyzing the results of that data collection process. Sixth, and by no means least important, is communicating those findings effectively as well as the implications of those findings to managers. Slide 37 (No Audio) Page | 7