Ethnography Hudson A How to Guide for the Ethnographic Method By Carl Hudson 1 of 11 Ethnography Hudson Table of Contents Introduction ..................................................................................................................................... 3 A Brief History ........................................................................................................................... 4 Significance of Ethnographic Research ...................................................................................... 4 Methodology ................................................................................................................................... 4 Design Cycle ............................................................................................................................... 4 Procedure .................................................................................................................................... 4 Step 1: Preparation............................................................................................................ 5 Step 2: Conducting the Field Study .............................................................................. 5 Step 3: Analysis of the Data ............................................................................................ 6 Step 4: Reporting ............................................................................................................... 6 Potential Problems ...................................................................................................................... 7 Example: Taxi Cab – Dispatch System .......................................................................................... 8 Annotated Bibliography ................................................................................................................ 10 2 of 11 Ethnography Hudson Introduction Ethnography is a method of research typically used in anthropology and sociology. This document is a brief guide to conducting such a study. It is in no way complete. Perfecting the methods could take years and vary enormously from one context to another. Because of its origins in social science, ethnography is typically described in following ways: a method of observing human interactions in social settings and activities (Burke & Kirk, 2001) a holistic observation of people in their ‘cultural context’ the study and systematic recording of human cultures; also : a descriptive work produced from such research (Merriam-Webster Online). Note that these definitions often relate ethnography to the study of culture. Culture can be described as the way of life of a group of people. In the realms of anthropology and sociology, cultures are usually analogous to ethnic groups. But, in the realm of Human-Computer Interaction (HCI) and product design, groups of people can be as small as a cluster of employees in a particular department. Thus there are two general forms of ethnography: the classic form and the modern design form. More comparisons of these two forms of ethnography are summarized in Table 1. Table 1: Comparisons between two types of Ethnography Roots of Classic Ethnography Design Ethnography Describes cultures Describes domains (Anthropology/Sociology) Uses local language Uses local language Subjective Objective Compares general principles of design Compares general principles of society Intervention Non-interference Duration: Several Weeks/Months Duration: Several Years (depends on task(s) studied) Ethnography is always conducted in the local language of the people being observed. In the classic form, this investigation involves learning the language of a particular culture including slang phrases and words of expression. In the design form, this method involves learning the terminology or jargon used in a particular workplace. Tighter time constraints also exist in design and so ethnographic methods are usually more intervening to ‘speed-up’ the data collection process. To meet deadlines, ethnographers can gather such information by stepping away from pure observational field work and becoming actively involved with ‘learning the ropes’. Research can be accomplished by asking prying questions, conducting interviews, and performing tasks themselves. Often ethnographers will need to become more intrusive -sacrificing objectivity to achieve their goal(s). This trade-off is common in ethnography. 3 of 11 Ethnography Hudson A Brief History Ethnography as we know it today was invented by Bronislaw Malinowski (Anderson, 1997; Malinowski, 1967; Kuper 1983). In 1915, Malinowski started a three year ethnographic study of the natives of the Trobriand Islands off the coast of New Guinea in the southwest pacific. During his three year visit, Malinowski documented three forms of data about the tribes there: Synoptic Charts organizing massive amounts of information into an easier to understand format Detailed descriptions of day to day lives and activities All stories, narratives, myths, etc. Using this holistic approach to studying the social interactions of the islanders, Malinowski discovered many interesting things such as their beliefs about kinships, magic, religion, and trade practices. Malinowski fashioned the modern analytic component to ethnography. Without this painstaking level of data collection and analysis, we would lose the ability to learn about ‘cultures’ from a unique inside perspective. Significance of Ethnographic Research With regards to design, ethnography is an ideal way to collect practical insider knowledge and experience about a group of people. Because of the ‘hands-on’ nature, it can be extremely useful for improving system design by revealing important aspects which may not seem obvious to designers. Strict observation alone does not always tell the whole story. Ethnographic approach allows one to look deeper at the behavior of people in certain group dynamics. An experienced ethnographer will have the ability to analyze the data thoroughly; allowing for the discovery of new relevant information. Methodology Design Cycle Ethnography is used in a variety of stages in the design cycle. Typically, it is best utilized in the conceptual or pre-design stage. It also holds useful in the iterative designing stage, affording alterations to the blueprints along the way. Ethnographers can also pose as users in the evaluation of the new design potentially saving money in the long term. In fact, the earlier ethnography is implemented into the design cycle, the sooner problems can be identified, saving the company money. Unfortunately, ethnography does not always get implemented soon enough and time deadlines tend to constrict its effectiveness. Procedure The way in which one conducts an ethnographic study depends on a variety of factors. It depends on time constraints imposed by the company or the design team. It depends on the size of one’s research budget, the focus of the study, when it will be implemented in the design cycle, instrumentation/materials at hand, the freedom/flexibility of the ethnographer, etc. Rose et al. (1995) present four steps which provide a rough guideline as to how to conduct an ethnographic study. These steps are in no way concrete. 4 of 11 Ethnography Hudson Step 1: Preparation Before conducting a study, on must make several preparations to determine the feasibility of the study and to ensure success. Firstly, determine the focus of the study. Ethnography by nature involves the collection of vast amounts of data. Outlining the goals will help sort through all the data later on. One should prepare questions which are of particular importance. Often these questions can be guided by concerns the design team has; however limiting goals only to the needs of the design team may be too narrow. Too fine a focus may abolish the chance of discovering new findings. A balance in the amount of focus is needed. Secondly, as an ethnographer one must begin to familiarize oneself with the organization policies, procedures, and general work culture. By gaining an understanding of these aspects of the work environment ahead of time, one will free up resources. Gathering details about day to day events, the flow of work, and other relevant things already takes up valuable time when conducting the study. Lightening the ethnographer’s plate is vital. On that note, it is also a good idea to familiarize oneself with the current system(s) and its history. Finally, one must find out how to gain access or permission from the proper authorities within an organization to conduct the study. Often people who may prevent access are deemed ‘gate-keepers’ and those who may help lift these road blocks are your ‘sponsors’. One of the greatest challenges is to convince sponsors that the research is worthwhile. Step 2: Conducting the Field Study While conducting the field study there are a number of things one needs to do to ensure it runs smoothly. It is a good idea to establish a healthy rapport with managers and users. This will launch an open dialogue that will encourage managers and employees to share their knowledge. A good rapport will also foster effective interviews which may complement recorded observations. A good practice it to be highly meticulous. Record all kinds of subjective/objective and quantitative/qualitative data. It may include observations, impressions, feelings, hunches, emerging questions, etc. Data can be recorded in a variety of ways such as field notes, open ended interviews and audio/video recordings. The key is to record every visit with detail and to record it immediately to ensure its accuracy. Finally, be sure to follow any leads that emerge from any visits. Leads provide an opportunity to discover innovative ideas about system design and justify the whole purpose for using ethnography. Nielsen (2002) provides some useful tips when conducting a field study. Some of these points are summarized below. Table 2: Dos and Don’ts for conducting a Field Study Don’t Do Ask simple Yes/No questions Ask open-ended questions Ask leading questions Phrase questions properly to avoid bias Use unfamiliar jargon Speak their language Lead/guide the ‘user’ Let user notice things on his/her own 5 of 11 Ethnography Hudson Step 3: Analysis of the Data Unlike other scientific methods, ethnography does not require collecting all the data before analysis. In fact, it is better to continually interpret the data as it is being conducted. Compile the collected data into numerical, textual, and multimedia databases as soon as possible. This helps to simplify, clarify, and refine the massive amounts of data: bringing emerging patterns to the surface. Refinement forces the ethnographer to continually redevelop ideas about the design. Organization also makes it easier to report any updates to the design team. Having quantifiable data and compiled statistics available help to solidify arguments to designers and engineers. Step 4: Reporting When writing or presenting any findings be sure to consider the multiple audiences and their particular goals. Managers, users, designers, and engineers all have different ideas of what to take away from the study. Once more, they also speak different ‘languages’. Be sure to use appropriate examples for each audience. Frequent reporting is highly recommended. The sooner findings are presented to the rest of the design team; the sooner it can be incorporated into design. Furthermore, once a prototype is developed, an ethnographer can act as a “substitute user in a ‘user-centered’ systems design process” (Bently et al., 1992). Even short debriefing meetings can ensure the relevant discoveries from the ethnographic method are communicated effectively. When writing an ethnographic report, Randall (1996) suggests the following format to present the findings of the study in a succinct manner. Purpose Statement o Outline the focus and goals of the study. Generally, the purpose of the study is to describe/analyze work activities, identify problems in work routines/practices, suggest solutions, identify current weaknesses in study and suggest new research directions. Executive Summary o A quick synopsis of key items mentioned in statement. o Brevity is the key. Some audience members will only read the summary and not the main body version. Main Body o A full account of findings, arguments, conclusions, and recommendations. Future Research o Identify current limitations to the study and justify why more research is required. Debriefing o Drive home ideas, arguments, problems & solutions. o Justify conclusions and prove that ethnography was worth the time & money. Appendix o Include concrete examples and data charts to support your arguments. 6 of 11 Ethnography Hudson Potential Problems Randall (1996) suggests that a huge problem may arise in the communication between ethnographers and the system designers. A dichotomy exists between these two groups due to the nature of each of their work. Ethnographers analyze data, try to be impartial and nonjudgmental and usually have lengthy timeframes to complete their work. Software engineers are the exact opposite. They synthesize data and must be judgmental due to the frequent deadlines they have. Randall (1996) suggests this dichotomy can be bridged by an iterative approach to ethnography where frequent communication between the two is a foundation for understanding. There are other problems one must deal with when conducting such a study. The rest of the issues are outlined as advantages and disadvantages in Table 3. Many of which have been discussed previously. Often these characteristics can be seen as tradeoffs between each other. Table 3: Advantages & Disadvantages to Ethnography Advantage Disadvantage Provides relevant ‘real-world’ data Context too specific, not generalizable to other organizations or systems. Provides in-depth understanding of people in an organization. ‘Going native’ – develops a bias for analysis and interpretation. Identifies assumptions that maybe taken for granted by system designers Multiple Roles Can be economical (if you ‘do it Must negotiate access (see yourself’). gatekeepers/sponsors in Step 1: Preparation) Time & Money (hiring, training, managing, conducting, analyzing data, etc.) Data is messy and often unstructured. Too much data, not enough time to tell a complete story. How do you assess significance? (Did we learn something new, valuable?) In closing, ethnography can prove to be very useful to the design process. Its effectiveness is of course dependant upon the freedom given to the ethnographer. Tight restriction such as deadlines, small budgets, or an unequal position on the design team may compromise effectiveness. In fact, if these restrictions are too tight, a different methodological study may be more effective. One of the constant struggles with this method of study is that it requires continual justification. Managers, designers and engineers do not always see the benefit of such a study until the near end. 7 of 11 Ethnography Hudson Example: Taxi Cab – Dispatch System The example I will illustrate here pertains to the taxi driver industry. The design team wishes to implement a new computerized cab-dispatch system. The software company has hired ethnographers to determine what problems exist with the current system. Specifically - what problems arise when using the device while driving? Step 1: Preparation Familiarize yourself with the o Radio codes o Cab driver procedures o Questionnaires o User demographics o Users’ feelings towards current system. Easy to use? Easy to learn? Focus of the study. o What problems arise when using the dispatch system and driving? Who are the Gatekeepers? Sponsors? o Unions? How much time do you have? Resources available? o Money? Cabs? How will we record data? o Video camera(s) in cab? On what? o Ethnographer as cab driver? Make field notes between customers? Step 2: Study Establish rapport with drivers and dispatchers o Small talk o Assure them that their performance/job is not at stake. We are looking at problems with the dispatch system and how to improve it. Emerging Issues (Leads): o How does the interface perform at different times of day? Rush-hour, Day/Night? o What features should be added/subtracted from current system? Weather, traffic reports? o What info given by the dispatch system is most important? Least important? o What are other tasks the driver is doing? (Workflow ≠ Flow-of-Work) Talking to friends/family on cell phone. Listening to radio Are they distractive? Record everything. o Daily Flow-of-Work (not workflow) Ask exploratory/probing questions o How long is a regular shift? o How often do you take breaks? 8 of 11 Ethnography Hudson Step 3: Analysis Look for emerging patterns in the data Create data charts. Compare Day vs. Night interactions with the device. Frequency of use at different times of day (i.e. rush-hour). Glare/ Contrast issues? Vision Acuity? Color perception? Clutter Issues – should the new system have a new head up display? Group Dynamics – how does the actions of one driver affect another? Dispatch? Step 4: Reporting Report findings frequently with designers Speak their language. 9 of 11 Ethnography Hudson Annotated Bibliography Anderson, B. (1997). Work, Ethnography and System Design. The Encyclopedia of Microcomputers, 20, 159-183. Marcel Dekker, NY. This article is a great overall guide to the history and methodology. If you need more information, this text provides an excellent overview and guidelines for implementation. Bentley, R., Hughes, J.A., Randall, D., Rodden, T., Sawyer, P., Shapiro, D. and Summerville, I. (1992) Ethnographically-informed systems design for air traffic control. CSCW ’92 Proceedings, November, 123-129. This is an excellent example of ethnography used for system design in Air Traffic Control. Here ethnography reveals unique group dynamics which ensure planes arrive safely and on time. With the current system, individuals could make on-the-fly corrections to incoming air traffic. The new computerized system interface needed to provide this same functionality. Burke, J. & Kirk, A. (2001). Ethnographic Methods. Retrieved September 29, 2004, from University of Maryland, CHARM: Choosing Human-Computer Interaction (HCI) Appropriate Research Methods Website: http://www.otal.umd.edu/hcirm/ethno.html Excellent source of information as to how to conduct an ethnographic study. Site also contains links to various other types of research methods relevant to HCI. Kuper, A. (1983). Anthropology and Anthropologists. Routledge, London. This text is a classic reference to ethnographic study. Malinowski, B. (1967). Argonauts of the Western Pacific. Routledge & Kegan Paul, London. The author is the godfather for ethnography. This is the original example of the classic ethnographic methodology. Little information here pertains to system design, but is an excellent source about the history of ethnography. Merriam-Webster Online. Retrieved September 29, 2004, from http://www.m-w.com/ It’s a dictionary website. Great way to look up words. Myers, M. (1999). Investigating Information Systems with Ethnographic Research. Communications for AIS, 2(23). Excellent reference. Basically another guide with points about benefits/limitations to ethnographic research and various styles to writing a report. Nielsen. J. (2002). Field Studies Done Right: Fast and Observational. Retrieved September 29, 2004 from http://www.useit.com Fantastic website for HCI and usability information. The site is written in easy to understand terms and is an asset to anyone interested in human factors/HCI. Randall, D. (1996). Ethnography and Systems Development: Bounding the Intersection. Tutorial notes presented at CSCW'96. 10 of 11 Ethnography Hudson This document bridges the gap between classical ethnography and modern design ethnography. Another excellent how to guide with plenty of details about relevant issues one must confront to achieve success. Rose, A., Plaisant, C., and Shneiderman, B. (1995). Using Ethnographic Methods In User Interface Re-engineering. Proceedings of the ACM 1995 conference for Designing Interactive Systems: processes, practices, methods, and techniques. New York, NY: ACM Press, 1995, pp. 115-122. This document is an excellent source of information regarding the procedure involved in ethnography. It provides an in-depth guide to ethnographic methodology. Rouncefield, M., J.A. Hughes, T. Rodden, S. Viller. Working with 'constant interruption': CSCW and the Small Office. Proceedings of the ACM 1994 Conference on Computer Supported Cooperative Work. New York, NY: ACM Press, 1994, pp. 275-286. A great source of information. The document outlines the important difference between workflow and the flow of work. It provides concrete examples of data collected in an ethnographic study, how to analyze it and how to succinctly convey findings. Salvador, T. & Mateas, M. (1997). Design Ethnography: Designing for Someone Else. An excellent source about ethnography. Authors go into great detail about the variations in the ethnographic methods. Further information is given about the role the ethnographer has regarding intervention, participation, objectivity/subjectivity, etc. Smith,, R. & Davis, S. (1997). The Psychologist as Detective: An introduction to Conducting Research in Psychology (pp. 398-399). Upper Saddle River, NJ: Prentice-Hall, Inc. Generally a good source to understand general research methods. Little information about ethnography. 11 of 11