Trends in Neuroscience and Education 5 (2016) 139–145 Contents lists available at ScienceDirect Trends in Neuroscience and Education journal homepage: www.elsevier.com/locate/tine Review article Technology and note-taking in the classroom, boardroom, hospital room, and courtroom Pam A. Mueller a, Daniel M. Oppenheimer b,n a b Princeton University, United States UCLA Anderson School of Management, BOX 951481, B423A Gold Hall, Los Angeles, CA 90095-1481, United States art ic l e i nf o a b s t r a c t Article history: Received 7 March 2016 Received in revised form 5 June 2016 Accepted 14 June 2016 Available online 16 June 2016 To date, technological interventions in note-taking have been generally unsuccessful in improving performance. One reason for this lack of success may be that developers focus on making note-taking easier, while neglecting how the technologies could affect the other psychological processes underlying effective note-taking. Importantly, since note-taking serves different purposes in different situations, the effectiveness of various technologies will also be situationally dependent. In this paper, we explore four distinct note-taking settings: the classroom, the boardroom, the hospital room, and the courtroom. In each section, we quickly review important past research before addressing the current state of notetaking in that arena, with special attention given to technological interventions. We conclude each section with a short discussion of what kinds of new technologies would be most helpful for note-taking in those situations. & 2016 Elsevier GmbH. All rights reserved. Keywords: Note-taking Education Technology Business Medicine Law Contents 1. The impact of technology 2. Classroom. . . . . . . . . . . . . 3. Boardroom . . . . . . . . . . . . 4. Hospital room . . . . . . . . . 5. Courtroom . . . . . . . . . . . . 6. Conclusion . . . . . . . . . . . . References . . . . . . . . . . . . . . . . on note-taking in the .................. .................. .................. .................. .................. .................. classroom, boardroom, hospital room, and courtroom . ............................................. ............................................. ............................................. ............................................. ............................................. ............................................. 1. The impact of technology on note-taking in the classroom, boardroom, hospital room, and courtroom Experimental research on note-taking has a long history [1]; for overviews, see Kiewra, Kobayashi [2,3]. While there is a great deal of nuance and complexity in the literature, one consistent theme is that note taking is not easy. The act of note taking requires a number of simultaneous, cognitively demanding processes. The note-taker has to comprehend the material, identify what content is worth recording, and recreate that content in an abridged form. The difficulty is exacerbated by the fact that the process typically n Corresponding author. E-mail address: daniel.oppenheimer@anderson.ucla.edu (D.M. Oppenheimer). http://dx.doi.org/10.1016/j.tine.2016.06.002 2211-9493/& 2016 Elsevier GmbH. All rights reserved. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139 140 141 142 143 143 144 occurs under severe time pressure, often without opportunities for reflection or clarification. In fact, it has been argued that notetaking can be as cognitively demanding as expert chess playing [4]. This difficulty is reflected in the quality of notes that people take. For example, it is not uncommon for people to fail to record half of the main points within a lecture [5,6]. Given the challenges inherent in note-taking, it seems plausible that technological innovations could be used to reduce cognitive burdens and facilitate more effective note-taking. Unfortunately, to date there is a dearth of examples of successful technology assisted note-taking. In fact, the bulk of the literature shows that incorporating technology into note-taking has either no effect or a deleterious effect. The lack of effective technological interventions in note-taking should not be interpreted to suggest that technology could never 140 P.A. Mueller, D.M. Oppenheimer / Trends in Neuroscience and Education 5 (2016) 139–145 Table 1 Summary of goals, challenges, and technology solutions across different domains. Note-taking situation Goal (s) Problems How can technology help? Classroom Deep understanding of content long-term learning External record of material for future review Students taking notes on laptops have a hard-to-overcome tendency to take verbatim notes and thus fail to process lecture content as deeply as longhand note takers Tablet/stylus technology requires notes to be taken by hand, but allows for a saved electronic copy Technology that asks questions and helps students think about notes being taken Boardroom Comprehensive and accurate record of what was discussed for use by self and others Facilitate participation and idea generation Workers take notes at the expense of participating in discussion Typing notes on a laptop would lessen working memory demands on employees, allowing them to participate in meetings and still take detailed notes Hospital room Record information for future reference over long-term treatment and patient care Documentation against malpractice claims Build and maintain trust with patient Note-taking may interfere with patient rapport Lessintrusive note-taking would be less likely to impair rapport (e.g., tablet as opposed to laptop or desktop) Courtroom Accurate account of witness interview or witness testimony to refer to later Maintain trust and satisfaction with legal system Interviewer notes tend to miss many important pieces of information Jurors are unsure what information is important “Smart pen” for interviewers, allowing audio recording and contemporaneous notes Structured note-taking guide for jurors be helpful. Indeed, the rapid evolution and application of digital technology to note-taking environments offers the hope of major advances in note-taking technology in the near future. However, for this to happen, developers of new technology need to understand what features the technology will need to have in order to capitalize on our cognitive systems to improve note-taking. New technologies should not only alleviate challenges that note-takers face, but should also avoid undermining the processes that make note-takers successful. Of course, note-taking serves many different purposes, and the technologies required to facilitate note-taking will therefore depend on the situation; appropriate technology will look different for different goals. As such, in the present paper we will explore four distinct note-taking settings: the classroom, the boardroom, the hospital room, and the courtroom. While all of the settings share a common goal of creating an external record for one's future reference, they differ in key other goals. In the classroom setting (where the majority of past research has taken place), notetaking should serve to enhance learning and comprehension of the material. In the boardroom, notes are often intended to create an external record for someone else's use or reference, and occasionally are meant to facilitate (or at least not impede) exchange of information. In the hospital room, note-taking needs to be done in such a way as to avoid undermining rapport between patients and health care workers. And in the courtroom, note taking can help jurors identify legally relevant details of a case, and keep jurors involved and satisfied with the legal process (see Table 1 for summary). As we turn to each distinct setting, we first give a quick overview of important past research and then address the current state of note-taking and note-taking research with an emphasis on the effectiveness of technological innovations. Finally, we will discuss what sorts of technologies would be most helpful for the notetaking goals in each of the four arenas. 2. Classroom non-trivial benefits for mastery of course materials [2,3]. Most undergraduates take notes in their classes and think that notetaking is important for learning [7,8]. However, technology in the university classroom is changing rapidly. Most current undergraduates have a laptop; studies suggest the proportion may be as high as 89–99% [10,11]. However, the extent to which they use laptops to take notes in class varies greatly across institutions. In our research, approximately twothirds of Princeton students reported regularly using a laptop to take notes, while less than half of UCLA students reported doing so [12]. Researchers at UCIrvine report that only 29% of students bring their laptop to class every day [13].1 At this point, students seem to be ambivalent about note-taking on laptops. They tend to believe that their ability to take more notes quickly on a laptop is an asset, rather than a liability, noting that efficiency is the biggest advantage of laptops [14]. Indeed, students consistently report that they believe laptops are beneficial for learning [15–17]. Despite this, some students seem to realize that by transcribing lectures, they are not processing or understanding the content, as evidenced by studies that interview students about note taking experiences, e.g., “[Y]ou have become a typing machine…too busy writing down what is being said to thoroughly process its contents.” [14], p. 46. Students at the University of North Carolina—Pembroke reported that compared to laptops, tablets, and phones, using pen and paper for note-taking was significantly more natural, efficient, easy, and effective [18]. They also reported an increased ability to express their thoughts when using pen and paper. Despite this, 41% of the students reported that they used an electronic interface to take notes. Just as students have mixed feelings about using laptops for note-taking, the research on how laptop note-taking affects learning outcomes is nuanced. While a number of studies have shown that laptops can offer advantages for immediate factual recall, [19–21] laptop note-takers do not perform as well as longhand note-takers on conceptual questions, or on recall of content following a delay [12]. Mueller & Oppenheimer [12] randomly assigned students to take notes on a short lecture either on a The prototypical note-taking situation involves students, so it is logical that the majority of note-taking research investigates academic situations. In general, note-taking has been shown to have 1 These studies are now several years old, and it is likely that an even higher percentage of students carry laptops, though some may have replaced them with tablets. P.A. Mueller, D.M. Oppenheimer / Trends in Neuroscience and Education 5 (2016) 139–145 laptop or with a pen and paper. In a subsequent test, students showed significantly better conceptual understanding when they had hand-written the notes, even when given access to their notes to study after a delay. Ironically, the very feature that makes laptop note-taking so appealing – the ability to take notes more quickly – was what undermined learning. When using a laptop, note-takers tend to transcribe lecture content verbatim. However, because handwriting is slower, pen and paper note-takers are not able to transcribe the content verbatim and are forced to selectively rephrase the material; doing so helps them process and understand the material more deeply and gain better conceptual mastery. Other researchers have similarly found better learning outcomes for students who took handwritten notes [13] including in actual classroom environments [22]. The fact that taking notes by laptop can undermine conceptual learning clearly demonstrates the importance of understanding the cognitive underpinnings of note-taking when developing notetaking technologies: features designed to make note taking easier can actually lead to inferior outcomes [23,24]. The goal of new classroom note-taking technologies should be to reduce extraneous cognitive load while preserving helpful cognitive processing. Indeed, counterintuitively, manipulating the programs used for digital note-taking to slow note-taking speed could help circumvent the natural tendency to take verbatim notes when using a laptop and induce students to engage in deeper processing. An analogous intervention in an online note-taking program was successful; a text-editing program that did not allow cutting and pasting of notes was shown to lead to better long-term retention of information than a program that allowed students to copy-paste chunks of text [23]. Providing a structured tool for typing notes on a computer, such as a matrix chart organizer, has also been shown to improve performance on assessments [24]. One of the biggest issues with digital technology in the classroom continues to be the potential for distraction that laptops provide (For a general review of some of the detriments of technology in the classroom, see Spitzer [25]). Recent studies have found that students may spend as little as one-third of classroom time taking notes, while the other two-thirds are spent on social media and other non-class distractions [26,27]. Using the internet for non-academic purposes negatively impacts exam performance regardless of students’ baseline intellectual ability [28]. Off-topic multitasking in class may not be detrimental to the multitasker alone. In one experiment, students seated so that their line of sight included two multitasking students scored 17% lower on a comprehension test than students who saw two on-task note-takers [29]. While a study on “laptop zoning” (separating the laptop from the longhand note-takers by seating section) found that the zones did not impact student performance, laptop notetakers did perform significantly worse on the exam than their previous statistics and demographics would have predicted, while pen-and-paper note-takers did significantly better [13]. As tablets become more prominent, distraction may decrease; one study reports significantly less time spent on various off-topic websites during class when using an iPad than when using a laptop [30]. However, a question that commonly arises regarding tablets is whether tablet-and-stylus is sufficiently similar to penand-paper note-taking so as to provide the same advantages. While there has not been a completely controlled experimental comparison, Kalnikaite & Whittaker [31] experimentally investigated differences in memory for people taking notes with pen and paper, taking notes with a tablet and stylus that also recorded speech, and not taking notes at all. Both note-taking conditions outperformed the no-notes condition, and there were no differences between performance in the two note-taking conditions one 141 and seven days later. Thirty days later, participants in the tablet condition performed best, but the researchers attributed that to their ability to access the underlying speech content. The researchers found that the notes taken with pen and paper and stylus and tablet were substantially alike, and did not differ in quantity, quality, or form. Other researchers reported similar findings regarding the content of stylus/tablet and pen/paper notes, but also noted that students felt that the interface of the tablets and PDAs was not as convenient or comfortable as plain pen and paper [32]. One final factor to consider regarding note-taking modality is the possibility of interventions on the instructor side. Huxham [33] demonstrated that the use of an “interactive window”—the use of a short problem to be discussed between small groups of students for three to five minutes—led to significantly higher note quality than a general class discussion on a topic.2 A simpler change that also improved the quality of student notes was the implementation of short lecture breaks in which students could consolidate and revise their notes [34].3 Moreover, as more assessments move onto the computer, issues related to context-dependent learning [35] may arise. Barrett et al. [36] reported that congruent modalities for note-taking and assessment led to higher scores than incongruence in note-taking and assessment. As stated above, in classroom settings, the primary goal of note taking is to facilitate learning. However, there is little evidence that digital note taking technology has been effective at promoting learning, and there is significant evidence that it can impede learning. This is largely due to two factors: (i) many digital technologies afford opportunities for distraction and (ii) current technologies typically facilitate the production of external storage rather than the content processing that note-taking can engender. At this point, tablet/stylus systems and smart pens (e.g., LiveScribe) may be the best technology for the classroom, allowing for longhand note-taking, minimizing the distraction of email/Internet, and providing students with an electronic record of the notes taken. However, outside of the classroom, the goals of note-taking are often different, and thus require different types of technological tools to be effective. While there has been less research examining factors influencing the effectiveness of note-taking outside of educational settings, a review of the goals and note-taking practices in different areas shows that our framework of examining aims and cognitive requirements for achieving those aims can give useful insights into how note-taking technology should be developed. 3. Boardroom While it is of course true that some of the classroom findings (e.g., the distractive capabilities of laptops) are relevant to the business world, note-taking raises distinct issues in the workplace as well (see Hartley [37] for a review of note-taking in nonacademic settings). While the data are sparser than for students, workers seem to be equally ambivalent about whether to use pen and paper or tech devices for note-taking. The single most common place to take 2 Because “quality” is a nebulous term, we provide the authors’ operationalizations here. Quality of notes was assessed for each of the 4 topics by two independent raters on the following scale: 0 (not present in the notes at all); 1 (some notes, but incomplete or involving misunderstanding; 2 (full notes showing understanding of the concept). 3 The measure of quality in this study was the number of “idea units” contained in the notes. The lecture contained a total of 95 idea units (e.g., “A variable ratio schedule involves rapid responding”). 142 P.A. Mueller, D.M. Oppenheimer / Trends in Neuroscience and Education 5 (2016) 139–145 notes is on the computer, but the combined instances of taking notes on post-its or in a notebook exceed notes taken on the computer [38]. In fact, the proportion of notes taken on computers and phones combined is approximately equal to notes taken on post-its and in a notebook. In the business world, note-taking is most likely to take place in meetings. One ethnographic field study reported that 63% of the workers in the sample always took their own meeting notes, and 75% did so at least frequently. However, workers felt that they faced a tradeoff between taking notes and participating in the discussion. The data bore this out; those workers who took detailed notes contributed the least to the conversation [39]. However, another study found that workers tended to take frequent, short notes during meetings, and that the quantity of notes was positively correlated with the amount of spoken words during the meeting [40]. Both studies reported that individuals’ note-taking strategies were idiosyncratic. The inconsistencies in the results and the differences between individuals’ note-taking strategies may be due to the competing goals facing workers during meetings. These include keeping a relatively complete record for oneself or for others unable to attend the meeting, and also actively providing input and participating in the discussion – two cognitively demanding tasks that may interfere with one another. Notetaking at the expense of participation is problematic because high levels of group participation in decision making are necessary for creative problem solving and innovation [41]. As an expert witness, a well-known note-taking researcher opined that workplace notes likely “omit most of what was said, omit details, context, and essential qualifiers, and contain inaccurate or vague statements” [42]. Workplace notes are likely to be less complete than lecture notes, because workplace presentations nearly always involve some visual content [43], and slides are also often provided in advance [44], both of which reduce note quantity. While some prior work, e.g., Kiewra et al. [45], suggests that more content will be written down in a small group or face-to-face setting, more ecologically valid research suggests the opposite; far fewer notes tend to be taken in small group meetings [39,40,46]. While much of the research on note-taking in the workplace involves meetings, there is also a literature on note-taking during job interviews. Note-taking in this context is used to create a record of the conversation and provide information for use in subsequent hiring (and promotion) decisions. Generally, interviewers have information about candidates prior to beginning the interview, leading to expectancy bias in their evaluations. The evidence is mixed, but note-taking in an interview may reduce the effects of bias [47,48]. However, other research suggests that while notetaking in interviews may improve recall of information about candidates, it does not improve accuracy in evaluation of the candidates [49]. Burnett et al. [50] suggest that the impact of notes in the interview setting may depend on their content: notes that focus on a candidate's job performance (e.g., sticks to a task, sets high goals) leads to more valid ratings than notes that focus on the candidate's interview performance (e.g., eye contact, seems nervous). Thus, while it is not entirely clear how, and to what extent, note-taking improves final decision making in the hiring process, note-taking tools that help people focus on more valuable information (as opposed to maximizing the amount of information recorded) could be particularly effective. Workplace note-taking is generally used to memorialize conversations and refresh one's own or someone else's memory about their content, rather than as a tool for learning. In contrast to the classroom, the goals of workplace note-taking may be better served by using a laptop or tablet. Typing notes is not as taxing on working memory as handwriting notes, leaving more cognitive capacity for workers to participate in discussions during meetings. It also provides a more complete record for later review, benefiting others who were unable to attend the meeting.. Having this more complete record may also reduce bias in hiring, although in hiring the nature of the notes taken may ultimately be more important than the quantity. A more definite recommendation for workplace interview note-taking will require significantly more research in this domain. 4. Hospital room Therapists, counselors, and doctors generally take notes in oneon-one encounters, which may form a part of a patient's long-term file. Doctors and students face similar competing considerations in terms of the goals of their note-taking. Doctors’ and therapists’ goals are to help understand a patient's issues and make clinical decisions – similar to students’ goals to understand the lecture content – but they also must create a record for future sessions to build on (more akin to the external storage goal). Doctors and counselors may also feel compelled to create a more complete record than most note-takers in case of future malpractice claims. However, doctors and therapists face one critical challenge that students do not: they must be able to take notes without damaging the rapport between counselor and patient. The research on note-taking in clinical settings is mixed and inconclusive. Some studies suggest note-taking may improve therapist performance by helping therapists remember patient information and reducing the impact of any biases that therapists may hold [37]. However, other work has not found note-taking to enhance recall or improve clinical judgment [51]. The extent to which note-taking upsets the patient-therapist dynamic is equally inconclusive. For example, when social work graduate students viewed videos of simulated therapeutic interviews, they perceived therapists who took notes throughout the session as less effective than those who did not [52]. They also believed that the client in a session with a note-taking therapist viewed the session more negatively (less rapport, less comfort, etc.). Other studies have failed to find a difference. For example, Christie, Bemister, & Dobson [53] created therapy videos in which the therapist either took occasional notes (8 times during a 9-minute video) or took no notes. Participants’ competency ratings of therapists who took notes did not differ from ratings of therapists who did not take notes. Still other studies show mixed results. For example, Miller [54] found no difference in perceived expertise or trustworthiness between note-taking and non-notetaking counselors, but did find that participants were more willing to visit a counselor who did not take notes than one who did. Introducing technology into therapeutic note taking does little to resolve the inconclusive nature of the literature. Rasminsky et al. [55] note the difficulty of integrating digital note-taking into psychiatry practice, since paying attention to the patient's affect, body language, and appearance is critical. However, a recent set of studies assigned patients to therapists taking notes with either pen and paper, iPad and stylus, or computer, and found no significant differences in patient ratings of the counselors [56]. With regard to physical examinations and other medical doctors’ appointments, an older study on physician note-taking found no significant differences in patient satisfaction based on whether the doctor took pen-and-paper or computer notes [57]. However, a more recent (and far larger) study suggests patients seeing lessexperienced physicians (medical residents in their first few years out of school) were more likely to agree that the computer made the visit feel less personal than those seeing more seasoned doctors [58]. Given the mixed evidence, it seems that note taking can impair patient-clinician relationships, but does not necessarily do so. P.A. Mueller, D.M. Oppenheimer / Trends in Neuroscience and Education 5 (2016) 139–145 While the data is not conclusive, some researchers have suggested that when note-taking does undermine rapport, it is a result of how note-taking affects attentive non-verbal behaviors of the counselor [54]. Thus, it is particularly important that note taking technologies developed for medical settings are designed with the awareness of how using them might disrupt conversational mannerisms (such as eye-contact, non-verbal mimicry, or gestures). The note-taking technology that would be most beneficial to workers in therapeutic fields would involve a less-intrusive device (e.g., tablet as opposed to laptop or desktop computer) to minimize the barrier between patient and counselor or physician. Tablet-and-stylus technology with effective OCR (optical character recognition) to transform handwriting into typed notes may be the best way to balance the two goals of workers in this field. The stylus would allow for relatively natural input while enabling continued interaction with a patient. Having a clean, typed record of notes, which could be compiled after each appointment, would be more useful as a subsequent reference. 5. Courtroom In the legal setting, note-taking comes in two main forms: juror note-taking and documenting witness interviews. Despite being discussed for over a century, juror note-taking is still an unsettled issue. Currently, note-taking is allowed on a state-by-state basis; one estimate suggests that jurors were allowed to take notes in 71.2% of state civil trials and 73.5% of federal civil trials, while the percentages were somewhat lower for criminal trials [59]. These figures mask the differences across states; while a few states have made it mandatory to allow note-taking, in other states, judges’ case-by-case decisions have disallowed note-taking in the majority of cases. Proponents of courtroom note-taking have argued that allowing jurors to take notes increases their recall of case facts and leads to better verdicts [60,61]. Additionally, there is some evidence that jurors are more satisfied with the justice system if they are allowed to take notes [62–64]. Juror satisfaction is important because, for many, jury duty is their first (and perhaps only) contact with the legal system. A juror's satisfaction or dissatisfaction can affect their support of and compliance with the legal system in general, and may affect the attitudes of others in their social network [65–67]. Opponents of juror note-taking have argued that juror notes can have undue influence during deliberations and may reflect the biases of the note-taker [68,69]. (e.g., Fischer v. Fischer, 1966; United States v. Darden et al., 1995). Penrod & Heuer [70], reporting on their prior field studies, argue that the weight of the experimental evidence suggests that these worries are unfounded. However, it is an open question whether any of these effects would be different if notes were taken with a digital device. There are many studies, both in the lab and in the field, investigating the effects of juror note-taking; for overviews, see [70,71]. In general, while these studies vary in their chosen measures, they find note-taking to be useful. Two papers are worth mentioning for their noteworthy findings. ForsterLee, Horowitz, & Bourgeois [72] cleanly distinguish the encoding and external storage effects of juror notes, and show that the impact is at the encoding stage – the differences between jurors who had access to their notes at deliberation and those who did not were minimal. Horowitz & Bordens [73] took a different approach from most other papers, and investigated jury outcomes, rather than just juror recall. Overall, mock civil juries (6 members) who were not allowed to take notes awarded higher compensatory and punitive damages than those who did take notes. However, there was also a 143 significant interaction with cognitive load. Under high cognitive load (a more complex case), juries that took notes awarded less in compensation, but under low cognitive load, juries whose members took notes actually awarded more in compensation [73]. In this study, jurors did not have access to their notes during deliberation. “Technological” innovations include the trial-ordered notebook (TON) created by Hope et al. [74]. The TON contains headings that outline the course of trial, and subheadings for jurors to make specific notes on the evidence, arguments, and rebuttals of both prosecution and defense. Hope et al. found jurors who used the TON noted more legally relevant details during the trial and had a more complete, but not more accurate, recall of trial information during a subsequent cued-recall test. Other researchers have found that the TON led to both more complete and more accurate recording of facts [75]. They did not find a difference between “freestyle” note-takers and TON note-takers on verdict accuracy. In terms of digital technology in the courtroom, it is unlikely that jurors will be allowed to take notes on a tablet or laptop anytime soon. Smartphones, tablets, and laptops are banned in many federal courtrooms as a result of the federal rule against broadcasting of proceedings [76], though some judges have begun to allow tweeting by journalists during civil trials [77]. Judges have also expressed concern that the sound of typing on a laptop would be disruptive [78]. Even in states with permissive rules regarding laptops in the courtroom, worries about distraction and publicity would likely keep them out of the hands of jurors. In any case, given the issues described above with regard to verbatim notetaking when typing, it is not clear that we would want jurors to make the switch from paper to screen. It is possible that some tablet-and-stylus technology could be developed that would help jurors structure their notes (akin to the TON), but at this point, research suggests that tablet notes and pen-and-paper notes are equivalent [31]. If this is true, the logistical difficulties created would outweigh the potential benefits. The biggest hurdle is that courts would have to provide the devices for the jurors. This is for two reasons: first, to make sure there is nothing inappropriate or distracting on the machine (e.g., games, internet access), and second, because juror notes are usually collected at lunch and at the end of the day. Jurors are generally not allowed to take their notes home with them and are unlikely to be willing to surrender their personal tablets or laptops to the court for the duration of trial. While much of the discussion of note-taking in the legal setting has focused on jurors, there is also a smaller literature on notes of witness interviews. Though this is changing, currently, not all witness interviews are recorded; therefore, investigators’ accurate representation of what a witness said is critical. Hyman Gregory [79] found that those who took notes during investigative interviews included more information and had a greater percentage of accurate information in their post-interview report (written two weeks after the interview). While taking notes is better than not, other research reminds us that notes are necessarily incomplete; in one study, 25% of incident-relevant details were not recorded in interviewers’ notes [80]. Recording these interactions is critical to preserving the initial recollections of witnesses, unfiltered by someone else's selective notes. No work has been done on technological innovations in witness interviewing, but it seems that the tablet programs that allow for speech recording and simultaneous annotation would be extremely useful in this context. 6. Conclusion Inside the classroom, learning is paramount, and there is good evidence suggesting how technology should and should not be 144 P.A. Mueller, D.M. Oppenheimer / Trends in Neuroscience and Education 5 (2016) 139–145 used in order to support this goal. However, outside the classroom, note taking is used in many varied situations. In business meetings, note takers are often tasked with keeping a relatively complete record to share with others, while also maintaining an active discussion. Doctors and therapists must take accurate and relatively comprehensive notes while still maintaining patient rapport. Jurors and police must take accurate notes, above all else, and the process should keep people engaged and satisfied with the legal system. The trend in digital note-taking innovations is to tout how an application or device “makes note-taking easy,” but in most of these situations, making note-taking easier is not the solution. Making note-taking easier may actually lead to ironic negative consequences. For instance, making the note-taking process too easy can undermine learning; “desirable difficulties,” such as slower note-taking, have been shown to improve educational outcomes [81–83]. Making note-taking easier also encourages people to take more notes; this, in turn, can impair patient rapport in the clinical setting, or undermine participation in workplace meetings. As note-taking technology continues to evolve, developers should consider how a new device or application could make notetaking more effective, not just easier. In order to do this, they need to understand the differing goals of taking notes in various settings. The developers can then consider interventions that encourage the cognitive processes that serve each goal. For instance, applications created for learning environments should encourage selectivity and deeper processing. Applications for doctors and counselors should require minimal interaction with the screen to encourage increased nonverbal communication with patients. Starting with the goal of effectiveness in a given context, rather than ease of use across the board, will hopefully lead to new technologies that improve note-taking experiences and outcomes for all users. References [1] C.C. Crawford, Some experimental studies of the results of college note-taking, J. Educ. Res. 12 (1925) 379–386. [2] K.A. Kiewra, A review of note-taking: the encoding-storage paradigm and beyond, Educ. Psychol. Rev. 1 (1989) 147–172. [3] K. Kobayashi, What limits the encoding effect of note-taking? A meta-analytic examination, Contemp. Educ. Psychol. 30 (2005) 242–262. [4] A. Piolat, T. Olive, R.T. Kellogg, Cognitive effort of notetaking, Appl. Cognit. Psychol. 19 (2005) 291–312. [5] L. Baker, B. Lombardi, Student's lecture notes and their relation to test performance, Teach. Psychol. 12 (1985) 28–32. [6] P.A. Nye, Student variables in relation to note-taking during a lecture, Prog. Learn. Educ. Tech. 15 (1978) 196–200. [7] P. Dunkel, S. Davy, The heuristic of lecture notetaking: perceptions of American & international students regarding the value & practice of notetaking, Engl. Specif. Purp. 8 (1989) 33–50. [8] R.A. Palmatier, J.M. Bennett, Notetaking habits of college students, J. Read. 18 (1974) 215–218. [10] S.D. Smith, G. Salaway, J.B. Caruso, The ECAR Study of Undergraduate Students and Information Technology, 2009, 〈http://www.educause.edu/Resources/ TheECARStudyofUndergraduateStu/187215〉. [11] University of Virginia, UVa first year student computer inventory, 〈http://itc. virginia.edu/students/inventory/2009/〉, 2009. [12] P.A. Mueller, D.M. Oppenheimer, The pen is mightier than the keyboard: advantages of longhand over laptop note taking, Psychol. Sci. 25 (2014) 1159–1168. [13] N.M. Aguilar-Roca, A.E. Williams, D.K. O’Dowd, The impact of laptop-free zones on student performance and attitudes in large lectures, Comput. Educ. 59 (2012) 1300–1308. [14] S. Jeong, W.S. Shin, I. Park, Students’ use of notebook computers in the college classroom: Benefits and pitfalls, Educ. Tech. Int. 16 (2015) 31–57 2015. [15] M. Barak, A. Lipson, S. Lerman, Wireless laptops as means for promoting active learning in large lecture halls, J. Res. Tech. Educ. 38 (2006) 245–263. [16] A. Mitra, T. Steffensmeier, Changes in student attitudes and student computer use in a computer-enriched environment, J. Res. Comput. Educ. 32 (2000) 417–432. [17] R. Skolnick, M. Puzo, Utilization of laptop computers in the school of business classroom, Acad. Educ. Leadersh. J. 12 (2008) 1–10. [18] A. Davis, An Analysis of Students’ Perceptions of Electronic Note Taking, Senior Thesis, University of North Carolina at Pembroke, 2015. [19] D.C. Bui, J. Myerson, S. Hale, Note-taking with computers: exploring alternative strategies for improved recall, J. Educ. Psychol. 105 (2013) 299–309. [20] L. Lin, C. Bigenho, Note-taking and memory in different media environments, Comput. Sch. 28 (2011) 200–216. [21] I. Schoen, Effects of method and context of note-taking on memory: Handwriting versus typing in lecture and textbook-reading contexts. Pitzer Senior Theses. 〈http://scholarship.claremont.edu/pitzer_theses/20〉, 2012. [22] M.C. Friedman, S. Moulton, H. Gehlbach, The impact of longhand and laptop note-taking on classroom performance, Paper presented at the Annual Meeting of the Psychonomic Society, 2014. [23] A. Bauer, K. Koedinger, Evaluating the effect of technology on note-taking and learning, CHI 2006 (2006) 520–525. [24] D.F. Kauffman, R. Zhao, Y. Yang, Effects of online note taking formats and selfmonitoring prompts on learning from online text: Using technology to enhance self-regulated learning, Contemp. Educ. Psychol. 36 (2011) 313–322. [25] M. Spitzer, Information technology in education: risks and side effects, Trends Neuro. Educ. 3 (2014) 81–85. [26] A.W. Amick, N. Cross, An almost paperless organic chemistry course with the use of iPads, J. Chem. Educ. 91 (2014) 753–756. [27] E.D. Ragan, S.R. Jennings, J.D. Massey, P.E. Doolittle, Unregulated use of laptops over time in large lecture classes, Comput. Educ. 78 (2014) 78–86. [28] S.M. Ravizza, D.Z. Hambrick, K.M. Fenn, Non-academic internet use in the classroom is negatively related to classroom learning regardless of intellectual ability, Comp. Educ. 78 (2014) 109–114. [29] F. Sana, T. Weston, N.J. Cepeda, Laptop multitasking hinders classroom learning for both users and nearby peers, Comp. Educ. 62 (2013) 24–31. [30] C.F. Mang, L.J. Wardley, Effective adoption of tablets in post-secondary education: Recommendations based on a trial of iPads in university classes, J. Inf. Technol. Educ.: Innov. Pract. 11 (2012) 301–317. [31] V. Kalnikaite, S. Whittaker, Cuing digital memory: How and why do digital notes help us remember?, in: BCS-HCI'08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction, 2008, pp. 153–161. [32] K. Kim, S.A. Turner, M.A. Pérez-Quiñones, Requirements for electronic note taking systems: a field study of note taking in university classrooms, Educ. Inf. Tech. 14 (2009) 255–283. [33] M. Huxham, The medium makes the message: Effects of cues on students’ lecture notes, Act. Learn. High. Educ. 11 (2010) 179–188. [34] L. Luo, K.A. Kiewra, L. Samuelson, Revising lecture notes: how revision, pauses, and partners affect note taking and achievement, Instr. Sci. 44 (2016) 45–67. [35] D.R. Godden, A.D. Baddeley, Context-dependent memory in two natural environments: On land and underwater, Br. J. Psychol. 66 (1975) 325–331. [36] M.E. Barrett, A.B. Swan, A. Mamikonian, I. Ghajoyan, O. Kramarova, R. J. Youmans, Technology in Note Taking and assessment: the effects of congruence on student performance, Int. J. Instr. 7 (2014) 49–58. [37] J. Hartley, Notetaking in non-academic settings, Appl. Cognit. Psychol. 16 (2002) 559–574. [38] A. Thakur, M. Gormish, B. Erol, B., Mobile phones and information capture in the workplace, CHI 2011 (2011) ACM: 978-1-4503-0268-5/11/05. [39] S. Whittaker, R. Laban, S. Tucker, Analysing meeting records: an ethnographic study and technological implications, Mach. Learn. Multimodal Interact. (2005) 101–113. [40] A. Bothin, P. Clough, Participants’ personal note-taking in meetings and its value for automatic meeting summarization, Inform. Technol. Manag. 13 (2012) 39–57. [41] C.K. De Dreu, M.A. West, Minority dissent and team innovation: the importance of participation in decision making, J. Appl. Psychol. 86 (2001) 1191–1201. [42] K.A. Kiewra, Note taking on trial: A legal application of note-taking research, Educ. Psychol. Rev., DOI: 〈http://dx.doi.org/10.1007/s10648-015-9353-z〉. [43] H. Maddox, E. Hoole, Performance decrement in the lecture, Educ. Rev. 28 (1975) 17–30. [44] H. Nouri, A. Shahis, The effect of Power Point lectures on student performance and attitudes, Account. Educ. J. 15 (2008) 103–117. [45] K.A. Kiewra, R.E. Mayer, M. Christensen, S. Kim, N. Risch, Effects of repetition on recall and notetaking: strategies for learning from lectures, J. Educ. Psychol. 83 (1991) 120–123. [46] F. Kahn, A survey of note-taking practices, Technical Report, Hewlett Packard Laboratories, 1992. [47] J.C. Biesanz, S.L. Neuberg, T.N. Judice, D.M. Smith, When interviewers desire accurate impressions: The effects of notetaking on the influence of expectations, J. Appl. Soc. Psychol. 29 (1999) 2529–2549. [48] T.H. Macan, R.L. Dipboye, The effects of the application on processing of information from the employment interview, J. Appl. Soc. Psychol. 24 (1994) 1291–1314. [49] C.H. Middendorf, T.H. Macan, Note-taking in the employment interview: effects on recall and judgment, J. Appl. Psychol. 87 (2002) 293–303. [50] J.R. Burnett, C. Fan, S.J. Motowidlo, T. DeGroot, Interview notes and validity, Pers. Psychol. 51 (1998) 375–396. [51] C. Lo, J.S. Wadsworth, The impact of novice counselors’ note-taking behavior on recall and judgment, Rehabil. Res. Pol. Educ. 28 (2014) 169–182. [52] L.P. Hickling, E.J. Hickling, G.F.P. Sison, S. Radetsky, The effect of note-taking on a simulated clinical interview, J. Psychol. 116 (1984) 235–240. P.A. Mueller, D.M. Oppenheimer / Trends in Neuroscience and Education 5 (2016) 139–145 [53] C.D. Christie, T.B. Bemister, K.S. Dobson, Record-informing and note-taking: A continuation of the debate about their impact on client perceptions, Can. Psychol. 56 (2015) 118–122. [54] M.J. Miller, Effects of notetaking on perceived counselor social influence during a career counseling session, J. Couns. Psychol. 39 (1992) 317–320. [55] S. Rasminsky, R. Berman, V.K. Burt, Are we turning our backs on our patients? Training psychiatrists in the era of the electronic health record, Am. J. Psychiatry 172 (2015) 708–709. [56] N.R. Wiarda, M.R. McMinn, M.A. Peterson, J.A. Gregor, Use of technology for note taking and therapeutic alliance, Psychotherapy 51 (2014) 443–446. [57] G.L. Solomon, M. Dechter, Are patients pleased with computer use in the examination room? J. Fam. Pract. 41 (1995) 241–244. [58] E. Rouf, J. Whittle, N. Lu, M.D. Schwartz, Computers in the exam room: Differences in physician-patient interaction may be due to physician experience, J. Gen. Intern. Med. 22 (2007) 43–48. [59] G.E. Mize, G.E. (2007), The State-of-the-States Survey of Jury Improvement Efforts: A Compendium Report (2007). [60] D.L. Rosenhan, S.L. Eisner, R.J. Robinson, Notetaking can aid juror recall, Law Hum. Behav. 18 (1994) 53–61. [61] United States v. Carlisi, 32. F.Supp. 479 (E.D.N.Y. 1940). [62] Cohee v. State, 942 P. 2d. 211 (Okla. 1997). [63] Densen v. Stanley, 84 So. 770 (Ala. Ct. App. 1919). [64] V.E. Flango, Would jurors do a better job if they could take notes? Judicature 63 (1980) 436–443. [65] S.C. Benesh, S.E. Howell, Confidence in the courts: a comparison of users and non-users, Behav. Sci. Law 19 (2001) 199–214. [66] S.S. Diamond, What jurors think: expectations and reactions of citizens who serve as jurors, Assess. Civil Jury (1993) 282–305. [67] T.R. Tyler, Psychological perspectives on legitimacy and legitimation, Annu. Rev. Psychol. 57 (2006) 375–400. [68] Fischer v. Fischer, 142 N.W. 2d. 857 (Wis. 1966). [69] United States v. Darden et al., 70 F.3d 1507 (8th Cir. 1995). [70] S.D. Penrod, L. Heuer, Tweaking commonsense: assessing aids to jury decision making, Psychol. Public Policy Law 3 (1997) 259–284. 145 [71] V.P. Hans, Empowering the active jury: A genuine tort reform, Roger Williams University Law Review 2008 (2008), pp. 39–72. [72] L. ForsterLee, I.A. Horowitz, M. Bourgeois, Effects of notetaking on verdicts and evidence processing in a civil trial, Law Hum. Behav. 18 (1994) 567–578. [73] I.A. Horowitz, K.S. Bordens, The effects of jury size, evidence complexity, and note taking process and performance in a civil trial, J. Appl. Psychol. 87 (2002) 121–130. [74] L. Hope, N. Eales, A. Mirashi, Assisting jurors: Promoting recall of trial information through the use of a trial-ordered notebook, Legal Crim. Psychol. 19 (2014) 316–331. [75] C. Thorley, R.E. Baxter, J. Lorek, The impact of note taking style and note availability at retrieval on mock jurors’ recall and recognition of trial information, Memory (2015), http://dx.doi.org/10.1080/09658211.2015.1031250. [76] Fed. Rules of Crim. Procedure 53. [77] C. Packer, Should courtroom observers be allowed to use their smartphones and computers in court? An examination of the arguments, Am. J. Trial Advocacy 36 (2013) 572–595. [78] State v. Komisarjevsky, 2011 WL 1032111. [79] A. Hyman Gregory, Investigative interviewing and memory: How accurate are interviewers’ recollections of investigative interviews? FIU Electronic Theses and Dissertations. Paper 199. 〈http://digitalcommons.fiu.edu/etd/199〉, 2009. [80] M.E. Lamb, Y. Orbach, K.J. Sternberg, I. Hershkowitz, D. Horowitz, Accuracy of investigators’ verbatim notes of their forensic interviews with alleged child abuse victims, Law Hum. Behav. 24 (2000) 699–708. [81] R.A. Bjork, Memory and metamemory considerations in the training of human beings, in: J. Metcalfe, A. Shimamura (Eds.), Metacognition: Knowing about knowing, MIT Press, Cambridge, MA, 1994, pp. 185–205. [82] C. Diemand-Yauman, D.M. Oppenheimer, E.B. Vaughan, Fortune favors the bold (and the italicized): effects of disfluency on educational outcomes, Cognition 118 (2011) 111–115. [83] R.A. Schmidt, R.A. Bjork, New conceptualizations of practice: common principles in three paradigms suggest new concepts for training, Psychol. Sci. 3 (1992) 207–217.