Session S2B TEACHING COLLABORATIVE WRITING AND PEER REVIEW TECHNIQUES TO ENGINEERING AND TECHNOLOGY UNDERGRADUATES Stephanie Nelson, Ph.D. 1 Abstract - A recent survey of engineering professionals found that they spent 44% of their time writing, and almost all sometimes wrote as members of a team. Yet E&T students, who typically struggle with writing tasks, generally write as individuals and are evaluated only by their professors. This paper discusses a rationale and methods to provide students with experience in writing collaboratively and critiquing one another’s writing. I argue that collaborative writing promotes active learning and provides students with experience working as part of a team. Peer review gives students experience in critical thinking and promotes editorial skills. These classroom techniques raise students’ comfort level at having their work evaluated by others in a professional setting. Course evaluation feedback and follow-up surveying confirm that students who complete the course are more likely to write collaboratively in future courses, and students report that they will seek collaborative writing opportunities in the workplace. of E&T serves a high number of “at risk” students, defined as students who come from ethnically and educationally disadvantaged backgrounds or are non-native English speakers. Less than 70% of our E&T students succeed initially in passing the University’s Writing Proficiency Exam, which must be attempted by the second sophomore year and is a requirement for graduation. Realistically, I cannot resolve all these students’ writing problems in the 11 weeks that we are together. However, I can enculture them to consider writing as a social activity, and thus continue to actively seek feedback on their writing from experts and peers while they are in school, and hopefully later from professional colleagues when they reach the workplace. This paper describes a rationale and some methods I use for encouraging students to work collaboratively as writers. INTRODUCTION There is a widely recognized need to improve the writing skills of Engineering and Technology students. In a 1991 survey conducted by the National Society of Professional Engineers, engineering industry representatives named as the number one priority for engineering educators: “more instruction in written and oral communications” [in 2, p. 135]. This perceived gap in engineering skills is not new. Ninety years ago, a survey conducted by S.C. Earle—the socalled “father of technical writing”—found that most engineering industry representatives believed their recently hired engineering graduates “did not have adequate English skills to perform their work” [3, p. 91]. In its Engineering Criteria 2000 mission statement, ABET has amended its criteria for evaluating engineering programs to include student demonstration of “a high level of communication skills” [4]. Notice that the emphasis is on communication. Focusing on successful communication skills for our students rather than on writing per se attests to the fact that writing is fundamentally a social activity. As Dorothy Windsor has noted, “any individual’s writing is called forth and shaped by the needs and aims of the organization, and that to be understood it must draw on the vocabulary, knowledge, and beliefs other organizational members share” [5, p. 271]. Regardless of technical or grammatical accuracy, the discourse of an engineering text will fail as communication if it does not adapt to the context In my 15 years as a technical writer at a NASA center, I observed that the most successful writers sought multiple reviews of their work from their colleagues, and many actively sought mentoring from writers they perceived to be more expert. Research and development engineers who publish their work in professional journals must successfully respond to the evaluation of their peers, yet in an academic setting we typically train students to write individualistically and to “write for the teacher” rather than for an audience of their peers. For the past 3 years, I have taught a senior-level professional communication class in a College of Engineering and Technology, the first 2 years as an adjunct faculty and last year as a full-time faculty. The class is not an engineering genre-specific course—I do not instruct students to write lab reports or technical proofs—but rather the course is an introduction to the types of professional communication students will be using in the workplace, as well as the research skills they will need to access resources and stay current in their field. The writing and presentation forms the class concentrates on include memos, proposals, instructions, progress reports, news stories and press releases [see 1],1 technical presentations, résumés, cover letters, and promotional writing about technical subjects. Our College 1 RATIONALE Department of Technology, California State University, Los Angeles , Los Angeles, CA 90032-8154 0-7803-6424-4/00/$10.00 © 2000 IEEE October 18 - 21, 2000 Kansas City, MO 30 th ASEE/IEEE Frontiers in Education Conference S2B-1 Session S2B of the cultural situation it addresses. It must both produce shared meaning for the sender and receiver of the communication, and promote the writer as a competent member of the engineering community [6, p. 118]. Successful engineering writing entails adapting to a new discourse community and mastering its conventions for communication. While more acculturated engineering professionals are often able to read their work from the perspective of their audience and anticipate their audience’s reaction [7, p.49], novice engineering professionals do not “naturally” know the discourse of the engineering community or their audience’s expectations [8, p. 14]. This is where peer review can be extremely helpful. Educators have noted that knowledge involving judgment is best gained through collaboration, and writing is just such a process of making judgments regarding what to write about, what to say, how to say it [9]. Writing plays a critical role in learning how to think, act, and evaluate like an engineer, and writing and reviewing collaboratively can enhance that role [10]. I find that students need to be trained and coached in the peer evaluation process on an ongoing basis. I do this by providing them with evaluation checklists that they fill out for the first few assignments. An example of a checklist for an assignment is shown in Figure 1. Once students seem confident in evaluating one another’s work, I wean them from the checklists; however, if the quality of the evaluations subsequently drops, I re-instate them. I grade the team’s papers as a group, and if one team member’s paper contains excessive errors or does not fulfill the assignment, I point out to all group members that I consider the group responsible for catching these problems before I am forced to lower that particular student’s grade. I set high standards for them as professional engineering writers, along with voicing a clear expectation that I hold the group responsible for collectively solving the problem of how to demonstrate its professional writing competency to me. M ETHODS Evaluation Criteria for Memo Assignment Evaluatee___________________________ Evaluator___________________________ 1. Does the draft follow the assignment? In his recent Bloomfield Distinguished Engineering Lecture [11], Richard Felder noted that once ABET Engineering Criteria 2000 is implemented, “engineering graduates will be 2. Is the draft easy to follow and well organized overall? required to demonstrate communication and multidisciplinary teamwork skills.” Felder cites the need for 3. Is the tone of draft professional and appropriate for a business more cooperative learning activities in engineering setting? education, and notes that “several thousand studies have confirmed the effectiveness of cooperative learning in every 4. Is the purpose clear, are the memo’s conclusions appropriate, conceivable educational setting” [ibid]. Both Felder and I and is it clear what actions are being requested? prepare our students to work collaboratively by pointing out that this is now standard practice in the workplace, and by 5. Are the sentences clear and well composed stylistically? citing research findings that students who work in groups enjoy class more and get better grades [12]. To accomplish the goal of improving communication 6. Is the format correct? and teamwork skills in my class, I put my students into teams of four at the beginning of the term. I use a writing 7. Is the draft free of mechanical errors in spelling, grammar, and skills pre-test to assess current competence, and then punctuation? diversify my teams in terms of writing competency, engineering major, gender, and ethnicity. These teams sit 8. Additional comments to improve the draft: together and collaborate on writing tasks as well as review one another’s writing throughout the term. While I do not grade teams on group writing tasks, I point out continually that they are responsible for improving one another’s grades Figure 1. Typical Peer Evaluation Guidelines through the peer evaluation process. In addition, in several group writing exercises they compete against other writing Felder allows his teams to “fire” students who don’t pull teams for extra credit points. Importantly, a component of their weight, and also allows students who consistently do their grade is based on evaluation by their team members on most of the work to “quit” the group [11], but he says that their performance as a peer reviewer and their performance these options were rarely exercised. I encourage team as a collaborative task contributor [see also 13].2 I also members to come to me with problems, and there have been refuse to accept a paper from a student unless it has been peer evaluated. If they miss the peer evaluation session, they some, but I have not yet had to re-arrange teams. And I find that at the end of the term, team members are quite willing to must take the paper to our University’s Writing Center, penalize members who have not pulled their weight by where peer evaluation is also performed. 0-7803-6424-4/00/$10.00 © 2000 IEEE October 18 - 21, 2000 Kansas City, MO 30 th ASEE/IEEE Frontiers in Education Conference S2B-2 Session S2B evaluating them poorly in the areas where they did not perform to the level of the other team members. When students submit their peer-reviewed papers to me, I ask them to attach the comments from their team members. However, I do not require them to act on these comments unless they feel the suggestions are warranted. Peer review ideally provides students with more latitude to examine peers’ responses critically than they might feel inclined toward the teacher’s more authoritative responses. As Herrington and Cadman have remarked, “the value of peer review exchanges can be realized as much in instances where a writer decides not to follow a peer’s advice as where she does” [14, p. 185]. Peer review empowers students to make their own decisions about the value of their peer’s suggestions. In their studies of peer review in the discipline of anthropology, Herrington and Cadman also find that students often focus on substantive matters of interpretation as well as organization and style, and students reported that viewing the work of their peers helped them to work out their own ways of presenting themselves as writers within the discipline. I have reached the same conclusion about my classes, where the level of critique is sometimes lacking in substance but is nearly always thoughtful and often sophisticated, and where students almost uniformly report that the process was helpful to them. Often, even students who are having difficulties with their own writing are able to give sound advice to others—sometimes working through their own writing challenges in the process. Students have impressed me with their ability to stay on task as well as their competence at recognizing and addressing complex rhetorical issues in professional engineering writing, including context, tone, credibility, authority, and collegiality. Research on writing groups [15] shows that they: • • • • • • • • • • stakes by having them write together as a group [7]. I accomplish this in my class by presenting the group with collaborative writing exercises that are creative as well as problem-oriented. I then have the teams compete with one another and reward the winning team. An example of a collaborative writing exercise is shown in Figure 2. Collaborative writing underscores the processes of solving problems and “thinking together” that are crucial elements of today’s engineering workplace. IN-CLASS ASSIGNMENT: GROUP PRESS RELEASE Your group is being featured in the E&T Department newsletter's "Team Spirit" column of its newsletter. As a group, write a press release describing the members of your group and how the group works as a team to accomplish it s academic goals, as well as any other information you think would help to demonstrate how your group has "team spirit." There's one catch. The paper is slated for publication on April 1st. To celebrate the occasion, your group has decided to try to fool your readers by including a piece of information about the group that sounds plausible but is not true. This piece of information should be closely tied with something about the group that IS true. For instance, you might say that “helping each other as a team comes easily for our group because we are all from large families, and in addition, we are all born under the sign of Virgo, and so are very detail-oriented when it comes to editing each other's work." (This is not a very exciting example—I am sure your group can be much more creative.) After you have completed the assignment, it should be turned in to me in proper press release format, anticipating that the newsletter would likely run it just as it appears in your copy. In other words, it needs to have a title that captures the gist of the news, as well as a strong lead that captures the who, what, where, when, why, and if relevant, how. The story should be in inverted pyramid order. Underline the two "facts" about your group, and we as a class will try to guess which statement is true about your group and which is false. The group who fools the most of us will get an extra credit point. Figure 2. Typical Group Writing Assignment Improve judgment and critical thinking skills Improve organization and appropriateness Improve students’ ability to direct others Improve reflexive understanding of writing as a mode of discourse and a process Provide students with a better sense of their audience Improve language usage Increase the amount of student revising done Reduce student apprehension about writing Expose students to a wider variety of ideas and styles Decrease teacher grading load! However, as Kathryn Riley comments in her article about habits of highly effective writers, peer reviewing can be helpful in an editorial sense but more often on only superficial features. To move teams toward a more synergistic and creative relationship, she suggests raising the Although I do not require the teams to meet outside of the classroom, I have noticed that they will often arrange voluntarily to help one another with a writing task, do a late peer review, or even study together for the mid-term or final. An additional benefit of collaborative writing is that it gives the more accomplished writers in the class—who might already be quite competent and thus unchallenged with much of the class content—the opportunity to step into my role as expert and teach other students. ASSESSMENT AND EVALUATION As stated above, I have been teaching this course primarily as an adjunct and have not developed an integral enough relationship with my students or the Department for students to return to me with testimonials of its success in preparing them as professional engineering communicators. Therefore it is the intention of this paper to present a summary of my 0-7803-6424-4/00/$10.00 © 2000 IEEE October 18 - 21, 2000 Kansas City, MO 30 th ASEE/IEEE Frontiers in Education Conference S2B-3 Session S2B methods and general evaluations from students as to their perceived value to them. However, next year I will join the faculty as a full-time tenure-track member, and I am in the process of developing an assessment plan that will provide more accurate information about whether the outcomes for the class are as I suspect. My own substantial tenure as a professional communicator in an engineering environment convinces me that viewing writing as a social process is critical to one’s success in the workplace, and this has been confirmed by students ancedotally. Students who are working in engineering firms while enrolled in the class have commented that they are learning skills and techniques that are immediately useful to them in their work. Recently, two alumni of my class told me that when faced with a team project in another class, they were the only team who literally wrote collaboratively rather than compiling individual writings, and that they got the highest grade of all teams on their project. The professor who taught this course also confirmed that their report excelled because it was more fully integrated, better organized, and less repetitive than other team reports. Our department, while not accredited by ABET,3 is putting together an extensive assessment plan, and technical communication competency is being assessed since it is an outcome that cuts across all programs. In addition to being a University-wide goal, it has also been identified as high importance/low performance outcome by our industry stakeholders in initial surveys. The assessment questionnaire will go to senior students, alumni, and student employers (stakeholders). In addition to questions we plan to ask regarding technical communication competency in general, questions I plan to ask regarding peer evaluation and collaborative writing specifically are the following: • I [my employees] seek feedback from their peers on their technical communication projects (memos, reports, presentations, etc.) before disseminating final versions. • I [my employees] seek advice on their technical communication projects from more senior or expert members of the organization. • I [my employees] have written collaboratively on one or more occasions. This data, when we implement the study next year, will provide me with a more accurate assessment of the outcomes of my course goals. In the meantime, in present standardized course exit evaluations, students tend to focus their comments on my performance and the contents of the course rather than on their peer review work. A typical comment is as follows: I think students’ focus on teaching and course content underscores that students are just as ingrained as their teachers in viewing knowledge as something that is transferred to them by experts and then carried around in their heads, rather than something that is socially constructed in response to specific contexts and settings. An example of this view is encapsulated in one of the few negative comments I’d had about group work: I found the group work to be time wasted. I would rather hear from the instructor. Despite this criticism, I do believe that students’ collaborative experiences are fundamental to empowering them as communicators and to encouraging positive social actions in their academic and professional lives that will promote their continued growth as engineering communicators. When prompted to consider this more carefully, as I believe will be the case in the assessment process, I believe students will reflect on and recognize the value of peer review and collaborative writing. I close this paper with additional comments from student evaluations on collaborative writing and peer review. I found that working with teams was much easier and fun. I was able to meet other classmates and use their skills to resolve my assignment problems. I enjoyed the group work and peer sessions. What was nice was that it was done in class and we worked well together. I enjoyed working with others in different fields. I learned a lot from them and would recommend this again. Dividing groups depending on pre-exam results was a good idea that made me work effectively with other group members. Peer assignments helped the class get other students’ perspectives on different writing assignments. I really enjoyed the group work. We had fun in class and the environment was fun and relaxing. It was an enjoyable way to work. *** END NOTES 1 It is great to have a teacher who knows the class material. Thank you, I’ve learned a lot. By the way, group work is a good idea. I teach journalistic writing techniques in this class for several reasons. First, I find my students have had little classroom exposure to this writing style, which is pervasive in our society. Second, writing in scientific fields has increasingly taken a more news-oriented turn, with the most 0-7803-6424-4/00/$10.00 © 2000 IEEE October 18 - 21, 2000 Kansas City, MO 30 th ASEE/IEEE Frontiers in Education Conference S2B-4 Session S2B important information and results foregrounded [1]. Managers of engineering organizations increasingly expect this kind of reporting of technical information. 2 I ask students to rate other group members on a scale of 5 to 1, corresponding to excellent, very good, adequate, needs improvement, or poor, on the following criteria: 1) This group member was always prepared and willing to contribute to group assignments, 2) This group member gave me valuable feedback on my work, 3) This group member made a valuable contribution to our group’s teamwork efforts. An additional successful group evaluation method is to have group members rank their group’s performance (including their own) or else spread 100 points according to each member’s level of contribution (again, including their own). [See 14]. 3 The Technology Department falls under the professional umbrella of the National Association for Industrial Technology, and thus far we have opted as a department not to seek accreditation for various reasons. [10] Herrington, A. J., “Writing in Academic Settings: A Study of the Contexts for Writing in Two College Chemical Engineering Courses,” Research in the Teaching of English, 19(4), Dec. 1985, 331-361. [11] Felder, R. M., “Educating Tomorrow’s Engineers.” Bloomfield Distingished Engineering Lecture, Wichita, KS: Wichita State University, Nov. 4, 1999. [12] Carnevale, A. P., Gainer, L. J., and Meltzer, A. S., 1988. Workplace Basics: Skills Employers Want. Washington D.C.: The American Society for Training and Development and the U.S. Department of Labor Employment and Training Administration. [13] Catanach Jr., A. H., and Rhoades, S. C., “A Practical Guide to Collaborative Writing Assignments in Financial Accounting Courses,” Issues in Accounting Education, 12(2), Fall 1997, 521-537. [14] Herrington, A. J., and Cadman, D., “Peer Review and Revising in an Anthropology Course: Les sons for Learning,” College Composition and Communication, 42(2), May 1991, 184-199. [15] Gere, A. R. , and Abbott, R. D, “Talking About Writing: The Language of Writing Groups,” Research in the Teaching of English, 19(4), Dec. 1985, 362-381. REFERENCES [1] Berkenkotter, C., and Huckin, T., “News Value in Scientific Journal Articles.” Genre Knowledge in Disciplinary Communication: Cognition/Culture/ Power. Hillsdale, NJ: Lawrence Erlbaum Assoc., 1995. [2] Landis , R. B. Studying Engineering: A Road Map to a Rewarding Career. Burbank, CA: Discovery Press. 1995. [3] Kynell, T. “English as an Engineering Tool: Samuel Chandler Earle and the Tufts Experiment.” J. Technical Writing and Communication, 25(1), 1995 85-92. [4] Director, Engineering Accreditation Commission, ABET, “Engineering Criteria 2000,” Baltimore, MD, 1999. [5] Windsor, D. A., “An Engineer’s Writing and the Corporate Construction of Knowledge,” Written Communication 6(3), July 1989, 270-285. [6] McGo wan, U., Seton, J., and Cargill, M., “A Collaborating Colleague Model for Inducting International Engineering Students into the Language and Culture of a Foreign Research Environment,” IEEE Trans. Professional Communication, 39(3), Sept. 1996, 117-121. [7] Riley, K., “Seven Habits of Highly Effective Writers,” IEEE Trans. Professional Communication, 42(1), March 1999, 4751. [8] Walker, K., “Using Genre Theory to Teach Students Engineering Lab Report Writing,” IEEE Trans. Professional Communication, 42(1), March 1999, 12-19. [9] Henschen, B. M., and Sidlow, E. I., “Collaborative Writing,” College Teaching, 38(1), Winter 1990, 29-32. 0-7803-6424-4/00/$10.00 © 2000 IEEE October 18 - 21, 2000 Kansas City, MO 30 th ASEE/IEEE Frontiers in Education Conference S2B-5