Edith Cowan University Centre for Learning and Development Engaging Students in Peer Review When properly implemented, engaging students in peer review leads to greater achievement of learning outcomes, higher student satisfaction and better UTEIs. The process gives students opportunities to gain benefits from both giving and receiving feedback, and from engaging in dialogue about quality and standards in the discipline. Giving feedback to peers When students review and give feedback to peers they improve their own work more than by receiving feedback alone (Cho & Cho, 2011). Reviewing the work of peers gives students opportunities to: examine work from the perspective of a critical reader; apply problem-solving skills in analysing work, diagnosing problems and proposing solutions; and learn by explaining what makes work good or not so good (Sadler, 2010). Receiving feedback from peers Feedback from peers leads to: ‘mindful’ or thoughtful reception of criticism and suggestions; engagement in dialogue with the assessor (if the opportunity is given); less passive acceptance and implementation of advice; a search for confirmation by going to other sources and questioning; and more self-corrections (Yang, Badger & Yu, 2006). Students rate feedback from peers, as compared with teacher feedback, as: more understandable; less directive*; and more helpful, particularly when received before a final mark is awarded. *Non-directive feedback is positively associated with complex improvement in work (Nicol, Thomson & Breslin, 2013). Clearly peer feedback is not the same as feedback from an expert (the teacher), particularly in relation to accuracy and content detail. Yet teacher feedback, compared with peer feedback, leads to: fewer self-corrections; more simple repairs; and no discernible effect on later work, although a specific task may be improved if feedback is given on a draft (Cho, Chung, King & Schunn, 2008; Cho & MacArthur, 2010; Cho, Schunn & Charney, 2006). Student Peer Review, August 2013 1 Edith Cowan University Centre for Learning and Development How can we develop effective, sustainable peer review and feedback processes? 1. Let students in on our secret We become skilled at making informed judgements about student work because we practise all the time, comparing student work, engaging in dialogue with colleagues and justifying grades to students. When we ask students to review the work of a peer and give feedback we begin to let them in to our secret world and its processes of assessment 2. Emphasise holistic judgement processes Encourage students to evaluate work in terms of the overall purpose of the task, and to give feedback on specific aspects of work in the context of the task purpose (Bloxham, 2013). 3. Be open about the complexity of professional judgement In our effort to make standards transparent for students we have developed a habit of representing them through rubrics. We need to acknowledge that the process of making professional judgements cannot be fully represented by criteria or rubrics. The truth is that these published criteria don’t reflect the way we actually make judgements (Brooks, 2009). 4. Be honest about our own process In practice we actually we tend to work backwards from holistic judgements, awarding marks to individual criteria later, or using criteria to check or confirm holistic judgement (Grainger, Purnell, & Zipf, 2008; Bloxham, Boyd, & Orr, 2011). We need to teach students to work this way – from holistic to particular, giving them opportunities to explain holistic judgements by drawing on criteria. 5. Encourage dialogue about quality and standards Student involvement in making holistic judgements, often using exemplars of previous students’ work at various standards, can initiate dialogues that give students access to the tacit knowledge of experts (Handley & Williams, 2011; Sambell, Barry-Cutter, & Price, 2011). 6. Be honest about judgement Professional judgement has the potential for legitimate individual difference. Different perspectives can be used to foster dialogue in which criteria are invoked to explain judgements. This will make students more critical and engaged users of feedback and lead to learning that lasts beyond an immediate task. 7. Redefine feedback Most students see feedback as only the written comments they get on an assignment the lecturer has marked and returned to them. Such a limited view of feedback excludes the dialogic process promoted by Nicol (2010). The informal processes of peer interaction (chats between students) offer excellent learning opportunities, often in a relaxed environment – exactly the environment conducive to deep learning (Sambell, et al., 2011). 8. Shift the locus of control to learners Feedback is too often based on what the teacher wants to say rather than on what the student is ready to hear. Students engaged in peer review experience greater feelings of autonomy and control (Carless, 2013). They also develop self-evaluative capacities so that they are able to continue improving and become autonomous, self-regulating learners. Student Peer Review, August 2013 2 Edith Cowan University Centre for Learning and Development 9. Redefine the teacher’s role Implementing peer review and feedback changes the teacher role from someone who mainly provides comments on student progress, to one of supporting students to make their own professional judgements (Carless, 2013). The instruction becomes less teacher-centred. 10. Create a classroom culture of openness and trust It is important to spend time on creating a classroom culture of support and understanding before attempting to implement a peer feedback system. Students are only ready to engage with a peer feedback process when they: feel comfortable with each other and the teacher; feel supported by their peers; respect each other’s opinions; and feel willing to take risks and make mistakes (Glasson, 2009). What can be done to create a supportive classroom culture? Implement in-class activities requiring cooperation and support (class meetings, games, roleplays); Attend to physical classroom layout (conducive to collaborative work); Explain why peer review is being introduced and how it benefits students; Provide explicit instruction about how to give and receive feedback; Value mistakes (So everyone’s work was perfect? That was a waste of time!); Respect individuals’ desire for privacy – ask for volunteers to share feedback, don’t insist; Insist that all views are listened to respectfully; and Use models or exemplars to practice with (Glasson, 2009). Feedback is central to the scholarship of assessment (Rust, 2007) as it helps students to understand standards, gauge their own achievement in relation to those standards, and identify ways of bridging the gap (Sadler, 1989). We can engage students in the scholarship of assessment by positioning assessment and feedback as learning activities that are integral to developing the professional judgement that will be required by them in their future careers. Student Peer Review, August 2013 3 Edith Cowan University Centre for Learning and Development References Bloxham, S. (2013). Building 'standards' frameworks: The role of guidance and feedback in supporting the achievement of learners. In S. Merry, M. Price, D. Carless & M. Taras (Eds.), Reconceptualising Feedback in Higher Education: Developing dialogue with students. London: Routledge. Bloxham, S., Boyd, P., & Orr, S. (2011). Mark my words: the role of assessment criteria in UK higher education grading practices. Studies in Higher Education, 36(6), 655-670. DOI: 10.1080/03075071003777716 Brooks, V. (2012). Marking as judgment. Research Papers in Education, 27(1), 63-80. DOI: 10.1080/02671520903331008 Carless, D. (2013). Sustainable feedback and the development of student self-evaluative capacities. In S. Merry, M. Price, D. Carless & M. Taras (Eds.), Reconceptualising Feedback in Higher Education: Developing dialogue with students. London: Routledge. Cho, Y. H., & Cho, K. (2011). Peer reviewers learn from giving comments. Instructional Science, 39(5), 629-643. DOI: 10.1007/s11251-010-9146-1 Cho, K., Chung, T. R., King, W. R., & Schunn, C. (2008). Peer-based computer-supported knowledge refinement: An empirical investigation. Communications of the ACM, 51(3), 83-88. DOI: 10.1145/1325555.1325571 Cho, K., & MacArthur, C. (2010). Student revision with peer and expert reviewing. Learning and Instruction, 20(4), 328338. DOI: 10.1016/j.learninstruc.2009.08.006 Cho, K., Schunn, C. D., & Charney, D. (2006). Commenting on writing typology and perceived helpfulness of comments from novice peer reviewers and subject matter experts. Written Communication, 23(3), 260-294. DOI: 10.1177/0741088306289261 Glasson, T. (2009). Improving Student Achievement: A practical guide to assessment for learning. Curriculum Corporation, Victoria, Australia. Grainger, P., Purnell, K., & Zipf, R. (2008). Judging quality through substantive conversations between markers. Assessment & Evaluation in Higher Education, 33(2), 133-142. DOI: 10.1080/02602930601125681 Handley, K., & Williams, L. (2011). From copying to learning: Using exemplars to engage students with assessment criteria and feedback. Assessment & Evaluation in Higher Education, 36(1), 95-108. Nicol, D. (2010). From monologue to dialogue: improving written feedback processes in mass higher education. Assessment & Evaluation in Higher Education, 35(5), 501-517. DOI: 10.1080/02602931003786559 Nicol, D., Thomson, A., & Breslin, C. (2013). Rethinking feedback practices in higher education: a peer review perspective. Assessment & Evaluation in Higher Education, (ahead-of-print), 1-21. DOI: 10.1080/02602938.2013.795518 Rust, C. (2007). Towards a scholarship of assessment. Assessment & Evaluation in Higher Education, 32(2), 229-237. DOI: 10.1080/02602930600805192 Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional science, 18(2), 119144. Sadler, D. R. (2010). Beyond feedback: Developing student capability in complex appraisal. Assessment & Evaluation in Higher Education, 35(5), DOI: 535-550.10.1080/02602930903541015 Sambell, K. (2013). Involving students in the scholarship of assessment: Student voices on the feedback agenda for change. In S. Merry, M. Price, D. Carless & M. Taras (Eds.), Reconceptualising Feedback in Higher Education: Developing dialogue with students. London: Routledge. Sambell, K., Barry-Cutter, E., & Price, N. (2011). Rethinking feedback in higher education: an assessment for learning perspective; Learning to learn: learning to cook: the F-word, feedback. Yang, M., Badger, R., & Yu, Z. (2006). A comparative study of peer and teacher feedback in a Chinese EFL writing class. Journal of Second Language Writing, 15(3), 179-200. DOI: 10.1016/j.jslw.2006.09.004 Student Peer Review, August 2013 4 Edith Cowan University Centre for Learning and Development Appendix 1: A guide to giving and receiving feedback Everyone knows what bad feedback feels like: we feel put down, attacked and confused. Even praise can be bad feedback if it is false and patronising. Useful feedback affirms our worth and gives specific support directed at improving our work. Guidelines for giving feedback Express your feedback in positive terms. For example, 'It would have been helpful if you had emailed the location and starting time for the meeting to everybody in the group' rather than 'How do you expect us to meet if you don't tell us the time and location'. Being positive gives an opportunity for agreement, being negative is more confrontational. Be descriptive rather than evaluative. Describing what you see reduces the need for others to react emotionally. Reveal your own position or feelings. For example, 'I felt confused by this point' rather than ‘This point doesn’t make sense'. Describing your reaction gives the person an opportunity to reflect and respond to the feedback. Be specific rather than general. For example, ‘I struggled to see the connection between this data and your discussion section', rather than ‘the discussion is too general’. Focus on things the person is likely to be able to change. Check that you have communicated your feedback clearly, ideally by discussing it with them. Guidelines for receiving feedback Listen to the feedback with an open mind and try to understand the other person's perspective. Be quiet while receiving feedback. If you even think about framing a response or trying to explain or justify your work you won’t get maximum value out of the feedback. Give the feedback serious consideration and weigh up the consequences of changing or not changing. Express your thoughts and feelings about the feedback and possible changes. Explore options with the person who has given you feedback - they may have other ideas. Express appreciation for the feedback. Adapted from: Boud, D. 2010 Assessment Futures Retrieved from http://www.iml.uts.edu.au/assessment-futures Gibbs, G. (1994) Learning in Teams: A Student Manual. Great Britain, The Oxford Centre for Staff Development. p47. Gibbs, G. (1994) Learning in Teams: A Student Guide. Great Britain, The Oxford Centre for Staff Development. p13). Student Peer Review, August 2013 5