Faculty Reps’ Briefing: Exam Feedback This document aims to outline various positions relating to examination feedback with the aim of promoting thought and discussion amongst Faculty Reps leading to considering improvements in individual Faculties. What is the University’s policy? The University is has the following policy on the feedback to students from summative examinations: The comments of External Examiners can form useful feedback to students on the cohort's performance and provide pointers for improvement for future candidates. It is good practice to make External Examiners' reports and any response to them available to students: suggestions include posting on a notice board, incorporation into course handbooks, or archiving in the faculty or departmental library. Comments that may be attributed to individual students may need to be removed. Similarly, internal examiners' reports can contribute to this feedback. In examinations where there are several hundreds of candidates it will not be reasonable for candidates to expect individual detailed written feedback on every part of their examination but comments from examiners about the cohort's performance as a whole can provide information to help candidates improve their performance. This can be most clearly communicated to 1 students if reports address issues on a question-by-question basis. More detailed information about the University’s general policies on assessment can be found at: http://www.admin.cam.ac.uk/offices/education/curricula/assessment.html What happens to exam scripts? The ability to provide feedback on a specific candidate’s performance in examination is, to a significant extent, governed by the availability of exam scripts. While examiners’ comments about scripts (recorded separately from the script) could be circulated to students, a better way would be to return scripts to students so that they, in collaboration with supervisors and Directors of Studies could consider the work and identify areas for future development. The University’s policy on examinations scripts is that they need never be released to students as they are not considered ‘personal data’ according to the definition of the Data Protection Act. Examiners’ comments, if recorded separately as per the guidance, are considered personal data but are destroyed shortly after the posting of the class-list. Any Faculty which chooses to deviate from this policy (e.g. Law) is obliged to notify the Education Committee of the General Board as to the reasons for their decision. If you would like to know your Faculty’s stance on the retention of scripts, you should ask to see the ‘Examinations Data Retention Policy’ which should be available to you from the Faculty Secretary. The full paper outlining the University’s policy on the retention of exam data and scripts can be found at: http://www.admin.cam.ac.uk/offices/education/policies/data.pdf 1 http://www.admin.cam.ac.uk/offices/education/support/to.html 1 What is CUSU’s policy? As the University has committed to preventing students having access to their completed exam scripts, CUSU has a broader policy which aims to find alternative ways in which feedback can be brought into the examinations process: CUSU Policy: Building Feedback for Students into the Exam Process CUSU noted that there is currently no feedback available to undergraduates on their performance in non-final year exams, and that examiners’ notes are destroyed once the papers have been marked, that there is no access for students, their supervisors or their directors of study to their exam papers once they have been marked. Therefore in cases where student performance is at odds with what has been predicted by supervisors there is no way for the students, the supervisors, or the directors of studies to evaluate the reason for the discrepancy and take appropriate measures, that this lack of transparency makes it difficult if not impossible for administrative errors involved in the marking process to come to light, that this lack of transparency makes it difficult, if not impossible, for the monitoring and evaluation of patterns of exam success related to: the teaching practices of individual supervisors; the differing practices for exam preparation of the various colleges; the differing practices for exam preparation of the various faculties and that the current procedure for requesting the re-marking of examination papers is designed in such a way that re-marks very rarely occur, regardless of the level of concern on the part of students, their tutors, their supervisors, or their directors of study. CUSU believed that examinations are an important part of the learning process for students and feedback on their performance would greatly contribute to their progress through the Cambridge system, that transparency in the examination system would enable greater understanding on the part of the University and the faculties of existing and potential weaknesses and inadvertent biases inherent in the system. CUSU resolved to support the right of students to receive feedback from their exams, to encourage transparency in the examination system, and to mandate the Academic Affairs Officer to bring this matter to the attention of the appropriate committee and subsequently to report back on his findings at the CUSU Council as soon as possible. What has been done so far? The following paper was introduced to the Education Committee of the General Board on 1 st October 2008. The document was then circulated to Faculty Boards to encourage them to debate the possibility of improved examination feedback through the publication of ‘generic’ feedback relating to the specific examination questions. Minute 449.3.4: Model Answers/Question specific feedback Mr Bagshaw introduced a CUSU paper (E4131): It was agreed to circulate the paper (under a cover note to be prepared by the Officers in liaison with Mr Bagshaw) to Faculty Boards, to stimulate debate and with a request that Boards consider what might be most appropriate in providing feedback on questions within their own subjects. 2 E4131 of 1 October 2008 Exam Feedback: the role of model answers/question-specific feedback Basis for improved exam feedback: CUSU’s Policy2 and Learning and Teaching Strategy3 and Patrick Leonard’s paper to the General Board Education Committee4 make clear the Union’s position that feedback from the summative examinations process is of great importance to students. While CUSU and GB Ed disagreed on the return of examination scripts to students, the University is committed to encouraging Faculties, Departments and Colleges to improving feedback on both formative and summative assessment. This can be seen in the Learning and Teaching Strategy5 and the LTS ‘have you tried’ document on the topic.6 GB Ed agreed that “model answers should be available to students where appropriate.”7 What are the benefits of model answers? Not only would students be able to use model answers to help understand their results in the context of the examinations they have undertaken but also to use the information to improve exam preparation in future years. Supervisors could use these to aid their own preparation for teaching particular courses; this would be particularly useful for supervisors teaching a paper for the first time. This could form part of the response to the QAA’s requirement that postgraduates undertaking supervision work require training.8 What form could model answers take? While marking guidelines are useful, these are most often too vague to allow students an understanding of how their work is translated into a specific mark/class. For Sciences, model answers could be the ‘correct’ answer to specific problems while for essays, they could follow a similar pattern to Arts. Arts answers would not need to be ‘model essays’ but, perhaps, a summary of what the examiner thought had been representative of the best/worst answers in terms of both structure and content. CUSU’s recommendations for model answers/question-specific feedback: 1. Examiners must, for each and every question set in their examinations, prepare and publish question-specific feedback. It is ALWAYS appropriate. 2. Feedback must be detailed enough to allow students and supervisors a clear understanding of how each question was answered well but need not be prescriptive; it must be publicised widely to students through handbooks, lectures, websites, Directors of Studies and supervisors so that all students are aware of the resources. 3. The General Board must be as firm in its resolution that Faculty Boards must require their examiners to produce question-specific feedback as it is in its opposition to the return of examination scripts to students. 2 http://www.cusu.cam.ac.uk/union/policy/CUSUPolicyJuly2008.pdf http://www.cusu.cam.ac.uk/academic/cusults/ E3885 of 14 March 2007 5 http://www.admin.cam.ac.uk/offices/education/strategy/strategy2006.pdf 6 http://www.admin.cam.ac.uk/offices/education/lts/examples/assessmentfeedback.pdf 7 GB Ed Minute 6.4(b) of 14 March 2007 8 QAA Audit 2008 Report, paragraph 36 3 4 3 How can Faculty Reps make changes in their Faculties? As the Education Committee’s paper was circulated in Michaelmas Term 2008, your Faculty should have considered it at a meeting of its Board. To follow-up on this and initiate a discussion on the topic of examination feedback, you might like to consider: What was your Faculty Board’s response to the CUSU paper? Asking for a summary of the discussion and access to the minutes of the relevant meeting should let you know what the current attitude of your Faculty is. What is the current practice in your Faculty? If you haven’t yet sat examinations, you could ask older students and/or supervisors to gauge what the current level of feedback is. What information is currently produced but kept private? Some Faculties generate question-specific information to help with the marking of examinations – if this isn’t currently public then making it so is an easy and cheap way for the Faculty to improve its service to students. Do you think that this is a matter which could generate interest amongst students? Conducting online polls, making posters, sending emails or using Facebook could be a way to establish the level on interest amongst students and could be used to solicit ideas for how the provision could be improved. As examinations vary between Faculties, it is important to seek a solution which fits with your local circumstances. Are there academics who might support improvements in the system? Speaking to supervisors and Directors of Studies about the benefits to both them and students about exam feedback is one way in which you could generate interest amongst the Faculty staff which could have an influence on the decision-makers on the Faculty Board. If you would like support, further information or advice, on this matter or anything else relating to your work as a Faulty Rep, please get in touch. Ant Bagshaw, Education Officer, Lent 2009 education@cusu.cam.ac.uk 4