Scope Academic staff Effective Date June 2008 Responsible Dept. Quality and Academic Standards, Registry Equality Impact Assessment No Last Updated By, and Date Updated by Quality and Academic Standards, July 2011 Next Review Date July 2012 Associated links and webpages No York St John University Marking, Feedback & Moderation Guidance on marking assessments – feedback to students 1 Feedback from assessments is a vital element on the process of learning. It will motivate students by letting them know how well they have done, where they need to improve and how to improve. In all cases feedback should be given as soon as is reasonably possible after the assessment to allow for development before the next assignment. Individual Faculties should agree their own particular strategy for giving student feedback in order to ensure consistency of student experience across the Faculty. 2 Effective feedback should: be helpful, constructive and encouraging indicate whether the learning outcomes are being achieved at that stage. indicate strengths and weaknesses. be legible ( if written) , relevant, useful and timely. encourage the student to reflect on their work. address inconsistencies. identify areas that need to be strengthened by increased knowledge. encourage critical and analytical thought. avoid facetious and sarcastic comments. be supported by verbal feedback if possible. justify the grade/mark awarded. indicate that the mark/grade is provisional subject to the confirmation of the Subject-Area Assessment Panel. Written Feedback should be made on an appropriate, purpose-designed feedback form. The University has designed a form which can be used by Faculties but it is acceptable for Faculties to design their own form and make their own arrangements. Where written feedback is offered, the feedback form should be legible and make clear who did the marking and is offering the feedback. The grade and mark should be justified in the comments. A marking cover sheet and feedback form may also facilitate the recording of second marking and moderating issues but these can be recorded separately. It is also recognised that there are other formats for individual feedback and that faculties are experimenting successfully with mp3 files. 5 Feedback on Examination Scripts It is the policy of the University that examination scripts are the property of the University and will not be released to students. Nevertheless students are entitled to feedback on examination performance in the same way as they are entitled to feedback on other assessed work. Furthermore the 1998 Data Protection Act entitles students to access the comments of their examiners which are regarded as personal data. Comments on examination scripts should be appropriate and in keeping with the approach of treating a students work with respect. The comments should be written on a separate piece of paper which can be returned to the student. 8 Penalties when marking Faculties should develop a policy on the implementation of penalties. Penalties could be used to flag up particular issues e.g. the breach of specific scientific or ethical conventions. Such penalties should not normally exceed 10% of the total module mark for the component or the effective lowering of a mark by a class. An exception to this might be where a piece of work demonstrates unsafe practice in a professional area where a fail mark might justifiably be recorded. Any system of penalty should be clearly notified to students in the module or programme handbook. The University’s policy on dealing with over length work can be found as document ASS19. In the case of spelling, grammar or presentation of work, the preferred approach in the University is that assessment criteria should be drafted in such a way as to cover such issues. Such an approach is consistent with the University's expectations in respect of skills in communication. Marking will, therefore, reflect the criteria and penalise unacceptable levels of error in spelling, grammar and presentation as a matter of routine. The Faculty should, however, adopt a consistent approach to identifying and addressing poor written communication skills and presentation skills for the benefit of students through written feedback. A consistent approach to penalising poor referencing is important since decisions about poor scholarship will pay a part in dealing with cases of suspected plagiarism. Faculties are asked to deal with poor academic practice through normal marking procedures. They are asked to ensure that their marking criteria are such that a student who does not reference appropriately will obtain a mark confined to a low class band (assuming content is otherwise acceptable). Such students will be offered detailed advice on how to improve their marks. Faculties are asked to consider the use of formative assessed work for first year students and possibly for international postgraduate students so that the students can attempt some written work which will offer experience of academic writing and referencing outside an assessment context. 9 Reliable marking As well as being concerned with motivating students and contributing to their learning through the provision of constructive feedback, marking must be reliable and consistent for the purposes of differentiating between the performances of students on the same programme of study and allowing a rank ordering of performance to take place. A marker should aim for self-consistency in marking and the procedures of a panel of examiners should seek to achieve inter-marker consistency. Aids to this are as follows. The use of assessment criteria for each assessment task Use of marking schemes The use of grade performance descriptors Anonymous marking to screen out possible assessor bias Trial marking by module or course teams Double-marking and moderation procedures. The University has established arrangements for the anonymous marking of assessments carried out under examination conditions and has agreed to establish similar arrangements for essays and dissertations. Faculties will decide the appropriate assessment criteria and marking schemes to be used for particular assessment tasks and may choose to engage in trial marking. The University has agreed that each Faculty will determine a policy for assuring itself of the reliability of its marking through establishing procedures for the moderation of marking. The following guidelines on Faculty Internal Moderation Procedures are provided. It is important that the Faculty internal moderation procedures are rigorous, robust and consistent. While the processes may vary to accommodate the style of learning and teaching of a particular module, the procedures should reflect an agreed minimum threshold of internal moderation. Double marking is one method of achieving moderation. Faculty is not committed to a policy of enforcing double marking although it is acknowledged that it might have a place eg in the marking of special studies, establishing marking standards with a new member of staff or dealing with failed or disputed pieces of work. 10 Moderation Moderation is an essential process of monitoring that assessment and marking have taken place in a way that ensures consistency across the module and between modules of the same level, matches learning outcomes, maintains standards and is fair to students. Process of Moderation This involves three stages. Stage 1 To ensure: That the assignments detailed in the module specification properly reflect the academic, generic, and cognitive learning outcomes of the module. That the total package of assignments for the module does not exceed the specified word limit or its equivalent. That assignment titles and tasks are appropriate and where necessary different from the previous assignments for the same module. That arrangements for the approval of individually negotiated assignments are clear. That mark schemes or specific assessment criteria for an assignment are agreed in advance and published to students as necessary. This stage of the moderation process MUST be completed before the module begins and the assignments are published in the module handbook. The external examiner should be involved in the moderation of all assessment tasks for modules contributing to final degree classification. Stage 2 To ensure: That the marking properly reflects the intentions of the assignment and the learning outcomes of the module. To ensure that there is consistency of marking across the module and between modules of the same level. This stage occurs after the module has been completed and the first marking has taken place. This might be achieved by second marking, blind second marking or sampling. Second marking might usefully take place where a module has been taught for the first time or where there is a new member of staff and should take place where the piece of work is both substantial and highly individualised e.g. a special study, ILU or Masters dissertation of 20 credits or more. In most other circumstances satisfactory moderation might be achieved by sampling. For modules where second marking does not take place, internal sampling will be organised by the module leader and should normally include any potential failures, first class work, borderlines and a sample across all other classifications. Academic Standards Committee agreed (June 2003) that the total sample should typically be the number equal to the square root of the total cohort on the module. A minimum number should be set for very small groups, e.g. groups of 10. The smallest sample should be 5 scripts. The internal moderated sample may usefully form the basis of that which is sent to the external examiner. Some Faculties may require moderation in addition to double marking in certain modules. Special arrangements should be made for the marking and moderation of assessed work and performance work. Often this can be achieved by more than one member of staff being involved. Consideration should be given to capturing ephemeral experiences for the purposes of moderation and external scrutiny. Stage 3 Moderation Report 11 A brief report on the process and the outcomes of the process of moderation should be included with the mark lists and presented to the Subject-Area Assessment Panel. External moderation Our External Examiners are moderators of standards. Programme teams are responsible for ensuring that appropriate samples of assessment from each module are sent to the External Examiner for moderation. Samples should include examples from the full-range of grades awarded. Samples should be a sensible size. The square root of the module cohort is a guide. The important principle is that the External Examiner has a sufficient range of work to reach a clear judgment about standards. External Examiners are not involved routinely in moderating assessment at Level 1 of a three year degree programme but would be involved with level 1 of a Foundation degree or if the award is set entirely at that level. Programme teams are responsible for ensuring that: The examiner receives samples as quickly as possible after the internal moderation. The examiner receives accompanying information about the module (Module Handbook) including assessment criteria. The Examiner receives clear written information about any special cases which s/he is being asked to consider (see d below). As well as receiving samples of assessed work, External Examiners may be asked to consider individual student cases. For example: To adjudicate on a disputed grade following extensive internal moderation. To advise on alleged plagiarism. To consider exceptional/outstanding work, awarded very high grades. To consider failed assessments. External Examiners should normally see all failed assessments on a taught module contributing to final awards where an overall fail mark for the module is likely to be recorded, i.e. not bracketed marks. It would be sensible for external examiners to see failed and all First Class Special Studies. It is neither necessary, nor good practice, to send all assessments at “classification borderlines” to the External Examiner. The internal moderation process should resolve most individual cases. If that process produces a borderline grade, than we should be confident in that grade and (through notes of the moderation process) be able to justify it. In the event an External Examiner determines that the overall level of grading on a module or modules is inappropriate, s/he will request that all work submitted for the assessment in question be re-marked by module tutors, taking into account the Examiner’s judgement about the original level of grading. If at all possible, this should be completed prior to the SAP meeting. Where this is not possible, module grades will be approved through Chair’s Action. 12 Disclosure of marks and feedback In accordance with the 1998 Data Protection Act, it is university policy that provisional marks be disclosed to students. This is important so that feedback is not delayed unduly by the pace of the overall mark confirmation process. However all marks should be clearly accompanied by the word “provisional” and the student made aware that the mark could go up or down as part of the collective consideration by the Subject-Area Assessment Panel. It would be prudent that any changes made at the Panel meetings are accompanied by the justification for such changes. Faculties should also develop good practice for the dissemination of marks. It is not considered appropriate for marks to be disseminated by e-mail, by ‘phone or via the notice boards with names. The Faculty strategy for dissemination of marks should be published in advance and should be used consistently throughout the Faculty. ASS14b Maintained by: Registry Last updated: July 2011