EXTERNAL EXAMINER HANDBOOK General Guidance for External Examiners 1. Boards of Examiners Meetings a) Schedule A schedule of Board of Examiners meetings will be circulated to all the School’s External Examiners annually. In addition, an invitation with specific timings of the Boards will be sent to External Examiners four weeks in advance of a forthcoming Board of Examiner meeting. b) Attendance It is a University regulation that no University degree shall be awarded without the participation of at least one External Examiner in the examining process. In addition, it is the University’s expectation that all External Examiners should be present at each meeting of a final-year Board of Examiners meeting. c) Consideration of Mitigating Circumstances (Undergraduate Programme) Students are clearly advised that any extenuating circumstances (medical or compassionate) must be brought to the attention of their personal tutor before the examination board meets in June. In addition to the information in the Student Handbook, several reminder messages are posted on my.wbs throughout the year. Finally, students are again reminded in May/June that it is their responsibility to ensure that documentary evidence is available to support any claims to extenuating circumstances, including difficulties encountered during the examination period. The School currently operates an extremely thorough process of pre-meetings and pre-boards in advance of the final Exam Board. Prior to the first pre-board, a pre-meeting is held which is attended by the Exam Board Secretary, WBS Senior Tutor, Undergraduate Programme Manager and Undergraduate Administrative Director. The objectives of the pre-meeting are: (a) To review the marks and ensure that none are missing or incomplete. (b) To identify all ‘borderline’ candidates and establish whether or not there are any extenuating circumstances which need to be taken into consideration. (c) To identify any further cases which, whilst not borderline, might necessitate special treatment by the examination board. (d) To agree which cases for special treatment of extenuating circumstances should be made by the Senior Tutor to the examination board. In addition, further to the above, the School has held discussions with the University’s Mental Health Co-ordinators regarding the treatment of those students with mental health conditions 1 and, if deemed appropriate, one of the Mental Health Co-ordinators will attend the premeeting to offer the School additional guidance on complex cases. The School then holds two pre-board meetings at which the cases of those students, deemed to have mitigating circumstances that may require consideration by the final Exam Board, are further discussed. At the pre-boards additional evidence and late marks relating to the student’s case may also come to light and this information is taken into account before a final decision is taken as to whether the case should be presented by the Senior Tutor at the final Exam Board. This process means that by the time the final Exam Board takes place, the School is able to make a clear recommendation to the final Board as to which students have mitigating circumstances necessitating special treatment. It is School practice to only consider students for special treatment by the Board who have been discussed at the pre-meeting and pre-boards and where written documentation is available. In accordance with the University’s proposed guidelines, External Examiners will be notified of the date of the pre-meeting held to discuss mitigating circumstances and an invitation offered to External Examiners to attend the pre-meeting should they wish to do so. d) Consideration of Mitigating Circumstances (Postgraduate) Programme teams should inform students of the need to submit mitigating evidence in writing (with professional or other suitable documentary corroboration as appropriate) at the earliest possible stage and by such a date as may be required for consideration at a forthcoming Board of Examiners meeting. In cases where students have been prevented, for medical reasons, from attending an examination or any part of an examination, the student should submit a medical certificate showing his/her inability to complete the examination at the prescribed time. If at all possible this should be no later than three days following the last day of his/her examinations. The School will advise students, when requesting medical evidence to support their application for mitigation, to advise their doctor that the information will be shared with a number of people and to discuss with their doctor the most appropriate wording of the medical evidence. All mitigating evidence (either from a student or personal tutor) should be communicated in writing to both the Secretary of the Board of Examiners and the Programmes Quality Officer in advance of the Board meeting to ensure clarity of information and that a proper record exists and is subsequently kept. New verbal and anecdotal information about candidates should not be introduced in the course of a Board meeting unless circumstances make this genuinely unavoidable. Discussion of mitigating circumstances will take place at the meeting of the Pre-Board, which external examiners may attend if they wish but are not required to do so. A written record of decisions relating to discussion of the mitigating evidence at the Pre-Board should be kept along with a brief indication of the reasoning behind the decisions. External Examiners should be consulted about the recommendations to be made to the Board of Examiners prior to the meeting of the Full Board. 2 The Full Board will normally accept the recommendation of pre-Board meeting without the need for further discussion of the personal or medical circumstances affecting students’ performance. Only in very exceptional circumstances should the Full Board request to see the evidence presented to the pre-Board. Where a request from a member of the Board is made for disclosure of such evidence, the Chair shall determine whether the circumstances of the case are so exceptional as to require disclosure, having particular regard to the sensitivity of the information to the student and to any other persons whose identity might be disclosed. Evidence should only be disclosed on the express authority of the Chair of the Board and on the strict understanding that all members of the Board are bound by a strict requirement of confidentiality and non-disclosure of evidence. e) Award of Degree with Merit and Distinction It is open to the Board to recommend the award of the degree with merit or the award of the degree with distinction as recognition of a consistent standard of high performance in both the taught element and the dissertation. Please refer to specific exam conventions for these options. Scripts will be sent at borderlines for both Merit and Distinction awards (i.e. 64 – 66 for the award of merit and 69-71 for the award of distinction). f) Confirmation of Results At the end of each Board of Examiner meeting the External Examiners present will be asked to confirm by signature, along with the Exam Board Chair and Secretary, their assent to the final classification of candidates. In the event of a disagreement over the final classification of a particular candidate, it is the policy of the School that the Exam Board Chair should take very careful account of the views of the External Examiners present before a final decision is reached. External Examiners have the right to withhold their signature if the decision of the Board is against their strong recommendation. In the event of this occurring, the Chair of the Exam Board would make a full report to the University’s Senate. 2. Assessment Processes a) Schedule for external moderation External Examiners for the School’s MBA and Undergraduate programmes will be provided with a schedule on an annual basis that provides information on the dates that scripts can be expected along with the date of return. External Examiners for the Specialist Masters programmes will receive guidance from the Programme Manager on the schedule for moderating scripts. Further information on the School’s guidelines for sample sizes and information to accompany the scripts for moderation can be found in the Liaison with External Examiner Handbook (Sections 2, 3 and 4). b) Approval of Examination Papers It is a University requirement that all examination papers (including resit papers) are sent to the relevant External Examiner for approval. 3 c) Approval of Coursework It is a School requirement that all coursework with a percentage weighting of 30% or more is sent to the External Examiner for prior approval. We would be grateful if our External Examiners could pay particular attention to whether the assessment has been designed to reduce the likelihood of plagiarism and that any concerns the External Examiner may have in this respect are drawn to the attention of the NIE concerned. 3. External Examiner Reports a) Date for submission The University requests that all External Examiners for Undergraduate programmes submit their annual report within one month of the summer Board of Examiner meeting. For Postgraduate programmes, the University requests that all External Examiners should submit their annual reports within one month of the November exam board (with the exception of the MPA programme where reports should be submitted within one month of the March exam board). b) Format The External Examiner report form seeks explicit responses to the topics listed below, derived from the QAA Code of Practice on External Examining: i) ii) iii) iv) v) vi) vii) viii) ix) x) xi) xii) xiii) c) The standards demonstrated by the students; The extent to which standards are appropriate for the award or award element under consideration; The design, structure and marking of assessments; The procedures for assessments and examinations; Whether or not External Examiners have had sufficient access to, and the power to call upon, any material needed to make the required judgements; Where possible, students’ performance in relation to their peers on comparable courses; The coherence of the policies and procedures relating to External Examiners and their with the explicit roles required of them; The curriculum, its aims, content and development; Resources as they impact upon student performance in assessments; The basis and rational for any comparisons of standards made; The strengths and weaknesses of the students as a cohort; The quality of teaching and learning methods which may be indicated by student performance; Any recommendations that the External Examiner may have. Completed Report Forms Completed External Examiner reports should be submitted electronically as Microsoft Word files within one month of the final Examination Board. Please submit external examiner reports to Mrs. Jo Latimer, Examinations Section, University of Warwick, e-mail J.Latimer@warwick.ac.uk. The reports will then be submitted to the Vice-Chancellor’s Office. 4 d) Consideration of Reports All External Examiner reports are read and annotated by the Deputy Vice-Chancellor before being sent to the School. The School then circulates the report to relevant Academic Directors, Heads of Group, Named Internal Examiners and Programme Teams, along with a request that any comments on issues raised in the report should be submitted to the School’s Programme Quality Committee. The comments received, along the report itself, are then discussed at the Committee and any necessary action arising from the report agreed. The Associate Dean (Programme Quality) then completes the University pro-forma noting any action that has been taken in response to recommendations in the report. It is University policy that this response is then forwarded to the relevant External Examiner. In addition, it is the policy of the School to write to the External Examiner separately thanking them for their report and responding to issues raised in the report. 4. Fees and Expenses External Examiner fees are paid annually by the University following receipt of the External Examiner report (see section 2 for the relevant date for submission of the report). Expenses arising from attendance at Board of Examiner meetings may be submitted to the University following each Board (Mrs. Jo Latimer, Examinations Section, University House, University of Warwick, Coventry CV4 8UW). It is not necessary to wait until the submission of the annual report. Expense forms are obtainable from the School upon request. 5 School Procedures for Liaison with External Examiners 1. Communication with External Examiners The Head of Group (or his/her representative) is required to: (i) Take responsibility for ensuring that liaison with the External Examiner is well coordinated by the group as a whole and is supported by the group office. (ii) Monitor adherence of the group to the pre-set deadlines with assistance from the group office. Named Internal Examiners are required to: (i) Take responsibility for liaison with External Examiners over academic matters (see paragraph 11 for programmes where this is not the case). (ii) Record communication with the External Examiner and make this information available for submission to the relevant programme. 2. Briefing of External Examiner NIEs are required to provide the following information to External Examiners: (i) Module outlines for background information and comment; (ii) Information on the assessment method for the course and the rationale for the assessment method; (iii) Outline of any coursework requirements plus model answer/marking scheme; (iv) Exam questions accompanied by model answers (as appropriate). (v) Criteria for selecting the size and composition of the sample; (vi) Action that the External is expected to take when moderating scripts. 3. Moderation of Marks by External Examiners and Size and Nature of Samples Samples should be divided into the following categories for inspection: (i) Validation that internal marking is of an appropriate standard, with recommendation, if necessary, that the marks of a whole cohort or sub-group be raised or lowered en bloc. (ii) Arbitration in cases of genuine internal uncertainty or disagreement where internal examiners have been unable to reach agreement in spite of their best efforts. The samples should be accompanied by clear instructions as to the nature of the sample and expected action from the External Examiner. Validation Sample It is recommended that the validation sample should be selected using the following guidelines: 30 scripts and below 31 to 50 8 scripts 8 scripts 10 51 to 75 76 to 150 9 - 12 scripts 10 scripts 6 150 to 200 14 13 scripts 200 plus 17 15 scripts 20 The Named Internal Examiner is required to ensure that: The sample of scripts is accompanied by a copy of the exam paper in question, if possible with outline solutions/mark scheme; A copy of the complete marksheet (with assessment grades, if relevant) is included; The mean and standard deviation of the range of marks are provided; Information is provided to External Examiners on the double marking that has taken place. In addition, the following guidelines are recommended: The sampling of scripts within each category should be random, ensuring an even spread across classifications. Fails are to be treated in the same way as other categories i.e. a sample in pack A and genuine borderline cases in pack B; The size of the sample of assessed work to be reviewed by the External Examiner(s) should always be confirmed with them at the start of the module, but should always be large enough for the External Examiner to be able to form a judgement as to the appropriateness of the marking; The NIE should ensure that the dispatch of the samples to the External Examiner is accompanied by a telephone call or fax to the External Examiner. The External Examiner would then be in position to inform the School of any subsequent loss or delay to the material. Arbitration Sample NIEs are required to make every effort to agree marks internally before sending borderline marks to External Examiners for adjudication. When sending this second pack of scripts to the External Examiner the NIE should provide clear instructions to the effect that the External Examiner is being asked to adjudicate between marks. Recommended guidelines: In cases of uncertainty or disagreement over borderline marks, NIEs should make every effort to ensure that it is the COMBINED mark for the module, not individual components of assessment, which is considered. Once every effort has been made internally to confirm that the mark is borderline, NIEs should send all items of assessment for that module (examined and assessed) for moderation by the External Examiner. Dispatch of Sample NIEs are required to send a letter detailing the contents of the sample being sent and clarifying the expected actions of the External Examiner i.e. validation or arbitration when dispatching the samples. This letter is a standard letter with gaps to be completed by the NIE (see appendix 1). 4. Assessed Coursework It is a requirement that all coursework of a percentage weighting of 30% and above is sent by NIEs to External Examiners for initial approval and the coursework assessments should then be included in samples sent to External Examiners for moderation. In the case of a module that is 7 wholly assessed by a number of small items of coursework, the NIE should use his/her judgement to ensure that the External Examiner receives a representative sample. 5. Meeting Deadlines for Marking NIEs are required to ensure that internal marking has been carried out by the agreed internal deadline. This is to ensure that there is sufficient time for samples of work to be delivered to the External Examiner for external moderation and for the External’s comments to be received in advance of the first meeting of the Examination Board. 6. Approval of Examination Papers It is a requirement that NIEs seek the approval of examination papers by External Examiners in time for the paper to be delivered to Academic Services by the pre-set deadline. NIEs should note that it is also a requirement of the School to ask External Examiners for approval of resit examination papers. 7. Change of Format to Examination Paper NIEs are required to seek approval from the External Examiner for any changes in format made to examination papers. In addition, all students should be notified in writing, well in advance of the examination, of the nature of any planned change. 8. External Examiners’ Annual Reports NIEs are required to give comments on External Examiner reports and comment on any action that has been taken in response to the report, or is planned. All comments received are considered by the Programme Quality Committee, who will respond formally to both the External Examiner and to the University. 9. Training Sessions for Named Internal Examiners Newly appointed NIEs are required to attend compulsory training sessions. The sessions will cover an overview of procedures relating to examination, assessment and communication with External Examiners along with consideration of good practice. Attendance at the training sessions is strongly recommended for existing NIEs. 10. Additional Information About The Examining Process Detailed schedules will be provided to External Examiners annually by Academic Services providing information on the following: Dates of Boards of Examiners Dates for receiving exam papers for approval and deadline for return. Expected dates for receiving scripts and deadline for return Dates for receiving and returning dissertations In order to make communication more consistent and transparent, a further letter will be sent to Undergraduate External Examiners in advance of the summer examination period to provide them with the following information: 8 The dates of the examinations for the modules for which they are responsible The number of students sitting the examination The anticipated size of the sample Advance warning of the expected date for dispatch of the scripts and the deadline for return. 11. Local Arrangements for External Examiners Some Programmes, such as the Specialist Masters, MPA and Postgraduate Diplomas have local arrangements for the liaison with the External Examiners, and the Course Director, or a representative from the Programme Team, co-ordinate communication with External Examiners on behalf of the Named Internal Examiners. 9 Dear External Examiner Please find enclosed two packs of scripts relating to the module listed below that are being sent to you for external moderation: Module Title and Code: ________________________________________________ Pack one contains ______ scripts for the validation of internal marking. These scripts have been selected randomly whilst ensuring that there is an even spread across all classifications. I would be grateful if you could confirm that the internal marking is appropriate, or, if necessary, provide a recommendation on whether the marks of the whole cohort or sub-group should be raised or lowered en bloc. Pack two contains _____ scripts requiring arbitration i.e. there is genuine internal uncertainty or disagreement. In these cases, I would be grateful if you could confirm what you consider to be an appropriate mark. I would be grateful if you could return the scripts and your comments to me by _________________. May I take this opportunity to thank you for your assistance. Best Wishes 10 NIE HANDBOOK (excerpt for External Examiners) The following extract from the Business School’s NIE Handbook offers information on the School’s assessment and examination processes which our External Examiners may find helpful. The full NIE Handbook is available on request, if required. 1) Assessments & Marking a) Late Submission of Assessed Work Undergraduate students receive a penalty of 5 marks (taking the overall mark for that item of assessment out of 100) for each working day that the work is late. Postgraduate students (Taught and Research) receive a penalty of 3 marks (taking the overall mark for that item of assessment out of 100) for each working day that the work is late. NIEs are not involved in applying the penalties, these are applied automatically. However, NIEs should ensure that Fridays are not used as submission deadlines for assignments due to the fact that only working days are taken into consideration. b) Marking and Return of Assessed Work Responsibility for the marking and return of assessed work lies with the NIE supported by the second marker, External Examiner and the Programme Office. (i) General Marking Criteria Charts, showing the agreed marking criteria for both postgraduate and undergraduate marking criteria, are attached as Appendix 1. Please note that, in line with recommendations of External Examiners, the School wishes to emphasize the importance of using the full range of marks, i.e. 0 – 100%. (ii) Marking Process The marking process has been defined as follows: (i) (ii) (iii) Students submit assignments electronically on my.wbs (with completed cover sheet to include word count, question numbers answered, CATS points applicable). An email is then sent from the Programme Office to the NIE to inform them that the assignments have been submitted and to check a) whether paper copies are required and b) whether the scripts should be sorted by question number (if applicable). Programme Office download scripts from my.wbs and, if applicable, sort papers electronically by question number before forwarding to academics. 11 (iv) (v) (vi) (vii) (viii) (ix) (x) (xi) (xii) (xiii) Assignments run through Turnitin (source-matching software that helps detect plagiarism) Delivery note downloaded and attached to assignment pack (delivery note includes module title, marker, agreed second marker, date scripts passed to marker, no of scripts, no. of scripts outstanding and return date). Academics notified that scripts are ready for collection. Scripts first marked. Once marked, if the NIE suspects plagiarism, the Plagiarism process should be followed (see section e) below). Comments recorded along with the mark on either on the electronic feedback form or on the bar-coded feedback form for those wishing to handwrite their comments. Scripts moderated (second marked) and final marks agreed by first and second markers. Borderline cases checked (following electronic aggregation of marks) with the final mark being adjusted in line with programme practice (e.g. no composite marks ending in a ‘9’ on the MBA and many Specialist Masters programmes). Marksheet validated for inaccuracy and inconsistency Bar-coded handwritten feedback forms scanned by the Programme Office. Marks and feedback released electronically to students with an automatic email informing students that the marks and feedback are available. NIE's and markers identifying illegible scripts should follow the procedure at: www2.warwick.ac.uk/fac/soc/wbs/central/academic-services/examinations (iii) Quality of Feedback NIEs should note that comments should be sufficiently detailed to be of assistance to the student in improving his/her performance. Please bear in mind that students will take the quality of the markers’ feedback as an important signal of the credibility of the marking process. Ensuring that helpful feedback is provided by all markers on the module is an important responsibility of the NIE. (iv) Second Marking The School’s policy on second marking is as follows: All projects (UG and PG) must be ‘blind’ second-marked i.e. the second marker must not have access to the first marker’s mark or comments. No examinations or pieces of assessed work should be ‘blind’ second-marked. ALL marked examinations and assessments should be subject to a process of moderation by a second person, as follows: a) At least 10 scripts, or 10% of the total, whichever is greater, shall be moderated to include: All failing scripts, all first-class/distinction marks (if any), plus a sample from across the full range of marks. b) The second marker should check: that the marks allocated by the first marker are reasonable; 12 c) (v) any scripts that appear to be out-of-line with the overall pattern of marks; that the transcription of marks on the front of the script is accurate; and, that all work submitted has been marked. In the event of a substantial disagreement between the first marker and second marker, the matter should be referred to the External Examiner for arbitration. Word Limits When setting an assessment, NIEs should ensure that any penalties for exceeding the word-limit are made clear to students and the External Examiner (e.g. a deduction of 5% for an additional X words). The word limit should exclude references. (vi) Arrangements for Marking NIEs, in conjunction with the Head of Group, will need to consider what arrangements need to be made for the marking of examination scripts and assignments. Teaching hours are credited on a proportional basis on the School’s TAP system for all academic staff assigned marking duties on a module that is ‘on-matrix’. TAP hours are allocated as follows: Undergraduate Courses Full weight module (24/30 CATS) - 3.2 hours per student Half weight module (12/15 CATS) - 1.6 hours per student Postgraduate Courses Module ≤15 CATS 1.6 hours per student Module >15 and ≤ 24 CATS 2 hours per student Module > 24 CATS 2.4 hours per student NIEs should note that the marking of scripts may not be out-sourced to academics that have no contractual arrangement with Warwick Business School. (vii) Turn-around Time NIEs must ensure that the first and second marking of their module is completed within TWENTY UNIVERSITY WORKING DAYS of the submission deadline of the work, as a maximum. (viii) Inputting of Marks onto MIS (UG modules only) When entering marks onto the MIS NIEs should ensure that WBS marking and moderation guidelines are followed and, if a composite mark ends in -9, a decision should be made about whether the overall performance is worthy of the class above or the class below. If the module is 100% assessed by course work, the NIE will still need to sign off the marks as being an accurate record. Marks should be checked carefully before they are signed off. This is easiest to do with another member of staff. 13 For further guidance on the inputting of marks onto the MIS please refer to Appendix Two. (ix) Disclosure of Marks The University permits the disclosure of actual percentage marks for ‘separately examined module components or elements of coursework’. However, in the event of an NIE disclosing marks to students in advance of approval by External Examiners and/or the final examination board, they must be accompanied by a clear indication that they are to be regarded as provisional. A qualifying statement should also be provided to students reminding them that their degree classification is related not only to individual marks, but also to the profile of the whole examination/assessment performance and that the examination board, in arriving at its academic judgment, also takes in to account other relevant factors (e.g. health). On some WBS programmes, marks are disclosed via my.wbs with this caveat. (x) Provision for Dealing with Student Academic Complaints General Guidance 1) Any complaint should be acknowledged at the earliest opportunity by return of email or letter. 2) An explanation of the process to be followed should be included at the outset along with confirmation of the person who will investigate the complaint. 3) If it is not clear, it may be helpful to invite the complainant to state the nature of the outcome they are seeking. Informal Complaint 1) Where an informal complaint has been raised directly with the NIE, the NIE should investigate and respond in consultation with their line manager. 2) The NIE should discuss the outcome of their investigation with their line manager prior to confirming the outcome in writing to the complainant. Formal Complaint 1) Formal complaints should be referred to the Dean for investigation by them or a nominated colleague. 2) Information should be gathered from departmental files by staff member investigating but care should be taken with regard to confidentiality. 3) Where students have declared a disability to the institution, it should be ensured that information is made available at all stages in the appropriate format. 4) A record of the complaint investigation should be kept in a departmental complaints file. The file should include a log of relevant communication including emails, notes of meetings and any discussions and their outcomes. 5) Any notes taken whilst investigating the complaint should be factual and accurate as the student may access any information held about them by making a Subject Access Request (see the University's Data Protection Policy). 6) The outcome should be communicated to the complainant by the Dean. 14 7) Reference should be made to the second stage of the University's Student Academic Complaints Procedure in case the student remains dissatisfied by enclosing a copy of the procedure with the letter. The student should be made aware that any escalation should be within the deadlines laid out in the procedure. In the event of the matter not being resolved at School level the student may submit a complaint via the University’s Student Academic Complaint Process. It should be noted, however, that students cannot use the Academic Complaint Process to challenge the academic judgement of examiners. The University’s Student Academic Complaint Process is available at the following link: www2.warwick.ac.uk/services/aro/academiccomplaints/procedure/ Non-academic complaints are dealt with under the University Complaints and Feedback Procedure, details of which can be found at http://www2.warwick.ac.uk/services/gov/complaintsandfeedback. 2) Examinations a) Compilation and approval of the examination paper NIEs will be reminded by Academic Services of deadlines for submitting examination papers six, four then two weeks before each deadline, and will be sent the University’s template for the required layout of examination papers (available at www2.warwick.ac.uk/fac/soc/wbs/central/academic-services/examinations/ ). The NIE will be responsible for the writing/compilation of the examination paper. The NIE should ensure that: - the paper has been peer-reviewed (possibly in a Group meeting) prior to sending the examination paper to the External Examiner for approval.1 - the examination paper must be approved by the External Examiner, in time to be delivered to Academic Services by pre-set deadlines. - none of the examination questions have been used verbatim in a previous examination paper, or any other form of assessment. NIEs should be aware that they may be required to provide an examination paper for re-sit examination sessions. Academic Services will try to provide NIEs with as much warning as possible that a re-sit paper is required. However, if a re-sit paper is required for external students the School may not be provided with much notice. NIEs should note that the University’s deadline for the submission of re-sit examination papers is usually the middle of July. b) Reading Time/Open Book/Change to Exam Length Any request by the NIE to remove/add reading time to an examination, change from closed to open book status or amend the examination length should be discussed with the relevant course team prior to submission to Programme Quality Committee for approval. 1 External Examiners should approve all examination papers contributing to final degree classifications. 15 (An annual request will be sent to all NIEs in early October requesting that all examination details are verified and requesting notification of any changes particularly those requiring University approval). The NIE should ensure that the External Examiner has been consulted regarding any proposed change to the format of the examination paper. In addition, students must be informed well in advance of any planned change. Reading time will only be granted in the case of those examinations where a substantial time is needed for a student to make a carefully considered choice between questions of a lengthy and detailed or intricate nature. A standard reading time of fifteen (15) minutes is permitted. An NIE requesting approval for reading time should send a rationale for the change to Academic Services along with a specimen paper for consideration by the Board of Undergraduate Studies (postgraduate requests are considered by the same Board). All requests to change the examination from closed to open book should also be sent to Academic Services, along with a rationale and an indication of whether the examination will be ‘open book unrestricted’ or ‘open book restricted’. In the case of ‘open book restricted’ examinations, a list of text books allowed into the examination room is also required. Any change to the examination length should also be reported. An increase in the length of an examination has to be submitted to the relevant Graduate or Undergraduate Studies Committee as a change to the course regulations. A decrease in the length of the examination does not require University approval but the University’s Examination Office has to be informed for timetabling purposes. c) Co-ordination of First and Second Marking Procedures It is the responsibility of the NIE to ensure that the deadlines which have been set for providing final marks to the Programme Managers (or other appropriate individuals) are observed. It is also the responsibility of the NIE to ensure that a procedure is in place to ensure that marks for each examination question are added correctly on the scripts and that they are then subsequently input into the MIS carefully. It is recommended that the NIE and second marker enter the marks together, if at all possible. d) Liaison with the External Examiner This involves examination paper approval (see above), and co-ordination of first and second marking internally. The NIE is also responsible for ensuring that samples of work for external examination are delivered to the External Examiner well in advance of the first meeting of the Examination Board. The criteria on which the sample is based should also be agreed, in advance, with the External Examiner. (Please refer to Appendix Three: Procedures for Named Internal Examiners on Liaison with External Examiners) 16 Appendix One Undergraduate Marking Criteria for the Faculty of Social Studies Class Scale Points on 17 Point Scale Range on 100% scale (after rounding) Excellent 96 90-100 Analysis Presents a highly-developed and mature answer with full, accurate and original development of concepts and theories Critique Understands and evaluates relevant arguments, debates and/or interpretations in a manner that demonstrates a highly developed capacity for originality and independent thought. Presentation Provides a fluent and wellstructured deployment of techniques of academic writing 70-89 Comprehension Demonstrates comprehensive knowledge and thoroughly assimilated understanding of the subject matter including, where appropriate, methodological, technical and scholarship skills Demonstrates command of the subject matter including, where appropriate, methodological, technical and scholarship skills Presents a tightly-focused, relevant and well-structured answer with full and accurate development of concepts/theories, and excellent use of evidence 60-69 Demonstrates good appreciation of the subject matter including, where appropriate, methodological, technical and scholarship skills Presents a coherent and closely-argued answer with good structure, accurate use of concepts/theories, and good use of evidence Understands and evaluates relevant arguments, debates and/or interpretations in a manner that demonstrates a developed capacity for independent thought. This may amount to an extension of existing arguments, debates and /or interpretations Understands and evaluates relevant arguments, debates and/or interpretations in a manner that demonstrates some capacity for independent thought. Demonstrates an understanding of core aspects of the subject matter including, where appropriate, methodological, technical and scholarship skills Presents an answer to the question taking into account appropriate structure, development of concepts/theories and reasonable use of evidence Understands and reproduces relevant arguments, debates and/or interpretations Demonstrates some familiarity with the subject matter including, where appropriate, methodological, technical and scholarship issues Shows an understanding of the question with some structure, knowledge of concepts/theories and use of evidence Demonstrates some awareness of relevant arguments, debates, and/or interpretations Demonstrates little evidence of familiarity with the subject matter including, where appropriate, methodological, technical and scholarship skills Demonstrates a poor grasp of the question with loose structure, little knowledge of concepts/theories and inadequate use of evidence Demonstrates little awareness of relevant arguments, debates, and/or interpretations Provides a thorough and consistent deployment of techniques of academic writing with particular reference to structure, referencing/sourcing and spelling/grammar Provides a thorough and consistent deployment of techniques of academic writing with particular reference to structure, referencing/sourcing and spelling/grammar Acknowledges and employs techniques of academic writing with particular reference to structure, referencing/sourcing and spelling/grammar Shows awareness of techniques of academic writing with particular reference to structure, referencing/sourcing and spelling/grammar Provides a poor demonstration of techniques of academic writing with particular reference to structure, referencing/sourcing and spelling/grammar First High Mid Low 2:1 2:2 Third High Mid Low High Mid Low High Mid Low 89 81 74 68 65 62 58 55 52 48 45 42 50-59 40-49 Fail High Mid Low 38 25 12 >0-39 Zero Zero 0 0 Work of no merit OR absent, work not submitted, penalty in some misconduct cases 17 Appendix One GENERAL MARKING CRITERIA FOR POSTGRADUATE ASSESSED WORK AND EXAMINATIONS 80+ An outstanding piece of work, showing total mastery of the subject-matter, with a highly developed and mature ability to analyse, synthesise and apply knowledge and concepts. All objectives of the set work are covered, and work is free of errors with a very high level of technical competence. There is evidence of critical reflection; and the work demonstrates originality of thought, and the ability to tackle questions and issues not previously encountered. Ideas are expressed with fluency. (It is necessary to consider this mark range in view of the frequent comments by External Examiners concerning our unwillingness to award marks above 80). 70-79 An excellent piece of work, showing a high degree of mastery of the subject-matter, with a well-developed ability to analyse, synthesise and apply knowledge and concepts. All major objectives of the set work are covered, and work is free of all but very minor errors, with a high level of technical competence. There is evidence of critical reflection, and of ability to tackle questions and issues not previously encountered. Ideas are expressed clearly. 60-69 A good piece of work, showing a sound and thorough grasp of the subject-matter, though possibly lacking in the breadth and depth required for a first-class mark. A good attempt at analysis, synthesis and application of knowledge concepts, but may be more limited in scope than that required for a mark of 70+. Most objectives of the work set are covered. Work is generally technically competent, but there may be a few gaps leading to some errors. Some evidence of critical reflection, and the ability to make a reasonable attempt at tackling questions and issues not previously encountered. Ideas are expressed with clarity, with some minor exceptions. 50-59 A fair piece of work, showing grasp of major elements of the subject-matter but possibly with some gaps or areas of confusion. Only the basic requirements of the work set are covered. The attempt at analysis, synthesis and application of knowledge and concepts is superficial, with a heavy reliance on course materials. Work may contain some errors, and technical competence is at a routine level only. Ability to tackle questions and issues not previously encountered is limited. Little critical reflection. Some confusion and immaturity in expression of ideas. 40-49 Not of a passable level for a postgraduate programme. A poor piece of work, showing some familiarity with the subject-matter, but with major gaps and serious misconceptions. Only some of the basic requirements of the work set are achieved. There is little or no attempt at analysis, synthesis or application of knowledge, and a low level of technical competence, with many errors. Difficulty in beginning to address questions and issues not previously encountered. Inability to reflect critically on an argument or viewpoint. Ideas are poorly expressed and structured. Below 40 Work not of passable standard, with serious gaps in knowledge of the subject-matter, and many areas of confusion. Few or none of the basic requirements of the work set are achieved, and there is an inability to apply knowledge. Technical competence is poor, with many serious errors. The student finds it impossible to begin to address questions and issues not previously encountered. The level of expression and structure is very inadequate. The student has failed to engage seriously with any of the subject-matter involved. 18 Postgraduate Marking Grid Factual Knowledge Conceptual Understanding Complete and thoroughly assimilated Complete 80+ Comprehensive 70-79 Comprehensive 60-69 Minor gaps Good overall grasp 50-59 Minor gaps Fair overall grasp 40-49 Some gaps major Partial grasp 30-39 Many gaps major Very little grasp, evidence of some confusion Analytical Ability Highly developed and mature Application/ Problem Solving Tackles new applications with ease Highly developed Tackles most new applications with ease Well Makes a good developed attempt at talking new applications Reasonably Makes some developed attempt to tackle new applications Some Makes little evidence of attempt to tackle ability new applications Little or no Incapable of analytical tackling new ability applications 19 Technical Capability (Where relevant) Complete mastery of all techniques High level of technical competence Sound technical competence with few gaps Competent routine techniques Critical Ability Expression of Ideas Originality Highly developed Fluent and wellstructured Outstanding Highly developed Clear and structured well- Considerable Generally welldeveloped Clear and structured well- Some in Superficial Only Some lack of clarity None and immaturity of expression Low level of Poorly technical developed competence numerous errors Very low level of None technical competence with many major errors Poorly structured None with some confusion Very confused and None lacking in clarity