ALSS Short Guide to Quality and Enhancement Processes Faculty of Arts, Law & Social Sciences A Short Guide to Quality Assurance and Enhancement 2005-6 Vers 6.0 (November 2005) D:\612935467.doc -1- ALSS Short Guide to Quality and Enhancement Processes -2- Introduction The purpose of this Guide is to provide an aide-mémoire for existing colleagues and to introduce new colleagues to the Quality and Assurance (QAE) Practices developed by the University and by the Faculty since its formation in January 2005. The Guide is intended for all colleagues delivering University-approved modules and pathways located in the Faculty, and colleagues based in regional partner colleges should adopt these practices in the course of 2005-6 if they have not already done so. The Faculty is sensitive to the fact that many partner colleges have their own traditions in respect of QAE, and this Guide applies solely to academic programmes for which the University is the awarding institution1. For the benefit of partner colleges, a Faculty QAE ‘Who’s Who’ is found in Appendix 1. A tabular overview of the Faculty’s annual QAE calendar is located in Appendix 9. The QAE instruments defined in this Guide are based on the Senate Codes of Practice2 and Procedural Documents, and on the Quality Assurance Agency (QAA) Codes of Practice3, all of which are updated periodically. Consequently, this Guide will be subject to periodic revision. It is acknowledged that in some of these Codes the terminology used to describe assessment instruments adopts paper-based outputs as its norm.This terminology does not always transfer easily to studio- and performance-based subjects and must be interpreted as necessary, but within the spirit of the Codes, to accommodate the moderation and archiving of artistic works. Questions arising from the information contained within this Guide, or suggestions about additional material that could usefully be included, should be addressed to Richard Monk (Faculty Quality Assurance Officer)4 or to Derrik Ferney (Associate Dean Academic Development)5. Approach Because the Guide is aimed at practitioners it starts with QAE practices at the level of the module and progresses subsequently to other QAE processes. Each section of the Guide has been kept as short as possible, with additional information made available through footnotes or appendices. The Guide and the forms it contains can also be accessed electronically6. Updates When updates are released the major changes or additions will be colour-coded in purple for ease of use. Once read, the font colour can be changed back to black. Derrik Ferney November 2005 1 The awarding institution is responsible for the academic standards of all awards granted in its name (Precept A1, QAA COP Sec 2 Collaborative provision and flexible and distributed learning – September 2004: 31) 2 Senate Codes of Practice (CoP) can be found on the website of the University’s Academic Quality and Standards Office (AQSO) at http://web.anglia.ac.uk/anet/academic/index.phtml 3 QAA CoP can be found at www.qaa.ac.uk 4 r.monk@anglia.ac.uk 5 d.ferney@anglia.ac.uk 6 at either: j:\schools\alss\faculty documents; or via the web at: http:/web.anglia.ac.uk/anet/alss/ D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes -3- 1 Modules 1.1 Module Leaders and Module Tutors While the duties of module tutors and module leaders overlap there are a number of important differences. All modules will have a designated module leader. Module leaders will be appointed by the Head of Department with resource responsibilities for the Department in which the module is located. The module leader will usually, but not always, be part of the module teaching team and will therefore also be a module tutor. Module leaders have specific responsibilities for ensuring the comparability of the student experience when the same module is offered by several providers (in respect, for example, of Module Guides and Assessment) and have specific responsibilities in relation to the annual review of modules. The respective duties of Module Leaders and Module Tutors are specified in Appendix 2. 1.2. Module Definition Form (MDF) This form is in effect a contract between the University and the student and is therefore an extremely important document. Modules Leaders must ensure that the delivery of a module for which they are responsible conforms in all respects with the specifications given in the MDF. Students and staff can access MDFs at: http://web.anglia.ac.uk/dso/catalogue/ 1.3. Module Guide Module Guides elaborate on the MDF to provide students with the basic information needed about each module they are taking. It is a QAA and therefore a Faculty expectation that all modules will have a Module Guide and that this will be distributed to students during or before the first week of teaching. Module Guides are compiled by the Module Leader (in cases of multiple delivery) and are normally no more than 6-8 pages in length. The Faculty template (ALSS 3) is located in Appendix 37. At the commencement of teaching, it is important that tutors discuss the contents of the Module Guide in some detail with students, explicitly drawing their attention particularly to the intended Learning Outcomes, to the teaching programme and to the assessment and assessment criteria (see 1.6.1. below). Some of the language used in, say, MDFs can be jargon-laden and it may be necessary to explain them in plain English. You should also tell students about the University’s policies in respect of poor academic practice and plagiarism, and inform them that they will be given a Module Evaluation Questionnaire towards the end of the teaching period. 1.4. Module Study Pack Many Modules make use of Study Packs. Study Packs collate a range of learning materials, including copyright material covered by the agreement between HEIs and the Copyright Licensing Agency, into a single volume which is often provided as an alternative to purchasing one or more textbooks. Study Packs can vary in length from 20 to 200 pages and are known by a number of terms, including ‘Module Dossiers’ in the former LLSS. ‘Study Pack’ is, however, the preferred term in law. Study Packs usually incorporate the Module Guide as their introductory pages. Students will generally be charged at cost for Module Study Packs, which (at Core Anglia) will be distributed via the ALSS Module Bookshop in Teaching Weeks 1 and 7 The electronic version of this form contains hyperlinks so that it can be ultimately placed on the web. D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes -4- 2 (plus the Friday before teaching starts). For a full account of Module Study Packs, see Appendix 4. 1.5. Module Assessment – Design Stage Guidance on assessment is given in the Senate COP on the Assessment of Students (September 05). Appendix 5 of this Guide contains a Faculty overview of Assessment as it will operate from 2006-7, but much of what it says applies equally to 2005-6. 1.5.1. Assessment Types: There are 3 main types of assessment: diagnostic, formative and summative (see Appendix 5, Secs 2.1 and 3 for definitions). Modules should normally include formative as well as summative assessments to help students learn more effectively. 1.5.2. Assessment Design: When designing summative assessments, use the methods specified in the MDF to test all the learning outcomes identified in the MDF, not just some of them. Check with the Pathway/Programme Leader that the assessments you are proposing fit in with the Assessment Strategy identified in the Pathway Specification Form (PSF) so that students experience a variety of assessment methods across the course as a whole. 1.5.3. Approval by External Examiner: Ensure that all major assessments and examinations you want to use have been approved by the relevant external examiner8 The Pathway or Programme Leader will be responsible for sending draft assessments to the External. 1.6. Module Assessment – Marking Stage 1.6.1. Submission Dates The Module Guide will normally specify the hand-in dates (or Weeks) for assessments. 1.6.2. Assessments submitted on tape or digital media Care needs to be taken with assessments which use the above media. While students are responsible for ensuring that their work can be read, the Faculty’s recent experience is that there can, on occasion, be genuine problems with these media. For example, there have been occurrences, particularly in respect of digital files - where staff have been unable to see on their own computer files that could be seen on other machines, including the student's. So if a student assessment handed in on audio- or video-tape, or on a floppy disk, zip disk, CD, DVD or similar memory device, turns out to be blank, it is helpful - where possible - to contact the student immediately and give them the opportunity to provide a copy of the recording or data. Alerting students to this and giving them the opportunity to hand in a copy does not, of course, mean the copy will necessarily count as part of the student's first attempt. It is for staff to decide if the error was genuine, or not, and to use their discretion accordingly. 8 See Senate COP on External Assessors (September 2005) Sec 4.1.13 at: http://web.anglia.ac.uk/anet/academic/qad/sen_codes_practice/ext_ex/extexam05_cop.doc D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes -5- 1.6.3. Marking Guidelines The Senate Code of Practice on Assessment (Sec. 6.2) specifies the various mechanisms used for marking and moderation. It is important to remember the following points: Assessment Criteria: The Module Guide will contain Assessment Criteria which should be explained to students at the outset of the module. Assessment Criteria clarify the general basis on which marks will be awarded. They cannot be written in a vacuum, and the Assessment Criteria for a specific module should be informed by the University’s generic assessment criteria9 and grading standards10 Marking Scheme: A Mark(ing) Scheme is required before you start to mark student work. The Mark(ing) Scheme relates the (general) Assessment Criteria to the (specific) assessment tasks you have set, and states the precise basis on which marks will be awarded. In some types of assessment there may be little or no difference between the Assessment Criteria and the Marking Scheme. To facilitate consistency, first markers constantly refer to the Marking Scheme when marking student work, and pass the Marking Scheme on to the internal moderator/second marker (and hence the External Examiner) with the sample of student scripts. Anonymous Marking: Assessments at HE Levels 1-4 will normally be marked anonymously11 by both the first marker and the second marker (internal moderator). This means that student work will be identified by SID numbers, not by name. Where this is not possible assessments will be subject to double marking12. In both cases, the internal moderator/second marker knows the marks awarded by the first marker. In contrast, Dissertations and Major Projects are subject to unseen (‘blind’) double marking where the second marker does not know the mark awarded by the first examiner. Written feedback to students (annotation of scripts and/or completion of coversheets): It is extremely important for the first marker to provide students with adequate levels of feedback on the marks you give their work. Feedback should correlate with your Assessment Criteria/ Marking Scheme so that you can explain why you gave a mark if asked to do so. Appendix 7 provides guidelines on written feedback to students. 9 Assessment criteria are explicit statements by the teaching team of what a student is required to do in order to demonstrate achievement of the learning outcomes for a module or for an item of assessment for a module. They broadly define a level of student knowledge, understanding, skills and competencies in relation to student achievement of learning outcomes. The Senate has approved (15 June 2005) a set of generic assessment criteria for modules at each award level (HE Levels 0-4). These generic assessment criteria are published annually in Anglia Ruskin’s Undergraduate and Postgraduate Student Handbooks. See: (www.anglia.ac.uk/anet/info_sources/ug_handbook.pdf and www.anglia.ac.uk/anet/info_sources/pg_handbook.pdf). 10 Grading standards comprise bands of marks normally on a percentage scale (e.g. 60-69%) or occasionally on a pass/fail basis. They are accompanied by descriptors and are used by markers to distinguish between grades of student achievement in completing an item of assessment for a module. The Senate has approved a set of generic grading standards which apply to assessed work at all award levels (HE Levels 0-4). These generic grading standards are published annually in the University’s Undergraduate and Postgraduate Student Handbooks. See: (www.anglia.ac.uk/anet/info_sources/ug_handbook.pdf and www.anglia.ac.uk/anet/info_sources/pg_handbook.pdf). 11 Anonymous marking is the process whereby the identity of individual students is, wherever possible, not revealed to markers at the marking stage (Senate COP 2.2.1). It is recognised that this is frequently not possible in performance- and studio-based subjects. Double marking (sometimes known as “second marking”) is the use of two markers to mark an item of assessment … It is the process whereby the work submitted by all students for a particular item of assessment is assessed by a second marker with access to the approved assessment criteria and marking scheme for that item of assessment. The second marker knows the mark awarded by the first marker and the purpose of the process is to agree a mark for each student. 12 Double marking as defined above is adopted at Anglia Ruskin only in cases where the principle of anonymous marking cannot be applied to a particular assessment instrument. (Senate COP 2.2.1) D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes -6- Checks on Marking Standards: Internal Moderation: All student assessed work must be first marked, then second marked (internally moderated13). The ALSS 1 Form is designed for this purpose. Checks on Marking Standards and Student Achievement: External Moderation: Assessments at HE Levels 2, 3 and 4 must also be externally moderated. The Senate Codes of Practice on External Examiners (September 2005, Sec 4.1.14) and on the Assessment of Students (September 2005, Sec. 6.2.5) state clearly that all module assessments at these levels must be externally moderated. Most Departments already achieve this and it will be the Faculty’s standard expectation from 2006-7. However, in some Departments whose work is characterised by high levels of collaborative provision and large numbers of modules, this may prove difficult to achieve in the transitional year 2005-6 (when a large volume of regional assessments previously handled by the Regional Office will for the first time be channelled through Departmental Assessment Panels). Exceptionally, such Departments may wish in 2005-6 to agree with their External Examiners an arrangement for focusing attention on a representative sub-set of assessments at Levels 2 and 3. Such an arrangement would be for one year only in anticipation of a return to the moderation of all assessments at HE Levels 2, 3 and 4 from 2006-7. Where such an arrangement operates, all assessments which have not previously been externally moderated must be made available to the External Examiner prior to the Departmental Assessment Panel (DAP) so that s/he may ‘have access to all assessed work’ (Senate COP on External Examiners, Sec 4.1.10). The ALSS1 (Internal Moderation Form): The ALSS1 is located in Appendix 6 of this Guide. The first marker should complete the form, attach it to the sample of student work as defined in the ALSS 1, along with the overall mark list and mark scheme, and forward the bundle to the second marker (internal moderator) who signs the sample off if s/he is content with the marking standards. It is advisable for the first marker to keep a photocopy of the mark list, mark scheme and student work. The bundle (bearing the signatures of the first and second markers) is sent off to the External Examiner who then also signs it if s/he is content with marking standards. The Programme or Pathway Leader will then arrange for the archiving of the bundle (not just the student work) for TWO YEARS, this being the normal retrospective horizon for QAA audits and reviews14. 1.6.4. First Marking First marking will normally be conducted by module tutors based at the centre where delivery has occurred; first marking will be informed by assessment criteria and a marking scheme (see 1.6.3. above). In the case of a module delivered in more than one centre, the common assessment criteria and marking scheme will have been issued by the Module Leader and will be used for all deliveries. Module Tutors will 13 Internal moderation is the process whereby an internal moderator reviews and moderates a defined sample of student work for a module which has been anonymously marked by a first marker. The sample draws on all items of assessment contributing to the overall assessment of the module, including written assignments and examination scripts. The sample includes student work associated with delivery of the module by a partner institution.The internal moderator has access to the approved assessment criteria and marking scheme for each assessment instrument in the sample, knows the mark awarded by the first marker, and also has access to any written feedback given to the student by the first marker. The purpose of internal moderation is to check the consistent application by the first marker of the assessment criteria, marking scheme and grading standards for the items of assessment in the sample. (Senate COP 2.2.1). 14 This will change with the forthcoming change in audit methodology, and the question of archived work will be reviewed at that point. D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes -7- select a representative sample of scripts, complete an ALSS1 (Internal Moderation Form) and forward the sample to the second marker (internal moderator). 1.6.5. Second marking (internal moderation) of modules offered at partner institutions and at the University Second marking will normally take place in one of two ways. At the discretion of the University Head of Department, the second marker (internal moderator) may be located either at the partner institution where the module has been delivered, or at the University. [Where the second markers (internal moderators) are based at the partner institution, Departments must ensure that they are fully briefed about procedures and proformas beforehand]. Departments must consider which of these two arrangements will best assure quality and provide the speediest means of internally moderating student work prior to sending it on for external moderation. However, where student work is first and second marked (internally moderated) at a partner college prior to being sent to an Anglia Ruskin External Examiner, the sample must be scrutinised by the member of the University Department’s academic staff (who may be the Module Leader) before it is forwarded to the External Examiner. Departments may take the view that the above can best be achieved by means of a single Departmental or Programme Moderation meeting. 1.6.6. Second marking (internal moderation) of modules offered at partner institutions but not at the University On occasion, a module may be delivered at partner college but not at the University. This is nuanced as follows: 1.6.6.1. partner colleges may offer modules which are not taught by the University but which fall within in a discipline in which the a Department of the University has subject expertise and therefore within the remit of the Department and its External Examiners. In this case, 1.6.5. (above) broadly applies, and the responsible Department will nominate a member of its academic staff to co-ordinate the assessment process on behalf of the Department and to ensure that all University and Policy requirements are satisfied. Such a role may be adopted by a colleague from a partner institution acting on behalf of the University Department, 1.6.6.2 partner colleges may offer modules in disciplines which are not taught at the University and in which the University has no subject expertise. In this case the responsible Department will nominate a member of its academic staff to co-ordinate the assessment process on behalf of the Department and to ensure that all University and Policy requirements are satisfied. Such a role may be adopted by a colleague from a partner institution acting on behalf of the University Department, provided that colleague is fully briefed by the Department beforehand. 1.7. Dispatch of samples of assessed student work to External Examiners The Head of Department is responsible for co-ordinating general liaison with, External Examiners. This will include arrangements for the dispatch of scripts and/or the viewing of student work. The Head of Department may delegate some aspects of liaison with External Examiners to Pathway/Programme Leaders who will, in turn, rely on Module Leaders (or other nominated colleagues) to provide fully documented samples of assessed work for external moderation. 1.7.1. Sample of assessed student work: Modules offered at a single centre Where modules (other than dissertations) are offered at a single centre, be it the University or a partner college, the ALSS 1 Internal Moderation form must be used to create a record of the moderation process. D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes -8- 1.7.2. Sample of assessed student work: Modules offered at more than one centre Where modules (other than dissertations) are offered at more than one centre, the procedure for first and second marking (internal moderation) is initially as detailed in 1.6.5., 1.6.6. and 1.7.1 (above). This will result in the Module Leader receiving a ‘bundle’ of assessed student work from each centre at which the module has been taught. The Department may, at its discretion and in consultation with the responsible External Examiners, either: 1.7.2.1. send or otherwise make available to External Examiners multiple ‘bundles’ of student assessed work for the same module, The advantage of ‘multiple bundles’ is that Externals see a full sample form each centre of delivery. The disadvantage is that this increases their workload very considerably and probably unacceptably in some cases. 1.7.2.2. send or otherwise make available to External Examiners a single ‘sample of samples’ drawing on the ‘bundle’ received from each centre of delivery. The advantage of the ‘sample of samples’ approach is that the External Examiner only has to deal with one ‘bundle’ (albeit a slightly larger one) per module. In addition, the External Examiner is always at liberty to see the full ‘bundle’ from a given centre. If this option is chosen, Form ALSS 4 must be completed by the Module Leader. (See Appendix 10) 1.8. Module Evaluation The standard University Module Evaluation Questionnaire (SMEQ) should be handed to students towards the end of the teaching period. Students may complete the SMEQ at home or in the class, at your discretion, but the aim is to get as high a return as possible. The ALSS 2 form provides an opportunity for lecturers to reflect on student feedback about their modules and student achievement; it also provides an opportunity to look forward to the next delivery of the module The ALSS 2 should be completed in draft around the time of the Departmental Assessment Panel (DAP), with externals' comments and details about marks being added at the DAP. ALSS 2 forms will be made available (in 'raw' or synoptic form) to students in 2005-6 (e.g. on notice boards or via a folder in the Departmental Office), discussed at staffstudent Programme Committees, and needed for the Reports Meeting in September, so please hang on to them and copy them to your HoD or nominee, who will be able to answer any additional queries you may have. A copy of the ALSS2 is located in Appendix 8 of this Guide. 1.9 Archiving the Module ‘Bundle’ 1.9.1. If all the above procedures are adhered to, the end result will be a ‘bundle’ of materials which provide physical evidence of the teaching, learning and assessment of a given module. This bundle must be archived for TWO YEARS following the year in which the module was delivered, this being the retrospective audit horizon specified by the QAA. D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes -9- 1.9.2. The Module Leader is responsible for compiling the ‘Bundle’ 1.9.3. The Head of Department is responsible for overseeing the physical storage of the ‘Bundles’, delegating this authority to Programme or Pathway Leaders as appropriate. 1.9.4. A Module ’Bundle’ consists of: Module Guide Assessment questions (copy of question papers, task/s set)* Assessment Criteria (in Module Guide)* Marking Criteria (specific to the assessment/s set)* Sample of Student Work (min. 6 scripts or 5%, whichever is greater)* Module mark list* (list of all marks for the module) ALSS 1 (signed by first marker, internal moderator and external examiner)* Student Questionnaires ALSS 2 Module report Form (*compiled by first marker and seen by internal moderator/second marker and external examiner) 1.9. The Reports Meeting Reports Meetings are organised on a Departmental basis and take place in September/October each year. They should be attended by representatives of all centres delivering Faculty modules. Meetings will deal solely with action taken/to be taken in respect of three reports: Module Reports: these may be presented either in ‘raw’ form (i.e. the meeting will simply receive the ALSS 2 forms for all modules delivered in the previous academic year) or in synoptic form (where the Programme or Pathway Leader has read all ALSS 2 forms, identified any missing forms and modules where action needs to be taken, and prepared a synoptic report to this effect). Module reports should be disseminated to students via notice boards and the first Departmental Committee meeting each year. External Examiner Report/s: the most recently received External Examiner’s Report and the Pathway/Programme Leader’s response to it Learning and Teaching Adviser’s Report. This report will synthesise observers’ comments from the previous year’s peer observation into proposed topics for staff development workshops in the current year. Departments will have the opportunity to endorse these topics and identify other areas that might provide a focus for the L&T Adviser’s activity in the current academic year. D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes Appendix D:\612935467.doc - 10 - ALSS Short Guide to Quality and Enhancement Processes Appendix 1 Department - 11 - Programme Programme Leaders Pathway Leaders FACULTY QAE ‘Who’s Who’ (HEFCE funded) Arts, Law and Social Sciences Anglia Law School HoD: Kathy Quinlan Deputy HoD: Peter Clayton Law, Academic Courses Law, Professional Courses David Stott Julia Ramsay Cambridge School of Art HoD: Paul Marris English, Communication, Film & Media HoD: Rowlie Wymer Deputy HoD: Paul Marris Art and Design Paul Shakeshaft Pat Coyle Communication, Film and Media English and Writing John Gardner Humanities & Social Sciences HoD: Alison Ainley Deputy : Colleen Moore Humanities Social Sciences Clarissa Campbell Orr Shaun Le Boutillier Languages and Intercultural Studies HoD: Annie Morgan-James Deputy HoD: Tony Morgan Nick Hillman English as a Foreign Language Languages and Intercultural Studies Sarah Fitt Music and Performing Arts HoD: Paul Jackson Helen Odell-Miller Music Performing Arts Alan Rochford Gianna Bouchard Dean: Monika Thomas Associate Deans: Curriculum Development & Student Experience: Ed Esche Academic Development: Derrik Ferney Director of Studies: Rick Allen Learning & Teaching Adviser (Cambridge): Jill Cosh Learning & Teaching Adviser (Chelmsford): Angela Yeoman-Clark Faculty Quality Officer: Richard Monk D:\612935467.doc CPE - Eva Joyce Law - Roger Thomas LLB: Nigel Stockwell LLM: Dorothy Heeneman LLM in LPC: David Chalk LLM International Sports Law - John O'Leary LPC: Ian King t.b.c. Communication, Media and Cultural Studies Pat Coyle English – John Gardner Film -Sarah Barrow MA in Communication, Media & Culture Joss Hands MA English Studies -Catherine Silverstone Writing - Katy Price Criminology: Colleen Moore History: Rohan McWilliam Philosophy: Katerina Deligiorgi Politics: Theo Schulte Public Service: Dave Baigent Sociology: Liz Bradbury English Language : Sarah Fitt French: Veronique Fournier German: Uwe Richter Intercultural Studies: Mike Fay Spanish: Carlos Toranzos Creative Music Tech -Julio d'Escriván Drama – Gianna Bouchard Music Richard Hoadley MA Music Therapy - Eleanor Richards [0.5] Other roles: MA Music Co-ordinator [until 2006] Nicholas Toller ALSS Short Guide to Quality and Enhancement Processes - 12 - Appendix 2 Module Leader 1. Be responsible for the effective implementation and operation of the module wherever, and by whatever means, it is delivered 2. Produce module definition form/s in collaboration with the Head of Department for the purposes of periodic review and approvals 3. Agree with all module tutors the times at which assessment will be conducted, ensuring that students in different cohorts are treated equally 4. Liaise with all module tutors and maintain regular communication with them 5. Agree with all module tutors a common approach to the presentation of the module to students, including a module guide 6. Agree with all module tutors a common approach to learning, teaching and assessment including collaborative providers, where applicable 7. Provide a representative sample of student work for moderation by the external examiner in consultation with the Head of Department 8. Organise the collection and internal moderation of student work so as to produce marks/grades agreed by the module team for presentation to Assessment Panels in accordance with published schedules 9. Monitor the progress of students and provide help and advice in relation to the module 10. Attend relevant staff-student committees 11. Support Programme Leaders in annual monitoring process, reviewing modules, identifying desirable modifications and initiating them in consultation with the Head of Department 12. Monitor the effectiveness of teaching on the module by analysing student evaluation questionnaires and the reports by module tutors. Produce reports for students on actions to be taken in response to module feedback 13. Highlight and seek solutions to any operational difficulties affecting the module, in liaison with the Head of Department where necessary 14 Attend Assessment Panels as required Module Tutor 1. Be involved in teaching the module to students 2. Maintain a weekly record of attendance and alert the Programme Leader (or nominee) to recurrent absence on the part of students 3. Liaise with module leader as necessary 4. Be responsible for the presentation of the module to students, using such templates for Module Guides and accompanying materials as may be specified by the Module Leader, 5. Explain the content of the module to students, in particular the close relationships between programme aims, module aims and learning and teaching activities 6. Teach the module effectively, in accordance with the learning, teaching and assessment strategies specified in the relevant module definition form 7. Provide draft assessments for the approval of the module leader and external examiner in a timely manner 8. Set and assess student work according to the guidelines established in the Module Definition Form and in discussion with the Module Leader 9. Monitor the progress of students and provide help and advice in relation to the module 10. Attend relevant staff-student committees as required 11. Administer a university questionnaire to students and provide a response to their comments to the module leader 12. Contribute to the assessment of the module 13. Inform the module leader of and operational difficulties affecting the module 14. Attend relevant Assessment Panels by invitation D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 13 - Appendix 3 Faculty: Arts, Law and Social Sciences Form ALSS3 Subject: (enter Pathway or Programme title) Module/Unit title: (Note: ‘Unit’ is included here for non-modular programmes) Module/Unit Code: (Add) Module/Unit Leader: (Add) Module Tutor/s: (Add Module Tutor’s/ Tutors’ details) Building/Room: (Add Module Tutor’s/ Tutors’ details) Tel: (Add Module Tutor’s/ Tutors’ details) Email: (Add Module Tutor’s/ Tutors’ details) Contents 1. Overview/Catalogue Summary ............................................................................ 13 2. Module Learning Outcomes ................................................................................ 13 3. Graduate Learning Outcomes ............................................................................. 13 3.1. Knowledge, Understanding and Intellectual Skills ......................................... 14 3.2. Transferable and Practical Skills ................................................................... 14 4. Pathway Outcomes ............................................................................................. 14 5. Outline Programme ............................................................................................. 14 6. Assessment......................................................................................................... 15 7. Assessment Criteria ............................................................................................ 15 8. Learning Resources ............................................................................................ 15 8.1. Recommended Texts .................................................................................... 15 8.2. Recommended Internet Resources............................................................... 15 8.3. Other Resources ........................................................................................... 15 9. Module Definition Form ....................................................................................... 15 1. Overview/Catalogue Summary (paste in Catalogue Summary from Box 14 of the MDF; MDFs can be located in the Anet on-line catalogue at http://web.anglia.ac.uk/dso/catalogue/ . If you don’t find it there then you have a problem (since the students won’t be able to see it either!) but you can also look for it in the j:\ drive (My Computer -> J:\Information\Validation Documentation\Module Definition Forms\Information), or from Anet (http://www.anglia.ac.uk/dso/catalogue/)). MAKE SURE THAT THE MDF YOU USE IS THE CURRENT ONE. 2. Module Learning Outcomes On successful completion of this module you will be able to: (paste in from Box 13 of the MDF) 3. Generic Learning Outcomes On successful completion of this module you will be able to: (delete any of the 9 GLOs below that don’t apply to your module; expand the retained GLOs if possible, by giving examples) D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 14 - 3.1. Knowledge, Understanding and Intellectual Skills 1. Demonstrate a capacity for systematic, conceptual and critical thinking 2. Act in an ethical manner, demonstrating political, social and cultural awareness 3. Identify a major area of discipline-based learning and demonstrate expertise within it, including evaluation of aspects of scholarship 4. Demonstrate an awareness of the transferability of skills and learning to future career/ further study/training 3.2. Transferable and Practical Skills 5. Work with confidence both independently and as a member or leader of a group or team 6. Show flexible and creative approaches to problem solving 7. Communicate clearly and appropriately, demonstrating a sense of audience 8. Produce output that is literate, numerate and coherent 9. Manage information in a range of media 4. Pathway Outcomes Module title contributes to the achievement of the outcomes of pathways relating to the following Pathways: (complete, as appropriate) In particular the module contributes to the attainment of the following asterisked Outcomes specified in the Pathway Specification (FV) Forms. (paste in appropriate Outcomes from box 14 of the Pathway Specification form. You can get PSFs from the j:\ drive, by typing: My Computer -> J:\Information\Validation Documentation\Module Definition Forms\Information MAKE SURE THAT THE J:DRIVE PATHWAY SPECS ARE THE CURRENT ONES) 5. Outline Programme (you can use all or some of the table provided below if you wish, or otherwise adapt it to suit; if it doesn’t suit your module then delete it and write a statement instead, perhaps pasting information from box 14 of the MDF ‘Indicative Outline Content’) Wk Lecture Seminar/Workshop Student-managed learning 1 2 3 4 5 6 e.g. Hand in Assignment 1 7 8 9 10 11 12 e.g. Hand in Assignment 2 D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 15 - 6. Assessment (paste in assessment info from Box 16 of MDF, providing more detail as necessary. Make sure weightings are clear if there is more than one assessment task) 7. Assessment Criteria Note to students: You should refer to the Undergraduate Student Handbook which contains generic Assessment Criteria for each level (year) of study (0-3) and generic marking standards (70%-100%, 60-69%, 50-59%, 40-49%, and 0%-39%). (the above reference provides a generic framework; you need to add some subjectspecific assessment criteria here. There needn’t be many of them, but they should test ALL the outcomes mentioned in sec 2 & any relevant ones form sec 4 (above). You may need to do this for each type of assessment task e.g. if you have an oral presentation that counts for marks, you need to specify exactly what you will be looking for, referring perhaps to 3.2.7. and 3.2.9. above). NOTE: The generic assessment criteria can be accessed online at: http://web.anglia.ac.uk/anet/staff/15-30/faq.phtml 8. Learning Resources 8.1. Recommended Texts (list recommended texts, possibly by pasting in from Box 18 ‘Indicative Learning Resources’ of the MDF; it is good practice to add ‘available in library’, or ‘in Short Loan collection’ after titles) 8.2. Recommended Internet Resources (please do provide some websites here; it is School policy to promote the use of C&IT in learning and teaching) 8.3. Other Resources (e.g. computer rooms, language laboratory, GIS lab, map room, local museum, local law courts ……) 9. Module Definition Form (paste in the current MDF for this module here. The purpose of doing this is to ensure that this delivery corresponds to the current MDF. (REM: parts of the MDF can be amended quite simply by obtaining the signature of the DoS, but the delivery MUST correspond to the current MDF) which students see at http://web.anglia.ac.uk/dso/catalogue/ Last Updated: September 05 D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 16 - Appendix 4 Module Guides and Module Study Packs Clarification of key terms and Faculty policy in respect of charging students for learning materials produced by staff 1. Definitions Module Guides provides students with the basic information needed about each module they are taking. It is a QAA and therefore a Faculty expectation that all modules will have a Module Guide. The Faculty template for the Module Guide (ALSS 3) is attached to this email. A Module Guide is normally no more than 6-8 pages in length. Study Packs collate a range of learning materials, including copyright material covered by the agreement between HEIs and the Copyright Licensing Agency, into a single volume which is often provided as an alternative to purchasing one or more textbooks. Study Packs can vary in length from 20 to 200 pages and usually incorporate the Module Guide as their introductory pages. 2. When can a charge be made? 2.1. NO CHARGE will be made for Lecture Notes and Handouts given out during lectures or other classes. So if, say, you provide students with paper copies of Powerpoint slides on a weekly basis you cannot make a charge for this. 2.2. NO CHARGE will be made for Module Guides which do not exceed 10 pages in length and are stapled rather than bound. Module Guides of this type should be distributed to students free of charge by the lecturer and not distributed via the Faculty Module Bookshop. 2.3. A CHARGE will be made for Study Packs. The Faculty makes a small charge in order to cover the very significant reprographics and other costs it incurs by providing students with Study Packs. Because Study Packs are normally a good deal cheaper than the text books that might otherwise have to be bought, they usually save students money. It is important to recognise that the price at which a Study Pack is sold to students will not exceed the reprographic, binding and distribution costs incurred in its production i.e. students will be charged at cost. The Faculty makes no profits through the sale of Study Packs and seeks to do no more than recoup its costs. The Faculty nonetheless recommends that staff producing Study Packs ensure that a small number of copies are placed in the library or in an appropriate learning resource centre where students can consult them free of charge. D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 17 - Appendix 4 (cont) 3. The legal basis for 2 (above) The provisions governing what students may be asked to pay for over and above their fees is contained in the Education (Student Fees) (Exceptions) regulations 1999, according to which the following charges may or may not be made: Category of Goods/Services Study materials Ref. Comments 2 Charges for individual lecture notes and handouts are specifically excluded. However, we consider that paragraph 2 would allow a charge to be made where handouts and lecture notes, available individually free of charge, are gathered for convenience into a summary pack. This paragraph would also allow charges for study packs covered by the agreement between HEIs and the Copyright Licensing Agency, i.e. packs which draw from a range of materials, including copyright material, often provided as an alternative to purchasing a number of textbooks. Other course materials 2 (b) Institutions may charge for materials where a student’s work produced with those materials becomes his own property. Examples include materials on art and design courses from which students create artefacts that they are allowed to keep or sell, and could also cover food on catering courses. 2 (a) In keeping with the above principles, we are of the view that institutions would not be able to charge for materials such as chemicals for use in experiments on science courses. These would fall under core provision and do not result in a product that becomes the student’s own property. Derrik Ferney (Associate Dean, Academic development) November 2005 D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 18 - Appendix 4 (cont) DIGITISATION OF DATA – ADVICE TO FACULTIES / DEPARTMENTS “Please note that the process of scanning (or digitising) pages of text and / or images in printed books and journals is, in most cases, subject to the permission of the copyright owner. Not obtaining permission from the rightsowner is likely to result in an infringement of copyright law for which the University may be prosecuted or fined. ‘Blanket’ permission for UK published titles is delivered by becoming a signatory to the Higher Education Trial Licence (covering Photocopying and Scanning Rights), a licence to which the University is not currently subscribed. While the University is looking at when it might participate in the trial (possible with effect from 1 August 2006), permission to scan extracts must be obtained on a transactional basis either from CLA Customer Services or INGENTA-HERON (under the terms of the HE Digitisation Agreement) or via direct permission from the appropriate rightsowner.” My Digital Copy Services Managers Jacqui Crane and Sue Fry can advise further on this. The responsibility to do so rests with the originator of the digitised module/extract. During the period January to July 2006, it would be helpful if Faculties and Departments would log with each copy centre use of the digitisation of modules in advance of clearance being obtained. We are presently examining whether optical scanning can be provided via the copy centres as an additional recharged service wef Spring 2006. In the interim this is not possible however due to pressure of reprographic work. Chris Hackett Director of Corporate Services November 2005 **************************************************************************************** May I remind staff of The University Library's role as a provider of copyright cleared content (particularly journal articles and book extracts). We are agents with the HERON digitisation service and make digitised content available to students studying particular modules through our website and Digital Library (although we can extend this to WebCT etc.) . If you are interested in making digitised content available online I would encourage you to approach your Academic Liaison Librarian (list below) or myself directly to see if we can help. Thanks, Graham Howorth November 2005 List of Academic Liaison Librarians with e-mail addresses: http://libweb.anglia.ac.uk/helpdesk/staff.htm D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 19 - Appendix 5 Assessment 1. Examinations will NOT be used as an assessment instrument in level 1 Semester 1 and pathway teams are invited to consider extending this to Semester 1 at other Levels, where this is not precluded by PSB requirements. This will facilitate a less stressful inter-semester marking period in January. 2. Closed assessment must account for a minimum of 25% of assessment per Level. This may be interpreted as 25% of assessment per module at the Department’s discretion. 2.1. Closed assessment consists of one or more tasks completed in controlled conditions. While the precise definition of ‘controlled conditions’ can be debated, the goal is to engineer situations in which it is highly probable that the work submitted by students is their own, and caeteris paribus their performance will provide a reliable measure of their level of achievement opportunities for poor academic practice, plagiarism, cheating or collusion are minimised 2.1.1. It is important to distinguish between closed assessment in general and examinations in particular; the principal difference resides in the fact that while all examinations are closed assessments, the opposite is not true. So while the archetypal form of closed assessment is the traditional unseen examination, other types of closed assessment may include open book examinations, oral tests (used extensively in Italian universities to prevent cheating in examinations), some types of field work and practicals, in-class tests, some types of group work, and so on. The Faculty will take advice from practice-based Departments about the extent to which artistic and musical products whose creation is closely and regularly supervised by lecturers can be seen as examples of closed assessment. 2.1.2. Closed assessment may take place at any point in the semester or in the assessment It is important to note that examinations are timetabled centrally by the Assessments Office to take place in the post-Semester Assessment period (Exams Week), while other forms of closed assessment are administered locally at Pathway level. 2.2. Open assessment consists of one or more tasks completed by students in their own time, with relatively little supervision, on or off the university's premises and using any reference materials they wish. The ‘largest’ open assessment is the Dissertation, with other forms of open assessment including in-course essays, portfolios, learner logs etc. Every open assessment will have an associated deadline by which it must be submitted and colleagues must make this clear in the MDF. 2.2.1. Non-examined assessment must normally be handed in no later than 6 working days after the completion of teaching 3. All modules should contain elements of formative assessment (including diagnostic assessment where required) as well as summative assessment. In its Code of Practice on the Assessment of students - May 2000 the QAA makes the following distinctions (Introduction 9, 10): Diagnostic assessment provides an indicator of a learner's aptitude and preparedness for a programme of study and identifies possible learning problems. D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 20 - Formative assessment is designed to provide learners with feedback on progress and informs development, but does not contribute to the overall assessment. Summative assessment provides a measure of achievement or failure made in respect of a learner's performance in relation to the intended learning outcomes of the programme of study. Any assessment instrument can, and often does, involve more than one of these elements. So, for example, much coursework is formative in that it provides an opportunity for students to be given feedback on their level of attainment, but also often counts towards the credit being accumulated for a summative statement of achievement. An end-of-module or end-of-programme examination is designed primarily to result in a summative judgement on the level of attainment the student has reached. Both formative and summative assessment can have a diagnostic function. Assessment primarily aimed at diagnosis is intrinsically formative though it might, rarely, contribute towards a summative judgement. 4. Modules extending over two semester will normally assess work completed in each semester. This assessment may or may not be completed during the semester in which the material tested is delivered. Thus, for example, students could be allowed the inter-semester break to prepare Semester 1 work for assessment/submission in Semester 2. Alternatively, they could complete, say, an in-class test (closed assessment) at the end of Semester 1. 5. Assessment instruments should test Graduate (Generic) Learning Outcomes (GLOs) as well as LOs. The contribution made by individual modules to the attainment of Pathway LOs should be evidenced on an Outcomes grid (See Appendix 3a below) 6. Pathway Designers should use a full range of assessment instruments when designing the curriculum and evidence this on an assessment grid (See Appendix 3 b below). The purpose of this grid is to provide evidence that pathways use a range of assessment instruments that, between them, (a) deliver the Learning & Teaching Strategy described in the PSF, (b) use an appropriate variety of assessment instruments, and (c) provide diagnostic/formative opportunities 7. Assessment for the same module must be identical or, where this is not possible for good academic reasons, comparable at all points of delivery Derrik Ferney 18 July 2005 D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 21 - Appendix 6 FACULTY OF ARTS, LAW AND SOCIAL SCIENCES ALSS1 - 1 ASSESSMENT MODERATION FORM Standard Procedure for marking modules at HE Level 1(B), 2(D), 3(H) and KVS Level 1 (B) and KVS modules NOT counting for degree classification 1. First marker marks all scripts and, using this form, passes a representative sample of scripts to internal moderator (2nd marker). Scripts should be marked according to assessment criteria and mark scheme and a brief explanation provided if the average of the passing marks given falls outside the expected range. The sample should consist of a minimum of 6 scripts (or 5% of the scripts if this is greater) and cover the top, bottom and middle of the range of marks. 2. Internal Moderator reads scripts received from the first marker and either (a) signs Assessment Moderation Form (overleaf) to indicate agreement with the marks awarded, or (b) suggests a review of marks for all students, explaining reason 3. If (a) then 2nd marker returns Assessment Moderation Form to 1st marker who (i) (photocopies the sample scripts if necessary); (ii) passes the completed Assessment Moderation Form and original sample scripts to the Subject Leader; (iii) gives Subject Leader a list of all marks and a mark scheme; (iv) returns to students the originals of scripts which do not feature in the sample, along with photo-copies of sample scripts If (b) then repeat steps 1-3 4. Subject Leader retains sample for TWO YEARS for monitoring/audit purposes Level 2(D), 3(H) and KVS modules counting for degree classification 1. At levels 2 & 3, first marker passes a representative sample of scripts to internal moderator (2nd marker). Scripts should be marked according to assessment criteria and mark scheme and a brief explanation provided if the average of the passing marks given falls outside the expected range. The sample should consist of a minimum of 6 scripts (or 5% of the scripts if this is greater) and cover the top, bottom and middle of the range of marks. 2. Internal moderator reads sample scripts and either (a) signs Assessment Moderation Form (overleaf) to indicate agreement with overall standard of marking or (b) suggests a review of marks for all students, explaining reason; Internal markers should seek to resolve uncertainties before the sample is forwarded to the external. 3. If (a) then 2nd marker returns Assessment Moderation Form to 1st marker who (i) (photocopies the sample scripts, if necessary); (ii) passes the completed Assessment Moderation Form and original sample scripts to the Subject Leader; (iii) gives Subject Leader a list of all marks and a mark scheme; (iv) retains remainder of scripts for eventual return to students If (b) then repeat steps 1-3 4. Subject leader sends sample scripts to External along with completed Assessment Moderation Form, list of marks for all students and mark scheme. 5. Subject Leader retains sample for TWO YEARS for monitoring/audit purposes (after return from External if External requires to see them). This proforma conforms with the requirements of the Senate Codes of Practice on External Examiners for Taught Programmes of Study (3rd Edition, January 2005) and on the Assessment of Students (April 2005). Last updated September 2005. D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 22 - FACULTY OF ARTS, LAW AND SOCIAL SCIENCES ASSESSMENT MODERATION FORM ALSS1 - 2 Module (name and code): Point of delivery: Field/Set: Number of candidates taking module: Academic Year: Semester (1, 2): First marker: Script Identifier (Normally SID no.) First Mark Internal Moderator’s Comment (need only be completed in detail if there is concern about the overall standard of marking) Alternative Mark (if remarked) 1 2 3 4 5 6 Continuation Sheet available For Internal Moderator: Please tick below as appropriate [ ] 1. The marks allocated to this sample of scripts indicate that the module has been fairly assessed. [ ] 2. All scripts should be re-marked because (Continue on separate sheet if necessary): Signed: Second marker______________________________________ Date: In the event of a re-mark (delete as appropriate) I now agree/do not agree that the marks allocated to this sample of scripts indicate that the module has been fairly assessed. Signed: Second marker______________________________________ Date: For External Examiner: Please tick number as appropriate [ ] 1. The marks allocated to this sample of scripts indicate that the module has been fairly assessed. [ ] 2. All scripts should be re-marked because (Continue on separate sheet if necessary): Signed: D:\612935467.doc External Examiner____________________________________ Date: ALSS Short Guide to Quality and Enhancement Processes FACULTY OF ARTS, LAW AND SOCIAL SCIENCES ASSESSMENT MODERATION FORM - 23 - ALSS1 - 3 Continuation Sheet Module (name and number):____________________________________ Script Identifier (Name or SID no.) First Mark Internal Moderator’s Comment (need only be completed in detail if there is concern about the overall standard of marking) Alternative Mark (if remarked) For Internal Moderator: Please tick number as appropriate [ ] 1. The marks allocated to this sample of scripts indicate that the module has been fairly assessed. [ ] 2. All scripts should be re-marked because (Continue on separate sheet if necessary): Signed: Second marker______________________________________ Date: [In the event of a re-mark (delete as appropriate) I now agree/do not agree that the marks allocated to this sample of scripts indicate that the module has been fairly assessed. Signed: Second marker______________________________________ Date: For External Examiner: Please tick number as appropriate [ ] 1. The marks allocated to this sample of scripts indicate that the module has been fairly assessed. [ ] 2. All scripts should be re-marked because (Continue on separate sheet if necessary): Signed: ___________________________________________________ Date: D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 24 - Appendix 7 ALSS Guidelines on Written Feedback to Students15 First Marking First marking measures the extent to which students have achieved the learning outcomes associated with the module. In addition, it provides students with feedback that they can use to help them learn from their successes and mistakes. First marking needs to be as transparent as possible so that the basis on which you have allocated marks will be clear to the second marker/internal moderator and to the External Examiner. Guidelines on First Marking 1. Mark in a different coloured pen, or pencil, to that used by the student so that your comments can be clearly distinguished on the script 2. Write short comments at appropriate intervals, indicating strengths and weaknesses of individual sections of the work and giving pointers (where appropriate) to how they might be developed. 3. Where an assessment consists of several sections, make comments on each 4. Where you have no comment to make on a page, mark it in some way to indicate that you have not overlooked it by accident 5. Transfer marks to the examination or assessment cover sheet as required 6. Write an overall comment at the end of the script, or on the cover sheet, as appropriate. The overall comment should provide a range of information for the student, which might include: an indication of how well s/he has achieved the learning outcomes associated with the module, the quality of language used and of arguments constructed, an indication of how the mark might have been improved. 7. Where a FAIL grade is awarded, ensure that your overall comment specifies which learning outcomes the script has failed to achieve. If you feel that the student can best be helped by discussing the work with you, then invite her/him in writing to make an appointment to see you. 8. Compile the sample in accordance with the requirements of the Senate COP on External Examiners, ensuring that it contains ‘a minimum 6 items or 5% (whichever is the greater) of the marked work .. (covering) .. the top, bottom and middle of the range of marks including some failures and borderline cases (where such examples exist)’. (COP, 8.14). 9. Enter details of the sample and marks awarded on the ALSS 1, sign it, and pass it to the second marker/internal moderator, along with copies of the assignment task or examination, overall mark list and assessment criteria/mark scheme. 10. When the sample has been signed off by the second marker/internal moderator, forward it to the Module/Pathway/Programme Leader, as appropriate 15 This applies to all assessments other than major projects which are blind second marked D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 25 - Second Marking/Internal Moderation The purpose of internal moderation is to check the consistent application by the first marker of the assessment criteria, marking scheme and grading standards for the items of assessment in the sample (Senate COP on the Assessment of Students). Note: Neither the second marker/internal moderator nor the External Examiner may change the marks of individual students (Senate COP on External Examiners, 8.22) Guidelines on Second Marking/Internal Moderation 1. Check that the sample of scripts conforms with the requirements of the Senate COP (see above) 2. Check that you have also been provided with copies of the assignment task or examination, overall mark list and assessment criteria/mark scheme. You should not moderate the sample until you have received all these documents. 3. Check the appropriateness of the assessment criteria/marking scheme used by the first marker. If you have any doubts, raise them with the first marker before moderating the scripts. 4. Check that marks have been transferred accurately to the cover sheet. 5. Check that feedback and the overall comment conform to the guidelines given above. 6. On the basis of the marking scheme (which tells you what the first marker is looking for) and the comments on the student script where these exist (which tell you what the first marker has found), check that the marks awarded are consistent across all the scripts in the sample 7. If you feel that the range of marks awarded correlates with the standards achieved by students in the work you have seen, and that the scripts have been marked fairly and consistently, then indicate this by completing the relevant sections of the ALSS 1, signing it off and returning it to the first marker. 8. If you have reservations, provide a brief explanation in the relevant sections of the ALSS 1 and return it to the first marker with the sample. It will be useful to discuss your views and seek to achieve agreement. If agreement can be reached and ALL marks in the affected range moderated, then sign off the sample and return it to the first examiner. Derrik Ferney Associate Dean (Academic Development) September 2005 D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 26 - Appendix 8 Faculty of Arts, Law and Social Sciences ALSS 2 Module Report Form This form should be completed by module leaders (where there is more than one delivery) or module tutors (in the case of single deliveries) who should provide the HoD or nominee with a copy of this form, along with the end-of-module student questionnaire around the time of the Departmental Assessment Panels. The Programme Leader will compile the results for use at Programme Staff-Student Committee and/or for display on noticeboards. Department: Centre of Delivery (Core/Partner): Academic Year: Semester: Module Code Module Title Module Leader(s) Module Assessment Profile: A B Results in band Enrolment Other Tutors C D L R F Mean Pass Mean The above figures can be read directly from SITS stats available at the DAP but may require modification after resits Student Feedback Briefly summarise results of student evaluation questionnaire/s Response of Module Leader/Tutor to Student Feedback (including resources if appropriate) Developments during the current year or planned for next year (if appropriate) External Examiner’s Comments State whether the external agreed the marks and/or commented on the module Last Updated: September 2005 D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 27 - Appendix 9 Draft Calendar of Quality Assurance and Enhancement Activity in ALSS (2005-6) The proposed calendar for 2005-6 rolls out to the whole of the new Faculty the Module Report Meetings trialled in the former LLSS last academic year. Discipline Network Groups (DNGs) are also included in this Calendar for the first time. Month (do by) Sept Oct Nov Dec Jan Feb March April May June July Aug Response to External’s report16 Departmental Reports Meeting17 √ √ Dean’s Grid / Standards at risk18 AMR + √ √ SMART Plan)19 Programme Committee20 - Sem 1 - Sem 2 Module Evaluation21 (Pre-) DAPs + Module Review22 - Sem 1 - Sem 2 AMR SubCttee O/view Report to Faculty Board23 √ Peer Observ -ation Discipline Network Groups24 (Department -based) L&T Committee - Sem 1 - Sem 2 √ √ √ √ √ Appraisal (current/ prospective) √ √ √ √ √ √ √ √ HODs co-ordinate Pathway/Programme Leaders’ responses to external examiners’ reports These will be conducted at Departmental level, ideally in September each year, chaired by the Head of Department, attended by the AD (Academic Development) and/or the Faculty Quality Assurance Officer.Their purpose is to ensure Pathway/Programme/Departmental alignment with university and QAA expectations regarding responses to three key areas of feedback: External Examiners’ Annual Reports, Module Reports (collated by the Pathway /Programme Leader from student feedback and ALSS2 Module Report Forms for the previous academic year, and which may be synoptic), and the Learning and Teaching Adviser Report/s 18 The Dean’s Grid is a summary of key issues/ recurring themes/good practice contained in External Examiners’ reports for the Faculty; the ‘Standards at Risk’ document identifies matters of serious concern for consideration by Senate 19 To be considered by Programme Committees in early November prior to collation by the Department for submission to AQSO by mid-November (Senate CoP Jan 2005 Sec 4.4: 27); then goes to ALSS DoS who assigns Reader for each AMR and to Sub-Committee of Faculty Board charged with the scrutiny of AMRs. Sub-Committee normally reports to Faculty Board in late January/February 20 The Annual Monitoring Report must be approved by the relevant Programme Committee before submission to the HOD 21 Module Tutors and Module Leaders use standard university questionnaire, then complete ALSS2 Module Report Form . and submit – with questionnaires – to Module Leader. Module Leaders collate MRFs from all contributing Module Tutors into a Synoptic Module Report. The synoptic report, along with the individual MRFs and the end-of-module student questionnaire should be given to the relevant Pathway/ Programme Leader so that Module Review can be conducted at or around the time of the pre-Departmental Assessment Panels (pre-DAPs), when the module assessment profile and External Examiner’s comments should also be available. The Pathway/Programme Leader may compile a synoptic overview report at Pathway/ Programme level (as appropriate), will report on them at DAPs, post them on student notice boards, and place them on the agendas of Programme Committees. Module Leader produces an overview report for the module and forwards this to Pathway Leaders,/Programme Leaders for the consideration of HoDs. Pathway/Programme Leaders compile synoptic overview reports at Pathway/Programme level (as appropriate), post them on student notice boards, and place them on the agendas of Programme Committees. 22 Module Review is conducted at pre-Departmental Assessment Panels (pre-DAPs) or at Departmental Assessment Panels (DAPs) at discretion of Department. 23 Faculty Board to determine whether the AMR has monitored standards and quality at an appropriate level of scrutiny. Remedial action may be required 24 Terms of reference: DNGs will provide a forum for the Faculty and its collaborative partners in related programme areas to share expertise, develop the curriculum and assure and enhance the quality of provision 16 17 D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 28 - Appendix 10 FACULTY OF ARTS, LAW AND SOCIAL SCIENCES ALSS4 - 1 ASSESSMENT MODERATION FORM FOR MODULES OFFERED AT MORE THAN ONE CENTRE Standard Procedure at HE Levels 2 – 4 How to use this form: 1. Module Leader receives ALSS 1 Forms + samples of assessed student work from Module Tutors. The samples should consist of a minimum of 6 scripts (or 5% of the scripts if this is greater) and cover the top, bottom and middle of the range of marks. 2. If the Module Leader is also acting as internal moderator, s/he moderates the sample, signing the ALSS 1 as appropriate. 3. If the Module Leader is not acting as internal moderator, s/he verifies that the quality of the first marking and internal moderation is appropriate and that it assesses fairly the standards achieved by students 4. The Module Leader then selects from each sample the accompanying ALSS 1 form and the number of scripts shown below: 2 centres: 5 scripts per centre 3 centres: 4 scripts per centre 4 centres: 3 scripts per centre 5 centres: 3 scripts per centre Additional scripts may be sent if desired. The sample of student assessed work from more than one centre should cover the top, bottom and middle of the range of marks 5. The Module Leader forwards or otherwise makes available the sample of student assessed work from more than one centre to the External Examiner who either (a) signs the Assessment Moderation Form (overleaf) to indicate agreement with the marks awarded, or (b) suggests a review of marks, explaining reasons. NOTE: the External may require that all marks be reviewed, or that marks within a specified range only be reviewed); the External may not change individual marks. 6. The Pathway Leader archives all samples for TWO YEARS for monitoring/audit purposes D:\612935467.doc ALSS Short Guide to Quality and Enhancement Processes - 29 - FACULTY OF ARTS, LAW AND SOCIAL SCIENCES ASSESSMENT MODERATION FORM Academic Year: ALSS4 - 2 Semester: Module (name and code): Department: Centres at which module was delivered D:\612935467.doc Number of candidates taking module First Marker Moderator ALSS Short Guide to Quality and Enhancement Processes - 30 - ALSS4 - 3 Script Identifier (Normally SID no.) Centre of Delivery Agreed Mark (Internal) External Examiner’s Comment (need only be completed in detail if there is concern about the overall standard of marking) 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 Continuation Sheet available For External Examiner: Please tick number as appropriate and sign and date below: [ ] 1. The marks allocated to this sample of scripts indicate that the module has been fairly assessed. [ ] 2. All scripts should be re-marked because (Continue on separate sheet if necessary): Signature: D:\612935467.doc Date: