External Moderation Process Online Assessment Guidelines Purpose External Moderation is the process of checking assessment practices across all organisations or people who assess against unit standards for which ServiceIQ has responsibility as the standard setting body. This includes: ServiceIQ, schools, PTEs, ITPs and ITOs who hold consent to assess for ServiceIQ unit standards. With changes in technology, there is an increasing preference for providers to develop on‐line learning and assessment platforms that provides for the facilitation of online assessment. This online assessment process brings with it some specific issues especially relating to integrity and authenticity. These guidelines are to set out some processes and protocols on the standards ServiceIQ will expect providers to meet when submitting online assessment materials for pre moderation approval. Process Pre‐assessment Moderation for Online assessment The normal criterion for Pre‐assessment Moderation as set out in our External Moderation Policy is to be followed, with the following highlighted additions. The materials are thoroughly checked to ensure: o Standard title, ID and version number are correct. o Assessment conditions are clear and easy to understand. o Assessment activity level of difficulty is appropriate to the level of the description. o Assessment activities cover the outcomes and evidence requirements. o Assessment activities are valid; i.e. they provide the learner with the opportunity to meet the requirements of the element/outcomes within the unit standard. o Sample answers (where included) are clear and appropriate. o Judgement statements are clear, noting acceptable performance levels (quantity and quality). [these latter two requirements may differ in the on‐line environment] External Moderation Process For internal Online Pre‐Assessment moderation When carrying out internal (ServiceIQ) online pre moderation, it is preferable if this can be done immediately after paper based post moderation has been completed. If this is not possible, then online moderation should be completed by the QA Advisor who completed, and is most familiar with the paper based moderation. Internal online moderation requires a system testing component to ensure the materials are fit for purpose in terms of functionality as well as content. A specific reporting form is available for this. o o o o o o o o ADDITONAL REQUIREMENTS FOR EXTERNAL PROVIDERS The allocated QA staff member should request a link and account from the provider to be able to look at, evaluate and test the system. The provider must provide a Process and Policy/Protocols document, which outlines: Their learning and assessment process and system (open book/closed book, are they allowed to use the internet as well etc.) Their student registration process How they enrol the student? How they ratify the student’s authenticity. Drivers licence/passport How they check the student is who they claim o o o o o o o o o o o o 2 GENERAL QUESTIONS Do they issue unique enrolment keys or student identifiers Do they have any authentication process during the assessment (challenge questions/phone calls etc.) How do they check against plagiarism How do they moderate What declarations do they have the student make (regarding this is their own work etc.) What statements do the providers make when registering the student (If you do not abide by the rules we may require you to resit etc.) What are their policies if the student is found to be not meeting their rules Do they have limited attempts or resits Do they have a mapping matrix of questions against ERs? What is the ratio of multi choice to written answers (is there a satisfactory mix and level of difficulty) Are the multi choice questions at a suitable level External Moderation Process o o Are the answers marked automatically or do they require an assessor – are they printed out or marked online? What documentation do they keep – what will be available for moderation? Notes: The student may need to provide the provider with verified proof of identification as part of the enrolment process. Verified (JP court, solicitor etc.) copies should be posted to the provider. They should not accept copies of the verified document; this includes electronic versions (scanned/faxed). Related Documents 3 External Moderation Policy Pre and Post Moderation Reporting Forms