External Moderator training presentation 2015/16

advertisement
UAL Awarding Body External Moderator Training
Sarah Atkinson
Head of Academic Standards
Introductions
Aims of the Meeting
Attendees
The Process
 The EM Role
 The EM Handbook
 UALab Approach
 Setting the schedule
 Communicating with Centres
Dear name of Course leader / Centre contact
I am writing to confirm arrangements for the forthcoming name of course moderation visit, and I am attaching a proposed schedule for the day.
To ensure that the assessment process is sound and that the standard meets the UAL Awarding Body assessment criteria for level of course, I will be
moderating a sample of completed and formatively assessed assignments for the name of course – Unit number.
The sample size for the qualification will be 10% of the cohort (or a minimum of 6) and the actual candidates decided in discussion with you on the day of
moderation, to ensure that a representative range is included.
I will also need to see evidence of the tracking, monitoring, assessment and internal verification of the non-graded units, please can you also make
available schemes of work, assignment briefs and assessment tracking for units unit numbers, it is not necessary to present student work for these
preceding units.
Please have ready a completed final results sheet with student ULNs. I will need to sign this off and send to the Awarding Body shortly after
Awarding Body shortly after the visit.
The moderation team will be myself and if applicable cc'd.
Please don't hesitate to contact me if you have any queries
I look forward to seeing you on confirm date of visit
Best Wishes
Your name and contact details
Selecting the Sample
 The sample for UAL Awarding Body qualifications is usually set at 10% of the cohort.
 This ensures that a sufficient number of sets of assessment evidence, covering all
disciplines and/or pathways and a range of internal assessors are externally
moderated and checked.
 Where a cohort or specialist pathway is below 50 Students a minimum sample of six is
acceptable.
 The External Moderator will always select the sample
 Samples should contain:
Grades in all categories, Pass, Merit and Distinction where a
qualification is graded.
Sufficient examples of the Referral Category, to establish the
Pass/Referral boundary and guidance for students to redeem
the grade
A range of disciplines reflecting the range of qualification
experience.
Assessment evidence assessed by a range of internal
assessors.
Documentation
To support the Sample Centres should
provide External Moderators with:
An outline of the structure of the course internal assessment,
standardisation and verification and process Schemes of
work and Assignment/Project briefs.
Examples of assessment and verification records sufficient to
enable the External Moderator to confirm that the
methodology is working and adheres to UALab guidelines
for good practice
EMs are required to confirm that the assessment and IV
processes for the assessment of the non-graded units
support decisions that are fair reliable and valid
Moderator Assessment Record Sheets
Reporting
Part 1: Candidate Sample
Part 2: Candidate Authentication
 Grade Confirmation
Part 3: Profile of Assessment Evidence
 Marks/Results Sheets
Part 4: Assessment Methodology
 Completing the Report
Part 5: General Commentary
 Coversheet
Part 6: Recommendations
Part 7: Actions
 EM handbook
Part 1: Candidate Sample
Candidate sample must be 10% of the cohort.
Candidate sample may be extended by 5% to clarify the accuracy of centre grading decisions.
Candidates in the sample should be identified only by their Unique Learner Number (ULN) which
can be retrieved from the Course Leader.
Part 2 : Candidate Authentication
Indicate either YES or NO to confirm that Candidate Authentication Forms were made available at
the point of the external moderation visit.
If the response is NO this must be an action for the following year.
Part 3: Profile of Assessment Evidence
Number of candidates in the cohort
Number of candidates in the sample
List the pathways and select a representative sample as a percentage of each area (10%-15%)
Number and percentage of D/M/P/R/W
Any special consideration or reasonable adjustment should be supported by the correct UAL
paperwork.
 Any areas of concern in regards to malpractice and maladministration in the assessment and
internal verification process.





EMs should use this section to report on the candidate evidence in relation to the assessment criteria
Part 4: Assessment Methodology









Assessment paperwork is fit for purpose.
Internally assessed units are rigorous and assessment decisions are fair, valid and free from bias.
Assessment internal verification and standardisation processes are suitably robust.
Assessment and internal verification documentation clearly evidences the decision making
process in borderline candidates.
Referred students are given clear feedback and time frame for resubmission.
Grading decisions across all pathways are consistent
The External Moderator is able to confirm that assessment decisions made by the centre are
consistent with national standards
If they are unsound the External Moderator should provide a commentary on those aspects which
require re-design or strengthening.
Any aspects described should be noted as actions
EMs should use this section to confirm that the assessment methodology conforms to good practice
Part 5: General Commentary











Teaching and Learning Materials
Student understanding of criteria and expectations as evidenced in self assessment
Opportunities for tutorial group critiques and peer review
Employer engagement
Quality of project proposals or overarching briefs – stretch and challenge
Range and depth of topics
Breadth and depth of research in informing project development
Level of investigation and experimentation
Quality of Centre documentation
Student progression
Overall quality of work by pathway
Provides an opportunity for a brief summary identifying areas of good practice as appropriate
The EM should select the appropriate definition to comment on each of the identified grading
themes for the level and qualification being assessed
Context
Research
Problem Solving
Planning and Production
Practical Skills
Evaluation and Reflection
Presentation
 Use sub headings
 Note differences between
pathways
 Note good practice and areas
for improvement
 Identify by ULN but not name
candidates
 Refer to EM handbook
Part 6: Recommendations
Recommendations are for guidance only and can be carried out at the discretion of the Centre
Recommendations should refer directly to commentary made in the report
The EM should report on any recommendations carried out from the preceding EM or Advisory
report and what if any impact this has had on quality improvement
Part 7: Actions
Actions are essential measures for improving standards for assessment and must be carried out by
the date agreed between the EM and the Centre
The EM must follow up on any actions required in the preceding EM or Advisory report
Questions?
The Extras
 Training and Events
 Standardisation
 Website
 Visual Standards Platform
 Senior Moderators
Training – Events – Standardisation – Conferences
2016
 FAD
EM Annual Training Event: Jan
External Assessor Training: Feb/Mar
Conferences: Jan/Feb/Mar
Standardisation Events: Apr/May/Jun
Exhibition: July
 Fashion Business and Retail
 Art and Design
 Media
 Performing Arts
 Music
Visual Standards Platform
http://workflow.arts.ac.uk/group/awarding-body-grade-standards/level2-diploma-in-art-design
Website
http://www.arts.ac.uk/about-ual/awarding-body/
Regions and Senior Moderators
North East
 FAD
North West
 Fashion Business and Retail
Midlands
South East
South West
 Art and Design
 Media
 Performing Arts
 Music
Chief Examiners
Sue Cook: sue.cook@arts.ac.uk
Sarah Atkinson: s.j.atkinson@arts.ac.uk
Martin Vella: m.vella@arts.ac.uk
 FAD
 Fashion Business and Retail
Andy Sankey: a.sankey@arts.ac.uk
 Art and Design
Marc Mollica: m.mollica@arts.ac.uk
 Media
 Performing Arts
 Music
In Practice
 Breakout Groups
 Scenarios – Exercise
 Reviewing Reports – Exercise
 Handling Difficult Situations
 Giving Feedback
 Observations
Reviewing Reports - Exercise
On your own read through the example reports and make notes in
relation to:
 Good reporting
 Poor reporting
You have 20 minutes to complete this task
 Discuss your findings with the others in your group
 Agree headline issues and appoint spokesperson
You have 10 minutes to complete this task
 Feedback to delegates
Final Questions and Next Steps
Download