Annual Monitoring &
Review
THE CRIMEA PILOT
Continuous Review for Improvement and the Monitoring of Enhancement
Activities
Quality Assurance Services
Introductions
Who are we?
Who are you?
CRIMEA PILOT
Aims & Expectations
• Kick start re-engagement with AMR
• Rebalance assurance and enhancement
• Emphasise outputs
• Reduce burden/ save time
• Clarify threshold standards/ KPIs
Distinguishing Features
• Freedom within broad parameters
• More timely implementation of actions
• Enhanced/ focused data provision
• ‘Single currency’ course log/ action plan
• An executive summary
• HoS engagement
How did we get here?
• Recommendations of Academic Board after
the 13/14 Annual Monitoring and Review
Cycle
• Outcomes of QAA Quality Code Chapter B8
(Monitoring and Review) mapping activities
• Annual Monitoring & Review Short Life
Working Group
• Ongoing consultation via focus groups/ email/
online
• Consistent endorsement of emerging
proposals
AMR Course Leader Issues
Process
Outputs
•
•
•
•
•
•
•
• What goes up doesn’t come
down
• Does anyone read my report?
• I have to wait to make changes
• Too much compliance & not
enough enhancement
• I’ve got action plans coming
out of my ears!
Too prescriptive
Too many meetings
Imposed schedules
Repetitive activities
Impenetrable/ unqualified data
Unclear performance expectations
Students aren’t interested/
engaged
• What can I do? The problem is with
these modules
Course Leader Aspirations
Process
Outputs
• Capture current range of activities
more effectively
• More organisational latitude/
autonomy
• Clarity on performance measures
• No duplication of discussion/
reporting
• Better presentation of data with
pre-analysis undertaken
• More timely availability of data
• Keep it brief/ report by
exception
• Report earlier when
achievements are fresh in the
mind
• Have the opportunity to
discuss actions with HoS
• Power to introduce timely
enhancements
• Focus on good practice for
embedding/ sharing
Continuous Improvement
CRIMEA PILOT
Key Elements of Process
1. Keep a Course Log linking to evidence
2. Freedom to arrange student engagement
3. Availability of early warning KPI data
4. End of year “Executive Summary”
5. Monitoring role for Head of School who will also lead the
discussions on outputs
CRIMEA PILOT
Threshold Parameters for Course
Log/ Action Planning
INTERNAL:
• Achievement
• Module evaluation
• Individual module success measures
• Student engagement and VLE update each
semester
• L4 to L5 progression (UG)
EXTERNAL:
• External examiner feedback
• DLHE/ Employability
• NSS (UG)
CRIMEA PILOT
Benefits
• Less prescription
• Ability to align activities with course ‘drivers’
• Clarity around threshold requirements
• Empowered to make changes in a timely way
• Recognition of the importance of the HoS role
• Focused support for courses
Support for ‘Pilotees’
• Emailed documentation pack after briefings – to include “A Ladybird
Book of CRIMEA”
• Regular engagement with QAS colleagues through your established
networks – invite us along
• Pilot group meetings at key points in the cycle
• Targeted emails when specific data sets/ quality indicators become
available
• A quality indicator/ data calendar
• Dedicated web support and pilot updates
CRIMEA PILOT
What to do first
• Familiarise yourself with the documentation
• Alert the rest of the course team
• Think about the QA and QE activities that could be included in the
log and start capturing them now
• Be prepared to have discussions with admin. colleagues about the
best approach to maintaining the log and the evidence
• Talk to your existing course reps about effective ways to manage
student involvement in AMR
Collaborative context
• Consideration given by • Evidence of liaison
SLWG to collaborative
between Leeds-based
context / challenges
teams and partnerbased teams
• Multiple intakes/
delivery locations
• Course and Partner
level monitoring
• Increased
opportunities for
• Other requirements –
comparative analysis
MQA, EDB, etc
of standards
• Enhanced MI
Role of Link Tutor
• Dependent on
collaborative model –
franchise, joint,
validated
• Where is the Course
Leader located?
• Course Leader
responsible for
completion of course
log, oversight rests
with Link Tutor
• Technology a key
enabler
• Discussions in Leeds
about issues /
resolutions to queries
may result in Link
Tutor entries …..
• University staff at
student meeting
• Revalidation…
Quality indicators
• ‘Information windows’
• Responsibility for
provision of
information
• Responsibility for
interpreting quality
indicators
• Equivalents –
employability data,
NSS
• Series of check points
throughout academic
cycle
• Course Leader
Summary – section for
Link Tutors
• Opportunity to
combine annual Link
Tutor report with exec
summary …..
Communication to partners
• Partner Development
Day
• Quality Connections
• Letter from QAS – Sep
15
• via key stakeholders:
Franchise/
Collaborative
Coordinators, Link
Tutors, Admin
• Course Leader Exec
Summary Templateall partners
• Pilotees new process
• Non-pilotees – old
process
• QAS engagement with
in country bodies
Questions?
http://www.leedsbeckett.ac.uk/partners/annual-review.htm
qas@leedsmet.ac.uk