How to pass the MRCPsych examination Dr Bruce Owen Outcomes • By the end of this session, participants will be able to – recognise one model of medical skills and how they are assessed – Describe the structure, content and function of the different parts of the assessment system in psychiatry – Recognise the concept of learning styles and how to structure their learning for maximum effectiveness “The most important things are not measured” W Edwards Deming Two purposes of assessment • Formative – ‘Assessment for learning’ • Summative – ‘Assessment of learning Miller’s pyramid Does Shows how Knows how Knows Performance Competence Miller’s pyramid and assessment 360˚ Performance Does WPBA CEX DOPs CbD Competence Shows how Knows how OSCE (CASC) Written tests MCQ/EMI Knows WPBA = Workplace based assessment OSCE = Observed structured clinical examination Outcomes • By the end of this session, participants will be able to – recognise one model of medical skills and how they are assessed – Describe the structure, content and function of the different parts of the assessment system in psychiatry – Recognise the concept of learning styles and how to structure their learning for maximum effectiveness The Assessment System • Includes: – Standardised (national) exams – mainly summative – Workplace-based assessments – mainly formative – Integration – ultimately summative National exams • Paper 1 – – – – Clinical topics at a basic level Basic psychology Psychopathology Social sciences • Paper 2 – – – – Psychopharmacology Neuroscience relevant Epidemiology Advanced psychology • Paper 3 – Research and ebm – All psychiatry specialties National clinical exam • CASC – 8 single stations 7 mins – 4 double/linked stations 10 mins Miller’s pyramid and assessment 360˚ Performance Does WPBA CEX DOPs CbD Competence Shows how Knows how OSCE (CASC) Written tests MCQ/EMI Knows WPBA = Workplace based assessment OSCE = Observed structured clinical examination WPBA in psychiatry • Lots of acronyms, only four methods Four core methods 1 • Based on documents: – Log book assessment – Case based Discussion (Chart Stimulated Recall) Four core methods 2 • Direct observation of a procedure – – – – – DOPS DONCS Teaching Case presentation Journal Club presentation Four core methods 3 • Observed clinical encounters – Mini-Assessed Clinical Encounter – Assessment of Clinical Expertise Four core methods 4 • Multi-source feedback (360°) – Mini-Peer Assessment Tool Integration – the tasks of the Annual Review of Competency Progression • Assess the evidence – Contained in Portfolio – Formal assessments – Reports • Make a decision based on the evidence – Summative pass/fail Guide for ARCP panels • Guides trainees and trainers as to what should be assessed • how it should be assessed • and at which stages ARCP Guide for Core Psychiatry Training http://www.rcpsych.ac.uk/training/curriculum2010.aspx ARCP decisions: 1. Progress onwards 2. Need to develop within time 3. Need to develop additional time 4. Leave the programme 5. Incomplete evidence Outcomes • By the end of this session, participants will be able to – recognise one model of medical skills and how they are assessed – Describe the structure, content and function of the different parts of the assessment system in psychiatry – Recognise the concept of learning styles and how to structure their learning for maximum effectiveness Learning/teaching activities • • • • Instructional activity Simulation Workplace activity Reflection Kolb’s Learning Cycle Perform part of an interview contributing to risk assessment Guided reading of psychiatric literature Active experimentation Concrete experience Abstract conceptualisation Reflective observation Watching your trainer perform a risk assessment Discussion of observations in supervision Kolb (1984) Experiential learning: experience as the source of learning and development. Prentice Hall Which type of learner are you? • Reflector – watch and feel – Watch, think and review • Theorist – watch and think – Think a problem through • Pragmatist – do and think – Likes to apply new learning • Activist – do and feel – Likes to experience new things Thank you! Any questions?