UCL MEDICAL SCHOOL INTERNAL QUALITY REVIEW MBBS Self Evaluative Statement Contents Page Introduction 2 Educational Organisational Structures 2 1. STUDENTS, STAFF AND LEARNING RESOURCES 2 1.1 Student Profile 1.2 Student Profile Trends 1.3 Academic Staff Profile 1.4 Non-Academic Support Staff Profile 1.5 RAE Assessment 1.6 Learning Resources 2 3 6 7 7 7 2. QUALITY MONITORING & ENHANCEMENT FRAMEWORK 9 2.1 Student Input and Feedback 2.2 Staff Support 2.3 Recruitment and Reception of Students 2.4 Student Support 2.5 The Teaching Function and Process 2.6 Programme Design, Operation and Review 2.7 Assessment of Student Performance 10 10 12 13 14 15 18 3. SELF-ANALYSIS 21 3.1 Approach to Self-analysis 3.2 Historical Note 3.3 What the Students Say 3.4 Planning, Structure, Content and Assessment 3.5 Areas Supporting the MBBS Programme 3.6 Resources 3.7 Additional Areas of Good Practice 3.8 Summary – Change and Opportunity 21 21 22 23 25 26 26 27 MBBS IQR Document Register 29 MBBS Programme SES 2010 Introduction This Self Evaluative Statement (SES) follows the structure given in the Academic Manual guidelines found on the UCL IQR website, with reference to the Gold Book. Additional evidence to support statements made in this document are accessible through hypertext where possible or listed in the document register and available at: http://www.ucl.ac.uk/medicalschool/quality/priv This process runs in parallel with the professional regulatory requirement of the GMC which covers similar ground, albeit in a different format. These processes have coincided in 2010. We have incorporated a small amount of evidence prepared for the GMC return. However this entire report has been written exclusively for the IQR panel. In order to understand the MBBS programme and its regulation we advise the IQR panel to familiarise themselves with the requirements of the GMC and we would therefore be grateful if the panel would read, in conjunction with this document, the following: Tomorrow’s Doctors: Outcomes and standards for undergraduate medical education (2009) UCLMS GMC Enhanced Return 2010 (Part A & Part B and Annex 1) th UCLMS GMC Enhanced Return 2010 ((Part C and Annex 2)– to be posted on the website on 16 March 2010 (Panel members will be notified via Rob Traynor) Educational Organisational Structures IQR panel member may wish to be aware of the following documents that provide an overview of the MBBS programme administration. Organograms FBS Graduate and UG Programme Academic and Welfare Leads FBS MBBS Module and Assessment Leads FBS MBBS Teaching Committee and Sub Committees MBBS & Graduate Programme Management Manuals 1. 2. 3. 4. Management - leadership roles & responsibilities Committees - structure, remit & membership Exam Boards - policy, structure, remit & membership Administration - structure & responsibilities (31 pages) (32 pages) (35 pages) (15 pages) Panel members are also advised that useful supporting information is available on the following web pages: A-Z Policies and Regulations Medical School Administration: Service Standards 1. STUDENTS, STAFF AND LEARNING RESOURCES 1.1 Student Profile The profile of students is displayed in tables 1.2.1 and 1.2.2 The number of students admitted to the programme is determined by quotas for funding, nationally agreed with the Department of Health (the former Medical Workforce Standing Advisory Committee) which allow for: There are 330 students entering Year 1 of MBBS programme (Portico course UBMMEDSING01) of whom: approx 290 enrol on a 6 year programme which includes a compulsory iBSc either between years 2 and 3 or between years 3 and 4 approx 40 graduate entrants enrol on a 5 year programme with exemption from the iBSc SES IQR MBBS 2010 2 of 29 55 students transferring into Year 3 of the MBBS programme (block 4 of Portico UBMMEDSING01) from Oxbridge and completing a 3 year programme Up to 10 students registering for an MBPhD in any year and who are selected just prior to entry to Year 3 of A100 and who may include students who entered the 6 year programme, the 5 year programme, the 3 year programme, and up to 4 students each year who transfer into Year 3 from other medical schools. We have, therefore, 4 separate cohorts of students gaining the MBBS award each year, each of which entered at a different point and so currently appear in different entry statistics: Cohort Portico code UBMMEDSING01 Starting block UBMMEDSING01 Descriptor Approx no. of student entering i 6 year MBBS Block 1 290 ii 5 year MBBS Block 1 iii 3 year MBBS Block 4 iv 8 year MBPhD Block 1 and Block 4 School leaver entrants who take an intercalated BSc in block 3, 4, or 5 Graduate entrants taking a 5 year through-course (exempt from iBSc) Oxbridge transfers entering in Year 3 of MBBS (block 4) Students awarded a joint MBBS and PhD on completion of thesis can transfer back into cohort (i) or (ii) Max no. graduates per year 40 55 10 of whom up to 4 are new entrants to UCL 389 Entry qualifications A wide range of entry qualifications are accepted although the majority of students enter with A levels. From 2010, the standard academic offer will rise to AAA+, or IB 38+ points. It is hoped this will help to minimise early Entry qualification (entrants) 2006-7 (n=327) 2007-8 (n=327) 2008-9 (n=337) AAAA, AAAB, AABB, AAA Majority 201 235 AAAAAA 2 2 2 AAAAA 5 9 6 AAB 26 29 28 International Baccalaureate 10 13 22 (mean grade point 40) Graduate entrants: BA BSc Masters PhD 46 st 9 (1 x 1 , 8 x 2:1) st 27 (5 x 1 , 22 x 2:1) 9 1 48 0 st 33 (7 x 1 , 26 x 2:1) 10 2 29 0 st 23 (3 x 1 , 20 x 2:1) 5 1 attrition from the course. 1.2 Student Profile Trends The Medical School has identified certain trends regarding the profiles of applicants and students: There has been an increase in the following areas:(i) (ii) (iii) (iv) the number of applicants and students with disabilities; the number of entrants with dependants; the upper age of admitted students; the range of nationalities of applicants and students (all continents represented); There is also a progressing increase in the proportion of state school entrants (currently 62%), approaching their representation amongst applicants. There has been a reduction in the number of suitable graduate applicants and therefore a decline in the number of graduate entrants in the past two years. SES IQR MBBS 2010 3 of 29 1.2.1 Student Profile - Males Category Year 1 (09/10 entry) Application Intake With declared disability EU/UK Non-EU Total White British White Irish White Other Mixed - White & Black Caribbean Mixed - White & Black African Ethnicity Mixed - White & Asian Other Mixed Asian/Asian British - Indian Asian/Asian British - Pakistani Asian/Asian British - Bangladeshi Asian/Asian British - Other Asian Black/Black British - Caribbean Black/Black British - African Black/Black British – Black Other Chinese Any Other Not stated MBBS Male Current student numbers Year 2 Year 3 Year 4 Year 5 Year 6 31 1058 234 3 137 8 145 7 170 8 178 7 141 11 152 8 186 9 197 9 179 10 189 5 139 6 145 390 87 89 79 97 93 70 1 7 1 1 2 2 1 1 1 32 16 5 4 7 7 7 4 4 2 3 3 1 6 162 15 27 19 28 36 26 61 5 10 5 3 7 5 27 1 4 6 4 1 4 96 4 11 6 9 19 9 3 1 53 4 4 3 4 2 4 2 41 42 358 1 6 4 9 1 3 4 9 6 6 16 6 17 10 7 8 6 6 8 SES IQR MBBS 2010 4 of 29 1.2.2 Student Profile - Females Category Year 1 09/10 entry) Application Intake With declared disability EU/UK Non-EU Total White British White Irish White Other Mixed - White & Black Caribbean Mixed - White & Black African Ethnicity Mixed - White & Asian Other Mixed Asian/Asian British - Indian Asian/Asian British - Pakistani Asian/Asian British - Bangladeshi Asian/Asian British - Other Asian Black/Black British - Caribbean 31 1301 270 1571 Chinese Any Other Not stated Year 6 3 132 15 147 74 5 183 13 196 104 10 153 8 161 72 14 168 14 172 100 2 183 11 194 92 1 4 1 3 1 4 21 4 4 2 3 2 7 5 2 5 5 3 2 21 19 28 20 25 25 2 2 4 3 5 7 1 5 2 5 3 1 2 6 2 5 7 15 13 23 10 2 2 1 1 1 6 6 11 Black/Black British - African Black/Black British – Black Other 141 8 149 85 MBBS Female Current student numbers Year 2 Year 3 Year 4 Year 5 2 8 11 5 6 156 1 11 5 6 13 7 8 9 8 10 11 1 11 10 2 13 5 4 18 9 2 SES IQR MBBS 2010 5 of 29 Widening participation There is a range of widening participation initiatives specifically aimed at increasing diversity of applicants to the MBBS, reaching unrepresented groups and supporting non-traditional students once they arrive. These are described in the document: Widening Participation in the MBBS Programme. In summary, these include: Target Medicine; Dick Whittington Summer School: interview, BMAT and personal statement guidance and support; The Camden and Islington Tutoring Scheme; Use of head teachers in interviews; UCL Ambassadors; Public engagement projects: the Reel Film Festival, Open Minds, Sexpression, Saving London’s Lives; Financial resources; The student welfare system (disability and peer support). 1.3 Academic Staff Profile Leadership of MBBS programme The MBBS programme is led by the Vice Dean and Director of Medical Education (Professor Jane Dacre) who reports directly to the Vice Provost for Health, Professor Sir John Tooke. The programme is supported by a range of academics based in FLS and FBS, and NHS staff. No individual works exclusively for the programme. The majority of academic staff based in FBS are also practising NHS clinicians. The number of full-time equivalent staff with leadership roles in the programme is approximately 7 (mostly at senior lecturer or professor level) (see: document: 0910 MBBS Leadership PAs and Medical Student Admin for IQR. Division of Medical Education Leadership roles for, and management of, the MBBS programme are overseen by the Division of Medical Education (DoME) although DoME does not receive direct funding for the programme. The majority of leadership post holders are members of staff in other Divisions in SLMS or are NHS staff with sessional arrangements with the Medical School. DoME academic staff, however, do make a significant contribution to the programme. Estimates of their time dedicated to the MBBS programme are as follows: 0.6 FTEs for Professor Dacre, 0.5 FTEs for Professor David Bender (Sub Dean and Director of Studies, Phase1), 3.5 senior lecturer FTEs, 0.8 lecturer FTEs, 1.4 clinical training fellows. DoME’s supporting roles provide consistency to the complex, integrated programme and include staff development, research related to medical teaching and learning, leading on peer tutoring, professional communication and ethics, and the three Clinical Skills Centres. DoME has close links with CALT, the London Postgraduate Deaneries (for medicine) and the GMC, through its internationally renowned work on assessment. (See DoME website). Other teaching staff In addition to SLMS academic staff, the following are involved in teaching UCL medical students: Clinical staff at: The Royal Free, University College and the Whittington Hospitals NHS Trusts Seven district general hospitals in south east England Approximately 300 GP practices spread throughout the UK A number of Mental Health Trusts and non-NHS psychiatric service providers A range of smaller NHS and voluntary sector providers These are listed in the spreadsheet: Clinical Providers for UCL medical students. The programme employs 54 professional development tutors, working 10 days per year who also act as academic advisors for Phase 1 students. The majority are GPs, with the rest drawn from a range of relevant fields. SES IQR MBBS 2010 6 of 29 Full lists of academic, welfare and module leads are available on the website as follows: Principal MBBS Academic Leads Module Leads MBBS Welfare and Admissions Leads FBS MBBS Module and Assessment Leads Staff with responsibilities within the MBBS programme also contribute to a wide range of College activities including, for example, membership of the following committees or working groups: Academic Board, Academic Committee, QMEC, Keys Skills, Camden Academy, e-learning, ESCILTA, etc.. 1.4 Non-Academic Support Staff Profile Support staff are drawn from Medical Student Administration, DoME and some academic divisions, and NHS Trusts. The Medical Student Administration programme support (including the MBPhD programme and Foundation School management during the first year post-graduation) totals 34 FTEs of staff time (see 0910 MBBS Leadership PAs and Medical Stud Admin for (IQR). For a full list of administrative support staff see: Current Student Administration post holders: In addition to staff within Medical Student Administration the following administrative support is provided through DoME: approximately 2.5 FTEs administrator and clerical staff plus 6 FTE for Technical Clinical Skills Centre staff. 1.5 RAE Assessment Academic members of staff contributing to the MBBS programme were entered in the RAE through their host Divisions within the Faculties of Biomedical and Life Sciences. Professor Jane Dacre acted as a 2008 RAE Panel Member for UOA 45 (Education). 1.6 Learning Resources Students are based mainly at the Bloomsbury campus for the first two years of the MBBS programme. In the third year, they continue to attend some teaching sessions within the UCL Bloomsbury campus, but spend the majority of their time at the three central NHS Trusts; the Royal Free, the Whittington and University College Hospital. In the fourth and final years, they are attached to a range of district general hospitals (DGHs), two general practices (out of a total of around 300) as well attending some sessions on one of the three main campuses (Royal Free, Whittington or Bloomsbury). The required learning resources vary from year to year, and the standard of provision can also vary. For the most part, students have access to adequate learning resources and facilities including libraries, computers, lecture theatres and seminar rooms although capacity is stretched by the size of the year cohorts (330-380) and this limits options for enhancing our teaching and assessments methods. Relevant SLMS and MBBS Facilities and Resources Committees (FRC) are collaborating to ensure current and future needs are met. Mechanisms are being developed to ensure that the MBBS FRC can initiate improvements, replacements and innovations. Lecture rooms & teaching spaces and rooms There is constant pressure on teaching space within the UCL campus given the restrictions of being in the centre of the capital and the number of listed buildings. Consequently there is only one lecture theatre on the Bloomsbury campus that can hold the entire cohort of Year 1 and 2 students, and only one lecture in the whole of UCL (under Royal Free NHS Trust management, in Hampstead) that can hold the entire cohort of Years 3-5. Laboratories and Dissecting Room There are two dry laboratories and three wet laboratories in the Cruciform Building and an additional dry laboratory in the Anatomy Building. The Cruciform laboratories are mostly equipped to a high standard, although SES IQR MBBS 2010 7 of 29 some of the equipment is in need of replacement. The laboratories are shared with Life Sciences courses and are used very heavily throughout the teaching year. Further development of non-lecture teaching is hampered by the lack of sufficient dry laboratories. The dissection room will hold half the class at a time. It has an excellent collection of potted specimens, and while it is moderately well equipped, it is in need of investment in air conditioning and new audio-visual equipment. It is used by a number of courses in anatomy in addition to medical teaching. Management of the dissection room has recently passed from the former Department of Anatomy to a faculty committee chaired by the Dean of Life Sciences. Computers & Information Technology Students have access to computing facilities on all the main campuses and at all NHS sites and are able to access the UCL email and Moodle resources. Students are generally satisfied with the level of access they have although at certain times capacity can not cope with the cohort size. Access to clinical systems in the noncentral NHS trusts is more variable. A full list of all e-learning resources has now been compiled on a single site. E-learning support is of the highest standard and is consolidated by the development of an E-learning advisory group and the appointment of a Learning Technology Adviser. There is a need for a large computer cluster room (seating 200 students) for use for on-line assessments and examinations. Teaching resources at clinical sites The Medical School has written agreements with all sites providing teaching. These agreements define the duties and responsibilities of the NHS Trusts providing training for medical student clinical training. Responsibilities incorporate the minimum standards for the provision of facilities and learning resources. Insufficient teaching space in the new UCH building was problematic for some years and raised serous concerns with the GMC. The site Sub Dean has worked closely with UCLH NHS Trust and made substantial improvements to the availability of appropriate facilities to support undergraduate learning. With the NHS trusts, especially the DGHs, a shortfall in the provision of the agreed resources is often a result of misdirection of SIFT funding within the trust, and can usually be resolved through negotiation with the trust’s finance department. 1. 2. 3. 4. 5. 6. Learning & Development Agreement between NHS London & Health Service Bodies Service Level Agreement between NHS London & UCLMS Letter of Agreement for between Medical School & Community Based Undergraduate Teaching 09-10 Letter of Agreement between Medical School & Small Providers of Undergraduate Teaching 09-10 Standard Tripartite Service Level Agreement- NHS London Medical School-NHS body 08-09 Community Based Teaching Standards Medical School & Community Based Teacher 2009-10 Clinical skills centres There is a clinical skills centre on each of the three central sites. These are well-equipped and staff provide excellent opportunities for learning. Clinical skills centres and their staff are essential for teaching as well as for the complex assessments required for medicine. The Clinical Skills Centres and their staff are predominantly funded via SIFT and therefore may be vulnerable following the implementation of the MPET review. Library provision Medical library services are provided at each of the three main campuses and at all the DGHs. Student feedback on libraries and the support provided by librarians is positive and as part of the annual QA processes, the QA Unit gathers feedback from the libraries to monitor whether they are receiving adequate financial support from the NHS trusts, allowing them to deliver the standards set in the SLA. The library at the Royal Free was recently refurbished to high specification. Funding for these services at central sites is complex, drawing on UCL, SIFT and other MADEL monies. SES IQR MBBS 2010 8 of 29 2. QUALITY MONITORING & ENHANCEMENT FRAMEWORK Description of the MBBS Programme QME Framework and its Articulation with Faculty- and InstitutionLevel QME Frameworks The General Medical Council has the statutory responsibility to set standards for basic medical education and to ensure that these standards are met. The subject benchmark statements for medicine are contained within the GMC document Tomorrow’s Doctors. The standards and learning outcomes contained within are based on current research evidence and best practice with regard to the education of medical professionals and the expectations of both patients and future employers. The Medical School underwent a full review through the GMC Quality Assurance of Basic Medical Education (QABME) procedures in 2004/2005. Following the requirements for the School listed in the resulting report (see Box 1, Section 3 of this SES), the Quality Assurance Unit was set up to ensure that the Medical School has a clear framework for organising quality management and quality control of an increasingly integrated programme in a complex and dynamic educational and service environment. The 2009 SLA between NHS London and the Medical School lays the responsibility for quality assurance and compliance with GMC requirements explicitly on the Medical School (and therefore, de facto, on UCL) The Quality Assurance Unit (QAU) within Medical Student Administration is academically led by the Sub Dean for Quality (0.2 FTE) who coordinates all its activities. As of January 2010 a further 0.2 FTE Senior Lecturer has joined to review and further develop student input and feedback. The role of the QAU is to ensure that high standards within teaching and learning processes for the undergraduate medical programme are recognised and rewarded, good practice is acknowledged and problems can be identified and addressed. The Unit has a key role in helping the MBBS programme interpret, respond to and reconcile the demands of its multiple stakeholders (students, staff, NHS providers and academic divisions) and ensuring its procedures and policies are compliant with the expectation of UCL, the GMC and NHS London. In order to fulfil this role, the QAU is responsible for co-ordinating the following: Internal monitoring of Medical School courses, modules and individual teachers through: o o o o o o o Development and dissemination of teaching standards / guidelines Student evaluation questionnaires (SEQs) QA / SIFT visits to NHS sites Liaison with student representatives Liaison with TPDU on staff development Overseeing the Reward and Recognition scheme (including the Top Teachers and Excellence in Medical Education awards) Promotion of peer review (this is the direct responsibility of the Academic Divisions) External monitoring Ensuring that procedures are established and maintained which allow the School to respond in a systematic and transparent manner to the regulatory requirements of the QAA (via UCL IQR and Annual Monitoring), the GMC and NHS London. The Medical School’s Quality Monitoring and Enhancement Committee (mQMEC) This committee oversees the activities of the QAU and identifies quality enhancement priorities for its curriculum committees and NHS providers. The committee reports to the MBBS Teaching Committee. The QA Unit works closely with the SIFT Office, TPDU, DoME, the three central NHS trusts and seven peripheral NHS trusts, the Sub Dean for Community (who is responsible for all GP placements), UCL Academic Services and committees throughout the Medical School. In response to the publication of the GMC’s Tomorrow’s Doctors 2009, the QAU will be piloting a system for gathering feedback from patients via hospital patient satisfaction surveys. Similarly, we are planning to pilot an employer's survey in order to gather feedback about the preparedness of our graduates. As we are net SES IQR MBBS 2010 9 of 29 exporters of graduates we would need to orchestrate an extensive survey of all foundation schools and their associated trusts. In discussion with the North Central Thames Foundation School (NCTFS), we have suggested to the GMC that such a survey is co-ordinated nationally as a joint enterprise between QABME, PMETB and medical school representatives. Current monitoring processes accurately identify areas of concern about, or risks to, the quality of any aspect of undergraduate medical education. We are planning to develop a Risk Register for the curriculum given the pressure on funding and the rapidly changing landscape that may mean some key providers closing, moving or altering services. The administrative operation of the MBBS programme is governed by a set of service standards available to all staff. 2.1 Student Input and Feedback Student input into the curriculum is extensive and aspires to best practice in higher education. The MBBS programme pioneered the use of online student evaluation questionnaires (SEQs) at UCL and currently gathers more than 20,000 responses per year. We are planning to improve the use of this data further by enhancing summaries, empowering student representatives, targeting SEQs, running more focus groups and improving access to SEQ data for all students and staff. There is very active student representation under the leadership of student union presidents, who in recent years have been dedicated and articulate advocates for their constituents. mQMEC ensures that student representatives and curriculum leads are informed and consulted regarding significant issues relevant to course quality monitoring and enhancement. Students sit on every curriculum committee, sub-committee and module management group, where ‘student issues’ are a standing item on all agendas. QA/SIFT site visit panels include a student representative. This involvement of students in educational reviews is considered best practice by the QAA and the NUS and actively welcomed by sites under review. In 2008-9, the QAU hosted a SSC in Educational Quality which resulted in a discussion paper Enhancing the student experience at UCL Medical School. A new senior lecturer with a special interest in developing the ‘student voice’ has recently joined the QAU. The formation of a Student Parliament is under discussion. A separate document detailing student feedback has been prepared for the IQR Panel: MBBS Student input and feedback (IQR) This document provides: 1. An overview of all mechanisms of student input 2. Summary of student evaluation questionnaires (SEQ) data for all Phases of the MBBS (2008-2009) 3. Longitudinal data - exit questionnaire data and national student survey (NSS 2004 – 2007) 4. A comparison with NSS data 2009 5. Summary of Student Staff Consultative Committee (SSCC) actions points (2007-2009) 6. Summary and response from MBBS to UCLU’s written submission to Institutional Audit 2008 National Workshops on Student Evaluation The QAU, in collaboration with the medical schools at Barts & The London and Hull York, has hosted two highly rated National Workshops on Student Evaluation. These events were supported by grants from UCL ESCILTA and the HEA Subject Centre for Medical Education. See: http://www.ucl.ac.uk/silva/medicalschool/quality/student-evaluation/ProgrammeFINAL.pdf 2.2 Staff Support Programme academic management Following the establishment of FBS and DoME in 2005 and the transfer of management of the MBBS programme to the Division of Medical Education in 2006, DoME and Medical Student Administration worked closely to ensure all committees with responsibilities for MBBS educational management aligned with College requirements. This involved a full review of the structures that had been set up at the time of the merger of the Royal Free and University College medical schools and the introduction of the new curriculum which remained divided across two faculties (FLS and FBS). The organisational charts for FBS as a whole and the MBBS programme are located on the Medical School website: SES IQR MBBS 2010 10 of 29 FBS Graduate and Undergraduate Programme Teaching Committees FBS MBBS Teaching Committee and Sub Committees Detailed guidance regarding the role of administrative staff in these structures are described in the Guide to Medical School MBBS Administration (4) Staff recruitment & induction Academic staff are appointed via their host academic divisions. The majority of administrative staff supporting the MBBS programme are recruited and appointed by Medical Student Administration and appointed by FBS Management in accordance with UCL HR. A few administrators are employed directly by an academic division or an NHS Trust. NHS Trusts are responsible for recruiting all their clinical teachers and deciding whether to include teaching in their job plans. Performance Academic staff (senior lecturer or above) are subject to the appraisal and staff review arrangements of UCL. Clinical academics, who are required to undergo an appraisal process agreed between the GMC and the Department of Health, undergo joint NHS/UCL appraisal annually under the Follet procedures. See: Appraisal Scheme - Clinical Senior Lecturers, Readers and Professors; Clinical teachers are appraised under the NHS appraisal scheme which includes a section on all teaching (not just of medical students). As a result of increased contact via the QA/SIFT visits and the undergraduate liaison committees, many NHS sites are now focusing on undergraduate teaching in appraisals and job-planning. Reward & recognition Formal reward and recognition for education and teaching within the UCL promotions process remains a challenge and SLMS is actively looking to devise criteria that define and capture excellence in medical education that would parallel the metric used for research-based promotion. Nonetheless a few staff have recently achieved promotion, in part, for their contribution to medical student education. These include: David Bender (to Professor), Alison Sturrock and Surinder Singh (to Senior Lecturer). Clinical staff can apply for NHS Clinical Excellence Awards (ACCEA) which in some areas reward education. In the past, major teaching hospitals awarded honorary UCL senior lecturer titles on all newly appointed staff. Most honorary academics are very proud of the title which, importantly, allows them access to electronic learning materials and library resources. There was, however, no process for monitoring the actual contribution of these appointees. The Medical School and Trusts have developed a robust system of appointment criteria, review and reappointment. Unfortunately UCL HR and the Medical School have been unable to resolve key issues related to these important appointments and therefore neither review nor new appointments for clinical teachers is currently taking place. The QAU is responsible for two informal reward and recognitions schemes:- Top Teachers (which are awarded on the basis of a student plebiscite) and the Excellence in Medical Education Awards. The latter are awarded on the basis of evaluation of an educational portfolio, and open to anyone involved in medical student teaching, not only UCL academics. Details of these can be found on the website. Recipients of UCL Provost’s Teaching Awards for contribution to the MBBS programme include David Bender (2007-8) and Ray Noble (2006-7). Staff development and training Academic staff have access to staff development through CALT and DoME’s TPDU. Teaching Improvement Project System, or TIPS courses offered are listed on http://www.ucl.ac.uk/dome/tips/courses . TIPS courses are funded through a special SIFT arrangement between DoME and a number NHS providers. As a result of the MPET funding review, the future of this programme and needs of medical teachers is under review. A separate paper outlining current approaches and challenges to staff development has been prepared. Faculty Development for Teachers on the MBBS Programme SES IQR MBBS 2010 11 of 29 Higher qualifications in education A number of key staff have teaching certificates or masters degrees education while other are currently enrolled in higher degree programmes. Many academics are also Fellows of the HEA and at least four individuals are undertaking a Doctorate in Education at the Institute of Education, including Deborah Gill and Anita Berlin. In 2010-11, DoME will welcome its first intake of students to a new UCL postgraduate Certificate in Clinical Education. 2.3 Recruitment and Reception of Students There continues to be considerable pressure on the available places for students to read Medicine. Applications for 2010 entry exceeded 2500 for a total of 330 places (nearly 8 applicants per place). Screening of qualifications includes assessment of application forms and use of Biomedical Admissions Test (BMAT) scores. All applications are read carefully by several people and an overall ‘priority’ score is assigned to each application. Candidates are then invited to interview in order of priority and interviewing continues until places are exhausted. This usually means that we invite 700 - 800 candidates to interview at UCL, between December and early March. This process is conducted by the Medical Admissions Officers and the Admissions Tutor in accordance with the selection procedure guidance published on the Medical School website and in the prospectus. Each selected candidate is interviewed by a panel of three interviewers. Panels are formed from a pool of over 250 interviewers, comprising academic members of staff, clinicians and laypersons. Lay interviewers include senior medical students, head teachers or other school representatives, careers advisers and healthcare administrators. The pool of lay interviewers includes individuals with disabilities. We endeavour to ensure that wherever possible, the panel of interviewers is balanced in terms of gender, profession, ethnicity, etc.. All interviewers receive structured training and are given guidance notes to ensure fairness. Interviewees have the opportunity to meet Admissions staff, including the Admissions Tutor, when visiting UCL for their interview, as well as joining a student-led guided campus tour, thus ensuring that all of their questions regarding academic matters, admissions or ‘student life’ can be addressed. Selection tool Description of assessment (e.g. academic qualities, personal qualities, ethical and professional behaviours) Use of this tool UCAS application form Academic qualifications, personal qualities (including motivation for medicine, evidence of teamwork, leadership and communications skills, study skills and outside interests). Academic profile is screened to ensure that entry requirements are met; personal statements and references are scrutinised in order to assess previous experience (work, volunteering, personal), motivation, study skills and other personal qualities. BMAT Assessment of scientific aptitude, critical thinking and written communication skills. BMAT allows us to identify potential in candidates irrespective of their background. The test includes an essay component, which is also used at interview. Comparison of scores of candidates with the average for the cohort – high scores strengthen an application. Scrutiny of essay to assess written English and ability to construct an argument. Interview Personal qualities and ethical and professional behaviour (including intellectual ability, motivation, understanding of a career in medicine, ability to express and defend opinions, awareness of relevant issues, attitude including integrity and flexibility, individual strengths, Interviewers score candidates for a set of criteria and make recommendations to the Admissions Tutor as to whether the candidate should receive an offer. SES IQR MBBS 2010 12 of 29 communication skills). The BMAT essay is used to provide a discussion topic. Additional documentation Academic qualifications, personal qualities. Candidates are given the opportunity to submit additional information to support their UCAS application (for example references or commentaries from work experience placements). Additional information is considered in order develop a more complete understanding of the candidate’s background and experience, particularly for graduates and mature applicants. 2.4 Student Support Personal Tutor and Medical Student Advisor Scheme Since 2004/2005, PDS tutors have been the pastoral tutor to members of their tutor group of approximately st nd fifteen 1 or 2 year students. The tutor helps to ensure academic and pastoral progress and support. Guidelines for this role for PDS tutors are circulated at tutor training. In Year 3, (the first clinical year) students will be assigned an advisor and expected to have four appointments over the course of this year. During Years 4 and 5, students are expected to have at least one appointment each year with their advisor in order that they can track their progress, potentially write them a reference, and give advice on foundation year applications. Welfare system There is a highly regarded welfare system for all medical students, offering both pastoral and academic support throughout the course and led by the Faculty Tutors. Welfare clinics are held on a daily basis at the three central sites with a balance of male and female, academic and clinical Welfare Tutors. For details please see Welfare Handbook and website. Over the last academic year, approximately 1,700 appointments were made for students in these clinics for welfare issues. The School’s ethos is to provide students in difficulty with easily accessible and flexible support through the overarching framework of the welfare system. The welfare provision has undergone extensive development over the last 5 years and is able to help students who have academic, personal, social or health problems. The service relies on both self-referrals and referrals by concerned staff where students may lack insight or motivation to address their difficulties. Key elements of the welfare system are: Close Supervision policy for students requiring extra support Student Support Cards for those who wish educational supervisors and/or examiners to be made aware of health or personal circumstances which might affect their performance Serious Concerns reporting system (via UCLMS Fitness to Practise forms) for student whose conduct has caused alarm during the course or in an assessment. Ultimately most students known to the welfare service will graduate with or without ongoing support. A few will be referred for a full Fitness to Practise procedure. The UCLMS welfare system, however, is not framed as a “Fitness to Practise" system. There is a clear overlap and link between pastoral and academic support and the fitness to practise process, but the ethos of the service is to emphasise support and encourage self-reporting and shared responsibility for students in difficulty. Preparation and progress of students away from College The largest part of a medical student’s time will be spent away from College on placements. One of the mainstays of preparation is ensuring both the public and the student are afforded adequate safeguards in terms of potential personal and health risks. Their professional responsibilities are emphasised in their PDS sessions where they are familiarised with the GMC document The Duties of a Doctor. Medical students are required to demonstrate that they are covered by a professional defence society, they have CRB clearance and that they know their immune status against a specified list of infectious diseases. In SES IQR MBBS 2010 13 of 29 future applicant will also need Independent Safeguarding Authority (ISA) clearance. These are explained in the Medical School A-Z Policies and Regulations Students’ commitment to their duties regarding these procedures is obtained when they sign the Student Agreement at the beginning of Year 1 and again in Year 3. NHS placements – hospital & GP A very strong emphasis is placed on ensuring student can access up to date joining instructions prior to placements and receiving the best possible induction on arrival. These are evaluated in the SEQs. Each hospital site has a named tutor or sub dean, and an undergraduate administrator for support and advice. Students on GP placements receive written web based information including access to evaluation by previous student. All students attend the academic department for a briefing prior to the placement. Students submit a Learning Needs Assessment checklist which is used for initial, mid-block and end-of-firm discussions. Overseas electives Nearly every final year student goes abroad for an 8 week medical elective. The procedures for screening placements and for preparing students are meticulous and include at least one personal interview and an occupational heath and insurance advice session for each of the 370+ final year students. Each student is given the personal mobile phone number of the Sub Dean for Electives prior to departure in case of emergency such as accident, theft or needle stick injury. Procedures for planning electives and staying safe are presented via detailed Factsheets. Student handbooks Every phase and module of the course has its own handbook which can be accessed via the website. In addition, the A-Z Policies and Regulations provides easily accessible and detailed advice in key areas. 2.5 The Teaching Function and Process The undergraduate medical course takes 6 years from entry to qualification with the degrees of MBBS and BSc (with the exception of graduate entrants and MBPhDs - see Student Profile, above). On the award of the UCL MBBS degree graduates are eligible for provisional registration with the GMC. This is followed by two years in foundation training posts. After the first foundation year graduates gain full registration with the GMC and after the second they begin specialist postgraduate training. The function of the programme is to produce highest possible calibre graduates who qualify for inclusion on the medical register. In order to achieve this, the entire programme must be approved by the GMC and comply with their published recommendations; Tomorrow’s Doctors. The recommendations cover all aspects of course content (through “outcomes for graduates”) and specify mandatory standards for the delivery of teaching, learning opportunities and assessment. The most recent edition of Tomorrow’s Doctors was published in September 2009 and is considerably more detailed than previous versions. All medical schools are required to be fully compliant with every outcome and standard by academic year 2011-12. In addition to the general expectations contained within Tomorrow’s Doctors each medical school has undergone a GMC review through the QABME procedures within the last 5 years. Overall, the provision at UCL was deemed satisfactory, however the GMC required the Medical School to address certain specific areas, and recommended changes in a number of others. Most, but not all, of these requirements have been addressed. Outstanding issues and the role of the ongoing Curriculum Review are addressed in Section 3, Self Analysis. It therefore follows that teaching function and processes of the MBBS programme are largely determined by the GMC’s graduate outcomes, standards and requirements. Nonetheless medical schools remain free to determine many aspects of their programme design in terms of overall pedagogic principles, timetabling, sequencing and sites of delivery. These are outlined in our Programme specification. SES IQR MBBS 2010 14 of 29 2.6 Programme Design, Operation and Review Programme aims Overarching aim: The MBBS programme aspires to educate the UCL Doctor: a highly competent and scientifically literate clinician, equipped to practise patient-centred medicine in a constantly changing modern world, with a foundation in the basic medical and social sciences. This vision is informed by research in education and the relevant sciences and is underpinned by the values of scholarship, rigour and professionalism. The focus is on the development of the student as a scientifically informed, socially responsible professional who, in turn, can serve the health needs of individuals and communities. Aims of the Programme: To ensure graduates are: Scientifically literate and clinically competent Ready to enter careers in any clinical speciality or in the biomedical sciences Capable of evidence-based practice Fit to practise clinically and / or conduct research legally and ethically with appropriate professionalism and attitudes FBS Teaching & Learning Strategy SES IQR MBBS 2010 15 of 29 Underlying Principles of the MBBS programme: Content: A coherent curriculum supporting acquisition of knowledge necessary to achieve excellence in clinical practice and clinical sciences. Programme design: In order to achieve our aims, there is an integrated 5 year, core programme of study, divided into three phases: Phase 1 (Years 1 and 2) Science and Medicine Phase 2 (Years 3 and 4) Science and Medical Practice Phase 3 (Year 5) Preparation for Practice All students who are not already graduates will intercalate a year to take a BSc degree in a basic or clinical science, history of medicine or another approved subject. This will normally be after the end of year 2, or sometimes after the end of Year 3. Vertical Spines and Modules There are also four vertical modules which run throughout the 5 year core programme: Society and the Individual Mechanisms of drug action and the use of medicines (which begins in Year 2) Pathological sciences Cancer medicine (introduced in 2009-10) The Professional Development Spine (PDS) runs through the 5 year programme of study in a vertical format. It includes: Clinical and Communication Skills; Ethics and Law; Evaluation of Evidence; Health Promotion; and Community Medicine. It was introduced with the new Curriculum in 2000. Learning is mainly in small group work and reflective activities both in protected time and embedded in other clinical activities. It is therefore integrated with the rest of the curriculum, and students undergo integrated (and stand-alone) assessment of professional skills. Student choice In order to allow students to pursue personal interests or direct their learning to areas where they may wish to gain additional experience, the programme incorporates two optional elements. In 2003, the GMC stipulated that at least 20% of the programme should be “student selected”, but the proportion has been reduced to 10% in the 2009 recommendations. SES IQR MBBS 2010 16 of 29 Student Selected Components (SSCs) There is a wide range of Student Selected Components in each phase of the programme. Options include placements in clinical and voluntary organisations, joining a research team or undertaking a library project. SSCs are assessed through the submission of a written report and receive very positive feedback. Electives The 8 week final year elective is one of the most popular parts of the programme. The majority of students go abroad – about 50% to USA, Australia or New Zealand, and the rest to developing countries throughout the world. Many are supported by charitable bursaries. Occasionally students who have failed a module in Year 4 forfeit their electives in order to have directed remedial study. Preparation and guidance for electives is described above (see Preparation and progress of students away from College). Assessment is through a supervisors report from the host institution and the grading of a project submitted by each student. Student feedback is gathered, collated and made available to future students to facilitate their choices. The organisation of the medical electives conforms to, and in some ways exceeds, the expectations outlined in the Gold Book. Intercalated BSc All students (except graduate entrants) undertake a one year programme for which they are awarded an iBSc degree. The delivery, quality assurance, annual monitoring and IQR of these programmes rest with their host departments or divisions. The final assessment of the iBSc award incorporates marks from earlier years of the programme. The Academic Committee has recently agreed that the proportion of marks from Years 1, 2 and 3 should be 1:1:6, bringing UCL in line with other medical schools. UCL offers the widest range of iBScs in the UK and approximately 60 students join UCL iBScs from other schools each year, and 10 UCL students undertake BScs outside the institution. From 2010-11, students entering the programme will be advised that they will only be able to intercalate between Years 2 and 3 to limit fluctuations of numbers entering clinical placements. MB PhD Programme The MB PhD Programme, which began in 1994, enables up to 10 students per year studying for Medicine to be awarded the degrees of MB BS, BSc and PhD in just eight years, instead of the normal nine if the PhD is undertaken separately. The aim of the scheme is to foster academically-minded medical students who wish in the future to combine research with clinical medicine. Students undertake a modified MBBS programme from rd their 3 year. Securing funding for students and ensuring they are able to complete both their medical studies and stay focused on a thesis is a challenge. A UCL MBPhD graduate has just gained a professorial chair at the age of 33. Programme operation The UCL and Royal Free curriculum prior to the merger, conformed to what is known as a traditional Flexnerian model – two years of basic science, organised in disciplines taught in lectures and laboratories, followed by three years of clinical placements in the major specialties. The 2000 curriculum introduced a modularised programme which ensured horizontal integration (in body systems in Phase 1, and in clusters of related clinical areas in Phase 2). Phase 3 aimed at providing more direct clinical contact in district general hospital and GP practices. Vertical integration was built in through the longitudinal modules listed above. Phase 1 (Years 1&2) In addition to the Professional Development Spine and the vertical modules, Phase 1 is arranged as a series of systems-based, consecutive modules, each of which builds on knowledge, understanding and skills acquired in previous modules, and which provides for the acquisition of further knowledge and skills in subsequent modules. Each module is based on a physiological system and provides integrated teaching across all disciplines. The modules are: Year 1: Foundations of Health and Disease; Infection and Defence; Circulation and Breathing; Fluids, Nutrition and Metabolism. Year 2: Movement and Musculoskeletal Biology; Neuroscience; Endocrine Systems and Regulation; Reproduction, Genetics and Development; Cancer Biology. SES IQR MBBS 2010 17 of 29 Phase 2 Year 3 begins with a 3 week, Introductory Course in Clinical Methods, followed by four modules of clinical attachments and related pathological sciences. The clinical attachments are spent at the 3 main university hospitals and in the community, and each student will experience attachments at two of the three central hospital trusts. The clinical attachments for all students cover:General Medical Specialties (GMS); General Surgery (including vascular and urology); General Medicine and Medicine in the Community (GM (MiC)); Care of the Elderly, with Orthopaedics and Rheumatology (COOP / O&R). Year 4 is organised as three modules: Child and Family Health with Dermatology (CFHD); Clinical Neuroscience (Psychiatry and Neurology with Ophthalmology) (CN); Women’s Health and Communicable Diseases (WHCD). Related material from the vertical modules and the Professional Development Spine is incorporated. Phase 3 While professional development is a theme running through the entire programme, it assumes paramount importance in the final year. The year provides choices to fulfil personal interests and to allow exploration of career possibilities through elective and selective attachments. Parallel to this is preparation for the Foundation Year 1 training that follows immediately on qualification. This preparation involves attachments in Medicine and Surgery in DGHs, in general practices and in an accident and emergency department. A new curriculum and structure for Phase 3 will be introduced in 2010-11. Teaching and learning methods The methods of teaching and learning incorporate formal lectures, laboratory practicals, workshops and computer-aided learning (CAL) in Years 1 and 2. Small group learning is mainly in weekly PDS sessions, complemented by some patient contact and community visits. There are recent innovations in integrated casebased workshops taught jointly by scientists and clinicians in some modules. During Year 3 students rotate through clinical placements at two of the three central hospital sites with approximately 8 days in general practice. Patient-based learning is supported by three lecture programmes: Pathological Sciences, Taught Course in Medicine and Use of Medicines. In Year 4 they are placed in the central hospitals, DGH sites and general practice and have a series of study days with lectures and small group activities. Phase 3 is entirely placement-based in general practices and DGHs, incorporating a mock OSCE exam and clinical revision sessions. This is supported by an innovative Moodle programme, Case of the Month, integrating core elements of the final year syllabus with professional development tasks oriented towards foundation year requirements. The new final year aims to emphasise in-depth, practical experience, incorporating longer placements and student assistantships. In addition, students in all years receive highly rated teaching and support from clinical skills staff. Learning and Teaching strategy for the programme is summarised in the 2008 FBS Teaching & Learning Strategy. This will be updated in light of the curriculum review described in Section 3 of this document. Programme review After the introduction of the new curriculum a rolling process to review each phase was introduced. In 2007 a number of drivers led to the commencement of a full review of the entire programme. A description of the curriculum review process and current recommendations forms the basis of Section 3 of this document (the Self Analysis). 2.7 Assessment of Student Performance The structure of the MBBS assessments is largely determined by requirements of the GMC. The assessment team at UCL have an international reputation for best practice and innovation in the assessment of professional SES IQR MBBS 2010 18 of 29 competency. DoME holds contracts with the GMC on a number of professional assessment projects. The MBBS assessment leads also participate in a national exam item-sharing project. In-course assessment In-course assessment in Phase 1 consists of two written reports at the end of each SSC, some practical reports and four essays for PDS (two in each year). In addition, students must complete the following items in their portfolio via Moodle: reflective passages based on key events such as first patient contacts; a checklist of achievement against UCL key skills (Year 1); a checklist of achievement of key skills against the GMC guidance o Good Medical Practice (Year 2); and a 360 appraisal. Written work is passed through Turnitin software and must reach a required standard for the student to progress. Marks are also sent to academic advisors. o In Year 3 students complete a range of tasks for their portfolio including a further 360 appraisal. Students receive written feedback on all work submitted, and oral feedback and an itemised mark sheet for their 20 workbased assessments (WBAs). At the end of each module they have one-to-one meeting with a tutor and receive a Report Form. It is a progression requirement that the portfolio is completed satisfactorily and students must achieve a minimum score in the WBAs. In Year 4, students complete a range of tasks depending on the module, receive an end of module Report form and keep a log book of clinical activities . In Year 5 students also undertake written work as part of their GP and SSC attachments on which they receive structured feedback. They must undertake a minimum of 8 WBAs and receive an overall Grade (A-E) for each attachment. In each year students whose in-course assessment indicates an academic or pastoral problem will need to see a Welfare or Faculty tutor and are offered remedial sessions as appropriate. Formative and Summative assessment through examinations Phase 1,Years 1 & 2: There is a formative assessment at the end of each module, and a summative assessment at the end of each year which determine progression. Year 3: Formative assessments, in the form of written papers, take place at week 15, and summative assessments, in the form of one written paper, workplace based assessment marks, and an Objective Structured Clinical Examination (OSCE) take place at the year end. The aggregate scores obtained in these assessments and in module assessments determine progression to Year 4. Year 3 assessments are moderated by external examiners. Year 4: Related material from the vertical modules and PDS is incorporated. Summative assessments comprising a written paper and an OSCE are held at the end of each module and progression depends on the results obtained in these three assessments. These are moderated by external examiners Final year: The final MBBS examination is an integrated, written and clinical assessment in Medicine, Surgery, Pathology, Use of Medicines and Public Health. It includes assessment of general professional skills including practical and clinical skills, communication skills and ethics. It does not include Paediatrics, Obstetrics and Gynaecology or Psychiatry (because these have been assessed in Year 4) except where these occur in the context of common medical or surgical emergencies. The written assessments consist of case-based written tests in papers designed to integrate separate materials under broad headings, and including exercises in data interpretation. The clinical examination is divided into two parts: A Long Station OSCE that tests for consultation skills, clinical reasoning, and physical examination skills of all body systems, with additional assessment of communication skills, ethical problem solving and critical appraisal of evidence. This exam involves real patients and some simulated patients. A Short Station OSCE consisting of “short” cases based on clinical scenarios and focused on examination, communication and diagnostic skills in any relevant clinical area (including Ophthalmology and Dermatology) and testing ability in practical procedures. The exam relies on simulated patients and manikins. Full information provided for students is available on the assessment webpage Students also receive a briefing immediately before each clinical exam. See LSO briefing and SSO briefing. The operation of exam boards are described in the document: Medical School Examination Boards (3) SES IQR MBBS 2010 19 of 29 External examiners The MBBS assessments rely on a large number of external examiners who are recruited in accordance with College policy. The list is submitted to College and available on request. In addition to a briefing on the day, examiners at finals receive a detailed Guide for Examiners outlining our procedures and expectations. Careers advice to students Over the past three years, there has been a new development within the MBBS programme - a comprehensive and structured approach to career advice led by the Sub Dean for Careers and supported by the Medical Careers Adviser, UCL Careers and Medical Student Administration. Factsheets and podcasts can be seen on the website. The advice and material are highly valued by students. All students receive: Individualised career support from Year 4 with trained careers advisers; A series of workshops to assist with preparing for Foundation Programme applications; An extensive range of factsheets located in a dedicated careers webpage; Access to an exceptionally wide range of iBSc and SSC options, with a strong academic focus. First destinations of graduating students The proportion of the final year cohort who graduated at first attempt are as follows: 2008/09 2007/08 2006/07 2005/06 93% 98% 94% 97.6% Proportion of graduates which has achieved full registration with the GMC or deferred or failed to complete a Foundation Programme Year Full Reg Did not apply for Full Reg Deferred entry to F1 Withdrew from F1 Did not enter/Left medicine 2008/9 93.2% 1.9% 1.6% 2.7% 2007/8 97.5% 1.9% 0.3% 2006/7 98.8% 0.6% 0.3% 2005/6 95.5% 1.8% 0.9% 0.3% F1 = Foundation year 1 or preregistration year (first year post-graduation) Repeating F1 Unknown 0.3% 0.3% 0.3% 0.3% 0.6% 0.9% SES IQR MBBS 2010 20 of 29 3. SELF-ANALYSIS 3.1 Approach to Self-Analysis The purposes of this self analysis are to summarise strengths and weaknesses of the MBBS programme, to draw the attention of the review team to innovations and good practice, and to highlight challenges that the programme faces. This section also includes actions that are planned to address the issues identified. As the programme is concurrently in the process of a PSRB review from the GMC and a detailed, internal Curriculum Review, this section is based on the self analyses, recommendations and aspirations arising from these parallel review activities. The evolution of these processes can be seen in our Annual Monitoring reports for College QMEC and our Annual Returns to the GMC. 3.2 Historical Note 1 UCL Medical School has emerged from the amalgamation of a number of institutions: University College Hospital Medical School merged with the Middlesex Hospital Medical School in 1987, and the Royal Free Hospital Medical School in 1998. These organisations combine a rich past in the history of science and medicine with advanced clinical practice. The current curriculum, which fully merged the University College and the Royal Free Hospital medical schools, commenced in a double process in 2000 with a new first and third year simultaneously. The first cohort to graduate with new final examinations did so in June 2004. In 2005 the programme underwent a full review under the GMC Quality Assurance of Basic Medical Education (QABME) procedures and was tasked with addressing a number of requirements (must-do) and recommendations (should do). See Box 1 below. (The full report and the School’s annual returns to the GMC are posted on the QAU webpage.) The Faculty of Biomedical Sciences was established in 2005, incorporating several world-famous medical institutions into its divisions. Staff from these divisions design and deliver the MBBS programme together with colleagues from UCL Faculty of Life Sciences. The formation of a Division of Medical Education (DoME) (incorporating the Academic Centre for Medical Education, ACME) was approved by the Senior Management Group of the newly established Faculty of Biomedical Sciences in 2006. One of the principal aims of this initiative was to enhance integration of administrative and academic responsibilities throughout all phases of the MBBS programme, with oversight of management of the curriculum, assessments, student load and educational quality, under the directorship of Professor Jane Dacre. 2 Box 1: Summary of requirements for UCL Medical School from GMC QABME 2005 Integration 1. Changes towards integration of the management 2. Changes towards integration of content of all Phases of the curriculum 3. Review teaching styles in Phase 1 to facilitate transition of students between Phases Quality Assurance 4. Further development of quality assurance Resources 5. Ensure adequacy of teaching space following the completion of the move to the new UCH Student Selected Components 6. Review the School’s arrangements for SSCs to ensure that all graduates undertake sufficient learning within SSCs (including those who do not intercalate). 7. The School is required to ensure that students undertake a sufficient breadth of SSCs 8. Curricular time devoted to SSCs is not used for remedial learning 9. Improve mechanisms for feeding back to students on SSCs Self assessment Completed Ongoing Ongoing Completed Completed Completed Completed Completed Completed 1 The MBBS programme in its current form has never undergone IQR. The last IQR with reference to medicine reviewed the clinical course at UCL, (i.e. years 3-5) in 1998, prior to the merger with the Royal Free, the introduction of the 2000 curriculum and the establishment of FBS. 2 Formerly known as known as Royal Free & University College Medical School (RFUCMS). Since 2009 UCL has been included in the GMC list of institutions awarding primary medical qualifications. SES IQR MBBS 2010 21 of 29 Curriculum Review – the process & background information The MBBS Review was commissioned by Professor Ed Byrne following the reorganisation of the two faculties into the SLMS. The overall aim of the review was to reflect on the strengths and weaknesses of the current MBBS programme and to make recommendations for change. Stage 1 involved the formation of a Steering Group which met over the summer of 2007, with the support of Working Parties (WPs) looking at six, specific areas. This resulted in the publication of recommendations in November 2007, which are set out in the MBBS Review Report 2007 Stage 2 started with a consultation on those recommendations, and a report on that consultation exercise was produced in April 2008, Consultation Report. This resulted in a number of significant structural changes (see below). The final stage is a more detailed consultation focussing on the curriculum content and delivery, which will culminate in the publication of an implementation plan. The current part of the Review was launched in July 2009 by a scoping exercise which initially focused on Years 3 and 4 of the course (Phase 2). It has now incorporated all three Phases and the vertical components, because of the need to ensure that our course is fully integrated. The steering group, with four working parties, has now reported. WP1 – Achieving Integration WP2 – Learning Objectives and the Curriculum Map WP3 – Creative Teaching and Learning Strategies WP4 – Implementation Across HEI & Healthcare Delivery Settings A Draft Summary Report MBBS review 2009 has been prepared for discussion. These recommendations, and the principles that will underpin the curriculum, will be considered in a meeting with Professor Sir John Tooke at the end of March, prior to the publication of a final implementation plan. Curriculum Review – drivers for change The factors driving the Curriculum Review can be summarised as: 1. Formation of FBS and the Academic Health Science Centre 2. Alignment with UCL administrative structures 3. Student feedback 4. Need to make further progress on outstanding requirements from GMC QABME report 2005 regarding integration (see Box 1 above) 5. Publication of Tomorrow’s Doctors 2009, with which we need to be fully compliant by 2011-12 6. Rapid change within the NHS provider landscape as a whole, and impact of Skills for Health and the Darzi Report for London 7. Change in the framework of delivery of medical education at both undergraduate and postgraduate level (in particular the Foundation Programme) 8. Implementation of the MPET funding review which will significantly affect SIFT monies for undergraduate education (particularly London teaching hospitals), expected 2011-12. 9. Increasing need to provide evidence of financial transparency as the economic downturn progresses and influences university and health service funding streams. 10. A number of reports, reviews and research papers highlighting priorities for medical education (notably the Tooke Report, the Patel Review, research commissioned by the GMC from the Skills for Health and Illing’s Group) 3.3 What the Students Say Tracking student feedback over a number of years, the following major themes have emerged regarding their perceptions of the strengths and weakness of the programme. SES IQR MBBS 2010 22 of 29 Strengths • • Overall satisfaction is higher than sector as whole. Areas for improvement Lack of clarity re: overall goals More active learning & clinical orientation needed in Phase 1 Lack of learning culture and student-centeredness in some clinical settings (a major symptom being cancellations of teaching) Areas rated very highly: Formal teaching Organisation and management Learning resources High levels of student representation & feedback on curriculum Better formative feedback (both quantity and consistency) Inadequacy of resources – quality of the estate Sources include: UCLMS SEQs & Exit Questionnaires, NSS Major achievements following Curriculum Review Stage 1 (2007-9) Committee structures have been changed to comply with College expectations. All students are now registered on a single Portico programme code for the 5 years of the MBBS course. Similarly the MBBS Faculty Tutors and all academics with leadership roles are now in a single Faculty, FBS, with clear role descriptions and management through the Division of Medical Education. We have also agreed that students will only intercalate at one point to reduce fluctuations in numbers Findings of Curriculum Review Stage 2 (2009- ongoing) Our starting point has been to view the curriculum as a dynamic phenomenon that needs constant attention and refocusing in order to remain fit for purpose in training the doctors of tomorrow. In reviewing the curriculum and exploring opportunities to improve the curriculum we are mindful that our responsibility for the curriculum includes everything a school does to achieve its goals rather than the more narrow conception of a curriculum as what is prescribed to be taught. Below is an analysis of the strengths, areas under development and vision for improvement divided into curriculum content, structure and assessment, followed by an analysis of support areas such as admissions, welfare, diversity, quality assurance and resources. The section ends by highlighting two additional areas of good practice and a summary. 3.4 Planning, Structure, Content and Assessment Strengths The programme content is robust in terms of factual, professional and technical knowledge, and it is underpinned by best practice in assessment. It produces well-informed graduates, (UCL graduates have won the University of London Gold Medal for the last five years) the vast majority of whom graduate and pursue careers in the NHS. Areas of good practice and innovation include examples of vertical integration running through the whole curriculum such as the Cancer Vertical Module introduced in 2008-9 and the Professional Development Spine (PDS), which we seek to emulate in other areas as we complete the requirement to integrate the whole programme. Strengths of the PDS are its longitudinal presence, use of small group work and reflection, as well the popular on-line Case of the Month, recently added to support final year students. PDS incorporates clinical skills teaching from a dedicated and collaborative team with a strong emphasis on professional relationships with students, and pastoral care. The team uses their facilities to maximise training in low-tech simulation, as well as in clinical settings, to enable students to achieve all Tomorrow’s Doctors’ practical competencies. PDS assessments have pioneered the use of the portfolio. In core modules, progress has been made in integration between Phase 1 and 2, with more emphasis on the clinical relevance of science, by using educational approaches that develop and foster integrative learning with scientists and clinicians working together in tutorials, problem based workshops, simulations and practicals. There are some examples of spiral learning which we plan to build on, such as developments in the Circulation & Breathing module in Year 1, and the Critically Ill Patient in Year 3. SES IQR MBBS 2010 23 of 29 Evidence of increased integration between Phases 2 and 3, and Foundation Year 1 include more skills training, in-situ simulation and the introduction of the revised Year 5 syllabus document and a new Year 5 timetable including Assistantships in 2010-11. Strengths in assessment accrue from the expertise of the team and the use of the most up to date formats throughout the course to test the application of knowledge in written tests rather than its acquisition, and preparation for practice in Objective Structured Clinical Examinations (OSCEs). Blueprinting and standard setting ensures tests are comprehensive, and have a robust pass mark defined by the Anghoff procedure. The tests are statistically robust and reliable. The use of common Workplace Based Assessments (WBAs) provides in vivo assessments, with observation of practice and feedback in a format that enhances integration from Year 3 through to the foundation years. The curriculum and assessments are supported by effective administration responsible for maintaining all documents and web pages, managing timetables and examinations for nearly 2,300 students and tracking progress using the MSSR. Areas for development The curriculum is now in its tenth year and has benefited from the quality of its original design. It has been possible to make some improvements during that time, but further change is hampered by the restrictive timetabling, and the need to keep students in blocks. Despite its many strengths however, a number of ongoing concerns from students, growing professional expectations and other drivers for change, offer us a unique and timely opportunity for thorough review. Students, and to some extent staff, want clearer aims and objectives, and these need to be mapped onto Tomorrow’s Doctors 2009. We are aware that our graduates need to be more capable of integrating knowledge and skills across a range of domains and, most importantly, demonstrate better patient-orientated, problemsolving and decision-making abilities. We also wish to develop students’ learning skills further to ensure they graduate as reflective and independent learners with greater hands-on experience, despite the increasingly risk-averse, clinical environment. In assessment we will expand the use of the portfolio to harmonise with the role of portfolios in postgraduate professional development, and ensure all Phase 2 and 3 tests are blueprinted and test preparedness for practise. We need to continue to improve feedback to students for formative assessments. The wider use of eassessment would greatly reduce the administrative burden, but this depends on availability of resources. Current processes for curriculum planning, articulation, mapping, funding and module management tend to lead to stasis and disintegration, rather than promoting regular improvement and rewarding quality. We are reviewing structures and the timetable “matrix” to facilitate change rather than manage a status quo. Key areas for improvement are therefore: • • • • • • • • • Redefining and clarifying overall aims and learning outcomes for the MBBS course Further improvement in integration, to ensure a balance of basic science and clinical practice across the whole course Ensuring the programme takes a patient-centred approach, beginning with sustained, early patient contact Ensuring preparation for practice is a key feature of the course Investment in e-learning, e-assessment and further development of the portfolio and formative assessment Ensuring delivery is mindful of educational objectives, changes in the provider landscape, expectations of patients and of the GMC More investment in positive role modelling and the intellectual and social benefit offered by small group work and membership of clinical teams Developing structures that allow programme review and curriculum development to be continuous and adaptable to reflect the dynamic environment Enhancing the unique selling point of UCL, by effectively integrating scientific principles into the course at all stages Actions planned to achieve improvements The first steps in achieving improvements are to identify key principles for:- SES IQR MBBS 2010 24 of 29 (1) selecting content; (2) ensuring a coherent, pedagogical approach to educational activities. Our next priorities are to ensure that documentation clearly articulates the curriculum and its learning outcomes. This will follow mapping against Tomorrow’s Doctors’ key recommendations and updating our checklist of key skills acquisition. We are considering a single, agreed list of core conditions addressed in the MBBS curriculum. We are already working on more generic and flexible attachments in Phases 2 and 3, shifting emphasis progressively from range to depth of clinical experience. This approach will allow us to move students readily between rapidly changing healthcare providers (where key teaching hospitals are likely to close or downsize) and prepare our students to work within new healthcare environments (such as poly-systems). In assessment we have expanded the use of the portfolio through the Moodle platform in the current year, and this has allowed for more prompt, personalised feedback. Work on standard setting and blueprinting is nearly complete for all Phases. Focus group studies will look at ways of improving confidence in WBAs and informing staff development. The effectiveness of the module management structure will be reviewed. Increasingly close relationships with academic divisions (including the identification of a teaching lead and annual educational goals), and with NHS Trusts mean that HEFCE(t) and SIFT monies, intended to fund the MBBS programme, are beginning to be more clearly accounted for. Managing the student load and fluctuations in numbers remains a challenge and unfortunately data gleaned from College via the Portico system is often flawed. For example only 230 out of 380 finalists were invited to participate in the NSS in 2009, and College estimates our attrition rate over the 6 year programme as 16%, whereas our own data suggests the figure is less than 10%. Academic Services have been actively seeking ways to identify the source of these discrepancies. 3.5 Areas Supporting the MBBS Programme Admissions, widening participation, welfare and career advice The use of the BMAT in the selection of medical students facilitates an admissions process which is fair, transparent, defensible and able to identify potential irrespective of background, resulting in diversity in the medical student population (age, nationality, educational, religious, social and ethnic background, disability). The high academic offer aims to minimise the attrition rate. Best practice is demonstrated in the provision of timely advice to prospective applicants, acknowledgement of application and structured feedback to unsuccessful interviewees. We use trained interviewers from diverse backgrounds including ‘lay’ people with disabilities. ‘Customer’ satisfaction is high in solicited and unsolicited feedback on aspects of the process notably Medical School open days, helpfulness of the medical admissions staff and constructive feedback following interview. On arrival students participate in an induction week and special induction arrangements are made to welcome and orientate Oxbridge transfers and MBPhD students. Overall we believe that our recruitment and reception procedures exceed requirements. There is enthusiastic participation by students in WP activities which raise awareness, create aspiration, dispel myths and help prepare applicants. The Medical School has formed a Fair Access to Medicine Executive (FAME). There are daily Welfare Clinics, and the access to tutors across all Phases is a model of good practice. Mechanisms have been developed to identify and support students in difficulty. Innovative, special provision accommodates student needs such as support cards, the close supervision register, special adjustments, support tutors, and peer support. Welfare works closely with the College counselling service, occupational heath and the chaplain. The work of the welfare tutors is assisted by the electronic Medical Schools Student Record system (MSSR). We have in place comprehensive procedures for medical student fitness to practise, which we endeavour to integrate with College disciplinary processes. Our comprehensive careers services are valued by students, and function well in terms of applicants succeeding in their first choice of Foundation Programme. Areas for development in admissions, widening participation, welfare and careers advice. We are concerned about the maintenance of the quality and diversity of applicants, given the proposed changes to the UCL Admissions process and the financial challenges for graduates, overseas applicants and lower socio-economic groups, and for EU and Home students unable to take out loans. Retaining interviews is SES IQR MBBS 2010 25 of 29 important in this process. We need to reconsider involvement in the UCL Open Day given the negative impact on applicants (see feedback to CRAS). We foresee particular challenges to fair access. These include lack of finance to existing schemes which are run on good will with limited staff involvement. New ISA restrictions will present a number of challenges to the medical school and may compromise involvement of staff and students in WP activities. Changes to the national curriculum may disadvantage applicants from State schools and make them ill-equipped to deal with the demands of the medical programme. Lifting the cap on tuition fees may also provide a disincentive for some students from families on low incomes. The focus of existing WP projects has very much been on financially and educationally disadvantaged groups, so we are examining ways of working with applicants with disabilities and addressing the national policy focussing WP on underrepresented, demographic groups such as students from the former eastern European countries. (Target Medicine is looking to recruit a further school in West London to remedy this.) Welfare services would benefit from ring-fenced funding, increased engagement and training of welfare tutors and greater communication with the student body. We would like to embed careers planning further into the programme and indeed alert potential applicants to the Medical School of the career prospects in medicine. We are mindful of the impact of academic quartiles in selection and of Situational Judgment Test (SJTs) in the foundation years, and hope to take this as an opportunity to pilot SJTs for undergraduates. Quality assurance and student feedback processes The QA Unit has, to date, been able to handle increasing regulatory demands while maintaining its primary function of monitoring the student experience and feeding into curriculum and teacher development. The QA unit has close links with student representatives who participate in site review panels and has pioneered the use of on-line feedback. Through close liaison with the SIFT Office, joint NHS Trust undergraduate education committees have increased service coordination, quality enhancement and allowed some understanding of value for money. The EMEAs and Top Teacher awards, coordinated by the QAU, are much appreciated by teaching and administrative staff. We are actively seeking ways to help students feel they really do have a voice. We would like to be able to close the loop more effectively – enhancing not just monitoring – but this depends on focussing data collection and a more effective module management structure. We aspire to making monitoring and regulation forces for good by using funding to influence and reward quality. In addition to our awards system we are piloting a Targeted Educational Development and Innovation Fund that we hope will be adopted by the Faculty as a whole through recurrent funding. In addition to annual reports to the GMC and college QMEC, we now also provide an annual report to NHS London. Tomorrow’s Doctors 2009 requires us to start gathering feedback from patients and NHS employers. Currently the greatest challenges to quality assurance are the increased regulatory demands which are in need rationalising, and the lack of alignment between the College, the GMC and the NHS (the major funder). (See written response to the Council for Healthcare Regulatory Excellence.) 3.6 Resources Human resources & staff development The programme depends on its academic and clinical faculty, which is generally of the highest quality and is supported by committed Medical School and local leadership, and excellent administrators. The TIPS programme has been very popular but current funding arrangements (through SIFT) are coming to an end and we see this as an opportunity to refocus on enhancing the student experience and intellectual development. ACME, Medical Student Administration and the QA Unit actively promote peer observation of academics in accordance with College QMEC but this remains the responsibility of the academic’s host Division. We are examining ways of retaining and recognising academics and clinicians with an interest in medical education, especially in programme design and leadership. This is a particular challenge in the life sciences. Aspects to address include resolving issues with UCL HR related to the appointment of honorary senior lecturers and developing new appointment and promotion criteria. The performance enhancement process being developed within FBS will enable us to value and recognise educational contributions better. This a good time to review our staff development provision to ensure that teacher training directly sustains our vision for the curriculum, engages with clinical teachers and complements other initiatives such as postgraduate, supervisor development in the NHS. The administrative support required for a stable programme is somewhat different to SES IQR MBBS 2010 26 of 29 that which we will now need in order to sustain a dynamic curriculum that will have to adapt continually to complex external requirements. We are concerned that such an approach to administration is not the norm in higher education institutions and is especially challenging in the current financial climate. We are aware that there are perceived difficulties amongst the academic teaching staff in gaining recognition and achieving academic promotion. Learning resources & funding SLMS and MBBS have established a Facilities and Resources Committees (FRC) to ensure current and future needs are met, based on a Facilities Management Plan which will provide regular review of the fitness for purpose of the facilities. Students report good levels of satisfaction with resources and access to IT in College and NHS sites. The clinical skills centres are highly valued, but the continuity of SIFT funding remains unclear until the MPET review is implemented. Progress on best practice in teaching methods will depend on identifying suitable space, particularly for small group and computer-assisted learning. Annual Monitoring reports have repeatedly identified quality and quantity of teaching space as a major challenge, which is exacerbated by issues related to room booking systems. We await the outcome of the Space Utilisation Study for the core campus commissioned by the Provost. The instability of the NHS settings (with undecided service changes) poses opportunities and risk to clinical attachments, and a probable increase in community-based learning opportunities. For clinical attachments to remain viable, students need accommodation and NHS Smartcards (which allow access to patient records). If there is a loss of residential accommodation at the DGHs, students will be faced with hefty travel expenses or accommodation costs and it is unclear how we will be able to address this. UCL have asked the London medical deans to look at the issue of smartcards. Challenges to resources at NHS sites are compounded by the fact that most NHS Trusts in London have not signed the new Learning Development Agreement (that itemises their obligations to the Medical School) due to concerns about the redistribution of funds that will follow the MPET review. (UCLH currently receives approx £90,000 per FTE, where many DGHs and GP teachers receive less than £10,000; the proposed universal tariff will be around £40,000 per FTE). We understand previous SLAs (Service Level Agreements) are extant and legally valid, and will be applied in good faith. 3.7 Additional Areas of Good Practice Internationalisation Students are exposed to an internationalised curriculum and global health primarily through their medical electives (described in Section 1). All aspects of the preparation and support for these exceed Gold Book requirements. In addition to electives, all students participate in a global health seminar during the pubic health teaching in the Child and Family Health module. The Institute of Child Health offers a popular SSC in global health, linked to specific electives in developing or intermediate countries, as well as an oversubscribed iBSc. After a 5 year moratorium (due overcrowding) the Medical School has begun to welcome up to 40 students annually from aboard to undertake elective periods at UCL and associated sites, and who study alongside our students. Peer tutoring The Medical School is proud of the range of peer-to-peer and near-peer tutoring opportunities that is based around the PALs (Peer Assisted Learning SSC). In addition to participating in the Introductory Course for Clinical Medicine, peer tutors support science modules in Phase 1, and UCL graduates frequently teach students at the DGHs at which they are undertaking their foundation programme. 3.8. Summary – Change and Opportunity In summary, the MBBS programme at UCL remains a popular choice amongst applicants, and its graduates are a credit to the Institution. Students are satisfied with their experience overall, but tell us there are clear areas for development. While there is evidence of outstanding practice, there are other aspects that are in need of refreshment to satisfy our informed and diverse students. In addition, the dynamic nature of medical practice and health care provision compel us to adapt the programme and adopt a flexible, change-oriented approach to curriculum design, pedagogy and management. Many of the necessary developments are ours to make in FBS, however some depend on factors within the College such as facilities, human resources and support services. Others are determined by external forces SES IQR MBBS 2010 27 of 29 such as the requirement to retain our GMC licence and therefore comply fully with its recommendations. The NHS, especially in London, is in a state of flux presenting us with potential opportunities while stretching our foresight, decision making and risk tolerance. This means the leaders of the MBBS programme are tasked with reconciling a range of disparate priorities and negotiating with many bodies with diverse agendas and modi operandi in order to offer our students the highest quality education. Those who teach and learn medicine are living in interesting times - we hope we will be able to ensure UCL is in a position to seize fully the opportunities now before us. SES IQR MBBS 2010 28 of 29 MBBS IQR Document Register (http://www.ucl.ac.uk/medicalschool/quality/priv) 0910 MBBS Leadership PAs and Medical Student Admin for IQR 2008 FBS Teaching & Learning Strategy Clinical Providers for UCL medical students Community Based Teaching Standards Medical School & Community Based Teacher 2009-10 Draft Summary Report MBBS Review 2009 Feedback to CRAS Guide for Examiners Guide to Medical School MBBS Administration Guidelines for PDS Tutors Learning and Developmental Agreement between NHS London & Health Service Bodies Letter of Agreement between Medical School and Community Based Undergraduate Teaching 09-10 Letter of Agreement between Medical School and Small Providers of Undergraduate Teaching 09-10 Library Questionnaire LSO Briefing MBBS Student input and feedback (IQR) Medical School Examination Boards Programme specification Service Level Agreement between NHS London and UCLMS SSO Briefing Standard Tripartite Service Level Agreement- NHS London Medical School-NHS body 08-09 Targeted_Education_Development_and_Intervention_Fund_Final Widening participation in the MBBS programme Written response to the Council for Healthcare Regulatory Excellence UCLMS Glossary IQR 2010 SES IQR MBBS 2010 29 of 29