2012 Situational Judgement and WMS Curriculum By Frances Varian Third Year Medical Student 20/04/2012 Contents 1. Introduction ………………………………………………………………………………………………… 2 2. Summary and Recommendations ..………………………………………………………….…… 2 3. Advantages and Disadvantages of SJTs……………………………..…………..………. ………. 3 4. Recommendations for Present Curriculum ……………………………………………………… 4 5. Recommendations for New Curriculum……………………………………………………………. 5 6. Conclusion ……………………………………………………………………………………………………… 7 7. References ……………………………………………………………………………………………………… 7 8. Appendix A: the SJT domains………………………………………………………………………….....8 9. Appendix B: Phase II Student Handbook…..………………………………………………………12 10. Appendix C: Phase I Situational Judgement material………………………………………..24 1 1. Introduction As of 2013, the SJT has replaced the ‘white-space’ application process as the preferred method of assessment into the UK Foundation programme. This comprises 50% of the total application, with the other 50% from academic achievement. SJTs are a type of psychological aptitude test also known as ‘professional dilemmas’. Foundation applicants are presented with a variety of hypothetical situations likely to be encountered on the job. Accompanying each situation are multiple ways to respond to the scenario. The test taker is then asked to make judgements about the possible courses of action; either ranking five responses from most appropriate to least appropriate, or by choosing the three most suitable choices from a list of eight options. Answers are then marked according to a pre-determined scoring key. SJT selection in postgraduate medical training was introduced nationally in 2007 for short-listing candidates at stage 2 of GP recruitment. Here, three ‘non-clinical’ domains: empathy, integrity and coping with pressure, are considered in combination with a clinical problem-solving test. So far, these methods have proved widely successful (Work Psychology Group 2009). This report looks at what opportunities are presented by the introduction of SJTs for the WMS curriculum – both in its current form and for the revised 2013 curriculum. 2. Summary of Recommendations Key points about Situational Judgement Tests (SJT) for curriculum review: SJT domains pin down behaviours outlined by Tomorrow’s Doctors SJTs are a valid way of assessing Non-Technical Skills (NTS) NTS are weighted of equal importance to academic achievement in the Foundation Programme selection process NTS are areas where students can struggle and should be supported as such SJTs are a useful way to reiterate the importance of NTS to students SJTs give an opportunity to evaluate how well we are preparing students for practice What the SJT can do for WMS in a wider context: Highlight to the GMC where we are additionally teaching and assessing NTS Target key areas of assessment within the horizontal teaching themes Offer a proven way to assess (formatively) students’ knowledge of NTS 2 Provide material for personal tutors and clinical educational supervisors to actively engage with their students beyond a pastoral role. Opportunity to promote to prospective applicants how effectively we prepare students for practice. Recommendations: Use the SJTs as a mechanism for evaluating key learning points on professionalism, for example managing own health and challenging prior knowledge Use the SJT to draw out professional values from the perspective of the medical student, potentially introducing a system for recording and reflecting on mistakes Use case-based learning to consider prioritisation in more detail; for example, listing investigations in order of urgency Consider actors for scenarios beyond patient relationships: angry relative, distressed colleague Encourage students to communicate and work together as a multi-disciplinary team through scripted group-based scenarios Utilise personal tutors to encourage discussions concerning NTS Concentrate a few sessions on explaining diagnosis and management to relatives Ask FY1’s to feed into the case work to recall what they would manage in a particular scenario, who they would call for help and when. This will engage students in understanding the limitations of the FY1 role. 3. Advantages and Disadvantages of SJTs The increasing popularity of SJTs are attributable to the wealth of research supporting this selection method. The advantages of which include (Weekly & Ployhart 2005; De Meijer & Born 2009): Validity akin to cognitive ability testing Face validity – ie relevant to the job. This is useful for candidates as well as employers to provide a realistic preview of the proposed role. Incremental validity of selection above cognitive and personality testing Unique, multidimensional assessment of performance not captured by other methods Less adverse impact on ethnic minority groups Easier to score than other types of assessment such as the situational interview and hence, can be implemented into large-scale testing programmes 3 However, as with any selection process there are drawbacks. In terms of SJT, the disadvantages include: Variety of performance predictors: unclear as to what they actually measure Multidimensional: difficulties developing scenarios to measure one particular construct Assumes past behaviour can predict future response to a similar situation Debate over whether they are ‘fakable’ Designing an effective selection system requires thorough analysis of the knowledge, skills, attitudes and personal qualities needed to be successful in that role. With respect to foundation selection, the ISFP (Improving Selection to Foundation Programme) developed nine domains of assessment for UKFPO (United Kingdom Foundation Programme Office) application (Patterson et al 2010): Commitment to Professionalism Learning and Professional Development Working effectively as part of a team Patient Focus Problem solving and decision-making Self-awareness and insight Coping with pressure Organisation and planning Effective communication These domains are discussed in detail in Appendix A. In order to get around the debate concerning ‘fakability’ of SJT (Nguyen, Biderman & McDaniel 2005), the ISFP have introduced answers to ‘should’ rather than what you ‘would’ do, assuming that intentions are related to knowledge. More implicitly than this, they use the SJT to measure those ‘non-technical skills’ (NTS) expected of a junior doctor. 4. Recommendations for Present Curriculum WMS can further develop students’ non-technical skills through situational judgement. Given my involvement in the integration of SJT material into the current curriculum, my experiences as a student and through my participation in the student support committee and curriculum review meetings, the following material has been developed for integration: 4 Phase II: - Student workbook (Appendix B): incorporating reading list, interviews with FY1s to carry out (1 per block), observations to carry out, own scenarios to collect (2 per block) to be discussed with clinical educational supervisor (CES) - (Collected examples could then be used to feed in to the early years.) - 4 teaching sessions to be delivered by CES: 1 per block in senior rotation - Students to work through online SJT examples in Acute, Obs and Gynae, Child Health and Medicine blocks. Phase I: - Reworked ‘Becoming a Professional’ section of clinical skills 2 handbook to incorporate SJT domains and scenarios. These scenarios are all challenges a medical student may encounter on the wards and loosely cover each domain. - Scenarios to be discussed with their personal tutor group before the answers go up online (Appendix C). 5. Recommendations for New Curriculum Commitment to Professionalism: Although professionalism is a horizontal theme in which values and ethics features heavily, there are other aspects less well-approached. Owning up to mistakes is something that medical students should be doing. I think there should be a system for recording and reflecting when students make mistakes as this is what you have to do in practice. Also, responsibility for health is something that the personal tutors can draw out. I feel the tutoring system is presently there for ‘struggling’ students when really students should recognise their limitations before they get to that stage. Relating examples such as this within an SJT-style scenario should draw out such learning points as part of professionalism. Finally, learning to challenge knowledge and speak up is definitely something that could be better drawn out, particularly in the early years. The SJT can utilise these issues and get students engaging in the values now rather than values they think they need in four years’ time. I think the message of the ‘professional medical student’ is key to bring out. Coping with pressure: I have to be honest and I don’t think this is taught well in the current curriculum. Whilst students manage the pressure of a heavy workload, the pressures of multitasking and prioritising required on the wards are very different. There is a real opportunity to 5 work on this through case-based teaching; investigations and management should be put into context. I think this is something that should be brought into the complex, advanced cases in year two. Consider having a list of investigations for different patients and ask student to prioritise them: e.g. you are on a respiratory ward with x,y, and z, how do you proceed? Another source of pressure comes from difficult patients and colleagues. In this respect the SJT can be useful for discussion as well as assessment. I would also suggest WMS consider actors presenting as an angry relative or distressed colleague. This would be a great way of preparing students for life on the wards beyond patient relationships. Effective communication: I think communication – particularly with patients – is very well taught at Warwick. Record-keeping is also mentioned, however it would be good for students to practice filling in the forms they need eg death certificate. What I feel could be brought out more is negotiating with colleagues. As mentioned, an actor could be brought in to do this. You should also consider having a ‘script’ with a profile for each part. One example might be a patient complaint. In groups you could have one person playing a difficult colleague, the other a doctor and one the patient. You can therefore practice relaying difficult information from the patient to your colleague diplomatically. Teamwork and communication are integral to your job as a doctor, yet the difficulties associated with this have yet to be properly addressed. Organisation and Planning: prioritisation is something that can be incorporated into coping with pressure. There are also various techniques that students can use to prioritise their workload and perhaps this theory is something that the personal tutors could work on with the students together with an SJT scenario? Patient focus: I feel this is the domain that is best approached at Warwick. What perhaps is not as clear however is the amount of focus on patient’s relatives. From interviews on the wards, it is clear that most complaints come from relatives, as do breaches of confidentiality. I think it would be important to concentrate some sessions around explaining diagnosis and management to relatives – either because the patient cannot consent, or because they have asked you to explain it. Again these issues can be drawn out using SJT examples. Problem-solving: This is about taking initiative and seeking help. What I feel could be better at Warwick is drawing out what you would deal with yourself as an FY1 and what you would realistically call for help with. It would be nice to have a greater sense of your limitations before you start the role. This could easily be drawn out in case-based discussion alongside clinical 6 knowledge. Knowing the expectations of an FY1 in each scenario would be useful. You could quite feasibly ask a group of FY1’s to feed into your case work and have them say what they would and wouldn’t do for the steps in management and when they would call for help. Self-awareness and Insight: Reflection has already been mentioned to be included in the eportfolio. Beyond this, ‘boundaries and limitations’ are part of self-awareness and this is more difficult to teach. Nevertheless, understanding roughly where the limits of an FY1 lie will give students valuable insight into the role they will be doing. This also builds into teamwork and knowing your roles and responsibilities. Bringing in this information earlier will mean that students look out for it more on the wards because they have greater awareness of the NTS they need as well as the clinical skills. Teamwork: I have mentioned this in communication but I really think there could be more emphasis on teamwork in the curriculum. The personal tutors can really be utilised in this respect, drawing upon discussions about difficult or struggling colleagues. See Appendix C as examples of this from the current phase I material. 6. Conclusion SJT are a fantastic and fun way to get students engaged in NTS. We should however, in all cases, make these skills EXPLICIT to students. Students like to know the fundamentals behind their learning in juxtaposition to the expectations of an FY1. Ultimately it’s about preparing medical students for a job and the SJT really adds value in that respect. 7. References De Meijer, L.A.L. & Born, M. Ph (2009). The situational judgement test: Advantages and disadvantages. In M. Born, C.D. Foxcroft & R. Butter (Eds.), Online Readings in Testing and Assessment, International Test Commission available from: http://www.intestcom.org/Publications/ORTA.php Ngyen, N.T. Biderman, M.D. McDaniel, M.A. “Effects of Response Instructions on Faking a Situational Judgement Test” Int. J. of Selection and Assessment. Vol 13 (4): 250-260 Patterson, F. et al (2010) Improving Selection to Foundation Programme Final Report Appendix D: FY1 Job Analysis. Work Psychology Group and University of Cambridge; pp 126-240 Weekly, JA and Ployhart, R.E. (2005) Situational judgment tests: theory, measurement and application. Lawrence Erlbaum Assoc Inc, New York. 7 Work Psychology Group (2009) Evaluation of situational judgement tests to select postgraduate trainees: validation studies in two specialties [pdf] available from: http://www.workpsychologygroup.com/assets/Library/Library-SJTs-to-select-postgrauatetrainees-AMEE.pdf Frances Varian 19/04/2012 f.l.varian@warwick.ac.uk 8 Appendix A The domain descriptors: definition of the attributes and behaviours expected of an FY1. 1. Commitment to Professionalism Definition Behaviours Displays honesty, integrity and awareness of confidentiality & ethical issues. Is trustworthy and reliable. Demonstrates commitment and enthusiasm for role. Willing to challenge unacceptable behaviour or behaviour that threatens patient safety, when appropriate. Takes responsibility for own actions. Is punctual Takes responsibility for own actions/ work Owns up to mistakes Takes responsibility for own health and well‐being Demonstrates commitment to and enthusiasm/motivation for role Understands/is aware of the responsibility of the role of being a doctor Is reliable Displays honesty towards others (colleagues and patients) Trustworthy Identifies/challenges unacceptable/ unsafe behaviour/situations when appropriate (colleague/organisational issues) Challenges others knowledge where appropriate Understands/demonstrates awareness of ethical issues, including confidentiality 2. Coping with Pressure Definition Capability to work under pressure and remain resilient. Demonstrates ability to adapt to changing circumstances and manage uncertainty. Remains calm when faced with confrontation. Develops and employs appropriate coping strategies and demonstrates judgement under pressure. Behaviours Remains calm and in control of situations Manages uncertainty/ambiguity Effectively deals with outcomes of mistakes/decisions Exhibits flexibility/adaptability when dealing with changing circumstance or issues Employs effective coping mechanisms for dealing with stress/emotions Demonstrates good judgement under pressure Does not give up easily Deals appropriately with confrontational/difficult situations (colleagues/patients) Seeks support when faced with stress/pressure 3. Effective Communication Definition Actively and clearly engages patients and colleagues in equal/open dialogue. Demonstrates active listening. Communicates verbal and written information concisely and with Behaviours General Listens effectively Ensures surroundings are appropriate when communicating Understands/responds to non-verbal cues Uses non‐verbal communication effectively 9 clarity. Adapts style of communication according to individual needs and context. Able to negotiate with colleagues & patients effectively. With Patients Uses language that is understood by patients/relatives and free from medical jargon Demonstrates sensitive use of language Communicates information to patients clearly and concisely Adjusts style of communication according to patient’s/relative’s needs Adjusts how much information to provide according to patient’s/relative’s needs Provides information to patients and keeps them updated Readily answers patient’s and relative’s questions Ensures has all the relevant information before communicating to patients/colleagues Asks questions/seeks clarification to gain more information /understanding about the patient Finds out patient’s/relative’s level of knowledge/understanding Allows patients/relatives to ask questions/uses silence effectively Checks patient’s/relative’s understanding Summarises information/reflects back to patients to clarify their own understanding With colleagues Asks questions of colleagues to gain more information Provides/summarises information accurately and concisely to colleagues Provides only relevant information to colleagues Keeps colleagues informed/updated (about patients and about where they will be) Is able to negotiate/use diplomacy Knows exactly what are asking for and why Is assertive where necessary Adapts style of communication according to need and situation Clarifies information to check their own understanding Written Displays high standards of written communication Uses concise and clear written communication Has legible handwriting 4. Learning and Professional Development Definition Behaviours Demonstrates desire and enthusiasm for continued learning, takes responsibility for own development. Willing to learn from others and from experience. Is open and accepting of feedback. Demonstrates a desire and enthusiasm to learn and improve Is willing to learn from others Keeps up to date with knowledge Is willing to learn outside of work through reading around subject/access to internet Learns from previous experiences Learns from mistakes Takes responsibility for own learning 10 Demonstrates a desire and willingness to teach others. Is open to and accepts of feedback Is willing to teach others 5. Organisation and Planning Definition Behaviours Manages and plans workload effectively, displaying efficient time management and delivering tasks on time. Able to prioritise effectively and re‐prioritise where appropriate. Is conscientious and maintains accurate records. Demonstrates effective time management Prioritises tasks effectively Manages and plans workload/tasks Checks tasks are complete/follows up tasks Maintains accurate records 6. Patient Focus Definition Behaviours Ensures patient is the focus of care. Demonstrates understanding and appreciation of the needs of all patients, showing respect at all times. Takes time to build relationships with patients, demonstrating courtesy, empathy and compassion. Works in partnership with patients about their care. Able to gain trust from patients/instil confidence Is empathetic towards patients Is able to maintain appropriate distance from patients/ relatives Is willing to make self available to patients (for support/provide continuity/get to know them) Understands/considers the differing needs of patients Recognises that patients have different backgrounds/values/ beliefs Shows respect for patients Works jointly with the patient about their care Recognises the patient as the centre of care Shows a genuine interest in patients Shows compassion towards patients/relatives Is willing to spend time with relatives Builds rapport with patients Is polite, courteous and presents an open manner when dealing with patients Provides reassurance to patients Considers patient’s safety at all times 7. Problem-solving and decision-making Definition Demonstrates an ability to assimilate a range of information and identify key issues. Engages with the wider issues and thinks creatively to solve problems and reach appropriate decisions. Is proactive and demonstrates initiative. Is able to attend to detail. Behaviours Makes appropriate decisions based on all the relevant information Demonstrates ability to use own initiative Able to assimilate and integrate information effectively Understands problems from a wider perspective/takes into account whole picture Demonstrates good attention to detail Is proactive; takes charge of a situation and makes things happen 11 8. Self-Awareness and Insight Definition Behaviours Demonstrates awareness of the boundaries of their own competence and willing to seek help when required, recognising that this is not a weakness. Exhibits appropriate level of confidence and accepts challenges to own knowledge Is willing to seek help when needed Able to say no when faced with a situation/task they are not comfortable with/admit that they don’t know Accepts that asking for help is not a weakness Recognises boundaries/limitations of own competence Displays appropriate level of confidence in self/own ability Accepts challenges to own knowledge Accepts mistakes will be made 9. Working Effectively as Part of a Team Definition Capability & willingness to work effectively in partnership with others and in multi‐disciplinary teams. Demonstrates a facilitative, collaborative approach, respecting others’ views. Offers support and advice, sharing tasks appropriately. Demonstrates an understanding of own and others’ roles within the team and consults with others where appropriate Behaviours a recognition of others’ knowledge/skills/abilities/roles/ responsibilities Able to identify and utilise the most appropriate person for a task/situation Aware of own role/responsibilities within team Builds rapport and establishes relationships with other team members Supports others (in a non‐task related way Is willing to offer assistance with tasks/workload Is willing to offer/provide advice Values other people’s opinions and contributions Shows respect for colleagues Delegates and shares tasks effectively Maintains harmony within the team Identifies when others are in difficulty/are struggling Able to take on board team members’ perspectives Able to adapt role within team where necessary i.e. take on role of leader Shares knowledge and expertise with colleagues Is willing to take direction from others Consults with others and asks for advice Makes others aware of own workload 12 Student Workbook: Improving Your Situational Judgement Name …………………………………………………………. By Frances Varian and Lara Cartwright Contents Introduction …………………………………………………………………………… 3 Using this workbook ……………………………………………………………… 5 Task 1: Preparation ..…………………………………………………………….. 6 Useful references ………………………………………………………. 9 Task 2: Interviewing……………………………………………………………… 10 Task 3: Observation……………………………………………………………….. 18 Task 4: Recording Examples.………………………………………………….. 19 Introduction The selection process for the UK Foundation Programme has changed as of 2013. Instead of essay-style questions on an application form, final year medical students will sit a 2 hour 20 minute assessment of 70 items based on clinical scenarios encountered as a junior doctor, known as Situational Judgement tests (SJT). This counts for 50 points in total – 50% of your application What areas does an SJT cover? Commitment to Professionalism Learning and Professional Development Working effectively as part of a team Patient Focus Problem solving and decision-making Self-awareness and insight Coping with pressure Organisation and planning Effective communication What will an SJT question look like? You are looking after Mr Kucera who has previously been treated for prostate carcinoma. Preliminary investigations are strongly suggestive of a recurrence. As you finish taking blood from a neighbouring patient, Mr Kucera leans across and says “tell me honestly, is my cancer back?” Rank in order the following actions in response to this situation (1= Most appropriate; 5= Least appropriate). A Explain to Mr Kucera that it is likely that his cancer has come back B Reassure Mr Kucera that he will be fine C Explain to Mr Kucera that you do not have all the test results, but you will speak to him as soon as you do D Inform Mr Kucera that you will chase up the results of his tests and ask one of your senior colleagues to discuss them with him E Invite Mr Kucera to join you and a senior nurse in a quiet room, get a colleague to hold your ‘bleep’ then explore his fears Answer:DCEAB It is not a FY1’s responsibility to break bad news to a patient and the full results are not available yet. It would be most appropriate for a senior colleague to speak to Mr Kucera with regards his diagnosis. Informing Mr Kucera that you will speak to him as soon as you get the test results back would still be appropriate as you are giving him some information, although this may not necessarily mean that you would be providing him with the diagnosis. It may be appropriate to discuss Mr Kucera’s fears with him, but by doing this you may not be attending to other ill patients and are asking a colleague to take on your responsibility by holding your bleep. It may also become a difficult conversation when you do not have full details of the results. It would not necessarily be appropriate to tell Mr Kucera that his cancer is back as this has not been confirmed; however it would be inappropriate to provide false hope to a patient when preliminary investigations are strongly suggestive of a recurrence. This examples is from the Improving Selection to the Foundation Programme (ISFP). For more examples see: http://www.isfp.org.uk/SJT/Pages/Example-questions.aspx 1 How to use this Workbook This workbook enables you to use your clinical blocks to most effectively prepare for the SJT. Feel free to dip in an out but you will get the most benefit from systematically working through it as follows: Task 1: take time to understand the definitions for the areas covered by the SJT on pages 6 to 8. Use the references on page 8 to read more widely around the domains, or revisit them when things crop up on the wards. Task 2: Interview an FY1 on the ward – there are four templates in this workbook so try to get one example per block Task 3: Carry out practical observations to increase your knowledge in these areas. These include the types of scenarios that you will be asked about in the SJT. Task 4: Use this workbook to record your own examples either through interview or observation. Aim to complete two examples per block. If you keep in the back of your mind you need to evaluate ‘non-technical’ skills, scenarios will start popping out at you without too much effort. Bring this workbook with completed examples to your scheduled meeting with your Clinical Educational Supervisor to discuss with your group. 2 Preparation The following nine domains are used as the basis for assessment in the SJT which is designed to evaluate your nontechnical skills. Commitment to professionalism Displays honesty, integrity and awareness of confidentiality & ethical issues. Is trustworthy and reliable. Demonstrates commitment and enthusiasm for role. Willing to challenge unacceptable behaviour or behaviour that threatens patient safety, when appropriate. Takes responsibility for own actions Learning and Professionalism Demonstrates desire and enthusiasm for continued learning, takes responsibility for own development. Willing to learn from others and from experience. Is open and accepting of feedback. Demonstrates a desire and willingness to teach others Coping with pressure Capability to work under pressure and remain resilient. Adapt to changing circumstances and manage uncertainty. Remains calm when faced with confrontation. Develops and employs appropriate coping strategies demonstrates judgement under pressure Organisation and planning Manages and plans workload effectively, displaying efficient time management and delivering tasks on time. Able to prioritise effectively and re‐prioritise where appropriate. Is conscientious and maintains accurate records Self-awareness and insight Demonstrates awareness of the boundaries of their own competence and willing to seek help when required, recognising that this is not a weakness. Exhibits appropriate level of confidence and accepts challenges to own knowledge. Effective Communication Actively and clearly engages patients and colleagues in equal/open dialogue. Demonstrates active listening. Communicates verbal and written information concisely and with clarity. Adapts style of communication according to individual needs and context. Able to negotiate with colleagues & patients effectively Problem-Solving and decision-making Demonstrates an ability to assimilate a range of information and identify key issues. Engages with the wider issues and thinks creatively to solve problems and reach appropriate decisions. Is proactive and demonstrates initiative. Is able to attend to detail. 3 Patient Focus Ensures patient is the focus of care. Demonstrates understanding and appreciation of the needs of all patients, showing respect at all times. Takes time to build relationships with patients, demonstrating courtesy, empathy and compassion. Works in partnership with patients about their care Working effectively as part of a team 1. 2. Capability & willingness to work effectively in partnership with others and in multi‐disciplinary teams. Demonstrates a facilitative, collaborative approach, respecting others’ views. Offers support and advice, sharing tasks appropriately. Demonstrates an understanding of own and others’ roles within the team and consults with others where appropriate Useful References BMA on social networking tips: http://www.bma.org.uk/images/socialmediaguidance_tcm41-206859.pdf Doctors in difficulty - read about some scenarios (particularly the “first times” section) and ways to deal with them: http://www.bma.org.uk/doctors_health/index.jsp Good Practice: Surviving Sepsis Video: http://www.chfg.org/articles-films-guides/surviving-sepsis-a-humanfactors-based-approach GMC ‘Tomorrow’s Doctors’ (pp 7-25): http://www.gmcuk.org/education/undergraduate/tomorrows_doctors_2009.asp GMC: Good Medical Practice in Action - elearning interactive case-studies: http://www.gmcuk.org/guidance/case_studies.asp National Patient Safety Agency: http://www.nrls.npsa.nhs.uk/resources/patient-safety-topics/human-factorspatient-safety-culture/ Patient Safety First: http://www.patientsafetyfirst.nhs.uk/Content.aspx?path=/interventions/Leadership/ SBAR e-learning tool http://www.nottingham.ac.uk/nmp/sonet/rlos/patientsafety/sbar/ SJT Examples: http://www.isfp.org.uk/SJT/Pages/Example-questions.aspx If you want to read about some ‘Never’ incidents: http://www.chfg.org/wp-content/uploads/2012/03/NeverEvents-final2-1.pdf 4 Task 2: Interviewing Ask an FY1 about the following …. Commitment to Professionalism: Where have you seen confidentiality being compromised? Have you ever had to challenge inappropriate behaviour? Learning and development: How do you build up your CV? What tips would you give? What ‘teaching’ do you have as an FY1? Coping with pressure: What pressures do you find yourself under? Have you ever made a mistake? What did you do about it? Have you ever experienced a confrontational situation? Who do you turn to when you need help? Team working: Have you ever had difficulties with a colleague? What were they? Find out the roles of other team members on the ward – including administrative staff. 5 Task 3: Observation (tick the boxes when completed) Organisation and planning: Look at how the jobs are prioritised after a ward round. Go with an F1 to the coroners and witness death certificate procedure. Effective Communication: Recognise good communication and bad communication at every opportunity Listen to a referral and practice the SBAR approach with your clinical partner Go with a doctor to see how they negotiate a scan for radiology Patient Focus: Observe times where patient concerns and views are integrated into management Observe the options given to patients about their treatment. What did you learn about their needs? Notes…… 6 Task 4: Build your own scenarios 1. 2. 3. 4. 5. Try to fill in two per block … Identify the judgement area that the scenario most closely relates to Describe the situation Analyse what the dilemma was and why Explain what the doctor did Find out what the doctor should have done, either use references to answer this section or just ask them – they should have learned from the situation 6. Reflect on this scenario to understand what you learned from it 7. Bring any completed scenarios that you are not completely confident about to discuss with your educational supervisor. Example Template Judgement Area: Commitment to professionalism Situation: Doctor was needed on the ward but also had teaching scheduled. Dilemma: Patient care comes first but also responsible for own learning. How urgent are the tasks on the ward? How essential is it that they attend the teaching? Can they rely on my colleagues to get the relevant information for me if they cannot get away? What the doctor did: Got very stressed about the fact they had to be two places at once. What should the doctor have done: Analysed calmly the dilemma and weighed positives and negatives of going to teaching or not before acting on their decision. Doctor decided to stay on the ward and asked colleague to make notes for them as otherwise they would be delayed at work for too long. Reflection: I learned that you should always try to meet your commitment to attend teaching but that patient care comes first; hence there may be times where you have to compromise and sacrifice your own learning. 7 Judgement Area: Situation: Dilemma: What the doctor did: What should the doctor have done? Reflection: 8 Taking into account your experiences, the 9 domains and SJT exercises online; reflect on the following areas and consider: What have you learned about yourself? Did your judgement differ to what you should do? How? Why were there differences? How will you work on this? Professionalism: Pressure: Communication: Organisation and planning: Learning and personal development: Patient focus: Problem-solving and decision-making: Team-work: Self-awareness and insight: 9 Feedback Please tick one box for each of the following… 1. The interviews helped me to think about the role of an FY1. Strongly Disagree 2. Disagree Neutral Agree Strongly Agree Disagree Neutral Agree Strongly Agree Fair Good Very good Excellent The teaching with my educational supervisor overall was: Poor 6. Strongly Agree The online examples available for SJT preparation overall were: Poor 5. Agree Developing my own scenarios helped me evaluate situations for the SJT. Strongly Disagree 4. Neutral The observations helped me to identify with the role of an FY1. Strongly Disagree 3. Disagree Fair Good Very good Excellent My impression of preparation for the SJT overall is: Poor Fair Good Very good Excellent Additional Comments (on improvements or anything particularly good) … 10 Appendix C: Phase 1 Situational Judgement Material Q1. You return home after a long day in the hospital. You log on to Facebook and see that you have a friend request from a patient you interviewed and examined for a portfolio that day. You remember them being a similar age to you. What should you do? Rank these responses from most appropriate (=1) to least appropriate (=5) A. B. C. D. Accept the request and maintain a friendly relationship with the patient Ignore the request Decline the request and explain to them why you cannot be friends Accept the request but alter your privacy settings so they can’t see anything on your profile E. Accept the request and then remove them as a friend later on Domain How the question assesses the domain. Commitment to Professionalism Understands ethical issues of confidentiality and maintaining professional boundaries Deals with difficult situations involving patients, demonstrates good judgement Communicates information to patient appropriately Maintains an appropriate distance from patients, is polite to patients Able to say no to a situation Makes appropriate decision about problem Coping with pressure Effective communication Patient Focus Self-awareness and insight Problem solving and decision-making Answer: CBDEA C is the most appropriate option. You should never accept friend requests from patients. You should explain that you have a duty to uphold a professional relationship. The patient will understand this and should respect that boundary. B is the next most appropriate response as this is preferable to accepting a friend request. You are not under any obligation to explain yourself to the patient – but it is polite to do so. A, D and E are not appropriate as you should not accept friend requests from a patient – no matter how close to your age they are. This is crossing a professional boundary which is there for good reason. The option of altering your privacy settings towards them however is more tempting than E or A. A is the least appropriate option of these as establishing a friendly relationship with a former patient – regardless of whether you are a medical student – is wholly inappropriate. Reference: BMA (no date) Using social media: practical and ethical guidance for doctors and medical students [pdf] available from: http://www.bma.org.uk/images/socialmediaguidance_tcm41-206859.pdf 11 Q2: You are on the medical ward and asked by the junior doctor to put in a cannula. You try three times in one arm and fail to get one in. What should you do? Choose the 3 most appropriate options from the following list? A. B. C. D. E. F. G. H. Ask your clinical partner to have a go Try the other arm to see if you can get it in Tell the junior doctor that you couldn’t do it Don’t say anything and wait until the FY1 asks you about it Ask one of the nurses to do it Ask the patient whether they are OK for you to keep trying Fill your attempts on the cannula pathway form Leave the ward before the FY1 can ask you about it Domain How the question assesses the domain. Commitment to Professionalism Learning and development, self-awareness and insight Problem solving and decision-making, Organisation and planning Take responsibility for cannulation, reliable, honest about not doing it Remains calm in front of patient, knows when to give up, adapts to situation, seeks support when under pressure Relays problem with task to others Ensures that patient gets cannula as IV access will be necessary of their care Willing to learn from clinical partner, aware that should stop at three attempts Makes appropriate decision to delegate task Maintain accurate cannula pathway records Working effectively as part of a team Delegates to colleague and lets junior know Coping with pressure Effective communication Patient Focus Answer: ACG A is appropriate as your clinical partner should gain experience as well as yourself – you are both learning. You might even learn something from them. C is appropriate as you should let your junior know that you couldn’t get the cannula in – it may be a particularly difficult patient in which case they can give you reassurance that you will do it next time. G is appropriate as it is best practice to fill in one of these forms – including all the sites that you attempted. The form is usually pink but you can ask any of the nurses at your trust. B is not appropriate as you should not try venepuncture or cannulation after three failed attempts – you should let someone else have a go. D and H are not appropriate as it is your responsibility to let the junior know you have had problems cannulating a patient. If you don’t they may forget to ask, or assume that you did it and the patient may not receive their medications as they are supposed to. Some drugs need to be delivered at specific times and you not putting in the cannula and delaying telling someone could compromise their care. E is not appropriate as only some nurses are trained in cannulation. Moreover, they have their own jobs to do. This is typically a junior’s job – or a trained medical student! 12 Q3. You are in clinic. You consultant has asked you to take a history from a new patient. He directs you to a different side room. Your clinical partner volunteers to take the history. Whilst you are watching them you notice that they are sitting with their arms crossed and mutter ‘ah ha’ so much that the patient is clearly unsettled. You wonder whether they have listened to anything the patient has said at all. What should you do? Rank the following responses from most appropriate to least appropriate A. B. C. D. Ask them to summarise their findings to you before you see your consultant Tell the consultant that you think the history-taking was very poor Apologise to the patient for their behaviour Give your clinical partner feedback on the consultation, drawing on the good and bad points E. Ask your clinical partner what they think went well and could be improved on Domain How the question assesses the domain. Commitment to Professionalism Honest towards your clinical partner, challenges others where appropriate Challenging situation with colleague Recognising need for good communication, communicating with colleague Importance of communication with patients Willing to learn from others and teach others Identify your good communication skills Use initiative to help clinical partner Coping with pressure Effective communication Patient Focus Learning and development, self-awareness and insight Problem solving and decision-making Working effectively as part of a team Supporting your colleague, provide advice, respect your colleague, share knowledge Answer: AEDCB A is the most appropriate option as you want to gauge what your clinical partner understood from the conversation. That and presenting is an important skill to practice E is the next most appropriate option as an important part of communication is establishing a platform with which to discuss your opinions. Rather than tackling the issue head on, introduce it slowly and make your clinical partner think first about the consultation D is the next most appropriate option as you should give constructive feedback in a manner that this both supportive and critical. This will leave your partner feeling better than if simply point out the negatives. C is the not appropriate as this will make you colleague feel uncomfortable and probably the patient even more so. Showing up your clinical partner like this is not acceptable – you are potentially spending two years with them – don’t alienate them B is not appropriate as again this is undermining your colleague and being unsupportive. See Tomorrow’s Doctors (2009) outcome 15 on the expectations and importance of communication; at http://www.gmc-uk.org/static/documents/content/GMC_TD_09__1.11.11.pdf 13 Q4. You have been taught to use the vacutainers to perform venepuncture by your clinical skills nurse at one of the trusts. A junior doctor asks you to take some bloods from a patient. They check that you have been trained and ask what materials you use. They then say “Oh I can’t be bothered with those; I just use a butterfly needle and syringe…that’s much easier than the vacutainers”. What should you do? Choose the three most appropriate options from the following list A. B. C. D. E. F. G. H. Attempt venepuncture using the vacutainer method Ask the FY1 to explain how to use the needle and syringe Attempt to take blood using the needle and syringe Ask your clinical partner for advice Ask a nurse what equipment to use Ask the FY1 to show you how to use the needle and syringe Bring the query to the attention of your personal tutor Email the clinical skills nurse about learning the needle and syringe method Domain How the question assesses the domain. Commitment to Professionalism Coping with pressure Takes responsibility for actions Managing ambiguity, good judgement under pressure Negotiating and asking questions Patient safety involved in correct technique Desire to learn from FY1, using knowledge learned. Insight into lack of training and experience in use of needle and syringe. Recognition of other skills of FY1 and nurses Effective communication Patient Focus Learning and development, self-awareness and insight Working effectively as part of a team Answer: AGH A is appropriate as you have been trained to use the vacutainer and therefore should proceed to take blood using that method rather than attempt with something you don’t know G is appropriate as these are the types of situations you should discuss with your personal tutor. They should be able to give you support and guidance on training. H is appropriate as there may be a reason why you haven’t been shown the needle and syringe method. The clinical skills nurses are very helpful and are always open for you to email with advice – or even pop in to see them. Ideally skills such as this should be taught to you by someone who knows best practice. B and F are not appropriate as whilst you can learn many things from an FY1, venepuncture should really be taught by the clinical skills nurse so you learn best practice from the outset. There is not guarantee that the teaching from the FY1 is the correct way. C is not appropriate and potentially dangerous for the patient. D and E are not top options as you should be able to make this decision by yourself. You are the one who has been asked to do the venepuncture. 14 Q5: You are in group work. There is one group member who is always late, often doesn’t turn up and when they are there, rarely participates in the session. What should you do? Rank these responses from the most appropriate (=1) to the least appropriate (=5): A. B. C. D. E. Speak to them at one side after the session Talk to your personal tutor about them Comment on their lateness when they arrive to make a point of it Ignore it as this is not your responsibility Find out from your other colleagues in the group whether anyone else is concerned about their behaviour Domain How the question assesses the domain. Commitment to Professionalism Coping with pressure Challenging unacceptable behaviour Challenges peer pressure to conform and propensity to avoid conflict. Communicating with colleagues in an appropriate manner, being diplomatic The focus in this case is on your colleague Maximising group work as an effective learning environment, insight into the well-being of your colleague Recognising that organisation is an important skill, working thorough the situation where colleagues are disruptive. Getting opinions from your group members, maintains harmony within the group Effective communication Patient Focus Learning and development, self-awareness and insight Problem solving and decision-making, Organisation and planning Working effectively as part of a team Answer: EABCD E is the most appropriate response. This behaviour concerns the whole group. It will be likely that other members are annoyed by this. Also, it will give you a chance to share responsibility for the issue, as well as find out any information on the individual concerned that may be important – for example someone might know they are having some personal issues. You can then delegate someone to speak to them so they don’t feel intimidated A is the next most appropriate option once you have spoken to your group. B is the next most appropriate option as you should raise your concerns with your tutor – particularly as this student may be struggling. They will be in a position to help your group and the individual involved. You should try to speak to your colleague first to let them know you are going to do this as you don’t want to go behind their back if you can help it. C is not appropriate as this may cause arguments, or worse, embarrass them so they no longer want to attend group sessions. D is the least appropriate option. You have a duty to your colleagues as outlined by tomorrow’s doctors (2009) 23 (j) to flag up something if they put patients at risk – learn this skill early as it’s important. Ref: http://www.gmcuk.org/static/documents/content/GMC_TD_09__1.11.11.pdf 15 Q6: You are medical student in theatre. A patient is under general anaesthesia and before the operation starts your consultant asks you to practice doing a PR on the patient. You have not gained consent from the patient and there is nothing in the notes. What should you do? Choose the top three options from the following list: A. B. C. D. E. F. G. H. Do the PR as you should respect your consultant Flatly refuse to do the PR Ask the consultant whether the patient has consented Ask your clinical partner to do it Tell the patient afterwards that you did the PR Record in the notes that you did the PR Politely ask if you can do one on the next patient who has consented Raise your concerns with your educational supervisor Domain How the question is assessing this? Commitment to Professionalism Coping with pressure Effective communication Learning and development, self-awareness and insight Problem solving and decision-making, Organisation and planning Respecting GMC guidance on consent Pressure from consultant on student Communicating views appropriately and raising concerns with supervisor Respecting patient’s rights to know about invasive procedure PR is a valuable learning opportunity, should take up where possible. Deciding whether to follow orders or politely decline. Working effectively as part of a team Not making your clinical partner do it Patient Focus Answer: CGH C is appropriate as it is important to ask whether the consultant has checked prior to the patient undergoing a General Anaesthetic G is appropriate as this demonstrates that you are keen to get experience but that you don’t want to do anything that might not be acceptable for the patient H is appropriate as this incident may not be isolated and other students may have also been in this difficult position. Your educational supervisor is there to support you and you should discuss issues like this with them. A is not appropriate as bad practice is never acceptable B is not appropriate as you don’t want to create unnecessary conflict – a more tactful approach will mean your consultant looks on you more favourably D is not appropriate – just because you are uncomfortable doing it shouldn’t mean you can pass it on to your colleague to take the blame if it goes wrong. F is not appropriate as you should not be doing a PR without consent from the patient Reference: see GMC (2009) Tomorrow’s Doctors – outcome 3; 20 (c): http://www.gmcuk.org/static/documents/content/GMC_TD_09__1.11.11.pdf 16 Q7: You are in an ophthalmology clinic, a patient came in with a visual field defect and the CT scan confirmed they are having an ‘evolving stroke’. The consultant calls the patient into the clinic to tell them this. Afterwards the consultant asks you to take the patient to lie down in another side room whilst they wait for a bed to be available. The patient asks you in the room “tell me honestly what the doctor said, I could hardly understand a word they had such a thick accent…you just can’t get a good doctor that speaks English these days.” What should you do? Rank the following responses from most appropriate to least appropriate A. B. C. D. E. Explain to them the consultant said they are having a stroke Tell the consultant that the patient did not understand the diagnosis Tell them that comment was inappropriate and you will not tolerate racism Bring the patient back to see the consultant Tell them you will get someone to come and explain the diagnosis to them Domain How the question is assessing this? Commitment to Professionalism Coping with pressure Effective communication Patient Focus Be honest with your consultant Pressure from patient for explanation Communicates patient views to consultant Does not let their personal views get in the way of their care. Recognises that breaking bad news is not appropriate for you to deliver & seek help Takes charge of situation and uses initiative to solve problem Learning and development, self-awareness and insight Problem solving and decision-making, Organisation and planning Working effectively as part of a team Aware of responsibility to consultant and share knowledge with them Answer: EBDAC E is the most appropriate option as you should address the patient’s concerns but not compromise your position. B is the next most appropriate option as you have a duty to advocate for your patient and explain their concerns to your senior who can address them accordingly D is the next most appropriate option as that way the consultant can readdress their concerns. A is not appropriate as you should not be breaking this news to the patient. You don’t know how they will react, nor are you in a position to answer their questions appropriately C is not appropriate as the patient may simply be angry and accusing them of being racist will not be well appreciated. You should not be passing judgements on patients and have to bypass comments for the sake of their care. 17 Q8. Your exams are coming up and you are feeling the pressure. You can’t seem to shake that cold you got a month ago; you are not sleeping well and have been slipping behind. You have made a revision timetable and you are really concerned that you won’t get through everything before your exams. What should you do? Rank the following responses from most appropriate (=1) to least appropriate (=5) A. Do nothing, it’s probably temporary and you usually manage to get through everything in the end B. Speak to a friend about your concerns C. Speak to your personal tutor about your concerns D. Rework your revision timetable so that you can get through it all E. Ask a senior medical student for advice Domain How the question is assessing this? Commitment to Professionalism Effective communication Learning and development, self-awareness and insight Problem solving and decision-making, Organisation and planning Taking responsibility for own health and wellbeing Employs effective coping mechanisms for dealing with stress Communicating concerns appropriately Willing to seek help when needed and accepts this is not a weakness Proactive about getting support, planning ahead and recognising a problem. Working effectively as part of a team Consulting others for advice Coping with pressure Answer: CBEDA C is the most appropriate response as your personal tutor should be the first person to contact when you require support. They are in the best position to help you. B is the next most appropriate response as you should seek support from someone in a similar position to you who can identify and share your concerns. Peer support is something you will look to throughout your career as a doctor – and who you will likely learn the most from. Start voicing your worries early, rather than bottling them up. E is the next most appropriate option as hopefully you should be in touch with your medical Mum or Dad – or at least know someone senior though an extra-curricular activity. Seniors have been through it all before and so they will be able to give you guidance and hopefully give you some tips on how to manage the workload. There is strong evidence supporting the benefit of students furthering other student’s academic development and is therefore encouraged (Sobral, 2002). 18 D is not an appropriate coping mechanism. Reworking the timetable will increase the pressure on you and mask the true problem. You should be seeking advice early. A is the least appropriate response as you should always flag up struggles earlier rather than later. Hoping that it will go away is not dealing with the problem effectively. Moreover, the later you leave it, the worse things may get. Reference: Sobral, D, T. (2002) Cross-year peer tutoring experience in a medical school: condition and outcomes for student tutors. Medical Education 36 (11); 1064-1070 19 Q9: You are on the ward looking through some patient notes for a portfolio. The phone starts to ring. The nurses are busy with a drug round and there is no one else around. What should you do? Choose the three most appropriate options from the following: A. B. C. D. E. F. G. H. Answer the phone Wait to see if anyone comes to get it Take a message and hang onto it until someone comes Take a message and try to find someone free to deliver the message Ignore it and continue getting the information for your portfolio Go and get someone to answer the phone Ask your clinical partner to answer it as you are busy with your portfolio Take a message and interrupt the nurses on their drug round to deliver it. Domain How the question is assessing this? Commitment to Professionalism Coping with pressure Reliable, honest and trustworthy Managing uncertainty whether to answer phone Clarifies information, takes down message The phone call may be important regarding a patient. Recognises this is within their own competence to answer phone Prioritises tasks – phone call over notes. Recognises no one else to answer phone Effective communication Patient Focus Learning and development, self-awareness and insight Problem solving and decision-making, Organisation and planning Working effectively as part of a team Supporting other team members on the ward. Aware not to interrupt drug round. Answer: ADC A and D are appropriate as you are perfectly within your rights and position as a medical student to answer the phone and take a message. You don’t know why that person is ringing but wouldn’t you rather have your call answered. You can always take a message and say you will get someone to ring them back. You should always pass on the message and therefore finding someone to deliver it is appropriate. C is appropriate. It is your responsibility if you note it down but you should keep hold of it rather than interrupt the nurses on their ward round. B is not appropriate as you can always pass it over to someone if they arrive. Be proactive. E and F are not appropriate as you can answer a phone yourself. G is not appropriate as your portfolio can wait for 5 minutes. This is about prioritisation and recognising that you should stop what you are doing to complete a more urgent task. H is not appropriate as you should never interrupt a drug round – the nurses will get angry with you because this is how mistakes happen and patient safety is compromised. You should find someone who is free who can act on the message. 20