The MCAT2015 Exam: The Basics for Advisors www.aamc.org/mcat2015 Presented By: Billy R. Ballard, DDS, MD Deputy Director, HRSA Center of Excellence Program Professor and Chair, Department of Pathology, Anatomy, and Cell Biology MCAT ® is a program of the Association of American Medical Colleges What We’ll Cover • • • • Creating the MCAT2015 Exam Introducing the MCAT2015 Exam Changes in Test Administration and Reporting Resources for You and Your Advisees We’ll stop for questions after each topic. 2 Creating the MCAT2015 Exam 3 The Broader Context The new MCAT exam means change for all of us. Planting seeds for a physician workforce to improve the health of all. Transforming admissions to keep pace with healthcare. Transforming Medical School Admissions Improving the holistic review of students…. Academic Competencies • Courses completed • Undergraduate grades • MCAT Scores Personal Competencies • Personal statements • Letters of recommendation • Reflections on experiences • Interviews • More tools to come Transforming Medical School Admissions Improving the holistic review of students…. Academic Competencies Personal Competencies Learn more: Analysis in Brief for September 2011 Medical School Admissions: More than Grades and Test Scores https://www.aamc.org/download/261106/data/aibvol11_no6.pdf How is the MCAT Exam Keeping Pace with Medicine? • Periodic reviews to ensure measurement of most important academic competencies in most capable ways • Competencies required in medical school are shifting • 5th review of the MCAT exam since 1928 • Previous review 1991 • New version in place through 2030 The MCAT2015 Timeline New exam goes live in Spring Prep materials available Last dates for current exam More prep materials released 2015 Sept 2012 2014 2012 entering freshman take 2015 MCAT Exam as Juniors 8 Jan 2015 Spring 2015 Fall 2016 First Med School Class selected with new MCAT Exam Evidence Base for the MCAT2015 Exam Fact-finding Efforts • Blue-ribbon panels • Holistic Review Project Advisory Committee • Over 90 Outreach events • Over 2700 completed Behavioral surveys and Social Science Foundations for Future Physicians Roadmap to Diversity: Integrating Holistic Review Practices Scientific Foundations for Future Physicians Report Recommendations for the MCAT2015 Exam • Preserve what works best • Eliminate what doesn’t • Enrich exam with concepts that future physicians are likely to need • Use testing format that has proven successful 10 Recommendations for the MCAT2015 Exam Preserves Testing of: • Natural sciences concepts that medical school faculty want entrants to know • Critical analysis and reasoning skills needed for success in medical school Eliminates: • Under-utilized Writing Sample section 11 Recommendations for the MCAT2015 Exam Enriches Exam By Testing: • Competencies in the Scientific Foundations for Future Physicians Report (SFFP) • Scientific inquiry, reasoning, research methods and statistics skills • Foundational concepts in the social and behavioral sciences 12 Recommendations for MCAT2015 Exam Also ask AAMC to… • Provide resources to help students prepare for the new exam • Develop new admissions tools to measure personal competencies important to medical school success (e.g., integrity, service orientation, dependability) 13 Before moving on… ANY QUESTIONS? Introducing the MCAT2015 Exam 15 New Exam – 4 Sections, 4 Scores 16 Biological & Biochemical Foundations of Living Systems Chemical & Physical Foundations of Biological Systems Psychological, Social, & Biological Foundations of Behavior Critical Analysis & Reasoning Skills # of Test Questions Testing Time (minutes) Chemical & Physical Foundations of Biological Systems 65 95 Critical Analysis & Reasoning Skills 60 90 65 95 65 95 MCAT2015 Exam Lunch Break Biological & Biochemical Foundations of Living Systems Psychological, Social, & Biological Foundations of Behavior Total Content Time 6 ¼ hours Total Time (w/ tutorial, breaks, survey, etc.) 7 ½ hours New Exam – 4 Sections, 4 Scores 18 Biological & Biochemical Foundations of Living Systems Chemical & Physical Foundations of Biological Systems Psychological, Social, & Biological Foundations of Behavior Critical Analysis & Reasoning Skills Using the Preview Guide www.aamc.org/mcat2015 Biological & Biochemical Foundations of Living Systems Combines knowledge of foundational concepts in the biological and biochemical sciences with scientific inquiry, reasoning, and research and statistics skills to solve problems that demonstrate readiness for medical school 20 Biological & Biochemical Foundations of Living Systems Concept 1 • Biomolecules have unique properties that determine how they contribute to the structure and function of cells, and how they participate in the processes necessary to maintain life. 21 Concept 2 • Highly-organized assemblies of molecules, cells, and organs interact to carry out the functions of living organisms. Concept 3 • Complex systems of tissues and organs sense the internal and external environments of multi-cellular organisms, and through integrated functioning, maintain a stable internal environment within an ever-changing external environment. Biological & Biochemical Foundations of Living Systems Foundational Concept 2 • Highly-organized assemblies of molecules, cells, and organs interact to carry out the functions of living organisms. 22 Scientific Inquiry and Reasoning Skills Knowledge of Scientific Concepts and Principles Scientific Reasoning and Problem Solving Reasoning about the Design and Execution of Research Data-based and Statistical Reasoning 23 Combining Skills and Concepts Foundational Concept 1 Content Category 1A Content Category 1B Content Category 1C Foundational Concept 2 Content Category 2A Content Category 2B Content Category 2C Skill 1 Skill 2 Skill 3 Skill 4 • Each cell represents the point at which foundational concepts, content categories, and scientific inquiry and reasoning skills cross • Test questions are written at the intersections of the content and skills 24 Biological & Biochemical Foundations of Living Systems Exam content typically taught in: • Introductory biology • General chemistry • Organic chemistry • First-semester biochemistry 25 New Exam – 4 Sections, 4 Scores 26 Biological & Biochemical Foundations of Living Systems Chemical & Physical Foundations of Biological Systems Psychological, Social, & Biological Foundations of Behavior Critical Analysis & Reasoning Skills Chemical & Physical Foundations of Biological Systems Combines knowledge of foundational concepts in the chemical and physical sciences with scientific inquiry, reasoning, research and statistics skills to solve problems that demonstrate readiness for medical school 27 Chemical & Physical Foundations of Biological Systems Concept 4 • Complex living organisms transport materials, sense their environment, process signals, and respond to changes using processes that can be understood in terms of physical principles. 28 Concept 5 • The principles that govern chemical interactions and reactions form the basis for a broader understanding of the molecular dynamics of living systems. Chemical & Physical Foundations of Biological Systems Concept 4 • Complex living organisms transport materials, sense their environment, process signals, and respond to changes using processes that can be understood in terms of physical principles. 29 Chemical & Physical Foundations of Biological Systems Exam content in this section typically taught in: • Introductory biology • Introductory general chemistry • Introductory organic chemistry • Introductory physics • First-semester biochemistry 30 New Exam – 4 Sections, 4 Scores 31 Biological & Biochemical Foundations of Living Systems Chemical & Physical Foundations of Biological Systems Psychological, Social, & Biological Foundations of Behavior Critical Analysis & Reasoning Skills Psychological, Social, & Biological Foundations of Behavior Knowledge and use of the concepts in psychology, sociology, biology, research methods and statistics that provide a solid foundation for learning in medical school about the behavioral and socio-cultural determinants of health and health outcomes 32 Psychological, Social, & Biological Foundations of Behavior Concept 6 Concept 7 Concept 8 • Biological, psychological, and sociocultural factors influence the ways that individuals perceive, think about, and react to the world. • Biological, psychological, and sociocultural factors influence behavior and behavior change. • Psychological, socio-cultural, and biological factors influence the way we think about ourselves and others. 33 Concept 9 • Cultural and social differences influence wellbeing. Concept 10 • Social stratification and access to resources influence wellbeing. Psychological, Social, & Biological Foundations of Behavior Concept 7 • Biological, psychological, and socio-cultural factors influence behavior and behavior change. 34 Psychological, Social, & Biological Foundations of Behavior Exam content typically taught in: • Introductory psychology • Introductory sociology • Introductory biology 35 New Exam – 4 Sections, 4 Scores 36 Biological & Biochemical Foundations of Living Systems Chemical & Physical Foundations of Biological Systems Psychological, Social, & Biological Foundations of Behavior Critical Analysis & Reasoning Skills Critical Analysis & Reasoning Skills What it tests? Asks examinees to critically analyze, evaluate, and apply information presented in passages Skills: • Foundations of comprehension • Reasoning within the text • Reasoning beyond the text 37 Critical Analysis & Reasoning Skills Passages from humanities & social sciences, including: • Ethics • Philosophy • Population health • Cross-cultural studies Specific disciplinary knowledge not needed 38 Using the Preview Guide • Describes the 4 sections Foundational concepts for each section Detailed outlines of content categories and topics Scientific inquiry and reasoning skills • Sample items with answers www.aamc.org/mcat2015 Using the Preview Guide • • Narrative descriptions of foundational concepts Information indicating: Level of knowledge needed for topics Courses in which topics typically are taught— according to surveys from faculty in minority- and majority-serving schools www.aamc.org/mcat2015 Example of Topic List 41 The “Preview Guide” • • Shows how concepts and scientific inquiry and reasoning skills come together Sample items demonstrate how this works PE = Phosphatadylethanolamine Before moving on… ANY QUESTIONS? Changes in Test Administration and Reporting 44 Testing in 2013 and 2014 • Writing Sample section will be eliminated effective January 2013 • A 45-minute trial for the 2015 exam containing 32 field-test questions will be offered • Trial Section is voluntary and unscored • Examinees will be opt-in/opt-out on day of exam 45 Testing in 2013 and 2014 • Trial Section will be administered at the end of the exam • Include questions in either: biochemistry, biology, chemistry, and physics or in psychology, sociology and biology • Questions will be assigned using data that students provide at registration about the courses they’ve completed • Even with the Trial Section, the exam will be shorter than in the past. 46 What’s the Incentive? Examinees who volunteer and make a good-faith effort will get: • $30 Amazon.com Gift Card* Claim Code** • Feedback on their performance compared to others who participated in the Trial Section • Chance to preview content medical schools find important. We ask for your help to encourage your students to participate in the Trial Section! *Amazon.com is not a sponsor of this promotion. Amazon, Amazon.com, the Amazon.com logo, Gift Codes on Demand, the Amazon Gift Card logo and 1-Click are trademarks of Amazon.com, Inc. or its affiliates. **Amazon.com Gift Cards may be used only to purchase eligible goods on Amazon.com or its affiliated website Endless.com. Gift Card’s cannot be redeemed for purchases of gift certificates or cards or for items from some third party sellers. Purchases are deducted from the Gift Card balance. Gift Card’s cannot be reloaded, resold, transferred for value, redeemed for cash or applied to any other account. Amazon is not responsible if a Gift Card is lost, stolen, destroyed or used without permission. See www.amazon.com/gc-legal.com for complete terms and conditions. Gift Card’s are issued and © 2012 by ACI Gift Cards, Inc., a Washington corporation. 47 Scoring in 2013 and 2014 Will scores be released earlier without the Writing Sample section? 48 • Unfortunately, No • Still 30-35 days • Multiple-choice scaling and equating takes the same amount of time as Writing Sample scoring. Testing in 2015 • January 2015 will be the last administration of the current MCAT exam • New exam will launch in Spring 2015 • Anticipating and planning for a higher demand in 2014 and January 2015 49 Logistics for the New Exam • Total testing time will be 7 ½ hours • Accommodated examinees with extra testing time will test over two or more days • Don’t yet have specifics, but the testing fee will increase • Fee Assistance Program will be available for those who qualify www.aamc.org/fap 50 Spring 2015+ Scoring • New score reports and scaled scores will be released in conjunction with MCAT2015 exam • For 2-3 application cycles, AMCAS will continue to report MCAT scores taken prior to spring 2015 (if applicable) • AMCAS will provide a way for examinees, advisors and medical schools to compare old and new scores 51 Work Continues on … • Scoring and score reports • Plans for working with medical schools on using and evaluating the new exam • Test administration logistics • Preparation materials • Outreach strategies 52 Before moving on… ANY QUESTIONS? Resources for You and Your Advisees 54 Now Available for the New Exam • • • • • • • • The Preview Guide for the MCAT2015 Exam (Second Edition) 3 videos Webinars – over 10 presentations Slide presentations and handouts Resources FAQ’s Research reports providing data used to design the exam Web site www.aamc.org/mcat2015/admins 55 Advising Students on Needed Courses • Varies by institution • The Preview Guide for the MCAT2015 Exam (Second Edition) and the MCAT2015 webinars provide information about typical coverage (according to our surveys) • Find the webinars and more at: www.aamc.org/mcat2015/admins The Course-Mapping Tool for the MCAT2015 Exam www.aamc.org/mcat2015/admins 57 Testing and Course Completion Data Some examinees test for the first time as juniors, some as seniors, and some later: • Juniors—41% • Seniors—27% • Later—27% Before testing, many current examinees complete biochemistry, psychology or sociology: • Biochemistry—63% • Introductory psychology—65% • Introductory sociology—32% 58 Testing and Course Completion Testing and course-taking data for are similar for: • Minority applicants • Applicants at schools w/out advisors • Non-science majors Except that: • Slightly more minority examinees, students without advisors, and non-science majors tested later • Slightly more science than non-science majors took biochemistry • Opposite was true for psychology and sociology 59 Applying to Medical School Some apply after junior year, some after senior year, and some while in post-bac or grad school: • Juniors—37% • Seniors—44% • Post-bac or grad school—19% Many medical schools require or recommend biochemistry or a behavioral or social science course: • 83% biochemistry • 53% behavioral or social science 60 Applying to Medical School Application patterns were similar across groups, except: • Slightly more minority examinees, students without advisors, and non-science majors applied later 61 Support for Curriculum Change MedEdPORTAL iCollaborative Pre-health Collection: Ensuring access to instructional resources for all who need them • • • • Free online collection teaching pre-health competencies. Searchable by competency, foundational concept or key words. Recommended by faculty reviewers. User community comments and shares resources. Contact : Jen Page jpage@aamc.org 62 MedEdPORTAL iCollaborative Pre-health Collection https://www.mededportal.org/icollaborative/pre-health 63 Resources for Students The MCAT Program is committed to providing: • Resources to help student prepare • A good testing experience 64 Resources for Students Available now: • “Preview Guide for the MCAT2015 Exam (Second Edition)” • Videos describing the exam • FAQ’s AAMCvideo: www.youtube.com/user/AAMCvideo www.aamc.org/mcat2015 Test Preparation for the New Exam By 2014: • The Official Guide to MCAT2015 Exam • Free practice test By 2015: • One more practice test Additional Possibilities: • Additional sets of items • Question bank Financial Support For Students? • Fee Assistance Program will continue • Continue free test prep resources • Free Summer Medical and Dental Education Program continues • Considering additional support More info at: www.aamc.org/fap www.smdep.org 67 Spreading the Word Can you help? • Share information with your students • Encourage participation on the Trial Section • Sharing information with advisors who aren’t here • Talking to students without Ideas? mcat2015@aamc.org advisors Thanks! Thank you very much for your active participation and helpful input For more information please visit: www.aamc.org/mcat2015