AAMC Implementation of the MedBiquitous Curriculum Inventory Data Exchange Standard Terri Cameron, MA Director of Curriculum Programs Spring 2014 MedBiquitous Curriculum Inventory V1 • Working Group launched in December 2010 • Susan Albright and Marc Triola, co-chairs 2010-2013 • Charter: “to develop XML standards for the exchange of curriculum data for benchmarking and educational research.” (Not just for AAMC Curriculum Inventory) • Reasons for Undertaking Work: • • • Enable local curriculum management systems to upload data to a central Curriculum Inventory Identify curricular trends Support curriculum benchmarking and reform • Approved by CI Working Group: February 2013 • Approved by ANSI: May 2013 www.aamc.org/medaps CI Pilot • September – December • 25 schools / six vendors • 5 schools working with school-based systems • Testing • Upload process • Accuracy of Verification Report to submitted data • School Portal functionality www.aamc.org/medaps www.aamc.org/medaps CI Pilot Results • Increased file size limits • Provided staging area for vendors • Improved error messages • Clarified AAMC Business Rules • Improved appearance of School Portal • Added curriculum file upload screen www.aamc.org/medaps www.aamc.org/medaps 2012-2013 Upload Process • CI Portal Open: December 10 • CI Portal Close: February 10: 65 Schools • One month follow up period for schools that did not participate • CI Gateway Close on March 10: 90 Schools • 85 US Medical Schools • 5 Canadian Medical Schools • Additional schools were in process but unable to meet deadline • All other schools contacted plan to participate in 2013-2014 Upload (August) www.aamc.org/medaps 2012-2013 Upload Details • • • • • • • • 50 Schools included competency mapping 4968 Sequence Blocks 107458 Events 108031 Sequence Block Expectations 283325 Event Expectations 61249 Assessment Methods 124068 Instructional Methods 22421 Resources www.aamc.org/medaps 2012-2013 Resource Details Resource Type 1 Audience Response System 2 Audio 3 Cadaver 4 Clinical Correlation 5 Distance Learning - Asynchronous 6 Distance Learning - Synchronous 7 Educational Technology 8 Electronic Health/Medical Record (EHR/EMR) 9 Film/Video 10 Key Feature 11 Mannequin 12 Plastinated Specimens 13 Printed Materials (or Digital Equivalent) 14 Real Patient 15 Searchable Electronic Database 16 Standardized/Simulated Patient (SP) 17 Task Trainer 18 Virtual Patient 19 Virtual/Computerized Laboratory 20 Wet Laboratory Number 1258 1216 458 997 286 14 5675 184 1134 2 96 2 570 809 104 341 76 193 177 244 www.aamc.org/medaps 2012-2013 ‘Other’ Resources Anatomy Biology of Cells inanimate models Medical equipment Museum Palliative Care Panel Panel discussions Personality/leadership test/profile (disc) Plastinated Specimens Printed Materials (or Digital Printed Materials (or Digital Equivalent) 8 1 1 19 1 1 3 21 Scenarios Searchable Electronic Database Simulator (Harvey) Small group discussion with facilitator Small group discussion with mentor of a project review 6 theater project 105 Ultrasound 161 ventilator 8076 62 68 3 25 3 2 9 1 Women's Health 1 Written assignments 8 www.aamc.org/medaps 2012-2013 Upload Process • Reasons for not participating this year: • Focused on LCME Site Visit • Curriculum Review/Renewal/Change • Just started working with new curriculum management system so did not have data completely entered / organized • Do not have system / have not decided on a vendor yet / do not have technical staff • Change in leadership / staff – needed time to come up to speed • Concerns about Verification Report • Vendor did not upload as planned www.aamc.org/medaps 2012-2013 Upload Process • Biggest Hurdles: • Report Start and End Dates • Institution Information • Competencies • Program to PCRS (related) • Hierarchy Levels (broader / narrower) • Academic Levels • Start and End Dates • Sequence Blocks in multiple levels • Unique Curricula • Multiple options for students www.aamc.org/medaps 2012-2013 Upload Process • Biggest Hurdles: • Organizing data • Documenting competencies in XML • CI Verification Report • Assessment Counts • Summative / Formative • Instructional Method Hour Counts • Constantly-changing environment • Communication! www.aamc.org/medaps 2012-2013 Upload Process • Successes: • Curriculum Management System Vendors • • • • MedBiq Leadership / Support • • • • • Valerie Smothers CI Implementers’ Listserv Webinars • • Massive changes to systems to support CI Great communication and feedback All but one uploaded as planned Nearly every school participated Physician Competency Reference Set (PCRS) Standardized Vocabulary School Participation www.aamc.org/medaps CI Reports • Two Sources of Data: • • Curriculum Inventory LCME Annual Questionnaire Part II • Phased Approach for Reporting: • • • Short-term (6-12 months) • Static Reports • Reports by Request (ciadmin@aamc.org) Intermediate-term (12- 18 months) • Dynamic Reports • Reports on Demand Long-term (2-3 years) • Enterprise-wide (AAMC) Reporting Solution www.aamc.org/medaps CI Reports • Reporting Options • Short-term and Intermediate • Choose types of schools to include: • All Schools • US Medical Schools • US Regional Medical Schools • Canadian Medical Schools • Osteopathic Schools • Enter search criteria • Reports will include: • Where and how often content is covered • Instructional methods • Assessment Methods • Competencies www.aamc.org/medaps Preparing for 2013-2014 • CI School Portal Opens August 1 • Closes September 30 • Staging (for testing uploads) available in May • • Vendors automatically have access Available to school developers by request • Webinars/Virtual Focus Groups: • • Three-part Developer Series Curriculum Deans and Administrators • Developer-to-Developer Hands-on Workshop: • Develop and upload one course plus Program Competencies mapped to PCRS www.aamc.org/medaps MedBiquitous Curriculum Inventory V2 • • • • Working Group convened in February 2014 Susan Albright and Hugh Stoddard, co-chairs Review of implementation of V1 Known Issues: Academic Level Assessment Methods – Requirement for Formative/Summative Event Duration (Assessments) Sequence Block Duration (Weeks) Resources (Require / Refine List ) Standardized Vocabulary Update Resources • Curriculum Inventory Website: www.aamc.org/cir • • • • • Webinar dates Developer resources Updates regarding reports Vendor List Participating Schools • MedBiquitous: www.medbiq.org • Curriculum Inventory Working Group: http://www.medbiq.org/curriculum_inventory • Competencies Working Group: http://www.medbiq.org/working_groups/competencies/index.html www.aamc.org/medaps Questions? www.aamc.org/medaps ©