TRUST ME, I’M A (CERTIFIED) DOCTOR EVERYTHING YOU EVER WANTED TO KNOW ABOUT MOC… …AND MAYBE MORE V I RG I N I A A . M OY E R , M D, M P H V I C E P R ES I D E N T, M O C & Q UA L I T Y T h e A m e r i c a n B o a r d o f P e d i a t r i c s Disclosures •I have no relevant financial relationships with the manufacturer of any commercial product or provider of commercial services discussed today. •I do not intend to discuss an unapproved/investigative use of a commercial product/device in my presentation. •I am employed full time by the American Board of Pediatrics • Which is why you invited me here. T h e A m e r i c a n B o a r d o f P e d i a t r i c s Why Certification? •Can’t we just assume that graduating from medical school and residency proves to the public that doctors are, and always will be, competent to practice pediatrics? • Remember “P=MD”? •Who can claim to be a pediatrician? • How does the public know who has the knowledge and skills to provide health care for children? T h e A m e r i c a n B o a r d o f P e d i a t r i c s Framework of the ABP Mission Founded 82 years ago at the dawn of the era of specialization A nationally recognized way to make their training, qualifications, and competencies clear to the public. Core concept in the mission statement: • To certify pediatricians based on standards of excellence that lead to high quality care. The ABP certification provides assurance to the public that a pediatrician fulfills the continuous evaluation requirements that encompass the six core competencies. T h e A m e r i c a n B o a r d o f P e d i a t r i c s Professional self-regulation “Societies grant professional communities freedom from external regulation in return for their commitment to regulate their members' conduct.” “For its part, the profession must self-regulate in an open and rigorous fashion or it will lose the privilege, and this would be unfortunate for both society and for physicians.” T h e A m e r i c a n B o a r d o f P e d i a t r i c s About the ABP •Independent, nonprofit certifying board created in 1933 Those certified are known as Diplomates of the Board •Sole mission is to the public •One of 24 specialty boards of the American Board of Medical Specialties (ABMS) •Includes >250 pediatricians who volunteer their time to set the standards of certification T h e A m e r i c a n B o a r d o f P e d i a t r i c s In the beginning… •The first year (1934), just an oral exam, then: •A written (essay) exam followed by an oral exam •MCQ exam followed by an oral exam (late 40’s) •= Permanent certification •Irrevocable (almost) T h e A m e r i c a n B o a r d o f P e d i a t r i c s Reasons for Change in Certification “Trust me, I am a physician.” •IOM reports Crossing the Quality Chasm and To Err is Human documenting the need for changes leading to improvement •Health care research that uncovered wide gaps in the quality and cost of care for conditions known to have a best practice •The public awareness about the quality gaps •The public’s demand for accountability from all involved in the profession 100% Long Term Goal = 95% 90% Performance Feedback Reports | q 80% 70% 60% 50% Improvement Collaborative on Reliability | q P4P Program | q Project Inception | q 40% p P4P Deadline 30% 20% z Self Management Collaborative Initiated p Web-based Registry Launched “Show me the Data.” p "Perfect Care" Including Flu Shot 10% O ct N D 03 ov 03 ec 0 Ja 3 n 0 Fe 4 b 0 M 4 ar 04 A pr 0 M 4 ay 0 Ju 4 n 04 Ju l0 4 A ug 04 S ep 0 O 4 ct 04 N ov 0 D 4 ec 0 Ja 4 n 0 Fe 5 b 05 M ar 05 A pr 05 M ay 0 Ju 5 n 05 Ju l0 5 A ug 05 S ep 0 O 5 ct 05 N ov 05 0% OVPCA Network Practice 1 T h e Practice 2 Practice 3 Practice 4 Practice 5 Practice 6 A m e r i c a n A system based simply on a single or periodic tests of knowledge needed improvement! B o a r d o f P e d i a t r i c s IOM Reports and MOC “To Err is Human” (2000) “Crossing the Quality Chasm” (2001) a single certificate at the end of training could not possibly provide assurance on core competencies around quality and safety for anyone’s entire professional career: “Given the rapid pace of change in health care and the constant development of new technologies and information… Professional certifying organizations should implement periodic re-examinations and re-licensing of doctors, nurses, and other key providers, based on both competence and knowledge of safety practices.” T h e A m e r i c a n B o a r d o f P e d i a t r i c s The Evolution of Board Certification ABP certifications were issued without any end dates = permanent certificates Certificates issued 2003-2009 required diplomates to pass a test of knowledge every 10 years and to complete one Part 2 and one Part 4 activity 1988 2003 Beginning in 1998, diplomates were obligated to pass a test of knowledge every 7 years T h e A m e r i c a n Over 150 different combinations of requirements! 2010 Certificates issued 2010 and forward, required diplomates to pass a test of knowledge every 10 years and to earn 100 points in Part 2 and Part 4 activities every 5 years B o a r d o f P e d i a t r i c s Because We Work to Improve It, MOC Is Not the Same for Everyone You have a certificate with an end-date that has not yet expired Time-Limited Certification •You have submitted MOC enrollment, or •You have become certified in a new specialty area, Continuous Certification or •You have gained the designation of Meeting MOC requirements in a permanent certification area. T h e A m e r i c a n B o a r d o f P e d i a t r i c s ABP Time-limited Certification You have a certificate with an end-date on it To-Do List Before your current certificate expires: Complete ONE Part 2 Self-Assessment activity Complete ONE Part 4 Performance in Practice activity Complete your online Re-enrollment application T h e A m e r i c a n B o a r d o f P e d i a t r i c s Continuous Maintenance of Certification No end date on certificate To-Do List Complete 40 points in Part 2 Self-Assessment activities Complete 40 points in Part 4 Performance in Practice activities Complete 20 points in either Part 2 or Part 4 activities Complete your online Re-enrollment application T h e A m e r i c a n B o a r d o f P e d i a t r i c s Both Initial Certification and MOC are Based on the Same 6 Core Competencies Part 1 – Professional Standing Patient care, Interpersonal & communication skills, Professionalism Part 2 – Knowledge Assessment Patient care, Medical knowledge, Practice-based learning & improvement, Systems-based practice Part 3 – Cognitive Expertise Medical knowledge Part 4 – Performance In Practice Patient care, Practice-based learning & improvement, Interpersonal & communication skills, Professionalism, Systems-based practice T h e A m e r i c a n B o a r d o f P e d i a t r i c s Part 1: Professionalism Current Requirement for Part 1 •All diplomates must hold a valid, unrestricted medical license •Cannot hold any licenses restricted for disciplinary reasons •Should NOT be in prison •Note: This is a low bar for professionalism. T h e A m e r i c a n B o a r d o f P e d i a t r i c s Part 2: Lifelong Learning and Self Assessment ABP’s General Pediatrics Knowledge Self-assessment Open book assessment used to indicate exam performance ABP’s Decision Skills Self-assessment Designed as if you are looking at a chart for a general pediatrics patient and determining how to proceed ABP’s Question of the Week 1 question released every Wednesday ABP’s Subspecialty/Topic Self-assessments 3 self assessments from each subspecialty, plus general topics (~50) Self-assessments from Other Organizations Including PREP, some CME courses, and many other organizations (~100) T h e A m e r i c a n B o a r d o f P e d i a t r i c s Question of the Week •A scenario every week with a single question •Take a shot at the question •See what everyone else has answered •Read the resources (provided) – recent abstract, commentary •Answer the question again (this time it counts) •Bonus clinical pearl •Up to 20 points of Part 2 credit per year T h e A m e r i c a n B o a r d o f P e d i a t r i c s Part 2 Concerns Limited choice of relevant activities available Many CME activities that seem to meet ABP MOC criteria don’t earn credit • IHI Open School MOC credit went live in October • Working with CITI to provide MOC credit for CITI courses • New partnership with ACCME • CME providers will be able to apply for MOC credit when they apply for CME • More types of activities will qualify, such as simulation and point of care CME • Activities will need to meet MOC standards: • Involve active participation and involve an assessment component T h e A m e r i c a n B o a r d o f P e d i a t r i c s Part 3 MOC- Cognitive Expertise Although the MOC cycle is 5 years, a secure test of knowledge is only required every 10 years. Note: Exam cycles usually do not coincide with MOC points cycles! Current Requirement for Part 3: • Successfully pass a secure test of knowledge every 10 years in each area of certification. T h e 1969 1980-1991 ABMS introduces Recertification Closed Book (voluntary) A m e r i c a n 1993-2002 1993 - 2002 Open Book Exam (every 7 years) B o a r d 2003-present Secure Exam (every 10 years) o f ?2017? - ? MOCA continuous assessment P e d i a t r i c s Concerns about the secure MOC exam Testing center security is demeaning (“treated like a criminal”) Doesn’t reflect real world practice, where we look things up •Future of Testing Conference – May 2015 https://abpedsfoundation.org/ •Walking in – Two key questions: • Should we move to remote proctoring for MOC Part 3? • Should we allow for use of resources? •Walking out – MOCA Minute (MOCA) T h e A m e r i c a n B o a r d o f P e d i a t r i c s Philosophical Shift Summative Assessment only T h e A m e r i c a n Summative Assessment and Learning B o a r d o f P e d i a t r i c s MOCA Minute™ Application T h e A m e r i c a n B o a r d o f P e d i a t r i c s ABA’s MOCA Minute™ 2016 Pilot: Summative Judgments Involves all ABA diplomates. Diplomates will answer a minimum of 30 questions per calendar quarter ABA will collect 120 data points from every diplomate every year that diplomate maintains her or his certification (1200 vs 180 over 10 years) Diplomates will build a continually-updated profile of their content knowledge over the course of their career These data can be used to make a dynamically summative judgment at any point(s) during a diplomate’s career T h e A m e r i c a n B o a r d o f P e d i a t r i c s 23 ABP’s MOCA Pilot – January 2017 •Participation voluntary, General Pediatrics only •Partner with ABMS – pilot and research •Initial focus on General Pediatrics assessment •Diplomates will be able to specify practice type: • Ambulatory • Inpatient • Both T h e A m e r i c a n B o a r d o f P e d i a t r i c s ABP MOCA Overview •1 question per week, more than 1 minute per question •Flexibility will allow diplomates to decide when to respond based on their schedule and time availability •Online resources or books may be used •Diplomates will need to answer without collaborating with peers or other individuals •A randomization protocol to minimize likelihood that any two diplomates receive the same questions during any given week •Clone of question will be sent if diplomate misses a topic/question (spaced education) •MOC Part 3 will remain in place until pilot ends Items in blue indicate differences from ABA . T h e A m e r i c a n B o a r d o f P e d i a t r i c s Part 4: Improvement in Professional Practice • ABMS 2015 Standards: • Activities result in improved population health outcomes, access to care, improved patient experience, increased value in health care system • Encourage activities within the context of the health care team and system of practice • Assure each diplomate has an adequate knowledge of QI science and practice T h e A m e r i c a n B o a r d o f P e d i a t r i c s Part 4 in the beginning: •Belief that large quality collaboratives and multi-institutional QI initiatives would grow rapidly, and most pediatricians would have access to these within five years. •PIMs built as an introduction to QI for those outside of institutional settings •Initial QI Project application directed to institutional sponsor of the project • Complex and expensive •Portfolio Programs, Pediatric and Multi-Specialty • Institution is authorized to approve projects • MSPP Allows projects that cross specialty lines (hand hygiene, infection control, CLABSI) T h e A m e r i c a n B o a r d o f P e d i a t r i c s Obvious problems Collaboratives and multi-institutional QI grew slowly Many local QI efforts evolved but difficult to get credit No credit for work with trainees Applications too complex/burdensome Fees too high • In the many thousands at the beginning • More recently, $500 per project Requirement for direct patient care to earn credit QI projects more often presented as posters and platforms than papers T h e A m e r i c a n B o a r d o f P e d i a t r i c s Part 4 Evolution •Portfolio Program expanded rapidly to include many more hospitals, organizations, and collaborative QI networks •Multi-specialty portfolio programs expanded to include 21 specialties •Fees decreased •New pathways introduced to provide credit for local QI efforts •Changes to “meaningful participation” requirements •Repeat credit for prolonged involvement in major projects •Publication credit expanded to posters and platforms T h e A m e r i c a n B o a r d o f P e d i a t r i c s Portfolio Programs •Portfolio sponsors (institutions, organizations) can approve projects on behalf of ABP •Allows institutions to align quality initiatives with MOC requirements •Pediatric Portfolios • 39 sponsors (CHOP, Cinti, ICN) Over 500 projects approved Multispecialty Portfolios 60 Multispecialty portfolio sponsors (Seattle, Nationwide, UNC) Over 400 projects approved Many more portfolio sponsors in the pipeline T h e A m e r i c a n B o a r d o f P e d i a t r i c s Pathways introduced in 2015 Small Group Quality Improvement Projects (completed), 25 points • This allows up to 10 diplomates to receive credit for a project they have already completed. The review and processing fee is $75 per project (not per diplomate) Proposed QI project • This allows a diplomate or team to submit a proposal and receive feedback and coaching if desired to develop a new project. There is no fee for this service. NCQA PCMH, 40 points • This allows diplomates whose practices achieve NCQA PCMH designation to receive credit for the QI work that is entailed. There is no fee. QI Program Development, 40 points • This allows diplomates who lead large, usually institutional QI initiatives to receive credit for their leadership. Review and processing fee is $150 per individual. T h e A m e r i c a n B o a r d o f P e d i a t r i c s QI Project applications from small groups Affectionately known as “SQIPA” Built for projects led by diplomates Up to 10 pediatricians can earn credit per project Simplified/streamlined QIPA application • 8 questions, directed to the physician project leader Application is for completed projects • Credit awarded immediately upon approval “Proposed project” pre-application also available • No credit, but will populate into the completed project application when finished T h e A m e r i c a n B o a r d o f P e d i a t r i c s Meaningful involvement in improvement efforts In order to receive credit, each diplomate attests to meaningful involvement in the work, by meeting 4 criteria: Be intellectually engaged in planning and executing the project. Participate in implementing the project's interventions (the changes designed to improve care). Review data in keeping with the project's measurement plan. Collaborate actively by attending team meetings. T h e A m e r i c a n B o a r d o f P e d i a t r i c s Application of QI methods to activities intended to improve the health of children Projects to improve research studies (eg, improve recruitment, improve flow through the CRC, improve other research processes) Projects to improve resident and student education in pediatrics (including research in pediatric education) ACGME/NAS Annual Program Evaluation • NAS requires documentation of annual program evaluation and improvement • Parallels QI project requirements • ABP Partnering with APPD and ACGME to develop a pathway to award credit T h e A m e r i c a n B o a r d o f P e d i a t r i c s Trainees Engaged in Quality Improvement •A “resident” is anyone in an ACGME-approved pediatric training program who has not yet achieved initial certification •Residents can now earn Part 4 MOC credit during residency for meaningful participation in QI activities (just like a diplomate) •Diplomates and residents can both apply for approval of a local QI project – ideally, the project leader applies, whether diplomate or resident •Resident Part 4 credit is “banked” to apply to first MOC cycle after initial certification •Residents have full access to Part 2 activities, but do not earn banked credit T h e A m e r i c a n B o a r d o f P e d i a t r i c s MOC for Fellows BEFORE the Fellow passes his/her GP exam (and thus becomes a certified diplomate of the ABP), the fellow is a “trainee”: • As long as an individual has a “training line” in the ABP system (eg is enrolled in an ACGME approved program), bankable credit can be earned. When the Fellow passes his/her initial GP exam, he/she is enrolled in the first 5-year cycle of MOC, needs 100 points just like any other diplomate • Any already banked Part 4 credit goes live • 10 Part 2 and 10 Part 4 points are automatically awarded for each year of fellowship training after the fellow achieves initial GP certification T h e A m e r i c a n B o a r d o f P e d i a t r i c s Performance Improvement Modules (PIMs) Originally intended to provide an introduction to QI methods for those outside of institutional settings or those with no QI experience All PIMs are based on an existing, successful QI effort, written by people who have done it. New PIM platform more linear, in e-course style More than half of PIMs are offered by other organizations, including subspecialty organizations T h e A m e r i c a n B o a r d o f P e d i a t r i c s Credit for Published QI Work •Must tell the story of a QI project, must present data over time •Published in a peer-reviewed journal or presented in a peer-reviewed poster or platform at a national (or international) meeting •Adhere to SQUIRE reporting guidelines •Be published/presented during the diplomate's current MOC cycle •Article, poster or platform slides must stand alone • Otherwise, better to apply via SQIPA application •BMJ Quality – a single-purpose portfolio sponsor T h e A m e r i c a n B o a r d o f P e d i a t r i c s Part 4 Outcomes “Has the MOC program tangibly improved clinical care for children?” “Isn’t the MOC-4 effort superfluous given all the other mandates for quality?” •Quality does not improve when we just “try harder” •Formal QI has been shown to be effective •Substantial QI efforts supported by ABP have made a difference •Even small efforts (PIMs) can have an impact •MOC credit helps to engage physicians in QI efforts T h e A m e r i c a n B o a r d o f P e d i a t r i c s CHILDREN’S HOSPITAL ASSOCIATION QUALITY TRANSFORMATION NETWORK Began in 2006 ABP helped catalyze the beginning of the blood stream infection work Currently three successful efforts with demonstrated improvement and growing enrollment: Preventing catheter associated blood stream infections in PICUs Preventing line infections in hematology/oncology patients Preventing catheter associated infections in peritoneal dialysis T h e A m e r i c a n B o a r d o f P e d i a t r i c s STATUS OF NATIONAL PICU CLABSI QUALITY TRANSFORMATION EFFORTS IN 2012 • 70 PICU teams at 54 institutions • 44 teams in 36 institutions focused on pediatric hematology/oncology • 28 teams in 28 institutions focused on peritoneal dialysis >3,220 CLABSIs prevented >$113 million dollars saved >380 deaths prevented T h e A m e r i c a n B o a r d o f P e d i a t r i c s ImproveCareNow Pediatric Inflammatory Bowel Disease Collaborative •275 Pediatric gastroenterologists •Patients enrolled = >5000 (Feb 2011) •Visits in the database = 17,460 •ABP Foundation funded startup T h e A m e r i c a n B o a r d o f P e d i a t r i c s Crohn’s Disease Remission Rate National database now includes >3000 patients T h e A m e r i c a n B o a r d o f P e d i a t r i c s Cumulative % of Asthma Population with “Perfect Care” CCHMC PHO Cumulative Percent of Network Asthma Population Receiving "Perfect Care" 100% 90% 80% 3/05 Self 1/05 Pay for 10/04 M anagement Performance Desktop PC Collaborative Rewards Registry Installed at Determined Practices 10/03 Project Inception Registry Established 70% 60% 5/04 1/04 Reliability Performance Improvement Feedback Collaborative Reports 50% 40% 8/05 Web Site with Registry Launched Practices achieve >80% reliability (“perfect care”) 3/ 31/ 06 "Perf ect Care" WITH Flu Shot 30% End 05-06 Season 8/04 Pay for 3/ 31/ 05 Performance "Perf ect Care" Program WITH Flu Shot Announced End 04-05 Season 20% 10% T h e A m e r i c a n B o a r d o f Jun 07 Apr 07 Feb 07 Dec 06 Oct 06 Aug 06 Jun 06 Apr 06 Feb 06 Dec 05 Oct 05 Aug 05 Jun 05 Apr 05 Feb 05 Dec 04 Oct 04 Aug 04 Jun 04 Apr 04 Feb 04 Dec 03 Oct 03 0% Copyright © 2005 Cincinnati Children’s Hospital Medical Center; all rights reserved P e d i a t r i c s Influenza Immunization PIM (N=2418) Absolutely Not 3% Probably Not 6% 0% None 25% Enthusiast ically 26% Yes 65% A m e r i c a n very positive 21% positive 54% Recommend to a Colleague - 91% T h e negative 0% Impact on Practice – 75% B o a r d o f P e d i a t r i c s MOC credit drives engagement in QI “Effectiveness of an Asthma Quality Improvement Program Designed for Maintenance of Certification” Pediatrics 2014 “Implementation of the NHLBI integrated guidelines for cardiovascular health and risk reduction in children and adolescents: rationale and study design for young hearts, strong starts, a clusterrandomized trial targeting body mass index, blood pressure, and tobacco.” Contemporary Clinical Trials 2014 “What’s in it for me? MOC as an Incentive for Faculty Supervision of Resident QI Projects” Academic Medicine 2015 “The national improvement partnership network: state-based partnerships that improve primary care quality.” Academic Pediatrics 2013 “Maintenance of Certification Part 4 Credit and recruitment for practice-based research.” Pediatrics 2014 “Quality Improvement in Childhood Obesity Management through the Maintenance of Certification Process” J Peds 2013 T h e A m e r i c a n B o a r d o f P e d i a t r i c s ABP’s Goal: Align MOC with the work that pediatricians already do: • Credit for PCMH • MOC credit for improvement activities that an individual is already doing, provided it meets standard improvement criteria • MOCA pilot: An exam format that does not require people to take a day off from work and does not require cramming • Alignment with requirements from other organizations (Collaborative Institutional Training Initiative, CITI, ACGME, etc.) T h e A m e r i c a n B o a r d o f P e d i a t r i c s ABP Commitments to Diplomates •A single, all-inclusive fee to maintain one certificate • Includes one “ticket” for an exam every 10 years • No additional cost required for MOC activities •No cost increase relative to the 7-year secure exam cycle fee •Whatever the process is when a person enters a cycle will not change for that person during that cycle • Any changes will apply to the next cycle •No duplication of effort T h e A m e r i c a n B o a r d o f P e d i a t r i c s No Duplication of Effort •MOC points earned apply to ALL of a diplomate’s certificates - each person has just one MOC cycle, even for the diplomates who have 4 ABP certificates. •Reciprocity from other Boards: • Diplomates of another American Board of Medical Specialties (ABMS) board who have met MOC requirements in their second specialty. • Diplomates practicing in Canada who have met the Royal College of Physicians and Surgeons (RCPSC) MOC requirements. • Diplomates who have completed 12 months of training in an ACGME nonPediatric residency or any fellowship program earn 10 Part 2 and 10 Part 4 points for each year of training. T h e A m e r i c a n B o a r d o f P e d i a t r i c s Why does this cost so much? •Fees from initial certification exams and MOC must cover the costs of core ABP operations: • Exam development, production and administration • 15 certifying exams; 15 MOC exams; CAQs; 15 in-training exams • Each exam question costs about $3,000 to develop • The smaller the group examined, the greater the per-person cost; thus Gen Peds fees help to cover small subspecialties • Staff to address eligibility requirements, resident tracking, in-training examinations, Milestones, examination psychometric analysis, CME fees (yours), quality improvement, standard setting, and RRC and ACGME activities… and much more •ABP fees lower than 21 other certifying boards • Few others have all-inclusive fees • No fee increase for this year or next year T h e A m e r i c a n B o a r d o f P e d i a t r i c s “there is no justification for requiring every physician to engage in quality improvement” The response from the business community (HBS): •“If physicians and other health care professionals fail to improve quality and innovation substantially in the near term, outside forces, such as regulators and policy makers, will likely become more involved in certification and mandating approaches to improvement. Assuming that the medical community values its independence, it would be well served to illustrate that it can and will lead the efforts necessary to improve quality and innovate in health care.” •“Physicians have long held a defensible claim to self-regulation: now they need to lead the effort to maintain it.” T h e A m e r i c a n B o a r d o f P e d i a t r i c s XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX What are my requirements? T h e A m e r i c a n B o a r d o f P e d i a t r i c s XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX What are my requirements? T h e A m e r i c a n B o a r d o f P e d i a t r i c s XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX What are my requirements? T h e A m e r i c a n B o a r d o f P e d i a t r i c s If you are interested in participating in the work of the ABP >250 physician volunteers, both specialists and generalists • 15 Subspecialty boards plus general peds exam-writing committees • Committees (Credentials, MOC, COI, Strategic Planning, Research, Finance…) • Public members on BOD, Foundation BOD, MOC committee Board of Directors • 15 members – 6-year terms, nonrenewable • Mix of generalists and subspecialists, 1 public member • Current chair is general pediatrician in private practice, next year’s chair is a Dept Chair • Nominating societies: AAP, APA, APS, AMSPDC, APPD, SPR Online Nominations Tool • Please nominate able candidates for all positions! • All nominees must be certified and meeting requirements of MOC Online question-writing portal We are looking for a few good QOW authors T h e A m e r i c a n B o a r d o f P e d i a t r i c s