The ACGME Annual Educational
Conference
After just one
Margarita
Be sure you can trust
those you ask for help
back to your room
A long night, a few drinks, all
you want to do is go to sleep,
then this starts…
Millstones
http://med.stanford.edu/gme/GME_Community.html
What Should a CCC Do First?
Understand their specialty Milestones
(Posted on acgme.org)
 Decide how to assess the Milestones –
Program Evaluation Strategy
 If necessary, identify new evaluation tools
from program director associations,
societies, colleges

NAS and Milestones and YOU
• The program coordinator will play a crucial
role in developing, implementing and
collecting data on x and reporting of milestone
evaluation tools to the CCC
Managing it all…
U - R - IT!
• Understanding RRC program requirements
• Requirements applied to evaluation
methods/process
• Implementing new evaluation system
•
2+2=4
(2+2)*4=16
• Tracking completion and accuracy (outliers)
for data aggregation
Implementing Assessment Tools to validate Milestones
• Evaluation systems
– Milestone-based/EPAs (Entrustable Professional Activities)
– Rotation-specific
– Patient handovers
– Define evaluator groups (faculty, staff,
patients)
– Set up and timing of delivery systems
4. Tracking and Reporting…
• Start with the end in mind:
– CCC biannual reporting windows to ACGME
• November 1- December 31 / May 1 - June 15
• Back track and set calendar events for:
– Periodic monitoring of evaluation completion
– Running aggregate reports and reviewing
milestone evaluation data
– Reviewing case logs, learning portfolios, duty
hours
Pulling the Data Together
End-ofRotation
Evaluations
Clinical Skills
Assessment
Nursing and
Staff / Techs
Evaluations
Quality
Improvement
Activities
Sim
Lab
Clinical Competency
Committee
Progress on Milestones
In-service
training
exams
Safety
Incident
Reports
Case
Logs
Patient/
Family
Evaluations
A milestone from General Surgery
Pulling the Data Together
End-ofRotation
Evaluations
Clinical Skills
Assessment
Nursing and
Staff / Techs
Evaluations
Quality
Improvement
Activities
Sim
Lab
Clinical Competency
Committee
Progress on Milestones
In-service
training
exams
Safety
Incident
Reports
Case
Logs
Patient/
Family
Evaluations
A milestone from General Surgery
Managing it all:
How will I pull this off?
The Toolbox
Creating a Resident Performance Profile Goals to
support your CCC
Resident performance data that is:
• Comprehensive
• Consolidated / Aggregated
• Easy for CCC to identify strengths, areas for
improvement, opportunities for
advancement
Creating a Resident Performance Profile
Step 1 – Defining what to track
Evaluations
Milestone End of Rotation (Total)
Medical Knowledge
Patient Care
Interpersonal & Communication Skills
Professionalism
Systems-Based Practice
Practice-Based Learning & Improvement
More tools…
Leveraging Resident Management System
(RMS)Tools, if Available
• RMSs – becoming more feature rich
• Curriculum
– Goals and Objectives and learning outcomes by
rotation
– Teaching and Assessment methodologies
• Evaluation tool development
– Sharing between programs and institutions
He was so lonely he needed his comfort blanket
Links to other sessions’ slides I attended…
• Katie’s Presentation Slides
http://www.acgme.org/acgmeweb/Portals/0/PDFs/2014AEC-Presentations/BR11.pdf
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/122
*****
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/187 ****
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/215
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/216
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/119
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/217
• hthttps://quickstart.quickmobile.com/cms/resources/render/3698/1/131
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/184
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/247
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/248
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/53
• https://quickstart.quickmobile.com/cms/resources/render/3698/1/54
• http://med.stanford.edu/gme/GME_Community.html ******