Results of the 2014 NRMP
Program Director Survey
All rights reserved. Permission to use, copy and/or distribute any
documentation and/or related images from this publication shall be
expressly obtained from the NRMP.
June 2014
www.nrmp.org
Requests for permission to use these data as well as questions about the content of this
publication or the National Resident Matching Program data and reports may be directed to
Mei Liang, Director of Research, NRMP, at datarequest@nrmp.org.
Questions about the NRMP should be directed to Mona M. Signer, Executive Director, NRMP,
at support@nrmp.org.
Suggested Citation
National Resident Matching Program, Data Release and Research Committee: Results of the
2014 NRMP Program Director Survey. National Resident Matching Program, Washington, DC.
2014.
Copyright © 2014 National Resident Matching Program.
Table of Contents
Introduction .................................................................................................................................................................. 1
All Specialties............................................................................................................................................................... 2
Charts for Individual Specialties
Anesthesiology ....................................................................................................................................................... 8
Child Neurology ................................................................................................................................................... 14
Dermatology ......................................................................................................................................................... 20
Emergency Medicine ........................................................................................................................................... 26
Family Medicine ................................................................................................................................................... 32
Internal Medicine.................................................................................................................................................. 38
Internal Medicine/Pediatrics ................................................................................................................................. 44
Neurological Surgery............................................................................................................................................ 50
Neurology ............................................................................................................................................................. 56
Obstetrics and Gynecology .................................................................................................................................. 62
Orthopaedic Surgery ............................................................................................................................................. 68
Otolaryngology ..................................................................................................................................................... 74
Pathology .............................................................................................................................................................. 80
Pediatrics .............................................................................................................................................................. 86
Physical Medicine and Rehabilitation .................................................................................................................. 92
Plastic Surgery ...................................................................................................................................................... 98
Psychiatry ........................................................................................................................................................... 104
Radiation Oncology ............................................................................................................................................ 110
Radiology-Diagnostic ......................................................................................................................................... 116
Surgery ............................................................................................................................................................... 122
Thoracic Surgery ................................................................................................................................................ 128
Transitional Year ................................................................................................................................................ 134
Vascular Surgery ................................................................................................................................................ 140
Introduction
In March 2014, the National Resident Matching Program
(NRMP) conducted its biennial survey of the directors of all
programs participating in the Main Residency Match®. The
primary purpose of the survey was to shed light on the factors
that program directors use to (1) select applicants to interview
and (2) rank applicants for the Match.
Several changes were made to the 2014 questionnaire. In the
past, program directors were asked to indicate factors they
used in selecting applicants to interview and to rate the
importance of each factor in ranking. In this survey, program
directors were asked to indicate factors they used in selecting
applicants to interview and rank respectively. They were
asked to rate the importance on a scale of 1 to 5 only for the
factors they used in their selection process. In addition, this
survey asked program directors how they handled unfilled
positions after the 2013 Match and SOAP. Because the
number of responses for that question was small, the results
are only reported in the "All Specialties" section.
The survey was fielded during the 18 days between the rank
order list deadline and Match Week so that program match
outcomes would not influence respondents' answers.
The survey solicited information on:
 the number of applications received, screened, and
reviewed, as well as the number of applicants interviewed
and ranked
 whether the program typically interviews and ranks specific
applicant groups
 use of test scores in considering which applicants to
interview, and
 the factors used for both interview selection and for ranking
applicants.
Numbers of responses are presented in most of the graphs.
Some graphs use data from multiple survey questions. In
those cases, different N's are listed. Numbers of applicants
ranked and positions in the Match are extracted from the
NRMP database. Graphs are suppressed for questions with
fewer than five responses.
The overall response rate for all specialties in this report was
52.7 percent. Transitional Year and 22 specialties with 10 or
more responses are included in this report. Their response rates
are listed in the table below. Response rates for those
specialties ranged from a high of 65.4 percent for Emergency
Medicine and Pediatrics to a low of 42.6 for Radiology.
_______________
Specialty
Anesthesiology
Child Neurology
Dermatology
Emergency Medicine
Family Medicine
Internal Medicine
Internal Medicine/Pediatrics
Neurological Surgery
Neurology
Obstetrics and Gynecology
Orthopaedic Surgery
Otolaryngology
Pathology
Pediatrics
Physical Medicine and Rehabilitation
Plastic Surgery
Psychiatry
Radiation Oncology
Radiology‐Diagnostic
Surgery
Thoracic Surgery
Transitional Year
Vascular Surgery
All others
Total
NRMP Program Director Survey Results, 2014
This report presents results by specialty on selected items
from the survey. The NRMP hopes that program directors,
medical school officials, and applicants find these data
useful as they prepare for and participate in the Main
Residency Match.
The NRMP's data reporting and research activities are guided by
its Data Release and Research Committee. NRMP data and
reports can be found at: www.nrmp.org/match-data/.
Surveys Sent Num ber Responding Response Rate
127
72
110
159
429
379
80
102
129
230
147
100
134
185
77
63
180
84
176
275
25
91
44
101
3,499
1
71
41
60
104
236
197
35
55
60
123
87
46
84
121
34
39
84
44
75
121
12
47
22
46
1,844
55.9%
56.9%
54.5%
65.4%
55.0%
52.0%
43.8%
53.9%
46.5%
53.5%
59.2%
46.0%
62.7%
65.4%
44.2%
61.9%
46.7%
52.4%
42.6%
44.0%
48.0%
51.6%
50.0%
45.5%
52.7%
All Specialties Combined
(N=1,844)
Figure 1
All Specialties
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=1,793)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
Average Rating
4.1
Letters of recommendation in the specialty
94%
86%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
84%
4.0
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
4.2
80%
78%
4.1
3.6
75%
4.1
Grades in required clerkships
70%
4.0
Gaps in medical education
70%
4.1
Honors in clinical clerkships
69%
4.0
Perceived commitment to specialty
69%
69%
Class ranking/quartile
4.3
3.9
Evidence of professionalism and ethics
65%
Personal prior knowledge of the applicant
65%
4.1
Audition elective/rotation within your department
4.0
Leadership qualities
63%
63%
Honors in clerkship in desired specialty
61%
4.3
Grades in clerkship in desired specialty
61%
61%
4.3
Alpha Omega Alpha (AOA) membership
4.5
4.0
3.8
Pass USMLE Step2 CS/COMLEX Lvl2 PE
57%
4.1
Perceived interest in program
4.1
Consistency of grades
57%
56%
Other life experience
56%
3.6
Volunteer/extracurricular experiences
54%
3.6
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
4.0
3.8
48%
43%
Visa status*
3.7
4.0
39%
34%
Applicant was flagged with Match violation by the NRMP
4.8
3.7
Interest in academic career
28%
Honors in basic sciences
27%
Gold Society membership
3.7
Away rotation in your specialty at another institution
27%
25%
Fluency in language spoken by your patient population
25%
3.6
USMLE/COMLEX Step 3 score
100%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
3
3.5
3.7
18%
50%
0% 1
2
3.5
3
4
5
Figure 2
All Specialties
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=1,799)
Percent Citing Factor
Interactions with faculty during interview and visit 93%
Interpersonal skills 93%
Interactions with house staff during interview and visit
88%
Feedback from current residents
82%
USMLE Step 1/COMLEX Level 1 score
80%
Letters of recommendation in the specialty
74%
USMLE Step 2 CK/COMLEX Level 2 CE score
71%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
68%
Perceived commitment to specialty
67%
Evidence of professionalism and ethics
64%
Perceived interest in program
62%
Leadership qualities
60%
Personal prior knowledge of the applicant
58%
Class ranking/quartile
57%
Graduate of U.S. allopathic medical school
57%
Personal Statement
55%
Audition elective/rotation within your department
55%
Grades in required clerkships
51%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
50%
Honors in clinical clerkships
49%
Honors in clerkship in desired specialty
45%
Gaps in medical education
45%
Grades in clerkship in desired specialty
45%
Alpha Omega Alpha (AOA) membership
45%
Other life experience
44%
Consistency of grades
40%
Volunteer/extracurricular experiences
40%
Demonstrated involvement and interest in research
36%
Graduate of highly regarded U.S. medical school
36%
Other post‐interview contact
33%
Interest in academic career
26%
Visa status*
23%
Applicant was flagged with Match violation by the NRMP
22%
Fluency in language spoken by your patient population
20%
Gold Society membership
20%
Honors in basic sciences
20%
Second interview/visit
19%
Away rotation in your specialty at another institution
17%
USMLE/COMLEX Step 3 score
15%
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
4
Average Rating
2
4.8
4.8
4.7
4.6
4.1
4.1
4.1
4.0
4.3
4.5
4.1
4.1
4.3
4.0
4.1
3.6
4.3
4.0
4.1
4.0
4.2
4.1
4.2
4.0
3.7
4.0
3.7
3.7
3.9
4.0
3.8
4.0
4.7
3.8
3.8
3.5
3.7
3.9
3.7
3
4
5
All Specialties
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure 3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
100%
Would your program consider applicants who fail the
exam on the first attempt?
N=1,746
N=1,601
100%
80%
80%
68%
63%
60%
40%
60%
40%
31%
26%
20%
0%
20%
1%
Yes, pass only
Yes, target score
0%
No
11%
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
100%
N=1,672
N=1,417
100%
80%
80%
60%
40%
58%
60%
50%
40%
31%
19%
20%
35%
20%
6%
0%
Yes, pass only
Yes, target score
0%
No
Never
Seldom
often
USMLE Step 1 and Step 2 CK Scores
Programs Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
USMLE Step 1
N=989
170
USMLE Step 2 CK
N=688
USMLE Step 1
N=684
USMLE Step 2 CK
N=508
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol in the box represents the mean.
NRMP Program Director Survey Results, 2014
5
All Specialties
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure 4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 Clinical Skills (CS)
USMLE Step 3
N=1,604
100%
90%
90%
80%
N=1,049
100%
78%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
22%
20%
20%
10%
18%
11%
10%
N=61
0%
71%
Yes
0%
No
N=41
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
90%
90%
80%
80%
70%
70%
60%
60%
50%
40%
50%
41%
40%
36%
30%
23%
20%
10%
10%
Yes, pass only
Yes, target score
33%
33%
34%
Yes, pass only
Yes, target score
No
30%
20%
0%
N=1,102
100%
N=1,140
0%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
COMLEX-USA Level 3*
N=1,057
100%
90%
90%
80%
80%
70%
70%
60%
50%
73%
60%
50%
50%
38%
40%
40%
30%
30%
20%
20%
12%
10%
0%
N=789
100%
17%
10%
10%
Yes, pass only
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
6
Yes, pass only
Yes, target score
No
All Specialties
Program's Interview Activities
Figure 5
Average Percentage of Applicants Rejected and Reviewed
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
900
100%
856
90%
800
80%
700
70%
600
60%
500
50%
51%
44%
40%
400
30%
300
20%
200
119
10%
96
100
77
0%
7
Percentage of applications rejected
0
Number of
positions in the
Match
Number of
applications
received
N=1,844*
N=1,799
Number of
interview
invitations sent
Number of
applicants
interviewed
N=1,776
Number of
applicants ranked
N=1,791
N=1,844*
Percentage of applicants receiving
an in-depth review
N=1,733
N=1,799
* Data from the NRMP database. All Responding programs included
Percentage of Programs that Typically Interview and Rank Each Applicant Type
100%
99%
31% of all programs consider all applicant groups
90%
80%
71%
69%
70%
60%
60%
51%
50%
40%
48%
35%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
Osteopathic
Physician
Canadian
Fifth Pathway
U.S. IMG
Non-U.S. IMG
N=1,772
Preferred Type of Communication About Applicants During SOAP
100%
90%
80%
70%
60%
59%
50%
40%
30%
24%
20%
15%
10%
2%
0%
We want to receive only the
ERAS application
We want to be contacted by
the applicant’s medical
school after we have initiated
contact with the applicant
We will initiate contact with
references and/or the
medical school, but we do
not wish to be contacted
N=1,582
NRMP Program Director Survey Results, 2014
7
Other
Anesthesiology
(N=71)
NRMP Program Director Survey Results, 2014
8
Figure AN-1
Anesthesiology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=67)
Percent Citing Factor
Average Rating
USMLE Step 1/COMLEX Level 1 score 99%
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
4.5
81%
3.9
87%
4.2
82%
4.1
78%
3.4
85%
4.1
69%
Gaps in medical education
75%
Honors in clinical clerkships
75%
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
4.2
4.0
60%
4.1
70%
75%
Audition elective/rotation within your department
75%
4.5
4.2
4.0
67%
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Volunteer/extracurricular experiences
4.2
69%
3.8
46%
4.0
69%
4.2
60%
3.6
57%
3.6
52%
Demonstrated involvement and interest in research
51%
3.7
3.4
Visa status*
45%
Applicant was flagged with Match violation by the NRMP
45%
Interest in academic career
3.2
3.3
36%
Away rotation in your specialty at another institution
3.8
25%
13%
Fluency in language spoken by your patient population
9
4.9
40%
Gold Society membership
NRMP Program Director Survey Results, 2014
3.8
27%
Honors in basic sciences
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.9
51%
Graduate of highly regarded U.S. medical school
USMLE/COMLEX Step 3 score
100%
4.2
52%
Perceived interest in program
Other life experience
4.2
48%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Consistency of grades
4.2
81%
Personal prior knowledge of the applicant
Leadership qualities
4.1
2.9
3.8
15%
50%
0% 1
2
3.1
3
4
5
Figure AN-2
Anesthesiology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=67)
Percent Citing Factor
Interactions with faculty during interview and visit 96%
Interpersonal skills
91%
Interactions with house staff during interview and visit
85%
Feedback from current residents
81%
USMLE Step 1/COMLEX Level 1 score
88%
Letters of recommendation in the specialty
65%
USMLE Step 2 CK/COMLEX Level 2 CE score
69%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
74%
Perceived commitment to specialty
72%
Evidence of professionalism and ethics
76%
Perceived interest in program
69%
Leadership qualities
75%
Personal prior knowledge of the applicant
66%
Class ranking/quartile
75%
Graduate of U.S. allopathic medical school
59%
Personal Statement
60%
Audition elective/rotation within your department
68%
Grades in required clerkships
59%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
43%
Honors in clinical clerkships
54%
Honors in clerkship in desired specialty
37%
Gaps in medical education
49%
Grades in clerkship in desired specialty
41%
Alpha Omega Alpha (AOA) membership
56%
Other life experience
51%
Consistency of grades
59%
Volunteer/extracurricular experiences
41%
Demonstrated involvement and interest in research
38%
Graduate of highly regarded U.S. medical school
43%
Other post‐interview contact
28%
Interest in academic career
19%
Visa status*
21%
Applicant was flagged with Match violation by the NRMP
21%
7%
Fluency in language spoken by your patient population
Gold Society membership
26%
Honors in basic sciences
29%
Second interview/visit
16%
Away rotation in your specialty at another institution
10%
USMLE/COMLEX Step 3 score
13%
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
10
Average Rating
4.8
4.8
4.7
4.6
4.2
3.8
4.2
4.2
4.2
4.4
4.0
4.1
4.3
4.1
4.3
3.3
4.1
4.1
4.1
4.0
4.0
3.9
3.9
3.8
3.7
4.0
3.6
3.5
3.9
3.7
3.2
3.9
4.7
3.4
3.8
3.7
3.3
3.7
3.4
2
3
4
5
Anesthesiology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure AN-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=68
100%
90%
90%
80%
80%
70%
70%
60%
50%
40%
43%
40%
30%
30%
15%
20%
10%
0%
57%
60%
50%
20%
N=63
100%
85%
10%
0%
Yes, pass only
Yes, target score
0%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=64
N=53
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
48%
50%
50%
40%
30%
55%
45%
40%
28%
23%
30%
20%
20%
10%
10%
0%
0%
Yes, pass only
Yes, target score
No
0%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=53
N=30
N=42
USMLE Step 2 CK
N=26
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
11
Anesthesiology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure AN-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=61
100%
90%
90%
80%
80%
70%
N=41
100%
73%
70%
64%
60%
60%
50%
50%
36%
40%
40%
30%
30%
20%
20%
N=61
10%
0%
20%
N=41 7%
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=45
90%
90%
80%
80%
70%
70%
60%
60%
53%
50%
50%
40%
40%
30%
24%
22%
30%
20%
20%
10%
10%
0%
Yes, pass only
Yes, target score
N=43
0%
No
42%
33%
26%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=38
90%
90%
80%
80%
70%
70%
47%
45%
50%
40%
40%
30%
30%
20%
20%
8%
10%
0%
73%
60%
60%
50%
N=30
Yes, pass only
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
13%
13%
Yes, pass only
Yes, target score
10%
12
No
Figure AN-5
Anesthesiology
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
704
700
70%
600
60%
500
400
46%
Percentage of applications
rejected
Percentage of applicants
receiving an in-depth review
40%
300
30%
200
152
142
100
0
47%
50%
20%
102
10%
7
Number of
positions in the
Match
N=71*
Number of
applications
received
N=68
Number of
interview
invitations sent
Number of
applicants
interviewed
N=67
N=68
0%
Number of
applicants
ranked
N=71*
N=66
N=68
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
30% of Anesthesiology programs consider all applicant groups
100%
N=67
90%
85%
84%
80%
70%
60%
55%
52%
50%
40%
51%
31%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
13
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Child Neurology
(N=41)
NRMP Program Director Survey Results, 2014
14
Figure CN-1
Child Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=40)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
Average Rating
93%
3.9
Letters of recommendation in the specialty 98%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
4.3
95%
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
4.2
80%
83%
Graduate of U.S. allopathic medical school
Grades in required clerkships
3.9
3.7
65%
80%
4.1
Gaps in medical education
57%
Honors in clinical clerkships
83%
Perceived commitment to specialty
83%
Class ranking/quartile
Evidence of professionalism and ethics
Leadership qualities
4.2
73%
3.9
70%
3.9
78%
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
4.1
4.3
4.0
73%
4.3
57%
4.0
55%
3.5
60%
3.7
63%
3.6
60%
3.8
35%
3.6
28%
Away rotation in your specialty at another institution
3.4
23%
28%
Fluency in language spoken by your patient population
15
4.7
18%
Gold Society membership
NRMP Program Director Survey Results, 2014
4.0
40%
Honors in basic sciences
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.9
45%
Applicant was flagged with Match violation by the NRMP
USMLE/COMLEX Step 3 score
100%
3.5
53%
Visa status*
Interest in academic career
3.6
57%
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
3.5
68%
Grades in clerkship in desired specialty
Perceived interest in program
4.2
57%
78%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
3.8
63%
Honors in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
4.1
4.1
Personal prior knowledge of the applicant
Audition elective/rotation within your department
4.0
3.5
3.8
53%
50%
0% 1
2
3
4
5
Figure CN-2
Child Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=40)
Percent Citing Factor
Interactions with faculty during interview and visit 95%
Interpersonal skills
93%
Interactions with house staff during interview and visit
90%
Feedback from current residents
75%
USMLE Step 1/COMLEX Level 1 score
83%
Letters of recommendation in the specialty
90%
USMLE Step 2 CK/COMLEX Level 2 CE score
75%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
83%
Perceived commitment to specialty
75%
Evidence of professionalism and ethics
68%
Perceived interest in program
78%
Leadership qualities
60%
Personal prior knowledge of the applicant
57%
Class ranking/quartile
50%
Graduate of U.S. allopathic medical school
48%
Personal Statement
70%
Audition elective/rotation within your department
60%
Grades in required clerkships
57%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
73%
Honors in clinical clerkships
57%
Honors in clerkship in desired specialty
57%
Gaps in medical education
38%
Grades in clerkship in desired specialty
55%
Alpha Omega Alpha (AOA) membership
35%
Other life experience
45%
Consistency of grades
33%
Volunteer/extracurricular experiences
43%
Demonstrated involvement and interest in research
65%
Graduate of highly regarded U.S. medical school
43%
Other post‐interview contact
45%
Interest in academic career
50%
Visa status*
20%
Applicant was flagged with Match violation by the NRMP
20%
Fluency in language spoken by your patient population
20%
10%
Gold Society membership
Honors in basic sciences
25%
Second interview/visit
30%
Away rotation in your specialty at another institution
18%
45%
USMLE/COMLEX Step 3 score
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
16
Average Rating
4.7
4.7
4.6
4.5
3.9
4.1
4.0
4.1
4.5
4.3
4.2
4.0
4.1
4.2
4.1
3.9
4.1
4.1
4.0
4.2
4.3
4.1
4.2
3.9
3.7
4.1
4.1
3.7
4.1
4.2
3.9
3.8
4.6
3.8
3.8
4.2
3.9
4.4
4.0
2
3
4
5
Child Neurology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure CN-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=39
100%
90%
80%
62%
70%
60%
60%
50%
50%
38%
40%
30%
30%
20%
20%
10%
0%
76%
80%
70%
40%
N=37
100%
90%
10%
0%
Yes, pass only
Yes, target score
22%
3%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=38
N=34
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
65%
50%
37%
40%
30%
32%
30%
20%
20%
13%
10%
10%
0%
0%
Yes, pass only
Yes, target score
No
3%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=16
N=11
N=11
USMLE Step 2 CK
N=8
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
17
Child Neurology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure CN-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=37
100%
89%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
0%
Yes
39%
29%
32%
20%
11%
N=37
10%
N=31
100%
N=31
10%
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=26
90%
90%
80%
80%
70%
70%
60%
60%
50%
40%
50%
42%
38%
40%
42%
35%
30%
30%
19%
20%
23%
20%
10%
10%
0%
N=26
Yes, pass only
Yes, target score
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=23
90%
90%
80%
80%
70%
70%
60%
60%
50%
40%
50%
39%
39%
30%
40%
22%
30%
20%
20%
10%
10%
0%
N=20
Yes, pass only
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
18
35%
40%
25%
Yes, pass only
Yes, target score
No
Figure CN-5
Child Neurology
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
500
49%
50%
400
40%
300
30%
200
20%
85
100
0
58%
60%
2
Number of
positions in the
Match
N=41*
Number of
applications
received
N=39
10%
25
18
13
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=39
N=39
0%
Percentage of applications
rejected
N=41*
Percentage of applicants
receiving an in-depth review
N=39
N=39
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
43% of Child Neurology programs consider all applicant groups
100%
N=40
90%
80%
73%
78%
68%
70%
68%
60%
60%
50%
45%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
19
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Dermatology
(N=60)
NRMP Program Director Survey Results, 2014
20
Figure D-1
Dermatology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=59)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
92%
Letters of recommendation in the specialty
93%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
4.3
4.5
83%
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
4.0
64%
4.1
85%
4.0
59%
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
4.2
64%
4.2
Gaps in medical education
Honors in clinical clerkships
Average Rating
42%
3.6
76%
4.3
73%
4.5
59%
4.3
64%
4.6
75%
4.5
Audition elective/rotation within your department
64%
4.4
Leadership qualities
63%
4.3
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
4.5
69%
4.4
58%
4.0
64%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
4.2
61%
4.3
68%
3.8
54%
3.9
53%
4.1
49%
3.9
39%
4.2
22%
Away rotation in your specialty at another institution
3.9
29%
15%
Fluency in language spoken by your patient population
21
4.9
17%
Gold Society membership
NRMP Program Director Survey Results, 2014
4.1
24%
Honors in basic sciences
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.8
46%
Applicant was flagged with Match violation by the NRMP
USMLE/COMLEX Step 3 score
100%
3.7
51%
Visa status*
Interest in academic career
4.1
25%
3.1
10%
50%
0% 1
2
4.0
3
4
5
Figure D-2
Dermatology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=59)
Percent Citing Factor
Average Rating
Interactions with faculty during interview and visit 97%
Interpersonal skills 95%
Interactions with house staff during interview and visit 95%
Feedback from current residents
80%
USMLE Step 1/COMLEX Level 1 score
59%
Letters of recommendation in the specialty
71%
USMLE Step 2 CK/COMLEX Level 2 CE score
39%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
51%
Perceived commitment to specialty
64%
Evidence of professionalism and ethics
68%
Perceived interest in program
63%
Leadership qualities
54%
Personal prior knowledge of the applicant
49%
Class ranking/quartile
34%
Graduate of U.S. allopathic medical school
34%
Personal Statement
46%
Audition elective/rotation within your department
47%
Grades in required clerkships
37%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
20%
Honors in clinical clerkships
49%
Honors in clerkship in desired specialty
34%
Gaps in medical education
20%
Grades in clerkship in desired specialty
34%
Alpha Omega Alpha (AOA) membership
36%
Other life experience
39%
Consistency of grades
34%
Volunteer/extracurricular experiences
37%
Demonstrated involvement and interest in research
39%
Graduate of highly regarded U.S. medical school
22%
Other post‐interview contact
22%
Interest in academic career
39%
Visa status*
5%
Applicant was flagged with Match violation by the NRMP
14%
7%
Fluency in language spoken by your patient population
Gold Society membership
15%
Honors in basic sciences
27%
Second interview/visit
3%
2.0
Away rotation in your specialty at another institution
20%
USMLE/COMLEX Step 3 score
7%
100%
50%
0% 1 2
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
22
4.9
4.9
4.9
4.8
4.1
4.2
3.9
4.0
4.4
4.6
4.1
4.3
4.6
4.2
4.2
3.9
4.7
4.3
3.8
4.2
4.5
4.0
4.3
3.9
4.0
4.3
4.0
4.1
3.7
3.6
4.1
4.3
4.6
3.8
3.8
3.6
3.9
3.8
3
4
5
Dermatology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure D-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=57
100%
82%
90%
80%
80%
70%
70%
60%
50%
40%
43%
40%
30%
30%
18%
20%
10%
0%
57%
60%
50%
20%
N=51
100%
90%
10%
0%
Yes, pass only
Yes, target score
0%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=51
N=38
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
47%
50%
50%
40%
30%
39%
40%
29%
30%
24%
20%
20%
10%
10%
0%
0%
Yes, pass only
58%
Yes, target score
No
3%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=43
N=19
N=13
USMLE Step 2 CK
N=8
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
23
Dermatology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure D-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=46
100%
N=24
100%
90%
90%
80%
80%
74%
70%
70%
60%
60%
50%
50%
40%
40%
26%
30%
30%
20%
20%
N=46
10%
0%
71%
17%
N=24
10%
Yes
0%
No
Yes, pass only
13%
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=17
90%
90%
80%
80%
70%
65%
80%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
N=15
18%
18%
20%
10%
10%
0%
0%
Yes, pass only
Yes, target score
No
13%
7%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=15
90%
80%
80%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
13%
7%
10%
0%
92%
80%
70%
20%
N=12
90%
Yes, pass only
Yes, target score
10%
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
24
8%
0%
Yes, pass only
Yes, target score
No
Figure D-5
Dermatology
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
500
50%
412
400
40%
300
33%
30%
200
20%
100
0
58%
60%
4
Number of
positions in the
Match
N=60*
Number of
applications
received
N=59
43
36
32
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=59
N=59
10%
0%
Percentage of applications
rejected
N=60*
Percentage of applicants
receiving an in-depth review
N=54
N=59
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
18% of Dermatology programs consider all applicant groups
100%
N=57
90%
80%
74%
70%
60%
50%
40%
35%
30%
30%
26%
26%
U.S. IMG
Non-U.S. IMG
19%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
25
Fifth Pathway
Emergency Medicine
(N=104)
NRMP Program Director Survey Results, 2014
26
Figure EM-1
Emergency Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=101)
Percent Citing Factor
Average Rating
USMLE Step 1/COMLEX Level 1 score 97%
3.9
Letters of recommendation in the specialty 99%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
4.8
91%
3.9
94%
4.0
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
67%
3.0
4.0
83%
3.8
88%
3.8
72%
Honors in clinical clerkships
82%
4.0
Perceived commitment to specialty
81%
4.1
Class ranking/quartile
83%
3.7
Evidence of professionalism and ethics
69%
4.4
Personal prior knowledge of the applicant
68%
4.3
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
4.4
87%
3.9
80%
4.6
86%
4.6
90%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
3.9
50%
3.9
65%
Consistency of grades
Other life experience
3.7
75%
3.8
52%
3.5
72%
Volunteer/extracurricular experiences
63%
Graduate of highly regarded U.S. medical school
61%
Demonstrated involvement and interest in research
3.6
3.4
3.1
43%
Visa status*
3.9
37%
Applicant was flagged with Match violation by the NRMP
29%
Interest in academic career
30%
Honors in basic sciences
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
27
3.0
3.3
39%
4.3
78%
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
100%
3.5
22%
Gold Society membership
Away rotation in your specialty at another institution
4.6
3.2
22%
18%
50%
0% 1
2
3.4
3
4
5
Figure EM-2
Emergency Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=101)
Percent Citing Factor
Interactions with faculty during interview and visit
89%
Interpersonal skills 93%
Interactions with house staff during interview and visit
91%
Feedback from current residents
88%
USMLE Step 1/COMLEX Level 1 score
86%
Letters of recommendation in the specialty
87%
USMLE Step 2 CK/COMLEX Level 2 CE score
80%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
75%
Perceived commitment to specialty
66%
Evidence of professionalism and ethics
61%
Perceived interest in program
62%
Leadership qualities
74%
Personal prior knowledge of the applicant
63%
Class ranking/quartile
63%
Graduate of U.S. allopathic medical school
62%
Personal Statement
43%
Audition elective/rotation within your department
75%
Grades in required clerkships
60%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
44%
Honors in clinical clerkships
57%
Honors in clerkship in desired specialty
71%
Gaps in medical education
41%
Grades in clerkship in desired specialty
71%
Alpha Omega Alpha (AOA) membership
50%
Other life experience
58%
Consistency of grades
31%
Volunteer/extracurricular experiences
51%
Demonstrated involvement and interest in research
28%
Graduate of highly regarded U.S. medical school
41%
Other post‐interview contact
36%
Interest in academic career
23%
Visa status*
23%
Applicant was flagged with Match violation by the NRMP
23%
20%
Fluency in language spoken by your patient population
Gold Society membership
28%
16%
Honors in basic sciences
Second interview/visit
26%
Away rotation in your specialty at another institution
63%
USMLE/COMLEX Step 3 score
11%
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
28
Average Rating
4.8
4.8
4.7
4.6
3.8
4.7
4.0
3.8
4.1
4.5
4.0
4.1
4.4
3.8
4.1
3.0
4.5
3.8
3.9
4.0
4.4
3.6
4.4
3.9
3.7
3.8
3.8
3.4
3.8
3.9
3.6
4.0
4.5
3.6
3.6
2.9
3.4
4.3
3.5
2
3
4
5
Emergency Medicine
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure EM-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=97
100%
90%
80%
80%
69%
70%
60%
50%
30%
50%
40%
31%
30%
20%
19%
20%
10%
0%
76%
70%
60%
40%
N=94
100%
90%
10%
0%
Yes, pass only
Yes, target score
5%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=96
N=85
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
54%
50%
50%
40%
40%
30%
20%
20%
10%
10%
0%
0%
Yes, pass only
Yes, target score
48%
30%
24%
22%
52%
No
Never
0%
often
Seldom
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=62
N=46
N=41
USMLE Step 2 CK
N=34
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
29
Emergency Medicine
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure EM-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=88
100%
N=55
100%
90%
90%
80%
80%
66%
70%
73%
70%
60%
60%
50%
50%
40%
40%
34%
30%
30%
20%
20%
N=88
10%
0%
15%
Yes
0%
No
13%
N=55
10%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=68
90%
90%
80%
80%
70%
70%
60%
60%
40%
40%
37%
40%
30%
24%
20%
20%
10%
10%
0%
48%
50%
50%
30%
N=66
Yes, pass only
Yes, target score
0%
No
29%
23%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=58
90%
90%
80%
80%
70%
50%
30%
60%
50%
40%
31%
30%
20%
20%
10%
10%
0%
78%
70%
59%
60%
40%
N=45
Yes, pass only
Yes, target score
10%
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
30
11%
11%
Yes, pass only
Yes, target score
No
Figure EM-5
Emergency Medicine
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
1,000
Average Percentage of Applicants Rejected and
Reviewed
100%
900
90%
830
800
80%
700
70%
600
60%
500
56%
50%
41%
400
40%
300
30%
174
200
138
20%
123
100
10%
11
0
Number of
positions in the
Match
N=104*
Number of
applications
received
N=104
Number of
interview
invitations sent
Number of
applicants
interviewed
N=101
N=103
0%
Number of
applicants
ranked
Percentage of applications
rejected
N=104*
Percentage of applicants
receiving an in-depth review
N=99
N=104
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
20% of Emergency Medicine programs consider all applicant groups
100%
N=101
90%
80%
72%
77%
70%
60%
47%
50%
40%
35%
30%
24%
22%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
31
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Family Medicine
(N=236)
NRMP Program Director Survey Results, 2014
32
Figure FM-1
Family Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=227)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
91%
3.8
83%
87%
Personal Statement
87%
4.0
4.1
3.9
78%
Grades in required clerkships
Gaps in medical education
4.0
80%
USMLE Step 2 CK/COMLEX Level 2 CE score
Graduate of U.S. allopathic medical school
4.1
68%
3.9
81%
4.3
Honors in clinical clerkships
Perceived commitment to specialty
52%
4.5
56%
Evidence of professionalism and ethics
70%
Personal prior knowledge of the applicant
69%
Audition elective/rotation within your department
70%
Leadership qualities
3.5
4.6
4.2
4.0
3.9
60%
Honors in clerkship in desired specialty
Other life experience
Volunteer/extracurricular experiences
4.2
81%
4.2
65%
3.7
63%
3.8
65%
4.3
56%
4.8
38%
3.2
8%
20%
Honors in basic sciences
Gold Society membership
2.9
3.5
25%
Away rotation in your specialty at another institution
3.2
12%
42%
Fluency in language spoken by your patient population
33
3.3
10%
Interest in academic career
NRMP Program Director Survey Results, 2014
3.6
40%
Applicant was flagged with Match violation by the NRMP
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.8
54%
Demonstrated involvement and interest in research
USMLE/COMLEX Step 3 score
100%
3.4
31%
Graduate of highly regarded U.S. medical school
Visa status*
4.1
51%
Alpha Omega Alpha (AOA) membership
Consistency of grades
3.9
44%
Grades in clerkship in desired specialty
Perceived interest in program
3.7
87%
Class ranking/quartile
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Average Rating
3.7
24%
50%
0% 1
2
3.4
3
4
5
Figure FM-2
Family Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=227)
Percent Citing Factor
Interactions with faculty during interview and visit 93%
Interpersonal skills 94%
Interactions with house staff during interview and visit
91%
Feedback from current residents
84%
USMLE Step 1/COMLEX Level 1 score
79%
Letters of recommendation in the specialty
67%
USMLE Step 2 CK/COMLEX Level 2 CE score
82%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
69%
Perceived commitment to specialty
84%
Evidence of professionalism and ethics
69%
Perceived interest in program
67%
Leadership qualities
59%
Personal prior knowledge of the applicant
64%
Class ranking/quartile
53%
Graduate of U.S. allopathic medical school
62%
Personal Statement
68%
Audition elective/rotation within your department
61%
Grades in required clerkships
50%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
77%
Honors in clinical clerkships
36%
Honors in clerkship in desired specialty
30%
Gaps in medical education
61%
Grades in clerkship in desired specialty
41%
Alpha Omega Alpha (AOA) membership
27%
Other life experience
52%
Consistency of grades
45%
Volunteer/extracurricular experiences
53%
Demonstrated involvement and interest in research
12%
Graduate of highly regarded U.S. medical school
31%
Other post‐interview contact
43%
8%
Interest in academic career
Visa status*
29%
Applicant was flagged with Match violation by the NRMP
25%
Fluency in language spoken by your patient population
34%
Gold Society membership
21%
Honors in basic sciences
13%
Second interview/visit
36%
Away rotation in your specialty at another institution
8%
USMLE/COMLEX Step 3 score
17%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
34
Average Rating
4.8
4.8
4.8
4.8
3.9
3.8
4.0
4.0
4.5
4.6
4.2
4.1
4.3
3.7
4.0
3.8
4.4
3.9
4.2
3.8
4.0
4.2
4.0
3.7
3.8
3.8
4.0
3.1
3.7
4.1
3.5
4.4
4.9
3.9
3.8
3.4
3.8
3.7
3.7
2
3
4
5
Family Medicine
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure FM-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=219
100%
90%
80%
80%
70%
60%
70%
57%
60%
60%
50%
42%
50%
40%
40%
30%
30%
20%
20%
10%
0%
N=205
100%
90%
10%
0%
Yes, pass only
Yes, target score
35%
5%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=213
N=194
100%
100%
90%
90%
80%
80%
70%
70%
60%
50%
60%
50%
50%
41%
40%
40%
30%
30%
20%
20%
8%
10%
0%
68%
10%
0%
Yes, pass only
Yes, target score
19%
13%
No
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=71
N=65
N=63
USMLE Step 2 CK
N=59
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
35
Family Medicine
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure FM-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=208
100%
89%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
0%
20%
11%
N=208
10%
N=126
100%
Yes
80%
13%
N=126 6%
10%
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=200
90%
90%
80%
80%
70%
60%
70%
61%
60%
56%
50%
50%
40%
40%
36%
30%
30%
20%
20%
10%
0%
N=193
4%
Yes, pass only
Yes, target score
32%
12%
10%
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=191
90%
80%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
16%
9%
10%
Yes, pass only
77%
80%
75%
70%
0%
N=117
90%
Yes, target score
20%
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
16%
7%
10%
36
Yes, pass only
Yes, target score
No
Figure FM-5
Family Medicine
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
1,149
1,000
Average Percentage of Applicants Rejected and
Reviewed
100%
900
90%
800
80%
700
70%
600
60%
500
50%
400
40%
300
30%
200
0
80
64
Number of
applicants
interviewed
Number of
applicants
ranked
10%
7
Number of
positions in the
Match
N=236*
Number of
applications
received
N=228
Number of
interview
invitations sent
29%
20%
106
100
68%
N=223
N=225
0%
Percentage of applications
rejected
N=236*
Percentage of applicants
receiving an in-depth review
N=215
N=228
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
36% of Family Medicine programs consider all applicant groups
100%
95%
N=224
90%
79%
80%
77%
70%
63%
60%
53%
47%
50%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
37
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Internal Medicine
(N=197)
NRMP Program Director Survey Results, 2014
38
Figure IM-1
Internal Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=194)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
Letters of recommendation in the specialty
Average Rating
92%
4.1
73%
3.8
Medical Student Performance Evaluation (MSPE/Dean's Letter)
90%
4.3
USMLE Step 2 CK/COMLEX Level 2 CE score
89%
4.2
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
66%
79%
4.0
70%
4.1
73%
4.1
65%
Perceived commitment to specialty
Class ranking/quartile
3.3
4.0
51%
3.7
74%
4.0
Evidence of professionalism and ethics
64%
Personal prior knowledge of the applicant
64%
4.4
3.8
Audition elective/rotation within your department
54%
Leadership qualities
53%
3.6
3.8
Honors in clerkship in desired specialty
57%
4.1
Grades in clerkship in desired specialty
59%
4.2
Alpha Omega Alpha (AOA) membership
58%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
4.3
75%
3.7
47%
4.0
55%
3.4
46%
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
3.9
3.8
45%
Demonstrated involvement and interest in research
3.7
40%
Applicant was flagged with Match violation by the NRMP
4.9
44%
Interest in academic career
29%
Away rotation in your specialty at another institution
9%
31%
Fluency in language spoken by your patient population
39
3.2
24%
Gold Society membership
NRMP Program Director Survey Results, 2014
3.5
21%
Honors in basic sciences
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.5
28%
Visa status*
USMLE/COMLEX Step 3 score
100%
3.5
38%
4.0
3.1
3.7
21%
50%
0% 1
2
3.5
3
4
5
Figure IM-2
Internal Medicine
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=194)
Percent Citing Factor
Interactions with faculty during interview and visit
92%
Interpersonal skills 95%
Interactions with house staff during interview and visit
82%
Feedback from current residents
73%
USMLE Step 1/COMLEX Level 1 score
83%
Letters of recommendation in the specialty
65%
USMLE Step 2 CK/COMLEX Level 2 CE score
86%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
79%
Perceived commitment to specialty
55%
Evidence of professionalism and ethics
64%
Perceived interest in program
55%
Leadership qualities
55%
Personal prior knowledge of the applicant
59%
Class ranking/quartile
71%
Graduate of U.S. allopathic medical school
69%
Personal Statement
52%
Audition elective/rotation within your department
47%
Grades in required clerkships
55%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
71%
Honors in clinical clerkships
51%
Honors in clerkship in desired specialty
52%
Gaps in medical education
54%
Grades in clerkship in desired specialty
52%
Alpha Omega Alpha (AOA) membership
51%
Other life experience
36%
Consistency of grades
46%
Volunteer/extracurricular experiences
29%
Demonstrated involvement and interest in research
27%
Graduate of highly regarded U.S. medical school
40%
Other post‐interview contact
21%
Interest in academic career
21%
Visa status*
36%
Applicant was flagged with Match violation by the NRMP
36%
28%
Fluency in language spoken by your patient population
Gold Society membership
25%
Honors in basic sciences
17%
Second interview/visit
13%
Away rotation in your specialty at another institution
7%
USMLE/COMLEX Step 3 score
24%
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
40
Average Rating
4.7
4.7
4.6
4.4
4.1
3.7
4.2
4.2
4.0
4.6
3.9
3.9
4.1
4.1
4.1
3.3
3.8
4.1
4.2
4.1
4.2
4.1
4.3
4.1
3.5
3.9
3.6
3.4
3.9
3.6
3.6
3.7
4.8
4.0
4.1
3.5
3.3
3.1
3.4
2
3
4
5
Internal Medicine
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure IM-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=184
100%
90%
80%
71%
70%
70%
60%
50%
50%
40%
40%
29%
30%
20%
20%
10%
10%
0%
77%
80%
60%
30%
N=173
100%
90%
1%
Yes, pass only
Yes, target score
16%
6%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=178
N=167
100%
100%
90%
90%
80%
80%
70%
65%
70%
60%
60%
50%
50%
40%
30%
40%
20%
11%
10%
10%
0%
Yes, pass only
33%
30%
25%
20%
0%
65%
Yes, target score
No
2%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=112
N=100
N=81
USMLE Step 2 CK
N=72
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
41
Internal Medicine
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure IM-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=172
100%
86%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
0%
20%
14%
N=172
10%
N=119
100%
76%
13%
N=119 12%
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=132
90%
90%
80%
80%
70%
70%
60%
60%
55%
40%
40%
28%
30%
17%
20%
27%
23%
20%
10%
10%
0%
50%
50%
50%
30%
N=130
Yes, pass only
Yes, target score
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=131
90%
90%
80%
80%
70%
70%
60%
57%
74%
60%
50%
50%
40%
40%
27%
30%
20%
30%
20%
15%
14%
12%
Yes, pass only
Yes, target score
10%
10%
0%
N=94
Yes, pass only
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
42
No
Figure IM-5
Internal Medicine
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
2,864
1,000
Average Percentage of Applicants Rejected and
Reviewed
100%
900
90%
800
80%
700
70%
600
60%
500
50%
61%
400
40%
309
300
178
200
20%
100
10%
18
0
Number of
positions in the
Match
N=197*
30%
30%
251
Number of
applications
received
N=190
Number of
interview
invitations sent
Number of
applicants
interviewed
N=187
N=189
0%
Number of
applicants
ranked
Percentage of applications
rejected
N=197*
Percentage of applicants
receiving an in-depth review
N=178
N=190
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
39% of Internal Medicine programs consider all applicant groups
97%
N=190
90%
85%
82%
80%
76%
74%
70%
63%
60%
50%
44%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
43
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Internal Medicine/Pediatrics
(N=35)
NRMP Program Director Survey Results, 2014
44
Figure IMP-1
Internal Medicine/Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=34)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
94%
4.1
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
4.1
74%
3.9
85%
3.6
71%
4.2
74%
4.2
82%
68%
Honors in clinical clerkships
68%
Perceived commitment to specialty
Class ranking/quartile
4.0
65%
Gaps in medical education
4.2
3.9
4.3
59%
4.2
74%
Evidence of professionalism and ethics
56%
Personal prior knowledge of the applicant
56%
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Consistency of grades
4.4
65%
4.6
68%
4.0
71%
3.8
59%
3.3
47%
3.5
62%
3.9
47%
2.9
24%
3.9
29%
Applicant was flagged with Match violation by the NRMP
4.8
24%
Interest in academic career
3.0
18%
Honors in basic sciences
3.4
24%
3.8
68%
Away rotation in your specialty at another institution
3.0
9%
15%
Fluency in language spoken by your patient population
45
4.1
41%
Visa status*
NRMP Program Director Survey Results, 2014
4.2
53%
Demonstrated involvement and interest in research
USMLE/COMLEX Step 3 score
100%
3.2
3.7
Graduate of highly regarded U.S. medical school
Gold Society membership
3.7
71%
Other life experience
Volunteer/extracurricular experiences
4.4
38%
Perceived interest in program
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
Average Rating
3.2
21%
50%
0% 1
2
3.6
3
4
5
Figure IMP-2
Internal Medicine/Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=34)
Percent Citing Factor
Interactions with faculty during interview and visit 94%
Interpersonal skills
86%
Interactions with house staff during interview and visit
91%
Feedback from current residents
86%
USMLE Step 1/COMLEX Level 1 score
89%
Letters of recommendation in the specialty
71%
USMLE Step 2 CK/COMLEX Level 2 CE score
83%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
71%
Perceived commitment to specialty
77%
Evidence of professionalism and ethics
77%
Perceived interest in program
49%
Leadership qualities
80%
Personal prior knowledge of the applicant
49%
Class ranking/quartile
83%
Graduate of U.S. allopathic medical school
54%
Personal Statement
57%
Audition elective/rotation within your department
34%
Grades in required clerkships
71%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
60%
Honors in clinical clerkships
60%
Honors in clerkship in desired specialty
57%
Gaps in medical education
60%
Grades in clerkship in desired specialty
57%
Alpha Omega Alpha (AOA) membership
71%
Other life experience
51%
Consistency of grades
46%
Volunteer/extracurricular experiences
66%
Demonstrated involvement and interest in research
31%
Graduate of highly regarded U.S. medical school
37%
Other post‐interview contact
26%
Interest in academic career
11%
Visa status*
17%
Applicant was flagged with Match violation by the NRMP
11%
9%
Fluency in language spoken by your patient population
Gold Society membership
40%
Honors in basic sciences
31%
Second interview/visit
11%
Away rotation in your specialty at another institution
9%
USMLE/COMLEX Step 3 score
11%
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
46
Average Rating
4.7
4.7
4.7
4.6
4.1
3.6
4.2
4.1
4.3
4.2
4.3
3.9
3.6
4.1
4.3
3.4
3.7
4.0
4.4
4.2
4.3
3.8
4.2
3.7
3.4
3.8
3.8
3.3
4.2
3.3
3.8
4.3
4.3
2.3
3.9
3.3
2.8
3.7
4.5
2
3
4
5
Internal Medicine/Pediatrics
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure IMP-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=34
100%
90%
76%
80%
80%
70%
60%
50%
50%
40%
40%
24%
29%
30%
20%
20%
10%
0%
71%
70%
60%
30%
N=31
100%
90%
10%
0%
Yes, pass only
Yes, target score
0%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=33
N=27
100%
100%
90%
90%
80%
80%
70%
70%
58%
60%
60%
50%
40%
30%
50%
40%
30%
30%
20%
20%
12%
10%
10%
0%
0%
Yes, pass only
52%
48%
Yes, target score
No
Never
0%
often
Seldom
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=23
N=18
N=20
USMLE Step 2 CK
N=14
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
47
Internal Medicine/Pediatrics
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure IMP-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=32
100%
88%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
0%
10%
Yes
79%
16%
20%
13%
N=32
10%
N=19
100%
0%
No
N=19
5%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=22
90%
90%
80%
80%
70%
70%
64%
60%
60%
50%
50%
40%
40%
30%
50%
32%
30%
23%
20%
14%
18%
20%
10%
10%
0%
N=22
Yes, pass only
Yes, target score
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=21
90%
90%
80%
80%
70%
70%
60%
57%
50%
40%
40%
30%
24%
20%
30%
19%
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
20%
20%
10%
10%
Yes, pass only
73%
60%
50%
0%
N=15
48
7%
Yes, pass only
Yes, target score
No
Figure IMP-5
Internal Medicine/Pediatrics
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
60%
500
42%
400
40%
300
245
30%
200
20%
100
0
48%
50%
69
53
49
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
N=35*
Number of
applications
received
N=34
N=35
N=35
0%
Percentage of applications
rejected
N=35*
Percentage of applicants
receiving an in-depth review
N=34
N=34
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
15% of Internal Medicine/Pediatrics programs consider all applicant groups
100%
N=34
90%
80%
70%
62%
60%
47%
50%
40%
35%
35%
26%
30%
21%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
49
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Neurological Surgery
(N=55)
NRMP Program Director Survey Results, 2014
50
Figure NS-1
Neurological Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=54)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
Average Rating
93%
4.4
Letters of recommendation in the specialty 98%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
4.7
81%
3.8
65%
4.0
78%
3.7
72%
4.3
Grades in required clerkships
59%
Gaps in medical education
61%
Honors in clinical clerkships
Perceived commitment to specialty
Leadership qualities
4.6
59%
3.9
74%
4.5
63%
4.3
4.2
67%
4.3
74%
Honors in clerkship in desired specialty
4.3
61%
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
4.2
80%
Personal prior knowledge of the applicant
Audition elective/rotation within your department
3.9
69%
Class ranking/quartile
Evidence of professionalism and ethics
4.3
4.3
44%
3.8
81%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
3.9
39%
Perceived interest in program
61%
Consistency of grades
61%
4.3
4.0
Other life experience
57%
3.6
Volunteer/extracurricular experiences
56%
3.5
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
3.8
65%
4.1
80%
Visa status*
Applicant was flagged with Match violation by the NRMP
Interest in academic career
4.1
59%
NRMP Program Director Survey Results, 2014
51
3.4
15%
3.9
56%
20%
Fluency in language spoken by your patient population
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.4
41%
Gold Society membership
USMLE/COMLEX Step 3 score
100%
4.6
22%
Honors in basic sciences
Away rotation in your specialty at another institution
4.0
39%
3.7
4%
50%
0% 1
2
3
4.5
4
5
Figure NS-2
Neurological Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=54)
Percent Citing Factor
Interactions with faculty during interview and visit 94%
Interpersonal skills
85%
Interactions with house staff during interview and visit
87%
Feedback from current residents
85%
USMLE Step 1/COMLEX Level 1 score
70%
Letters of recommendation in the specialty
89%
USMLE Step 2 CK/COMLEX Level 2 CE score
44%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
70%
Perceived commitment to specialty
78%
Evidence of professionalism and ethics
74%
Perceived interest in program
74%
Leadership qualities
65%
Personal prior knowledge of the applicant
56%
Class ranking/quartile
33%
Graduate of U.S. allopathic medical school
46%
Personal Statement
56%
Audition elective/rotation within your department
65%
Grades in required clerkships
43%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
26%
Honors in clinical clerkships
50%
Honors in clerkship in desired specialty
43%
Gaps in medical education
28%
Grades in clerkship in desired specialty
39%
Alpha Omega Alpha (AOA) membership
48%
Other life experience
31%
Consistency of grades
37%
Volunteer/extracurricular experiences
33%
Demonstrated involvement and interest in research
63%
Graduate of highly regarded U.S. medical school
43%
Other post‐interview contact
46%
Interest in academic career
52%
Visa status*
20%
Applicant was flagged with Match violation by the NRMP
13%
Fluency in language spoken by your patient population
13%
Gold Society membership
6%
Honors in basic sciences
19%
Second interview/visit
31%
Away rotation in your specialty at another institution
37%
USMLE/COMLEX Step 3 score
2%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
52
Average Rating
4.8
4.8
4.9
4.7
4.4
4.5
4.2
3.5
4.5
4.6
4.4
4.4
4.6
3.6
4.3
3.8
4.6
3.8
4.1
4.0
4.0
3.9
4.0
4.0
3.9
4.0
3.9
4.1
4.0
4.2
4.2
3.5
4.6
3.7
3.3
3.4
3.9
3.9
5.0
2
3
4
5
Neurological Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure NS-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=52
100%
90%
79%
80%
80%
70%
70%
60%
50%
40%
42%
40%
30%
30%
19%
20%
10%
0%
58%
60%
50%
20%
N=48
100%
90%
10%
2%
Yes, pass only
Yes, target score
0%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=47
N=33
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
47%
50%
40%
50%
39%
40%
32%
30%
30%
21%
20%
20%
10%
10%
0%
0%
Yes, pass only
61%
Yes, target score
No
Never
0%
often
Seldom
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=35
N=19
N=24
USMLE Step 2 CK
N=13
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
53
Neurological Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure NS-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=46
100%
N=28
100%
90%
90%
76%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
24%
20%
75%
21%
20%
N=46
10%
0%
N=28
10%
Yes
0%
No
Yes, pass only
4%
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=17
90%
90%
80%
80%
70%
65%
78%
70%
60%
60%
50%
50%
40%
40%
30%
N=18
30%
24%
20%
20%
12%
10%
10%
0%
0%
Yes, pass only
Yes, target score
No
17%
6%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=17
90%
82%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
18%
20%
10%
10%
0%
94%
30%
30%
20%
N=16
90%
0%
Yes, pass only
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
54
6%
0%
Yes, pass only
Yes, target score
No
Neurological Surgery
Program's Interview Activities
Figure NS-5
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
500
50%
400
40%
40%
300
30%
202
200
20%
100
0
57%
60%
50
38
27
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
2
Number of
positions in the
Match
Number of
applications
received
N=55*
N=53
N=53
N=53
10%
0%
Percentage of applications
rejected
N=55*
Percentage of applicants
receiving an in-depth review
N=52
N=53
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
21% of Neurological Surgery programs consider all applicant groups
96%
N=53
90%
80%
70%
60%
53%
50%
40%
40%
26%
30%
40%
42%
U.S. IMG
Non-U.S. IMG
23%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
55
Fifth Pathway
Neurology
(N=60)
NRMP Program Director Survey Results, 2014
56
Figure N-1
Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=59)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
90%
Letters of recommendation in the specialty
92%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
4.0
4.3
85%
4.2
75%
4.0
Personal Statement
71%
Graduate of U.S. allopathic medical school
71%
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
3.7
4.2
63%
4.2
76%
4.1
61%
4.1
71%
4.2
75%
4.0
Evidence of professionalism and ethics
63%
Personal prior knowledge of the applicant
63%
Audition elective/rotation within your department
4.3
4.0
4.0
59%
Leadership qualities
56%
Honors in clerkship in desired specialty
58%
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
4.1
4.1
4.0
56%
3.4
44%
3.4
53%
3.9
58%
3.3
49%
4.0
39%
4.7
34%
3.3
39%
Honors in basic sciences
3.4
22%
Gold Society membership
3.6
31%
Away rotation in your specialty at another institution
3.5
22%
27%
Fluency in language spoken by your patient population
57
3.9
49%
Interest in academic career
NRMP Program Director Survey Results, 2014
4.4
64%
Applicant was flagged with Match violation by the NRMP
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
4.2
56%
Visa status*
USMLE/COMLEX Step 3 score
100%
3.9
61%
Other life experience
Volunteer/extracurricular experiences
Average Rating
3.4
3.7
25%
50%
0% 1
2
3
4
5
Figure N-2
Neurology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=59)
Percent Citing Factor
Interactions with faculty during interview and visit 97%
Interpersonal skills 98%
Interactions with house staff during interview and visit 93%
Feedback from current residents
73%
USMLE Step 1/COMLEX Level 1 score
80%
Letters of recommendation in the specialty
81%
USMLE Step 2 CK/COMLEX Level 2 CE score
68%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
73%
Perceived commitment to specialty
75%
Evidence of professionalism and ethics
61%
Perceived interest in program
56%
Leadership qualities
59%
Personal prior knowledge of the applicant
61%
Class ranking/quartile
68%
Graduate of U.S. allopathic medical school
51%
Personal Statement
54%
Audition elective/rotation within your department
47%
Grades in required clerkships
49%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
53%
Honors in clinical clerkships
49%
Honors in clerkship in desired specialty
47%
Gaps in medical education
47%
Grades in clerkship in desired specialty
46%
Alpha Omega Alpha (AOA) membership
44%
Other life experience
41%
Consistency of grades
46%
Volunteer/extracurricular experiences
37%
Demonstrated involvement and interest in research
44%
Graduate of highly regarded U.S. medical school
44%
Other post‐interview contact
37%
Interest in academic career
39%
Visa status*
22%
Applicant was flagged with Match violation by the NRMP
22%
Fluency in language spoken by your patient population
25%
Gold Society membership
25%
Honors in basic sciences
20%
22%
Second interview/visit
20%
Away rotation in your specialty at another institution
19%
USMLE/COMLEX Step 3 score
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
58
Average Rating
4.9
4.8
4.7
4.5
3.9
4.2
3.8
4.1
4.3
4.4
4.0
4.1
4.2
4.1
4.1
3.6
4.1
4.0
4.0
4.0
4.2
4.1
4.2
4.1
3.5
4.0
3.3
3.3
4.0
4.0
3.6
3.8
4.7
3.7
3.9
3.4
4.0
3.9
4.0
2
3
4
5
Neurology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure N-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=58
100%
90%
80%
70%
60%
60%
60%
50%
50%
40%
40%
30%
30%
20%
20%
10%
0%
76%
80%
70%
40%
N=51
100%
90%
10%
0%
Yes, pass only
Yes, target score
22%
2%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=58
N=49
100%
100%
90%
90%
80%
80%
70%
70%
60%
40%
60%
50%
50%
50%
40%
34%
30%
30%
16%
20%
10%
0%
0%
Yes, target score
24%
20%
10%
Yes, pass only
73%
No
2%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=28
N=23
N=20
USMLE Step 2 CK
N=16
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
59
Neurology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure N-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=57
100%
N=40
100%
90%
90%
77%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
23%
20%
20%
N=57
10%
0%
68%
20%
13%
N=40
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=41
90%
90%
80%
80%
70%
70%
60%
60%
51%
50%
50%
40%
40%
30%
27%
22%
30%
20%
20%
10%
10%
0%
Yes, pass only
Yes, target score
N=40
0%
No
40%
38%
Yes, target score
No
23%
Yes, pass only
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=36
90%
90%
80%
80%
70%
70%
47%
50%
50%
40%
40%
28%
30%
25%
20%
20%
10%
10%
0%
68%
60%
60%
30%
N=28
Yes, pass only
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
60
25%
7%
Yes, pass only
Yes, target score
No
Neurology
Program's Interview Activities
Figure N-5
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
60%
500
400
50%
Percentage of applications
rejected
Percentage of applicants
receiving an in-depth review
40%
300
30%
200
20%
100
0
48%
50%
443
73
59
51
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
Number of
applications
received
N=60*
N=60
N=59
N=59
0%
N=60*
N=59
N=60
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
53% of Neurology programs consider all applicant groups
97%
N=59
90%
81%
80%
80%
71%
70%
85%
71%
60%
53%
50%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
61
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Obstetrics and Gynecology
(N=123)
NRMP Program Director Survey Results, 2014
62
Figure OG-1
Obstetrics and Gynecology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=117)
Percent Citing Factor
Average Rating
USMLE Step 1/COMLEX Level 1 score 97%
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
4.2
92%
4.1
76%
3.9
84%
4.1
81%
3.5
68%
4.2
75%
4.1
Gaps in medical education
72%
4.2
Honors in clinical clerkships
72%
4.2
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
58%
72%
4.0
64%
4.1
3.9
62%
65%
Honors in clerkship in desired specialty
67%
Grades in clerkship in desired specialty
62%
Alpha Omega Alpha (AOA) membership
62%
Perceived interest in program
4.4
69%
Leadership qualities
Pass USMLE Step2 CS/COMLEX Lvl2 PE
4.0
4.4
4.4
3.7
4.0
57%
4.0
50%
Consistency of grades
57%
Other life experience
57%
Volunteer/extracurricular experiences
4.2
4.0
3.6
3.7
51%
Graduate of highly regarded U.S. medical school
3.6
38%
Demonstrated involvement and interest in research
3.6
43%
Visa status*
33%
Applicant was flagged with Match violation by the NRMP
33%
4.2
4.8
Interest in academic career
22%
Honors in basic sciences
21%
Gold Society membership
NRMP Program Director Survey Results, 2014
63
3.6
3.7
13%
21%
Fluency in language spoken by your patient population
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.2
35%
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
100%
3.5
3.5
14%
50%
0% 1
2
3.7
3
4
5
Figure OG-2
Obstetrics and Gynecology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=117)
Percent Citing Factor
Interactions with faculty during interview and visit 96%
Interpersonal skills
91%
Interactions with house staff during interview and visit
91%
Feedback from current residents
86%
USMLE Step 1/COMLEX Level 1 score
79%
Letters of recommendation in the specialty
72%
USMLE Step 2 CK/COMLEX Level 2 CE score
74%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
58%
Perceived commitment to specialty
67%
Evidence of professionalism and ethics
61%
Perceived interest in program
57%
Leadership qualities
60%
Personal prior knowledge of the applicant
60%
Class ranking/quartile
53%
Graduate of U.S. allopathic medical school
54%
Personal Statement
49%
Audition elective/rotation within your department
53%
Grades in required clerkships
46%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
45%
Honors in clinical clerkships
48%
Honors in clerkship in desired specialty
54%
Gaps in medical education
42%
Grades in clerkship in desired specialty
46%
Alpha Omega Alpha (AOA) membership
47%
Other life experience
42%
Consistency of grades
36%
Volunteer/extracurricular experiences
34%
Demonstrated involvement and interest in research
28%
Graduate of highly regarded U.S. medical school
29%
Other post‐interview contact
35%
Interest in academic career
20%
Visa status*
16%
Applicant was flagged with Match violation by the NRMP
17%
Fluency in language spoken by your patient population
15%
Gold Society membership
25%
Honors in basic sciences
12%
Second interview/visit
22%
Away rotation in your specialty at another institution
10%
USMLE/COMLEX Step 3 score
11%
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
64
Average Rating
4.8
4.8
4.8
4.7
4.1
3.9
4.0
3.7
4.2
4.5
4.2
4.2
4.1
3.9
4.1
3.4
4.2
4.0
4.2
4.1
4.1
4.2
4.0
4.0
3.7
4.0
3.6
3.7
4.1
4.0
3.7
3.9
4.7
3.8
3.9
3.1
3.5
3.6
4.2
2
3
4
5
Obstetrics and Gynecology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure OG-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=114
100%
80%
90%
75%
80%
70%
60%
50%
50%
40%
40%
25%
30%
20%
19%
20%
10%
0%
75%
70%
60%
30%
N=104
100%
90%
Yes, pass only
Yes, target score
6%
10%
0%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=112
N=97
100%
100%
90%
90%
80%
80%
70%
70%
60%
54%
60%
50%
50%
40%
30%
40%
27%
30%
19%
20%
20%
6%
10%
10%
0%
53%
41%
0%
Yes, pass only
Yes, target score
No
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=71
N=46
N=50
USMLE Step 2 CK
N=34
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
65
Obstetrics and Gynecology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure OG-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=109
100%
N=60
100%
90%
90%
79%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
21%
20%
0%
23%
20%
N=109
10%
72%
N=60 5%
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=72
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
50%
29%
21%
20%
30%
35%
25%
20%
10%
10%
0%
41%
40%
40%
30%
N=69
Yes, pass only
Yes, target score
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=63
90%
90%
80%
80%
70%
70%
60%
60%
50%
44%
44%
40%
30%
30%
10%
0%
20%
11%
Yes, pass only
Yes, target score
20%
10%
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
76%
50%
40%
20%
N=45
66
4%
Yes, pass only
Yes, target score
No
Obstetrics and Gynecology
Program's Interview Activities
Figure OG-5
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
60%
52%
500
50%
425
400
300
30%
200
20%
89
100
0
44%
40%
72
63
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
N=123*
Number of
applications
received
N=122
Number of
interview
invitations sent
N=119
N=122
0%
Percentage of applications
rejected
N=123*
Percentage of applicants
receiving an in-depth review
N=117
N=122
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
15% of Obstetrics and Gynecology programs consider all applicant groups
97%
N=116
90%
80%
75%
70%
60%
54%
48%
50%
40%
34%
30%
30%
18%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
67
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Orthopaedic Surgery
(N=87)
NRMP Program Director Survey Results, 2014
68
Figure OS-1
Orthopaedic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=85)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
95%
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
4.4
92%
4.2
79%
USMLE Step 2 CK/COMLEX Level 2 CE score
82%
Graduate of U.S. allopathic medical school
81%
Grades in required clerkships
4.0
64%
Personal Statement
Honors in clinical clerkships
4.5
74%
4.2
52%
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
4.3
53%
Honors in clerkship in desired specialty
4.2
75%
4.5
67%
4.4
4.6
64%
4.1
74%
4.5
69%
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
4.1
72%
Audition elective/rotation within your department
Leadership qualities
3.8
87%
Perceived commitment to specialty
Class ranking/quartile
4.0
3.3
Gaps in medical education
4.4
58%
3.9
84%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Other life experience
64%
4.2
3.6
3.6
59%
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
3.9
55%
66%
Volunteer/extracurricular experiences
3.9
46%
3.7
69%
Visa status*
19%
Applicant was flagged with Match violation by the NRMP
20%
Interest in academic career
3.8
3.8
12%
Away rotation in your specialty at another institution
32%
Fluency in language spoken by your patient population
9%
69
4.8
40%
Gold Society membership
NRMP Program Director Survey Results, 2014
4.0
25%
Honors in basic sciences
USMLE/COMLEX Step 3 score
100%
3.6
19%
Consistency of grades
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
Average Rating
3.4
3.7
3.9
0%
50%
0% 1
2
3
4
5
Figure OS-2
Orthopaedic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=85)
Percent Citing Factor
Interactions with faculty during interview and visit
89%
Interpersonal skills
88%
Interactions with house staff during interview and visit
86%
Feedback from current residents
82%
USMLE Step 1/COMLEX Level 1 score
70%
Letters of recommendation in the specialty
73%
USMLE Step 2 CK/COMLEX Level 2 CE score
48%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
57%
Perceived commitment to specialty
46%
Evidence of professionalism and ethics
64%
Perceived interest in program
57%
Leadership qualities
57%
Personal prior knowledge of the applicant
54%
Class ranking/quartile
50%
Graduate of U.S. allopathic medical school
61%
Personal Statement
46%
Audition elective/rotation within your department
62%
Grades in required clerkships
48%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
11%
Honors in clinical clerkships
52%
Honors in clerkship in desired specialty
48%
Gaps in medical education
33%
Grades in clerkship in desired specialty
37%
Alpha Omega Alpha (AOA) membership
55%
Other life experience
39%
Consistency of grades
38%
Volunteer/extracurricular experiences
38%
Demonstrated involvement and interest in research
48%
Graduate of highly regarded U.S. medical school
30%
Other post‐interview contact
15%
Interest in academic career
23%
Visa status*
10%
Applicant was flagged with Match violation by the NRMP
12%
2%
Fluency in language spoken by your patient population
Gold Society membership
11%
Honors in basic sciences
25%
Second interview/visit
12%
Away rotation in your specialty at another institution
21%
USMLE/COMLEX Step 3 score
1%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
70
Average Rating
4.6
4.6
4.6
4.6
4.2
4.3
4.0
3.9
4.1
4.5
4.0
4.1
4.5
4.0
4.4
3.5
4.7
4.0
4.3
4.1
4.1
4.0
4.2
3.9
3.7
4.0
3.7
3.9
4.0
3.9
3.9
4.0
4.7
3.0
3.8
3.6
3.7
3.5
4.0
2
3
4
5
Orthopaedic Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure OS-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
N=84
100%
Would your program consider applicants who fail the
exam on the first attempt?
93%
90%
80%
80%
70%
70%
60%
50%
40%
37%
40%
30%
30%
20%
0%
61%
60%
50%
10%
N=71
100%
90%
20%
7%
10%
0%
Yes, pass only
Yes, target score
3%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=75
N=55
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
52%
50%
50%
40%
30%
20%
65%
40%
28%
20%
20%
10%
10%
0%
0%
Yes, pass only
33%
30%
Yes, target score
No
2%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=65
N=30
N=27
USMLE Step 2 CK
N=15
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
71
Orthopaedic Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure OS-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=65
100%
N=41
100%
90%
90%
80%
80%
66%
70%
60%
60%
50%
50%
40%
40%
34%
30%
30%
20%
20%
N=65
10%
0%
73%
70%
22%
N=41 5%
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=27
90%
90%
80%
80%
74%
70%
70%
60%
60%
50%
50%
40%
40%
19%
20%
0%
84%
30%
30%
10%
N=25
20%
7%
10%
Yes, pass only
Yes, target score
0%
No
8%
8%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=26
88%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
0%
92%
20%
20%
10%
N=26
90%
8%
Yes, pass only
10%
4%
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
72
4%
4%
Yes, pass only
Yes, target score
No
Figure OS-5
Orthopaedic Surgery
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
549
60%
500
50%
400
40%
300
30%
200
20%
100
0
49%
46%
72
59
51
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
N=87*
Number of
applications
received
N=84
N=83
N=83
0%
Percentage of applications
rejected
N=87*
Percentage of applicants
receiving an in-depth review
N=81
N=84
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
13% of Orthopaedic Surgery programs consider all applicant groups
99%
N=83
90%
80%
70%
60%
51%
50%
40%
27%
30%
23%
20%
20%
16%
14%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
73
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Otolaryngology
(N=46)
NRMP Program Director Survey Results, 2014
74
Figure O-1
Otolaryngology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=46)
Percent Citing Factor
Average Rating
USMLE Step 1/COMLEX Level 1 score 98%
4.3
Letters of recommendation in the specialty 100%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
4.6
74%
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
59%
Perceived commitment to specialty
4.2
61%
3.6
85%
4.4
67%
4.3
59%
Evidence of professionalism and ethics
4.0
65%
4.4
70%
Audition elective/rotation within your department
4.4
4.3
63%
Leadership qualities
76%
Honors in clerkship in desired specialty
76%
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
4.4
74%
Class ranking/quartile
Personal prior knowledge of the applicant
3.7
67%
Gaps in medical education
Honors in clinical clerkships
4.0
74%
Graduate of U.S. allopathic medical school
Grades in required clerkships
3.5
4.4
4.6
4.5
61%
4.0
83%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
4.2
46%
Other life experience
3.7
59%
3.8
72%
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
4.3
54%
Consistency of grades
Volunteer/extracurricular experiences
4.1
20%
3.9
48%
4.3
80%
Visa status*
4.0
17%
24%
Applicant was flagged with Match violation by the NRMP
4.8
4.2
Interest in academic career
35%
Honors in basic sciences
33%
17%
3.7
39%
13%
3.8
Gold Society membership
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
USMLE/COMLEX Step 3 score
100%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
75
3.9
2.8
4%
50%
0% 1
2
4.0
3
4
5
Figure O-2
Otolaryngology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=46)
Percent Citing Factor
Interactions with faculty during interview and visit 96%
Interpersonal skills 96%
Interactions with house staff during interview and visit 96%
Feedback from current residents 96%
USMLE Step 1/COMLEX Level 1 score
71%
Letters of recommendation in the specialty
80%
USMLE Step 2 CK/COMLEX Level 2 CE score
31%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
38%
Perceived commitment to specialty
60%
Evidence of professionalism and ethics
64%
Perceived interest in program
53%
Leadership qualities
73%
Personal prior knowledge of the applicant
56%
Class ranking/quartile
40%
Graduate of U.S. allopathic medical school
44%
Personal Statement
42%
Audition elective/rotation within your department
53%
Grades in required clerkships
40%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
4%
Honors in clinical clerkships
53%
Honors in clerkship in desired specialty
51%
Gaps in medical education
33%
Grades in clerkship in desired specialty
44%
Alpha Omega Alpha (AOA) membership
49%
Other life experience
40%
Consistency of grades
22%
Volunteer/extracurricular experiences
42%
Demonstrated involvement and interest in research
64%
Graduate of highly regarded U.S. medical school
20%
Other post‐interview contact
20%
Interest in academic career
33%
Visa status*
7%
Applicant was flagged with Match violation by the NRMP
18%
7%
Fluency in language spoken by your patient population
16%
Gold Society membership
Honors in basic sciences
20%
Second interview/visit
2%
Away rotation in your specialty at another institution
20%
USMLE/COMLEX Step 3 score
2%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
76
Average Rating
4.9
4.8
4.8
4.7
3.7
4.3
3.7
3.7
4.5
4.2
4.3
4.3
4.7
3.9
4.5
3.6
4.3
4.1
4.0
4.2
4.2
3.4
4.1
3.7
3.8
3.6
4.1
4.2
4.1
4.3
4.2
4.0
4.8
2.5
3.4
3.0
5.0
3.9
3.0
2
3
4
5
Otolaryngology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure O-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=46
100%
80%
80%
90%
80%
70%
70%
60%
60%
50%
45%
40%
30%
30%
20%
20%
10%
0%
55%
50%
40%
20%
N=40
100%
90%
10%
0%
Yes, pass only
Yes, target score
0%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=42
N=27
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
38%
40%
30%
67%
40%
33%
29%
20%
20%
10%
10%
0%
0%
Yes, pass only
33%
30%
Yes, target score
No
0%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=32
N=14
N=15
USMLE Step 2 CK
N=8
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
77
Otolaryngology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure O-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=39
100%
N=28
100%
90%
90%
80%
80%
70%
70%
62%
60%
75%
60%
50%
50%
38%
40%
40%
30%
30%
20%
20%
N=39
10%
0%
14%
N=28 11%
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=19
80%
74%
70%
60%
60%
50%
50%
40%
40%
30%
30%
16%
20%
11%
10%
0%
79%
80%
70%
20%
N=19
90%
90%
Yes, pass only
Yes, target score
16%
10%
0%
No
5%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=19
90%
79%
80%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
16%
10%
0%
94%
80%
70%
20%
N=16
90%
10%
5%
Yes, pass only
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
78
6%
0%
Yes, pass only
Yes, target score
No
Figure O-5
Otolaryngology
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
600
60%
500
50%
400
40%
312
31%
300
30%
200
20%
100
0
67%
70%
46
37
35
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
3
Number of
positions in the
Match
N=46*
Number of
applications
received
N=45
N=45
N=45
10%
0%
Percentage of applications
rejected
N=46*
Percentage of applicants
receiving an in-depth review
N=45
N=45
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
24% of Otolaryngology programs consider all applicant groups
98%
N=46
90%
80%
70%
70%
60%
50%
37%
40%
30%
28%
28%
Osteopathic
Physician
Canadian
28%
24%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
79
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Pathology
(N=84)
NRMP Program Director Survey Results, 2014
80
Figure PA-1
Pathology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=84)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
Average Rating
94%
4.3
Letters of recommendation in the specialty 98%
4.5
Medical Student Performance Evaluation (MSPE/Dean's Letter)
83%
4.0
USMLE Step 2 CK/COMLEX Level 2 CE score
86%
4.0
Personal Statement
83%
Graduate of U.S. allopathic medical school
68%
Grades in required clerkships
4.0
60%
Gaps in medical education
3.8
75%
Honors in clinical clerkships
Perceived commitment to specialty
3.8
4.1
57%
3.5
93%
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
4.6
57%
63%
Grades in clerkship in desired specialty
Perceived interest in program
Consistency of grades
4.1
3.9
64%
3.9
54%
4.1
58%
4.1
68%
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
4.4
57%
Leadership qualities
Honors in clerkship in desired specialty
3.8
3.6
54%
4.0
71%
4.4
67%
4.0
58%
Other life experience
39%
3.5
Volunteer/extracurricular experiences
40%
3.5
Graduate of highly regarded U.S. medical school
61%
Demonstrated involvement and interest in research
60%
4.1
3.7
Visa status*
46%
Applicant was flagged with Match violation by the NRMP
45%
Interest in academic career
Fluency in language spoken by your patient population
81
3.8
3.3
8%
Away rotation in your specialty at another institution
NRMP Program Director Survey Results, 2014
4.2
42%
Gold Society membership
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
4.8
35%
Honors in basic sciences
USMLE/COMLEX Step 3 score
100%
3.9
50%
42%
26%
3.6
36%
3.5
3
0% 1
4.3
2
4
5
Figure PA-2
Pathology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=84)
Percent Citing Factor
Interactions with faculty during interview and visit 95%
Interpersonal skills 93%
Interactions with house staff during interview and visit
89%
Feedback from current residents
89%
USMLE Step 1/COMLEX Level 1 score
89%
Letters of recommendation in the specialty
85%
USMLE Step 2 CK/COMLEX Level 2 CE score
79%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
65%
Perceived commitment to specialty
82%
Evidence of professionalism and ethics
64%
Perceived interest in program
71%
Leadership qualities
42%
Personal prior knowledge of the applicant
54%
Class ranking/quartile
52%
Graduate of U.S. allopathic medical school
60%
Personal Statement
55%
Audition elective/rotation within your department
54%
Grades in required clerkships
37%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
61%
Honors in clinical clerkships
35%
Honors in clerkship in desired specialty
36%
Gaps in medical education
46%
Grades in clerkship in desired specialty
40%
Alpha Omega Alpha (AOA) membership
31%
Other life experience
25%
Consistency of grades
37%
Volunteer/extracurricular experiences
21%
Demonstrated involvement and interest in research
45%
Graduate of highly regarded U.S. medical school
40%
Other post‐interview contact
40%
Interest in academic career
37%
Visa status*
31%
Applicant was flagged with Match violation by the NRMP
30%
Fluency in language spoken by your patient population
27%
Gold Society membership
2%
Honors in basic sciences
27%
Second interview/visit
21%
Away rotation in your specialty at another institution
19%
USMLE/COMLEX Step 3 score
31%
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
82
Average Rating
4.8
4.7
4.7
4.7
4.3
4.3
4.1
4.0
4.5
4.5
4.5
4.0
4.2
3.8
4.0
3.8
4.1
3.9
4.0
3.8
3.9
4.2
4.0
4.0
3.2
3.9
3.3
4.0
4.0
4.3
4.1
3.9
4.8
4.5
2.5
3.9
3.9
3.9
3.8
2
3
4
5
Pathology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure PA-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=82
100%
90%
80%
63%
70%
60%
60%
50%
50%
35%
40%
30%
30%
20%
20%
10%
10%
0%
79%
80%
70%
40%
N=77
100%
90%
1%
Yes, pass only
Yes, target score
14%
6%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=77
N=72
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
52%
50%
40%
82%
50%
40%
32%
30%
30%
16%
20%
20%
10%
10%
0%
0%
Yes, pass only
Yes, target score
No
13%
6%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=42
N=34
N=33
USMLE Step 2 CK
N=27
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
83
Pathology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PA-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=73
100%
90%
90%
84%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
16%
20%
0%
64%
30%
20%
N=73
10%
N=61
100%
N=61 7%
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=62
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
50%
39%
40%
41%
38%
30%
30%
20%
11%
10%
0%
N=56
Yes, pass only
Yes, target score
21%
20%
10%
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=55
90%
90%
80%
80%
70%
70%
60%
60%
55%
50%
55%
50%
40%
40%
27%
30%
18%
20%
32%
30%
20%
13%
10%
10%
0%
N=47
Yes, pass only
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
84
Yes, pass only
Yes, target score
No
Pathology
Program's Interview Activities
Figure PA-5
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
60%
500
50%
42%
400
349
40%
300
30%
200
20%
100
0
56%
55
41
32
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
4
Number of
positions in the
Match
N=84*
Number of
applications
received
N=82
N=82
N=82
10%
0%
Percentage of applications
rejected
N=84*
Percentage of applicants
receiving an in-depth review
N=80
N=82
* Data from the NRMP database. All Responding programs included
Percentage of Programs that Typically Interview and Rank Each Applicant Group
67% of Pathology programs consider all applicant groups
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
99%
N=81
93%
93%
91%
94%
91%
U.S. IMG
Non-U.S. IMG
68%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
85
Fifth Pathway
Pediatrics
(N=121)
NRMP Program Director Survey Results, 2014
86
Figure P-1
Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=120)
Percent Citing Factor
Average Rating
USMLE Step 1/COMLEX Level 1 score 98%
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
4.0
77%
3.8
87%
4.1
81%
4.1
70%
77%
4.0
69%
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Audition elective/rotation within your department
Leadership qualities
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
4.1
77%
4.0
63%
Perceived commitment to specialty
Class ranking/quartile
3.4
56%
Other life experience
Volunteer/extracurricular experiences
4.0
54%
3.9
4.0
63%
4.1
66%
3.9
62%
4.2
64%
3.7
39%
3.8
63%
3.6
52%
3.7
55%
3.7
44%
3.4
23%
3.9
33%
Applicant was flagged with Match violation by the NRMP
4.8
30%
18%
Interest in academic career
Honors in basic sciences
3.6
3.4
24%
Gold Society membership
3.7
39%
Away rotation in your specialty at another institution
3.5
16%
33%
Fluency in language spoken by your patient population
87
3.9
57%
Visa status*
NRMP Program Director Survey Results, 2014
3.8
65%
Demonstrated involvement and interest in research
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
4.4
60%
Graduate of highly regarded U.S. medical school
USMLE/COMLEX Step 3 score
100%
4.0
75%
Perceived interest in program
Consistency of grades
4.0
3.4
2.7
16%
50%
0% 1
2
3
4
5
Figure P-2
Pediatrics
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=120)
Percent Citing Factor
Interactions with faculty during interview and visit 98%
Interpersonal skills 95%
Interactions with house staff during interview and visit
93%
Feedback from current residents
90%
USMLE Step 1/COMLEX Level 1 score
90%
Letters of recommendation in the specialty
76%
USMLE Step 2 CK/COMLEX Level 2 CE score
88%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
82%
Perceived commitment to specialty
60%
Evidence of professionalism and ethics
67%
Perceived interest in program
56%
Leadership qualities
66%
Personal prior knowledge of the applicant
62%
Class ranking/quartile
77%
Graduate of U.S. allopathic medical school
68%
Personal Statement
60%
Audition elective/rotation within your department
63%
Grades in required clerkships
69%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
71%
Honors in clinical clerkships
57%
Honors in clerkship in desired specialty
52%
Gaps in medical education
56%
Grades in clerkship in desired specialty
56%
Alpha Omega Alpha (AOA) membership
52%
Other life experience
46%
Consistency of grades
47%
Volunteer/extracurricular experiences
57%
Demonstrated involvement and interest in research
30%
Graduate of highly regarded U.S. medical school
36%
Other post‐interview contact
27%
Interest in academic career
21%
Visa status*
23%
Applicant was flagged with Match violation by the NRMP
23%
Fluency in language spoken by your patient population
31%
Gold Society membership
35%
Honors in basic sciences
21%
Second interview/visit
18%
Away rotation in your specialty at another institution
13%
USMLE/COMLEX Step 3 score
11%
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
88
Average Rating
4.7
4.8
4.7
4.6
4.2
3.8
4.1
4.2
4.1
4.5
3.8
4.0
4.2
4.1
4.1
3.4
4.0
3.9
4.3
4.1
4.2
4.2
4.2
4.2
3.6
3.9
3.7
3.4
3.7
3.8
3.6
3.7
4.9
3.4
3.8
3.5
3.5
3.7
3.4
2
3
4
5
Pediatrics
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure P-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=116
100%
90%
80%
70%
56%
60%
60%
43%
50%
40%
40%
30%
30%
20%
20%
10%
0%
77%
80%
70%
50%
N=113
100%
90%
10%
1%
Yes, pass only
Yes, target score
18%
5%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=113
N=108
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
40%
38%
50%
42%
40%
30%
30%
20%
20%
27%
20%
6%
10%
10%
0%
67%
0%
Yes, pass only
Yes, target score
No
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=54
N=45
N=49
USMLE Step 2 CK
N=40
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
89
Pediatrics
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure P-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=111
100%
90%
N=67
100%
90%
82%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
81%
30%
18%
20%
20%
N=111
10%
0%
13%
N=67 6%
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=100
90%
90%
80%
80%
70%
70%
60%
60%
52%
50%
50%
40%
40%
33%
30%
30%
20%
20%
15%
44%
29%
27%
10%
10%
0%
N=97
Yes, pass only
Yes, target score
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=91
90%
90%
80%
80%
70%
60%
79%
70%
60%
60%
50%
50%
40%
40%
30%
30%
30%
20%
20%
10%
10%
0%
N=61
Yes, pass only
Yes, target score
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
15%
7%
10%
90
Yes, pass only
Yes, target score
No
Figure P-5
Pediatrics
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
1,124
1,000
Average Percentage of Applicants Rejected and
Reviewed
100%
900
90%
800
80%
700
70%
600
60%
500
50%
400
40%
300
35%
30%
221
192
200
161
20%
100
10%
15
0
Number of
positions in the
Match
N=121*
58%
Number of
applications
received
N=118
Number of
interview
invitations sent
Number of
applicants
interviewed
N=116
N=116
0%
Number of
applicants
ranked
Percentage of applications
rejected
N=121*
Percentage of applicants
receiving an in-depth review
N=114
N=118
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
42% of Pediatrics programs consider all applicant groups
100%
N=118
90%
86%
80%
72%
72%
69%
70%
60%
60%
47%
50%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
91
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Physical Medicine and Rehabilitation
(N=34)
NRMP Program Director Survey Results, 2014
92
Figure PMR-1
Physical Medicine and Rehabilitation
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=33)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
91%
Letters of recommendation in the specialty
91%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
4.0
4.3
88%
4.2
85%
4.0
79%
3.9
64%
Class ranking/quartile
Evidence of professionalism and ethics
3.9
73%
4.2
55%
4.5
67%
3.8
76%
4.4
55%
4.3
Consistency of grades
Other life experience
Volunteer/extracurricular experiences
4.0
45%
4.4
58%
Alpha Omega Alpha (AOA) membership
Perceived interest in program
4.1
48%
Honors in clerkship in desired specialty
Pass USMLE Step2 CS/COMLEX Lvl2 PE
3.9
67%
Leadership qualities
Grades in clerkship in desired specialty
3.9
76%
Personal prior knowledge of the applicant
Audition elective/rotation within your department
3.7
76%
Honors in clinical clerkships
Perceived commitment to specialty
3.5
42%
4.2
73%
4.2
58%
4.2
67%
3.6
55%
3.6
67%
Graduate of highly regarded U.S. medical school
3.6
33%
Demonstrated involvement and interest in research
3.8
42%
Visa status*
3.6
33%
Applicant was flagged with Match violation by the NRMP
4.6
39%
Interest in academic career
27%
Gold Society membership
6%
Away rotation in your specialty at another institution
NRMP Program Director Survey Results, 2014
93
3.4
3.5
3.8
39%
Fluency in language spoken by your patient population
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
2.9
21%
Honors in basic sciences
USMLE/COMLEX Step 3 score
100%
Average Rating
3.9
42%
3.8
33%
50%
0% 1
2
3
4
5
Figure PMR-2
Physical Medicine and Rehabilitation
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=33)
Percent Citing Factor
Interactions with faculty during interview and visit 94%
Interpersonal skills 94%
Interactions with house staff during interview and visit
85%
Feedback from current residents
79%
USMLE Step 1/COMLEX Level 1 score
82%
Letters of recommendation in the specialty
82%
USMLE Step 2 CK/COMLEX Level 2 CE score
76%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
76%
Perceived commitment to specialty
79%
Evidence of professionalism and ethics
58%
Perceived interest in program
58%
Leadership qualities
48%
Personal prior knowledge of the applicant
52%
Class ranking/quartile
52%
Graduate of U.S. allopathic medical school
39%
Personal Statement
64%
Audition elective/rotation within your department
64%
Grades in required clerkships
58%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
70%
Honors in clinical clerkships
36%
Honors in clerkship in desired specialty
33%
Gaps in medical education
45%
Grades in clerkship in desired specialty
45%
Alpha Omega Alpha (AOA) membership
39%
Other life experience
52%
Consistency of grades
61%
Volunteer/extracurricular experiences
36%
Demonstrated involvement and interest in research
52%
Graduate of highly regarded U.S. medical school
24%
Other post‐interview contact
30%
Interest in academic career
15%
Visa status*
18%
Applicant was flagged with Match violation by the NRMP
21%
Fluency in language spoken by your patient population
27%
Gold Society membership
9%
Honors in basic sciences
18%
Second interview/visit
9%
Away rotation in your specialty at another institution
33%
USMLE/COMLEX Step 3 score
27%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
94
Average Rating
4.8
4.7
4.7
4.6
4.0
4.2
4.0
4.2
4.5
4.6
4.2
4.1
4.1
3.9
4.0
3.7
4.7
3.8
4.0
4.1
4.5
3.9
4.3
3.8
3.6
4.1
3.7
3.4
3.8
4.1
4.0
3.8
4.9
3.8
3.7
3.7
3.3
4.4
3.8
2
3
4
5
Physical Medicine and Rehabilitation
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure PMR-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=31
100%
90%
80%
80%
70%
48%
60%
48%
50%
40%
40%
30%
30%
20%
20%
10%
0%
67%
70%
60%
50%
N=30
100%
90%
10%
3%
Yes, pass only
Yes, target score
20%
13%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=31
N=29
100%
100%
90%
90%
80%
80%
70%
70%
60%
50%
60%
45%
40%
50%
40%
32%
30%
30%
23%
20%
20%
10%
10%
0%
83%
0%
Yes, pass only
Yes, target score
No
10%
7%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=11
N=12
N=7
USMLE Step 2 CK
N=8
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
95
Physical Medicine and Rehabilitation
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PMR-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=30
100%
N=23
100%
90%
90%
80%
80%
70%
70%
70%
60%
60%
50%
50%
40%
65%
40%
30%
30%
30%
20%
20%
N=30
10%
0%
17%
17%
N=23
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=31
90%
90%
80%
80%
70%
70%
60%
60%
50%
48%
50%
42%
40%
40%
30%
30%
20%
20%
10%
10%
0%
N=31
Yes, pass only
Yes, target score
45%
32%
23%
10%
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=29
90%
90%
80%
80%
70%
60%
70%
57%
60%
55%
50%
50%
40%
34%
40%
30%
30%
26%
17%
20%
20%
10%
10%
0%
N=23
Yes, pass only
Yes, target score
10%
0%
No
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
96
Yes, pass only
Yes, target score
No
Physical Medicine and Rehabilitation
Program's Interview Activities
Figure PMR-5
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
60%
500
400
349
45%
40%
300
30%
200
20%
86
100
0
51%
50%
68
54
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
Number of
applications
received
N=34*
Number of
interview
invitations sent
N=34
N=34
N=34
0%
Percentage of applications
rejected
N=34*
Percentage of applicants
receiving an in-depth review
N=34
N=34
* Data from the NRMP database. All Responding programs included
Percentage of Programs that Typically Interview and Rank Each Applicant Type
27% of Physical Medicine and Rehabilitation programs consider all applicant groups
N=33
100%
100%
90%
80%
70%
60%
50%
40%
30%
20%
10%
0%
97%
79%
79%
61%
45%
NRMP Program Director Survey Results, 2014
G
M
.S
.I
M
-U
.S
.I
N
on
U
w
th
Pa
Fi
fth
97
G
ay
n
ad
ia
an
C
O
s
P h teo
y s pat
i c hi
ia c
n
ra
d
.S
.G
U
U
.S
.S
en
io
r
ua
te
42%
Plastic Surgery
(N=39)
NRMP Program Director Survey Results, 2014
98
Figure PS-1
Plastic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=34)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
94%
Letters of recommendation in the specialty
94%
4.3
4.8
Medical Student Performance Evaluation (MSPE/Dean's Letter)
62%
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
3.1
65%
4.4
85%
3.6
74%
4.2
Grades in required clerkships
50%
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
Personal prior knowledge of the applicant
Honors in clerkship in desired specialty
4.2
74%
4.2
59%
3.6
68%
4.2
76%
4.4
4.4
65%
4.1
71%
4.5
74%
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
4.5
56%
4.2
79%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
3.8
53%
Consistency of grades
3.6
62%
Volunteer/extracurricular experiences
3.6
65%
Graduate of highly regarded U.S. medical school
3.8
62%
4.0
82%
3.0
3.9
24%
3%
Fluency in language spoken by your patient population
99
3.1
21%
12%
Away rotation in your specialty at another institution
NRMP Program Director Survey Results, 2014
4.2
47%
Gold Society membership
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
4.7
29%
Honors in basic sciences
USMLE/COMLEX Step 3 score
100%
3.9
47%
Applicant was flagged with Match violation by the NRMP
Interest in academic career
4.2
44%
Other life experience
Visa status*
4.0
26%
Perceived interest in program
Demonstrated involvement and interest in research
3.6
76%
Audition elective/rotation within your department
Leadership qualities
3.9
35%
Class ranking/quartile
Evidence of professionalism and ethics
Average Rating
3.0
15%
50%
0% 1
2
4.0
3
4
5
Figure PS-2
Plastic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=34)
Percent Citing Factor
Interactions with faculty during interview and visit
88%
Interpersonal skills
91%
Interactions with house staff during interview and visit
85%
Feedback from current residents
68%
USMLE Step 1/COMLEX Level 1 score
56%
Letters of recommendation in the specialty
82%
USMLE Step 2 CK/COMLEX Level 2 CE score
32%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
32%
Perceived commitment to specialty
62%
Evidence of professionalism and ethics
56%
Perceived interest in program
35%
Leadership qualities
53%
Personal prior knowledge of the applicant
53%
Class ranking/quartile
26%
Graduate of U.S. allopathic medical school
44%
Personal Statement
29%
Audition elective/rotation within your department
62%
Grades in required clerkships
24%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
18%
Honors in clinical clerkships
44%
Honors in clerkship in desired specialty
47%
Gaps in medical education
9%
Grades in clerkship in desired specialty
26%
Alpha Omega Alpha (AOA) membership
47%
Other life experience
38%
Consistency of grades
21%
Volunteer/extracurricular experiences
29%
Demonstrated involvement and interest in research
62%
Graduate of highly regarded U.S. medical school
24%
Other post‐interview contact
9%
Interest in academic career
44%
Visa status*
21%
15%
Applicant was flagged with Match violation by the NRMP
3%
Fluency in language spoken by your patient population
Gold Society membership
3%
Honors in basic sciences
15%
Second interview/visit
0%
Away rotation in your specialty at another institution
18%
USMLE/COMLEX Step 3 score
12%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
100
Average Rating
4.8
4.7
4.8
4.7
4.2
4.5
4.0
3.4
4.5
4.5
4.3
4.3
4.5
4.2
4.1
3.7
4.7
3.8
4.2
4.0
4.6
4.3
4.7
4.1
3.7
4.3
4.0
4.0
4.3
4.0
4.3
4.4
4.4
3.0
4.0
3.4
4.3
3.5
2
3
4
5
Plastic Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure PS-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=35
100%
90%
90%
80%
80%
70%
60%
50%
50%
40%
40%
30%
33%
30%
14%
20%
10%
0%
67%
70%
60%
20%
N=30
100%
86%
10%
0%
Yes, pass only
Yes, target score
0%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=35
N=23
100%
100%
90%
90%
80%
80%
70%
70%
57%
60%
50%
50%
40%
40%
30%
30%
23%
20%
20%
10%
0%
0%
Yes, target score
35%
20%
10%
Yes, pass only
65%
60%
No
0%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=21
N=11
N=14
USMLE Step 2 CK
N=8
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
101
Plastic Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PS-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=34
100%
N=28
100%
90%
90%
80%
80%
71%
70%
70%
60%
60%
50%
50%
40%
50%
40%
29%
30%
30%
20%
29%
21%
20%
N=34
10%
0%
N=28
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=9
80%
80%
67%
70%
60%
50%
50%
40%
33%
30%
30%
20%
20%
33%
10%
10%
0%
67%
70%
60%
40%
N=9
90%
90%
0%
Yes, pass only
Yes, target score
No
0%
0%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=8
90%
90%
80%
80%
70%
63%
70%
50%
50%
38%
40%
30%
30%
20%
20%
38%
10%
10%
0%
63%
60%
60%
40%
N=8
0%
Yes, pass only
Yes, target score
No
0%
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
102
0%
Yes, pass only
Yes, target score
No
Plastic Surgery
Program's Interview Activities
Figure PS-5
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
600
60%
500
50%
400
40%
300
29%
30%
192
200
20%
100
0
67%
70%
2
Number of
positions in the
Match
Number of
applications
received
N=39*
N=38
10%
35
30
25
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=37
N=37
0%
Percentage of applications
rejected
N=39*
Percentage of applicants
receiving an in-depth review
N=36
N=38
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
18% of Plastic Surgery programs consider all applicant groups
97%
N=33
90%
80%
70%
60%
50%
45%
39%
40%
27%
30%
24%
24%
U.S. IMG
Non-U.S. IMG
18%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
103
Fifth Pathway
Psychiatry
(N=84)
NRMP Program Director Survey Results, 2014
104
Figure PSY-1
Psychiatry
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=83)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
87%
Letters of recommendation in the specialty
84%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
Average Rating
3.7
4.1
94%
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
4.2
84%
92%
4.1
84%
Grades in required clerkships
Gaps in medical education
3.9
70%
3.9
89%
4.3
Honors in clinical clerkships
Perceived commitment to specialty
3.7
66%
3.7
88%
4.5
Class ranking/quartile
58%
Evidence of professionalism and ethics
71%
Personal prior knowledge of the applicant
70%
3.6
4.6
4.0
Audition elective/rotation within your department
65%
4.1
Leadership qualities
65%
4.1
Honors in clerkship in desired specialty
67%
4.1
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
Consistency of grades
Other life experience
4.2
71%
3.4
51%
4.0
82%
4.2
60%
4.0
51%
3.8
65%
Volunteer/extracurricular experiences
57%
3.6
Graduate of highly regarded U.S. medical school
58%
3.6
Demonstrated involvement and interest in research
45%
Visa status*
43%
Applicant was flagged with Match violation by the NRMP
3.3
3.9
4.8
54%
Interest in academic career
Honors in basic sciences
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
105
3.4
40%
Away rotation in your specialty at another institution
USMLE/COMLEX Step 3 score
100%
2.8
22%
Gold Society membership
Fluency in language spoken by your patient population
3.4
30%
3.1
24%
4.0
51%
29%
50%
0% 1
2
3.4
3
4
5
Figure PSY-2
Psychiatry
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=83)
Percent Citing Factor
Interactions with faculty during interview and visit 98%
Interpersonal skills 99%
Interactions with house staff during interview and visit 95%
Feedback from current residents
89%
USMLE Step 1/COMLEX Level 1 score
73%
Letters of recommendation in the specialty
78%
USMLE Step 2 CK/COMLEX Level 2 CE score
73%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
71%
Perceived commitment to specialty
84%
Evidence of professionalism and ethics
77%
Perceived interest in program
62%
Leadership qualities
61%
Personal prior knowledge of the applicant
61%
Class ranking/quartile
51%
Graduate of U.S. allopathic medical school
66%
Personal Statement
74%
Audition elective/rotation within your department
59%
Grades in required clerkships
48%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
61%
Honors in clinical clerkships
44%
Honors in clerkship in desired specialty
48%
Gaps in medical education
66%
Grades in clerkship in desired specialty
52%
Alpha Omega Alpha (AOA) membership
45%
Other life experience
54%
Consistency of grades
40%
Volunteer/extracurricular experiences
39%
Demonstrated involvement and interest in research
35%
Graduate of highly regarded U.S. medical school
45%
Other post‐interview contact
39%
Interest in academic career
32%
Visa status*
33%
Applicant was flagged with Match violation by the NRMP
34%
Fluency in language spoken by your patient population
48%
Gold Society membership
29%
Honors in basic sciences
17%
Second interview/visit
17%
Away rotation in your specialty at another institution
11%
USMLE/COMLEX Step 3 score
27%
0% 1
100%
50%
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
106
Average Rating
4.9
5.0
4.9
4.8
3.8
3.9
3.9
4.2
4.4
4.8
4.2
4.1
4.1
3.6
4.1
3.7
4.2
3.8
4.1
3.8
3.9
4.2
4.0
3.7
3.9
4.2
3.8
3.6
3.8
3.8
3.7
4.1
4.9
4.2
3.7
3.3
3.6
3.6
3.3
2
3
4
5
Psychiatry
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure PSY-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=83
100%
90%
80%
70%
80%
69%
70%
60%
56%
60%
50%
50%
40%
41%
40%
30%
30%
30%
20%
20%
10%
0%
N=71
100%
90%
10%
1%
Yes, pass only
Yes, target score
3%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=83
N=70
100%
100%
90%
90%
80%
80%
70%
60%
70%
60%
64%
60%
50%
50%
40%
40%
30%
16%
20%
20%
10%
10%
0%
0%
Yes, pass only
30%
30%
24%
Yes, target score
No
6%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=17
N=14
N=14
USMLE Step 2 CK
N=12
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
107
Psychiatry
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure PSY-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=80
100%
N=63
100%
90%
90%
80%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
20%
0%
30%
20%
N=80
10%
59%
N=63 11%
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=72
80%
80%
70%
67%
70%
60%
60%
50%
50%
31%
30%
58%
40%
40%
30%
24%
18%
20%
20%
10%
0%
N=71
90%
90%
3%
Yes, pass only
Yes, target score
No
10%
0%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=70
90%
80%
70%
80%
67%
70%
60%
60%
50%
50%
40%
40%
30%
23%
53%
33%
30%
20%
20%
10%
10%
0%
N=49
90%
Yes, pass only
Yes, target score
No
0%
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
14%
10%
108
Yes, pass only
Yes, target score
No
Figure PSY-5
Psychiatry
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
1,000
Average Percentage of Applicants Rejected and
Reviewed
100%
900
858
90%
800
80%
700
70%
61%
600
60%
500
50%
400
40%
300
200
20%
100
100
0
30%
30%
79
61
Number of
applicants
interviewed
Number of
applicants
ranked
10%
7
Number of
positions in the
Match
N=84*
Number of
applications
received
N=81
Number of
interview
invitations sent
N=81
N=83
0%
Percentage of applications
rejected
N=84*
Percentage of applicants
receiving an in-depth review
N=77
N=81
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
40% of Psychiatry programs consider all applicant groups
98%
90%
86%
89%
N=83
80%
80%
67%
70%
63%
60%
46%
50%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
109
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Radiation Oncology
(N=44)
NRMP Program Director Survey Results, 2014
110
Figure RO-1
Radiation Oncology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=43)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
Average Rating
95%
4.3
Letters of recommendation in the specialty 100%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
4.5
86%
4.0
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
51%
84%
Graduate of U.S. allopathic medical school
Grades in required clerkships
3.8
65%
4.2
77%
3.9
Gaps in medical education
Honors in clinical clerkships
47%
3.8
72%
4.2
Perceived commitment to specialty
67%
Class ranking/quartile
65%
Evidence of professionalism and ethics
63%
Personal prior knowledge of the applicant
Audition elective/rotation within your department
4.1
4.5
4.0
4.6
56%
4.3
4.3
72%
Leadership qualities
60%
4.3
Honors in clerkship in desired specialty
60%
4.3
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
4.1
70%
60%
Other life experience
58%
Volunteer/extracurricular experiences
4.3
3.7
3.9
53%
Graduate of highly regarded U.S. medical school
4.0
63%
4.4
86%
Visa status*
21%
Applicant was flagged with Match violation by the NRMP
23%
Interest in academic career
Fluency in language spoken by your patient population
111
4.0
3.9
3.7
14%
44%
12%
Away rotation in your specialty at another institution
NRMP Program Director Survey Results, 2014
4.7
28%
Gold Society membership
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.6
53%
Honors in basic sciences
USMLE/COMLEX Step 3 score
100%
4.3
21%
Consistency of grades
Demonstrated involvement and interest in research
3.8
60%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Perceived interest in program
4.3
56%
3.8
3.4
9%
50%
0% 1
2
3
4.5
4
5
Figure RO-2
Radiation Oncology
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=43)
Percent Citing Factor
Interactions with faculty during interview and visit
84%
Interpersonal skills
86%
Interactions with house staff during interview and visit
70%
Feedback from current residents
70%
USMLE Step 1/COMLEX Level 1 score
57%
Letters of recommendation in the specialty
77%
USMLE Step 2 CK/COMLEX Level 2 CE score
23%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
45%
Perceived commitment to specialty
57%
Evidence of professionalism and ethics
39%
Perceived interest in program
61%
Leadership qualities
39%
Personal prior knowledge of the applicant
45%
Class ranking/quartile
39%
Graduate of U.S. allopathic medical school
27%
Personal Statement
45%
Audition elective/rotation within your department
39%
Grades in required clerkships
41%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
2%
Honors in clinical clerkships
41%
Honors in clerkship in desired specialty
23%
Gaps in medical education
11%
Grades in clerkship in desired specialty
25%
Alpha Omega Alpha (AOA) membership
18%
Other life experience
32%
Consistency of grades
23%
Volunteer/extracurricular experiences
20%
Demonstrated involvement and interest in research
61%
Graduate of highly regarded U.S. medical school
30%
Other post‐interview contact
25%
Interest in academic career
41%
Visa status*
2%
Applicant was flagged with Match violation by the NRMP
5%
7%
Fluency in language spoken by your patient population
0%
Gold Society membership
Honors in basic sciences
14%
Second interview/visit
7%
Away rotation in your specialty at another institution
30%
USMLE/COMLEX Step 3 score
2%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
112
Average Rating
4.9
4.9
4.8
4.6
3.8
4.4
4.2
4.2
4.4
4.6
4.4
4.2
4.4
4.0
4.0
4.0
4.4
3.7
4.0
3.8
4.3
3.4
4.0
4.0
3.6
4.2
3.7
4.4
3.8
4.5
4.2
4.0
5.0
3.3
3.5
4.3
4.0
4.0
2
3
4
5
Radiation Oncology
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure RO-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=41
100%
90%
80%
73%
80%
70%
70%
60%
60%
50%
44%
40%
27%
30%
20%
20%
10%
0%
54%
50%
40%
30%
N=39
100%
90%
10%
0%
Yes, pass only
Yes, target score
3%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=35
N=28
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
37%
43%
40%
30%
23%
20%
20%
10%
10%
0%
0%
Yes, pass only
54%
Yes, target score
No
4%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=24
N=10
N=11
USMLE Step 2 CK
N=6
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
113
Radiation Oncology
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure RO-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=36
100%
90%
90%
80%
80%
70%
70%
61%
60%
N=23
100%
74%
60%
50%
50%
39%
40%
40%
30%
30%
20%
20%
N=36
10%
0%
22%
N=23
10%
Yes
0%
No
Yes, pass only
4%
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=20
80%
80%
70%
70%
60%
50%
50%
40%
40%
30%
30%
20%
20%
10%
10%
0%
70%
70%
60%
20%
N=20
90%
90%
Yes, pass only
Yes, target score
20%
10%
10%
No
0%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=20
90%
80%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
10%
Yes, pass only
22%
20%
10%
0%
78%
80%
70%
70%
20%
N=18
90%
Yes, target score
10%
No
0%
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
114
0%
Yes, pass only
Yes, target score
No
Figure RO-5
Radiation Oncology
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
73%
700
70%
600
60%
500
50%
400
40%
300
30%
169
200
100
0
2
Number of
positions in the
Match
N=44*
Number of
applications
received
N=43
26%
20%
10%
32
25
22
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=44
N=44
0%
Percentage of applications
rejected
N=44*
Percentage of applicants
receiving an in-depth review
N=42
N=43
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
12% of Radiation Oncology programs consider all applicant groups
100%
N=42
90%
80%
70%
60%
55%
50%
45%
40%
30%
19%
20%
19%
12%
14%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
115
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Radiology-Diagnostic
(N=75)
NRMP Program Director Survey Results, 2014
116
Figure RD-1
Radiology-Diagnostic
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=74)
Percent Citing Factor
Average Rating
USMLE Step 1/COMLEX Level 1 score 99%
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
4.2
77%
91%
4.5
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
Grades in required clerkships
Gaps in medical education
Honors in clinical clerkships
66%
3.9
74%
3.3
82%
4.2
76%
4.5
72%
4.1
81%
Perceived commitment to specialty
Class ranking/quartile
3.9
4.1
62%
3.9
85%
4.3
Evidence of professionalism and ethics
64%
Personal prior knowledge of the applicant
64%
4.2
4.1
Audition elective/rotation within your department
59%
Leadership qualities
58%
Honors in clerkship in desired specialty
3.7
4.2
47%
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
3.9
4.2
50%
3.9
77%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
4.4
31%
Perceived interest in program
65%
4.0
Consistency of grades
64%
4.1
Other life experience
Volunteer/extracurricular experiences
Graduate of highly regarded U.S. medical school
Demonstrated involvement and interest in research
3.6
61%
3.3
50%
3.9
57%
3.5
47%
Visa status*
42%
Applicant was flagged with Match violation by the NRMP
42%
Interest in academic career
3.9
3.2
15%
14%
Fluency in language spoken by your patient population
117
3.8
22%
Away rotation in your specialty at another institution
NRMP Program Director Survey Results, 2014
3.3
41%
Gold Society membership
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
4.6
27%
Honors in basic sciences
USMLE/COMLEX Step 3 score
100%
4.1
3.0
18%
50%
0% 1
2
3.5
3
4
5
Figure RD-2
Radiology-Diagnostic
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=74)
Percent Citing Factor
Interactions with faculty during interview and visit 95%
Interpersonal skills 97%
Interactions with house staff during interview and visit
85%
Feedback from current residents
82%
USMLE Step 1/COMLEX Level 1 score
85%
Letters of recommendation in the specialty
65%
USMLE Step 2 CK/COMLEX Level 2 CE score
53%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
78%
Perceived commitment to specialty
61%
Evidence of professionalism and ethics
51%
Perceived interest in program
64%
Leadership qualities
57%
Personal prior knowledge of the applicant
55%
Class ranking/quartile
73%
Graduate of U.S. allopathic medical school
62%
Personal Statement
49%
Audition elective/rotation within your department
50%
Grades in required clerkships
59%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
24%
Honors in clinical clerkships
50%
Honors in clerkship in desired specialty
32%
Gaps in medical education
42%
Grades in clerkship in desired specialty
27%
Alpha Omega Alpha (AOA) membership
53%
Other life experience
50%
Consistency of grades
45%
Volunteer/extracurricular experiences
34%
Demonstrated involvement and interest in research
39%
Graduate of highly regarded U.S. medical school
42%
Other post‐interview contact
38%
Interest in academic career
31%
Visa status*
27%
Applicant was flagged with Match violation by the NRMP
22%
8%
Fluency in language spoken by your patient population
Gold Society membership
19%
Honors in basic sciences
26%
Second interview/visit
12%
Away rotation in your specialty at another institution
8%
USMLE/COMLEX Step 3 score
11%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
118
Average Rating
4.7
4.7
4.7
4.6
4.1
3.9
3.8
4.3
4.1
4.4
4.2
4.1
4.2
4.4
4.3
3.3
4.3
4.3
3.9
4.2
4.3
4.3
4.3
4.0
3.7
4.2
3.5
3.7
4.1
3.7
3.6
4.0
4.9
3.3
4.1
3.7
3.8
3.2
3.9
2
3
4
5
Radiology-Diagnostic
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure RD-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=71
100%
90%
80%
80%
70%
70%
60%
60%
50%
45%
40%
30%
30%
20%
14%
10%
0%
52%
50%
40%
20%
N=62
100%
86%
90%
10%
0%
Yes, pass only
Yes, target score
3%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=66
N=44
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
44%
36%
40%
30%
20%
40%
30%
20%
20%
10%
10%
0%
0%
Yes, pass only
50%
48%
Yes, target score
No
2%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=53
N=26
N=33
USMLE Step 2 CK
N=15
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
119
Radiology-Diagnostic
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure RD-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=62
100%
N=39
100%
90%
90%
80%
80%
70%
69%
70%
60%
60%
60%
50%
50%
40%
40%
40%
30%
30%
20%
20%
N=62
10%
0%
23%
N=39 8%
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=29
90%
90%
80%
80%
70%
70%
48%
50%
50%
40%
40%
28%
24%
30%
20%
20%
10%
10%
0%
67%
60%
60%
30%
N=27
Yes, pass only
Yes, target score
No
0%
19%
15%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=28
90%
80%
70%
60%
60%
50%
50%
40%
40%
30%
21%
20%
20%
11%
10%
0%
76%
80%
68%
70%
30%
N=25
90%
Yes, pass only
Yes, target score
No
0%
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
16%
8%
10%
120
Yes, pass only
Yes, target score
No
Figure RD-5
Radiology-Diagnostic
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
60%
500
50%
426
400
39%
40%
300
30%
200
20%
106
100
0
56%
84
76
Number of
applicants
interviewed
Number of
applicants
ranked
10%
7
Number of
positions in the
Match
N=75*
Number of
applications
received
N=74
Number of
interview
invitations sent
N=71
N=73
0%
Percentage of applications
rejected
N=75*
Percentage of applicants
receiving an in-depth review
N=73
N=74
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
28% of Radiology-Diagnostic programs consider all applicant groups
99%
N=74
90%
78%
80%
70%
64%
60%
50%
50%
45%
36%
40%
30%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
121
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Surgery
(N=121)
NRMP Program Director Survey Results, 2014
122
Figure GS-1
Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=115)
Percent Citing Factor
Average Rating
USMLE Step 1/COMLEX Level 1 score 97%
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
Personal Statement
Graduate of U.S. allopathic medical school
4.4
92%
4.3
79%
3.8
87%
4.3
72%
3.5
76%
4.3
Grades in required clerkships
70%
Gaps in medical education
69%
Honors in clinical clerkships
Perceived commitment to specialty
Class ranking/quartile
Evidence of professionalism and ethics
Personal prior knowledge of the applicant
Honors in clerkship in desired specialty
4.0
65%
4.0
58%
4.5
62%
4.1
4.0
53%
4.2
68%
4.4
73%
69%
Alpha Omega Alpha (AOA) membership
70%
Perceived interest in program
4.3
70%
Grades in clerkship in desired specialty
Pass USMLE Step2 CS/COMLEX Lvl2 PE
4.1
78%
Audition elective/rotation within your department
Leadership qualities
3.9
4.2
3.9
4.2
47%
3.9
55%
Consistency of grades
3.9
39%
Other life experience
52%
3.6
Volunteer/extracurricular experiences
50%
3.6
Graduate of highly regarded U.S. medical school
3.8
Demonstrated involvement and interest in research
47%
Visa status*
45%
Applicant was flagged with Match violation by the NRMP
3.5
3.9
29%
Away rotation in your specialty at another institution
3.5
21%
10%
Fluency in language spoken by your patient population
123
3.8
21%
Gold Society membership
NRMP Program Director Survey Results, 2014
4.8
33%
Honors in basic sciences
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.9
27%
Interest in academic career
USMLE/COMLEX Step 3 score
100%
3.9
43%
3.3
3.9
10%
50%
0% 1
2
3
4
5
Figure GS-2
Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=115)
Percent Citing Factor
Interactions with faculty during interview and visit
91%
Interpersonal skills
89%
Interactions with house staff during interview and visit
86%
Feedback from current residents
76%
USMLE Step 1/COMLEX Level 1 score
82%
Letters of recommendation in the specialty
79%
USMLE Step 2 CK/COMLEX Level 2 CE score
78%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
58%
Perceived commitment to specialty
69%
Evidence of professionalism and ethics
53%
Perceived interest in program
64%
Leadership qualities
59%
Personal prior knowledge of the applicant
53%
Class ranking/quartile
55%
Graduate of U.S. allopathic medical school
62%
Personal Statement
51%
Audition elective/rotation within your department
48%
Grades in required clerkships
41%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
38%
Honors in clinical clerkships
46%
Honors in clerkship in desired specialty
59%
Gaps in medical education
38%
Grades in clerkship in desired specialty
44%
Alpha Omega Alpha (AOA) membership
48%
Other life experience
42%
Consistency of grades
33%
Volunteer/extracurricular experiences
36%
Demonstrated involvement and interest in research
34%
Graduate of highly regarded U.S. medical school
35%
Other post‐interview contact
36%
Interest in academic career
31%
Visa status*
24%
Applicant was flagged with Match violation by the NRMP
14%
Fluency in language spoken by your patient population
10%
Gold Society membership
18%
Honors in basic sciences
17%
Second interview/visit
23%
Away rotation in your specialty at another institution
12%
USMLE/COMLEX Step 3 score
8%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
124
Average Rating
4.8
4.7
4.8
4.6
4.4
4.2
4.2
3.8
4.3
4.5
4.1
4.2
4.3
4.0
4.3
3.4
4.2
4.0
4.2
4.1
4.2
4.1
4.2
4.1
3.6
3.9
3.5
3.9
4.0
4.1
3.9
4.1
4.3
3.7
3.9
3.6
4.0
3.7
3.9
2
3
4
5
Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure GS-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=112
100%
91%
90%
90%
80%
80%
70%
70%
60%
60%
50%
45%
40%
30%
30%
20%
0%
53%
50%
40%
10%
N=104
100%
20%
9%
10%
0%
Yes, pass only
Yes, target score
2%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=107
N=92
100%
100%
90%
90%
80%
74%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
10%
0%
16%
10%
36%
20%
10%
0%
Yes, pass only
62%
Yes, target score
No
2%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=94
N=76
N=72
USMLE Step 2 CK
N=58
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
125
Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure GS-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=102
100%
N=62
100%
90%
90%
80%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
74%
30%
20%
20%
0%
10%
Yes
16%
20%
N=102
10%
0%
No
10%
N=62
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=54
90%
90%
80%
80%
70%
70%
60%
52%
37%
40%
40%
0%
30%
30%
30%
10%
57%
60%
50%
50%
20%
N=53
20%
11%
13%
10%
Yes, pass only
Yes, target score
No
0%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=50
90%
90%
80%
80%
70%
64%
60%
50%
50%
40%
40%
26%
30%
20%
20%
10%
10%
0%
80%
70%
60%
30%
N=40
Yes, pass only
Yes, target score
10%
No
0%
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
126
10%
10%
Yes, pass only
Yes, target score
No
Figure GS-5
Surgery
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
731
700
70%
62%
600
60%
500
50%
400
40%
300
200
20%
92
100
0
33%
30%
74
55
Number of
applicants
interviewed
Number of
applicants
ranked
10%
5
Number of
positions in the
Match
N=121*
Number of
applications
received
N=118
Number of
interview
invitations sent
N=115
N=117
0%
Percentage of applications
rejected
N=121*
Percentage of applicants
receiving an in-depth review
N=115
N=118
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
19% of Surgery programs consider all applicant groups
100%
N=113
90%
80%
66%
70%
60%
50%
50%
48%
39%
37%
40%
30%
23%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
127
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Thoracic Surgery
(N=12)
NRMP Program Director Survey Results, 2014
128
Figure TS-1
Thoracic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=12)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
92%
Letters of recommendation in the specialty
92%
Average Rating
4.1
4.7
Medical Student Performance Evaluation (MSPE/Dean's Letter)
83%
4.0
USMLE Step 2 CK/COMLEX Level 2 CE score
83%
4.0
Personal Statement
83%
3.6
Graduate of U.S. allopathic medical school
Grades in required clerkships
33%
83%
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
4.1
50%
4.0
83%
4.0
50%
Class ranking/quartile
Evidence of professionalism and ethics
4.0
33%
4.6
42%
Audition elective/rotation within your department
42%
Honors in clerkship in desired specialty
Grades in clerkship in desired specialty
Alpha Omega Alpha (AOA) membership
4.3
4.6
4.4
67%
4.0
58%
4.5
4.2
50%
4.0
58%
5.0
42%
Applicant was flagged with Match violation by the NRMP
5.0
17%
3.7
50%
Honors in basic sciences
3.7
25%
Gold Society membership
0%
Away rotation in your specialty at another institution
Fluency in language spoken by your patient population
129
4.0
25%
17%
Visa status*
NRMP Program Director Survey Results, 2014
3.8
42%
Volunteer/extracurricular experiences
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
4.0
33%
Other life experience
USMLE/COMLEX Step 3 score
100%
3.6
42%
Consistency of grades
Interest in academic career
3.6
58%
Perceived interest in program
Demonstrated involvement and interest in research
3.4
50%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
Graduate of highly regarded U.S. medical school
3.5
58%
Personal prior knowledge of the applicant
Leadership qualities
4.3
50%
17%
8%
3.5
17%
3.5
3
5.0
0% 1
2
4
5
Figure TS-2
Thoracic Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=12)
Percent Citing Factor
Interactions with faculty during interview and visit
92%
Interpersonal skills
92%
Interactions with house staff during interview and visit
83%
Feedback from current residents
83%
USMLE Step 1/COMLEX Level 1 score
75%
Letters of recommendation in the specialty
92%
USMLE Step 2 CK/COMLEX Level 2 CE score
67%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
58%
Perceived commitment to specialty
75%
Evidence of professionalism and ethics
75%
Perceived interest in program
42%
Leadership qualities
67%
Personal prior knowledge of the applicant
50%
Class ranking/quartile
8%
Graduate of U.S. allopathic medical school
33%
Personal Statement
67%
Audition elective/rotation within your department
25%
Grades in required clerkships
67%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
33%
Honors in clinical clerkships
67%
Honors in clerkship in desired specialty
67%
Gaps in medical education
25%
Grades in clerkship in desired specialty
67%
Alpha Omega Alpha (AOA) membership
50%
Other life experience
33%
Consistency of grades
42%
Volunteer/extracurricular experiences
17%
Demonstrated involvement and interest in research
67%
Graduate of highly regarded U.S. medical school
58%
Other post‐interview contact
58%
Interest in academic career
50%
Visa status*
17%
Applicant was flagged with Match violation by the NRMP
25%
Fluency in language spoken by your patient population
17%
0%
Gold Society membership
Honors in basic sciences
17%
Second interview/visit
17%
Away rotation in your specialty at another institution
8%
USMLE/COMLEX Step 3 score
0%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
130
Average Rating
4.8
4.6
4.8
4.6
4.2
4.6
4.3
3.3
4.2
4.3
4.4
4.1
4.0
5.0
4.5
3.4
4.3
3.9
4.0
4.3
4.3
4.0
4.3
4.3
3.5
4.0
3.0
3.5
4.0
4.1
3.8
4.5
4.0
4.5
3.0
4.0
4.0
2
3
4
5
Thoracic Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure TS-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=12
100%
90%
80%
80%
70%
60%
50%
50%
33%
40%
30%
33%
30%
20%
20%
8%
10%
0%
67%
70%
58%
60%
40%
N=6
100%
90%
Yes, pass only
Yes, target score
10%
0%
No
0%
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=12
N=5
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
42%
80%
50%
42%
40%
40%
30%
30%
17%
20%
20%
10%
10%
0%
0%
Yes, pass only
Yes, target score
No
20%
0%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
250
240
230
USMLE Step 1 not
reported because
of low response
rate
USMLE Step 2 CK
not reported
because of low
response rate
220
210
USMLE Step 2 CK
not reported
because of low
response rate
200
190
180
170
USMLE Step 1
N=5
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
131
Thoracic Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure TS-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=11
100%
91%
90%
N=6
100%
90%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
30%
20%
67%
33%
20%
N=11
10%
0%
9%
Yes
N=6
10%
0%
No
0%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=7
90%
90%
80%
80%
70%
70%
60%
60%
50%
43%
30%
29%
29%
20%
10%
10%
Yes, pass only
Yes, target score
33%
30%
20%
0%
50%
50%
40%
40%
N=6
No
0%
17%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 3*
N=4
100%
N=5
90%
80%
Not reported because
of low response rate
70%
60%
60%
50%
40%
40%
30%
20%
10%
0%
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
132
0%
Yes, pass only
Yes, target score
No
Figure TS-5
Thoracic Surgery
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
62%
600
60%
500
50%
400
40%
300
30%
200
20%
108
100
0
36%
1
Number of
positions in the
Match
N=12*
Number of
applications
received
N=12
10%
33
28
23
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=12
N=12
0%
Percentage of applications
rejected
N=12*
Percentage of applicants
receiving an in-depth review
N=12
N=12
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
17% of Thoracic Surgery programs consider all applicant groups
100%
N=12
90%
80%
70%
58%
60%
58%
50%
50%
42%
40%
30%
25%
25%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
133
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Transitional Year
(N=47)
NRMP Program Director Survey Results, 2014
134
Figure TY-1
Transitional Year
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=47)
Percent Citing Factor
Average Rating
USMLE Step 1/COMLEX Level 1 score 98%
4.2
Letters of recommendation in the specialty
Medical Student Performance Evaluation (MSPE/Dean's Letter)
USMLE Step 2 CK/COMLEX Level 2 CE score
53%
3.9
85%
4.2
89%
4.1
Personal Statement
70%
Graduate of U.S. allopathic medical school
68%
Grades in required clerkships
3.9
4.4
53%
Gaps in medical education
68%
Honors in clinical clerkships
70%
4.4
4.4
4.3
Perceived commitment to specialty
Class ranking/quartile
28%
72%
4.3
Evidence of professionalism and ethics
66%
Personal prior knowledge of the applicant
68%
4.7
4.3
Audition elective/rotation within your department
66%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
64%
3.8
4.2
4.4
74%
4.0
53%
3.9
47%
3.8
60%
Graduate of highly regarded U.S. medical school
3.6
36%
Demonstrated involvement and interest in research
4.3
32%
Applicant was flagged with Match violation by the NRMP
4.6
40%
Interest in academic career
Honors in basic sciences
17%
26%
Gold Society membership
23%
Away rotation in your specialty at another institution
6%
15%
Fluency in language spoken by your patient population
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
135
3.8
28%
Visa status*
USMLE/COMLEX Step 3 score
100%
4.2
23%
Alpha Omega Alpha (AOA) membership
Volunteer/extracurricular experiences
4.1
28%
Grades in clerkship in desired specialty
Other life experience
4.2
45%
Honors in clerkship in desired specialty
Consistency of grades
3.9
40%
Leadership qualities
Perceived interest in program
4.1
3.9
3.9
3.5
4.0
4.4
9%
50%
0% 1
2
3.3
3
4
5
Figure TY-2
Transitional Year
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=47)
Percent Citing Factor
Interactions with faculty during interview and visit
89%
Interpersonal skills
89%
Interactions with house staff during interview and visit
74%
Feedback from current residents
83%
USMLE Step 1/COMLEX Level 1 score
91%
Letters of recommendation in the specialty
40%
USMLE Step 2 CK/COMLEX Level 2 CE score
79%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
72%
Perceived commitment to specialty
21%
Evidence of professionalism and ethics
72%
Perceived interest in program
79%
Leadership qualities
53%
Personal prior knowledge of the applicant
57%
Class ranking/quartile
66%
Graduate of U.S. allopathic medical school
60%
Personal Statement
68%
Audition elective/rotation within your department
36%
Grades in required clerkships
60%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
60%
Honors in clinical clerkships
64%
Honors in clerkship in desired specialty
23%
Gaps in medical education
49%
Grades in clerkship in desired specialty
19%
Alpha Omega Alpha (AOA) membership
57%
Other life experience
45%
Consistency of grades
40%
Volunteer/extracurricular experiences
47%
Demonstrated involvement and interest in research
28%
Graduate of highly regarded U.S. medical school
34%
Other post‐interview contact
45%
Interest in academic career
15%
Visa status*
23%
Applicant was flagged with Match violation by the NRMP
26%
Fluency in language spoken by your patient population
19%
Gold Society membership
15%
Honors in basic sciences
28%
Second interview/visit
15%
Away rotation in your specialty at another institution
13%
USMLE/COMLEX Step 3 score
15%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
136
Average Rating
4.7
4.8
4.6
4.3
4.0
3.9
4.2
4.3
4.1
4.6
4.4
4.2
4.4
4.2
4.2
3.9
4.3
4.2
4.2
4.1
3.9
4.3
4.1
4.0
4.0
4.3
3.9
3.8
4.0
4.0
4.0
4.5
4.8
4.4
3.9
4.1
3.7
3.8
3.7
2
3
4
5
Transitional Year
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure TY-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=47
100%
80%
90%
74%
80%
70%
70%
60%
50%
40%
40%
28%
30%
23%
20%
20%
10%
0%
65%
60%
50%
30%
N=43
100%
90%
Yes, pass only
Yes, target score
7%
10%
2%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=44
N=36
100%
100%
90%
90%
80%
80%
70%
70%
60%
60%
50%
40%
50%
41%
40%
32%
27%
30%
30%
20%
20%
10%
10%
0%
0%
Yes, pass only
69%
Yes, target score
No
28%
3%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=26
N=16
N=19
USMLE Step 2 CK
N=10
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
137
Transitional Year
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure TY-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=44
100%
90%
90%
80%
80%
68%
70%
N=19
100%
84%
70%
60%
60%
50%
50%
40%
40%
32%
30%
30%
20%
20%
N=44
10%
0%
16%
N=19
10%
Yes
0%
No
0%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=27
90%
90%
80%
80%
70%
70%
60%
60%
48%
50%
40%
50%
40%
33%
30%
30%
19%
20%
38%
31%
31%
Yes, pass only
Yes, target score
20%
10%
10%
0%
N=26
Yes, pass only
Yes, target score
No
0%
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=25
90%
90%
80%
80%
70%
70%
60%
80%
60%
52%
50%
50%
40%
40%
40%
30%
30%
20%
20%
8%
10%
0%
N=15
Yes, pass only
Yes, target score
10%
No
0%
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
20%
138
0%
Yes, pass only
Yes, target score
No
Figure TY-5
Transitional Year
Program's Interview Activities
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
70%
600
60%
541
500
55%
50%
400
40%
300
34%
30%
200
20%
99
100
78
78
Number of
applicants
interviewed
Number of
applicants
ranked
10%
10
0
Number of
positions in the
Match
N=47*
Number of
applications
received
N=46
Number of
interview
invitations sent
N=46
N=45
0%
Percentage of applications
rejected
N=47*
Percentage of applicants
receiving an in-depth review
N=45
N=46
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
17% of Transitional Year programs consider all applicant groups
100%
N=47
90%
80%
74%
70%
60%
50%
40%
38%
34%
30%
30%
23%
19%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
139
Fifth Pathway
U.S. IMG
Non-U.S. IMG
Vascular Surgery
(N=22)
NRMP Program Director Survey Results, 2014
140
Figure VS-1
Vascular Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Selecting Applicants to Interview
(N=20)
Percent Citing Factor
USMLE Step 1/COMLEX Level 1 score
Average Rating
95%
3.8
Letters of recommendation in the specialty 100%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
4.7
70%
USMLE Step 2 CK/COMLEX Level 2 CE score
80%
Personal Statement
80%
3.9
3.6
3.9
Graduate of U.S. allopathic medical school
55%
Grades in required clerkships
3.9
50%
Gaps in medical education
Honors in clinical clerkships
Perceived commitment to specialty
30%
4.1
80%
4.8
55%
Evidence of professionalism and ethics
55%
Honors in clerkship in desired specialty
4.0
4.2
65%
Pass USMLE Step2 CS/COMLEX Lvl2 PE
4.2
3.8
4.5
65%
3.7
50%
Other life experience
3.7
50%
Graduate of highly regarded U.S. medical school
3.8
55%
4.0
75%
3.9
45%
3.5
10%
10%
Gold Society membership
Away rotation in your specialty at another institution
3.0
3.7
30%
15%
Fluency in language spoken by your patient population
141
4.6
25%
Honors in basic sciences
NRMP Program Director Survey Results, 2014
3.7
45%
Applicant was flagged with Match violation by the NRMP
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
3.9
40%
Volunteer/extracurricular experiences
USMLE/COMLEX Step 3 score
100%
3.6
45%
Consistency of grades
Interest in academic career
4.0
75%
Alpha Omega Alpha (AOA) membership
Visa status*
3.3
60%
65%
Demonstrated involvement and interest in research
4.5
45%
Grades in clerkship in desired specialty
Perceived interest in program
4.0
60%
Audition elective/rotation within your department
Leadership qualities
3.5
70%
Class ranking/quartile
Personal prior knowledge of the applicant
4.0
3.3
15%
50%
0% 1
2
3
4.3
4
5
Figure VS-2
Vascular Surgery
Percentage of Programs Citing Each Factor And Mean Importance Rating¹ for Each
Factor in Ranking Applicants
(N=20)
Percent Citing Factor
Interactions with faculty during interview and visit 95%
Interpersonal skills 100%
Interactions with house staff during interview and visit
85%
Feedback from current residents
60%
USMLE Step 1/COMLEX Level 1 score
75%
Letters of recommendation in the specialty 95%
USMLE Step 2 CK/COMLEX Level 2 CE score
70%
Medical Student Performance Evaluation (MSPE/Dean's Letter)
55%
Perceived commitment to specialty
60%
Evidence of professionalism and ethics
55%
Perceived interest in program
60%
Leadership qualities
40%
Personal prior knowledge of the applicant
50%
Class ranking/quartile
50%
Graduate of U.S. allopathic medical school
35%
Personal Statement
40%
Audition elective/rotation within your department
30%
Grades in required clerkships
40%
Passing USMLE Step 2 CS/COMLEX Level 2 PE
35%
Honors in clinical clerkships
50%
Honors in clerkship in desired specialty
40%
Gaps in medical education
10%
Grades in clerkship in desired specialty
45%
Alpha Omega Alpha (AOA) membership
50%
Other life experience
40%
Consistency of grades
35%
Volunteer/extracurricular experiences
25%
Demonstrated involvement and interest in research
60%
Graduate of highly regarded U.S. medical school
40%
Other post‐interview contact
40%
Interest in academic career
45%
Visa status*
20%
Applicant was flagged with Match violation by the NRMP
5%
0%
Fluency in language spoken by your patient population
10%
Gold Society membership
Honors in basic sciences
25%
Second interview/visit
5%
Away rotation in your specialty at another institution
15%
USMLE/COMLEX Step 3 score
20%
100%
50%
0% 1
¹ Ratings on a scale from 1 (not at all important) to 5 (very important).
* International Medical Graduates only
NRMP Program Director Survey Results, 2014
142
Average Rating
4.9
4.7
4.7
4.2
3.9
4.7
3.9
3.8
4.7
4.5
4.6
3.9
3.9
3.8
4.3
3.6
4.0
4.1
3.7
3.7
4.0
3.0
4.1
4.1
3.6
4.2
2.8
3.9
3.9
3.6
4.2
3.5
5.0
2.5
3.4
3.0
4.0
4.0
2
3
4
5
Vascular Surgery
Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When
Considering Which Applicants to Interview
Figure VS-3
Percentage of Programs That Use USMLE Step 1 Score
Scores required?
Would your program consider applicants who fail the
exam on the first attempt?
N=21
100%
81%
80%
90%
80%
70%
60%
50%
50%
40%
40%
30%
32%
30%
19%
20%
10%
0%
68%
70%
60%
20%
N=19
100%
90%
10%
0%
Yes, pass only
Yes, target score
0%
0%
No
Never
Seldom
Often
Percentage of Programs That Use USMLE Step 2 (CK) Score
Would your program consider applicants who fail
the exam on the first attempt?
Scores required?
N=21
N=15
100%
100%
90%
90%
80%
80%
71%
70%
60%
50%
50%
40%
40%
30%
30%
20%
67%
70%
60%
14%
20%
14%
10%
10%
0%
0%
Yes, pass only
Yes, target score
33%
No
0%
Never
Seldom
often
Average USMLE Step 1 and Step 2 CK Scores Programs
Consider When Granting Interviews
Scores Below Which Programs
Generally Do Not Grant Interviews
Scores Above Which Programs
Almost Always Grant Interviews
260
260
250
250
240
240
230
230
220
220
210
210
200
200
190
190
180
180
170
170
USMLE Step 1
USMLE Step 2 CK
USMLE Step 1
N=11
N=8
N=8
USMLE Step 2 CK
N=6
The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th
percentiles) and the line in the box is the median. The x-shaped symbol is the mean.
NRMP Program Director Survey Results, 2014
143
Vascular Surgery
Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and
COMLEX-USA Scores* When Considering Which Applicants to Interview
Figure VS-4
Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores
USMLE Step 2 CS
USMLE Step 3
N=21
100%
N=15
100%
90%
90%
76%
80%
80%
70%
70%
60%
60%
50%
50%
40%
40%
30%
20%
20%
N=21
0%
33%
30%
24%
10%
53%
13%
N=15
10%
Yes
0%
No
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores
COMLEX-USA Level 1*
100%
COMLEX-USA Level 2-CE*
100%
N=13
90%
90%
80%
80%
70%
70%
60%
60%
50%
50%
38%
40%
30%
38%
50%
40%
33%
30%
23%
20%
20%
10%
10%
0%
N=12
Yes, pass only
Yes, target score
No
0%
17%
Yes, pass only
Yes, target score
No
Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores
COMLEX-USA Level 2-PE*
100%
COMLEX-USA Level 3*
100%
N=11
90%
90%
80%
80%
70%
70%
60%
60%
50%
45%
27%
27%
20%
10%
10%
Yes, pass only
Yes, target score
No
0%
* Osteopathic applicants only
NRMP Program Director Survey Results, 2014
30%
30%
20%
0%
50%
50%
40%
40%
30%
N=10
144
20%
Yes, pass only
Yes, target score
No
Vascular Surgery
Program's Interview Activities
Figure VS-5
Average Number of Positions, Applications Received, Interview
Invitations Sent, and Applicants Interviewed and Ranked
Average Percentage of Applicants Rejected and
Reviewed
1,000
100%
900
90%
800
80%
700
600
60%
500
50%
400
40%
300
27%
30%
200
20%
100
0
69%
70%
54
1
Number of
positions in the
Match
Number of
applications
received
N=22*
N=21
10%
22
17
14
Number of
interview
invitations sent
Number of
applicants
interviewed
Number of
applicants
ranked
N=22
N=22
0%
Percentage of applications
rejected
N=22*
Percentage of applicants
receiving an in-depth review
N=21
N=21
* Data from the NRMP database. All Responding programs included
100%
Percentage of Programs that Typically Interview and Rank Each Applicant Type
38% of Vascular Surgery programs consider all applicant groups
95%
N=21
90%
80%
71%
70%
62%
60%
48%
50%
52%
43%
43%
40%
30%
20%
10%
0%
U.S. Senior
U.S. Graduate
NRMP Program Director Survey Results, 2014
Osteopathic
Physician
Canadian
145
Fifth Pathway
U.S. IMG
Non-U.S. IMG