Results of the 2012 NRMP Program Director Survey August 2012 www.nrmp.org

advertisement

Results of the 2012

NRMP Program Director Survey

August 2012 www.nrmp.org

Requests for permission to use these data as well as questions about the content of this publication or the National Resident Matching Program data and reports may be directed to

Mei Liang, Director of Research, NRMP, at mliang@nrmp.org.

Questions about the NRMP should be directed to Mona Signer, Executive Director, NRMP, at msigner@nrmp.org

.

Suggested Citation

National Resident Matching Program, Data Release and Research Committee: Results of the

2012 NRMP Program Director Survey. National Resident Matching Program, Washington, DC.

2012.

Copyright © 2012 National Resident Matching Program.

Table of Contents

Introduction

The National Resident Matching Program (NRMP) conducted a survey of the directors of all programs participating in the

2012 Main Residency Match ℠ . The primary purpose of the survey was to shed light on the factors that program directors use in both (1) selecting applicants to interview and (2) ranking applicants for The Match.

The survey was fielded during the 19 days between the rank order list deadline and Match Week so that program match outcomes would not influence respondents' answers.

The survey solicited information on:

· the number of applications received, screened, and reviewed, as well as the number of applicants interviewed and ranked

· the percentage of interview slots offered prior to the

November 1 release date of the Medical Student

Performance Evaluation (MSPE/Dean's Letter)

· whether the program typically interviews and ranks specific applicant groups

·

· the use of test scores in considering which applicants to interview, and the factors used for both interview selection and for ranking applicants.

The overall response rate for all specialties in this report was 44.8 percent. Transitional Year and 21 specialties with

10 or more responses are included in this report. Their response rates are listed in the table below. Response rates for those specialties ranged from a high of 66.1 percent for

Physical Medicine and Rehabilitation to a low of 30.9 for

General Surgery.

Numbers of responses are presented in most of the graphs.

Some graphs use data from multiple survey questions. In those cases, different N's are listed. Numbers of applicants ranked and positions in the Match are extracted from the

NRMP database. Graphs are suppressed for specialties with less than five responses.

This report presents results by specialty on selected items from the survey. The NRMP hopes that program directors, medical school officials, and applicants find these data useful as they prepare for and participate in The Match.

_______________

The NRMP's data reporting and research activities are guided by its Data Release and Research Committee.

NRMP data and reports can be found at: www.nrmp.org/data/ .

Specialty

Anesthesiology

Child Neurology

Dermatology

Emergency Medicine

Family Medicine

General Surgery

Internal Medicine

Internal Medicine/Pediatrics

Neurological Surgery

Neurology

Obstetrics and Gynecology

Orthopaedic Surgery

Otolaryngology

Pathology

Pediatrics

Physical Medicine and Rehabilitation

Plastic Surgery

Psychiatry

Radiation Oncology

Radiology

Transitional Year

Vascular Surgery

All others

Total

NRMP Program Director Survey Results, 2012

Surveys Sent Number Responding Response Rate

251

161

107

147

731

76

98

142

191

104

117

153

451

530

85

199

110

35

253

56

57

190

127

4,371

88

46

53

98

235

164

296

35

42

59

113

87

51

78

131

37

27

88

45

88

49

13

37

1,960

40.5%

46.1%

42.9%

41.5%

45.0%

54.0%

47.7%

53.1%

46.1%

44.2%

45.3%

64.1%

52.1%

30.9%

51.8%

66.1%

47.4%

46.3%

52.9%

44.2%

44.5%

37.1%

29.1%

44.8%

1

All Specialties Combined

NRMP Program Director Survey Results, 2012 2

Figure 1

All Specialties

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0%

N=1,666

20%

NRMP Program Director Survey Results, 2012 3

40%

62%

62%

61%

61%

61%

60%

60%

60% 80%

69%

68%

67%

67%

63%

63%

71%

70%

69%

82%

81%

77%

100%

Figure 1

All Specialties

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continuted)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

51%

51%

50%

49%

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

36%

45%

34%

28% Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

27%

23%

Gold Society membership

0%

N=1,666

20%

23%

40% 60%

55%

55%

54%

53%

53%

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 4

80% 100%

Figure 2

All Specialties

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0 1

N=1,666

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 5

2 3

3.9

3.8

3.8

4

4.0

4.0

4.0

4.0

3.9

4.1

4.1

4.1

4.2

4.2

4.2

4.8

4.7

4.7

4.6

4.5

4.5

5

Figure 2

All Specialties

Mean Importance Ratings* of Factors in Ranking Applicants

(continuted)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 6

1

N=1,666

2

2.8

2.8

2.8

2.6

2.4

3

3.1

3.0

3.3

3.2

3.0

3.0

3.4

3.3

3.7

3.6

3.8

3.7

3.7

4 5

Figure 3

All Specialties

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

100%

80%

60%

40%

20%

36%

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=1,844

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=1,494

80%

63%

61%

60%

0%

Yes, pass only Yes, target score

1%

No

40%

20%

0%

26%

Never Seldom

13%

Often

100%

80%

60%

40%

20%

33%

0%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=1,771

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=1,303

80%

59%

48%

60%

40%

32%

20%

20%

Yes, target score No

0%

Never Seldom

8% often

USMLE Step 1 and Step 2 CK Scores

Programs Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

280

260

240

220

200

180

160

180

160

140 140

120 120

100

USMLE Step 1

N=997

USMLE Step 2 CK

N=708

100

USMLE Step 1

N=689

USMLE Step 2 CK

N=506

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in thebox is the median. The x-shaped symbol in the box is the mean.

NRMP Program Director Survey Results, 2012 7

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure 4

All Specialties

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 Clinical Skills (CS)

N=1,705

USMLE Step 3

N=1,138

77%

N=76

Yes, pass only

23%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

21%

Yes, pass only

10%

N=53

Yes, target score

69%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1*

N=1,262

COMLEX-USA Level 2-CE*

N=1,212

42%

Yes, pass only

35%

Yes, target score

23%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

39%

Yes, pass only

29%

Yes, target score

32%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=1,166

55%

Yes, pass only

10%

Yes, target score

35%

No

COMLEX-USA Level 3*

50%

40%

30%

20%

10%

0%

100%

90%

80%

70%

60%

21%

Yes, pass only

N=878

8%

Yes, target score

71%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 8

Figure 5

All Specialties

Program's Interview Activities

50%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=1,836

40%

30%

20%

10%

25%

12%

11%

16%

26%

10%

0%

0% 1-24% 25-49%

600

500

400

300

200

100

0

800

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

765

700

89

66

Number of applications received

Number of applicants interviewed

Number of applicants ranked

7

Number of postions in The

Match

50-74% 75-99% 100%

Average Percentage of Applications Interviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

53%

Percentage of applications rejected without an interview

46%

Percentage of applicants receiving an interview

N=1,844 N=1,849

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

98%

73%

U.S. Senior U.S. Grad

NRMP Program Director Survey Results, 2012

37% of all programs consider all applicants

N=1,868

73%

Osteopathic

55%

Canadian

9

42%

Fifth Pathway

63%

U.S. IMG

52%

Non-U.S. IMG

Anesthesiology

(N=88)

NRMP Program Director Survey Results, 2012 10

Figure AN-1

Anesthesiology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=74

40%

66%

74%

66%

76%

69%

70%

60%

73%

70%

76%

73%

80%

72%

72%

74%

72%

84%

84%

88%

82%

82%

100%

NRMP Program Director Survey Results, 2012 11

Figure AN-1

Anesthesiology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

32%

28%

15%

20%

26%

28%

34%

40% 60%

58%

53%

53%

65%

61%

69%

49%

50%

54%

61%

80% 100%

N=74

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 12

Figure AN-2

Anesthesiology

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 13

1

N=74

2 3

4.0

3.9

4.2

4.2

4.0

4.1

4.2

4.2

4.2

4.9

4.7

4.7

4.6

4.4

4.6

3.9

3.8

4

4.0

4.2

4.3

5

Figure AN-2

Anesthesiology

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 14

1

N=74

2

2.3

2.1

2.8

3.0

2.6

2.8

3.1

3.1

3.0

3.3

3.5

3.6

3.6

3.7

4.0

3.7

3.8

2.7

3 4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure AN-3

Anesthesiology

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

18%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=87

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=69

82%

90%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

35%

Never

62%

Seldom

3%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

17%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=81

Would your program consider applicants who fail their exam on the 1st attempt?

N=61

57%

Yes, target score

26%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

51%

Never

49%

Seldom

0% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=64

USMLE Step 2 CK

N=46

USMLE Step 1

N=48

USMLE Step 2 CK

N=36

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 15

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure AN-4

Anesthesiology

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=76 100%

USMLE Step 3

N=53

90%

67%

N=76

Yes, pass only

33%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

21%

Yes, pass only

N=53

11%

Yes, target score

68%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

29%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=59 N=51

90%

54%

80%

70%

60%

17%

50%

40%

30%

20%

29%

31%

10%

0%

Yes, pass only Yes, target score No Yes, pass only Yes, target score

39%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=47

COMLEX-USA Level 3*

N=35

53%

Yes, pass only

4%

Yes, target score

43%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

29%

Yes, pass only

3%

Yes, target score

69%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 16

Figure AN-5

Anesthesiology

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=86

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

7% 8%

17%

22%

37%

8%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

719

117

98

Number of applications received

N=86

Number of applicants interviewed

N=86

* Data from the NRMP database

Number of applicants ranked

N=88*

8

Number of positions in The

Match

N=88*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

48%

46%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=83 N=86

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

100%

39% of Anesthesiology programs consider all applicants

N=87

84% 83%

68%

54%

45%

52%

U.S. Grad Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

NRMP Program Director Survey Results, 2012 17

Child Neurology

(N=46)

NRMP Program Director Survey Results, 2012 18

Figure CN-1

Child Neurology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=41

73%

66%

78%

88%

54%

71%

40%

49%

68%

66%

80%

73%

73%

61%

66%

56%

61%

61%

63%

60%

66%

80% 100%

NRMP Program Director Survey Results, 2012 19

Figure CN-1

Child Neurology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

32%

39%

32%

49%

44%

46%

39%

59%

56%

51%

56%

51%

46%

54%

59%

17%

20% 40% 60% 80% 100%

N=41

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 20

Figure CN-2

Child Neurology

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 21

1

N=41

2 3

3.8

4.1

3.8

4.1

4.1

4

3.6

3.8

3.8

4.1

4.1

4.1

4.4

4.3

4.3

4.4

4.8

4.6

4.7

4.5

4.4

5

Figure CN-2

Child Neurology

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 22

1

N=41

2

2.7

2.8

3

3.1

3.2

3.1

3.5

3.4

3.5

4

3.4

3.7

3.6

3.3

3.5

3.6

3.6

3.9

4.0

4.0

5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure CN-3

Child Neurology

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

43%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=44

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=38

90%

82%

80%

55%

Yes, target score

2%

No

70%

60%

50%

40%

30%

20%

10%

0%

11%

Never Seldom

8%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

35%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=40

Would your program consider applicants who fail their exam on the 1st attempt?

N=33

45%

Yes, target score

20%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

18%

Never

76%

Seldom

6% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=19

USMLE Step 2 CK

N=14

USMLE Step 1

N=11

USMLE Step 2 CK

N=7

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 23

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure CN-4

Child Neurology

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=40 100%

USMLE Step 3

N=33

90%

75%

N=40

Yes, pass only

25%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

18%

Yes, pass only

N=33

27%

Yes, target score

55%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

48%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=33 N=31

90%

80%

70%

60%

45%

30%

21%

50%

40%

30%

20%

26%

10%

0%

Yes, pass only Yes, target score No Yes, pass only Yes, target score

29%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=29

COMLEX-USA Level 3*

N=27

48%

Yes, pass only

21%

Yes, target score

31%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

33%

Yes, pass only

15%

Yes, target score

52%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 24

Figure CN-5

Child Neurology

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=42

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

19% 19%

7%

24%

21%

10%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

51

17

Number of applications received

N=43

Number of applicants interviewed

N=43

* Data from the NRMP database

12

Number of applicants ranked

N=46*

2

Number of positions in The

Match

N=46*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

31%

73%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=43 N=43

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

98%

61% of Child Neurology programs consider all applicants

N=44 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

84%

U.S. Grad

86%

Osteopathic

86%

Canadian

61%

Fifth Pathway

77%

U.S. IMG

77%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 25

Dermatology

(N=53)

NRMP Program Director Survey Results, 2012 26

Figure D-1

Dermatology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=47

60%

70%

77%

74%

45%

57%

72%

40%

70%

49%

49%

55%

64%

51%

66%

55%

55%

51%

51%

60% 80%

85%

100%

NRMP Program Director Survey Results, 2012 27

Figure D-1

Dermatology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

26%

28%

40%

40%

30%

13%

17%

15%

20% 40%

47%

60%

60%

64%

57%

60%

57%

62%

62%

80% 100%

N=47

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 28

Figure D-2

Dermatology

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 29

1

N=47

2 3

3.3

4.1

3.7

3.9

4.3

3.6

4.1

4 5

4.3

4.5

4.2

4.2

4.4

4.3

4.2

4.4

4.9

4.8

4.7

4.6

4.7

Figure D-2

Dermatology

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 30

1

N=47

2

2.7

2.8

2.7

3

3.0

2.9

3.1

3.4

3.9

3.4

3.7

3.6

3.9

3.5

4.0

4.1

3.4

3.5

3.4

4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure D-3

Dermatology

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

22%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=51

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=36

78% 90%

80%

Yes, target score

0%

No

70%

60%

50%

40%

30%

20%

10%

0%

61%

Never

39%

Seldom

0%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

17%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=47

Would your program consider applicants who fail their exam on the 1st attempt?

N=25

34%

Yes, target score

49%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

68%

Never

32%

Seldom

0% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=36

USMLE Step 2 CK

N=17

USMLE Step 1

N=12

USMLE Step 2 CK

N=6

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 31

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure D-4

Dermatology

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=41 100%

USMLE Step 3

N=37

90%

46%

N=41

Yes, pass only

54%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

11%

Yes, pass only

N=37

16%

Yes, target score

73%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

13%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=23 N=23

90%

78%

80%

70%

60%

Yes, pass only

9%

Yes, target score No

50%

40%

30%

20%

10%

0%

0%

Yes, pass only

9%

Yes, target score

91%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=23

91%

COMLEX-USA Level 3*

N=21

4%

Yes, pass only

4%

Yes, target score No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

0%

Yes, pass only

5%

Yes, target score

95%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 32

Figure D-5

Dermatology

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

90%

N=51

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

2% 2% 2%

4%

0%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

332

33 27

Number of applications received

N=50

Number of applicants interviewed

N=53

* Data from the NRMP database

Number of applicants ranked

N=53*

3

Number of positions in The

Match

N=53*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

37%

57%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=51 N=51

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

98%

19% of Dermatology programs consider all applicants

N=52 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

67%

U.S. Grad

31%

Osteopathic

33%

Canadian

21%

Fifth Pathway

33%

U.S. IMG

23%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 33

Emergency Medicine

(N=98)

NRMP Program Director Survey Results, 2012 34

Figure EM-1

Emergency Medicine

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=88

40%

75%

93%

68%

80%

63%

86%

76%

70%

73%

57%

65%

67%

69%

74%

69%

69%

80%

60%

65%

78%

80% 100%

NRMP Program Director Survey Results, 2012 35

Figure EM-1

Emergency Medicine

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

28%

38%

60%

64%

44%

59%

61%

57%

56%

53%

41%

43%

64%

25%

23%

20%

25%

40% 60% 80% 100%

N=88

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 36

Figure EM-2

Emergency Medicine

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 37

1

N=88

2 3

3.8

4.8

3.7

3.9

4.3

4.4

3.6

3.9

3.8

4.0

3.6

3.6

3.9

4 5

4.7

4.7

4.6

4.4

4.6

4.8

4.8

Figure EM-2

Emergency Medicine

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 38

1

N=88

2

3.2

3.4

3.4

2.5

2.6

2.5

2.8

3.0

2.5

2.7

3.3

2.6

2.9

3.1

2.7

3.4

3

3.8

4

4.2

5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure EM-3

Emergency Medicine

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

46%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=96

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=83

90%

80%

77%

54%

Yes, target score

0%

No

70%

60%

50%

40%

30%

20%

10%

0%

16%

Never Seldom

7%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

25%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=92

Would your program consider applicants who fail their exam on the 1st attempt?

N=69

45%

Yes, target score

30%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

42%

Never

58%

Seldom

0% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=47

USMLE Step 2 CK

N=35

USMLE Step 1

N=32

USMLE Step 2 CK

N=27

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 39

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure EM-4

Emergency Medicine

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=88 100%

USMLE Step 3

N=58

90%

67%

N=88

Yes, pass only

33%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

14%

Yes, pass only

N=58

5%

Yes, target score

81%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

38%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=63 N=59

90%

80%

70%

60%

Yes, pass only

27%

Yes, target score

35%

No

50%

40%

30%

20%

10%

0%

29%

Yes, pass only

20%

Yes, target score

51%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=54

COMLEX-USA Level 3*

N=46

35%

Yes, pass only

7%

Yes, target score

57%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

15%

Yes, pass only

9%

Yes, target score

76%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 40

Figure EM-5

Emergency Medicine

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=95

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

12%

20%

14%

32%

22%

1%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

719

132

117

Number of applications received

N=97

Number of applicants interviewed

N=96

* Data from the NRMP database

Number of applicants ranked

N=98*

11

Number of positions in The

Match

N=98*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

39%

57%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=96 N=96

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

100%

20% of Emergency Medicine programs consider all applicants

N=96 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

72%

U.S. Grad

68%

Osteopathic

35%

Canadian

23%

Fifth Pathway

41%

U.S. IMG

26%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 41

Family Medicine

(N=235)

NRMP Program Director Survey Results, 2012 42

Figure FM-1

Family Medicine

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=205

87%

76%

82%

61%

61%

62%

57%

50%

72%

60%

73%

47%

40%

66%

61%

59%

48%

52%

58%

60% 80%

82%

100%

NRMP Program Director Survey Results, 2012 43

Figure FM-1

Family Medicine

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

40%

44%

52%

52%

55%

24%

17%

46%

58%

34%

41%

15%

20%

31%

30%

18%

20% 40% 60% 80% 100%

N=205

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 44

Figure FM-2

Family Medicine

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 45

1

N=205

2 3

3.4

3.4

3.8

4.1

4.0

3.8

4.0

3.6

4.3

3.5

4.6

4.0

4.9

4.8

4.7

4.7

4.7

4.6

3.8

4

3.9

5

Figure FM-2

Family Medicine

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 46

1

N=205

3.5

3.9

3.9

3.8

3.3

2.6

3.3

3.6

3.8

2.1

2.6

2.1

2.5

2

2.2

3

3.2

3.3

3.3

3.4

4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure FM-3

Family Medicine

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

66%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=229

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=173

90%

34%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

3%

Never

54%

Seldom

42%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

58%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=226

Would your program consider applicants who fail their exam on the 1st attempt?

N=170

35%

Yes, target score

7%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

8%

Never

67%

Seldom

25% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=57

USMLE Step 2 CK

N=53

USMLE Step 1

N=43

USMLE Step 2 CK

N=38

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 47

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure FM-4

Family Medicine

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=223

91%

100%

90%

USMLE Step 3

N=150

N=223

Yes, pass only

9%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

25%

Yes, pass only

N=150

7%

Yes, target score

67%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

72%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=209 N=205

90%

80%

70%

60%

66%

Yes, pass only

27%

Yes, target score

1%

No

50%

40%

30%

20%

10%

0%

Yes, pass only

27%

Yes, target score

7%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=201

82%

Yes, pass only

8%

Yes, target score

10%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

29%

COMLEX-USA Level 3*

N=131

Yes, pass only

7%

Yes, target score

64%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 48

Figure FM-5

Family Medicine

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=222

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

7%

15% 14%

24%

33%

6%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

907

900

800

700

600

500

400

300

200

100

0

72

52

Number of applications received

N=231

Number of applicants interviewed

N=232

* Data from the NRMP database

Number of applicants ranked

N=235*

6

Number of positions in The

Match

N=235*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

68%

33%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=226 N=226

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

99%

U.S. Senior

81%

45% of Family Medicine programs consider all applicants

93%

N=230

U.S. Grad Osteopathic

69%

Canadian

55%

Fifth Pathway

84%

U.S. IMG

61%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 49

General Surgery

(N=164)

NRMP Program Director Survey Results, 2012 50

Figure GS-1

General Surgery

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=140

40%

64%

59%

65%

64%

69%

64%

59%

60% 80%

63%

66%

56%

69%

65%

73%

75%

71%

74%

78%

84%

89%

100%

NRMP Program Director Survey Results, 2012 51

Figure GS-1

General Surgery

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

26%

21%

24%

22%

20%

22%

40%

43%

60%

47%

51%

49%

54%

52%

60%

56%

54%

56%

49%

80% 100%

N=140

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 52

Figure GS-2

General Surgery

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 53

1

N=140

2 3

3.5

3.7

4

4.1

4.1

3.9

4.1

4.2

4.5

4.3

4.1

4.3

4.1

4.0

4.3

4.3

4.7

4.7

4.5

4.6

4.6

5

Figure GS-2

General Surgery

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 54

1

N=140

2

2.1

2.6

2.4

3

2.8

2.9

2.7

3.0

3.3

3.0

3.1

3.3

3.3

3.8

3.6

4.0

3.4

3.6

3.6

4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure GS-3

General Surgery

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

17%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=157

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=128

83%

90%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

38%

Never

59%

Seldom

3%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

21%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=150

Would your program consider applicants who fail their exam on the 1st attempt?

N=112

65%

Yes, target score

14%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

50%

Never

48%

Seldom

2% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=122

USMLE Step 2 CK

N=93

USMLE Step 1

N=93

USMLE Step 2 CK

N=72

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 55

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure GS-4

General Surgery

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=141 100%

USMLE Step 3

N=79

90%

79%

80%

70%

60%

N=141

Yes, pass only

21%

No

50%

40%

30%

20%

10%

0%

11%

Yes, pass only

N=79

8%

Yes, target score

81%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

16%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=77 N=76

90%

80%

70%

60%

Yes, pass only

40%

Yes, target score

44%

No

50%

40%

30%

20%

10%

0%

17%

Yes, pass only

37%

Yes, target score

46%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=72

COMLEX-USA Level 3*

N=55

46%

Yes, pass only

3%

Yes, target score

51%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

15%

Yes, pass only

2%

Yes, target score

84%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 56

Figure GS-5

General Surgery

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=158

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

31%

6% 6%

18%

27%

13%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

623

68

42

Number of applications received

N=162

Number of applicants interviewed

N=159

* Data from the NRMP database

Number of applicants ranked

N=164*

5

Number of positions in The

Match

N=164*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

62%

37%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=160 N=162

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

99%

31% of General Surgery programs consider all applicants

N=160 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

73%

U.S. Grad

53%

Osteopathic

50%

Canadian

35%

Fifth Pathway

56%

U.S. IMG

41%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 57

Internal Medicine

(N=296)

NRMP Program Director Survey Results, 2012 58

Figure IM-1

Internal Medicine

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=258

47%

60%

62%

48%

52%

57%

56%

40%

50%

60% 80%

72%

82%

65%

72%

66%

67%

76%

65%

62%

78%

74%

100%

NRMP Program Director Survey Results, 2012 59

Figure IM-1

Internal Medicine

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

30%

16%

29%

20%

20%

28%

40%

43%

51%

41%

42%

43%

40%

41%

47%

50%

45%

55%

60% 80% 100%

N=258

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 60

Figure IM-2

Internal Medicine

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 61

1

N=258

2 3

3.7

4

4.1

4.0

4.1

4.2

4.0

3.9

4.1

4.1

4.1

3.7

3.8

4.1

4.2

4.5

4.3

4.2

4.5

4.7

4.6

5

Figure IM-2

Internal Medicine

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 62

1

N=258

1.9

2

2.7

2.8

2.7

2.4

2.5

2.9

2.7

2.9

3.0

2.2

3.8

3.4

3.3

3.3

3.7

3.6

3.5

3 4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure IM-3

Internal Medicine

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

34%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=280

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=245

90%

65%

Yes, target score

1%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

22%

Never

69%

Seldom

9%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

28%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=272

Would your program consider applicants who fail their exam on the 1st attempt?

N=225

58%

Yes, target score

14%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

33%

Never

62%

Seldom

5% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=162

USMLE Step 2 CK

N=141

USMLE Step 1

N=119

USMLE Step 2 CK

N=101

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 63

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure IM-4

Internal Medicine

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=256 100%

USMLE Step 3

N=160

85% 90%

80%

70%

60%

N=256

Yes, pass only

15%

No

50%

40%

30%

20%

10%

0%

23%

Yes, pass only

N=160

11%

Yes, target score

66%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

39%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=194 N=186

90%

80%

70%

60%

48%

13%

50%

40%

30%

20%

35%

44%

10%

0%

Yes, pass only Yes, target score No Yes, pass only Yes, target score

21%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=178

COMLEX-USA Level 3*

N=122

65%

Yes, pass only

13%

Yes, target score

22%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

20%

Yes, pass only

11%

Yes, target score

69%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 64

Figure IM-5

Internal Medicine

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=283

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

22%

13% 14%

17%

29%

4%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

1,908

900

800

700

600

500

400

300

200

100

0

172

106

Number of applications received

N=284

Number of applicants interviewed

N=283

* Data from the NRMP database

Number of applicants ranked

N=296*

10

Number of positions in The

Match

N=296*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

62%

36%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=279 N=278

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

98%

43% of Internal Medicine programs consider all applicants

N=286 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

72%

U.S. Grad

79%

Osteopathic

63%

Canadian

48%

Fifth Pathway

77%

U.S. IMG

72%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 65

Internal Medicine/Pediatrics

(N=35)

NRMP Program Director Survey Results, 2012 66

Figure IMP-1

Internal Medicine/Pediatrics

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=31

39%

48%

58%

71%

58%

55%

40%

45%

60%

71%

58%

58%

58%

68%

80%

71%

68%

81%

74%

77%

68%

90%

100%

NRMP Program Director Survey Results, 2012 67

Figure IMP-1

Internal Medicine/Pediatrics

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

29%

48%

52%

52%

52%

61%

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

16%

32%

35%

39%

29% Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

6%

16%

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

10%

20%

26%

39%

40% 60% 80% 100%

N=31

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 68

Figure IMP-2

Internal Medicine/Pediatrics

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 69

1

N=31

2 3

3.9

3.7

4

4.1

4.1

4.2

3.8

4.1

4.1

4.1

4.4

4.3

4.6

4.3

3.9

4.2

4.6

4.6

4.6

5.0

4.8

5

Figure IMP-2

Internal Medicine/Pediatrics

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 70

1

N=31

1.9

2

2.7

2.4

2.6

2.8

3.0

3.3

3.2

3.0

3.4

3.6

3.5

3.4

3.7

3.8

3.8

3.8

2.4

3 4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure IMP-3

Internal Medicine/Pediatrics

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

40%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=35

Would your program consider applicants who fail their exam on the 1st attempt?

100%

90%

N=25

88%

60%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

12%

Never Seldom

0%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

26%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=35

Would your program consider applicants who fail their exam on the 1st attempt?

N=24

43%

Yes, target score

31%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

42%

Never

58%

Seldom

0% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=18

USMLE Step 2 CK

N=11

USMLE Step 1

N=14

USMLE Step 2 CK

N=10

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 71

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure IMP-4

Internal Medicine/Pediatrics

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=33 100%

USMLE Step 3

N=24

90%

64%

N=33

Yes, pass only

36%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

8%

Yes, pass only

N=24 8%

Yes, target score

83%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

33%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=30 N=29

90%

80%

70%

60%

Yes, pass only

43%

Yes, target score

23%

No

50%

40%

30%

20%

10%

0%

24%

Yes, pass only

34%

Yes, target score

41%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=27

COMLEX-USA Level 3*

N=21

41%

Yes, pass only

7%

Yes, target score

52%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

14%

Yes, pass only

5%

Yes, target score

81%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 72

Figure IMP-5

Internal Medicine/Pediatrics

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=34

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

21%

3%

9% 9%

50%

9%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

204

50 45

Number of applications received

N=32

Number of applicants interviewed

N=35

* Data from the NRMP database

Number of applicants ranked

N=35*

5

Number of positions in The

Match

N=35*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

48%

52%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=33 N=33

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

100%

17% of Internal Medicine/Pediatrics programs consider all applicants

N=35 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

43%

U.S. Grad

77%

Osteopathic

34%

Canadian

26%

Fifth Pathway

54%

U.S. IMG

26%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 73

Neurological Surgery

(N=42)

NRMP Program Director Survey Results, 2012 74

Figure NS-1

Neurological Surgery

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=37

40%

43%

73%

70%

59%

68%

76%

57%

62%

54%

65%

70%

70%

81%

92%

70%

68%

73%

60%

68%

76%

80% 100%

NRMP Program Director Survey Results, 2012 75

Figure NS-1

Neurological Surgery

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

14%

20%

27%

30%

40% 60%

59%

49%

57%

73%

54%

49%

57%

46%

54%

65%

62%

76%

86%

80% 100%

N=37

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 76

Figure NS-2

Neurological Surgery

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 77

1

N=37

2 3

3.9

3.9

4.3

4.2

4.3

4.5

4.7

4.4

4.7

4.9

4.5

4.7

4.7

4.2

4.5

3.5

3.9

4.1

3.8

4.3

4 5

Figure NS-2

Neurological Surgery

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 78

1

N=37

2

2.7

3.1

3.4

3.5

3.7

3.5

3.9

4.1

4.3

4.1

3.8

4.2

3.6

3.5

3.4

3.8

3.1

3

3.7

4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure NS-3

Neurological Surgery

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

15%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=40

85%

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=33

90%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

55%

Never

33%

Seldom

12%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

27%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=37

Would your program consider applicants who fail their exam on the 1st attempt?

N=25

46%

Yes, target score

27%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

44%

Never

48%

Seldom

8% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=26

USMLE Step 2 CK

N=9

USMLE Step 1

N=22

USMLE Step 2 CK

N=8

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 79

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure NS-4

Neurological Surgery

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=37 100%

USMLE Step 3

N=23

90%

73%

N=37

Yes, pass only

27%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

30%

Yes, pass only

N=23

22%

Yes, target score

48%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

29%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=14 N=14

90%

64%

80%

70%

60%

Yes, pass only

7%

Yes, target score No

50%

40%

30%

20%

10%

0%

29%

Yes, pass only

7%

Yes, target score

64%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=12

COMLEX-USA Level 3*

N=13

33%

Yes, pass only

8%

Yes, target score

58%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

23%

Yes, pass only

8%

Yes, target score

69%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 80

Figure NS-5

Neurological Surgery

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=39

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

21%

5%

10%

8%

23%

33%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

188

35

Number of applications received

N=41

Number of applicants interviewed

N=42

* Data from the NRMP database

24

Number of applicants ranked

N=42*

2

Number of positions in The

Match

N=42*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

44%

49%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=41 N=41

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

98%

28% of Neurological Surgery programs consider all applicants

N=40 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

63%

U.S. Grad

38%

Osteopathic

33%

Canadian

28%

Fifth Pathway

50%

U.S. IMG

50%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 81

Neurology

(N=59)

NRMP Program Director Survey Results, 2012 82

Figure N-1

Neurology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=55

40%

58%

56%

55%

64%

51%

53%

51%

60% 80%

75%

69%

73%

73%

67%

62%

73%

58%

65%

67%

85%

93%

100%

NRMP Program Director Survey Results, 2012 83

Figure N-1

Neurology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

40%

45%

47%

56%

40%

45%

22%

31%

18%

20%

20% 40%

33%

44%

38%

33%

40%

60%

62%

80% 100%

N=55

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 84

Figure N-2

Neurology

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 85

1

N=55

2 3

4.1

3.7

4.0

3.9

4

4.1

4.2

4.0

4.1

4.3

3.8

5

3.9

4.6

4.2

4.3

4.5

4.7

4.7

4.8

4.6

4.5

Figure N-2

Neurology

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 86

1

N=55

2

2.8

2.8

2.7

3

3.1

2.9

3.4

3.0

3.3

4

3.8

3.8

3.3

3.4

3.3

3.1

3.4

3.6

3.6

3.9

5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure N-3

Neurology

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

29%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=58

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=49

90%

80%

69% 80%

70%

Yes, target score

2%

No

60%

50%

40%

30%

20%

10%

0%

18%

Never Seldom

2%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

30%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=57

Would your program consider applicants who fail their exam on the 1st attempt?

N=46

56%

Yes, target score

14%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

17%

Never

80%

Seldom

2% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=28

USMLE Step 2 CK

N=23

USMLE Step 1

N=21

USMLE Step 2 CK

N=18

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 87

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure N-4

Neurology

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=53 100%

USMLE Step 3

N=40

85% 90%

80%

70%

60%

N=53

Yes, pass only

15%

No

50%

40%

30%

20%

10%

0%

28%

Yes, pass only

N=40

13%

Yes, target score

60%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

36%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=44 N=40

90%

80%

70%

60%

45%

Yes, pass only Yes, target score

18%

No

50%

40%

30%

20%

10%

0%

40%

Yes, pass only

30%

Yes, target score

30%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=40

COMLEX-USA Level 3*

N=33

57%

Yes, pass only

15%

Yes, target score

28%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

27%

Yes, pass only

18%

Yes, target score

55%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 88

Figure N-5

Neurology

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=55

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

11%

16%

9%

20%

33%

11%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

374

55 46

Number of applications received

N=57

Number of applicants interviewed

N=56

* Data from the NRMP database

Number of applicants ranked

N=59*

5

Number of positions in The

Match

N=59*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

57%

43%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=55 N=55

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

98%

58% of Neurology programs consider all applicants

N=57 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

84%

U.S. Grad

81%

Osteopathic

74%

Canadian

60%

Fifth Pathway

82%

U.S. IMG

79%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 89

Obstetrics and Gynecology

(N=113)

NRMP Program Director Survey Results, 2012 90

Figure OG-1

Obstetrics and Gynecology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=97

40%

58%

67%

69%

59%

56%

76%

73%

74%

81%

79%

74%

75%

58%

67%

67%

56%

65%

59%

58%

60% 80% 100%

NRMP Program Director Survey Results, 2012 91

Figure OG-1

Obstetrics and Gynecology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

29%

29%

30%

26%

20%

26%

40%

47%

36%

43%

60%

55%

51%

59%

47%

56%

54%

53%

60% 80% 100%

N=97

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 92

Figure OG-2

Obstetrics and Gynecology

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 93

1

N=97

2 3

3.6

3.6

4

4.0

4.0

3.8

4.2

4.1

4.2

4.1

4.3

4.2

4.1

4.1

4.6

4.4

4.8

4.7

4.7

4.7

4.7

5

Figure OG-2

Obstetrics and Gynecology

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 94

1

N=97

2.6

2.9

3.0

3.0

3.3

2.8

3.0

3.0

3.3

3.0

3.3

3.3

3.4

3.5

2

2.1

3 4

4.0

3.9

3.9

5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure OG-3

Obstetrics and Gynecology

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

36%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=111

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=88

90%

64%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

22%

Never

66%

Seldom

13%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

38%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=109

Would your program consider applicants who fail their exam on the 1st attempt?

N=82

54%

Yes, target score

8%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

34%

Never

60%

Seldom

6% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=63

USMLE Step 2 CK

N=52

USMLE Step 1

N=45

USMLE Step 2 CK

N=38

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 95

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure OG-4

Obstetrics and Gynecology

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=107 100%

USMLE Step 3

N=59

86% 90%

80%

70%

60%

N=107

Yes, pass only

14%

No

50%

40%

30%

20%

10%

0%

25%

Yes, pass only

N=59

14%

Yes, target score

61%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

39%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=84 N=80

90%

80%

70%

60%

Yes, pass only

39%

Yes, target score

21%

No

50%

40%

30%

20%

10%

0%

40%

Yes, pass only

33%

Yes, target score

28%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=77

COMLEX-USA Level 3*

N=55

55%

Yes, pass only

13%

Yes, target score

32%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

29%

Yes, pass only

11%

Yes, target score

60%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 96

Figure OG-5

Obstetrics and Gynecology

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=112

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

16%

11% 12%

15%

29%

17%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

370

66 56

Number of applications received

N=112

Number of applicants interviewed

N=112

* Data from the NRMP database

Number of applicants ranked

N=113*

5

Number of positions in The

Match

N=113*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

55%

45%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=108 N=109

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

100%

29% of Obstetrics and Gynecology programs consider all applicants

N=112 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

63%

U.S. Grad

77%

Osteopathic

45%

Canadian

33%

Fifth Pathway

55%

U.S. IMG

43%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 97

Orthopedic Surgery

(N=87)

NRMP Program Director Survey Results, 2012 98

Figure OS-1

Orthopedic Surgery

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=78

69%

85%

85%

78%

49%

73%

60%

69%

64%

76%

77%

83%

79%

40%

50%

77%

76%

78%

60%

68%

78%

80% 100%

NRMP Program Director Survey Results, 2012 99

Figure OS-1

Orthopedic Surgery

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

37%

56%

23%

31%

14%

19%

18%

20% 40%

42%

60%

62%

62%

60%

55%

67%

68%

71%

65%

80% 100%

N=78

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 100

Figure OS-2

Orthopedic Surgery

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 101

1

N=78

2 3

3.4

4.0

4.3

4.5

4.3

4.5

4.4

3.9

4.3

4.6

4.9

4.7

4.6

4.8

4.7

4.3

3.7

4.4

4.2

4.3

4 5

Figure OS-2

Orthopedic Surgery

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 102

1

N=78

2

3.8

2.5

2.7

2.6

2.9

3.2

3.3

3.7

3.2

3.6

2.7

2.8

2.7

3

3.6

3.8

4.1

3.9

4.3

4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure OS-3

Orthopedic Surgery

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

11%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=84

88%

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=68

90%

Yes, target score

1%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

59%

Never

40%

Seldom

1%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

17%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=72

Would your program consider applicants who fail their exam on the 1st attempt?

N=49

44%

Yes, target score

39%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

69%

Never

31%

Seldom

0% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=67

USMLE Step 2 CK

N=32

USMLE Step 1

N=38

USMLE Step 2 CK

N=19

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 103

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure OS-4

Orthopedic Surgery

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=72 100%

USMLE Step 3

N=45

90%

57%

N=72

Yes, pass only

43%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

11%

Yes, pass only

N=45

4%

Yes, target score

84%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

13%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=38 N=37

90%

79%

80%

70%

60%

Yes, pass only

8%

Yes, target score No

50%

40%

30%

20%

10%

0%

8%

Yes, pass only

5%

Yes, target score

86%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=37

8%

Yes, pass only

3%

Yes, target score

89%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

8%

COMLEX-USA Level 3*

N=36

Yes, pass only

3%

Yes, target score

89%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 104

Figure OS-5

Orthopedic Surgery

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=83

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

67%

1%

7%

5% 6%

13%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

530

62 51

Number of applications received

N=85

Number of applicants interviewed

N=83

* Data from the NRMP database

Number of applicants ranked

N=87*

5

Number of positions in The

Match

N=87*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

47%

56%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=84 N=84

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

99%

14% of Orthopedic Surgery programs consider all applicants

N=83 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

67%

U.S. Grad

30%

Osteopathic

27%

Canadian

16%

Fifth Pathway

24%

U.S. IMG

17%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 105

Otolaryngology

(N=51)

NRMP Program Director Survey Results, 2012 106

Figure O-1

Otolaryngology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=45

40%

84%

93%

87%

73%

56%

80%

80%

58%

71%

58%

71%

67%

80%

60%

82%

69%

80%

60%

67%

73%

80% 100%

NRMP Program Director Survey Results, 2012 107

Figure O-1

Otolaryngology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

20%

13%

13%

18%

20% 40%

40%

44%

60%

51%

53%

64%

69%

62%

60%

71%

76%

82%

67%

80% 100%

N=45

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 108

Figure O-2

Otolaryngology

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 109

1

N=45

2

2.7

3.4

3.9

3.3

4.0

4.5

4.3

4.4

4.5

4.1

4.3

4.3

4.7

4.7

4.6

4.9

4.8

4.0

4.0

3 4

4.1

5

Figure O-2

Otolaryngology

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 110

1

N=45

3.2

3.5

3.9

3.8

4.0

3.9

2.4

3.3

3.2

2.1

2.4

2

2.2

2.1

2.6

3

3.0

3.4

3.2

4

4.0

5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure O-3

Otolaryngology

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

16%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=50

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=42

84%

90%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

57%

Never

38%

Seldom

5%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

20%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=45

Would your program consider applicants who fail their exam on the 1st attempt?

N=23

33%

Yes, target score

47%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

57%

Never

35%

Seldom

9% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=37

USMLE Step 2 CK

N=11

USMLE Step 1

N=19

USMLE Step 2 CK

N=6

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 111

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure O-4

Otolaryngology

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=44 100%

USMLE Step 3

N=28

90%

50%

N=44

Yes, pass only

50%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

7%

Yes, pass only

N=28

7%

Yes, target score

86%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

5%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=21 N=19

90%

81%

80%

70%

60%

Yes, pass only

14%

Yes, target score No

50%

40%

30%

20%

10%

0%

5%

Yes, pass only

5%

Yes, target score

89%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=19

5%

Yes, pass only

5%

Yes, target score

89%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

COMLEX-USA Level 3*

N=19

0%

Yes, pass only

5%

Yes, target score

95%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 112

Figure O-5

Otolaryngology

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=51

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

41%

4% 4%

2%

12%

37%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

251

38 32

Number of applications received

N=51

Number of applicants interviewed

N=51

* Data from the NRMP database

Number of applicants ranked

N=51*

3

Number of positions in The

Match

N=51*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

32%

64%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=51 N=51

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

100%

18% of Otolaryngology programs consider all applicants

N=50 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

54%

U.S. Grad

28%

Osteopathic

32%

Canadian

20%

Fifth Pathway

24%

U.S. IMG

22%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 113

Pathology

(N=78)

NRMP Program Director Survey Results, 2012 114

Figure PAC-1

Pathology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=70

40%

56%

56%

64%

70%

77%

67%

80%

93%

89%

74%

59%

79%

57%

66%

54%

57%

59%

59%

61%

60% 80% 100%

NRMP Program Director Survey Results, 2012 115

Figure PAC-1

Pathology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

59%

61%

64%

61%

54%

40%

27%

36%

36%

50%

43%

51%

51%

57%

66%

14%

20% 40% 60% 80% 100%

N=70

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 116

Figure PAC-2

Pathology

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 117

1

N=70

2 3

3.5

3.7

3.7

3.6

4

3.9

3.9

4.2

4.4

4.6

4.7

4.0

4.4

4.3

4.7

4.7

4.6

4.9

4.8

3.7

4.3

5

Figure PAC-2

Pathology

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 118

1

N=70

2

2.2

2.8

3.2

3.5

3.8

3.8

3.9

4.0

4.0

3.8

3.4

3.5

2.6

3.4

3.4

3.4

2.8

3

2.9

4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure PAC-3

Pathology

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

31%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=75

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=58

90%

69%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

16%

Never

72%

Seldom

12%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

25%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=72

Would your program consider applicants who fail their exam on the 1st attempt?

N=52

63%

Yes, target score

13%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

17%

Never

71%

Seldom

12% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=44

USMLE Step 2 CK

N=35

USMLE Step 1

N=30

USMLE Step 2 CK

N=21

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 119

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure PAC-4

Pathology

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=67 100%

USMLE Step 3

N=55

90%

82%

80%

70%

60%

N=67

Yes, pass only

18%

No

50%

40%

30%

20%

10%

0%

29%

Yes, pass only

N=55

16%

Yes, target score

55%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

35%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=52 N=51

90%

56%

80%

70%

60%

49%

50%

40%

30%

20%

10%

29%

10%

0%

Yes, pass only Yes, target score No Yes, pass only Yes, target score

22%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=52

COMLEX-USA Level 3*

N=39

56%

Yes, pass only

21%

Yes, target score

23%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

33%

Yes, pass only

8%

Yes, target score

59%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 120

Figure PAC-5

Pathology

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=75

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

15%

19%

15%

12%

25%

15%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

362

40

27

Number of applications received

N=77

Number of applicants interviewed

N=77

* Data from the NRMP database

Number of applicants ranked

N=78*

4

Number of positions in The

Match

N=78*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

54%

44%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=76 N=77

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

97%

U.S. Senior

91%

U.S. Grad

63% of Pathology programs consider all applicants

N=75

91%

Osteopathic

73%

Canadian

65%

Fifth Pathway

85%

U.S. IMG

83%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 121

Pediatrics

(N=131)

NRMP Program Director Survey Results, 2012 122

Figure P-1

Pediatrics

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=109

91%

60%

52%

66%

68%

71%

57%

56%

56%

71%

72%

74%

66%

75%

71%

50%

54%

58%

40%

50%

60% 80% 100%

NRMP Program Director Survey Results, 2012 123

Figure P-1

Pediatrics

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

27%

20%

37%

32%

18%

17%

20%

34%

40%

54%

50%

39%

38%

50%

46%

50%

51%

55%

60% 80% 100%

N=109

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 124

Figure P-2

Pediatrics

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 125

1

N=109

2 3

3.9

4.0

4.2

3.9

4

4.1

4.0

3.9

4.0

4.0

4.1

4.1

4.1

4.2

4.2

4.5

4.9

4.7

4.7

4.6

4.6

5

Figure P-2

Pediatrics

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 126

1

N=109

2

2.2

2.2

2.6

2.6

2.7

3.1

3.3

2.8

3.5

3.4

2.8

3.2

3.4

3.5

3.6

3.5

3.8

3.2

3 4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure P-3

Pediatrics

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

56%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=126

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=98

90%

80%

78%

43%

Yes, target score

2%

No

70%

60%

50%

40%

30%

20%

10%

0%

3%

Never Seldom

19%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

48%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=124

Would your program consider applicants who fail their exam on the 1st attempt?

N=94

40%

Yes, target score

13%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

14%

Never

73%

Seldom

13% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=43

USMLE Step 2 CK

N=37

USMLE Step 1

N=35

USMLE Step 2 CK

N=29

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 127

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure P-4

Pediatrics

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=121 100%

USMLE Step 3

N=76

90%

82%

80%

70%

60%

N=121

Yes, pass only

18%

No

50%

40%

30%

20%

10%

0%

14%

Yes, pass only

N=76

4%

Yes, target score

82%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

55%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=110 N=105

90%

80%

70%

60%

50%

33%

50%

40%

30%

20%

12%

27%

10%

0%

Yes, pass only Yes, target score No Yes, pass only Yes, target score

24%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=96

COMLEX-USA Level 3*

N=68

64%

Yes, pass only

7%

Yes, target score

29%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

13%

Yes, pass only

4%

Yes, target score

82%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 128

Figure P-5

Pediatrics

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=126

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

13%

21%

9%

17%

33%

9%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

965

900

800

700

600

500

400

300

200

100

0

160

127

Number of applications received

N=131

Number of applicants interviewed

N=129

* Data from the NRMP database

Number of applicants ranked

N=131*

13

Number of positions in The

Match

N=131*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

54%

45%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=131 N=131

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

97%

40% of Pediatrics programs consider all applicants

N=128

87%

76%

67%

63% 63%

45%

U.S. Grad Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

NRMP Program Director Survey Results, 2012 129

Physical Medicine and Rehabilitation

(N=37)

NRMP Program Director Survey Results, 2012 130

Figure PMR-1

Physical Medicine and Rehabilitation

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

39%

32%

52%

45%

52%

45%

52%

52%

61%

58%

58%

71%

81%

74%

77%

Other life experience 42%

Honors in clerkship in desired specialty 32%

Consistency of grades 48%

Audition elective/rotation within your department 48%

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%

N=31

NRMP Program Director Survey Results, 2012 131

Figure PMR-1

Physical Medicine and Rehabilitation

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

45%

42%

48%

35%

45% Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

26%

35%

39%

35%

32%

26% Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

16%

39%

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

3%

20%

23%

19%

40% 60% 80% 100%

N=31

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 132

Figure PMR-2

Physical Medicine and Rehabilitation

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 133

1

N=31

2 3

3.1

3.4

3.7

3.8

3.5

3.6

3.9

3.7

3.8

4

4.1

4.1

4.6

4.2

4.2

4.4

4.6

4.9

4.7

4.6

4.5

5

Figure PMR-2

Physical Medicine and Rehabilitation

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 134

1

N=31

2.9

2.7

2.8

2.5

2.6

2.9

3.3

3.2

3.0

3.3

3.7

3.8

3.7

3.8

4.1

2

2.1

2.5

2.9

3 4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure PMR-3

Physical Medicine and Rehabilitation

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

41%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=29

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=28

90%

52%

Yes, target score

7%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

21%

Never

71%

Seldom

7%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

33%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=30

Would your program consider applicants who fail their exam on the 1st attempt?

N=26

47%

Yes, target score

20%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

15%

Never

81%

Seldom

4% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=14

USMLE Step 2 CK

N=12

USMLE Step 1

N=10

USMLE Step 2 CK

N=9

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 135

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure PMR-4

Physical Medicine and Rehabilitation

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=29 100%

USMLE Step 3

N=20

90%

83%

80%

70%

60%

N=29

Yes, pass only

17%

No

50%

40%

30%

20%

10%

0%

25%

Yes, pass only

N=20 10%

Yes, target score

65%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

55%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=29 N=30

90%

80%

70%

60%

53%

34%

50%

40%

30%

20%

10%

30%

10%

0%

Yes, pass only Yes, target score No Yes, pass only Yes, target score

17%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=28

COMLEX-USA Level 3*

N=18

71%

Yes, pass only

11%

Yes, target score

18%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

28%

Yes, pass only

17%

Yes, target score

56%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 136

Figure PMR-5

Physical Medicine and Rehabilitation

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=32

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

25%

16% 16%

6%

31%

6%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

300

59

44

Number of applications received

N=37

Number of applicants interviewed

N=34

* Data from the NRMP database

Number of applicants ranked

N=37*

4

Number of positions in The

Match

N=37*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

45%

50%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=36 N=33

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

97%

30% of Physical Medicine and Rehabilitation programs consider all applicants

97% N=33 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

67%

U.S. Grad Osteopathic

45%

Canadian

42%

Fifth Pathway

70%

U.S. IMG

48%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 137

Plastic Surgery

(N=27)

NRMP Program Director Survey Results, 2012 138

Figure PS-1

Plastic Surgery

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=24

63%

54%

63%

71%

79%

88%

96%

75%

75%

58%

54%

71%

58%

54%

40%

50%

60%

63%

80%

75%

75%

75%

100%

NRMP Program Director Survey Results, 2012 139

Figure PS-1

Plastic Surgery

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact 0%

Gold Society membership

0%

4%

20%

25%

40%

50%

46%

46%

42%

50%

58%

60%

63%

71%

80%

71%

79%

75%

88%

67%

100%

N=24

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 140

Figure PS-2

Plastic Surgery

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 141

1

N=24

2 3

3.4

3.8

3.4

3.8

4.0

3.3

3.9

4.2

4.6

4.5

4.4

4.5

4.7

4.7

4.7

4.0

3.9

4.2

3.8

4.3

4 5

Figure PS-2

Plastic Surgery

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 142

1

N=24

1.0

1.0

2

2.4

2.9

3.0

2.9

3.2

2.8

3.7

3.5

3.8

3

3.2

4

3.7

3.8

3.9

3.9

3.7

3.7

5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure PS-3

Plastic Surgery

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

44%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=27

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=18

90%

56%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

56%

Never

44%

Seldom

0%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

35%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=26

Would your program consider applicants who fail their exam on the 1st attempt?

N=14

27%

Yes, target score

38%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

50%

Never

50%

Seldom

0% often

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

140

120

100

200

180

160

280

260

240

220 USMLE Step 1 not reported because of low response rate

USMLE Step 2 CK not reported because of low response rate

USMLE Step 1

N=13

USMLE Step 2 CK

N=5

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 143

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure PS-4

Plastic Surgery

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=25 100%

USMLE Step 3

N=22

90%

60%

N=25

Yes, pass only

40%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

27%

Yes, pass only

N=22 9%

Yes, target score

64%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

46%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=13 N=11

90%

80%

70%

60%

46% 50%

40%

30%

20%

36%

8%

10%

0%

Yes, pass only Yes, target score No Yes, pass only

0%

Yes, target score

64%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=11

COMLEX-USA Level 3*

N=10

36%

Yes, pass only

9%

Yes, target score

55%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

30%

Yes, pass only

10%

Yes, target score

60%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 144

Figure PS-5

Plastic Surgery

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

93%

90%

N=27

80%

70%

60%

50%

40%

30%

20%

10%

0%

0%

4%

0% 0%

4%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

172

29

Number of applications received

N=26

Number of applicants interviewed

N=27

* Data from the NRMP database

22

Number of applicants ranked

N=27*

2

Number of positions in The

Match

N=27*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

30%

71%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=25 N=25

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

96%

38% of Plastic Surgery programs consider all applicants

N=26 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

65%

U.S. Grad

50%

Osteopathic

58%

Canadian

42%

Fifth Pathway

46%

U.S. IMG

42%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 145

Psychiatry

(N=88)

NRMP Program Director Survey Results, 2012 146

Figure PSY-1

Psychiatry

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=74

40%

53%

69%

78%

62%

65%

69%

85%

81%

86%

72%

81%

84%

54%

84%

64%

70%

57%

55%

60%

65%

80% 100%

NRMP Program Director Survey Results, 2012 147

Figure PSY-1

Psychiatry

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

27%

38%

53%

55%

66%

47%

66%

41%

72%

62%

65%

58%

58%

49%

27%

20%

27%

40% 60% 80% 100%

N=74

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 148

Figure PSY-2

Psychiatry

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 149

1

N=74

2 3

4.1

3.4

3.8

3.8

3.7

4.5

4.0

3.8

3.8

4.1

4.0

4.3

4.3

3.6

4

4.9

4.9

4.9

4.8

4.7

4.8

5

Figure PSY-2

Psychiatry

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 150

1

N=74

2

2.2

3

3.0

2.9

3.1

3.3

3.1

2.9

2.9

2.9

3.5

3.8

4

3.1

3.5

3.6

3.6

3.8

3.8

4.2

5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure PSY-3

Psychiatry

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

65%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=82

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=64

90%

34%

Yes, target score

1%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

5%

Never

56%

Seldom

39%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

56%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=82

Would your program consider applicants who fail their exam on the 1st attempt?

N=63

33%

Yes, target score

11%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

5%

Never

67%

Seldom

29% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=22

USMLE Step 2 CK

N=22

USMLE Step 1

N=20

USMLE Step 2 CK

N=20

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 151

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure PSY-4

Psychiatry

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=80 100%

USMLE Step 3

N=59

84%

90%

80%

70%

60%

N=80

Yes, pass only

16%

No

50%

40%

30%

20%

10%

0%

32%

Yes, pass only

N=59

19%

Yes, target score

49%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

63%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=70 N=69

90%

80%

70%

60%

61%

Yes, pass only

34%

Yes, target score

3%

No

50%

40%

30%

20%

10%

0%

Yes, pass only

28%

Yes, target score

12%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=68

COMLEX-USA Level 3*

N=46

74%

Yes, pass only

10%

Yes, target score

16%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

30%

Yes, pass only

15%

Yes, target score

54%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 152

Figure PSY-5

Psychiatry

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=83

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

10%

19% 18%

20%

28%

5%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

664

68

50

Number of applications received

N=86

Number of applicants interviewed

N=85

* Data from the NRMP database

Number of applicants ranked

N=88*

6

Number of positions in The

Match

N=88*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

55%

42%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=83 N=83

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

97%

58% of Psychiatry programs consider all applicants

94%

N=86 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

81%

U.S. Grad Osteopathic

71%

Canadian

63%

Fifth Pathway

90%

U.S. IMG

76%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 153

Radiation Oncology

(N=45)

NRMP Program Director Survey Results, 2012 154

Figure RO-1

Radiation Oncology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=36

40%

92%

97%

92%

81%

64%

81%

69%

81%

83%

58%

67%

89%

75%

60%

64%

64%

64%

72%

64%

80%

86%

100%

NRMP Program Director Survey Results, 2012 155

Figure RO-1

Radiation Oncology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

11%

14%

20%

25%

40%

47%

50%

44%

58%

56%

61%

60%

69%

64%

72%

67%

69%

80%

86%

89%

100%

N=36

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 156

Figure RO-2

Radiation Oncology

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 157

1

N=36

2 3

3.6

4.1

3.7

4.1

4.1

3.7

4.4

4 5

4.3

4.1

4.3

4.6

4.5

4.5

4.6

4.8

4.7

4.5

4.5

4.4

4.5

Figure RO-2

Radiation Oncology

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 158

1

N=36

2

2.3

3.0

3.0

3.0

3.1

3.1

3.3

3.5

3.9

4.3

3.8

4.3

3.9

4.5

3.4

3.8

2.7

3

3.9

4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure RO-3

Radiation Oncology

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

21%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=42

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=34

79% 90%

80%

Yes, target score

0%

No

70%

60%

50%

40%

30%

20%

10%

0%

59%

Never

38%

Seldom

3%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

24%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=38

Would your program consider applicants who fail their exam on the 1st attempt?

N=23

45%

Yes, target score

32%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

65%

Never

26%

Seldom

9% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=25

USMLE Step 2 CK

N=12

USMLE Step 1

N=17

USMLE Step 2 CK

N=7

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 159

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure RO-4

Radiation Oncology

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=37 100%

USMLE Step 3

N=30

90%

70%

N=37

Yes, pass only

30%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

30%

Yes, pass only

N=30

0%

Yes, target score

70%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

20%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=20 N=19

90%

70%

80%

70%

60%

Yes, pass only

10%

Yes, target score No

50%

40%

30%

20%

10%

0%

11%

Yes, pass only

5%

Yes, target score

84%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=19

COMLEX-USA Level 3*

N=19

16%

Yes, pass only

0%

Yes, target score

84%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

16%

Yes, pass only

0%

Yes, target score

84%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 160

Figure RO-5

Radiation Oncology

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=42

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

69%

5% 5%

10%

2%

10%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

183

28

Number of applications received

N=45

Number of applicants interviewed

N=44

* Data from the NRMP database

24

Number of applicants ranked

N=45*

2

Number of positions in The

Match

N=45*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

30%

67%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=44 N=45

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

98%

30% of Radiation Oncology programs consider all applicants

N=43 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

67%

U.S. Grad

63%

Osteopathic

37%

Canadian

33%

Fifth Pathway

33%

U.S. IMG

33%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 161

Radiology

(N=88)

NRMP Program Director Survey Results, 2012 162

Figure RD-1

Radiology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

N=80

40%

75%

76%

66%

70%

63%

69%

59%

71%

60%

66%

80%

86%

76%

51%

66%

74%

64%

73%

60%

74%

79%

100%

NRMP Program Director Survey Results, 2012 163

Figure RD-1

Radiology

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

28%

34%

25%

15%

23%

19%

20% 40% 60%

49%

61%

56%

63%

59%

66%

66%

51%

59%

54%

80% 100%

N=80

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 164

Figure RD-2

Radiology

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 165

1

N=80

2 3

3.8

4.2

3.7

4.2

4.0

4.2

3.8

3.9

4.2

3.5

4.3

4.2

4.2

4.7

4.8

4.6

4.5

4.8

4.8

3.7

4 5

Figure RD-2

Radiology

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 166

1

N=80

2

2.0

2.8

2.8

2.5

2.7

2.9

2.8

2.4

3.3

3.2

3.4

3.4

3.5

3.7

4.0

3.8

4.0

3.8

3 4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure RD-3

Radiology

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

13%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=83

87%

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=74

90%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

59%

Never

41%

Seldom

0%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

18%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=79

Would your program consider applicants who fail their exam on the 1st attempt?

N=50

35%

Yes, target score

47%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

60%

Never

40%

Seldom

0% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=62

USMLE Step 2 CK

N=25

USMLE Step 1

N=39

USMLE Step 2 CK

N=19

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 167

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure RD-4

Radiology

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=78 100%

USMLE Step 3

N=56

90%

47%

N=78

Yes, pass only

53%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

16%

Yes, pass only

N=56

5%

Yes, target score

79%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

13%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=45 N=44

90%

80%

70%

60%

51%

36%

50%

40%

30%

20% 16%

20%

10%

0%

Yes, pass only Yes, target score No Yes, pass only Yes, target score

64%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=43

COMLEX-USA Level 3*

N=41

16%

Yes, pass only

9%

Yes, target score

74%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

12%

Yes, pass only

7%

Yes, target score

80%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 168

Figure RD-5

Radiology

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=82

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

40%

9%

5%

10%

23%

13%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

458

77

64

Number of applications received

N=84

Number of applicants interviewed

N=83

* Data from the NRMP database

Number of applicants ranked

N=88*

6

Number of positions in The

Match

N=88*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

40%

57%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=82 N=82

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

99%

33% of Radiology programs consider all applicants

N=86

79%

69%

52% 52%

42%

34%

U.S. Grad Osteopathic Canadian Fifth Pathway U.S. IMG Non-U.S. IMG

NRMP Program Director Survey Results, 2012 169

Vascular Surgery

(N=13)

NRMP Program Director Survey Results, 2012 170

Figure VS-1

Vascular Surgery

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

Other life experience

Honors in clerkship in desired specialty

Consistency of grades

Audition elective/rotation within your department

0% 20%

100%

100%

100%

71%

71%

86%

86%

100%

86%

57%

40% 60%

100%

86%

100%

86%

100%

80% 100%

100%

100%

100%

100%

N=7

NRMP Program Director Survey Results, 2012 171

Figure VS-1

Vascular Surgery

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

86%

86%

100%

100%

71%

100%

100%

86%

100%

86%

57%

100%

57%

71%

14%

20% 40%

43%

60% 80% 100%

N=7

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 172

Figure VS-2

Vascular Surgery

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 173

1

N=7

2 3

3.2

3.5

3.8

3.9

4.0

3.9

3.9

4

4.1

4.3

4.3

4.4

4.5

4.8

4.6

4.7

4.4

4.9

4.9

4.4

4.8

5

Figure VS-2

Vascular Surgery

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 174

1

N=7

2

2.0

3.2

4.1

3.3

3.3

2.7

2.8

3.1

3.0

3.4

3.4

2.6

3.7

3.9

4.0

4.3

4.2

3

3.0

4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure VS-3

Vascular Surgery

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

18%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=11

82%

Would your program consider applicants who fail their exam on the 1st attempt?

100%

90%

N=8

88%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

13%

Never Seldom

0%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

27%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=11

55%

Yes, target score

18%

No

Would your program consider applicants who fail their exam on the 1st attempt?

N=5

100%

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

0%

Never Seldom

0% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220 USMLE Step 2 CK not reported because of low response rate

USMLE Step 2 CK not reported because of low response rate

200

180

160

140

120

100

USMLE Step 1

N=7

USMLE Step 1

N=7

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 175

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure VS-4

Vascular Surgery

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=11 100%

USMLE Step 3

N=8

90%

73%

N=11

Yes, pass only

27%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

25%

Yes, pass only

N=8

38%

Yes, target score

38%

No

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

Not reported because of low response rate

Not reported because of low response rate

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

Not reported because of low response rate

Not reported because of low response rate

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 176

Figure VS-5

Vascular Surgery

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=12

90%

83%

80%

70%

60%

50%

40%

30%

20%

10%

0%

0% 0% 0%

8% 8%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

79

21

Number of applications received

N=12

Number of applicants interviewed

N=12

* Data from the NRMP database

18

Number of applicants ranked

N=13*

1

Number of positions in The

Match

N=13*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

37%

62%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=12 N=12

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

100%

25% of Vascular Surgery programs consider all applicants

N=12 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

75%

U.S. Grad

50%

Osteopathic

42%

Canadian

25%

Fifth Pathway

50%

U.S. IMG

42%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 177

Transitional Year

(N=49)

NRMP Program Director Survey Results, 2012 178

Figure TY-1

Transitional Year

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

USMLE/COMLEX Step 1 score

Letters of recommendation in the specialty

Personal Statement

Grades in required clerkships

USMLE/COMLEX Step 2 score

Grades in clerkship in desired specialty

Graduate of U.S. allopathic medical school

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Class ranking/quartile

Gaps in medical education

Personal prior knowledge of the applicant

Perceived commitment to specialty

Honors in clinical clerkships

Applicant was flagged with Match violation by the

NRMP

Volunteer/extracurricular experiences

46%

49%

62%

59%

59%

59%

56%

64%

64%

64%

67%

64%

72%

67%

77%

Other life experience 67%

Honors in clerkship in desired specialty 38%

Consistency of grades 56%

Audition elective/rotation within your department 36%

0% 10% 20% 30% 40% 50% 60% 70% 80%

N=39

NRMP Program Director Survey Results, 2012 179

Figure TY-1

Transitional Year

Percentage of Programs Citing Each Factor in Selecting Applicants to Interview

(continued)

Evidence of professionalism and ethics

Interpersonal skills

Perceived interest in program

Graduate of highly regarded U.S. medical school

Leadership qualities

Alpha Omega Alpha (AOA) membership

Demonstrated involvement and interest in research

Feedback from current residents

Visa status*

Honors in basic sciences

Fluency in language spoken by your patient population

Interest in academic career

Away rotation in your specialty at another institution

USMLE/COMLEX Step 3 score*

Other post-interview contact

Gold Society membership

0%

18%

15%

21%

28%

36%

20%

26%

40%

46%

54%

62%

62%

64%

41%

44%

54%

51%

41%

60% 80% 100%

N=39

* International Medical Graduates only

NRMP Program Director Survey Results, 2012 180

Figure TY-2

Transitional Year

Mean Importance Ratings* of Factors in Ranking Applicants

Applicant was flagged with Match violation by the

NRMP

Interactions with faculty during interview and visit

Interpersonal skills

Interactions with housestaff during interview and visit

Feedback from current residents

Evidence of professionalism and ethics

Grades in clerkship in desired specialty

Perceived commitment to specialty

Letters of recommendation in the specialty

Graduate of U.S. allopathic medical school

USMLE/COMLEX Step 1 score

Leadership qualities

Honors in clerkship in desired specialty

Gaps in medical education

Grades in required clerkships

USMLE/COMLEX Step 2 score

Honors in clinical clerkships

Class ranking/quartile

Medical Student Performance Evaluation

(MSPE/Dean's Letter)

Personal prior knowledge of the applicant

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

NRMP Program Director Survey Results, 2012 181

1

N=39

2 3

3.3

3.6

3.8

3.9

3.9

4.2

3.2

4.7

4.6

4.3

4.5

4.2

4.4

3.7

4

3.9

3.9

3.9

4.2

4.1

4.1

5

Figure TY-2

Transitional Year

Mean Importance Ratings* of Factors in Ranking Applicants

(continued)

Consistency of grades

Perceived interest in program

Visa status**

Audition elective/rotation within your department

Graduate of highly regarded U.S. medical school

Alpha Omega Alpha (AOA) membership

Fluency in language spoken by your patient population

Personal Statement

Other life experience

Demonstrated involvement and interest in research

Honors in basic sciences

Volunteer/extracurricular experiences

USMLE/COMLEX Step 3 score**

Other post-interview contact

Interest in academic career

Gold Society membership

Second interview/visit

Away rotation in your specialty at another institution

0

*Ratings on a scale from 1 (not at all important) to 5 (very important).

** International Medical Graduates only

NRMP Program Director Survey Results, 2012 182

1

N=39

1.8

2

2.8

2.8

3.1

2.6

2.6

2.9

3.4

3.3

3.4

3.7

2.4

2.7

3.6

3.7

3.8

3.9

4.2

3 4 5

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure TY-3

Transitional Year

Programs That Use USMLE Step 1 and Step 2 Clinical Knowledge (CK) Scores When

Considering Which Applicants to Interview

38%

Yes, pass only

Percentage of Programs That Use USMLE Step 1 Score

Scores required?

N=47

Would your program consider applicants who fail their exam on the 1st attempt?

100% N=35

90%

62%

Yes, target score

0%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

29%

Never

63%

Seldom

9%

Often

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

28%

Yes, pass only

Percentage of Programs That Use USMLE Step 2 (CK) Score

Scores required?

N=46

Would your program consider applicants who fail their exam on the 1st attempt?

N=32

57%

Yes, target score

15%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

34%

Never

56%

Seldom

9% often

140

120

100

200

180

160

280

260

240

220

Average USMLE Step 1 and Step 2 CK Scores Programs

Consider When Granting Interviews

Scores Below Which Programs

Generally Does Not Grant Interviews

Scores Above Which Programs

Almost Always Grant Interviews

280

260

240

220

200

180

160

140

120

100

USMLE Step 1

N=21

USMLE Step 2 CK

N=19

USMLE Step 1

N=10

USMLE Step 2 CK

N=9

The boxes in the boxplots above represent the interquartile range (or IQR, which is the range between the 25th and 75th percentiles) and the line in the box is the median. The x-shaped symbol is the mean.

NRMP Program Director Survey Results, 2012 183

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Figure TY-4

Transitional Year

Percentage of Programs That Use USMLE Step 2 Clinical Skill (CS), Step 3, and

COMLEX-USA Scores* When Considering Which Applicants to Interview

Percentage of Programs That Use USMLE Step 2 CS and Step 3 Scores

USMLE Step 2 CS

N=46

87%

100%

90%

USMLE Step 3

N=23

N=46

Yes, pass only

13%

No

80%

70%

60%

50%

40%

30%

20%

10%

0%

22%

Yes, pass only

N=23

13%

Yes, target score

65%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

40%

Percentage of Programs That Use COMLEX-USA Level 1 and Level 2-CE Scores

COMLEX-USA Level 1* COMLEX-USA Level 2-CE*

100%

N=30 N=29

90%

80%

70%

60%

Yes, pass only

37%

Yes, target score

23%

No

50%

40%

30%

20%

10%

0%

31%

Yes, pass only

31%

Yes, target score

38%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

Percentage of Programs That Use COMLEX-USA Level 2-PE and Level 3 Scores

COMLEX-USA Level 2-PE*

N=30

COMLEX-USA Level 3*

N=19

57%

Yes, pass only

10%

Yes, target score

33%

No

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

26%

Yes, pass only

11%

Yes, target score

63%

No

* Osteopathic applicants only

NRMP Program Director Survey Results, 2012 184

Figure TY-5

Transitional Year

Program's Interview Activities

100%

Percentage of Program's Interview Slots Extended Prior to the November 1st MSPE/Dean's Letter Release Date

N=46

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

24%

13%

11%

15%

28%

9%

0% 1-24% 25-49% 50-74% 75-99% 100%

1,000

Average Number of Applications Received, Applicants

Interviewed and Ranked and Positions in The Match

900

800

700

600

500

400

300

200

100

0

508

81 76

Number of applications received

N=48

Number of applicants interviewed

N=47

* Data from the NRMP database

Number of applicants ranked

N=49*

10

Number of positions in The

Match

N=49*

Average Percentage of Applications Rejected and

Reviewed

100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

52%

42%

Percentage of applications rejected

Percentage of applicants receiving an interview

N=45 N=46

Percentage of Programs that Typically Interview and Rank Each Applicant Groups

100%

23% of Transitional Year programs consider all applicants

N=47 100%

90%

80%

70%

60%

50%

40%

30%

20%

10%

0%

U.S. Senior

57%

U.S. Grad

68%

Osteopathic

38%

Canadian

26%

Fifth Pathway

34%

U.S. IMG

32%

Non-U.S. IMG

NRMP Program Director Survey Results, 2012 185

Download