Fairness and the New MCAT Exam

advertisement
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Session #2
Fairness and the New MCAT Exam
©2015 AAMC. May be reproduced and distributed with attribution and
without alteration by and within AAMC member organizations only.
AAMC Admissions Hub
www.aamc.org/admissions
Resources on Fairness
• FACTS data on MCAT Scores (aamc.org/facts)
• Using MCAT Data in 2016 Medical Student Selection
• “Do Racial and Ethnic Group Differences in Performance on the MCAT Exam Reflect
Test Bias” (Academic Medicine, May 2013)
•
2
Khan Academy collection and other free and low cost test preparation resources
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Learning objectives
By the end of this session, you will:
• Know how fairness was key to the design and
development of the new exam
• Learn about local efforts to help students
prepare for the new exam
3
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Refer to information in this guide during
the session
4
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Fairness played a critical role in blueprint
development
5
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Fairness played a critical role in blueprint
development
6
•
Balance academic competencies from the
natural, behavioral, and social sciences
•
Test psychology and sociology concepts like
discrimination, stereotype threat, and socioeconomic inequalities
•
Increase attention to population health, studies
of diverse cultures, ethics, philosophy
•
Test concepts covered widely in
undergraduate science courses
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Fairness played a critical role in blueprint
development
7
•
Longer sections that allow medical schools to
consider applicants’ strengths and
weaknesses in relation to their curricula
•
More working time per question, allowing test
takers to work through the information
presented in the passage, think about the
question, and decide on the best answer
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Fairness played a critical role in
developing test questions
8
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
We used tried-and-true procedures to
develop the new questions, and some new
ones as well
9
•
Editorial review
•
Technical review
•
“Summits” with experts
•
Bias and sensitivity review
•
“Field testing” – try out questions to see how
they work
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Addressing Fairness when Developing
Questions for the Psychological,
Social, and Biological Foundations of
Behavior Section
10
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Potentially sensitive content
Some content in the Psychological, Social, and
Biological Foundations of Behavior Section is
potentially sensitive
• Prejudice and Bias
• Discrimination
• Health Disparities
• Healthcare Disparities
11
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Gathering feedback on potentially sensitive
content
Does potentially sensitive Psychological, Social,
and Biological Foundations of Behavior section
content interfere with the performance of
examinees from underrepresented minority groups
by distracting them or slowing them down?
DO NOT REPRODUCE OR DISTRIBUTE WITHOUT PERMISSION
12
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Methods of gathering feedback
Interviews
with 2013
MCAT
Examinees
Focus Group
with Medical
Students and
MCAT Exam
Editors
Review of
Responses to
PSBB Study Postadministration
Survey
13
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Results
14
•
Very few individuals identified the content as
distracting
•
Individuals underrepresented in medicine were
no more likely to identify the content as
distracting than others
•
In general, participants noted that topics such
as health disparities are relevant to medical
school and important for future medical
students to know
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Monitoring Fairness Data During
Field Testing
15
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
New test questions were tried out on
examinees in 2013 and 2014
16
•
Examinees volunteered to take a 32-item “trial
section” at the end of the test
•
Volunteers who showed a “good faith effort”
received $30 and feedback on the new
questions
•
Data from the trial section were used to:
•
Identify questions with good statistical
properties
•
Highlight any opportunities for improved item
development
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
We monitored the field test data for
fairness
17
•
Attended a minority-serving institution or an
institution with no pre-health advisor
•
Received fee assistance from the AAMC
•
Males vs. females
•
Race/ethnicity (white, Black, Latino)
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Results
18
•
More than 113k students tried out new questions
•
Participation rates were high, and the vast
majority of examinees showed a good faith effort
•
The participants were similar demographically to
the population of examinees
•
The high data quality helped build a large item
bank for the new MCAT exam
•
Differences in average performance were
comparable to the differences on the old MCAT
exam
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
After Lunch, You’ll See Early Data from
the April and May 2015 Examinations
19
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Fairness played a critical role in
developing the score scales for the new
MCAT exam
20
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Developing the Score Scales
with Fairness in Mind
21
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Many data sources influenced the design
of the new score scales
22
•
Surveys of admissions officers on the use of
MCAT scores and other applicant data in
admissions
•
Acceptance rates for applicants with different
ranges of MCAT scores and undergraduate
GPAs
•
Graduation rates for medical students with
different ranges of MCAT scores and
undergraduate GPAs
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Medical schools use academic metrics,
experiences, and attributes holistically
Mean
Importance
Ratings
Highest
Importance
Ratings
(>= 3.0)
Medium
Importance
Ratings
(>=2.5 and
<3.0)
Lowest
Importance
Ratings
(<2.5)
23
Academic Metrics
 GPA: Science/math
 MCAT total score
 Upward or downward
grade trend
 GPA: Total
 Performance in a postbaccalaureate program
 Selectivity of undergrad.
institution (Priv.)5
 On schedule to meet premedical coursework
 GPA: Cumulative nonscience/math
 Completion of challenging
non-science courses
 Selectivity of undergrad.
institution (Public)5
Experiences
Demographics2
 Healthcare experience
 Community
service/volunteer
experience
 Experience with
underserved populations
 Navigated through cultural
barriers or challenges
 Leadership experience
 U.S. citizenship/permanent
residency (Pub.)5
 State residency (Pub.)5
 Research experience (Priv.)5
 Experience with populations
unlike the applicant
 Lack of access to optimal
educational resources
 Special family obligations or
other circumstances
 Work or athletic scholarship
obligations while in school
 Experience with prejudice
 Research experience (Pub.)5
 Rural or urban background
(Pub.)5
 First-generation college
student
 U.S. citizenship/permanent
residency (Priv.)5
 Race/ethnicity
 Socioeconomic status (SES)
 Rural or urban background
(Priv.)5
 Multilingual
 Legacy
 Gender
©2015 AAMC. May be reproduced and distributed with attribution and without alteration by and within AAMC member organizations only
3
Acceptance Data
24
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Percentages of 2012-2014 applicants
admitted into one or more medical schools
Old MCAT Total
GPA Total 5-14
3.80-4.00 4%
3/80
15-17
2%
4/162
18-20
11%
57/524
21-23
21%
317/1,526
24-26
27-29
38%
61%
1,363/3,554 4,232/6,978
30-32
76%
7,110/9,361
33-35
84%
6,298/7,504
36-38
39-45
All
88%
91%
69%
3,688/4,176 1,385/1,519 24,457/35,384
3.60-3.79 0%
0/177
2%
8/367
8%
83/1,024
16%
371/2,332
27%
45%
1,332/4,866 3,725/8,284
64%
5,997/9,359
76%
4,513/5,973
80%
85%
1,782/2,235 435/514
52%
18,246/35,131
3.40-3.59 0%
1/336
2%
13/553
5%
67/1,278
12%
314/2,607
22%
32%
1,010/4,691 2,307/7,151
48%
3,600/7,455
62%
2,382/3,854
70%
819/1,176
75%
176/234
36%
10,689/29,335
3.20-3.39 0%
0/370
1%
5/561
4%
41/1,168
11%
249/2,262
18%
604/3,344
23%
1,012/4,369
35%
1,453/4,106
47%
889/1,902
58%
316/547
65%
74/113
25%
4,643/18,742
3.00-3.19 0%
0/388
0%
2/553
3%
25/928
8%
123/1,578
17%
373/2,218
19%
455/2,361
29%
530/1,851
53%
21/40
18%
1,954/10,958
2.80-2.99 0%
0/368
1%
4/386
3%
19/626
6%
54/908
12%
132/1,069
16%
158/998
29%
7/24
12%
660/5,521
2.60-2.79 0%
0/274
0%
1/284
3%
12/355
5%
24/486
9%
47/512
15%
57/388
30%
3/10
9%
251/2,749
2.40-2.59 0%
0/196
0%
0/151
1%
2/179
3%
8/240
9%
19/221
14%
22/152
17%
18/109
16%
6/37
18%
3/17
--
6%
79/1,304
2.20-2.39 0%
0/132
0%
0/77
0%
0/94
0%
0/91
8%
7/88
12%
8/68
15%
6/39
7%
1/14
--
--
4%
22/611
2.00-2.19 0%
0/53
0%
0/40
0%
0/42
0%
0/28
0%
0/30
14%
2/14
18%
2/11
--
0%
0/10
5%
306/6,229
0%
---0/12
12%
24%
39%
57%
71%
79%
85%
1,460/12,070 4,887/20,601 11,978/30,769 18,954/33,316 14,520/20,521 6,757/8,522 2,102/2,459
1.47-1.99 0%
-0/42
0%
1%
All
4/2,419 37/3,143
44% of48%
112/233
applicants
24%
27%
26%
one
179/746received
85/310
22/86or
more 32%
21%
28%
59/276
33/117
15/47
acceptances
39%
313/808
2%
4/220
4
0%
0/90
44%
61,005/140,049
Percentages of 2012-2014 applicants
admitted into one or more medical schools
Old MCAT Total
GPA Total 5-14
3.80-4.00 4%
3/80
15-17
2%
4/162
18-20
11%
57/524
21-23
21%
317/1,526
24-26
27-29
38%
61%
1,363/3,554 4,232/6,978
30-32
76%
7,110/9,361
33-35
84%
6,298/7,504
36-38
39-45
All
88%
91%
69%
3,688/4,176 1,385/1,519 24,457/35,384
3.60-3.79 0%
0/177
2%
8/367
8%
83/1,024
16%
371/2,332
27%
45%
1,332/4,866 3,725/8,284
64%
5,997/9,359
76%
4,513/5,973
80%
85%
1,782/2,235 435/514
52%
18,246/35,131
3.40-3.59 0%
1/336
2%
13/553
5%
67/1,278
12%
314/2,607
22%
32%
1,010/4,691 2,307/7,151
48%
3,600/7,455
62%
2,382/3,854
70%
819/1,176
36%
10,689/29,335
3.20-3.39 0%
0/370
1%
5/561
4%
41/1,168
11%
249/2,262
18%
604/3,344
23%
1,012/4,369
35%
1,453/4,106
65%
74/113
25%
4,643/18,742
3.00-3.19 0%
0/388
0%
2/553
3%
25/928
8%
123/1,578
17%
373/2,218
19%
455/2,361
53%
21/40
18%
1,954/10,958
2.80-2.99 0%
0/368
1%
4/386
3%
19/626
6%
54/908
12%
132/1,069
16%
158/998
29%
7/24
12%
660/5,521
2.60-2.79 0%
0/274
0%
1/284
3%
12/355
5%
24/486
9%
47/512
15%
57/388
30%
3/10
9%
251/2,749
2.40-2.59 0%
0/196
0%
0/151
1%
2/179
3%
8/240
9%
19/221
14%
22/152
9% of applicants
47%
58%
with
GPAs
889/1,902
316/547
above
29%
39% 3.8 and
48%
530/1,851
313/808
112/233
MCAT scores
24%
27%
26%
above
38
are
not
179/746
85/310
22/86
admitted
into
21%
28%
32%
59/276
33/117
15/47
any medical
17%
16%
18%
schools
18/109
6/37
3/17
75%
176/234
--
6%
79/1,304
2.20-2.39 0%
0/132
0%
0/77
0%
0/94
0%
0/91
8%
7/88
12%
8/68
15%
6/39
7%
1/14
--
4%
22/611
2.00-2.19 0%
0/53
0%
0/40
0%
0/42
0%
0/28
0%
0/30
14%
2/14
18%
2/11
--
1.47-1.99 0%
0/42
0%
All
--
0%
0/10
5%
0%
0/12
12%
--
--
--
24%
39%
57%
1%
71%
--
2%
4/220
79%
85%
0%
0/90
44%
4
Percentages of 2012-2014 applicants
admitted into one or more medical schools
Old MCAT Total
GPA Total 5-14
3.80-4.00 4%
3/80
15-17
2%
4/162
18-20
11%
57/524
21-23
21%
317/1,526
24-26
27-29
38%
61%
1,363/3,554 4,232/6,978
30-32
76%
7,110/9,361
33-35
84%
6,298/7,504
36-38
39-45
All
88%
91%
69%
3,688/4,176 1,385/1,519 24,457/35,384
3.60-3.79 0%
0/177
2%
8/367
8%
83/1,024
16%
371/2,332
27%
45%
1,332/4,866 3,725/8,284
64%
5,997/9,359
76%
4,513/5,973
80%
85%
1,782/2,235 435/514
52%
18,246/35,131
3.40-3.59 0%
1/336
2%
13/553
5%
67/1,278
12%
314/2,607
22%
32%
1,010/4,691 2,307/7,151
48%
3,600/7,455
62%
2,382/3,854
70%
819/1,176
36%
10,689/29,335
3.20-3.39 0%
0/370
1%
5/561
4%
41/1,168
11%
249/2,262
18%
604/3,344
65%
74/113
25%
4,643/18,742
3.00-3.19 0%
0/388
0%
2/553
3%
25/928
8%
123/1,578
17%
373/2,218
53%
21/40
18%
1,954/10,958
2.80-2.99 0%
0/368
1%
4/386
3%
19/626
6%
54/908
12%
132/1,069
29%
7/24
12%
660/5,521
2.60-2.79 0%
0/274
0%
1/284
3%
12/355
5%
24/486
9%
47/512
8% of applicants
23%
35% GPAs
47% 3.00 -58%
with
1,012/4,369
1,453/4,106
889/1,902
316/547
3.19 and
19%
29%
39%
48%
scores
455/2,361 MCAT
530/1,851
313/80821-23
112/233
are24%
admitted
at
16%
27% into 26%
158/998
179/746
22/86
least
one85/310
medical
15%
21%
28%
32%
57/388
59/276 school
33/117
15/47
75%
176/234
30%
3/10
9%
251/2,749
2.40-2.59 0%
0/196
0%
0/151
1%
2/179
3%
8/240
9%
19/221
14%
22/152
17%
18/109
16%
6/37
18%
3/17
--
6%
79/1,304
2.20-2.39 0%
0/132
0%
0/77
0%
0/94
0%
0/91
8%
7/88
12%
8/68
15%
6/39
7%
1/14
--
--
4%
22/611
2.00-2.19 0%
0/53
0%
0/40
0%
0/42
0%
0/28
0%
0/30
14%
2/14
18%
2/11
--
1.47-1.99 0%
0/42
0%
All
--
0%
0/10
5%
0%
0/12
12%
--
--
--
24%
39%
57%
1%
71%
2%
4/220
79%
85%
0%
0/90
44%
4
Medical Student Performance
28
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
The vast majority of medical students graduate in four years
Old MCAT Total
GPA Total 5-14
3.80-4.00 --
15-17 18-20
-72%
59/82
21-23
77%
244/317
24-26
27-29
87%
91%
1,048/1,200 3,025/3,333
30-32
91%
4,328/4,774
33-35
36-38
39-45
90%
89%
88%
3,157/3,497 1,713/1,934 615/701
All
90%
14,196/15,850
3.60-3.79 --
58%
7/12
66%
81/122
74%
294/395
83%
89%
1,010/1,220 2,911/3,269
90%
4,086/4,530
89%
87%
90%
2,525/2,833 1,027/1,174 233/258
88%
12,175/13,816
3.40-3.59 --
40%
4/10
69%
75/109
72%
259/362
80%
762/955
87%
1,960/2,252
89%
2,656/2,979
90%
88%
1,537/1,713 562/641
89%
115/129
87%
7,933/9,157
3.20-3.39 --
55%
6/11
65%
60/93
65%
178/272
75%
418/557
85%
905/1,066
90%
1,202/1,336
89%
676/760
88%
247/280
84%
41/49
84%
3,734/4,427
3.00-3.19 --
43%
6/14
38%
20/52
62%
104/169
71%
229/321
84%
411/487
87%
429/495
90%
246/274
90%
97/108
81%
13/16
80%
1,557/1,939
2.80-2.99
--
38%
11/29
59%
54/92
62%
91/147
74%
120/162
85%
128/150
--
72%
508/706
2.60-2.79
--
44%
8/18
47%
18/38
63%
32/51
80%
45/56
86%
42/49
--
70%
171/246
2.40-2.59
--
--
40%
4/10
61%
11/18
71%
15/21
86%
18/21
--
--
73%
61/84
--
--
--
--
--
--
--
44%
8/18
--
--
2.20-2.39
2.00-2.19
1.47-1.99
All
--
--
87%
of medical
82%
88%
77/94
15/17
students
85%
--in 4
graduate
22/26
years
--
--
44
--
--
50% 47% 62%
70%
81%
88%
90%
90%
88%
88%
87%
10/20 31/66 316/510 1,155/1,660 3,604/4,474 9,394/10,650 12,893/14,339 8,253/9,210 3,667/4,160 1,026/1,163 40,349/46,252
Medical students with a wide range MCAT scores and UGPAs
graduated in 4 years
Old MCAT Total
GPA Total 5-14
3.80-4.00 --
15-17 18-20
-72%
59/82
21-23
77%
244/317
24-26
27-29
87%
91%
1,048/1,200 3,025/3,333
30-32
91%
4,328/4,774
33-35
36-38
39-45
90%
89%
88%
3,157/3,497 1,713/1,934 615/701
All
90%
14,196/15,850
3.60-3.79 --
58%
7/12
66%
81/122
74%
294/395
83%
89%
1,010/1,220 2,911/3,269
90%
4,086/4,530
89%
87%
90%
2,525/2,833 1,027/1,174 233/258
88%
12,175/13,816
3.40-3.59 --
40%
4/10
69%
75/109
72%
259/362
80%
762/955
87%
1,960/2,252
89%
2,656/2,979
90%
88%
1,537/1,713 562/641
89%
115/129
87%
7,933/9,157
3.20-3.39 --
55%
6/11
65%
60/93
65%
178/272
75%
418/557
85%
905/1,066
90%
1,202/1,336
89%
676/760
84%
41/49
84%
3,734/4,427
3.00-3.19 --
43%
6/14
38%
20/52
62%
104/169
71%
229/321
84%
411/487
81%
13/16
80%
1,557/1,939
2.80-2.99
--
38%
11/29
59%
54/92
62%
91/147
74%
120/162
--
72%
508/706
2.60-2.79
--
44%
8/18
47%
18/38
63%
32/51
80%
45/56
--
70%
171/246
2.40-2.59
--
--
40%
4/10
61%
11/18
71%
15/21
--
--
--
--
--
2.20-2.39
--
2.00-2.19
1.47-1.99
All
--
--
88%
247/280
81% of medical
87%
90%
90%
students
429/495
246/274
97/108
entering with
85%
82%
88%
MCAT
scores
128/150
77/94
15/17
between
24-26
86%
85%
-42/49 graduate
22/26
in 4
years
86%
--18/21
--
--
--
--
--
73%
61/84
44%
8/18
--
--
44
50% 47% 62%
70%
81%
88%
90%
90%
88%
88%
87%
10/20 31/66 316/510 1,155/1,660 3,604/4,474 9,394/10,650 12,893/14,339 8,253/9,210 3,667/4,160 1,026/1,163 40,349/46,252
A new exam means new score scales
Decision Rules
• No overlap
• Emphasis on the
center of the scale
31
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
14
32
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
After Lunch, You’ll Have a Chance to
Work with the New Score Reports
33
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Our Research on Fairness is Just
Beginning
34
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
MCAT validity research
The MCAT Validity Committee is responsible for
evaluating the new exam and how well it:
• Supports diversity and is fair
• Predicts medical students’ academic
success
• Helps admissions officers do their work
35
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
36
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Validity committee members
•
•
•
•
•
•
•
•
•
•
•
•
37
Catherine Lucey, M.D. (Chair)
Aaron Saguil, M.D., LTC
(Vice-chair)
Ngozi Anachebe, M.D.
Ruth Bingham, Ph.D.
Barbara Beckman, Ph.D.
Kevin Busche, M.D.
Victoria Cannon
Steven Case, Ph.D.
Deborah Castellano, M.S.
Jerry Clark, Ph.D., M.B.A.
Julie A. Chanatry, Ph.D.
Daniel M. Clinchot, M.D.
•
•
•
•
•
•
•
•
•
•
•
Liesel Copeland, Ph.D.
Hallen Chung, M.A.
Martha L. Elks, M.D.
William Gilliland, M.D.
Jorge A. Girotti, Ph.D., M.A.
Joshua Hanson, M.D., M.P.H.
Brandon Hunter
Loretta Jackson-Williams, M.D.
David Jones, Ph.D.
R. Stephen Manuel, PhD.
Stephanie C. McClure, M.D.,
FACP
• Janet McHugh
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
24
Validity committee members
•
•
•
•
•
•
•
•
•
•
•
•
38
Stephen Nicholas, M.D.
Wanda Parsons, M.D., FCFP
Boyd F. Richards, Ph.D.
Stuart Slavin, M.D.
Jenna Smith, Ph.D.
Aubrie Swan Sein, Ph.D., Ed.M.
Doug Taylor
Carol Terregino, M.D.
Ian W. Walker, M.D.
L. James (LJ) Willmore, M.D.
Robert A. Witzburg, M.D.
David Wofsy, M.D.
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
24
The MCAT validity research will evaluate a
number of questions, for example:
39
Diversity and fairness
• Are differences in average scores for
test takers in different racial/ethnic
groups smaller or larger than
differences on the old exam?
Academic preparation
• Will more humanities and psychology
majors take the new exam?
Admissions decision
making
• How are medical school admissions
committees using scores from the new
exam in admissions?
Predicting medical
student performance
• Will scores from the new exam predict
academic performance throughout
medical school?
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Two working groups are studying fairness
issues
Questions
•
People
•
•
•
•
Pre-health advisors
Admissions
Diversity affairs
Other
Change
to test
•
•
•
•
Access to preparation
resources
Access to courses
Barriers to success
Changes to diversity
Other
Changes to
preparation
Data
•
•
•
•
MCAT registration
PMQ
AMCAS applications
Other
Potential
differences
in access
Potential
increases
in group
differences
DO NOT REPRODUCE OR DISTRIBUTE WITHOUT PERMISSION
40
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
We will report validity data as they become
available
Applications
for the 2016 class
sent to medical
schools
MCAT2015
launches
2016 class
matriculates
MCAT session
at the PDC,
preliminary
predictive
validity results
for PSBB
Predictive validity
results for M1
students reported
at AAMC
Annual Meeting
Acceptance data
reported for 2016
class
Acceptance data
reported for 2017
class
Nov.
2018
Nov.
2017
June
2015
April 2015
Predictive validity
results for M1, M2
students reported
at AAMC
Annual Meeting
July 2015
Aug 2016
Jan. 2017
Jan. 2018
25
DO NOT REPRODUCE OR DISTRIBUTE WITHOUT PERMISSION
41
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Fairness played a critical role in
developing preparation resources for
aspiring physicians
42
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Helping Students Prepare
Study
Understand
Practice
43
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Helping Students Prepare
Study
Understand
Practice
44
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Helping Students Prepare
Study
Understand
Practice
45
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Helping Students Prepare
Study
46
Understand
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Khan Academy tutorials teach concepts
targeted by the new test
47
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
What are your colleagues doing?
Jorge Girotti
Ngozi Anachebe
DO NOT REPRODUCE OR DISTRIBUTE WITHOUT PERMISSION
48
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Activity 2.2
49
2015 AAMC Admissions and Student Diversity Affairs
Professional Development Conference
Download