Minutes from the Curriculum Committee Mini Retreat on 6/30/11 Topic Discussion Action Items

advertisement
Minutes from the Curriculum Committee Mini Retreat on 6/30/11
7/1/11
Topic
Attending:
Introduction – Where
We Are in the LCME
Process/Role of the
Committee
Specific Policy Issues
– Plans for Next Year
Discussion
Bacon, Cairns, Chuang, Cross, Dent, Farrell, Felix, Gilliland,
Hobbs, Emily Holmes, Marks, Rao, Steiner, Stone, Viera,
Dan Wurzelman; Newton - Chair
 Over the last year and a half, we have made dramatic
progress in addressing the 48 potential citations we
identified in review 13 months ago. With respect to
the curriculum, our major effort has been to identify
our core competencies and milestones, define the
UNC96 and core procedures, map the curriculum and
now to put these in place.
 This committee represents the institutional oversight
required by LCME standard ED2: we have
responsibility for ongoing review of the program. The
purpose of today’s retreat is to do an evaluation of the
overall program and make suggestions for next year.
 Timeliness of Grades – the attached data suggest that
for all the clerkships, grades are now timely.

Duty Hours Review - Data reveal roughly the same
pattern as last year. Years 3 & 4 have no problems
with duty hours, as measured by the 80 hour criterion.
Inpatient rotations are roughly 60-75 hours/week and
outpatient rotations are 45-55 hours/week.
Regarding the 10 hour rule, members supported
collection of data but wanted to make sure optional
unscheduled activities were not excluded by the rule.
Action Items



Duty Hours – CC1 and CC2 report no concerns from
students about duty hours/overall work in the first
two years. There have been occasional comments that
preparation for boards is stressful but no evidence
that it is overwhelming. How should we monitor? The

Proposal: We are in
compliance.
Henceforward, OME
will monitor regularly,
using one45, and
intervene as
appropriate. There
needs to be no further
action on the part of
the Curriculum
Committee unless
problems arise.
We are in compliance.
For next year, we will
continue to monitor
via one45 with the
inclusion of a specific
question regarding 10
hours of rest between
scheduled activities.
We, therefore, will
continue to monitor.
Consensus was that
there was not a
problem with duty
hours in years 1 & 2.
We will continue to
Document1



group’s sense was that an ongoing focus group with
students would be appropriate. We need to ensure
that as we switch to more team based and selfdirected learning, total hours (inside and outside) of
the classroom do not expand. We need to track this.
Midcourse Formative Reviews – Students report that
experience with getting midcourse clerkship reviews is
quite variable across departments. Ob/Gyn is
excellent but others are not; similarly, the use of
clinical logs is variable across rotations. One45 data
confirms this.
There is consensus that midcourse reviews are
valuable for monitoring both the student experience
and the clinical log. There was discussion about what
constitutes the appropriate midcourse review. Key
elements were that it be simple, use one45 and
include some student self-assessment.
Proposal – that we document midcourse review
through a short form in one45.
Midcourse Review in Years 1 & 2 – The pilot of year 1
block IV formative review demonstrated feasibility.
Faculty, however, felt uncomfortable giving judgments
about midcourse aptitude across competencies –
underscored by the choppy nature of that block.
There was disagreement as to the value of broad
midcourse review in the first year. The group affirmed
the importance of feedback with information about
standard deviation in each of the first year courses but
wondered whether it was appropriate to try to judge
all competencies in each block. One lesson is that
different blocks might emphasize different
competencies – for example, block II highlights the
communications competencies. This could be the
focus of assessments and midcourse feedback.



monitor with our
course focus groups
and CC1 and CC2
ongoing review, and
bring back any issues
that emerge.
Will clerkship
directors to develop
and implement this
year a midcourse
review form in one45
that is simple and
includes a studentgenerated
component. The
CC3/4 clerkship
meeting next week
will finalize the form.
Year 1 & 2 long
courses such as
Medicine & Society,
Clin. Epi. and CSD/CSI
will have midcourse
feedback across
competencies.
Midcourse review in
the first year will
include specific
feedback around
medical knowledge
and student standing
within the class. We’ll
pilot the use of
midcourse feedback
for competencies that
are addressed in a
specific block,.
Another possibility is using peer assessment
selectively. This could provide excellent assessment of
some of the competencies (e.g., communication skills)
and might stand as a proxy for this sort of midcourse
Document1
review. This would be good to pilot next year.

Common Assessment Forms – Over the last two weeks
a draft common assessment form for the core
clerkships has been created. It includes behavioral
anchors across all seven competencies and assessment
of the learner’s mastery. The assessment task force
acknowledged that there are substantial differences in
what clerkships want in the common assessment
forms as well as how they will be used. Accordingly,

they have created a process for piloting different
versions of the form, with a goal of having a common
assessment form across the clerkships in place by mid
fall.
Review of the professionalism forms reveals a variety
of different forms being used relatively rarely.

Academic Comparability Across Sites – A key issue is
grade rates. Following up last year’s discussion, the
rates of Honors grades have come down, but there is
some concern that the rate of High Pass needs some
attention. In some clerkships, the rate of High Pass
and Honors together is as high as 95%. The
assessment task force discovered variation in who fills
out the assessment form. Early data suggest that there
is not much variation in clinical assessment – faculty
development is necessary. They proposed specific
proportions for Honors, High Pass and Pass. These
would need to be seen in the context of increasing
competition for residencies nationally – and the
importance of the shifts in grades from one year to the
next with respect to the match. The consensus of the
Curriculum Committee was that we need to extend
our concerns about grade inflation to High Pass but
not to have a rigid formula yet. We also need further
exploratory work and probably faculty development
regarding clinical assessment and the consistency of
the evaluation process from site to site.

The Curriculum
Committee approved
development and
implementation of a
common assessment
form this year. It will
include all
competencies,
behavioral grounding
and identification of
students at risk. In
addition, the current
professionalism forms
will not be used
routinely; specific
professionalism items
will be included in the
common assessment
form.
CC3,4 assessment task
force will recommend
thresholds for Honors
and High Pass, and
give
recommendations for
collection of
information.
There are cases in which there is clearly variation in
grading across sites. A preliminary look at the strength
of students across clerkships suggests that this is not
an adequate explanation for grade variability. The
Document1
consensus of the committee was that we need to
improve the consistency of grading across sites. We
will intervene in the various elements of variance,
including faculty development over the next year.



Program Review

Mistreatment – Newton summarized the current
status of mistreatment. The key issues are:
o 29% of the students report experiencing or
observing mistreatment; of those experiencing
it, only 31% reported it to anyone in a position
of authority.
o Mistreatment is not nurse vs. student nor
what happens when we ask students to do
things for patients, and only rarely is it
physical abuse, unwanted sexual advances or
racial slurs. Most mistreatment falls into two
buckets: a) specialty bashing including not
giving people going into a certain discipline
experience in the discipline’s clerkship, and b)
lack of respect for patients or for the student’s
role.
The plan for this year includes:
o Development of an institutional positive
learning environment statement
o Explicit involvement of department chairs in
clerkships, with an emphasis on Surgery and
Ob/Gyn
o Orientation to the issue for rising third years
and residents
o Continuing real time surveillance via the
survey of fourth-year students in September.
o AHEC campus ombudsmen for confidential
reporting and investigation; zero tolerance
policy addressing safety issue
Comments included:
o Grade issues are sometimes part of the
complaints.
o Faculty development is a challenge. They need
to learn to ask about specialty plans in a way
that students don’t find threatening.
This is an overall review of the medical student
education program.
Please note that some of the elements of the review
that we envisioned last October are not available – the
residency program director data, a competency-based
roll up across the curriculum with outcomes at student

OME will follow up.

The overall
assessment is very
good.
We plan a more
systematic use of data
to admissions process
– outliers and process.

Document1
and course level, as well as long-term outcomes from
licensure data. In addition, data we’ve reviewed over
the course of the year were not reproduced (e.g.,
board part III scores, CPX scores, clinical log scores and
the like).

Comments:
o



Please note that there has been a dip in
interviews and acceptances among minority
candidates, although an increase of
acceptance rates. African Americans/Indians
are among the best in country; the Hispanics
one of the worst. The rate of MED alumni
acceptances increased.
o The cohort experience is typical except that in
this year, the number of MD-PhDs ended up
fewer.
o A question was raised about leave of absence
– what happens to those people. The majority
of leaves of absence are for research and
enrichment purposes. They almost all come
back. Of the ones that do it for academic
challenges, about 50% come back. Consensus
was that it would be valuable to have further
information.
The year committees reported out. CC1 raised a
number of issues for next year – integrating CAC into
CSD, the development of a cumulative end of year
exam, the use of small groups and TBL and
acknowledging the departure of Alan Cross. CC1 hopes
to integrate social sciences more definitively into the
curriculum via a new grant. Of note, the first year
curriculum has gone from 17 to 4 courses in 10 years.
CC2 – The multi-phased mapping has gotten course
directors to rewrite their objectives and sometimes
their exams and course content. In some cases, it has
identified redundant material or gaps. The major issue
that should be a focus for next year is prepping for
Step I. It’s loud and clear from the GQ as well as
discussion that some of effort needs to be made. Of
note, there’s less time than there used to be to
prepare for Step I. There has been some turnover in
CC2 leaders, some of which is intentional.
CC3/4 – There’s also been some turnover in CC3/4 and
there’s been a lot of work related to LCME as noted
above. Key issues include the importance of mapping
and comparability across clerkships with an emphasis

Also, tuition increase
will support new
efforts for Hispanics.
OME will bring
analysis of LOA data
back to committee.
Leave of absence
follow-up in
Curriculum
Committee.
The Curriculum
Committee and OME
will work with
students to develop
options for board
prep.
Document1
on grading, competencies and the like.
Other Comments:
 Assessment (how we assess, what we’re assessing,
broadening assessment) needs to be a major focus
next year.
 A key idea arrived at today is that we can have
individual blocks (in the first two years) and individual
clerkships focus on different competencies and fit
together as a whole. We need to have GME formally
represented on this group.

Future Items
o There was a proposal to change the name of
this committee to the Education Committee. It
is a better descriptor of our authority over not
just curriculum but also admissions and longterm outcomes, and it eliminates confusion
with the year committees.
o Newton introduced the strategic planning
process which is about to kick off. We will
likely have a focus on the needs of the state of
NC and the curriculum. More to come as
charges are defined and people on
committees are finalized.

Continue to broaden
assessment.

OME will engage new
DIO.
Approved
unanimously.

Document1
Download