Rater Training for Clinical Skills Verification
Module 5
Performance Standards
Michael Jibson, M.D., Ph.D.
Jeffrey Hunt, M.D.
David Kaye, M.D.
Richard Summers, M.D.
Pre-test
Module 5
1. The Clinical Skills Verification Examination
requires that residents demonstrate competency
all of the following areas except:
a.
conduct of the interview
b.
doctor-patient relationship and rapport
development
c.
case formulation
d.
case presentation
Pre-test
Module 5
2. The Clinical Skills Verification Examination
defines competency:
a)
based on a developmental sequence of
skills over the four years of the adult
psychiatry residency
b)
based on the expected competency of PGY2
psychiatry residents
based on the expected skills of a competent
general psychiatrist in the community
based on the standards of the live patient
ABPN examination
c)
d)
Pre-test
Module 5
3. Residents must:
a)
pass all items on the CSV forms in
order to pass the assessment
b)
pass all three sections in order to pass the
assessment
c)
pass the majority of items on the CSV
form in order to pass the assessment
d)
Have a global passing grade on the
examination if they have failed one
section in order to pass the assessment
Pre-test
Module 5
4.
Which of the following statements is true
about the anchor points on the CSV form?
a)
b)
c)
d)
the anchor points have been validated
using standardized patient interviews
the anchor points assist in the process of
developing inter-rater reliability
the anchor points assist in the process of
developing test validity
the anchor points are derived from
ACGME competencies
CSV Form
• 3 Major items
• Physician-patient relationship
• Conduct of the interview
• Case presentation
• 10 Subscores with anchors
• Must score >5 of 8 on each major item
CSV Form
• 3 major item scores are global impressions
• They are informed by subscores
• They need not be an average of the subscores
• Subscores may be given different weights depending on the
clinical situation
CSV Form
• Subscore anchors for a score of 5-6 define the
minimum expectations in each category
• Anchors assist with inter-rater reliability
• Major items, subscores, and anchors have not yet
been validated
CSV Standards
A score of 5 represents:
• the minimum acceptable standard
• for a general psychiatrist
• practicing in the community
CSV Standards
Scoring should NOT:
• be adjusted to the resident’s level of training
• require excellent or outstanding performance
• expect performance at the level of a subspecialist
Videos
• All videos include actual patients
• All patients and residents have consented to the
use of these videos for educational purposes
• Your responses will be saved for quality assurance
assessment
• It is possible that these data will eventually be
used for a research study, but no IRB proposal has
been submitted
Videos
• The videos have been edited. Rate the residents
performance on what you see
• If the resident presents material in the case
presentation, assume it was obtained during the
patient interview
• The videos are found in the accompanying slide
set
Post-Test
Module 5
1. The Clinical Skills Verification Examination
requires that residents demonstrate competency
all of the following areas except:
a.
conduct of the interview
b.
doctor-patient relationship and rapport
development
c.
case formulation
d.
case presentation
Post-Test
Module 5
1. The Clinical Skills Verification Examination
requires that residents demonstrate competency
all of the following areas except:
c. case formulation
The CSV exam requires competency in establishing a
Doctor-Patient Relationship, Conduct of interview and
Case Presentation.
Post-Test
Module 5
2. The Clinical Skills Verification Examination
defines competency:
a)
based on a developmental sequence of skills
over the four years of the adult psychiatry
residency
b)
based on the expected competency of PGY2
psychiatry residents
c)
based on the expected skills of a competent
general psychiatrist in the community
d)
based on the standards of the live patient
ABPN examination
Post-Test
Module 5
2.
The Clinical Skills Verification
Examination defines competency:
c)
based on the expected skills of a
competent general psychiatrist in the
community
Post-Test
Module 5
3. Residents must:
b)
pass all three sections in order to
assessment
pass the
Residents must demonstrate competence on the global
ratings of Doctor-Patient Relationship, Conduct of the
interview and Case presentation. They do not have to pass
each individual anchor under these categories.
Post-Test
Module 5
4.
true
form?
a)
b)
c)
d)
Which of the following statements is
about the anchor points on the CSV
the anchor points have been validated using
standardized patient interviews
the anchor points assist in the process of
developing inter-rater reliability
the anchor points assist in the process of
developing test validity
the anchor points are derived from ACGME
competencies
Post-Test
Module 5
4.
Which of the following statements is true
about the anchor points on the CSV form?
b) the anchor points assist in the process of
developing inter-rater reliability