Student Assessment Practices and Procedures

advertisement
Appendix A
Student Assessment Practices and Procedures
Passed by the Student Assessment Committee: Aug 16th 2012
Preamble
This document outlines the procedures specified by the Student Assessment Committee
(SAC) in order that courses and competencies follow the Student Assessment Policy in
assessing curricular objectives. These procedures are developed by the SAC and
approved by the MD Program Executive Committee. The procedures will be reviewed
annually and revised, as needed, in order to ensure that the policy is followed and
administrative practices run smoothly.
1. Governance of Student Assessment, Policy and Practice.
Practices and procedures in this document will be overseen by the SAC and approved by
the MD Program Executive Committee. The CFRC will be responsible for ensuring that
courses are in compliance with policies and procedures set out by the SAC.
2. Narrative Feedback
As per the Student Assessment Policy section 2.9, narrative description of student
performance must be included as part of the assessment in all courses where studentteacher interaction permits. The process for provision of these narrative assessments must
ensure that they are shared with the student and they are reviewed by the Course Director
or relevant delegate. Instances of deficient performance are referred to the Director of
Academic Advising for review and possible remediation. Instances of outstanding
performance are documented in the student record.
3. Preclerkship Assessment
As stated in the Student Assessment Policy section 3.3, formative assessment must be
present in every course. An assessment plan must be in place for each course and the
schedule of assessment events must be displayed on the course Web site for all students
to see at the start of the term (Student Assessment Policy section 3.4 and 3.5). The Year
Directors will review the assessment schedules of all courses prior to displaying them on
the course Web pages. This review will allow for the coordination of formative
assessment events among courses within each term and facilitate the planned staggering
of assessment events to avoid overloading students with formative assessments and
interfering with their preparation for, and attendance in, other courses.
Across all courses within a term, no more than two assessment events (e.g., assignments,
tests) contributing to final grades will be scheduled within any given week.
In the case of midterm examinations and major assignment deadlines, no more than three
may be scheduled in any given week. (Assignments are considered to be “major” if they
are worth more than 20% of the course grade). Further, during those weeks, no other
formative assessments contributing to course grades should be planned.
Suggested weighting of assessment throughout the term is provided in the following
table:
Distribution Targets Guideline:
Assessment method
Quizzes/lab quizzes
Recommendations Rationale
0-25%
Encourage frequent opportunities
for self-assessment
TBL(team-based
learning)/SGL (small group
learning) mark – individual
Guide studying and ensure
important concepts are learned
TBL/SGL marks – group
Assignments
0-25%
Midterm examinations or unit
tests*
10-25%
Final
examination/assignment*
45-70%
Encourage development of
collaborator and professionalism
competencies. Limit the
contribution of group work to
individual results unless peer
assessment strategies are in place
Encourage alternative methods of
assessment
Provide exposure to exam format,
guide study efforts, reduce
emphasis on final exam
Ensure learning objectives are met
at the end of course. Reduce high
stakes nature of final assessment
*where applicable
4. Examination Procedures - Pre-clerkship and Extended Clerkship Courses
(section 4.0 of Student Assessment Policy)
a) Examination Development
-
As per the Student Assessment Policy section 4.1, examinations will be
constructed according to the course assessment blueprint.
-
The schedule for examination preparation will be set by the Curricular
Coordinators and approved by the Year Directors by beginning of each term. The
schedule will be as follows:
T = exam dates
T minus 1.5 weeks  exams to print
T minus 2.5 weeks  exams to Curricular Coordinators for Final Version
T minus 4 weeks  exam review by SAC rep and Assessment Consultant
T minus 5weeks  all items to Curricular Coordinators
b) Post-examination review
-
-
-
Technical reports of the final examinations will be distributed to the Course
Director and SAC term representative prior to the Examiners’ meeting to allow
for any necessary adjustments to the exam results.
Technical analysis of the examination will consist of descriptive statistics (Mean,
Standard Deviation, Standard Error of the Mean, Range) and estimates of
reliability, i.e., Cronbach’s Alpha. Item analysis will consist of item difficulty and
biserial correlation. If items are deleted from the exam based on this review,
marks will be calculated prior to the Examiners’ meeting. A list of deleted items
will be given to the Curricular Coordinator for removal from the Question Bank
until revision of the questions has been done.
Review of examination difficulty will consist of comparing the descriptive
statistics to those from the exams of previous years and across courses within the
term and looking at the statistics of old questions versus new.
c) Examiners’ meeting
-
-
-
-
As per the Student Assessment Policy section 4.4, each term will have an
Examiners’ meeting. The meeting should be attended by all Course Directors for
the term, an SAC representative, the Year Director and representatives from
FSGL, Clinical Skills and the Competency Leads or designates for each of these.
The meeting will be scheduled by the Curricular Coordinator.
Complete and finalized course marks will be circulated in a secure manner to the
Course Director, Year Director and SAC representative for review prior to the
Examiners’ meeting.
Student results will be reviewed. Any students with poor or failing performance
will be reviewed as per the Student Assessment Policy section 6.0. Review of
individual student performance will include, but is not limited to, course marks,
small group learning attendance and other competency role data.
Recommendations will be taken to the Progress and Promotions Committee.
A course report including the above statistical information, a review of processes
during the term and the de-identified results of the Examiners’ meeting, including
recommendations made to the Progress and Promotions Committee, will be made
to the SAC by the SAC term representative.
-
In the case of the extended clerkship courses, exam review will be done by the
Course Director, the Extended Clerkship Curriculum Director and the SAC term
representative.
5. Clerkship Assessment (further development required)
Locally developed examinations used in clerkship will undergo the same development
and review procedures as in the preclerkship courses.


Portfolio assessment will be developed in conjunction with the Competency
Committee.
Clinical Skills and FSGL assessment will be developed in conjunction with the
appropriate stakeholders.
Download