MEoT Presentation to Council

advertisement
Midterm Evaluations of
Teaching Pilot Project
Kiran Mahal & Dr. Simon Bates
About Dr. Bates
• Academic Director of CTLT and
Senior Advisor for Teaching and
Learning at UBC
• Faculty member in Department of
Physics
• Dean of Teaching and Learning in the
College of Science and Engineering
at University of Edinburgh
Midterm (Concurrent)
Evaluations of Teaching
• Distinct from final evaluations (SEoT)
– No effect on tenure or promotion
– Designed and administered by faculty
member
• Not a new concept
– Extensive research about benefits
– Sauder has mandated for undergraduate
courses
Benefits of MEoT
• On average, instructors who conduct midterm course
evaluations perform better on end of term evaluations1,2,3
• Students are more likely to take teaching evaluations
more seriously if they see that their input matters3
• Midterm course evaluations improve student perceptions
of both the instructor’s commitment to teaching and their
concern for students’ performance3
• Sustained administration of formative evaluations leads
to a continuation of positive changes to teaching scores
over time4
1 Prince, A.R. and Goldman, M., “Improving part-time faculty instruction,” Teaching of Psychology, 8, no. 3 (1981): 160-162.
2 Overall, J. U., and March, H.W., “Midterm feedback from students: its relationship to instructional improvement and students: Cognitive and
affective outcomes,” Journal of Educational Psychology, 71 (1979): 856-865.
3 Brown, M. J., “Student Perceptions of Teaching Evaluations,” Journal of Instructional Psychology, 35, no. 2 (2008): 177-181.
4 Wilson, R.C., “Improving faculty teaching: Effective use of student evaluations and consultants,” Journal of Higher Education, 57, no. 2 (1986):
196-211.
Pilot Project
• Led by AMS and CTLT
• SEoT Implementation Committee
supported pilot
• VP Academics of SUS, AUS, KUS and
EUS
• Steering Committee of VP Academics and
Associate Deans
• 22 faculty members, 35 courses, 3400+
students
Pilot Project
• Deliberately non-prescriptive, examples
provided
• Faculty members encouraged to “close the
loop”
• Resources guide compiled by AMS/CTLT
provided to participants
• Most instructors opted for paper based
Follow Up Survey
• Students – response rate 18%
1. Did you participate in providing feedback in the midterm evaluation of
teaching for this course? If not, why not?
2. Was the mid-term evaluation feedback discussed with students in class?
3. Were there aspects of the course that were changed as a result of the
midterm evaluation, and / or did aspects of your understanding of the
rationale for the way the course is structured and delivered change?
4. Identify aspects of this midterm evaluation that you think were particularly
positive or negative.
5. Any other comments you would like to make?
• Faculty – response rate 72%
1. Do you believe that incorporating a midterm evaluation into your course was
beneficial or not? (please explain briefly)
2. How engaged in the midterm were students, e.g. in terms of participation
rates, quality / thoughtfulness of comments etc.?
3. Were you surprised by any of the feedback you received and, if so, how?
4. Identify aspects of this midterm evaluation that you think were particularly
positive or negative
5. Would you advocate for midterm evaluations to be more widely adopted in
your discipline?
Results - Students
• High level of engagement from student
(~80-90% of class)
• Discussion about results took place (71%)
• Student indicated that understanding of
the course changed
• ½ of students reported positive change in
classroom
• Students appreciated opportunity to
provide feedback
• Need for a name change
Results - Faculty
• 2 felt process was not beneficial
• Other 14 felt beneficial and student
provided good constructive feedback
• ½ indicated weren’t surprised by results,
had chance to provide “response” to
feedback
• Would support wider implementation, feel
should not be mandated
Next Steps
• Debrief of results with Steering Committee
and Deans
• Continuing pilot in term 2
• Final comprehensive report with
recommendations
• AMS Education Committee revising
student evaluation of teaching policy
Download