Closing the Feedback Loop - University of West London

advertisement
Closing the Feedback Loop:
Engaging Students by Acting on Mid-term Feedback
Dr. Anke Görzig
University of West London
Introduction
Results & Closing the Loop Actions
It has become common practice to seek students’ views and satisfaction to
inform improvement in higher education institutions.
Response rates
•
Mid-term: ~59% for the lecture and 24% for the module (n = 41).
•
End-term: 9% (n =17)
Descriptive statistics: The module was rated as M = 7.04 (SD = 1.50)
(scale: 1- very bad to 10-very good). This was fed back to students during
the lecture in more detail by using a histogram.
Word Cloud
The current project
The option of “closing the loop” with regards to students’ feedback at midterm for one particular module is explored pursuing the following aims:
• Open a dialogue with students with regards to their feedback and how it
is translated into actions
• Implement those actions during the same term and with the students
that were involved in giving the feedback to ensure that action points
would be timely and applicable
It was further explored whether action points derived from mid-term
feedback would be reflected in end of module evaluations.
Method
Participants
End-term: N = 170 second year undergraduate psychology students
enrolled in a Psychology module at a post-92 University in the UK.
Mid-term: N ~ 70 students who attended the lecture in week 6.
Procedure
• Completion of mid-term feedback forms after the lecture (week 6).
• Feeding back of results and discussing action points (week 7).
• Module evaluation via Blackboard (week 13 ff.).
Materials
Mid-term – paper questionnaires
•
•
•
•
What do you like most about this module and/or the teaching of it?
What do you like least about the module and/or the teaching of it?
What suggestions can you offer that would make this course a better learning
experience?
How would you rate the module overall? (scale: 1- very bad to 10-very good)
A word cloud resulting
from mid-term feedback,
displaying words in
different sizes
corresponding to their
frequency, was
presented to students in
the lecture.
Frequencies of words in
a positive (green) or
negative (red) context
were displayed (see
Figure 1).
Thematic analysis and Mid-to-end-term change
• Four core themes were derived via a thematic analysis of free text from
student feedback. Themes were fed back to students in the lecture
including a discussion of derived action points (see Table 1).
• Figure 2 shows the derived themes and the proportion of positive and
negative quotes associated with each at mid- and end-term evaluation.
End-term – electronic questionnaires (institution wide)
•
•
What were the most positive aspects of this module? (list up to 3 below)
What improvements would you make to this module? (list up to 3 below)
Contact: anke.goerzig@uwl.ac.uk
Action points
The following action points were discussed with students (see Table1).
Table 1: Mid-term feedback themes and associated action points .
Theme
Teaching Style
& Staff rapport
Students comments
• Should be more interactive,
engaging
• Slower pace
• Noise levels of others too high
• Teaching is good, tutors are
approachable
Structure &
Content
• Too much information on slides
and in one lecture
• Content is interesting
• Lectures are well structured
Discussion / Action points
• Introducing more interactive
elements
• Lecturer’s and students’
engagement is required
• Effort to speak slower
• Called upon students to be
more considerate in terms of
noise levels
• Team will review / not put too
much information into one
single lecture
• More self-study required
Supportive
actions and
Materials
• More support for assignments
needed
• Material on Blackboard is very
good
• Pointed students to sources for
guidance
• Availability for appointments
• Upcoming support in seminars
Seminars
• More interaction and
assignment focus needed
• Well matched to the lecture
• Most seminars include
exercises especially tailored
towards the assignment
Figure 1: Word Cloud showing word frequencies of mid-term feedback
% positive and negative quotes
“Closing the loop”
• The feedback of views and action points resulting from student
feedback to students is referred to as “closing the loop” (Powney & Hall
1998) and regarded as an important element of practice (Harvey 2001).
• These practices often occur at the course or institutional level at the
end of term or after course completion.
• Collecting student views at the end of the term is making resulting
actions for the student cohort involved impossible (Cook-Sather 2009).
• Awareness of their feedback’s impact can increase student participation
in feedback surveys and course satisfaction (Watson 2003).
Results & Closing the Loop Actions
Themes derived from mid- and end-term feedback
Figure 2: Percentages of positive and negative quotes by theme and time of evaluation
Discussion
Conclusions
• Most elements improved from mid- to end-term.
• The exception was the increase in negative feedback for Supportive actions
& Materials due to students asking for more support with their assessments
– as action was taken this most likely points towards a difficult assessment.
Implications
• Engaging students by acting on mid-term feedback on a module level can
improve teaching and learning.
• Opening a dialogue with students improves student engagement and is an
important issue in terms of total quality management (Leckey & Neill 2001).
Limitations and Future Directions
• The low response rates question validity and representativeness of results.
• It is unknown whether the same or different students have completed midand end-term feedback forms; hence, a change in rating is possibly due to a
change in respondents.
• Encourage more students to participate by stressing the impact of feedback.
• Standardise and compare ratings across other modules.
References
Cook-Sather, A., 2009. From traditional accountability to shared responsibility: The benefits and challenges of student consultants
gathering midcourse feedback in college classrooms. Assessment & Evaluation in Higher Education, 34(2), pp.231–241.
Harvey, L., 2001. Student feedback: a report to the higher education funding council for England., Centre for Research into Quality: The
University of Central England in Birmingham.
Leckey, J. & Neill, N., 2001. Quantifying quality: the importance of student feedback. Quality in Higher Education, 7(1), pp.19–32.
Powney, J. & Hall, S., 1998. Closing the loop: the impact of student feedback on students’ subsequent learning., Edinburgh: Scottish
Council for Research in Education.
Watson, S. (2003). Closing the feedback loop: Ensuring effective action from student feedback. Tertiary Education and Management, 9(2),
145–157. doi:10.1080/13583883.2003.9967099
Download