Video as a Tool for Self-assessment

advertisement
VIDEO AS A TOOL FOR SELF-ASSESSMENT OF
UNDERGRADUATE ORAL PRESENTATIONS
FINAL REPORT
Dr David J McGarvey and Dr Paul C Yates, School of Chemistry and Physics
INTRODUCTION
Keele’s Learning and Teaching Strategy (May 2000) places great emphasis (Section
3.6, key objectives in learning and teaching) on the development of key transferable
skills in undergraduate teaching. Specifically (Section 3.4), the strategy expresses
within the educational aims…’a capacity for self-reflection, self-assessment and self
criticism’ and ’…the ability to communicate effectively, both orally and in writing’.
This project addresses the development of oral presentation skills through the use of
video as a vehicle for critical reflection and self-assessment.
Undergraduate oral presentations form a vital component of the Principal courses in
Chemistry and Biological & Medicinal Chemistry at Keele. All undergraduates are
requested to give one oral presentation per year at levels I, II & III. Detailed written
guidelines are provided and, at level I, an introductory presentation by an academic
member of staff is given as part of the study skills programme. The assessment of
the oral presentation at levels I and II contributes 5% of the mark for the laboratory
component of the module in which the presentation is given. In addition, there is an
element of peer assessment of the presentations at levels I & II. Both staff and
students use an assessment pro-forma (see Appendix 1) with explicit assessment
criteria. Oral presentation sessions at levels I & II are preceded by an introductory
session and concluded by a general feedback session hosted by the Academic Staff
member in charge (usually the Module Leader). Detailed individual feedback is
provided on the oral presentation assessment form at levels I & II, a copy of which is
stored with the student’s records. As part of our continual development of such
activities, from September 2000 undergraduates will have the opportunity to deliver
an oral presentation using an LCD projector and PowerPoint.
In summary, the key features of the management of oral presentations in chemistry
are:
 Structured peer assessment
 Group and individual feedback
 Opportunities for delivering an oral presentation through the use of an LCD
projector and PowerPoint software (from September 2000).
PROJECT DESCRIPTION
AIMS
 To encourage students to be self-critical through self-assessment of their oral
presentations on video.
 To improve the quality of feedback provided to students.
OBJECTIVE
 To improve student performance in delivering effective oral presentations.
IMPLEMENTATION
 The project was implemented during 2001-2002.
 1st and 2nd year students were asked to carry out a self-assessment after
viewing the video (see Appendix 2).
 The use of video was evaluated through an evaluation questionnaire (see
Appendix 3).
SELF-ASSESSMENT AND EVALUATION
 Self-assessment was done on an individual basis.
 Eight students participated in the evaluation exercise (see Appendix 3 for a
summary).
 Evaluation was based on an indication of the extent of agreement/disagreement
(1-5) with positive statements about the use of video.
 The evaluation feedback indicates that most students found the video tool useful
and some students identified specific aspects of their presentation that could be
improved.
 Practical considerations such as the choice of room (background noise), lighting
and camera angle etc. are important for the exercise to be beneficial to students.
 Time demands are modest, but careful organisation is required and technical
support is recommended.
 The equipment costs are modest and could be shared between Departments or
within a Faculty.
 On balance, our conclusion is that video as a tool for self-assessment of
undergraduate oral presentations is beneficial to students.
 The use of video is established in the undergraduate chemistry and BMC
courses and all student oral presentations are now recorded as a matter of
routine.
 Students have a free choice as to whether they view their presentation and take
up of this opportunity is ~30-40%.
FINANCIAL STATEMENT
Item
Video camera
Tripod
Camera tapes and
Blank VHS tapes
Technical Support
Total
Budget requested
£300
£50
£100
Actual spend
£499
£116
£165
£615
£615
ACKNOWLEDGEMENTS
This Innovation Project is part funded by the Higher Education Funding Council for
England & Wales (HEFCE) via the Learning and Teaching Committee of Keele
University. The authors thank Dave Olivant and Sue Love for technical assistance,
and also 1st and 2nd year Chemistry/BMC undergraduates for their participation and
valuable feedback.
Appendix 1
SCHOOL OF CHEMISTRY & PHYSICS
ORAL PRESENTATION PEER ASSESSMENT FORM
Name of Speaker:
Name of Assessor(s):
Module: Chem-
Experiment:
Date:
CRITERIA
Quality of visual aids
General organisation &
structure of talk
Clarity of explanation
Presentation style
Response to questions
Time-keeping
COMMENTS:
FINAL MARK:
%
GRADE (A-E)
Appendix 2. Examples of Self Assessment Comments
The comments below are taken from the COMMENTS box of the completed
proforma given in Appendix 1.
 “I went a little too fast. I had a good idea and I really kept it entertaining, but I
don’t think any information got through”.
 “Came across in the presentation that I was nervous. Though I did get better
throughout the speech. In future oral presentations, I need to maintain eye
contact with the audience more often”.
 “I tried to keep things simple which I thought was good as the majority of
people can understand more easily. I probably made things too simple though
and as a result didn’t have the information available to answer the questions”.
 “I sometimes mumbled over points when I had difficulty explaining my point.
Waffled a bit in making an attempt to answer the questions”.
 “Visual aids were good but I think I looked at the screen too much. More eye
contact with the class was needed to get feedback if they understood. Could
have done with more detail and added some results”.
 “Weaknesses: Spoke a little too quickly at first. Paused a few times. Strengths:
Fairly organised; all acetates were in order”.
 “It would have been better if I had notes and had practiced more because I
forgot most of what I was going to say. OHPs done on the computer would
have been clearer”.
 “Clearly explained all points but there needs to be more eye contact and
louder speech. There was too much hesitation and some overheads were
quite faint. Possibly need to practice the talk a bit more and read around the
area which the talk deals with”.
Appendix 3. Evaluation Questionnaire Summary
SCHOOL OF CHEMISTRY & PHYSICS
VIDEO AS A TOOL FOR SELF-ASSESSMENT OF
UNDERGRADUATE ORAL PRESENTATIONS
EVALUATION FORM
Name:
Module: Chem-
Title of My Talk:
Date:
Statement
AGREE/ DISAGREE (Scale 1-5)
The video recording was of good quality.
2.5
Watching the video of my presentation
only served to confirm my previous
assessment of how I thought I had
preformed.
2.8
Having watched the video recording I
have noted particular aspects of my
presentation that I will try to improve
upon in future (if applicable, please
summarise what these are).
2.6
Having viewed the video recording of my
presentation I feel will be more confident
about giving presentations in the future.
2.6
I would recommend self-assessment of
oral presentations via video to other
students.
2.3
Viewing the video recording of my
presentation has been useful to me.
2.4
COMMENTS (these can be quite general or specific, including suggestions for
improvements we could make to the whole process and/or any comments you have
on the overall assessment of your presentation and this evaluation form).
Summary of comments made in the COMMENTS box:
 “Possibly give those who are doing the talk first a bit more notice to prepare
and give them a bit more advice than that given”.
 “Good idea to have peer input but it may have been more useful to have a
breakdown showing lecturer marks as well”.
 “The camera view from the side of the room was not suitable for viewing what
I did on the blackboard”.
 “A very good idea and I can do better”.
Acknowledgements: This Innovation Project is part funded by the Higher Education
Funding Council for England & Wales (HEFCE) via the Learning and Teaching
Committee of Keele University.
Download