Inclusive assessment in the scientific curricula

advertisement
INCLUSIVE ASSESSMENT IN THE
SCIENTIFIC CURRICULA
Dr Kimberley Bennett
Mr Sebastian Stevens
Who’s who?

Dr Kimberley Bennett (kimberley.bennett@plymouth.ac.uk)
 Lecturer/
Deputy program leader in Marine Biology
 Module lead ‘Biology and Physiology of Marine
Vertebrates’

Mr Sebastian Stevens (sebastian.stevens@plymouth.ac.uk)
 Associate
Lecturer
 Research Assistant
Introduction



Improving inclusivity through the use essays as
summative assessment
Testing the benefits of formative peer review in the
scientific curricula
Encouraging all students to engage with essay writing
support
What’s the problem with essays?

Some students at third year still struggle with:
 Introduction
(Start broad and narrow down)
 Constructing
 Providing
critical review
 Concluding
 Reading
arguments
effectively
widely to provide a balanced review
Why does the problem arise?



Students were getting no ‘feedforward’ (inc from peers )
Students want formative feedback across programme/
earlier in academic year
Essays may benefit a limited number of thinking styles
Inclusivity and thinking styles



People have different thinking styles (Sternberg 1994)
Traditional assessment and teaching methods benefit
particular thinking styles
Flexibility within an assessment and varying type of
support available should benefit more students by
involving a greater range of thinking styles
Essays benefit specific thinking styles
Requirements
Corralling information
Working alone
Organising tasks and logic of
argument
Synthesis and analysis
Seeing the big picture
Focussing on detail
Works well for students who are:
 Conservative
(prefer traditional
approaches)
 Internal (Like to work alone)
 Local (deal with details, specifics
and concrete examples)
 Global ( see generalities)
 Executive (like to be given
structure)
What can we do about it?

Maximise creativity, ownership and motivation
Give wide choice in titles
 Make titles flexible


Maximise creativity, ownership and motivation
Students must write an article for publication
 Mimic academic peer review process



Provide support to help students with structure
Provide support that targets wider range of thinking styles
Liberal (prefer new approaches)
 External (prefer interaction)
 Legislative (like to be creative)
 Judicial (like evaluation)

The Research

Teaching Fellowship Award (PedRIO)

Formative Peer Review

Writing Workshops

Questionnaire

Voluntary
What was the assessment?

Review article on a ‘group’ of their choice in one of up to
4 areas:
 cardiovascular
adaptation;
 conservation status;
 nutritional requirements and energy balance
 human impacts

Peer review

Sign up in term 1/ Hand in term 2
Writing Workshop


Discursive
Help with structure of essay writing using examples
and specific tips and tricks e.g.:
 Start
with why we care
 Use short sentences
 End introduction defining aims and scope

Peer review
 What
is the role of a peer reviewer?
 What ‘counts’ as helpful feedback
 How should you respond?
Participation in the study
Questionnaire only
All students in the study (N=36)
1
27
Peer Review only
3
5
Writing Workshop only
Both Peer Review and
Writing Workshop
Results: peer review was helpful
Of the students who took part in the peer review process:

85.7% received helpful suggestions to improve their essay

96.4% felt that they received fair comments on their work

92.1% felt that receiving peer feedback was helpful

92.8% felt that giving peer feedback was helpful

87.0% of students who took part in peer review saw
improvement between their submitted draft and the final
essay.
Results: the workshop was helpful
Of the students who took part in the writing workshop:




100% felt that they could now better structure their
essays
100% felt that they could now write a better
introduction
96.3% felt that they could now write a better
conclusion
96.3% felt that they could now evaluate and critique
literature more effectively.
Impact on Summative Results



Crude measure with many underlying factors
Correlation between attendance at one or more
support interventions and a rise in assignment grade
Strong influence of previous high achievers taking part
in the support interventions, with more lower achievers
disengaged.
So why didn’t some students participate?

Of the 74 students in the cohort, 27% did not participate
in any of the interventions
 7%
(N=5) of the non participators completed a questionnaire
and explained why they did not participate
 20%
(N=19) did not participate or tell us why
Qualitative Survey Responses: Identified
barriers to participation

Time management
 Early
 Too
hand in for peer review
many hand in’s at one time

Lack of confidence in providing feedback

Lack of confidence in feedback from a classmate
 Some
students felt that they only wanted feedback from a
professional
Solutions: overcoming barriers



Time management on the part of students

Earlier sign up and peer review deadline to give more time

Avoid deadlines from other modules
Lack of confidence in ability to provide feedback

Explain the value and importance of peer feedback and demonstrate satisfaction
scores for last year

Provide extra support in giving feedback: workshop with Learning Development
earlier in academic year
Lack of confidence in feedback from a classmate

Show improved final grades for those students that have had their draft essay
reviewed by a peer

Supporting students to give feedback that provides suggestions for improvement
Targeting the ‘unknowns’



Our interventions help students with external, judicial,
executive and legislative thinking styles
Students who are more internal and conservative may
dislike the approaches offered
Additional help is made available:
 List
of alternative sources ie. ‘writing café; learning
development one-to-one tutorials
Q
and A forum on Moodle
Conclusion
Students said that the workshop and peer review were
worthwhile and should be embedded earlier in their
programme
The interventions appear to positively impact on summative
results
Students receive formative feedback (feed forward) in line
with university policy and inclusivity agenda
How can we target students who don’t participate but don’t tell
us why? (make it compulsory; e-feedback?)
THANK YOU FOR LISTENING
The average difference in essay grade between taking
part in both peer review and the writing workshops
compared with taking part in nothing was 11.72%
Students who took part in
something had an average
grade of 64.75%
N
Average Essay
Percentage
(Std.dev)
Average Essay
Grade
Cohort Participators
54
64.75 (11.28)
B
Both Peer review and
Workshop
39
65.97 (11.86)
B
Workshop Only
10
63.40 (10.46)
B-
Peer Review Only
5
58.2 (6.02)
C+
Cohort NonParticipators
20
54.25 (12.79)
C
Total
74
61.88 (12.55)
B-
Students who took part in
nothing had an average
grade of 54.25%
Download