Four ideas to support the development of assessment strategies

advertisement
Four ideas to support the development of assessment strategies
1. Reversed alignment
Why is alignment important?
‘The alignment of assessment with other features of a course is the basis of course design and
central to effective assessment. The model shown in Figure 1 summarises the relationships. If the
aims are unclear then the system crumbles. Clear and realistic outcomes provide students with a
good guide to what has to be learnt and lecturers with a guide on how to teach and what learning
opportunities to provide. Relevant learning opportunities help students to achieve the learning
outcomes. Effective assessment methods and tasks are related to the learning outcomes and the
methods of learning. If the criteria are too fuzzy or unduly specific then it is difficult for assessors to
ensure consistency of judgement and for students to fulfil the demands of the assessment task.
Without close links between feedback, criteria and the assessment tasks, lecturers cannot help
students to achieve the learning outcomes of a course or a programme’.
Brown 2001
Aligning Assessment
Aims
Intended Learning Outcomes
Methods of Learning
Assessment methods and tasks
Criteria
Marking
Feedback
What is reversed alignment?
Given that assessment is such an important driver of student activity and learning, the suggestion
is that we start by defining the aims and then move straight to identifying the assessment strategy
and/or the particular type(s) of assignment(s) which will be used the module. The details about the
methods of learning and even the fine detail about the intended learning outcomes can follow.
Realistically the whole process is much more iterative. Ideas about assessment will be
interspersed with thoughts about learning activities, an emerging syllabus and intended learning
outcomes. However, by bringing assessment to the forefront in this process it is more likely that
valid and varied assessment experiences will result.
Source: Brown G (2001) Assessment: a guide for lecturers. York: LTSN /HEA
2. Involving students
Research undertaken at Oxford Brookes (Rust et.al.,2003) shows that if students are highly
engaged in the whole assessment process
• their experience of assessment (as they report it in evaluation surveys including the NSS)
improves
• they are more likely to achieve good results
Active student engagement
4.The ‘Cultivated’ Community of Practice
Approach
3.The Social Constructivist Approach
Actively engagement of students in
formal processes devised to
communicate tacit knowledge of
standards.
The Future
2. The ‘DominantLogic’ ExplicitModel
Standards explicitly articulated (with
limitations) and passively presented
to students.
The Past
Tacit standards communicated through
participation in informal knowledge
exchange networks ‘seeded’ by specific
activities.
1.The Traditional Model
Tacit standards absorbed over
relatively longer times
informally and serendipitously.
Passive student engagement
Who does what in your assignments? Normally the students do the assessment task and the tutor
does everything else. Using self and peer assessment this can change:
Who decides? Tutor
Tutor and students
Individual
Groups of students
in negotiation
students
What?
Designs the assessment scheme
Sets the assignment
Sets the Assessment criteria
Introduces the Assessment task
Support for Assessment process
Marks and grades work
Gives feedback
Moderates
Attends assessment panel
Source: Rust,C., Price,M. and O’Donovan, B. (2003) Improving students’ learning by developing
their understanding of assessment criteria and processes. Assessment and Evaluation in Higher
Education Vol 28, No.2 147-164
3. Efficiency vs effectiveness
Can assessment be both efficient and effective?
In deciding which assignments to use Hornby (2003) argues that we need to find those which are
resource efficient (they can be managed by staff without taking up excessive amounts of time) and
effective (they meet the needs of the programme and are valid measures of student attainment;
they should also provide opportunities for learning and for giving feedback)
Through the work of the Scottish Higher Education Enhancement Committee (Hornby 2003)
several types of assignment where shown to be effective and efficient (see diagram).
There are clearly disciplinary differences in the approaches to assessment which are seen to be
appropriate, efficient and effective. However, the Scottish enhancement project identifies five which
are widely used:
1.
2.
3.
4.
5.
6.
Strategic Reduction of Summative Assessment
Front-end loading
In Class Assessment
Self and Peer assessment
Group Assessment
Automated assessment
Source: Hornby, Win (2003) Dogs, Stars, Rolls Royces and Old Double Decker Buses: Efficiency
and effectiveness in assessment accessed online at
http://www.enhancementthemes.ac.uk/documents/events/20040113/Hornbypaperrevised.doc
4. Rationalising assessment
Students interviewed at a recent Higher Education Academy conference asked for better planning
of the spread of their assignments and suggested that:
• module leaders should have a system for seeing where others are planning to place
assessments to avoid assessment deadline ‘hot spots’;
• online assessment calendars should be made available to students within their VLE on
which they can see the spread of assignments for their chosen modules
A more radical approach to rationalizing involves using programmatic (whole programme) or
level (based on each year) assessment. Brown (2001) develops this idea:
‘The outcomes based approach to assessment design (see 1. Reverse alignment) leaves open the
questions of whether the outcomes that are being assessed should be those of the degree
programme or those of the module (or short course) and whether every learning outcome should
be assessed. There are arguments for and against the use of programme or module outcomes as
the basis for assessment tasks. If one opts for assessing every outcome of every module then one
runs the risk of over-assessing students – and UK students are probably the most overassessed
students in Europe. If one opts for programme outcomes one risks not assessing essential
knowledge and skills but one has a framework for estimating student progression and
achievement.
On balance, the better strategy is to ensure that within each module, teaching and learning
opportunities are provided which move the students closer to the programme outcomes and that
some programme outcomes are assessed in some of the modules so that by the end of the
programme all the outcomes have been assessed at each level on at least two occasions. This
approach ensures that one has repeated and therefore probably more reliable measures of
achievement, and a realistic, not unduly burdensome approach to assessment. A matrix of the
learning outcomes of a programme and the assessments used in different modules helps one to
identify the links between programme outcomes and their assessment’.
Designing the matrix as part of an assessment strategy…..
Learning outcome
(from a programme)
Module(s) it is
assessed in
Type of assessment
(exam/coursework)
Brief details of
assignment
Source: Brown G (2001) Assessment: a guide for lecturers. York: LTSN /HEA
Download