A Model for assessment of prior learning

advertisement
A MODEL FOR ASSESSMENT OF PRIOR LEARNING
R L PETERSON
Manukau Institute of Technology
Abstract
A Centre for Assessment of Prior Learning has been established at Manukau Institute of
Technology. The institute is located in South Auckland, a region with the largest population
of Polynesian and Maori people in New Zealand.
Mostly industrial, South Auckland is a melting pot for new New Zealanders, many of whom
come to NZ with diverse skills but lack a New Zealand qualification to assist them to gain
entry to the workforce, and to get points for immigration purposes. Motivated by pressure
from candidates needing RPL quickly, the writer began to consider alternatives to lengthy
portfolio assessments. Obstacles to progress include assessor suspicion and the theoretical
aspects of most New Zealand qualifications. Collaboration with colleagues in other technical
institutes led to observation of a group of four boat-builders making a joint 1-hour
presentation to meet the criteria for three separate 1-year courses within a Diploma. The
courses were Health, Safety and Professional Ethics; Critical Thinking and Problem Solving;
Communication and Customer Service. Development of assessor workshops was considered
key to the advancement of assessment practices for CAPL, along with co-operation from
guinea pig clients.
A MODEL FOR ASSESSMENT OF PRIOR LEARNING
R L PETERSON
Manukau Institute of Technology
Introduction
Towards the end of 2001, Manukau Institute of Technology began the process to set up a
centre, which would be dedicated to the assessment of prior learning (APL). The centre would
be one of five throughout New Zealand. Although described by the business community as
long overdue, there has been an impression that teaching staff generally have little
appreciation and even less understanding of the practice of awarding credit for learning other
than learning that takes place in a classroom or workshop.
In line with the New Zealand Government’s priorities for tertiary education as outlined in the
Tertiary Education Strategy (See Extract Appendix I), NZQA has recently announced a new
policy for credit recognition and transfer. The document contains the policy, principles,
objectives, outcomes, strategies and a timeline for implementation. The policy strengthens
the requirement for tertiary institutions to ensure that when qualifications, courses and
programmes are developed they actively promote and facilitate credit recognition and
transfer. It emphasises benefits to learners and requires providers to include credit
recognition as one of the pathways to learning that may be taken following the award of some
qualifications.
In establishing the Centre for Assessment of Prior Learning at MIT, the author has been
concerned that experiential learning, which has developed in a real-life holistic fashion, is
reduced to what is in effect a multitude of written assignments. Conversations about
integrated assessment have been around for some time. Nevertheless, when you look at
assessments set for most courses in tertiary institutions you see instruments that assess
knowledge and skills in a piecemeal fashion. It occurs to us that the facilitation of
assessments for recognition of prior learning provides an opportunity to enhance practices
surrounding assessment in a tertiary institution like MIT - this paper describes the progress to
date.
History of CAPLNZ
In 1990 the Education Amendment Act gave NZQA responsibility for developing a national
framework that is flexible enough to allow people of all ages, backgrounds, perspectives and
histories to gain formal recognition for competency already achieved.
The first reports on Recognition of Prior Learning were published by NZQA and the National
Centre for Education Research in 1990.
In 1991 NZQA affirmed its support for the formal recognition of prior learning, but it was to
be two more years before its policy on RPL was approved.
Since then a number of overseas experts on RPL have run workshops in New Zealand, and in
1993 a national conference on RPL took place in Wellington. The practice of recognising
1
prior learning has evolved slowly since then, although many tertiary education programmes of
study include a statement about RPL and most providers have policies and procedures that
include provision for RPL. Some organizations have specialist staff working as RPL
facilitators with students.
In 1999 Otago Polytechnic took up the challenge to offer a centre that would facilitate the 8step process for RPL that is now the hallmark of the Centre for Assessment of Prior Learning
operating at five New Zealand polytechnics. The unique feature of the CAPL service is that it
is designed to provide the service to a new target group, those who may not otherwise have
chosen to participate in formal education.
The CEO of Otago Polytechnic visited NZQA in 2000 and a Memorandum of Understanding
was drawn up for CAPL and NZQA to co-operate to achieve the common objective of
increasing opportunities for RPL.
In September 2001 the CAPL Manager at Otago Polytechnic came to MIT to discuss the
possibility of MIT working with other TANZ partners on Otago’s model for APL and in 2002
a Centre for Assessment of Prior Learning was established at MIT with a full-time manager
and part-time administrator.
The TANZ arrangement has the potential to project the CAPL service through all of its
partners – Otago Polytechnic, Christchurch Polytechnic Institute of Technology, the Universal
College of Learning, Manukau Institute of Technology and The Open Polytechnic of New
Zealand. The partnership gives excellent geographical coverage for clients, together with a
range of qualifications and a sizeable pool of assessors.
It must be made clear that the scope of CAPL services is not all embracing, and is limited to
NZQA qualifications registered on the National Qualifications Framework, other national
qualifications such as the NZ Diploma in Business, along with TANZ provider qualifications.
Despite growing enthusiasm and support for RPL, there is still a great deal of resistance to be
overcome. There is fear by some academic staff and by some clients that standards may be
compromised. The tendency to undervalue what people can learn from previous life and
work experiences is still strong, with some educators and institutions remaining sceptical of
knowledge or skills they have not taught, particularly if that learning has occurred outside an
academic setting. It has been crucial, therefore, that the people given the mandate to establish
CAPL New Zealand have the backgrounds to give credibility to the new centres.
The original Manager of CAPLNZ came from a background in hospitality. Since 1998 he
focused on training and recruitment, setting up Job Shop at Otago Polytechnic to offer
training programmes and assessment of prior learning to the hospitality sector. He was a
member of the government ministerial working party on RPL in early childhood education
and a Regional Moderator with the Hospitality Standards Institute.
At Manukau Institute of Technology, the brief to set up a Centre for Assessment of Prior
Learning was given to a staff member from the Centre for Educational Development, whose
background had been strongly linked to assessment, having been contracted by NZQA since
1994 as a marker, examiner, writer and moderator. Since coming to MIT she had been
involved in training workplace assessors and in other industry training. Her role in the CED
had largely been in the area of assessment and moderation. Her research interests lie with the
2
motivations of independent learners – a field which fits comfortably with the experiential
learning that CAPL is designed to recognise.
The Model Used
CAPL has been founded on the philosophical premise that learning takes place every day, at
home, at work and in the community. Assessment ought to be about standards of performance
achieved, not about how learning occurred, thus any prior learning ought to be potentially
capable of being awarded credit.
Several acronyms are used to describe prior learning assessment: RPL (recognition of prior
learning), APL (assessment of prior learning) and RCC (recognition of current competence).
Whatever is preferred, the following definitions are useful:
Recognition of Prior Learning (RPL) is the acknowledgement of skills and
knowledge already acquired by a person from work and/or life experience or
from previous study. This prior learning may include:

courses provided by professional bodies, voluntary associations, enterprises,
private educational institutions, trade unions, government agencies and/or
other providers recognised by the university.
 work or other forms of practical experience; and
 life experience.
(Victoria University, Melbourne)
RPL is a form of assessment used to determine whether a person has achieved,
through informal and formal learning and experience, the required competence
for entry and/or credit in a recognised course or training program (Rumsey,
1994:15).
It is important to note that RPL/APL/RCC is not about awarding credit for experience, the
number of years a person has been in a job, workshops attended, level of position, patience or
effort. RPL/APL/RCC is solely about awarding credit for learning related to qualifications.
The major barriers to a successful RPL/ACC/RCC application are the economic fears of
traditional academics, concerns about quality assurance, student resistance to rigorous
procedures, cost and insufficient facilitation and administration support. In December 2002
the New Zealand Qualifications Authority Supporting Learning Pathways: Credit
Recognition and Transfer Policy declared “credit recognition and credit transfer are the litmus
test of confidence in quality assurance arrangements for education”.
The key principle on which CAPL is founded is that if applicants can satisfactorily
demonstrate that they already have the specific knowledge and skills required by the
unit/module/course then credit should be awarded. A candidate must be able to



apply related theories and concepts
analyse data, theories and concepts where applicable
demonstrate conciseness, and precision in transmitting the required evidence
3
The processing of RPL/APL/RCC involves an examination of the claim by a candidate to
possess the outcomes that are expected from a course. It is the task of the candidate to
document or otherwise demonstrate these outcomes to the satisfaction of the institution. It
remains the candidate’s responsibility to present a convincing case to justify each claim.
Candidates need to understand and recognise the knowledge and skills they have. They also
need to be able to:




demonstrate the depth and range of appropriate skills and knowledge
verify their skills and knowledge
identify any weaknesses
demonstrate analytical abilities
Of interest in this paper is the method used to enable the candidate to achieve this. Portfolios
have been a large part of the business of CAPL to date. Workshops have been held to assist
clients to construct appropriate portfolios for assessment. In the portfolio workshop
candidates are taught how to match their learning with the learning outcome provided for each
course. Following the evidence guide provided, the portfolio is organised and crossreferenced. Candidates must explain how individual pieces of evidence relate to learning
outcomes.
The average candidate submits portfolios at the rate of approximately one per month. A
person claiming to have learning equal to a national diploma can spend up to a year
submitting portfolios for assessment. Throughout this period, the CAPL facilitator works
closely with the applicant motivating, guiding and checking before the completed document is
submitted for assessment. It is a very time-intensive process and clients have rightly observed
that it is like completing a succession of major assignments. Frequently documentary
evidence is not available for a range of reasons and the clients end up treating the exercise like
a written project where a fictitious scenario is devised and documents created to prove their
learning.
A different model explored
Andrew Gonczi (2003) has identified the major conceptual problems in competency-based
assessment. He maintains that the idea of competence is based on two views of learning. The
first is the behaviourist view which looks at the individual tasks a person can carry out. The
second assumes that generic skills can be transferred to various tasks. Gonczi’s model
incorporates both of these - he calls it the ‘relational concept’, based on situated learning. In
this view competencies should not be separated from other things because outcomes only
make sense within a context. He proposes a holistic assessment system based on
a) assessment of performance as opposed to abstract tests of knowledge
b) multiple sources of evidence obtained through multiple assessments in multiple
contexts
c) recognition that judgements of evidence are only judgements
d) recognition that judgements need to be based on standard tests.
A case study
Bob first appeared a year ago when CAPL was launched at MIT. He believed his experience
in business was sufficient to equal learning he would gain from enrolling in a business course.
Under normal circumstances, Bob would be expected to acquaint himself with a unit standard
4
from the compulsory and elective units in a qualification and gather suitable evidence. He
would then assemble a portfolio, including a description showing how he had gained skills
and applied theories. Documents to prove each aspect would be included. The portfolio
would be submitted for assessment, the assessor would ‘turn it around’ within two weeks and
the result would be given to Bob – either congratulating him (unofficially) on his competence,
or requesting further evidence, in which case there would be a resubmission in several weeks,
followed by further feedback.
This could represent up to 10 credits towards a 120-credit diploma. The exercise may have
taken 2-3 months. Each further claim by Bob would extend the process by a similar
timeframe.
Integration
In assessing prior learning the evidence will perhaps describe whole tasks and achievements that
encompass outcomes from several units/modules/courses.
Integration provides an opportunity to reduce assessment time and make assessment activities
complement and reinforce learning. Assessment Guidelines for the drilling industry in
Australia
include
this
statement:
…. it is the intention that the ability to perform the unit of competency as a whole
be the key criterion in any assessment process.
Careful planning can minimise the number of assessment occasions and provide for a more
holistic approach. NZQA’s guide to learning and assessment recommends:
To develop an integrated assessment activity one needs to identify what the
course or unit requires of the learner, devise an activity that requires a complete
performance, go back to the unit and check off the learning outcomes and
criteria, and if necessary expand the activity to cover more. Better still;
consider whether more than one course can be combined in assessment (NZQA,
2001).
Two CAPL pilots are underway to investigate ways that integrated assessments could work to
speed up yet retain the rigour of the process. In the first, a straightforward NQF unit is
selected and the traditional method of portfolio assessment is used to establish confidence by
the assessor in the candidate. For subsequent units a series of meetings is held with the client
where the client tells their ‘story’ and identifies key areas of knowledge gained from their
work. They link this knowledge with the learning outcomes of the selected unit standard. The
CAPL facilitator talks with them to ensure they are comfortable about what they will include
in a presentation.
Meeting with the assessor, the CAPL facilitator then discusses the objective of the unit and
keeps the assessor in the picture about what has been planned with the client.
The client prepares some overheads and talks with the assessor about their work – fully aware
that they must meet the learning outcomes of the particular unit/module/course.
5
In the second, a similar process is followed. Key areas of knowledge and skill are identified
and matched to the components of a qualification during an initial interview. In this pilot
study however, the integration is based on several units/modules/courses.
A discussion between facilitator and client clarifies the unique features of both portfolio
assessment and an integrated model where perhaps two or three assessors from different
subject areas will be present at a presentation. Briefing includes explaining criteria from
assessors and the client considering how they might meet the criteria, for example:

Verbal presentation to assessors and possibly an audience, using
OHT/Video/PowerPoint to demonstrate presentation/communication skills;

Handout prepared to demonstrate written communication skills and to cover
content unsuited to the presentation, or to check the quality of academic writing
and use of references, ability to develop a coherent argument and to confirm
critical evaluation of ideas;

Interaction with audience to demonstrate skills in training or communication areas;

Activity to demonstrate further training skills;

Content prepared and points covered to demonstrate prior learning in relevant
areas;

A debate could be used to demonstrate adequate knowledge of the subject in
sustaining a considered argument;

Interactive questioning to draw out and relate applicants skills.
A meeting may be held with the assessor/s and client to clarify issues raised or to review the
scope and depth of learning. This may be particularly useful where values are important.
Quality Assurance Mechanisms
Accredited providers are required to establish and use quality assurance mechanisms. MIT’s
Quality Management System includes the following:





Programme Committees have the task of monitoring assessments
Assessment procedures of courses/programmes are scrutinised by the Programme
Committee and the Academic Standards Committee
Appropriate staff training is undertaken on assessment and moderation
New or revised assessments are moderated and adjustments made where appropriate
Appropriate external moderation and accreditation requirements are met
One of the unexpected outcomes of the establishment of the Centre for Assessment of Prior
Learning has been the heightened awareness of the range of assessment practices throughout
the Institute, some attached to the performance criteria checklist, others believing, with
Gonczi, that outcomes only make sense within a context. Working closely with staff in the
Centre for Educational Development enables workshops to be planned especially for
assessors who are working with CAPL. These workshops will enhance assessors’
6
understanding of APL and develop best practice guidelines in assessment, which will be
distributed throughout the Institute.
Conclusion
In establishing dedicated Centres for Assessment of Prior Learning a new client group is
being targeted which may not have enrolled otherwise. Assessments using portfolios have
raised awareness that a checklist approach may not be the most effective.
An integrated approach, which considers the kinds of tasks that need to be performed in a
workplace and the knowledge required to perform those tasks, could improve the efficiency
and affordability of assessment by reducing time involved in providing evidence and by
combining the competencies of several courses.
Trialling integrated assessments will require a paradigm shift for a number of staff and
training will be necessary to increase understanding of APL as well as an holistic approach to
assessment.
Getting buy-in to the philosophy of APL from academic staff is at times difficult but provides
an opportunity for enhancing assessment practices. Working collaboratively with other staff
in a developmental way will lead to establishment of best practice assessment guidelines.
7
References
Australian Drilling Industry Training Committee, (2002). Assessment Guidelines for the
drilling industry. Sydney: Australian National Training Authority.
Campus Review, March 6-12, 2002, p7 Reshaping the learning curve for the future.
Gonczi, A. (1997). Competency-based Assessment: Can We Assess What We Don’t
Understand? News from the Forum, Vol 4 No 3, September 1997. Retrieved 18 June 2003:
http://www.nceltr.mq.edu.au/FORUM/sep97.htm
Gonczi, A. (ed.) (1992). Developing a competent workforce: adult learning strategies for
vocational education and training. Adelaide: TAFE National Centre for Research and
Development.
Gonczi, A. (1993). An integrated approach to professional education and assessment: a
consideration of arguments for and against. Sydney: University of Technology Sydney.
NZ Qualifications Authority (2001). Learning and Assessment: a guide to Assessment for the
National Qualifications Framework. Wellington: NZQA
NZ Qualifications Authority (2002). Supporting Learning Pathways: Credit Recognition and
Transfer Policy. Wellington: NZQA.
Manukau Institute of Technology (2002). Quality Management System 5th Edition.
Meldrum, R. & Richardson, L. (2001). In Sickness and in Health: Learning and Assessment
Inside and Outside the New Zealand Qualifications Framework. Paper presented at the
International Vocational Education & Training Association (IVETA) Annual Conference
2001, Montego Bay, Jamaica, 2001.
Ministry of Education (2003). Education Priorities for New Zealand. Retrieved 30 May 2003
from:
http://www.beehive.govt.nz/mallard/education/index.html
Rumsey, David (1993). Practical issues in workplace assessment in National Assessment
Research Forum: A forum for research into competency-based assessment (VEETAC
Competency Based Training Working party Assessment Steering Group), NSW TAFE
Commission, Sydney.
Rumsey, David (1994). Assessment practical guide. Australian Government Publishing
Service.
Toop, L, Gibb, J and Worsnop, P. Assessment system designs. Australian Government
Publishing Service, Canberra.
Wilson, P. (1993). Integrating workplace and training system assessments. Testing Times
Conference, NCVER, Sydney.
8
Appendix I
Extract from Tertiary Education Policy Directions for 21st Century
1.3 THE WAY FORWARD FOR THE TERTIARY SECTOR
The Green Paper identified four objectives for the
tertiary sector:




expanding opportunities for participation for all;
improving the participation and achievement of
currently under-represented groups;
creating incentives to improve the quality of
qualifications, research, and teaching;
encouraging value for both the students’ and
taxpayers’ financial contribution.
From:
TERTIARY EDUCATION IN NEW ZEALAND
Policy Directions for the 21st Century
White Paper
Published on behalf of the Government of New Zealand
by the Ministry of Education
Download