Best Practices in Adult Learning

advertisement
Prior Learning Assessment
CAEL
Prior Learning Assessment
“PLA 101”
CAEL
Prior Learning Assessment
What is Prior Learning Assessment, or
‘PLA’?
 The evaluation for college credit of the
knowledge and skills one gains from life
experiences (or from non-college
instructional programs) including
employment, parenting, travel, hobbies,
and volunteer service.
CAEL
Prior Learning Assessment
Four Approaches to PLA:
 Nationally standardized exams in
specified disciplines
 ‘Challenge’ exams for local courses
 Evaluated non-college programs
 Individualized assessments
CAEL
Prior Learning Assessment
Types of Standardized Exams:
 AP Exams
 CLEP Tests
 Excelsior College Exams
 DANTES Subject Standardized
Tests (DSST)
CAEL
Prior Learning Assessment
More on Advanced Placement (AP)
Exams:
 34 Exams in 19 subject areas
 Common for high school students
 Run by the College Board
 74% within CAEL survey use them
CAEL
Prior Learning Assessment
More on College Level Examination
Program (CLEP) Tests:
 34 tests of “101”-level material
 3 to 12 credits for each exam taken
 5 million users since 1967
 79% within CAEL survey use them
CAEL
Prior Learning Assessment
More on Excelsior College Exams
(aka Regents College; ACT/PEP)
 Proficiency-based exams
 About 40 exams in many areas
 Excelsior College (New York)
 31% within CAEL survey use them
CAEL
Prior Learning Assessment
More on DANTES Subject Standardized
Tests (DSST):
 Developed for the military, available to
civilians
 Nearly 40 exams in many areas
 Run by Chauncey Group Int’l of ETS
 53% within CAEL survey use them
CAEL
Prior Learning Assessment
“Challenge” exams of local courses:
 At institutional discretion, using
locally-developed tests/exams
 May be final exams of courses
 63% within CAEL survey use them
CAEL
Prior Learning Assessment
Evaluated non-college programs of
instruction (externally evaluated):
 American Council on Education
“National Guides” with credit
recommendations
 Hundreds of organizations and
programs, military & civilian
 68% with CAEL survey use military
guides, 34% use civilian guides
CAEL
Prior Learning Assessment
Individualized assessments (of
students and of programs):
 Portfolio process – 48% within
CAEL survey use this approach
 College-based assessments of
external certifications – 17% within
CAEL survey use this approach
CAEL
Prior Learning Assessment
Data source:
 Prior Learning Assessment: A
Guidebook to American
Institutional Practices (1999)
published by CAEL.
CAEL
Prior Learning Assessment
CAEL’s early history in PLA:
 1977 – CAEL Validation Report
 1977 – Principles of Good Practice
 1979 – ACE, COPA, & AACRAO
endorse PLA & CAEL Principles
 1979 – 1st CAEL Survey of PLA
Practices
CAEL
Prior Learning Assessment
CAEL today:
 Has 700+ members
 Consults with employers and
colleges about PLA and “adultfriendly” other service features
 Also manages tuition
reimbursement programs for a
workforce of 500,000 for clients
CAEL
Prior Learning Assessment
Why Portfolio PLA? 3 MYTHS –
 PLA depresses enrollment.
 Tests are rigorous but portfolio
PLA is not.
 Only ‘weak’ or ‘lazy’ students
want PLA.
CAEL
Prior Learning Assessment
Why PLA? Enrollment effects:
 PLA students often enroll for
more (not fewer) courses vs.
those with no PLA credits.
 2001 Simpson College study:
75% retention with PLA vs.
38% for those without PLA.
CAEL
Prior Learning Assessment
Why PLA? Portfolio effects:
 Portfolio PLA students show
better complex problemsolving skills (vs. classroom)
 2002 University of Connecticut
study in the Journal of
Continuing Higher Education
CAEL
Prior Learning Assessment
Why PLA? PLA & Performance:
 Portfolio PLA students tend to
show higher cumulative GPAs
 Studies in 1992 @ UMUC, and
in 2003 among 1600 students in
4 Illinois public universities.
CAEL
Prior Learning Assessment
Why PLA? As a choice factor:
 2000 College Board study of
1500 adults who rated ‘credit
for prior learning policy’ as
more important than ‘small
class size’ or ‘availability of
financial aid’.
CAEL
Prior Learning Assessment
Higher Learning Commission
Recommends “assessment of prior
learning using principles
advocated by such organizations as
the Council for Adult and
Experiential Learning (CAEL)…”
 Source: Adult Degree Completion
Programs, June 22, 2000

CAEL
Prior Learning Assessment
PLA Endorsed:

See “Evaluation of Extra-Institutional
and Experiential Learning for
Purposes of Transfer and Award of
Credit,” in the joint statement of
American Association of Collegiate
Registrars and Admissions Officers,
American Council on Education, & the
Council for Higher Education
Accreditation, Sept. 28, 2001
CAEL
Prior Learning Assessment
PLA Policy Considerations:
Federal level – PLA not aid-eligible
 State level – Some states regulate PLA
as an activity, setting ‘caps’
 Institutional level – ‘Faculty Senate’
program approval may be required
 Department level – Academic
disciplines vary in attitude toward PLA

CAEL
Prior Learning Assessment
Activity: Discussion
 Read
the ‘Sally S’ Scenario.
What questions about PLA
does this scenario raise for
you and your colleagues?
CAEL
Prior Learning Assessment
How Do Adults Learn?
 The (David) Kolb Model of
Experiential Learning

Source: Experiential Learning:
Experience as the Source of Learning &
Development, Prentice-Hall, 1984
CAEL
Prior Learning Assessment
The Kolb Model: 4 Dimensions:
 Concrete Experience
 Reflective Observation
 Abstract Conceptualization
 Active Experimentation
CAEL
Prior Learning Assessment
Kolb & ‘Learning Style’:
 Concrete Experience:

Feelers: favor sensation
 Reflective

observation:
Observers: favor watching
CAEL
Prior Learning Assessment
Kolb & ‘Learning Style’:
 Abstract Conceptualization:

Thinkers: favor abstraction
 Active

Experimentation:
Doers: favor activity
CAEL
Prior Learning Assessment
Kolb: people grow & develop:
 Affectively: to sense/feel
 Symbolically: to think
 Behaviorally: to act
 Perceptually: to observe
CAEL
Prior Learning Assessment
Possible Portfolio Components:
 Title Page / Summary
 Statement of Credit Requested
 Personal Goals Statement
 Academic Degree Plan
 Resume
CAEL
Prior Learning Assessment
Possible Portfolio Components:
 List of Learning Competencies
 ‘Learning Autobiography’
 Academic Transcripts
 ‘Certificated’ Learning
 Other Evidence of Learning
CAEL
Prior Learning Assessment
Possible Portfolio Components:
 Bibliography of Readings
 Course Descriptions
 Letters of Recommendation
CAEL
Prior Learning Assessment
Discussion Question:
 Given what has been said
about adult learning theory,
and the possible portfolio
components, which of the
components would you require
of adults, and why?
CAEL
Prior Learning Assessment
6 Steps to Assess Prior Learning:
 #1 - Identification: Review
experience to identify
potentially creditable learning.

Faculty guide adults, often
through a portfolio
development course.
CAEL
Prior Learning Assessment
6 Steps to Assess Prior Learning:
 #2 - Articulation: Relate
proposed credit to academic,
personal, and professional
goals.

A joint responsibility of the
learner and faculty.
CAEL
Prior Learning Assessment
6 Steps to Assess Prior Learning:
 #2 - Articulation: an important
additional note: Both assessors
and those assessed must be
clear about learning outcomes,
not just the learning content!
CAEL
Prior Learning Assessment
6 Steps to Assess Prior Learning:
 #3 - Documentation: Prepare
evidence to support the claim
for credit.

Primarily for the learner to do,
perhaps in a portfolio
development course.
CAEL
Prior Learning Assessment
6 Steps to Assess Prior Learning:
 #4 - Measurement: Determine
the degree and level of
competence achieved.

Faculty must do this step.
CAEL
Prior Learning Assessment
6 Steps to Assess Prior Learning:
 #4 - Measurement: an
additional note: there are
multiple techniques to assess
learning! Learner & assessor
should agree upon approach.
CAEL
Prior Learning Assessment
6 Steps to Assess Prior Learning:
 #5 - Evaluation: Determine the
credit equivalency.

Faculty must do this step.
CAEL
Prior Learning Assessment
6 Steps to Assess Prior Learning:
 #6 - Transcription: Prepare a
useful record of the results.

Task of administration, with
the advice of appropriate
faculty.
CAEL
Prior Learning Assessment
What is College Level Learning?
 Curricular Characteristics:
 Breadth: communication, arts &
humanities, social sciences, etc.
 Depth: in a disciplinary area
 Integration: Coherence, synthesis
 Rigor: demanding, challenging
CAEL
Prior Learning Assessment
What ‘other’ techniques might be
used to assess prior learning?
Performance tests (work samples)
 Simulations (games, role-play)
 Essays (learning autobiographies)
 Interviews (structured, paneled)
 Checklists, rating schemes

CAEL
Prior Learning Assessment
What is College Level Learning?
 Process Features:
 Collaboration: between faculty &
student, & between students
 Self-reflection: on personal values
 Scholarship: research basis
CAEL
Prior Learning Assessment
What is College Level Learning?
 Performance Domains:
 Communication
 Computation
 Critical Thinking
 Aesthetic & Ethical Awareness
 Lifelong Learning
CAEL
Prior Learning Assessment
What is College Level Learning?
 Additional Characteristics:
 Having a theoretical basis
 Having generality beyond the
context in which it was acquired
 Having representation in existing
college curricula
CAEL
Prior Learning Assessment
ACTIVITY: A Portfolio Excerpt
 Let’s
look at a segment of an
actual student portfolio to test
the preceding concepts …
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 Source: Assessing Learning:
Standards, Principles, &
Procedures, by Urban
Whitaker. CAEL: 1989
 (each followed by examples of
malpractice of the principle..)
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 #1 - Credit should be awarded
only for learning, not for
experience.
CAEL
Prior Learning Assessment
‘Malpractice’ on Principle 1:
 Credit for ‘time served’
 Example: Following WWI &
WWII, GI’s received 9 to 15
units for a year and a day of
enlisted or commissioned duty.
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 #2 - College credit should be
awarded only for college-level
learning.
CAEL
Prior Learning Assessment
‘Malpractice’ on Principle 2:
 Credit for ‘progress’ or ‘effort’
rather than accomplishment.
 Example: The ‘A’ for effort
despite lack of competence.
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 #3 - Credit should be awarded
only for learning that has a
balance, appropriate to the
subject, between theory and
practical application.
CAEL
Prior Learning Assessment
‘Malpractice’ on Principle 3:
 Credit for incomplete learning,
missing theoretical or practical
components.
 Question: Would you trust
pilots or physicians who lacked
either component?
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 #4 - The determination of
competence levels and of
credit awards must be made by
appropriate subject matter and
academic experts.
CAEL
Prior Learning Assessment
‘Malpractice’ on Principle 4:
 Implying or promising in
promotional materials that
credit is to be awarded for
experience, when real
judgments must be made by
qualified assessors.
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 #5 - Credit should be
appropriate to the academic
context in which it is accepted.
CAEL
Prior Learning Assessment
‘Malpractice’ on Principle 5:
 ‘Redlining’ general education
or major areas for PLA credit,
making it ‘elective only.’
 Example: business credits
counted only as electives, not
in the appropriate major area.
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 #6 - Credit awards and their
transcript entries should be
monitored to avoid giving
credit twice for the same
learning.
CAEL
Prior Learning Assessment
‘Malpractice’ on Principle 6:
 ‘Double counting’ of credit.
 The integrity of the degree and
curriculum is in question when
double-counting occurs.
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 #7 - Policies and procedures
applied to assessment,
including provision for appeal,
should be fully disclosed and
prominently available.
CAEL
Prior Learning Assessment
‘Malpractice’ on Principle 7:
 Policies in name only, not in
practice, such as for appeals.
 No institution can put itself in
the situation above without
jeopardizing its integrity.
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 #8 - Fees charged for
assessment should be based on
the services performed in the
process and not determined by
the amount of credit awarded.
CAEL
Prior Learning Assessment
‘Malpractice’ on Principle 8:
 Billing students for PLA fees
based on credits awarded.
 Question: How does the
assessor or institution resist the
‘perverse incentive’ in this?!
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 #9
- All personnel involved in the
assessment of learning should
receive adequate training for the
functions they perform, and
there should be provision for
their continued professional
development.
CAEL
Prior Learning Assessment
‘Malpractice’ on Principle 9:
 Assigning assessment work to
persons untrained for it.
 An analogy: We know that
content experts are not also
automatically teaching experts.
CAEL
Prior Learning Assessment
Quality Assurance Principles:
 #10
- Assessment programs
should be regularly monitored,
reviewed, evaluated, and revised
as needed to reflect changes in
the needs being served and in
the state of the assessment arts.
CAEL
Prior Learning Assessment
‘Malpractice’ on Principle 10:
 Assessment program
stagnation.
 Without maintenance, even
strong structures will weaken
and eventually collapse.
CAEL
Prior Learning Assessment
Pausing Now for Discussion:
 What parts of the preceding
“ring true” for you? Why?
 What parts of the preceding
material do you want to
question or to challenge?
CAEL
Prior Learning Assessment
CAEL’s recommended
development process for
implementing portfolio PLA:
 Build awareness & legitimacy
 Design an appropriate
program
 Implement it with training
 Troubleshoot startup problems
CAEL
Prior Learning Assessment
PLA from a “systems” view:
Option 1: Local PLA programs &
policies at each college/university
 Option 2: One statewide center for
PLA decision-making; credits
transferred as needed (Vermont)
 Option 3: ‘Mixed’ models of
individuality with collaboration

CAEL
Prior Learning Assessment
CAEL’s resources to help your
school start portfolio PLA:
 Publications
 Public PLA workshops
 OnLine PLA certification
 On-campus consulting help
CAEL
Prior Learning Assessment
For More Information:
WWW.CAEL.ORG
CAEL
Download