Jennifer Fager, Ph.D. UWEC

advertisement
Jennifer Fager, Ph.D.
UWEC
fagerjj@uwec.edu
Please do not reproduce or disseminate without permission
Assessment Planning
Assessment Plans should be developed for each program included in your
curriculum. This process will benefit your students by:
1.
2.
3.
4.
Providing a set of clear expectations for what they are to learn.
Clarify where this learning is to take place.
Identify key assessments that are linked to learning outcomes.
Setting expected performance levels.
An effective plan includes:
1.
2.
3.
4.
a set of student learning outcomes,
a curriculum map,
a list of artifacts/evidence to be collected, and
a plan for using and sharing the results with stakeholders.
This workbook is designed to help you develop an assessment plan that may be
useful to you, your colleagues, your students, and other stakeholders. Of course
there are many formats that might be used and other language or labels can be
used to identify these concepts, however, each plays a key role in the
development of a plan that is useful.
Writing Student Learning Outcomes
When writing Student Learning Outcomes, the focus should be on observable outcomes
and an “action verb” can provide that focus. Student Learning Outcomes usually begin
with something like:
By the end of the secondary education program, students will be able to design
curriculum and instruction appropriate for the cognitive development of all
learners.
Design is the “action verb” in this example.
By the end of the chemistry program, students will be able to apply knowledge of
ions, solutions and solubility to explain the formation and properties of
homogeneous mixtures.
Apply and explain are the “action verbs” in this example.
Identify
Describe
Demonstrate
Generalize
Recognize
Attend
Hit
Perform
Predict
Conjugate
Name
Classify
Translate
Explain
Specify
Volunteer
Communicate
Evaluate
Design
Others?
Distinguish
Order
Predict
Apply
Create
Participate
Dance
Speak
Locate
Define
Construct
Interpret
Analyze
Judge
Run
Solve
Interview
Draw
Student Learning Outcomes should describe what students should know, be able to do
and/or be like (dispositions) by the end of the defined program. These types of Student
Learning Outcomes are typically linked to domains. The common domains of learning
include cognitive, affective and psychomotor.
List four or five things you want your graduates to know by the end of your program.
1.
2.
3.
4.
5.
Cognitive (Knowledge) Domain
Level
Knowledge
Action Verbs
Recite, List
Comprehension
Translate, interpret, predict,
generalize, identify
examples
Application
Apply, rewrite
Analysis
Analyze, dissect, resolve,
solve, diagnose, investigate
Synthesis
Create, synthesize, write
Evaluation
Evaluate, judge, rate,
appraise
Outcome Example
By the end of the chemistry
program, students will be
able to list all of the
elements on the Periodic
Table.
By the end of the French
program, students will be
able to translate a
paragraph of text from
English to French.
By the end of the BIS
program, students will be
able to apply basic Web
development skills
By the end of the special
education program,
students will be able to
diagnose learning
disabilities in K-12 settings.
By the end of the art
program, students will be
able to create at least 12
original works in their
medium.
By the end of the music
education program,
students will be able to
judge student
performances.
For each of the four or five things you want your students to know by the end of the
program, write down a verb that would describe the action a student would need to take
to be able to demonstrate their knowledge:
1.
2.
3.
4.
5.
Other domains commonly used as a reference in teaching are the Affective Taxonomy
and the Psychomotor Taxonomy. The affective domain includes a focus on students’
attitudes, values and dispositions. These outcomes are a little more difficult to measure;
however, it is possible, and many disciplines are including these in their national
standards.
Affective (Values, Dispositions) Domain
Action Verbs
Outcome Example
Attend, accept, listen,
By the end of the women's
selectively attend to
studies program, students
will listen attentively to
alternative views on select
issues.
Responding
Comply with, approve,
By the end of the
volunteer, applaud, acclaim elementary education
program, students will able
to comply with PL 94-142.
Valuing
Increase proficiency in,
By the end of the political
relinquish, assist, support,
science program, students
deny, protest, debate
will be able to debate
numerous sides to an
argument.
Organization
Balance, organize,
By the end of the
formulate, accommodate
environmental studies
program, students will be
able to organize the
conservation efforts of
urban, suburban and rural
communities.
Characterization by a value Respect, interpret, use
By the end of the
complex
evidence, maintain
counseling program,
objectivity
students will be able to
objectively interpret
evidence presented by
clients during a therapy
session.
Level
Receiving
List four or five values or dispositions you would expect a graduate of your program to
demonstrate and an action a student would need to take to be able to demonstrate the
value or disposition:
1.
2.
3.
4.
5.
The Psychomotor Taxonomy focuses on the development of students’ physical abilities
and skills. These Student Learning Outcomes may include performances, skill in a
sport, typing skills, painting, playing an instrument, manipulating another person’s limbs
during physical therapy and demonstrating a dissection.
Psychomotor (Skills) Domain
Level
Perception
Action Verbs
Chooses, describes,
detects, differentiates,
distinguishes, isolates,
relates, selects, separates
Set
Begins, displays, explains,
moves, proceeds, reacts,
responds, shows, starts,
volunteers
Guided Response
Assembles, builds,
calibrates, constructs,
dismantles, displays,
dissects, fastens, fixes,
grinds, heats, manipulates,
measures, mends, mixes,
sketches
Assembles, builds,
calibrates, constructs,
dismantles, displays,
dissects, fastens, fixes,
grinds, heats, manipulates,
measures, mends, mixes,
sketches
Assembles, builds,
calibrates, constructs,
dismantles, displays,
dissects, fastens, fixes,
grinds, heats, manipulates,
measures, mends, mixes,
sketches, demonstrate
Adapts, alters, changes,
rearranges, reorganizes,
revises, varies
Mechanical Response
Complex Response
Adaptation
Origination
Arranges, combines,
composes, constructs,
creates, designs, originates
Outcome Example
By the end of the music
theatre program, students will
be able to relate types of
music to particular dance
steps.
By the end of the physical
education program, students
will be able to demonstrate
the proper stance for batting
a ball.
By the end of the physical
education program, students
will be able to perform a golf
swing as demonstrated by
the instructor.
By the end of the biology
program, students will be
able to assemble laboratory
equipment appropriate for
experiments.
By the end of the industrial
education program, students
will be able to demonstrate
proper use of woodworking
tools to high school students.
By the end of the industrial
education program, students
will be able to adapt their
lessons on woodworking
skills for disabled students.
By the end of the dance
program, students will be
able to create a dance step.
List four or five performances or skills you would expect a graduate of your program to
demonstrate and an action a student would need to take to be able to demonstrate the
value or disposition:
1.
2.
3.
4.
5.
Where in the program do students have the opportunity to
learn these outcomes?
Program
Outcomes
Core Courses:
101
102
201
x
x
301
x
Mutli-cultural Capstone
course
Course
x
Outcome 1
x
x
Outcome 2
x
x
x
x
Outcome 3
x
x
Outcome 4
x
x
Outcome 5
x
x
x
x
Outcome 6
Outcome 7
x
x
Outcome 8
x
x
x
x
x
x
Outcome 9
x
Outcome 10
x
The faculty in the department of Musicology engaged in the
curriculum mapping exercise above during a recent faculty meeting.
Examine the map and list questions you might pose to the faculty
members.
Question 1:
Question 2:
Question 3:
What recommendations might you provide to the faculty based upon
your questions?
Recommendation 1:
Recommendation 2:
Recommendation 3:
Map your Curriculum. Where in your program do students have the opportunity
to learn what you intend for them to learn?
Our Program
Outcomes
Our Core Courses:
Evidence/Artifacts—How do you know that students have
learned what you intended for them to learn?
Below is a list of existing program artifacts/evidence that can be used to assess student
learning outcomes:
1. Capstone experiences
2. Portfolio evaluations
3. Thesis and dissertations
4. National exams
5. Comprehensive Exams
6. Course Grades
7. Course Assignments
8. Field Experience Reports
9. Practicum Evaluations
10. Internship Evaluations
11. Student surveys/interviews/focus groups
12. Student Presentations
13. Student Publications
14. Student Performances
15. Admissions data
16. Placement data (career, graduate school)
17. Employer Surveys
18. Alumni Surveys
What evidence/artifacts do you currently collect? List ideas below.
1.
2.
3.
4.
5.
How do these artifacts/evidence measure student learning?
What level of proficiency is expected on each of these artifacts/evidence to suggest
students learned what was intended?
1.
2.
3.
4.
5.
Reporting Results
Data are useful when they are used. How will you use the information you have
gathered to improve the quality of the learning experience or program for the students?
Sample Assessment Report Summary
Student Learning Outcome Assessed:
By the end of the AAS Multimedia Track, graduates will be able to design and maintain a
website appropriate software and technology.
What did you do to assess the outcome?
We developed a rubric (attached) that included each aspect of the website design
including database management, interfaces, appropriate links, user authentication, etc.
What did you find as a result of this assessment?
We discovered that 92% of our students were able to develop a website based upon the
criteria outlined on our rubric. Strengths included the students’ abilities to use
appropriate technologies (100% met this target area) and weaknesses included
database development (68% did not meet the target in this area).
What are you going to do as a result of the assessment?
As a result of our assessment activities we are going to engage in the following:
Add two additional lessons on database development. We will develop an additional
learning module available to students as a tutorial for those who require remediation in
this area.
We will review this outcome again in the spring after the curriculum changes to
determine whether our changes made a significant difference in students’ abilities to
develop databases.
Review your Assessment Activities by completing the following. This process
allows you to “close the assessment loop.”
Assessment Report Summary
Student Learning Outcome Assessed:
What did you do to assess the outcome?
What did you find as a result of this assessment?
What are you going to do as a result of the assessment?
Reference:
Gronlund, N.E. (2000). How to Write and Use Instructional Objectives. Upper Saddle
River, NJ: Prentice-Hall, Inc.
Download