Rubric for Assessing Programmatic Planning & SLOs

advertisement
RUBRIC FOR ASSESSING PROGRAMMATIC PLANNING & SLOS
PLANNING TO ASSESS THE PROGRAM
Programmatic planning should…
state mission in terms of educational
purpose or goals
relate its mission and goals to the
University mission and planning
connect program mission and goals to
its SLOs
link program-level outcomes to specific
course-level outcomes in measurable or
observable terms
Definitions of terms
Educational purpose and goals are broad
statements of purpose in philosophical
terms often describing values and
aspirations.
These statements help align the program
with the University’s mission and planning
as they describe how the program’s
mission and goals relate to and support the
overarching institutional planning.
SLOs that connect directly and specifically
to the program clearly support and
advance (or align with) the program’s
mission and goals, while identifying what
students should expect to know or be able
to do by program completion.
This linkage is generally depicted via tables,
lists, or other schema to represent
intended SLOs within courses or
sequences of courses as they relate to
overall program SLOs (e.g., showing
hierarchical programmatic connections
and/or explaining how courses fit together
within degree programs and other course
sequences such as options, minors,
credentials, or concentrations, etc.).
Rubric
4 = very clearly stated
3 = stated with some clarity
2 = stated, but generally lacking clarity
1 = not stated
4 = relationships very clearly stated
3 = relationships stated with some clarity
2 = relationships stated, but generally
lacking clarity
1 = relationship not described
SLOs are connected to program mission
and goals:
4 = clearly
3 = somewhat
2 = infrequently
1 = no connection apparent
The linkages are:
4 = very clearly described
3 = described with some clarity
2 = described, but lacking clarity
1 = not described
Score
Subtotal (16 points possible) _______
Page 1 of 4 (compiled by Dr. Helen Bergland, Eastern Washington University )
PROGRAMMATIC STUDENT LEARNING OUTCOMES ASSESSMENT:
SLOs are CONTENT-specific, MEASURABLE, and the results of assessment are best used to IMPROVE student learning.
CONTENT
The SLOs should…
describe essential program-specific
content that students are able to
demonstrate in terms of knowledge,
skills and values upon graduation
Definitions of terms
SLOs identify in program-specific contentcentered terms (e.g., concepts, theories,
paradigms, etc.) the knowledge, skills, and
values that the program aims to convey
focus on student-centered learning
Student-centered outcomes are 1) outputoriented, focusing on what graduates
actually know and are able to do, 2)
competency-based and tied to the most
important skills and knowledge in a
program, and 3) designed to support
continual improvement through ongoing
assessment of student learning (Western
Washington University).
“Learning outcomes are statements of
what a student is expected to know,
understand and/or be able to demonstrate
after completion of a process of learning”
(ECTS Users’ Guide, 2005)
describe a learning outcome, not a
process
Page 2 of 4 (compiled by Dr. Helen Bergland, Eastern Washington University )
Rubric
SLOs describe essential program-specific
content that students can demonstrate in
terms of knowledge, skills and values
upon graduation
4 = all
3 = most
2 = few
1 = none
SLOs are focused on student-centered
learning, not on instructional goals or
activities
4 = all
3 = most
2 = few
1 = none
Score
SLOs are stated as outcomes, not as a
process
4 = all
3 = most
2 = few
1 = none
Subtotal (12 points possible) _______
(SLOS CONTINUED) MEASURABLE
The SLOs should…
be measurable
be written using action verbs to specify
definite, observable behaviors, skills, or
end products
list only one skill per statement
Definitions of terms
Measurable outcomes link actual student
learning to intended post-graduate
abilities, and lead to the production of
evidence that graduates have met the
intended goals.
Assessment becomes most useful when
we know what we’re looking for. Using a
specific verb to describe student actions
makes the statement measurable and
helps define the type of assessments
needed to show that the objectives were
achieved. Action verbs provide definite,
observable actions to measure.
Keep the SLO simple by limiting it to one
skill per learning outcome (hint: the word
“and” often points to multiple skills.) If
multiple skills are included, the outcome
becomes complex and difficult to
measure. Divide multiple skills into
separate statements.
2
Page 3 of 4 (compiled by Dr. Helen Bergland, Eastern Washington University )
Rubric
SLOs are stated in measurable terms:
4 = all
3 = most
2 = few
1 = none
SLO language is
4 = specific, definite and observable
3 = imprecise, general, approximate
2 = vague, ill-defined, or unclear
1 = so unclear as to be unmeasurable
Score
SLOs list one skill per statement:
4 = all
3 = most
2 = few
1 = none
Subtotal (12 points possible) _______
(SLOS CONTINUED) IMPROVE
SLO assessment results should:
be used to improve student learning
be used to identify areas to improve
show how the unit’s use of student
learning outcomes data is an effective
part of that program’s curriculum and
course development and revision
activities
Definitions of terms
A well-designed SLO leads to 1) the
collection of useful assessment data, 2)
productive analysis of the data, and 3)
results that inform revisions to the
curriculum and improve student learning.
Rubric
Score
Assessment of SLO data will:
4 = strongly lend itself to improvement of
student learning
3 = somewhat lead to improvement…
2 = unlikely lead to improvement…
1 = Not apparent that assessment of SLO
data will lead to improvement
Meaningful assessment lends itself to
Assessment of SLO data will:
adaptive curriculum that is responsive to
4 = strongly lend itself to improvement of
assessment results. This, in turn, lends
curriculum and/or learning environment
itself toward producing “a campus that
3 = somewhat lead to improvement…
becomes a learning organization, capturing 2 = unlikely lead to improvement…
information and making effective use of it
1 = Not apparent that assessment of SLO
in continuing to improve” (PKAL).
data will lead to improvement
This section should present a well4 = definitely
developed and coherent assessment plan
3 = probably
that includes continuous and well2 = possibly, but uncertain
integrated linkage among assessment,
1 = definitely not
planning, and implementation activities.
Subtotal (8 points possible) _______
Rubric developed and adapted from the following resources
 Cal State Hayward WASC Planning Process Rubric, December 2003
 University of Connecticut, “How to Write Program Objectives/Outcomes” retrieved from http://assessment.uconn.edu/primer/
 ECTS Users’ Guide (2005), Brussels: Directorate-General for Education and Culture. Available at





http://ec.europa.eu/education/programmes/socrates/ects/doc/guide_en.pdf
PKAL: Project Kaleidoscope. Washington D.C. Retrieved from http://www.pkal.org/documents/AssessmentToImproveStudentLearning.cfm
Schreyer Institute for Teaching Excellence. “Identifying desired measurable learning objectives.” Retrieved from
http://www.schreyerinstitute.psu.edu/Tools/ProgramAssessment/MeasurableOutcomes/
Tomorrow’s Professor, (n.d.) Stanford University. Retrieved from http://cgi.stanford.edu/~dept-ctl/tomprof/posting.php?ID=170
University of Wisconsin LaCrosse. Retrieved from www.uwlax.edu/learningoutcomes/edreading/WritingStudentLearningOutcomes.pdf
Western Washington University’s Center for Instructional Innovation & Assessment. “Selecting measurable learning outcomes.” Retrieved
from http://pandora.cii.wwu.edu/cii/resources/outcomes/default.asp
Page 4 of 4 (compiled by Dr. Helen Bergland, Eastern Washington University )
Download