Assessment Plan Development Kit for Curriculum Proposals 2.0

advertisement
2013-14
Virginia Commonwealth University
Assessment and Institutional Effectiveness
ASSESSMENT PLAN
DEVELOPMENT KIT FOR
UNDERGRADUATE AND
GRADUATE CURRICULUM
PROPOSALS
A handbook of practical information
Assessment Plan Development Kit 2.0
Introduction
This “Assessment Development Kit” provides explanations and worksheets the elements of an
assessment plan. The “kit” can be used to replace, update, or to develop a new plan for
assessing expected student learning. The following list comprises these required elements:
Element
pages attachments
Mission Statement
Goals for the Program
Outcomes/Objectives for Expected Student Learning
Measures of the Expected Learning
Targets for Student Achievement
Curriculum Map
Implementation/Administration Plan
The “kit” contains examples of complete assessment plans for degree programs at VCU and an
empty template to be used for assembling and presenting a new or revised assessment plan.
Assessment and Institutional Effectiveness
Office of Planning and Decision Support
September, 2013
Page | 1
Assessment Plan Development Kit 2.0
Assessment and Curriculum: Actions and Procedures
The Office of Assessment and Institutional Effectiveness reviews and approves assessment
planning for the following curricular proposal actions:
1. A proposal to revise existing curriculum, including the addition and deletion of courses.
2. A proposal for a new SCHEV approved certificate, baccalaureate degree, or graduate
degree.
Required Procedures
1. When proposing to revise existing curriculum, complete the following:

Contact the Director of Assessment to review the current assessment plan in
WEAVE. The findings will support one of the following recommendations.
Finding
Assessment plan is current;
findings are up-to-date
Assessment plan is current
but findings are incomplete
Assessment plan is not up
to date or is incomplete
Action
Assessment Director Signature
Action required for signature approval:
Develop an action plan for ongoing, sustainable assessment
and reporting (Attachments I, J, K; see History Assessment
Plan, Attachment M)
Action required for approval: Prepare Plan to Assess Student
Learning Outcomes including an action plan for administering
the assessment plan (Attachment N)

Obtain signature approval from the Director of Assessment on the Signature Sheet
PRIOR to submitting the proposal to the school/college curriculum committee.

Upon approval from the appropriate university level curriculum committee (UUCC or
P&C), arrange with the Director of Assessment to enter the revised assessment plan
into WEAVEonline.
2. When proposing a new, SCHEV approved certificate, baccalaureate degree, or graduate
degree complete the following:

In consultation with the Director of Assessment, use the Assessment Plan
Development Kit to prepare the following elements of a plan to assess student
learning outcomes.
 Mission statement
Assessment and Institutional Effectiveness
Office of Planning and Decision Support
September, 2013
Page | 2
Assessment Plan Development Kit 2.0






Goals for the program
Objectives/Outcomes for student learning
Measures of student learning
Expected targets
Curriculum Map
Implementation/Administration Plan

Complete the Plan to Assess Student Learning Outcomes (Attachment N) PRIOR to
submitting the New or revised curriculum proposal to the University Undergraduate
Curriculum Committee or the Graduate Programs and Courses Committee.

Obtain the Director of Assessment’s approval on the Signature Sheet.

Upon approval from the appropriate university level curriculum committee (UUCC or
P&C), arrange with the Director of Assessment to enter the assessment plan for the
new degree in to WEAVEonline.
Required: Mission Statement
Mission/Purpose statements name a department’s or program’s purposes for existing.
Normally, these statements present the broadest perspective on what the unit or program does
and what it intends to achieve. Often a mission statement carries an implicit statement of
values as well as the relationship the unit or program has to the institution as a whole.
A useful mission/purpose statement identifies what the program will help students achieve and
states how the program contributes to its wider communities.
Some program accreditors provide explicit directions for mission/program statements. These
programs do not need to create additional language. All other programs should have a
mission/purpose statement.
Attachment A: Writing a Mission Statement
Required: Goals for the Degree Program and Expected Outcomes for Student
Learning
Goals are broad statements about the desired ends of a university, college, school, department,
office, program, or course. Goals are usually too general to actually guide assessment practice,
but they can provide a bridge between the mission statement and the outcomes.
Assessment and Institutional Effectiveness
Office of Planning and Decision Support
September, 2013
Page | 3
Assessment Plan Development Kit 2.0
Outcomes/Objectives name the knowledge, skills, and attitudes that students are expected to
develop via the curriculum. Outcomes/objectives are concrete and concise, naming what
students should be able to demonstrate upon completing a course, a program, or a degree.
Well written outcome/objective statements




Use action verbs that name what students should know and know how to do over time.
Focus on what students should do, not on what the instructor teaches.
Serve as guidelines for content, instruction, and grading.
Convey to learners exactly what is to be accomplished.
Is it a goal or is it an outcome? Goals are general; outcomes are specific. Frequently, goals are
about the program and outcomes are about the students’ demonstrated learning. Consider the
following excerpt from VCU assessment plans for a graduate degree program:
(Program) Goals
The PHD program in _______ prepares
students to be effective communicators.
The PHD program in ________ provides
rigorous learning experiences leading to strong
research competencies.
(Student Learning) Outcomes
Students will write effectively in appropriate genres for
a variety of audiences.
Students will speak effectively in a variety of contexts
and occasions.
Students will accurately analyze and critically interpret
quantitative and qualitative data.
Students will synthesize a set of diverse, complex
research studies into well-organize literature reviews.
Students will demonstrate an understanding of the
major scholarly and practitioner journals in their fields.
Attachment B: Writing Student Learning Outcomes
Attachment C: Bloom & Anderson’s Taxonomy
Align outcome statements with VCU General Education Core Competencies (for
undergraduate degrees only). Aligning outcomes with VCU General Education Core
Competencies demonstrates how a degree program contributes to the general education
mission of the university. NOTE: Concerning the VCU General Education Core Competencies:
a program does not need to have an aligned student learning outcome for each competency.
Attachment D: Aligning Outcomes to VCU General Education Core Competencies
Required: Measures of Expected Student Learning
Measures of student learning are the assessments of student learning.
 Direct measures provide concrete evidence of what students have learned. For
example, a direct measure of quantitative literacy could be a standardized test taken
outside of class or an assignment in a class to pose and solve a problem using
quantitative methods.
Assessment and Institutional Effectiveness
Office of Planning and Decision Support
September, 2013
Page | 4
Assessment Plan Development Kit 2.0
 Indirect measures are student perceptions of how well they have achieved the
outcomes. Examples include surveys and interviews.
 A measure/assessment that is not part of the course and for which students receive no
graded credit is an “add-on measure.”
 A measure/assessment that is part of a course, such as a capstone project or a
performance, is an “embedded measure.”
See Attachment E for lists of direct and indirect, and embedded and add-on measures.
Measures need to be aligned with the outcomes. In other words, the link between the
assessment method or measure and the desired learning outcomes must make sense. For
example, public speaking skills cannot be assessed with an essay. Writing effectively cannot be
assessed with a multiple choice exam. Uses of nationally normed tests need to be reviewed for
alignment with the learning outcomes. Alignment of the assessment measures is, for the most
part, common sense: does the method measure what has been taught?
See Attachment F for an example of measures aligned to outcomes and goals.
Required: Curriculum Map
Maps guide us through our travels. Likewise, a curriculum map is an important and useful
reference tool in the hands of students and faculty. If students and faculty have access to and
use the map, then they can better understand the design and purpose of the curriculum. When
students see connections between their learning experiences, their learning is deeper and
more lasting.
The tool most frequently used to assess the intentionality of the program is a curriculum map,
a simple matrix that illustrates in which courses the learning outcomes are taught. We use road
maps to plot a route to where we want to go. Likewise, a curriculum map is a powerful tool to
plot the route through the curriculum.
A curriculum map identifies where outcomes are intentionally supported, areas of overlap, and
outcomes that have been overlooked.
Students need multiple opportunities to develop and practice applying knowledge and skills.
Any curriculum should have a developmental arch for learning outcomes, from introductory
level to appropriate levels of mastery upon graduation.
0-this course does not teach this outcome
1-this course introduces students to this outcome
2-this course gives students opportunities to practice this outcome
3-this course provides students opportunities to demonstrate mastery of this
outcome
Assessment and Institutional Effectiveness
Office of Planning and Decision Support
September, 2013
Page | 5
Assessment Plan Development Kit 2.0
A Google search for curriculum map will yield other coding schemes.
Attachment G: Sample Curriculum Map
Attachment H: Curriculum Map Template
Page | 6
Required: Implementing and Administering the Plan to Assess Expected Student
Learning
The success of the plan for assessing expected student learning depends upon implementation
and administration. What actions need to be taken? Who will follow through? Who oversees
or coordinates? When will actions be completed? Asking and answering these simple
questions are necessary.
Attachment I: Implementing and Administering the Assessment Plan
Improving Student Learning
Discussion among the faculty about assessment findings is crucial. Has the department or
program defined a process or procedure for bringing faculty together annually to discuss
student learning, the curriculum, and assessment findings?
The most daunting aspect of assessment is “closing the loop.” It is common for programs,
colleges, and universities to collect mountains of data but not commit themselves to using the
data to inform change. Susan Hatfield, from Winona State University in Minnesota, explains
that using assessment findings to inform change is challenging “because in many cases, the
program already takes into account student performance and adjusts the curriculum and
teaching methods accordingly . . . Some changes are the result of personnel decisions, collegewide initiatives, changes in enrollment, leadership agendas, and simply intuition. These
changes, however, are not substitutes for the systematic analysis of program-level student
learning outcomes.”
Attachment J: Discussing Assessment Findings
Attachment K: Using Assessment Findings
References
Maki, Peggy. Assessing for Learning, 2nd ed. Sterling VA: Stylus. 2010.
Suskie, Linda. Assessing Student Learning: A Common Sense Guide, 2nd ed. San Francisco: Jossey-Bass. 2009.
Walvoord, Barbara. Assessment Clear and Simple. San Francisco: Jossey-Bass. 2004.
Assessment and Institutional Effectiveness
Office of Planning and Decision Support
September, 2013
Download