Assessment Reports by Non-Academic and Non

advertisement
1
2012 Assessment PLAN Template
Assessment Plan by Non-Academic and Non-College Academic Units:
Due by August 15, 2012
As part of our ongoing accreditation by the Higher Learning Commission, all non-academic units at YSU
participate in assessment processes and practices. Assessment is an ongoing activity and is not limited
to YSU’s self-study processes for the Higher Learning Commission.
When is the plan due? The deadline for all non-academic units’ and non-college academic units’
assessment plan is Wednesday, August 15, 2012. We recognize that this date is later than in past
years and that it is also a very busy time for non-academic units; if there are extenuating circumstances
that may warrant an extension, please contact our office.
Where do I send the plan? This year the Office of Assessment (OOA) is transitioning to a new online
reporting process (see “What’s New This Year?” below for more information). Your plan should be
submitted through our new online plan form at http://www.jotform.us/ysuassessment/2012naplan.
What is an Assessment Plan? An assessment plan outlines the ways in which your unit intends to
collect and analyze data for unit and/or program improvement, with a specific focus on learning
outcomes. A plan can be a chance for a unit to “take a step back” and decide how they can best (and
most efficiently) collect data on what they want to measure; for a unit new to assessment reporting, it
allows them to develop and focus assessment efforts.
What is crucial to include in these plans?
Each unit can define the focus for its plan,
based upon in-depth knowledge of the
department and its units; however,
assessment plans should not be merely a
description of unit activities but should
include one measurable learning outcome,
with thoughtful consideration of how you
will collect data to assess that learning
outcome, and what you anticipate the
outcome of your measures to be. In addition,
consideration of how you will share data
with internal and external stakeholders is
important to include.
Do I have to complete an assessment plan
and an assessment report? NO! Your unit
may choose to complete either an
assessment plan or an assessment report. Do
not complete both. Note: you cannot complete a
A Robust Assessment Process
plan two years in a row—if your unit completed a
plan last year, then your unit is not eligible to complete a plan this year.
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
2012 Assessment PLAN Template
2
What’s new this year?
 NEW ONLINE REPORTING PROCESS: The OOA is working hard behind the scenes to streamline
reporting processes so the focus is on the good work of assessment, not the paperwork! To
support this goal, we are moving to submission of plans through an online form. This form will
allow you to type directly into the form, or cut and paste from this completed Word template.
You will also have the ability to save and come back to your form, as well as upload
attachments. We will provide a walkthrough of the new form at all OOA Assessment
Workshops, or you may contact our office for assistance. We appreciate your cooperation and
patience as we transition to this new system and work out any kinks; if for some reason you
cannot access the online form, we will allow email submission. Once in place, this system will
also allow more powerful analysis of plans and reports, easier access to previous plans and
reports for both OOA and individual units, and the ability to focus more resources toward
assessment training and consultation.
 Fewer questions! We have listened to your feedback and have worked with staff from Student
Affairs to reduce the total number of questions this year. We will continue to work to reduce
the reporting process length and complexity. The focus should be on learning, not the form.
 New Higher Learning Commission Criteria: the Higher Learning Commission’s “New Criteria for
Accreditation” was released in February of 2012 and will become effective on January 1, 2013.
The New Criteria places a much higher focus on student learning and on infusing the use of
assessment for continuous improvement into all that an institution does. To help support this
increased focus, and to build familiarity with the New Criteria across campus, the OOA has
indicated how each question on the plan relates to New Criteria. We will also have one optional
question (optional in 2012; will be mandatory in subsequent years) asking units to explain how
they would be able to provide evidence for one of the New Criteria. The New Criteria can be
found on the HLC website at:
https://content.springcm.com/content/DownloadDocuments.ashx?Selection=Document%2C5f
a00220-896c-e111-b379-0025b3af184e%3B&accountId=5968. Note: if you have trouble
viewing this document, try cutting and pasting the URL directly into your web browser.
 Enhancing Report Quality: We are completing the increase minimum threshold of plan and
report quality to 70% the total possible points (completed over a three-year period). You can
also view the rubric on the OOA website.
Quality Rating
Exemplary
Proficient
Progressing
Inadequate
Percentage of
Total Points
90-100%
80-89%
70-79%
69% or less
How will the plans be reviewed? A team from the YSU Assessment Council will review the plans and
provide feedback based on a rubric (a set of evaluative criteria). To ensure that our focus in on the
vitality of unit self-appraisal and continuous improvement (and not the form itself), note that questions
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
3
2012 Assessment PLAN Template
on the rubric are weighted differently. You can view the rubric and question values on the OOA
website.
For accreditation purposes the OOA maintains a record of all plans and reports. Assessment plans and
reports will be posted on the OOA Word Press site or other secure site to provide units a wider
distribution of their results and recommendations. The OOA also seeks to provide information back the
campus community in useful ways; for example, the OOA “Use of Data” Chart informs units how other
units are collecting and using student learning data for improvement purposes.
How do I know what you are looking for in the plan?
 For definitions of important terms see page 7; for hints and tips on filling out the plan, please
see the “Assessment Plan Tips and Hints” document on the OOA website at
www.ysu.edu/assessment/directions.html.
 In addition, a link to the rubric that will be used to review/evaluate/score this plan is provided
at www.ysu.edu/assessment/directions.html. Note that some questions in the template are
weighted more heavily than others; you can view the rubric for the questions’ weight, or value.
 A workshop series will be conducted by the Office of Assessment in July 2012 and will provide
examples of exemplary plans as well as critical elements to attend to in completing the
template. If you cannot attend the workshops, the materials will be on the assessment website
at www.ysu.edu/assessment/directions.html.
Assessment process image credit, page one: http://pdx.edu/studentaffairs/assessment-planning-andpractice.
If you experience difficulty opening the hyperlinks in this document, please copy and paste the links
into your web browser’s address bar.
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
4
2012 Assessment PLAN Template
Assessment Plan Template
Due August 15, 2012
Instructions: Complete the first section, “Current Unit Status,” outlining the current state of your unit’s
assessment activities for the 2011-2012 academic/fiscal year. For the second section, “Assessment Plan
Development,” you will be asked about your chosen learning outcome and how you plan to measure it.
All supplemental documents and material needed to help you create this plan are located on the
Assessment website. Please save electronic or paper copies of relevant assessment materials in your
own office for at least 10 years.
Name of Department or Unit:
Name of Person Preparing This Plan:
Title:
Email Address:
Campus Phone:
Direct Supervisor:
Extension and Email of Supervisor:
Division Vice President:
Extension and Email of Vice President:
Date Submitted:
Plan or report submitted in 2011?
Number of attachments to this report:
Section 1: Current Unit Status
1. Explain how your unit supports the 2020 Strategic Plan of Youngstown State University (The
YSU 2020 Strategic Plan can be found at http://web.ysu.edu/2020.) (Related to HLC Criterion 1,
Core Component 1.A, Sub-component 2 and Criterion 3, Core Component 4.E., Sub-component
1)
2. Describe the goals for your unit from the previous academic/fiscal year.
3. How do your goals support the learning environment at YSU? (Related to HLC Criterion 4)
Describe your current assessment activities:
4. Provide a brief summary of unit and/or program improvement data collected that document
your unit’s assessment activities for the 2011-2012 academic/fiscal year (e.g., explain how you
measured unit and/or program activities for continuous improvement). (Related to HLC
Criterion 4, Core Component 4.B., Sub-component 2)
5. How was that data analyzed and used by your unit? (Related to HLC Criterion 4, Core
Component 4.B., Sub-component 3)
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
5
2012 Assessment PLAN Template
6. How did your unit utilize feedback from the Office of Assessment regarding last year’s
assessment report? (Note: if this is your unit’s first time completing a plan or report, answer
“first reporting year.”)
Section 2: Assessment Plan Development
Develop a learning outcome:
7. State at least one learning outcome1 that is relevant for your unit. Note: you may use the same
LO used in a past year or you may use/develop a new LO. (Related to HLC Criterion 4, Core
Component 4.B., Sub-component 1)
8. How does this learning outcome fit your unit?
9. How does this learning outcome fit in with the YSU 2020 Strategic Plan? (Related to HLC
Criterion 1, Core Component 1.A, Sub-component 2 and Criterion 3, Core Component 4.E., Subcomponent 1)
Measure your learning outcome:
10. What is the way (or ways) you will measure the status of and/or progress in this learning
outcome over the 2012-13 academic/fiscal year? Note: consider tools that would incorporate
both direct and indirect measures.
11. What do you anticipate the outcome of your measure(s) to be? What do you hope to find out?
Close the feedback loop: As part of a healthy assessment process, assessment activities and highlights
should be shared with, and feedback and recommendations solicited from, both internal stakeholders
(such as unit staff) as well as external stakeholders (such as students, other staff/faculty, and the wider
community).
12. What are the major constituency groups for your unit? Note: think not just within your unit or
your supervisory structure (internal stakeholders), but about students/faculty/staff, the larger
university, the surrounding community, and beyond (external stakeholders). (Related to HLC
Criterion 4, Core Component 4.B., Sub-component 4)
13. How and when do you plan to involve your major constituency groups in the assessment
process (e.g., data sharing and recommendation gathering)? (Related to HLC Criterion 4, Core
Component 4.B., Sub-component 3)
1
For information on what a learning outcome is and how to construct one for your unit, please attend the Office of
Assessment workshop on assessment plans in July 2012 or see the website at www.ysu.edu/assessment/directions.html for
learning outcome workshop materials
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
6
2012 Assessment PLAN Template
Relation to New Higher Learning Commission Criteria:
14. (OPTIONAL FOR 2012) Please provide an example of how your unit could provide evidence,
through learning outcomes assessment, for the new HLC Criterion Five (Resources, Planning,
and Institutional Effectiveness), Core Component 5A (The institution engages in systematic and
integrated planning.), Sub-component 2 (The institution links its processes for assessment of
student learning, evaluation of operations, planning, and budgeting.):
Executive Summary:
15. Executive Summary (summarize the key ideas from section two only, Assessment Plan
Development, with a maximum length of one-half page).
Optional:
16. Is there anything else you would like to share regarding your assessment plan and/or is there
any particular area on which you would like assistance or feedback?
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
7
2012 Assessment PLAN Template
Appendix - Assessment Terms and Definitions
Term
Assessment
Outcomes
Performance
Criteria
Evaluation
Stakeholder
Direct Measure
Indirect Measure
Definition
Other Terms
Used
Processes that identify, collect, analyze,
and report data that can be used to
evaluate achievement.
Statements that describe what students
(or other individuals) are expected to
know and be able to do when a unit’s
intervention is complete
Specific, measurable statements
identifying the performance(s) required
to meet the outcome; confirmable
through evidence.
Process of reviewing the results of data
collection and analysis and making a
determination of the value of findings
and action(s) to be taken.
Evaluation
A person, group, organization, or system
who affects or can be affected by an
organization's actions
Direct measures provide for the direct
examination or observation of [staff,
faculty, student] knowledge or skills
against measurable learning outcomes
Indirect measures of learning that
ascertain the opinion or self‐report of the
extent or value of learning experiences
Constituency
Objectives, standards, goals.
Terminology may vary by discipline
and/or accrediting agency.
Standards, rubrics, specifications,
outcomes, metrics, objectives
Assessment
Written papers, tests, oral presentations,
performance appraisals, internship
supervisors’ evaluations, behavioral
observations, etc.
Written surveys, exit and other
interviews,
archival records, focus groups, etc.
Table adapted with permission from Gloria M. Rogers’ Presentation “Building a Foundation: Best
Practices, Common Mistakes”© July 13, 2009 Live Text Collaboration and Assessment
Conference, Gloria M. Rogers, Ph.D., Managing Director, ABET, Professional Services,
http://www.abet.org/assessment.shtml.
Download