Assessment Reports by Non-Academic and Non

advertisement
1
2012 Assessment PLAN Tips and Hints
Appendix -Tips and Examples on Completing the Assessment Plan Form
Below you will find further explanation of the information the Office of Assessment seeks, as well as some
fictional examples of the types of answers that could be included in a plan (though certainly not an exhaustive
collection). For the purposes of the example, we have created a fictional YSU Office who is focused on student
community involvement; this is an area in which multiple units on campus are engaged.
Note that plans that would be considered exemplary do not need to be examples of a textbook assessment
process; rather, they show honest exploration of learning outcomes and earnest intent to use data to make
decisions and share information. They will not necessarily have “black and white” examples of data, analyses, or
conclusions. Indeed, our example is meant to not be “textbook” perfect, but rather to give you some idea of what
responses might look like!
Name of Department or Unit:
Name of Person Preparing This Plan:
Title:
Email Address:
Campus Phone:
Direct Supervisor:
Extension and Email of Supervisor:
Division Vice President:
Extension and Email of Vice President:
Date Submitted:
Plan or report submitted in 2011?
Number of attachments to this report:
Notes
Office of Community Involvement
Joe Smith
Assistant Director
jesmith@ysu.edu
941-0000
Judy Doe, Director
9999, jrdoe@ysu.edu
Jack Fahey
8888, dvp@ysu.edu
August 15, 2012
Report
One
Many questions on the report template state their relationship to the
New HLC Criteria. This is not something you need to address in your
answers; rather, it is only meant as an opportunity to familiarize yourself
with the New Criteria, which go into effect January 2013. They can be
viewed at :
https://content.springcm.com/content/DownloadDocuments.ashx?Sele
ction=Document%2C5fa00220-896c-e111-b3790025b3af184e%3B&accountId=5968
Section 1: Current Unit Status
Notes
For section one we are interested in learning more about your
unit and the types of data you currently collect. It is not
necessary to relate the answers in section one to the learning
outcome you will state later in question seven, unless you find it
helpful to approach this section that way.
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
2
2012 Assessment PLAN Tips and Hints
1. Explain how your unit supports the 2020 Strategic Plan of Youngstown State University (The
YSU 2020 Strategic Plan can be found at http://web.ysu.edu/2020.) (Related to HLC Criterion 1,
Core Component 1.A, Sub-component 2 and HLC Criterion 3, Core Component 4.E., Subcomponent 1)
Notes
Relate your unit’s purpose to at least one
cornerstone/theme/priority of the 2011-2020 Strategic Plan. You
do not have to provide an exhaustive list of how your unit relates,
only an example or two.
The 2020 Strategic Plan, Theme 2.2 is Satisfaction with
Example
non-academic experiences and campus life—the
explanation under this theme specifically includes the
importance of participation in service learning and
community activities. Our unit’s main goal is to
increase participation in community activities as well
as meaningful reflection on the impact of those
activities on students’ development.
2. Describe the goals for your unit from the previous academic/fiscal year.
Notes
What are your unit’s goals, either focused on the past year, or if
you do not do yearly goals, what are the overall goals of your
unit?
Our unit had three main goals this past year: 1.
Example
Increase Office of Community Involvement’s visibility on
the YSU campus; 2. Increase student participation in
community volunteer activities through our office; and
3. Increase partnerships with Youngstown area schools
for students to serve as tutors.
3. How do your goals support the learning environment at YSU? (Related to HLC Criterion 4)
Notes
Every unit on campus contributes to the learning environment,
because the learning environment impacts not just students, but
faculty and staff. Units that do not include significant student
contact also contribute to the learning environment. Note that
you can choose to focus broadly on what your office does, or
specifically on the area you are considering for the plan.
Participation in community service activities helps
Example
students learn about civic responsibility and better
understand the community and region in which we
live. In addition, participation in these activities helps
to produce graduates that are prepared to be involved
citizens, able to utilize the knowledge gained through
their degree program to better our region and the
world.
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
3
2012 Assessment PLAN Tips and Hints
Describe your current assessment activities:
4. Provide a brief summary of unit and/or program improvement data collected that document
your unit’s assessment activities for the 2011-12 academic/fiscal year (e.g., explain how you
measured unit and/or program activities for continuous improvement). (Related to HLC
Criterion 4, Core Component 4.B., Sub-component 2)
Notes
1. This does not need to be data related to your learning
outcome, only focused on continuous improvement.
2. You can provide just a list of the types of data, you don’t need
to include the actual data (e.g. “the numbers”).
3. We would like to know what data you have been collecting
because: 1)this will help us provide feedback on collecting
data for your learning outcome and 2) data collection should
be an ongoing process, even in planning years
We fielded a survey in fall 2011 asking students about
Example
their participation in community service activities and
their knowledge of opportunities for community service
participation on the YSU campus. We track student
participation in programs through our office; we have
been collecting this data yearly for the past five years.
5. How was that data analyzed and used by your unit? (Related to HLC Criterion 4, Core
Component 4.B., Sub-component 3)
Notes
This does not have to be a formalized process, e.g., it could be a
discussion of the data that came out of a unit meeting. We want
to know how you have used data in the past to help evaluate and
make decisions.
The survey of student participation helped us
Example
understand that first year students, in particular, were
not aware of community engagement opportunities on
campus. We are currently in the planning stages of how
to target first-year students more directly about
opportunities. In addition, the survey revealed that
students don’t understand the impact of community
involvement on their academic and personal
development. We are also in the planning stages of
incorporating a more compelling case for students to
participate—e.g. “what’s in it for them” if they
participate in our programs. Building this case is
particularly important since many of our students work
at jobs off campus as they complete their academic
coursework.
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
4
2012 Assessment PLAN Tips and Hints
6. How did your unit utilize feedback from the Office of Assessment regarding last year’s
assessment report? (Note: if this is your unit’s first time completing a plan or report, answer
“first reporting year.”)
Notes
Refer to your feedback from the 2011 plan or report to aid in
completing this question; if you met personally with Office of
Assessment staff, feedback from that meeting would also be
appropriate to include.
The feedback said we should communicate with
Example
stakeholders more widely, specifically those outside our
unit. This is one of the reasons we decided to complete
an assessment plan this year, to allow us time to
identify those groups and develop a plan to
communicate with them in the future.
Section 2: Assessment Plan Development
Develop a learning outcome:
Notes
The intent of questions 7-9 is to facilitate alignment of
assessment activities in the continuum from the specific activity
(learning outcome, and resulting data collection), to the unit,
through to the larger university. For more on learning outcomes,
you can contact the Office of Assessment.
7. State at least one learning outcome1 (LO) that is relevant for your unit. Note: you may use the
same LO used in a past year or you may use/develop a new LO. (Related to HLC Criterion 4, Core
Component 4.B., Sub-component 1)
Notes
A learning outcome should be clearly written, measurable, and
focused on a single skill or knowledge set. For questions 7-9 only,
we show an example of both a student-focused and staff-focused
learning outcome.
Students will be more aware of the importance of
Example
community involvement to their education.
(student
focused LO)
Staff demonstrate awareness of professional
Example
(staff focused responsibilities of students serving in community
organizations.
LO)
8. How does this learning outcome fit your unit?
Notes
Specifically relate the learning outcome you have chosen to the
purpose of your unit.
1
For information on what a learning outcome is and how to construct one for your unit, please attend the Office of
Assessment workshop on assessment plans in July 2012 or see the website at www.ysu.edu/assessment/directions.html for
workshop materials.
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
5
2012 Assessment PLAN Tips and Hints
Example
(student
focused LO)
Example
(staff focused
LO)
This is directly related to our unit’s purpose, to promote
the benefit of community involvement to our students.
By ensuring our staff are responsive to the needs of the
community organizations with which we partner, and
therefore maintain a positive working relationship, we
are well positioned to continue and expand our
students’ community service opportunities.
9. How does this learning outcome fit in with the YSU 2020 Strategic Plan? (Related to HLC
Criterion 1, Core Component 1.A, Sub-component 2 and Criterion 3, Core Component 4.E., Subcomponent 1)
Notes
Specifically relate the learning outcome you have chosen to the
2020 strategic plan.
Promoting the importance of community involvement
Example
helps to encourage participation, and the Regional
(student
focused LO) Engagement Cornerstone outlines the importance of
Example
(staff focused
LO)
student involvement in the community to support
quality learning experiences and positive community
change (in particular Theme 1, Priority 1).
By maintaining positive and responsive relationships
with our community partners, we enable students to
interact positively with community partners, and foster
the collaborative relationships with community
organizations outlined in the Regional Engagement
Cornerstone (in particular Theme 1, Priority 1).
Relate your learning outcome to Higher Learning Commission (HLC) Criteria:
10. (OPTIONAL FOR 2012) Please provide an example of evidence from your unit for the new HLC
Criterion Five (Resources, Planning, and Institutional Effectiveness), Core Component 5A (The
institution engages in systematic and integrated planning.), Sub-component 2 (The institution
links its processes for assessment of student learning, evaluation of operations, planning, and
budgeting.):
Notes
This question is optional, but a good way to begin familiarizing
yourself with the New HLC Criteria that goes into effect on
January 1, 2013. Consider how the assessment activities you are
planning may impact your planning and budget decisions.
Remember also: this question is asking how the work of your unit
contributes to YSU meeting this HLC criteria; it is the work of
many academic and non-academic units that helps YSU to meet
the requirements (i.e., your unit is not solely responsible).
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
6
2012 Assessment PLAN Tips and Hints
Example
While we didn’t think of it this way before reading this
question, the 2011 survey results made it clear that
more staff and financial resources needed to be
devoted to a campus campaign. Through this
assessment plan, we are devoting both fiscal and staff
resources in order to carry out plans. Results from this
year’s assessment will inform future planning and
budgets.
Measure your learning outcome:
11. What is the way (or ways) you will measure the status of and/or progress in this learning
outcome over the 2012-13 academic/fiscal year? Note: consider tools that would incorporate
both direct and indirect measures
Notes
While you must have a minimum of one tool/measure, we
recommend no more than two. You can use perceptions or
attitudes to look at the impact of your unit’s activities on faculty,
staff, or student learning. Measuring perceptions is an indirect
measure. It is also possible to measure individuals’ factual
knowledge about information they learned during a staff
development workshop or as a result of completing community
service or participating in a learning community. This would be
considered a direct measure. Note that an exemplary rating on
this item would be for a unit that includes a direct measure in its
tools.
In spring 2013 e will repeat the survey (see attachment)
Example
given in fall 2011 asking students about their
awareness and participation in community service
activities as an indirect measure after our fall 2012
awareness campaign. The fall 2011 can serve as
“baseline data”, and we can look for any changes after
the awareness campaign.
2
12. What do you anticipate the outcome of your measure(s) to be? What do you hope to find out?
Notes
This is your sense of what you hope to find. Remember that your
estimate of what you expect to find may not be realized and it
does not just have be focused on positive results e.g. your results
may turn out differently than you expected. That is fine.
Remember that unexpected findings can lead to another
valuable question that you can address at a future time. Even if
you anticipate that the findings may be “negative” (i.e.
individuals lack knowledge), that is not a bad thing because it is
that honest appraisal or finding that can lead to continuous
Note: there are no actual “fictional” attachments; this is meant only to point out that additional evidence can be attached to a
report when needed.
2
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
7
2012 Assessment PLAN Tips and Hints
improvement
Example
We hope to see some increase in the awareness of
students regarding the availability and importance of
community service activities, but we aren’t sure how
much impact it will have on actual involvement (since
this is a closely related goal).
Close the feedback loop: As part of a healthy assessment process, assessment activities and highlights
should be shared with, and feedback and recommendations solicited from, both internal stakeholders
(such as unit staff) as well as external stakeholders (such as students, other staff/faculty, and the wider
community).
13. What are the major constituency groups for your unit? Note: think not just within your unit or
your supervisory structure (internal stakeholders), but about students/faculty/staff, the larger
university, the surrounding community, and beyond (external stakeholders).
Notes
Who is impacted by (either directly or indirectly) or interested in
your work? A lot of people are interested in what you are doing
and can benefit from hearing about your project.
Internally, we should share the information with all
Example
our staff as well as the Division VP.
Externally, we think students would be interested in our
work and there are several other units on campus who
do work in community involvement (such as University
Honors and Scholars, WYSU, and Alumni Services) that
we could share our information with.
14. How and when do you plan to involve your major constituency groups in the assessment
process (e.g., data sharing and recommendation gathering)? (Related to HLC Criterion 4, Core
Component 4.B., Sub-component 3)
Notes
Explain when and with what groups you will share the findings of
what you intend to examine. It is important to include groups
outside your own unit. Make an effort to not just share findings
passively (e.g., put on a website) but also actively (e.g.,
presentations, discussions); it is also an opportunity to ask the
key groups what they see in the data and might recommend to
improve the unit.
We will compile the results from our survey and share
Example
the information with the groups listed above through:
monthly meetings with internal staff to update, present
data, and solicit recommendations; soliciting a story
about the results in the Jambar for students (spring
2013); and inviting other campus units to come in
person for a presentation and discussion of the data
(April 2013).
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
8
2012 Assessment PLAN Tips and Hints
Executive Summary:
15. Executive Summary (summarize the key ideas from section two only, Assessment Plan
Development, with a maximum length of one-half page).
Optional:
16. Is there anything else you would like to share regarding your assessment plan and/or is there
any particular area on which you would like assistance or feedback?
Notes
The Office of Assessment and the Assessment Council want to
hear about your questions and let us know what information or
assistance you may need
We reference some work in the plan that is not directly
Example
related to the learning outcome,—we didn’t feel like we
wanted to limit response to those questions to just
learning outcome related answers.
Also, we are not certain how to incorporate a direct
measure with this learning outcome—do you have any
ideas?
Please submit plans through the online system by Wednesday, August 15, 2012 at http://www.jotform.us/ysuassessment/2012naplan.
Rev. 7/3/12
Download