SELECTED RESOURCES FOR CREATING THE ANNUAL ASSESSMENT REPORT

advertisement
SELECTED RESOURCES FOR CREATING THE ANNUAL ASSESSMENT REPORT
The purpose for this collection of information is to answer some questions faculty and
department heads may have about the annual assessment report and provide some resources
to assist with the process of creating that report. This packet includes:
•
•
•
•
•
The Assessment Cycle: Activities and Timelines
Some FAQs Related to the Annual Report of Assessment Activity
Completing the Annual Assessment Activities Report: Some Guidelines and Information
Closing the Loop (some questions to stimulate discussion about next steps after
assessment)
Responding to the Data (some questions and potential action steps)
For additional resources, see http://www.uni.edu/assessment/Assessment_Planning.shtml:
Thinking About Assessment
Why do we do assessment? What does good assessment look like? What does the
Higher Learning Commission expect from assessment activities? This link provides
some background information for thinking about assessment.
Developing an Assessment Plan
Writing an assessment plan involves determining what you want students to learn, how
your program will lead to student learning, and how you can get a clear picture of what
students have learned. The links below provide resources for some specific steps in
creating an assessment plan.
Organizing the Plan
Writing Learning Outcomes
Selecting Assessment Strategies
Reviewing the Plan
How do you know if you have a well-written plan, one that will be doable, deliver useful
information for your program area, and provide a clear explanation of your assessment
processes to those inside or outside of your department, whether they read it today or
ten years from today? This link provides both some general and specific guidelines for
evaluating your assessment plan.
Reporting Findings and "Closing the Loop"
What is the assessment cycle for UNI? What are the formats for assessment
reports? How can information from assessment activities be put to use for program
improvement? This link provides resources to help you make assessment an ongoing
process for reviewing your accomplishments and strengthening your program.
Individual consultation on creating assessment plans is also available by calling the Office of
Academic Assessment at 273-2778 for an appointment.
The Assessment Cycle:
Activities and Timelines
Annual
Assessment
Activities
Suggested
Departmental
Timelines
Implement the plan.
Fall/spring/summer,
according to plan
University/College/
Department
Deadlines
Assessment Office
Deadlines

Share the data.

Analyze, summarize,
and archive the
assessment data.
Share with
department faculty
no later than May 1.
Spring or summer

Use the data to
make changes to
courses/curriculum.

Evaluate learning
outcome statements
and the assessment
plan.
Fall and/or spring
semester
Record changes for
annual report.
Fall semester
Send assessment
activity report to
Department head &
Dean by
November 1.
Send assessment
activity report to
Academic Assessment
by November 1.
Submit program
self-studies by
deadline for
Academic Program
Review.

Revise curriculum
according to
timelines for
curricular review.
Create/revise/review
outcomes and the
plan for assessing
student learning.

Repeat the process
Complete (or revise/
review) plan and
learning outcomes
for each program by
end of fall semester.
Send reviewed and/or
updated learning
outcomes and
assessment plan to
Academic Assessment
by December 1.
FAQ’S FOR THE ANNFUAL REPORT OF ASSESSMENT ACTIVITY
What is the purpose of the annual report of assessment activity?
The annual report of assessment activity is intended to serve both the department and the
university. For the department, the annual report is intended to provide an overview of
assessment activity and findings that can be read quickly to see what assessment activities
were implemented in a given year, what was learned, what plans were made to put assessment
information to use, and what changes were made in response to previous year’ assessment
findings—without having to read through tables, graphs, or pages of specific detail. The annual
reports can serve as a useful resource for completing Section V of the Academic Program
Review, as well as for reviewing and revising student learning outcomes and program
assessment plans.
For the university, the annual report provides a university-level (as opposed to department- or
program-level) archive of assessment activity that can be easily accessed for an institution-wide
picture of assessment activity across programs, departments, and colleges.
Does a department have to do its annual assessment report in two forms—one for the
Office of Academic Assessment and one for the department/College Dean?
The annual report of assessment activity submitted to the Office of Academic Assessment is
intended to be a summary of assessment activities, findings, and resultant decisions/actions
related to delivery of the program and to its assessment.
Department/program areas may create their own format for reporting on assessment activity
within the department and then use the annual report template the capture the highlights of
assessment processes, findings, and decisions resulting from assessment activity. Another
alternative for department/program-level reporting would be to use the sections of the annual
report template from Academic Assessment to label sections of the department/program report
and then include whatever additional information would be useful for a more complete report at
the department/program level—e.g., tables, graphs, appendices, detailed descriptions/
explanations/analyses, etc. Following the general structure of the annual report template would
facilitate the creation of the annual report for the Office of Academic Assessment.
When is the annual report due to the Office of Academic Assessment?
The report is due to the Office of Academic Assessment by November 1 of the academic year
following the year for which assessment activity is being reported. College Deans and/or
department heads may have an earlier deadline for submission of assessment reports.
Who has access to the annual report that is submitted to the Office of Academic
Assessment?
Annual reports of assessment activity are archived in electronic format on a computer drive in
the Office of Academic Assessment that is accessible to staff working in the office. The reports
may be shared with the President, the Provost, the Associate Provost for Academic Affairs, the
Associate Provost for Faculty Affairs, or their designees, upon their request. When a system
for peer review of annual assessment reports is created, peers serving as reviewers will have
access to annual reports assigned to them for review.
COMPLETING THE ANNUAL ASSESSMENT ACTIVITIES REPORT: SOME GUIDELINES AND INFORMATION
Name of College:
•
Is all of the information in this section completed?
•
Does the information provided here allow this report to be read without the need to refer to
other documents—e.g., the assessment plan that was being followed, the particular set of
learning outcomes, the stated overall purpose/goal of the program at the time of the
assessment activities, etc.
•
Could a reader easily locate other documents related to this report—e.g., a more detailed
report, the particular assessment plan and version of program learning outcomes used when
the activities in this report were implemented?
•
Is the date of submission for the fall following the academic year in which the activities were
carried out? I.e., a report dated November 1, 2011, would report on assessment activities
during the 2010-2011 academic year.
Name of Department/Unit:
Program:
Department/Unit Mission:
Program Learning Goals:
Person submitting this report (name and e-mail):
Date submitted:
Assessment Measurements Conducted During the Current Year
Student Learning
Outcomes Assessed
Assessment Procedures (Include
methods used, when and where
implemented, number assessed,
person responsible, etc.)
(Outcome)
•
(Outcome)
•
(Outcome)
•
(Outcome)
Are both course titles and
numbers included when cited?
Are the instruments used clearly
described and/or accurately
labeled?
Is the process described clearly
enough to be understood by an
external reader or over time?
Summary of Findings
(Tables, graphs, and more detailed
reports are kept at the
department level.)
• If there were targets for
performance, are those
included?
• Are the findings clearly stated?
• Are the findings evaluated/
analyzed? I.e., is information
provided to indicate the context/
impact of the findings?
Methods Used for Sharing
Assessment Information
•
•
How was information shared with
faculty?
Was any part of the information
gained shared outside of the
department? If so, what was
shared with whom, and through
what media?
Next Steps: Are changes indicated, along with timelines for action? If no changes are needed, is this space used to indicate that? To see a list of potential action
steps, see http://www.uni.edu/assessment/documents/closingtheloop.pdf, “On Using Assessment Information and Closing the Loop.”
Follow-Up Report on Changes Recommended in the Previous Year
Focus for Follow-Up
Recommended Program Changes
Actions Taken
•
Revisions to Student Learning Outcomes
SOA Plan Revisions
•
Are action steps clearly described, with
timelines for action and the group and/or
persons involved in the actions indicated?
If the action is not yet complete, is additional
information provided in the next column?
Comments/Further Action Steps
This space can be useful for indicating information
such as what worked or didn’t work with the
change processes used, what steps might be
taken next, how the effectiveness of the changes
might be evaluated, etc.
Additional Comments: (E.g., lessons learned; thoughts for future assessment planning, budgeting, or strategic planning; resources to explore, etc.)
Anything not already captured which could be useful to a future reader of this report and/or guide future thought or action related to the program or its assessment.
Closing the Loop
“Closing the loop” refers to making use of information gained from doing assessment in order to
make improvements—in assignments, in courses, in curricula, in program support and services,
and even in the assessment process itself. This page and the following one suggest some possible
directions and strategies for reviewing and putting to use what has been learned from completing
assessments.
CLOSE THE
LOOP
ASK
QUESTIONS
The Assessment
Process:
ANALYZE &
REPORT
The Steps and
Some Questions
for Planning
PLAN
IMPLEMENT
The plan
• Was it doable?
• Was it implemented as planned?
• Was the timing right?
• What changes would you make?
Data
• How did the data collection tools work?
• Was data analysis effective?
• How useful were the data?
• What else would you like to know?
Program decisions
• What might explain student successes?
• Why might student achievement vary from the expected or desired?
• What resources might students need to succeed?
• What changes could be made in learning outcomes? Courses? Assignments? Curriculum?
Systems
• How are changes introduced and implemented?
• How are changes documented?
• Are reports working?
• Are documentation, storage and retrieval processes working?
• Are lines of communication and collaborative processes working?
Responding to the Data
Some Ways to Use Assessment Data
•
To identify the strengths and weaknesses of students in the program(s) related to
specific content knowledge
•
To identify the strengths and weaknesses of students in the program(s) related to
broader degree-related skills, such as writing, oral communication, critical
thinking, research/information seeking, etc.
•
To analyze and/or improve content, assignments, etc., for specific courses within
the program(s)
•
To compare current performance of students in the programs with previous
performance of students in the programs
•
To compare student performance with levels of performance expected by
employers and/or graduate or professional programs
•
To identify resources (programs, services, etc.) that could add to levels of
student achievement in the program(s)
•
To determine potential program changes for the curricular review cycle (e.g.,
additional courses, courses to delete, courses to revise, etc.)
•
To provide information for determining needs for specific faculty expertise when
hiring faculty members
•
To identify information that can be used in recruiting students to the program(s)
and/or providing information on the program(s) to such groups as parents,
employers, etc.
•
To analyze and/or improve program assessment procedures
•
Other . . .
Some Action Steps:
•
Modifications, additions, deletions to courses in the curriculum
•
Changes, additions, deletions to course assignments
•
Modifications to program requirements (e.g., prerequisite courses, course
sequence, specified levels of attainment, etc.)
•
Revisions to program goals and outcomes
•
Changes to the assessment methods, strategies, timing
•
Non-curricular changes (i.e., laboratory facilities, departmental policies and
procedures)
•
Addition, deletion, modification of services/support for students
•
Other . . .
For additional information, see http://www.uni.edu/assessment/documents/closingtheloop.pdf.
Download