Process, Forms, Meeting Outline

advertisement
Consultation Process for Assessment Reports in the Division of Student Affairs
Purpose
The purpose of the assessment report consultation process is to assist departments and
units in developing, refining and better reporting the outcomes of their work. We consider
this a conversation meant to help clarify and improve the assessment work in the Division
of Student Affairs.
Rationale for Assessment Report Consultation Process
The review of unit’s assessment plan and report has been altered in order to provide a
more targeted consultation with units and departments as well as to help units and
departments make updates and changes in assessment plans based upon the
consultation concerning their assessment reports.
The new Assessment Report Consultation Process has two goals:
1. To meet individual units at their level of knowledge and skill in order to help them
progress, in reasonable steps, in the area of assessment. Units within the division
are at various stages in their development of a unit culture of inquiry which includes
documenting that journey and its outcomes.
2. To make the best use of time for unit representatives and assessment council
consultants. Some units may need more consultation than others in order to
progress.
Responsibility of Assessment Council Consultants
Reviewers will arrange the meeting after they have reviewed the assessment report and
will facilitate the conversation during the review. The purpose of the review is to aid units
in developing and documenting a process and the outcomes of that process. Decisions
should be clearly documented and relate back to the data that was collected and the
meaning that the unit made of that data. The rubric and meeting notes will be posted on
Compliance Assist after the review consultation has occurred.
The reporting of data is necessary but not sufficient in the assessment process. An
evaluation of the data and its usefulness in helping to answer the question or measure the
degree to which an outcome was met is essential.
Help units to evaluate what they have done via reflection and purposeful thought about
how it could be improved in the next iteration. Praise areas of strength and ponder issues
that are a struggle. Think with the department not for them.
Responsibility of Units/Departments
Units/departments are responsible for engaging in the assessment process and the review
of their work. This includes submitting reports in a timely manner in Compliance Assist so
that they can be reviewed in either September/October or January/February and notifying
Maureen Cochran when the report is ready to be reviewed.
Approved by the Student Affairs Assessment Council, 9-12-12
1
The assessment council reviewers will set up a day and time to come to the
unit/department to discuss the assessment report. The unit/department head, the
departmental assessment contact and any other people the assessment contact invites
should be present at the meeting. The unit/department will be asked to present their
assessment work, addressing the points listed under “Agenda for the Assessment Report
Consultation Meeting.”
This is intended to be an intentional conversation about the work of the unit/department
and how the assessment council members can be helpful in answering questions, offering
suggestions, etc. related to the assessment work.
One of the goals of this meeting is to come up with a plan for improvement in the
assessment work. The “plan” must be able to be implemented thus the unit/department
and the reviewers should come to some agreement about what is feasible/realistic. The
assessment work is a process that must consider resources, expertise, etc. knowing that
not all units will progress at the same rate.
Assessment Report and the Consultation Process
1. All units will submit annual assessment reports in Compliance Assist during one of two
time periods:
a.
Units will choose either September 15-20 or January 15-20 to submit
reports
b.
Each unit will provide Maureen Cochran with notification of which date the
unit is going to use for their report submission date (September or
January). This is due to Maureen by August 30 so that there is sufficient
time to schedule consultants and so that we know which areas of
Compliance Assist to monitor.
c.
Assessment reports submitted at other times may not be reviewed in
order to be respectful of assessment council consultant’s time and other
commitments. Units will however be responsible for continuing to improve
their assessment plans and reports.
2. The reports are the documentation of full-cycle assessment. These reports contain the
mission, goals, outcomes, methodology for assessing each outcome, results (making
meaning), and decisions/recommendations/actions taken based upon the results.
3. For those departments who would like additional help in developing their assessment
plan for the coming year, assessment council members can serve as consultants for
plan development. This is done in order to aid units in acting on suggestions for
improvement discussed in the meeting.
4. Assessment report consultants will read through the reports and note suggestions on
the report rubric as in previous years.
5. Consultants will agree on the major points to be discussed at the meeting with the unit
and they will set up a time to meet with the unit representatives.
6. The Unit whose report is being discussed will present their report, significant findings
and decisions made using the results at the time of the review. This should also
Approved by the Student Affairs Assessment Council, 9-12-12
2
include any questions or issues that are of concern upon which the unit would like
some feedback or help.
7. Reviewers will document their conversations with units and the steps that the unit
agrees to engage in for the next year.
8. If a unit wants further consultation on how to further develop or refine their plan for the
coming year, the consultants can assist with this as well. The requesting department is
responsible for setting up the consultation follow-up meeting about plan improvement.
Agenda for the Assessment Report Consultation Meeting
1. The Unit whose report is being reviewed will provide an oral report/overview of their
assessment report along with any questions or issues upon which they would like
feedback. The oral presentation will address the following questions:
a. What question or questions was/were your assessment designed to answer?
What did you want to learn from your assessment?
b. To what degree did your results provide you with information to answer the
question you had?
c. What specific findings helped you to make a decision, alter a program or
teaching method, etc.?
d. How did you use the information? What actions were taken? Who will you
share this information with and how?
e. What if anything would you do differently next time?
2. The consultants will provide observations, suggestions and clarification around those
issues that are of primary importance to the unit.
3. Additionally the consultants will offer suggestions which may aid in improving the level
of the understanding or clarity of the report.
4. The meeting concludes with an agreement on what updates/changes or areas to be
worked on in the following assessment year. Consultants document the agreed upon
steps or areas for work in the coming year and post the rubric and meeting notes in
Compliance Assist and notify Maureen Cochran when this is completed.
Approved by the Student Affairs Assessment Council, 9-12-12
3
Preparation for Consult
Assessment Report Consultation Process Flow Chart
Assessment
Report is
Ready for
Review
Unit notifies
Maureen
Maureen
notifies
consultants
Consultants
set up mtg
with unit
Consultants
meet to
prepare for
mtg with
unit
Consultants
review
rubric
comments/
issues
Consultants read
report using rubric to
note any major issues
Note any
major
problems
with
report,
Review
agenda
Consultation Meeting Outline
Meeting with Unit: Note those in attendance (prefer that
department head takes part in this meeting)
Provide an orientation to the meeting, set parameters,
make introductions
Introductions
Any
Questions/
Issues
Presentation
of report by
unit
Conversation
with unit
What went
well
What didn’t
go so well
Was data
useful and
how
What will unit do to improve
assessment in the coming year?
Document this on the agenda form.
Completion
Closing the meeting: Praise the good things, tell them
how to get help revising their plan if they desire, confirm
steps they will take to improve assessment, thank them
for their time/interest, etc. How they can view
comments, etc. on Compliance Assist.
Consultants
type up
notes and
post in
Compliance
Assist
Send notice
to Maureen
when this is
completed
Consultants
notify unit
when notes
are posted
in
Compliance
Assist
Approved by the Student Affairs Assessment Council, 9-12-12
Hurrah! Consultants
finished unless unit
wants help with plan
in which case the unit
may contact you for
assistance.
4
Department/Unit Name:
Date of Consultation:
Names of Consultants:
Department/Unit Representatives in Attendance:
Outline: Agenda for the Assessment Report
Consultation Meeting
I.
Introductions and Purpose of the meeting
a. Personal Introductions
b. Set the tone as a meeting with a purpose but also the conversational nature of the
meeting and the clear offer of help
c. Peer to peer consultation on assessment work
d. Frame the time available (typically 1 hour) and that if additional meetings are needed,
that they can be scheduled at the end of the meeting
II.
Ask the unit what questions they would like to address first or how they thought their
assessment process went this year
a. Note these.
III.
Presentation of Assessment Report by Unit (brief—no more than 20 minutes)
a. Brief presentation of the report addressing the 5 questions
b. Addition of any other questions or concerns of the unit/department
c. Complement them on their work
1. What question or questions was/were your assessment designed to answer? What did
you want to learn from your assessment?
2. To what degree did your results provide you with information to answer the question you
had?
Approved by the Student Affairs Assessment Council, 9-12-12
5
3. What specific findings helped you to make a decision, alter a program or teaching
method, etc.?
4. How did you use the information? What actions were taken? Who will you share this
information with and how?
5. What if anything would you do differently next time?
IV.
Respond to the units questions/concerns and/or major areas that you believe would
make a difference in their report.
a. This is a give and take conversation that is up to the consultants how they proceed in
helping the unit move forward. Again, think with the unit and not for them. Suggestions,
ideas, etc. are fine but also help them to think about how an improvement might occur.
V.
Near the end of the meeting aid the unit/department in planning next steps. What will
they do to improve their assessment work in the next iteration?
a. Write this down as we will send it back to them after the review notes are posted in
Compliance Assist and Maureen is notified.
Approved by the Student Affairs Assessment Council, 9-12-12
6
VI.
Closing Remarks: What happens next??
If you would like further consultation or help in implementing some of the improvements in your
next assessment plan we are willing to help. Please let us know and offer some times/place,
etc. for this meeting. It is probably better to meet sooner rather than later for this next
consultation.
We post copies of our comments and agreed upon next steps on Compliance Assist under
your department/unit name. These are kept on file to refer to throughout the year and again at
next year’s consultation meeting. A summary report is provided to Dr. Larry Roper, Vice
Provost for Student Affairs regarding each department/unit’s status concerning assessment.
Thank you for taking your time to meet with us and to work on assessment for continuous
improvement in your unit.
Approved by the Student Affairs Assessment Council, 9-12-12
7
Download