Refresher Course on Assessment

advertisement

Refresher Course on Assessment

January 22, 2016

A Workshop for Department Chairs, Program Directors, and Others

Why do I have to turn in an assessment report?

Middle

States

We do annual assessment each year in order to meet the accreditation standards set forth by the Middle States Commission on Higher

Education (MSCHE).

The assessment process at Rutgers is organized at the University level for all academic unist by the Executive Council on Assessment (ECA).

The ECA ensures compliance with standards set by MSCHE.

Nursing CCAS

Graduate

ECA

Business

Undergrad

Reporting

Unit

Reporting

Unit

Law

What is assessment?

According to Barbara Walvoord: “ Assessment is the

“systematic collection of information, using the time, knowledge, expertise, and resources available, about student learning to inform decisions that affect student learning.” (Assessment Clear and

Simple, 2010)

Where do I begin with assessment?

Before you can submit an assessment report, you’ll need a current assessment plan.

An assessment plan is comprised of five parts:

1. Learning Goals

2. Methods

3. Standards, Benchmarks, and

Tools

4. Timetable

5. “Closing the Feedback Loop”

Learning goals must be measurable, manageable, meaningful.

student-centered. grounded in continuous improvement. comprised of three categories: knowledge, skills, and habits of mind.

Learning goals must also be publically accessible online.

on all course syllabi (which should also be publically accessible online).

Learning goals are also hierarchically aligned.

Rutgers

College

Reporting Unit

Course

Sample Learning Goals : Biochemistry and Molecular Biology

Upon completion of the major, we intend that a BCMB student will...

1. Possess a broad and fundamental understanding of biology and chemistry with particular focus on how molecules found in biological systems confer the properties of living organisms.

2. Be able to perform the common methods and use the tools of the field including laboratory and computational techniques.

3. Have the ability to conduct independent scientific investigation and scientific inquiry.

4. Be able to locate, evaluate, and communicate scientific information effectively both by written and oral presentation.

The two basic methods of assessment are

Direct assessment , meaning they look at actual student work

(papers, tests, portfolios, presentations, licensure exams, etc.) and

Indirect assessment , meaning they look at anything that is not direct

(surveys, exit interviews, placement rates, etc.).

Both direct and indirect methods and tools are detailed in terms of reporting unit, not course level.

Standards and benchmarks measure to see if learning goals are being met appropriately.

do not always appear in assessment plans.

Standards show the level in which students are meeting or exceeding expectations.

Benchmarks quantify the standards:

80% of students exceeded our expectations on the final exam = standard.

We expect 85% of students to do well on the final exam = benchmark.

A rubric is helpful tool to apply the standards.

Fails to meet expectations

Meets expectations Exceeds expectations

The work is well organized

The work uses appropriate analytic techniques.

The work shows clear understanding of basic concepts.

The application of basic concepts is sensible and reasonable.

Your timetable should be cyclical, assessing all learning goals every 2-4 years, instead of trying to address them all at once.

Learning goals 1 and 2

Learning goals 3 and 4

Learning goal 5

You are required to do at least one form of direct assessment each year.

Learning goals 1 and 2

“Closing the feedback loop” means acting on the results of your assessment to foster improvement.

It involves looking at your data in relation to your learning goals. Ask yourself: to what degree do we meet these goals? identifying and stating ways to address the gaps. looking at new data to see if you have addressed the problem. If you identified a problem in 2012 and made a plan to fix it, have you analyzed the outcomes in 2015? If not, you still have not “ closed the loop .”

Example: We noticed last year that students were not performing well on their final papers, so we implemented a two draft policy to check their progress before they turned in their final drafts. Students did better overall after turning in two drafts.

Who will do this assessment?

Assessment is a shared responsibility. As such, each reporting unit must establish an assessment committee to ensure that all yearly requirements of assessment are met.

When does all of this happen?

All reporting units are required to have a current assessment plan submitted to TMAC by February 15 th .

Keep in mind that all assessment plans should be periodically revised.

At the end of spring semester, you’ll submit your assessment report.

So I need a plan by Feb. 15

th

and a report by spring?

That’s correct.

The assessment report is what gets submitted to TMAC by the end of the year. This gets compiled into a larger CCAS report, which then gets sent up the hierarchy chain all the way until it gets to MSCHE.

Okay, but what’s in the assessment report?

The assessment report is actually quite simple. It’s a standardized form that you fill out based on your assessment plan , your analysis of the plan, and your actions to close the feedback loop .

And don’t worry, TMAC is here and happy to help you if you’re stuck or if you just want some feedback on your plan, report, or both!

So let me get this straight…

Each year I have to

A. Form an assessment committee

B. Create or revise a current assessment plan

C. Ensure we are analyzing and acting on the plan

D. Submit that plan by Feb 15th

F. Report our findings each year in spring and that’s it?

That’s it!

Except it’ll actually be your assessment committee that shares the responsibility of letters B-F!

Download