Steps in Student Learning Outcomes Assessment T O

advertisement
TAKE ON
ASSESSMENT
Steps in Student Learning Outcomes Assessment
1. Define intended educational outcomes
a. Identify audience
b. Determine what will be learned
c. Identify degree of learning desired
2. Identify methods for measuring outcomes
a. Where in the curriculum or program would we expect the learning to occur?
b. What opportunities are available to collect data?
c. How will data collection occur?
d. When will data collection occur?
3. Administer assessments (example below)
a. Observations
b. Testing
c. Survey
d. Recall/writing activity
e. Performance of task
f. Focus groups
g. Exit interviews
h. GPA
i. Placement/internship/advancement rates
4. Review results
a. Determine if outcomes were met
b. Determine if improvement to programs/service/course should be made
5. Repeat assessment cycle
StudentAffairs.Com, 2011
Tricia S. Nolfi
TAKE ON
ASSESSMENT
Developing Learning Outcomes




Who is the audience?
o Example: Student organization treasurers
What should they know, demonstrate, understand and apply, or value?
o Example: Ability to manage and balance an organization account
What circumstances/condition will facilitate the learning?
o Example: Participation in the Treasurer’s Workshop, individualized advisement
To what degree will the outcome be met?
o Regular and accurate accounting
The student will be able to demonstrate regular and accurate accounting after participating in
the Treasurer’s Workshop and through individualized advisement.
Effective Measures


What do you want to find out? What will be useful? What can help you tell your story?
Identify tools that will help you get the answer.
Capturing the Data
o Sample of population
o “Snapshot” in time
o Longitudinal study
The student will be able to demonstrate regular and accurate accounting after participating in
the Treasurer’s Workshop and through individualized advisement.
Measure:
 Work product: invoices, payment requests (accuracy), allocation request forms
 Observation: meetings with peers
 Self-assessment: post-workshop assessment (3-6 mo/s out)
StudentAffairs.Com, 2011
Tricia S. Nolfi
TAKE ON
ASSESSMENT
Linking Assessment to Plans
Sample Planning Guide
Unit Mission
Program/Service
Goal/Outcome
The ABC
Department
provides…
Student staff
training
To provide
supervisory
skills
StudentAffairs.Com, 2011
Measure(s)
 Knowledge
of ABC and
123
 Ability to a,
b, c….
 Accurately
doing that



Methods
Data
Collection
Use of Results
Observation
Supervisor
journals
Peer
evaluations
8/25/11 –
11/30/11
Performance
reviews
Staff
training
program
Tricia S. Nolfi
TAKE ON
ASSESSMENT
Assessment Resources
ACPA. ASK Standards http://www.myacpa.org/pub/pub_books_assessment.cfm. Free to members
ACPA. Assessment Planning Tool http://www.myacpa.org/pub/pub_books_assessment.cfm. Must be
purchased
Andreas, R. E. (1993). Program planning. In M.J. Barr (Ed.), The handbook of student affair
administration. (pp. 199-215) San Francisco: Jossey–Bass Publishers.
Assessment Offices in Student Affairs [sample list]
 Bowling Green State University
http://bgsu.edu/offices/ir/
 Indiana State University
http://www.indstate.edu/studentaffairsresearch/
 Indiana University - Purdue University Indianapolis
http://imir.iupui.edu/imir/default.htm
 Ohio State University
http://studentaffairs.osu.edu/sa_assessment.asp
 Rutgers, The State University of New Jersey
o Assessment Plans (http://ctaar.rutgers.edu/assessment/guidelines.html )
o Best Practices (http://ctaar.rutgers.edu/assessment/NotableIdeasandPractices.htm )
 Texas A&M University
http://studentlifestudies.tamu.edu /
 University of California - Davis - Student Affairs Research and Information
http://www.sariweb.ucdavis.edu/onepageofficesummary.pdf
 University of Georgia- Student Affairs Research
httpp://www.uga.edu/studentaffairs/assess/extres/index.htm#links
 University of Michigan
http://www.umich.edu/~rsa/
 University of Wisconsin System - Assessment in Student Affairs
http://www.uwsa.edu/acadaff/assess/index.htm
Assessment Update: Progress, Trends, and Practices in Higher Education. Inside HigherEd. Website:
http://www.insidehighered.com/
Bloom’s Taxonomy http://www.coun.uvic.ca/learning/exams/blooms-taxonomy.html
Council for the Advancement of Standards in Higher Education
 http://www.cas.edu/index.html
StudentAffairs.Com, 2011
Tricia S. Nolfi
TAKE ON
ASSESSMENT



The CAS Book of Professional Standards in Higher Education .
Self-Assessment Guides
Presentations on assessment: http://www.cas.edu/index.html
Galbraith STAR model: http://www.jaygalbraith.com/services/starmodel.html
Keeling,R P., Wall, A.F., Underhile, R., Dungy, G. (2008). Assessment reconsidered. NASPA
Publications.
Metrics and Rubrics are the best practice models for assessment.
 Northern Illinois University Research and Assessment Offices has a session on rubics:
www.niu.edu/stuaff/assessment/Student%20Affairs-Rubrics101.ppt
 UNC Greensboro has a great resource page for creating rubrics for student affairs
assessment: http://studentaffairs.uncg.edu/assessment/tools/
Knowing What Students Know: The Science and Design of Educational Assessment (2001). Read free
online at http://www.nap.edu/openbook.php?record_id=10019&page=1
Liddell, D.L. & Lund, J.P. (Ed.) (2000). Powerful programming for student learning: Approaches that
make a difference. New Direction for Student Services. 90.
Nolfi, T. & Ruben B. (2010) Assessing & Improving Student Organizations. NACA/ACPA.
http://tinyurl.com/4clpj65
Palomba. C and Banta, T.E. (1999). Assessment Essentials: Planning, implementing, improving
assessment in higher education. San Francisco: Jossey-Bass.
Ruben, B. (2009) Excellence in Higher Education. NACUBO
Suskie, Linda. What is "Good" Assessment? A Synthesis of Principles of good Practice. From "What
is "good" assessment? A new model for fulfilling accreditation expectations" presented at the First
Annual International Assessment and Retention Conference, Phoenix AZ, June 2006. (PDF
Download:
http://planning.iupui.edu/page/download/?key=129728430&path=/consult/conferences/natio
nal/06/handouts/monday/suskie.pdf)
Upcraft, M.L. & Scuh, J.H. (1996) Assessment in student affairs: A guide for practitioners. San
Francisco: Jossey-Bass Publishers.
StudentAffairs.Com, 2011
Tricia S. Nolfi
Download