Assessment of
Academic Advising
Tuesday, April 21, 2015
Carolyn Blattner (UCAE) & Elena Payne-Wiens (CoAA)
Goals
• Discuss basic principles of assessment of advising
• Consider tools for assessment
• Review current UNC Charlotte academic advising
assessments
• Discuss best practices for assessment of
academic advising
• Consider challenges of assessment
Assessment
“Assessment is the systematic
collection, review, and use of
information about educational
programs undertaken for the
purpose of improving student
learning and development.”
Palomba and Banta (1999).
Assessment Essentials.
What do we assess?
Customer satisfaction
• How satisfied with advising overall…
Learning Outcomes/Objectives
• UNCC has 7 Advising Learning Outcomes
Patterns/trends
• Numbers of contacts, survey data over time
Why do we assess?
• Improve services
• Help students attain goals
• Understand strengths/barriers
Continuous Improvement
UNCC Advising Outcomes (1)
As a result of the academic advising process at UNC
Charlotte, students will be able to
1. Evaluate personal interests and abilities leading to the
creation of realistic academic and professional goals.
2. Access and navigate the University online resources
and processes.
3. Develop an educational plan that leads to the timely
completion of educational goals.
UNCC Advising Outcomes (2)
As a result of the academic advising process at UNC
Charlotte, students will be able to
4. Access University academic and student support services
and resources.
5. Follow academic and administrative policies and procedures.
6. Develop the critical thinking and independent decisionmaking skills to make and accept responsibility for academic
decisions.
7. Discover and integrate co- and extra-curricular activities and
programs that enhance the collegiate experience.
Current University Surveys
1. SOAR surveys (every session)
• Response rate: FR = 89%, TR = 46%
• 6-7 questions on advising
2. Nat’l Survey of Student Engagement - NSSE
• First-years and Seniors every other Spring (2014, 2016…)
• 2014 Response rate: FR= 17%, SR = 20%
• 11 questions on advising
3. Sophomore Survey – every 3rd Spring (2013, 2016…)
• 13 questions on advising
4. Graduating Senior Survey - every 3rd Spring (2013, 2016...)
• 2013 Response rate: 77%
• 6 questions on advising
Other advising surveys
• BCoB – email (9 Qs), certain weeks of advising – SurveyShare
• CoE – email (5 Qs), annually (March) – Campus Labs
• CHHS – email (26 Qs), annually, after reg. – Qualtrics
• CoAA – email (10 Qs), annually, after reg. – Campus Labs
• UCOL – email (24 Qs), during advising – SurveyShare
• Criminal Justice – email (9 Qs), during advising– SurveyShare
• CLAS – computer (8 Qs), after advising session – Qualtrics
• CoED – computer, Seniors, required – TaskStream
• OASES – comp./email (16 Qs), during advising – Campus Labs
4 Common Question Groups
TIME
• sufficient
• quality
• availability
INFORMATION
•
•
•
•
•
courses, requirements, degrees
policies, procedures
support options, referrals
special opportunities
career and grad school
DEMEANOR
• professional, courteous,
• friendly, approachable
• listened carefully, concerned
OVERALL SATISFACTION & Comments
How can the data be used?
In several ways:
1.
2.
3.
4.
5.
6.
Provide informal feedback to advisors
Gauge effectiveness of services and processes
Gain general understanding of student satisfaction
Identify new initiatives, training, technology, etc.
Test effectiveness of new initiatives, technology, etc.
Other?
Challenges?
Feedback loop – sharing results
Using results
“Complainers” (how information is used)
Other?
Brainstorm!
Other ways to assess advising?
What else are we curious about?
Feedback from advisors, directors, other constituents
besides students?
Resources
Advising Redesign Report 2015: Academic Advising
Assessment Questions and Longitudinal Data – UNC Charlotte,
February, 2015 – includes data on all University surveys over
time. (Ask Advising Redesign rep)
Palomba, C.A., & Banta, T. W. (1999). Assessment
essentials. San Francisco, CA: John Wiley & Sons, Inc.
NACADA website – nacada.ksu.edu
Assessment of Academic Advising Bibliography
Assessment of Academic Advising Overview