Student Success
through Libraries:
A Mixed-Methods Model for Assessing
and Demonstrating Library Value
Jamie Edwards
Library Research & Innovative Practice Forum
June 4, 2015
Overview

Background

Problem

Methods

Findings

Implications

Recommendations

Conclusions
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Background

Library value to the community
 Serving
the learning and research mission of the
institution

Services and resources

Learning and accountability

Assessment in academic libraries

Student success
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Problem

How can libraries demonstrate and improve their
role in helping students achieve success

Intersections of the library and the student
experience
 Physical
and electronic collections
 Space
 Skills
training and workshops

Variety of methods

Holistic model
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Methods

Used ACRL guidelines and research to identify
areas of library impact on student success

Created rubric of “REAL” student outcomes
 Recruitment/retention/graduation
 Engagement/experience
 Achievement
 Learning
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Methods

Used EBSCO Library & Information Science
Source

Found 489 relevant records from 2010 to 2015

Chose 50 studies based on the REAL rubric

Analyzed the studies, created concept matrix

Used matrix and findings to recommend holistic
model
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Findings

Recruitment, Retention, and Graduation
 Nine
studies: mostly quantitative methods
 Library
 Most
resources (collections, staff, expenses, etc.)
looked at retention
 Existing
data sets; surveys
 Quantitative
found weak, but statistically significant
and positive correlations of library usage and
retention, etc.
 Qualitative
found positive student perceptions
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Findings

Engagement and Experience
 Sixteen
studies: mostly qualitative methods
 Relationship
 Use
between needs and perceptions
of library space, services, resources
 Nearly
all used surveys and questionnaires
 Several
used methods similar to ethnographic study
(e.g., observations, focus groups, interviews, etc.)
 Qualitative
methods provided rich results in
identifying needs; perceptions very positive
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Findings

Achievement
 Nine
 GPA
studies: only quantitative methods
as proxy for achievement
 E-resources,
 Existing
 Data
book loans, instruction
library and campus data sets
privacy
 Weak,
but statistically significant and positive
correlations of library usage and GPA
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Findings

Learning
 Sixteen
studies: mostly qualitative methods
 Information
 Library
literacy
instruction: delivery method; effectiveness
 Direct
measures: pre/post tests, assignments,
citation analysis
 Indirect
measures: surveys, focus groups, interviews
 Qualitative:
largely positive reflections of learning
 Quantitative:
Student Success through Libraries
mixed results
University of Maryland – Jamie Edwards – June 4, 2015
Implications

Trends
 Recruitment/retention/graduation:
mostly
quantitative methods with existing data sets
 Engagement/experience:
mostly qualitative methods
similar to ethnography on student needs/perceptions
 Achievement:
quantitative analysis of relationship
between library use and GPA
 Learning:
mostly qualitative analysis of information
literacy and perception of library instruction
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Implications

Gaps
 Some
studies used mixed-methods, though not always
meaningfully
 Recruitment/retention/graduation
and achievement
studies could use more qualitative methods to provide
richer stories and triangulation to support data
 Engagement/experience
and learning studies could
use more quantitative methods to provide big picture
numbers and data to support personal stories
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Recommendations

Collaborate with stakeholders
 Data
managers, student advisors, faculty,
administrators, library staff, and students

Holistic framework
1.
Align library mission and values with institution
2.
Identify key student outcomes critical to priorities
3.
Align assessment plan with outcomes and priorities
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Recommendations
4.
Identify complementary methods for triangulation
a.
Recruitment/retention/graduation: use data sets to look for
correlations between library use and student progress; support
with surveys, focus groups, interviews
b.
Engagement/experience: use ethnographic studies to look at
use of library space, services, resources; supplement with
survey and correlation data
c.
Achievement: use data sets to look for correlations between
library use and GPA; support with surveys of student and
faculty perceptions
d.
Learning: use pre/post tests and citation analysis to study
effects of library instruction on info lit; supplement with survey
and correlation data
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Recommendations
5.
Partner with stakeholders on campus
6.
Collaborate within the library to increase engagement
and strategic use of assessment
7.
Consider data quality, privacy, visualization
8.
Communicate results inside and outside the library;
share best practices and encourage further research
9.
Use feedback to inform further learning and strategy
10.
Incorporate learning, strategy, and communication into
planning initiatives
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Conclusions

Wealth of new research on assessment of
student success and libraries

Harness this data to create and improve
research models

Identify key student outcomes; align priorities
(strategic assessment)

Use mixed-methods approach for triangulation

Help libraries improve their support of students
and demonstrate their value
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015
Thank you!

Questions?

For more information, contact Jamie at
jamyung@umd.edu
Student Success through Libraries
University of Maryland – Jamie Edwards – June 4, 2015