Using Data to Motivate: An Inexpensive and

advertisement
1
Using Data to Motivate: An Inexpensive and Student-Focused
Approach to Retention Problems and Solutions
Debbie Kepple-Mamros
Director of Institutional Research and Coordinator of Retention Activities
Graceland University
kepplema@graceland.edu
Abstract - Higher Education has come to accept that retention is a formidable challenge that only
big data can help meet. In response a niche market has been developed by software providers who
offer ‘retention solutions.’ While these programs may favorably impact retention, they tend to
place most of the responsibility for ensuring success on the university. The expense of purchasing a
‘retention solution’ in addition to the personnel costs associated with installing the software,
coordinating the program, possibly duplicating longstanding retention programs and coordinating
student interventions can be cost-prohibitive. Graceland University has accepted that retention is a
complex problem and that the solution to it must be data-driven but has rejected that this needs to
be done by an outside provider. Utilizing a reporting system already in place, the institution
harnessed data and put it in the hands of the individuals who can make actionable changes: the
students. All students are sent information like personal class attendance records and midterm
GPAs, which encourages improved personal responsibility. By recognizing that the solution could
be internal Graceland has been able to improve retention and save money by developing the power
of its existing tools and staff.
Introduction
Higher Education has come to accept that retention is a formidable challenge that only “big data”
can help meet. In response a niche market has been developed by software providers who offer ‘retention
solutions.’ These software solutions are sometimes too big or not nimble enough to target the root of
attrition for some small institutions. A main cause of attrition is often each individual student’s academic
experience (Demaris, 2008). This paper does not seek to discount the culture and socio-economic status
of students and its impact on persistence. It’s well documented at all levels of education that income plays
a large role in success (Payne, 2005). It also does not seek to diminish the role that student life, athletics
and admissions can and should play in retention. Rather, it supports the theory that a key contributor to
student attrition is the students’ academic experiences. Many areas across campus can favorably impact
student success through both one-on-one interventions and systemic changes and it’s the students who
potentially need interventions that most retention software seeks to identify. Still, the question lingers
about whether retention products are successful enough to justify their costs. The primary thesis of this
paper is that most small institutions have the ability to identify these students using their own data and
institutional knowledge without spending tens of thousands of dollars for a product created by an outside
provider.
While some of the available products may favorably impact retention, the responsibility for
ensuring success remains the university’s. The expense of a‘retention solution’ plus the personnel costs
associated with installing the software, coordinating the program, possibly duplicating or usurping
2
longstanding and successful retention efforts and coordinating student interventions can be costprohibitive. Graceland University has accepted that retention is a complex problem and that the solution
to it can be data-driven but has rejected that this needs to be done by an outside provider.
Some of the retention solutions are great products with the ability to securely access your student
information, set up a platform, store information in a cloud, and provide immediate alerts to staff when
interventions are necessary. The analysis they provide based on either local data or national comparisons
can also be valuable. However, institutions who find these products most useful are typically those who
have come late to the retention game, like highly selective institutions who only recently noticed a
retention decline or institutions whose funding was not entirely dependent on student enrollment. The
economy of the last decade has changed higher education, and for the first time many small private
colleges with small endowments are finding themselves at the leading edge. For most small private
colleges, retaining students to graduation has been a priority since the 1980s. Retention directors or
committees using good learning management and reporting systems allow small institutions to identify
students in need of help and provide the personal attention for which small colleges are known.
Graceland University is a small liberal arts institution located in one of the poorest counties in
Iowa. Like many private colleges, Graceland was established in the 19th century by a Christian church. Its
sponsors envisioned a non-sectarian institution of higher education open to all people regardless of
religion, or financial or social status. As Iowa’s first regionally accredited junior college, it flourished as a
two-year institution throughout the first part of the 20th century. Then in 1960, Graceland responded to
economic and educational changes and transitioned to offer baccalaureate degrees. In January 1988, the
institution responded to another societal need and launched its first distance learning nursing program. In
the 1990s, acutely aware of the needs of both nearby community college students and the fragile smalltown workforces, Graceland established low-cost transfer opportunities at satellite centers at three rural
community colleges. Then with the initiation of the first graduate program in 1995, Graceland reviewed
and revised its mission to include graduate study. It now offers 34 bachelor’s degree options, master’s
degrees in education, nursing and religion, and a doctorate in nursing practice from campuses in Lamoni,
Iowa and Independence, Missouri as well as bachelor’s degree completion programs at satellite centers.
Over the past several decades, Graceland has experienced another significant change, not
unknown to other small colleges across the country. Graceland has always seen itself as fairly diverse for
a small private institution in the Midwest but that diversity has changed. Prior to the 1990s, the majority
of Graceland’s student population was associated with the sponsoring church. In Fall 1985, 82% of
Graceland’s total student body were members of this sponsoring church. In Spring 2014, only 33% of
students on the residential campus were members of the sponsoring church.1 In Fall 1985, 17.7% of the
student body participated in athletics. In Spring 2014, 56% of the student body actively participated in
athletics. In Fall 1985, the student body hailed from 42 states and 10 countries. In 2013, Graceland’s
students came from 44 states, two territories and 32 countries. In Fall 1986, the earliest date for which
Graceland has electronic records that indicate race and ethnicity, 89% of the student body were white US
citizens. Of the other 11%, almost half of them were international students. In Spring 2014, the
percentage of international students was higher, 9% compared to 5% nearly thirty years earlier, but the
1
The percentage is much lower if distance education students and those in the face-to-face completion programs are
counted. In 1985, all Graceland students were associated with the residential campus. For accurate comparisons, all
2013-14 numbers will refer to the residential campus.
3
most significant change was in the number and percentage of members of minority groups. Just over 27%
of Graceland’s student body now identify as non-white US citizens compared to 5% in 1986.
More recent comparisons show that the number and percentage of low-income students has gone
from 34% of the incoming class in 2002 to 52% in 2013, and the type of poverty has changed. Graceland
is seeing more students who have experienced urban as opposed to rural poverty. We have also seen an
increase in additional high-risk populations. Several students each year enroll after aging out of foster
care. We are beginning to enroll students who grew up in migrant farm worker households. Finally, we
are experiencing an increased number of traditional-aged students from out-of-state who are single
parents, who lack a local, familial support system. One thing that has not changed much over the past 30
years is the students’ academic profile. Taking into account the changes in the scaled scoring, Graceland’s
incoming classes today have the same ACT average of 21 as they did 30 years ago.2 Graceland’s students
are academically average. Yet, many of them are under-resourced and lack more than just money or
access to credit.
An under-resourced student is a student who not only lacks access to money, but also lacks a
support system and mentors who understand the system in which they, the students, are trying to succeed
(Krodel, 2011). Many of today’s students come to college with assumptions that administrators and
instructors fail to recognize - just as the students are incapable of recognizing the assumptions of the
faculty. They lack the language and understanding of higher education. Many who come from underresourced schools, lack the vocabulary to comprehend lectures and written course materials. In addition,
many students tend to arrive at college with a belief that intelligence is a fixed trait (Doyle and
Zakarajsek, 2013). According to Terry Doyle and Todd Zakarajsek, in their work The New Science of
Learning, “Each fall, tens of thousands of students enroll in classes that they do not believe they have the
ability to pass. They also believe that hiring a tutor, visiting the professor during office hours for extra
help, or even working harder will make no difference (Doyle and Zakarajsek, 2013).” Contemporary
culture has made things more challenging. Many first generation students believe that seeking help is a
sign of weakness. Many low-income students not only struggle to pay for required textbooks, they begin
with the assumption that books are not a valid source of information and that they can navigate the
classroom environment through their peers and instructors. In short, under-resourced students arrive in
classes with some critical assumptions that need to be recognized and appreciated in order to make a
difference in their persistence (Kirsch, 2013). Software has little chance of understanding or counteracting
these traits.
In the face of this changed situation and the retention challenges that come with it, it seemed like
the perfect time for Graceland to contract with a vendor who offered a retention solution, and we explored
three such products. While each product offered us something new, all overlapped with things we were
already doing. And while adamant to improve retention, Noel-Levitz data indicated that our retention was
already exceeding the expectations of our student profile. Graceland’s data in the CSRDE Retention
Report from June 2014 compared favorably to institutions of similar size, academic profile and location
(Whalen, ed., 2014). A 5-year average retention rate for first year students of 69.9% was good. Thus we
2
In 1989, the ACT was replaced with the enhanced ACT, which was a longer test and had different methods of
scoring. The enhanced ACT average scores increased by 1.8 points across the US. Graceland’s first year class in
1985 had an average ACT score of 18.8. The 2013 first year class had an average of 21. A score of 20.9 was
reported as the national average for students taking the ACT in 2013.
4
did not expect to experience the large retention improvement that the products were claiming. Most of the
vendors insinuated that their pricing correlated to the expected retention gains. We were skeptical. Like
most small institutions in the wake of the most recent recession, many programs and academic
departments are constrained by shrinking budgets. Spending tens of thousands of dollars for a product
that we had some reservations about just didn’t make sense. After much thought and planning, we decided
to implement the main processes of these retention solutions using the systems and people we had in
place.
First Graceland acknowledged that many retention efforts were already in place. The University
has had a TRIO Program in place for decades and has long had developmental courses that count for
credit towards graduation. There is an understood institution-wide ‘mission’ to make personal
connections with students. The research on class sizes has produced varying results, with some studies
showing that class size has little impact on the factual knowledge students retain, and others showing
students in smaller classes acquire problem solving and written communication skills much better (Center
for Excellence in Teaching and Learning). Graceland’s faculty pursue the latter outcome and have
aggressively protected the caps on class sizes in order to promote student-faculty interactions, which
allows them to teach these skills across the disciplines. As a result, less than 5% of Graceland’s courses
have more than 44 students enrolled.3 While dated, research conducted by Steve Chatman in 1996 showed
that 10% of course sections offered at universities nationally had greater than 44 students (Chatman,
1997). At Graceland, 63% of course offerings have fewer than 20 students, with an average class size
across all undergraduate sections between 17 and 18. Graceland has had an Enrollment and Persistence
Committee since the 1980s, and appointed a Coordinator of Retention Activities in 2010. Yet, we knew
we needed more. Fortunately, in 2010, Graceland also transitioned to JICS, a Jenzabar product, and with
that transition acquired its first learning management system. In the same year, the report writing system
transitioned from Improptu to Cognos and new report writers were trained.
Retention Solutions on a shoestring budget – or Homegrown Retention for Small
Institutions
Graceland’s faculty, staff and administrators, through experience, training and professional
development, understand that many of our students, being under-resourced, don’t know how to monitor
their own learning. They do not have the experience of following their progress in a course by adding up
the points they have received and dividing that number by the total points possible. They have not had
mentors to show them how to manage their time or create daily schedules. With the understanding that
data could not solve these problems but rather identify students who needed help, Graceland set out to
build its own retention solution step-by-step and completely customized. Utilizing Cognos and the
learning management system, the institution harnessed data and put it in the hands of the individuals who
can make actionable changes: the students. All students routinely receive information like personal class
attendance records and midterm GPAs, which encourages improved personal responsibility. By
recognizing that the solution could be internal Graceland has been able to improve retention and save
money by developing the power of its existing tools and staff (Kelly, 2013). Expectations are now
explicit: go to class, keep up with your coursework and focus on your academics. By making expectations
3
33 course sections out of 374 undergraduate offerings had 40 or more students registered. Graceland University,
Institutional Research, Common Data Set, 2013.
5
explicit, which is absolutely necessary for under-resourced students according to Eric Jensen, individual
instructors and the university as a whole are building hope, a necessity for high-risk student success
(Jensen, 2009). In order to make sure students understand that we expect them to go to class, every class,
every day, turn in all homework and strive for successful completion of 15 s.h. each semester, Graceland
implemented multiple early warning systems each with the goal of promoting personal responsibility
among the students.
Attendance
In fall 2010 Graceland began to require all instructors to record class attendance through the
learning management system, Jenzabar’s eRacer. This move, the first in a series of steps to make
expectations explicit using data, was controversial among some faculty members initially but has since
been embraced. The learning management system’s attendance component automatically defaults to show
each student as present. Instructors simply need to go in and make a choice from a drop down box for
students who were tardy, absent-excused, or absent-unexcused. For students and instructors the difference
between the three can be significant. An excused absence could allow a student to make up a quiz. Being
tardy might allow the student to take the quiz and only be docked points after a certain number of late
arrivals. Attendance records can be easily accessed by students and instructors but any benefit for the
students stands on the assumption that they know to check the attendance portion of the course page and
know that a high number of absences will negatively affect their learning and their grade.
To combat this, two additional methods of communicating to students that attendance is
important have been incorporated. Many instructors utilize an option with attendance that automatically
sends an email to a student after they have missed so many class meetings, usually 3-4. It continues to
send an email for each subsequent miss. The simple email message is shown in Figure 1:
From: webadmin@graceland.edu [mailto:webadmin@graceland.edu]
Sent: Thursday, September 12, 2013 1:57 PM
To: sxxxxxxxxxxxxxxxxxxxxxxxx
Subject: Absence warning for student xxxxxxxxxxxxxxin World Civilizations I
This e-mail warning has been generated because Student xxxxxxxxxxx has 6 unexcused absences in
World Civilizations I (HIST1310 (GC13) 1; Faculty: xxxxxxxxxxxxxxx).
Figure 1: Absence Warning.
The messages are not easily customizable but the benefit of even a canned message is that it tells the
student that they were missed.
Another layer was added to the attendance message at the suggestion of one of the men’s
residence hall directors. IT programed the learning management system to show an individualized banner
to each student with their total number of absences at the top of each page. Whenever a student logs in
during the semester, the red banner will appear that states “According to our records, you have X
absences this semester.” Additionally, there is a campus-wide effort to have conversations with students
6
emphasizing the importance of going to class. The students get the message that missing more than 10-15
class sessions in a single semester puts them at risk for falling out of satisfactory academic progress. This
message is delivered in orientation meetings, in first year experience courses and in the residence halls.
The goal is to instill the belief that missing class is not normal.
Analysis of the results suggests that Graceland is moving closer towards that goal. Attendance
taking and personal follow-up with students has correlated to improved class attendance. In fall 2011,
fulltime students had an average of 16.4 absences per student per semester. In fall 2013, fulltime students
had an average 13.8 absences per student per semester.
For those of us using the data to understand and motivate students, the cumulative number of
absences are used in several ways. Using Cognos to report information out of our database, several
reports have been written to show students attendance. One report shows an individual student’s
attendance for the semester (Figure 2). The report is available to be run by advisors, the Dean of Student
Life and the Coordinator of Retention Activities.
Attendance Report
Student ID: 000000
Student Name: John Smith
Classification: FF
Cumulative GPA: 2.42
Course Work Course Number
Course Work Course Title
Present
Excused Absent
Unexcused Absent
Tardy
ENGL1410
Modern Rhetoric
21
0
1
0
HIST1310
World Civilizations I
21
2
5
0
INTD1100
Critical Thinkg Lib Arts-Science
22
2
0
0
MATH1310
Mathematical Concepts I
32
3
5
0
SCIE1250
Descriptive Astronomy
Summary
16
2
2
0
112
9
13
0
Figure 2: Cognos 10 Attendance Report for Individual Student.
Several other reports showing the full list of students and cumulative attendance information is
automatically generated weekly and sent to specific people. These are also run daily during the first two
weeks of classes each semester to help admissions and the Registrar determine which students may have
not returned. The weekly reports have become a part of our warning system and alert advisors, coaches,
hall directors and academic program directors to students who have missed a large number of classes in a
given week. The data is used to reinforce appropriate behaviors and professional expectations. Figure 3
shows a sample of one of the reports.
Recent Absence Report for All Students
ID Number
Student Name
Session
Present
Excused Absent
Unexcused Absent
Tardy
999999
Samuel Jones
FR
3
0
8
0
999999
Jane Doe
JR
5
0
7
0
999999
Mary Smith
JR
5
0
7
1
999999
Jose Hernandez
SO
4
1
6
0
999999
DJ Grey
SR
0
1
6
0
7
Figure 3: Cognos 10 Weekly Attendance Report
Collaboration across areas on campus occurs when any one of our warning systems is triggered. Every
Friday at 11am a retention staff meeting takes place that includes people from student life, academics,
athletics, health services, TRIO program, international programs and religious life. The group gets a copy
of the full attendance report for the week and a cumulative attendance report for the semester. Members
of the group are assigned students of concern to contact.
Welfare checks are conducted immediately for students who typically have good attendance and
appear on the reports in a given week with a high number of absences. Those students who have chronic
absence issues are followed up with by appointment. These interventions are not seen as urgent but are
expected to happen with a few days of the report and assignment. A feedback loop is built into the
process. By the following week’s meeting, each person who was assigned to follow up with a student
reports back the results of the meeting. Graceland’s administration is confident that both the messages to
the students about attendance and the interventions based on class attendance data have made a positive
impact on student success as will be discussed below.
MIDTERM GRADES AND GPA
In fall 2012 Graceland began to require faculty to calculate and enter midterm grades for all
students. Prior to this, only deficient grades were required and only students with a D, F or I at midterm
got a notice. The act of recording some grades, but not all, confused the students and Graceland also felt it
caused complacency. Students who did not receive a deficient midterm notice may have had all Cs in
their courses and were truly at risk. For advisors, this practice provided an incomplete picture. The
advisor would not know whether the student with an F in Statistics had all Cs in his/her other courses or
all As and Bs, yet would make very different recommendations in the face of these two disparate
situations.
As with the attendance recording, this change met some resistance among the faculty. Some
claimed it caused more work, while others took the philosophical stance that by providing too much
information for students we were inhibiting the development of students’ self-efficacy. Nonetheless, the
policy to require all students to receive midterm grades for all courses was passed by a large margin with
the hope that it would improve students’ academic performance and thus improve retention.
The change did not result in an overall improvement in the average session GPA for students. In
the term prior to the introduction of midterm grades the end of session average GPA for all fulltime
undergraduates was 2.99. At the end of spring 2014, the average session GPA was 2.97. In both sessions
15% of all fulltime undergraduates finished the semester with less than a 2.0 GPA. In spring 2014, there
was a slight, but insignificant, increase in the cumulative GPA of enrolled students from 3.02 to 3.03.
Well aware that the midterm grade notifications were not making a significant difference in
academic performance, the registrar’s office put into practice the same philosophy we have applied to
attendance: put the information in the hands of the individuals who can make actionable changes - the
students. While students were already getting midterm grade notices, they were not getting midterm
8
GPAs and did not understand how to calculate or project a GPA. The registrar’s office made the decision
to employ an element of gamification to the midterm grade message. Gamification is the use of game
design elements in non-game contexts. In education this happens when students are visually presented
with their progress in levels, points, or graphs that show progression. It can also happen through badging
where students earn public recognition for an accomplishment or through a number of other gamesituations. In spring 2013, the systems specialist in Graceland’s Registrar’s office created a chart using
Cognos that pulled midterm grades from the database. Using a very basic element of gaming and
extending a car and road trip theme that had been used elsewhere on campus, students are now visually
presented with their progress on a colored meter that looked like a car’s gas gauge or speedometer using
the same colors as a traffic light. No data is available to report yet. Results will be assessed over the next
several semesters. See Figure 4 for an example of the notice students receive.
Figure 4: Cognos 10 GPA Meter Report for Student
9
FLAG FORM
A final example of how Graceland created its own retention solution using tools and skills it
already possessed is the creation of the FLAG (For a Lower Attrition Goal) form. The FLAG form is an
alert or concern that any faculty or staff member can use to bring attention to a student at any time.
Created by using the contained form portlet in our learning management system, the simplicity of this is
that anyone who can use basic computer technology can create one. This form was rolled out in 2011 and
every fall receives an updated introduction to the faculty and staff. A link to the form appears on multiple
pages on Graceland’s internal website. When complete, the faculty or staff member clicks on the submit
button and the form is automatically sent to both the Dean of Student Life and the Coordinator of
Retention Activities. The form itself is shown Figure 5.
FLAG FORM______
The primary goal of the FLAG Form is to help students succeed and graduate from
Graceland University. Faculty and Staff should use the form to submit an academic or
personal concern about a student. It facilitates student success by getting important
information to staff, advisors and counselors for timely interventions.
*
Your name:
XXXXX XXXXX
*
Student's
name:
Student ID (if
known):
Please explain the concern:
Please tell us what you have
done to address the
situation. (see note)
Please provide suggestions
about how we might help the
student?
Note:
If this is an academic concern or a personal concern and you have a relationship with the
student, please find a time to visit personally with this student. If you would like assistance on
how to start the conversation or what resources might be available, please call the Dean of
Students.
All concerns will be emailed to the Dean of Students, and the Coordinator of Retention Activities.
Submit
Figure 5: Jenzabar eRacer Contained Form used for Graceland’s FLAG Form
While it might appear simplistic, it has proved to be very useful. On average 3 FLAGs are
received weekly, although some weeks see a much higher number. Unless a FLAG alerts staff to a
situation that needs immediate attention, the concerns are discussed and assigned for follow-up each week
at the Friday retention staff meeting in the same manner as the attendance issues. The form and process
10
has been assessed in two ways. The first was through tracking students who were flagged against their
end-of-semester GPAs. As expected an overwhelming majority of the FLAGs were for students who
finished the semester with lower than a 2.0 GPA or who withdrew before the end of the semester. This
might seem to suggest that the form is not working to improve academic performance, but it does show
that the faculty and staff are very aware of who is struggling both in and out of class, an important step in
improving retention.
Conclusion
Assessment of any retention initiative is essential. However, as with any education or social
science research, causation is difficult to prove, especially with the rapid changes occurring in higher
education today. In Graceland’s case, assessment is both qualitative and quantitative and evaluates both
the individual initiatives and overall retention. An analysis of the individual results related to each of the
initiatives was shown above. Qualitatively Graceland conducted a University-wide SWOT analysis via
Survey Monkey in early spring 2014. Seventy-eight of 227 employees responded (34% response rate).
Forty-nine of the 78 respondents specifically mentioned either attendance taking, midterm grades or the
FLAG form as a strength of our current retention program. Finally, the most comprehensive quantitative
assessment is shown in the actual retention and graduation rates. While first year cohort retention rates
have remained stable, the University-wide undergraduate spring-to-fall retention rate has increased from
80.9% to 83.9% in three years and has been above the ten-year average of 82.2% for two of the last three
years. It is too early to tell whether any of these policies will have an impact on 6-year graduation rates,
however, the most recent 4- and 5-year rates are showing improvements. The 2008 cohort graduation rate
after 4 years was five percentage points above the previous year (35.5% vs. 30.6%) and 2 percentage
points above any of the previous five years’ rates. The five year graduation rate for this cohort showed an
even bigger improvement, increasing over seven percentage points over the previous year. In fact, this
cohort that finished its fourth and fifth years in 2012 and 2013 has a higher five-year graduation rate than
any of the previous cohorts dating back to 2003 had in six years (52.3% in five years vs. an average of
48.8% in six years for previous cohorts or a high of 50.4% among them). The 2009 cohort is showing
similar improvements over the 2003-2007 cohorts in graduation rates.
Cohort Year
Cohort Enrollment
First Year Retention Rate
Graduated w/in 4
Years
Graduated w/in 5
Years
Graduated w/in 6
Years
2002
267
72.70%
31.10%
42.70%
47.60%
2003
253
72.30%
33.60%
46.60%
49.80%
2004
305
73.40%
28.20%
43.60%
47.20%
2005
254
70.50%
30.30%
47.20%
50.40%
2006
251
76.80%
33.60%
46.80%
49.40%
2007
271
70.80%
30.60%
45.00%
47.60%
2008
197
72.10%
35.50%
51.80%
53.80%
2009
220
70.50%
32.30%
49.50%
2010
220
69.10%
2011
259
68.00%
2012
231
69.70%
2013
326
11
Undoubtedly Graceland is making other changes that affect persistence to graduation that might
be influencing these numbers. For example, in fall 2013, a new work-study policy was introduced that
guaranteed any student a job on campus if they wanted one. In addition, Graceland also now has a
certified Bridges out of Poverty trainer on staff who presents regularly at professional development
sessions. In the end, the essential message of this paper is that small institutions can create, implement
and target their own ‘retention solutions’ to fit their needs without paying tens of thousands of dollars
annually to an outside vendor.
Works Cited
Center for Excellence in Teaching and Learning, Class Size, Minnesota State University at Mankato.
Retrieved 5/29/2014 http://www.mnsu.edu/cetl/teachingresources/articles/classsize.html
Chatman, Steve. (1997) "Lower Division Class Size at U.S. Postsecondary Institutions" Research in
Higher Education, 38 (5).
Demaris, Michalyn, Kritsonis, William. (2008) The Classroom: Exploring its Effects on Student
Persistence and Satisfaction. Focus on Colleges, Universities, and Schools 2(1).
Doyle, Terry, & Zakrajsek, Todd. (2013) The new science of learning; How to learn in harmony with
your brain. Sterling, VA: Stylus.
Jensen, Eric. (2009) Teaching with Poverty in Mind. Alexandria, VA: ASCD.
Kelly, Rob. (2013) A data-driven approach to student retention and success. Faculty Focus: Higher Ed
Teaching Strategies from Magna Publications. http://www.facultyfocus.com/articles/academicleadership/a-data-driven-approach-to-student-retention-and-success/
Kirsch, Irwin, Braun, Henry, Yamamoto, Kentaro & Sum, Andrew. (2009) America’s perfect storm:
Three forces changing our nation’s future. State College, PA: ETS.
Krodel, Karla, Becker, Karen, Ingle, Henry, & Jakes, Susan. (revised 2011) Helping under-resources
learners succeed at the college and university level: What works, what doesn’t and why. Highland,
TX: aha!
Payne, Ruby. (2005) A framework for understanding poverty. Highland, TX: aha!
Whalen, Sandra, ed. (2014) 2013-14 CSRDE Retention Report, Center for Institutional Data Exchange
and Analysis (C-IDEA), Norman, OK: University of Oklahoma Outreach.
Download