The Texas Interdisciplinary Plan Mentor Academy The University of

The Texas Interdisciplinary Plan Mentor Academy
The University of Texas at Austin
The Institution
The University of Texas (UT) at Austin is a four-year, tier one public research
university serving 37,037 undergraduates, of which 94.4% are traditional-aged college
students in residence. The ethnic distribution of the entering class in 2006 were 57.3%
White, 17.1% Hispanic, 17% Asian American, 4.2% African American, 3.7%
international, and 0.5% American Indian. Females comprised just over half of the firstyear class (52.3%.).
Description of the Initiative
Since 1999, the Texas Interdisciplinary Plan (TIP) Mentor Academy has been a
dynamic element of the TIP Scholars program. TIP Scholars seeks to provide a small
college experience for over 300 first-year students in the Colleges of Liberal Arts and
Natural Sciences. The program provides academic and social support through smaller
classes, academic advising, linked courses, a critical thinking seminar, social
connections, academic peer mentoring, and academic tutoring. Currently, the Mentor
Academy employs 65 upper-division students as academic peer mentors who promote
academic excellence and successful transition for TIP Scholars.
Each peer mentor is an integral part of the small college experience through
leading a group of five or six first-year students and tutoring for a specific entry-level
course. Through an interview process, academic peer mentors are selected based on their
academic achievement, knowledge of campus resources, and selfless desire to assist firstyear students.
The Mentor Academy coordinator, a full-time staff member, supervises the
mentor cadre, develops extensive topical training modules, and conducts training
beginning in the spring and continues throughout the year. Mentors are required to attend
training which helps them learn a specific skill or strategy (e.g., active listening). During
this training, mentors discuss ways in which they would apply these skills to their mentor
or tutor sessions. The topics presented are required by the College Reading and Learning
Association (CRLA) mentor and tutor certification curriculum. The topical training along
with student contact hours results in the opportunity for mentors and tutors to acquire
Level I (general), Level II (master), or Level III (advanced) certification. In addition to
student contact and training, mentors are required to submit a weekly report, which
includes the mentor/tutor activity and progress reports on each of their mentees. Each
mentor receives a staff response to their weekly report. This process allows for staffmentor communication and possibly preemptive assistance for first-year students and
mentors.
Mid-fall term, the Mentor Academy coordinator helps the mentors to pause and
consider their job performance thus far. The coordinator gathers information for each
mentor from staff observations in the tutoring lab, mentee survey data, and mentor selfCopyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
University of Texas at Austin
Page 2
assessments. After the data compilation, the coordinator confers with each mentor/tutor
about their performance and current status in the CRLA certification process. Each
mentor/tutor has the opportunity to identify their strengths, reflect on weaknesses, and
plan strategically for the rest of the year.
Research Design
Research has identified feelings of connection to the institution and student
satisfaction as some of the most important factors in first-year student success. Creating
the small college atmosphere is the means to foster that connection and satisfaction. TIP
Scholars assessment objectives center on the strength of connection to the program and
college and the level of student satisfaction within their environment. The Mentor
Academy survey addresses first-year student satisfaction with their mentoring/tutoring
experience, their sense of comfort within the college and program, and their level of skill
acquisition.
The Findings
Following are data that assess retention, academic performance, and program
satisfaction for the TIP Scholars as well as academic performance for academic peer
mentors. TIP Scholars are compared to a control group that parallel the TIP population
and also students who applied to TIP Scholars but were not selected.
Due in part to program admission strategies, the TIP Scholars population is more
diverse than the control group (Table 1). Anecdotal evidence suggests that students are
also more likely to attend the University when they have been admitted to a program like
TIP Scholars.
Table 1
Demographics of TIP Scholars and Control Populations, 2006
TIP scholars
All control
Not selected to TIP
UT first-year
students overall
N
298
1,077
441
7,417
Low
SES
33.89%
27.76%
22.45%
First
generation
41.95%
38.81%
33.56%
Underrepresented
group
46.64%
33.89%
29.25%
Gender
(Male)
46.98%
31.66%
2.04%
Mean
SAT
1118
1117
1119
45.70%
1230
TIP Scholars have academically outperformed a control group of their peers each
year since the program began in 2002. Compared to the control group, the 2006-2007 TIP
Scholars



Earned higher GPAs during their first year at the University
Were more likely to achieve predicted GPAs calculated by the Office of
Admissions
Were half as likely to be on academic probation
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
University of Texas at Austin
Page 3

Had a more favorable GPA distribution in both Colleges
As shown in Figure 1, TIP Scholars earned higher GPAs during their first year at UT,
both in liberal arts and natural sciences. This trend has been observed each year since the
program began in 1999.
Freshman GPA Comparison at End of First Year
3.40
3.19
3.20
3.10
2.95
3.00
2.81
2.78
2.80
2.74
TIP Scholars
Not Selected
2.60
2.54
All Control
2.43
2.40
2.21
2.20
2.00
Pre-CS
Liberal Arts
Life Sciences
Figure 1. First-year student GPA comparison at the end of first year, 2006.
Approximately 70% of TIP Scholars earned GPAs of 3.0 or better after their first
year at the University (Tables 2 and 3). This pattern was observed for students in both
liberal arts and natural sciences. Fewer than 50% of students in the control group
achieved similar GPAs. This year showed an increase in the percent of students who have
less than a 2.0 at the end of the first year.
Table 2
Distribution of First-Year GPAs in Natural Sciences, 2006
TIP Scholars
All Control
Not Selected
3.5+
32%
21%
25%
GPA Categories
3.0 - 3.4
2.5 - 2.9
2.0 - 2.4
38%
18%
10%
33%
18%
14%
31%
20%
13%
< 2.0
2.0%
14%
11%
Table 3
Distribution of First-Year GPAs in Liberal Arts, 2006
TIP Scholars
3.5+
40%
GPA Categories
3.0 - 3.4
2.5 - 2.9
29%
14%
2.0 - 2.4
6.0%
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
< 2.0
11%
University of Texas at Austin
Page 4
All Control
16%
31%
18%
20%
15%
Not Selected
16%
28%
24%
19%
14%
Table 4 highlights the level of academic achievement held by the TIP academic
peer mentors. The average mentor GPA was a 3.51.
Table 4
Distribution of Mentor GPAs for 2006
3.5+
58%
TIP Mentors
GPA Categories
3.0 - 3.4
2.5 - 2.9
29%
11%
2.0 - 2.4
2%
In addition to academic achievement, we are also interested in measuring the
mentors’ level of confidence in the skills they acquire during training. Each mentor
completed a self-evaluation consisting of 13 items (e.g., communication, problemsolving, and their strengths and weaknesses as mentors). See Appendix A for the selfevaluation. Table 5 highlights findings from the self-evaluation.
Table 5
Percentages From Mentor Self-Evaluation, 2006
% Agree
% Neutral
% Disagree
Communicate
100.00
0.00
0.00
Time spent
69.81
20.75
9.43
Students
communicate
98.08
1.92
0.00
Show interest
100.00
0.00
0.00
Understand
students
98.11
1.89
0.00
Motivator
94.34
5.66
0.00
Agenda
63.46
26.92
9.62
Listen
100.00
0.00
0.00
Questions
98.08
1.92
0.00
Talk
80.39
17.65
1.96
Problem-solving
88.46
9.62
1.92
Used skills
80.39
17.65
1.96
Project worthwhile
56.86
17.65
25.49
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
< 2.0
0%
University of Texas at Austin
Page 5
As seen in Figure 2, TIP Scholars reported high levels of satisfaction with their
mentors’ performance in all surveyed areas (See Appendix B for instrument). For
example, 94% of TIP Scholars report that they agreed or strongly agreed that they felt
comfortable talking with their mentor. Our anecdotal evidence has shown that open
communication with the mentor increases the feeling of connection to the TIP Scholars
program and the University as a whole.
Mentee Evaluation of Mentor Performance
300
250
200
150
Agree
Neutral
100
Disagree
50
0
Available
Comfortable
Genuine
Succeed
Group
Respect
Organized
Agree
251
254
256
250
245
264
257
Neutral
16
13
12
18
18
2
8
Disagree
2
2
1
1
4
1
4
Figure 2. Results of mentee evaluation of mentor performance.
Conclusion
Based on past assessment, we redesigned our mentor training model to include
scheduled, continuous, and consistent training modules. These modules have evolved
from strictly coordinator-led to a more peer teaching peer-instructing model that focuses
on skill development and application, such as group dynamics and working towards
consensus. In that particular module, mentors are challenged with a problem and asked to
work through the process to reach genuine consensus.
In the area of tutoring, our assessment revealed significantly low liberal arts
tutoring attendance. In response, the TIP Liberal Arts Academic Teams program was
created. This new initiative moved away from the traditional drop-in tutoring model to a
group format that involves tutor-guided discussions and opportunity for individual and/or
group work. This new format produced consistent and higher attendance rates. Further
evaluation will provide insight for this positive reaction and will help tailor the tutoring
experience for this population of students.
Next steps include formalizing the study of mentor training modules on the
mentor and mentee experience. We have discovered a significant gap in the literature and
challenge other institutions to add to the body of knowledge concerning undergraduate
mentoring, training, and best practices.
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
University of Texas at Austin
Page 6
Primary Contributor
Jennifer L. Smith
Mentor Academy Coordinator
1 University Station, GRG 234, G2550
Austin, TX 78712
Phone: 512-232-6197
E-mail: jlsmith@mail.utexas.edu
Additional Contributor
Susan Harkins
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
University of Texas at Austin
Page 7
Appendix A
Please use the orange scantron to bubble in your responses to Questions 1- 26. Bubble in your first and last name,
bubble in your UTEID for identification. Fill out the other contact information but leave the course and unique
TIP Mentor Self-Evaluation
20089
(First & Last Name)_____________________________________________ Date_________
Your honest feedback will help us improve the TIP Scholars mentoring program. Please rate
yourself on following items on a 5 component scale by bubbling in one number only on your
scantron form. A = strongly disagree, C=Somewhat Agree and E = strongly agree.
Strongly
Disagree
Disagree
Somewhat
Agree
Agree
Strongly
Agree
A
B
C
D
E
1. I’m confident that I respond to emails and/or calls A
from my mentees.
B
C
D
E
2. I am comfortable communicating with my
mentees.
A
B
C
D
E
3. I am genuinely interested in my mentees’ success
at UT.
A
B
C
D
E
4. I respect individual differences amongst my
mentees.
A
B
C
D
E
5. I am well-organized and on-time.
A
B
C
D
E
6. I have helped my mentees learn to work as a
team.
A
B
C
D
E
7. I am knowledgeable about the instructions and
guidelines for the Meeting of the Minds Project in
my mentee’s UGS Seminar.
A
B
C
D
E
8. I serve as a facilitator for the Meeting of the
Minds Project for my mentee’s UGS Seminar.
A
B
C
D
E
9. I feel that my mentoring relationship has helped
my mentees to perform better academically.
A
B
C
D
E
10. I feel that my mentoring relationship has helped
my mentees to successfully transition from high
school to college.
A
B
C
D
E
11. I go over skills and techniques that are helpful to A
my mentees (e.g. time management, goal-setting,
etc.).
B
C
D
E
12. I have introduced my mentees to useful
resources on campus.
B
C
D
E
A
MORE QUESTIONS ON BACK OF THIS PAGE -TURN PAGE OVER
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
University of Texas at Austin
Page 8
Your honest feedback will help us improve the TIP Scholars mentoring program. Please rate
yourself on following items on a 5 component scale by bubbling in one number only on your
scantron form. A = strongly disagree, C=Somewhat Agree and E = strongly agree.
Strongly
Disagree
Disagree
Somewhat
Ag ree
Agree
Strongly
Ag ree
A
B
C
D
E
13. I ask relevant and appropriate questions.
A
B
C
D
E
14. I help my students stay focused and on task.
A
B
C
D
E
15. My students use problem-solving strategies as a
result of participating in the Meeting of the Minds
group project.
A
B
C
D
E
16. My students practice and develop leadership
skills as a result of participating in the Meeting of
the Minds project.
A
B
C
D
E
17. I feel my students learned to work together.
A
B
C
D
E
18. I feel that the Meeting of the Minds project was
a worthwhile experience for my mentees.
A
B
C
D
E
19. I ask my mentees individually about their
academic performance.
A
B
C
D
E
20. I find mentor training valuable.
A
B
C
D
E
21. I feel that my confidence has increased due to
my participation in mentor training.
A
B
C
D
E
22. I feel that my leadership skills have improved
due to my participation in mentor training.
A
B
C
D
E
23. I feel that my academics have improved while
working as a mentor.
A
B
C
D
E
24. I feel like I am a part of a community within UT
as a result of my participation as a TIP mentor.
A
B
C
D
E
25. I feel like I am giving back to UT as a result of
my participation as a TIP mentor.
A
B
C
D
E
26. All restraints aside (like graduating, studying
abroad, etc.), if given the opportunity I would return
for another year of mentoring.
A
B
C
D
E
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
University of Texas at Austin
Page 9
What are your strengths as a mentor?
______________________________
__________________________________________________________________
______
______________________________
What suggestions do you have for improving:
1) Your effectiveness as a mentor?
__________________________________________________________________
2) The support provided by the TIP staff
________________________________________________
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
University of Texas at Austin
Page 10
Additional comments:
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
University of Texas at Austin
Page 11
Appendix B
20089
USE PENCIL ON YOUR SCANTRON
Fill in the Instructor’s name and unique number on the Sanctron
Fill in your Mentor’s First & Last Name for Course on your Scantron
TIP Scholars Mentoring Evaluation
(To be completed by mentees)
Your Peer Mentor (First & Last Name)___________________ UGS Unique#____________
Your honest feedback will help us improve the TIP Scholars mentoring program. Please rate the
following items on a 5 component scale by bubbling in one letter only on your scantron form.
A = strongly disagree, C=Somewhat Agree and E = strongly agree.
Strongly
Disagree
Disagree
Somewhat
Agree
Agree
Strongly
Ag ree
A
B
C
D
E
1. I’m confident that my mentor will respond to my
emails and/or calls.
A
B
C
D
E
2. I feel comfortable communicating with my
mentor.
A
B
C
D
E
3. My mentor seems genuinely interested in my
success at UT.
A
B
C
D
E
4. My mentor respects individual differences.
A
B
C
D
E
5. My mentor is well-organized and on-time.
A
B
C
D
E
6. My mentor has helped my group work as a team.
A
B
C
D
E
7. My mentor is knowledgeable about the
instructions and guidelines for the Meeting of the
Minds Project in my UGS Seminar.
A
B
C
D
E
8. My mentor serves as a facilitator for the Meeting
of the Minds Project in my UGS Seminar.
A
B
C
D
E
9. I feel that having a mentor has helped me to
perform better academically.
A
B
C
D
E
10. I feel that having a mentor has helped me to
successfully transition from high school to college.
A
B
C
D
E
11. My mentor goes over skills and techniques that
are helpful to me (e.g. time management, goalsetting, etc.).
A
B
C
D
E
12. My mentor has introduced me to useful
resources on campus.
A
B
C
D
E
MORE QUESTIONS O N BACK OF THIS PAGE
TURN PAGE OVER
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.
University of Texas at Austin
Page 12
What role has your mentor played in the Meeting of the Minds project?
__________________________________________________________________
______________________________
Name one thing your mentor does well. Be Try to be specific: for example is you feel
she or he is a good listener, explain how.
Name one thing your mentor might work on. Again, try to be as specific as possible here.
Additional comments:
________________________________________________
Copyright © 2009 University of South Carolina, National Resource Center for The First-Year
Experience & Students in Transition. All rights reserved.