Using Data to Develop a Comprehensive Academic Probation Program at a Large College Identify stakeholders at your institution for this work Understand why data is key to the development of this process Identify your population and the challenges this entails Identify learning centered strategies to reach this population of students Dr. Julie Corderman, Manager of Student Services at the Winter Park Campus of Valencia College Oversee front line staff for Student Services at our campusincludes Answer Center, Career Center and Atlas lab Adjunct Instructor in Psychology Developing a comprehensive Probation and Suspension program at Valencia Our campus Dean tasked the Career Center with working with Probation and Suspension students The idea behind this appointment was following the O’Banion Model of assisting students with focusing on long term goals and goal setting Life Goals Career Goals Educational Goals (Major) Course Selection Schedule On-going conversations with my advisors about the probation student population Created an ad hoc system for my advisors to use as a method of keeping each other in the loop with regards to student we were seeing Began to collect and tally Probation Passes (We had passes collected from a three year period) Began discussions with OIT on creating a data report (18 months) Sent a team of Student Services staff members to Destinations program during Summer to begin discussion of interventions (3 months) Sent team members to NACADA conference Developed a work team of key stakeholders Who are the stakeholders at your school? Who might be invested in this work? Who do you need at the table for discussion? Who are the best advisors for the job? Think broadly and forward Project Facilitator Academic Deans (2) Faculty (2) Deans of Students (2) Counselors (2) Conduct Coordinators (2) Career Advisors (2) Financial Aid Liaison (1) Black Board Liaison (1) OIT Liaison (1) Helps you to separate fact from fiction Enables you to have important information when speaking to various stakeholder groups at the college Enables you to begin to formulate a plan Enables you to determine if your plan is working Enables you to tweak portions of your program as supported by the data Redesigning our probation pass Identifying our population and developing interventions based on numbers Flex courses - should students on P2 be able to take them? Advisors began to see more and more students rolling onto academic probation as Banner helped us to “clean up” reports Many of the probation students we were seeing were not able to articulate reasons for being on probation Many of the probation students did not have clear educational goals; supporting O’Banion’s Model Many of these students had unrealistic expectations about how many classes they could successfully navigate in a term Many of the students were not taking responsibility for changing their academic behavior Personal or Working too Family Lack of focus much/work problems or motivation schedule Accident or sickness Failing grades/low GPA Misunderstood the question Blank Poor time management 1 0 14 23 29 24 10 99 17 2 0 9 14 21 14 0 93 18 3 2 2 13 28 7 4 36 6 4 3 36 45 66 19 12 159 102 5 19 4 36 70 8 31 27 63 6 5 52 35 108 36 7 119 98 7 2 24 18 48 29 3 138 10 8 1 6 5 12 1 0 47 3 9 0 7 9 20 20 1 80 4 10 2 16 19 60 15 2 28 66 Total 34 170 217 462 173 70 826 387 Percentage 2% 9% 12% 26% 10% 4% 46% 21% Use Valencia ressources Manage time (skill shops, more wisely labs etc) Blank Pass my classes/try harder Retaking Seek help from failed classes Quit job/reduce teachers and Misunderstood to raise GPA working hours advisors the question 1 9 91 29 1 46 19 2 2 2 45 55 22 5 10 9 5 15 3 2 67 7 2 4 9 2 4 4 29 182 61 33 15 30 28 27 5 6 4 23 8 11 1 0 27 6 42 198 85 23 37 49 18 15 7 25 109 52 11 32 24 11 5 8 4 27 2 1 41 2 0 0 9 8 42 30 10 20 40 8 5 10 8 129 39 12 6 23 10 6 Total 178 904 350 106 222 206 84 106 10% 50% 19% 6% 12% 11% 5% 6% We had to determine how to gather the population information from our data warehouse We had to define our population (different parameters AW, P1, P2, SU) We had to determine what types of data were important to mine: Term GPA CUM GPA Major HS Zip Code Sex Ethnicity Cleared vs. registered We had to determine when to run the report during a term cycle We had to determine which fields to mine the data from to get correct data Our first usable report was run at the end of Summer term 2011 We just ran our 5th report at the beginning of December 2012 Each term we run a college wide report plus a report on our pilot group vs. a control group In addition, each term we begin to experiment with digging deeper into the data to answer theories about our work such as: “Do flex term courses have an impact on student outcomes?” “What impact is withdrawing having on this population?” 1392 1400 1000 1176 1173 1200 929 800 P1 701 P2 600 400 488 441 282 279 200 120 74 63 105 59 0 201130 SU 434 201210 201220 201230 201310 1400 1282 1171 1200 1060 1000 AA 807 800 AS 675 671 600 Personal AAS 507 T-Cert 440 400 331 278 200 44 23 15 75 47 38 55 26 26 37 12 25 60 15 34 0 201130 201210 201220 201230 201310 200 186 180 160 140 151 135 131 Nursing 120 Radiography Dental Hygiene 100 Sonography 79 80 Respiratory Cardiovascular 60 40 20 29 15 20 25 17 14 14 2 2 7 20 22 17 3 2 6 13 9 11 0 201130 201210 201220 201230 14 14 6 4 4 1 201310 Large numbers –how are we going to manage? How can we manage the flow of these students so they can be evenly distributed (by Campus? By Advisor?) With the varying numbers in each group, do we want to have different levels of intervention for each group? Does there need to be a different strategy with our Allied PreClinical students? What about including our Academic Warning students? Schools that we studied were dealing with much smaller numbers Began seeing some schools with online tutorials and forms for students We already had a form called the “Probation Pass” for students online We initially created a Blackboard course as a way to “corral” students college wide The course enables us to direct flow where we can manage it Allows students to check in via e-mail Contributes to ongoing dialogue during the term Allows same advisor to follow a student throughout their time on Probation Allows us to gather data on effectiveness of assignments We went through many attempts at this (still a work in progress) Created a set of online assignments that students are given each term they are on probation Manually load names each term AFTER previous term grades have rolled Advisor is the “Instructor” of the course and determines what assignment to give a student based on questionnaire information Advisors can send reminders to their students as well as personal emails encouraging students during the term Assignments are built to be self-gradeable Student must receive 80% or more on every assignment to be cleared for future courses Credit restrictions apply to probation and suspension students All students go through the “Orientation assignment” their first term on Probation This assignment includes: Catalog definitions of Probation and Suspension Probation process and student responsibility Probation Contract Questionnaire - reasons for being on Probation (student selects from options) Quiz regarding understanding of the process In subsequent terms, students are given assignments to complete BEFORE registration for the next term These assignments are based on the results of the students’ questionnaire Academic Probation Questionnaire My academic performance may have been affected by the following reasons: Poor time management Transportation Problems with class attendance Juggling work and school Childcare issues Course difficulty Lack of Communication with instructors No chosen major Family/relationship concerns Illness Financial issues Early morning classes or late classes Lack of motivation Emotional/psychological issues College adjustment/transition problems Too much socializing Did not meet with Academic Advisor Did not use tutoring services or labs Study problems Other Solutions (check all that may apply) Academic/Study Skills Use tutoring services and labs Communicate/visit with instructors Change study environment Form a study group Attend Academic Workshops Learn about goal setting Be aware of academic calendar Get career counseling Time Management Set goals Say “No” Make a “To Do” list Reward yourself Turn off cell phone Other I commit to the following actions this semester: Work related/ Financial Get a different job Quit job/remain unemployed Reduce working hours See Financial Aid Counselor Family/Personal Discuss goals with family members Delegate duties Make appointment with Counseling/Consultation Develop routines Get medical help Say “No” Complete __ _ study hours per week Make college a priority Keep a time management log that outlines class Maintain regular class attendance Manage work, personal, and study time Consult regularly with instructors about progress Seek tutoring from Valencia’s Support Labs Attend workshop(s) Consult with Advisor regarding academic progress Complete required probation assignments by deadline(s) Other Orientation Time Management Learning Styles Procrastination Study Habits GPA Calculator Communicating with your Instructors Defining Your Career Path Financial Planning Academic Resources Educational Planning Reading and Writing Skills Test Anxiety Loneliness/Depression Is Online for Me? (In Development) Math Support Writing Support Has run for 4 terms Served between 50-150 students per term 60/40 Success Rate Team consists of 4 full-time advisors & 7 part-time advisors (only 1 FT advisor is one of my direct reports. The others are “volunteering”) Summer 2011Pilot Group (n=52) Summer 2011 Unrestricted Group (n=52) Bad News: (34%) Bad News: (26%) P1 to P2=7 (13%) P1 to P2= 5 (9%) Suspended=11 (21%) Suspended=9 (17%) Good News: (66%) Good News: (74%) Maintained=18 (35%) Maintained= 19 (37%) Good Standing=16 (31%) Good Standing= 19 (37%) *6TWs (Term Withdrawals) Fall 2011 Pilot Group (n=76) Fall 2011 Unrestricted Group (n=76) Bad News: (39%) Bad News: (51%) P1 to P2=19 (25%) P1 to P2=22 (29%) Suspended=11 (14%) Suspended=17 (22%) Good News: (61%) Good News: (49%) Maintained=19 (25%) Maintained=15 (20%) Good Standing=27 (36%) Good Standing= 22 (29%) *9TWs Spring 2012 Pilot Group (n=91) Spring 2012 Unrestricted Group (n=91) Bad News: (33%) Bad News: (39%) P1 to P2= 20 (22%) P1 to P2= 22 (24%) Suspended= 10 (11%) Suspended=14 (15%) Good News: (67%) Good News: (60%) Maintained= 45 (41%) Maintained=33 (36%) Good Standing= 24 (26%) Good Standing 22 (24%) *8TWs *3TWs Summer 2012 Pilot Group (n=53) Summer 2012 Unrestricted Group (n=53) Bad News: (28%) Bad News: (36%) P1 to P2= 8 (15%) P1 to P2= 10 (19%) Suspended=7 (13%) Suspended= 9 (17%) Good News: (72%) Good News: (64%) Maintained=16 (30%) Maintained= 16 (30%) Good Standing=22 (42%) Good Standing= 18 (34%) *11TWs *2TWs Fall 2013 Pilot Group (n=151) Fall 2013 Unrestricted Group (n=151) Bad News: (39%) Bad News: (51%) P1 to P2= 41 (27%) P1 to P2=51 (27%) Suspended=18 (12%) Suspended=26 (17%) Good News: (61%) Good News: (49%) Maintained=51 (34%) Maintained= 36 (24%) Good Standing=41 (27%) Good Standing= 38 (25%) *10TWs *4TWs Students who do not respond to e-mails during the term tend to do worse Students who are engaged with their advisor tend to improve Students are coming in earlier during the registration process Financial Aid has become more aligned with this process due to changes in Satisfactory Academic Progress terms Students who take ownership of their performance and take steps to make changes have the best improvement Many students are not willing to make changes The population’s overall GPA is slowly rising Many of the low performers have stopped coming to school Many have lost Financial Aid and are no longer able to attend school We are intervening earlier Subject: RE: Summer Registration Hey mrs Natalie question my math class idk if I'm doin gd n it what do u think is the best opinion I do? Bein that I'm on academic probation and I'm on an appeal D plan for financial aid please write me back ASAP to let me know if there is anything I can do!!!! Could I withdraw and pick up another class to make up for it? Or no? I dnt wanna be penalized cause I'm doin gd so far. Brit. Hi Kera, this is Ally. I'm having issues being motivated for school; I work a lot and its very labor intensive. I don't think college is for me but I know I have to do it. I withdrew from my class because I was doing awful, I really want to do good and I know I can I'm just having trouble adjusting to the college life, I took the personality test in the my portfolio and it said I would be best doing something technical. I really enjoyed my programming concepts it just was a little above my skill set. I finished the probation module, I’m not sure what to do next or if you think I should take a semester off to get my life situated or drop out. I really don't want to drop out. Hello Ally, First, I want to commend you for being proactive about your classes and possible academic goals. Many other students haven’t put the kind of consideration into their classes that you have – so you’re already taking the right steps. If you want to take a semester off from classes to further explore your academic options, I would like to recommend that you not take the time off completely. Instead, I would recommend coming in to set up an intensive three-meeting career assessment series at the Career Center. This career assessment series will go in depth and help you clearly define different career options that best fit your personality and goals. Then, it will help you identify possible degree programs that match those goals. I think this will give you a better idea of what steps to take next as far as picking out classes to take. If you are interested in setting this up for the spring, please let me know and I will get you in touch with one of the Career Advisors here at Winter Park Campus. After you’re done with the career assessment series, we can meet again to regroup and decide what your plans will be over the summer semester. How does this sound? That sounds wonderful. I contacted a friend of the family to think about getting into something computer-related so I'm really interested in trying that. If I could do the three Career meetings that would be fantastic. My life has a lot of stuff happening really quick so I'm trying really hard to juggle everything. I'm excited that I have an advisor because I have been having to do everything by myself and I have made bad choices and realizing it too late and I just really, really don't want to be a failure. 25% 25% 23% 23% 23% 23% 20% 19% 20% 16% 15% 15% 15% 15% 15% 14% 14% 13% Full TWK 10% 10% H2 10% 7% 5% 0% A B C D F W Moving all forms that students use to Dynamic Forms Rolling out a website for students in Academic Distress Creating a timeline for scaling the program college wide Separate strategies for P1, P2, and SU statuses P1=Hold and Advisor meeting; course load may be limited P2=Hold and Blackboard course; course load will be limited SU=Sit out a term and while sitting out, student needs to complete workshop and remediation plan before readmit Implement a strategy for Academic Warning students Faculty to examine Early Alert programs Dr. Julie Corderman, Manager Student Services, Winter Park Campus 407-582-6868, jcorderman@valenciacollege.edu