Consulting Report for Georgia Institute of Technology on use of Technology in Advising and Athletic Eligibility Submitted by Mike Kirkendall and Keith Williams Consultants, AACRAO Consulting Services May 16, 2007 American Association of Collegiate Registrars and Admissions Officers One Dupont Circle NW, Suite 520 Washington, DC 20036 1 Student Advising and Student-Athlete Advising We were informed that there has been a move away from using faculty for student advising because of an ever-increasing emphasis on faculty research. However, the small number of professional advisors results in a high student to advisor ratio. For example, the College of Management (COM) has three (including one search in progress) full-time advisors but enrolls 1200 undergraduate students. The largest concentration of student-athletes by far is in the College of Management, and that college works closely with Athletic Advising to check student progress. This last year, advisors from COM went to the Athletic Advising offices to meet with studentathletes. Unfortunately, the pressure on COM advising staff meant that these appointments were only 15 minutes long. The Director of Advising said that her staff could not do any developmental advising in this short period of time, and could barely cover degree requirements. The well-trained advisors are clearly frustrated that they spend all their time checking degree requirements rather than being able to have more meaningful conversations about student issues and goals. This lack of quality advising time is significant for all students but is particularly so for student-athletes who have rigorous practice and competition schedules (we were told this averages 30 hours a week) that further reduce their study and planning time. Though Athletic Advising has many young and recently-hired staff, our meeting with them emphasized their eagerness to provide excellent student service. Athletic Advising currently has eight advisors and is searching for one more. This staff serves approximately 425 student-athletes. When the athletic advisors were asked for the one thing they needed to do a better job helping students, they all responded that a computerized degree audit is at the top of their list. Their frustration with the flawed CAPP system was very apparent; they are anxious to work on a project that would give students immediate and on-going feedback about their degree progress and eligibility. The current process requires that student-athletes meet with their Athletic Advisor to choose courses. Unfortunately, there is nothing to guarantee that students will then register for the correct courses once they are in the registration system. At present, students are potentially able to change their schedules in a way that would lead to loss in NCAA eligibility. A degree audit system would allow students and advisors to immediately check the impact of changes in the students’ schedules. Finally, a separate theme came out of our meeting with Athletic Advising that is worth mentioning: course availability. Despite the fact that all student-athletes have priority registration (priority registration provides registration access before other students have access to the system), the athletic advisors commented that during registration certain courses were unavailable to their students. In particular, courses are restricted as being available to students in a specific major and are unavailable as electives. The professional advisors we met with in the schools did not think this was a problem, saying that such restrictions are common on all campuses and have remained fairly constant at Georgia Tech. They disputed the sense of the athletic advisors that this was a new phenomenon. They added that special sections of the freshmen seminar course have been added specifically for student-athletes and that some required course sections are scheduled to coordinate with practice schedules. In addition, there is no control on the number or timing of internal transfers from one college to another. Students are given one ‘free’ transfer: they can choose to change colleges at any point in the semester, including after the schedule of courses hsas been built for the upcoming term, once in their careers without any review or approval of the college. This, along with the growth in the size of the student body over the last several years, makes it very difficult for the colleges to accurately predict course demand and to build schedules 2 that will satisfy student preferences or needs. This is a problem on many campuses but is critical when a group of students, such as athletes, need to maintain progress on their degrees to remain eligible to participate in athletics. Recommendations Georgia Tech seems to still be in the transition between a faculty advising and a professional advising model. At present there are not enough professional advisors in the academic units to provide anything but the most rudimentary check of degree requirements. By comparison, student-athletes have access to rich and plentiful advising and academic support resources. A review of advising resources, with goals for decreasing the student to advisor ratio, should be done. The implementation of a comprehensive and accurate degree audit product would provide a common source of degree progress information for students, professional advisors, and athletics advisors. Since these implementations generally are completed on a rolling basis, with individual colleges being done in a set order, I would recommend that the coding and activation of the audit begin in the College of Management. (See following sections for further recommendations on degree audit software selection and implementation.) Included in the degree audit implementation should be the ability for students to process ‘what if’ audits. Students could check their records against not just their current majors but also against other majors they may be interested in possibly pursuing. Robust course capacity planning is a cornerstone of providing sections to students when needed, helping to ensure satisfactory academic progress. The current policy on the timing of internal transfers should be changed so that the academic units can more accurately plan for capacity needs. Allowing students to change transfer internally after course section planning puts students and advisors in the frustrating position of not being able to get the courses needed for degree progress. Degree Audit Software Selection and Implementation The degree audit software ‘CAPP’ was chosen at the state level for all state schools without an evaluation of campus needs. A robust software product search would have analyzed the needs of each campus, created a Request for Proposals (RFP), and solicited vendors to respond to the RFP with information about their product’s ability to perform the tasks required. To further doom the product, no resources were allocated to implement the software. Without project management or the staff needed to write and edit degree requirements the software is not able to accurately check students degree requirements. When students ran their audits, the errors they received made them believe they had unfulfilled requirements, causing them undue stress and sending them to the advising office where it was explained that they were fine and it was just a software glitch. The Electrical Engineering School has announced that they will not use the product. The Registrar was under the impression that the School of Management used the software the most but when we met with the Director of Advising, she told us that they discourage students from using it because of the errors. 3 Since there weren’t staff resources added to maintain the audit, inadequate coding could not be corrected. The audit is only used as a starting point for checking degree requirements for studentathletes but is so flawed that the hard copies we saw were covered with hand-written corrections. Recommendations A degree audit system is a valuable tool for any campus but given Georgia Tech’s very small professional advising staff and high need to track student-athlete progress, it is critical. An audit capable of accurately checking a student’s progress toward the degree would free up time for the type of developmental advising that is so critical for student success and retention. This is particularly true for student-athletes who have large amounts of time dedicated to participating in their sports and are, hence, at greater risk. We have learned from Sungard/CAPP consultants that CAPP does not have the capability of checking some of the specific requirements for the degree progress of Tech student (in particular it cannot enforce limitations on low grades that can be applied to the major, and it lacks the ability to perform a percentage check over past semesters needed in the athletic eligibility check.) This leaves two major vendors that should be considered for a new implementation of degree audit software, DARS and DegreeWorks. DARS is by far the older of the two systems having been written at Miami University in the early 80’s. DARS has developed a module for checking athletic eligibility and progress that is used at many schools with large athletic programs (e.g. Ohio State, USC, Wisconsin at Madison). DegreeWorks does not currently have a module for checking eligibility but they have expressed a desire to develop one and are confident that they will be able to in the near future. DegreeWorks has recently been purchased by Sungard, the company that owns and maintains the Banner Student Information System, owned and used in the Georgia State system. An RFP should be written, overseen by the Registrar’s Office, and should include input on degree requirements needs for the coding of the software from each of the colleges at the University. The RFP should include the need to review eligibility requirements for student-athletes. (Requirements can appear for student subpopulations based on the data base coding.) Once the proposals are received from vendors, a review committee composed of representatives from the registrar’s office, professional advisors from each college, the Athletics Advising Office, and the administrative computing group should meet to review the proposals and select a vendor. Once a system is chosen, this same group should guide the implementation, including drafting a project communication plan for the campus and creating an implementation timeline. 4 Athletic Academic Eligibility at Georgia Tech The momentum from the 2005 NCAA infractions report has created an improved athletic academic certification process at Georgia Tech, by establishing checks and balances and institutional controls, but it is one that is a labor intensive, paper driven process and still vulnerable to errors that could lead to additional infractions. When the NCAA began increasing the student-athlete academic benchmarks in the 1990s many institutions established similar paper driven models to quickly insert academic personnel as a check and balance into the certification process. High workloads, personnel turnover and advances in technology prompted many of these institutions to utilize programming, web services and vendor built academic applications as tools in the collection, review and validation of student-athlete academic information needed for eligibility reporting. A majority of the human resources at Georgia Tech that have been directed to manage, perform and monitor the athletic academic eligibility process are new to the campus and this certification model. Given the extent of the workload, the complexity of balancing NCAA benchmarks with Georgia Tech academic rules and the high profile of the Georgia Tech athletics programs, it is only the staff’s dedication, energy, and attention to detail that has ensured the success of this process. Over time, even these motivated employees may be worn down, and eventual mistakes made. Additionally, the institution is vulnerable if certain personnel in the certification process leave Georgia Tech. Knowledgeable and experienced personnel have been hired into key Registrar, Compliance and Athletic Association positions. Though their positions could be filled over time, the loss of any of these persons would severely compromise the effectiveness of this process until new personnel could be brought up to speed, endangering the accuracy of the compliance process. Fortunately, in preparation for a recent internal audit, documentation of the process was created that could lessen the impact of personnel turnover. Recommended Technology Enhancements Georgia Tech is not effectively utilizing available technologies to enhance and validate the athletic academic eligibility process. In fact, the little technology that is being used is actually adding to the workload by producing unreliable data. The CAPP audit produced to determine a studentathlete’s ”degree applicability of courses” (vital in eligibility determination) proved unreliable to the Assistant Registrar who determines eligibility; she then added a step to run it by a colleague for review. Technology can, and should, be a component of the athletic certification process. It can relieve the pressures of manual paper processes and serve as an additional institutional control when monitoring eligibility data. The use of technology will never be a “magic bullet” that identifies, certifies, and reports student-athletes in a seamless, automated process void of human review. An institution should be prepared to assign human resources to manage the process, certifying the student-athletes academic performance against the NCAA benchmarks, and coordinating all the athletic academic eligibility reporting requirements. 5 A couple of technological enhancements can be initiated for increased student-athlete monitoring and reporting 1) Degree Audit System in Eligibility Processing The degree audit system is the filter by which all students’ academic progress is measured. Maintained by offices outside the Athletic Association, the Registrar and the academic units, and the use of this application for student-athletes assessments is crucial in order to evaluate the student-athlete population in the same manner as the non-athlete student population. NCAA bylaw 14.02.5 “Good Academic Standing and Progress Toward Degree” states: The phrases "good academic standing" and "progress toward degree" are to be interpreted at each member institution by the academic officials who determine the meaning and application of such phrases for all students, subject to the controlling regulations of the institution. So if the degree audit is the tool by which all students at an institution are determining their academic progress then that tool has to be used to determine the academic progress of the student-athletes as well. In terms of conflicts of interest, checks and balances, and institutional controls, this arrangement should be preferable to the institution. The Registrar’s Office would maintain the accuracy of the degree coding while the academic advisors record exceptions in the system, allowing the Athletic Association personnel the ability to review the information but not alter or influence the data. A comprehensive degree audit application, with the ability to project performance in anticipated coursework, is not only a benefit for the student-athlete forecasting and certification process but is also a benefit for non-athlete student needs. Tracking progress through a degree program with the ability to forecast course degree applicability or g.p.a., and test out degree plans would make all students better informed about their academic standing. Forecasting student-athlete progress Forecasting is the process for projecting student-athlete academic performance and thus their academic eligibility status. Forecasting allows a student (or advisor) to run “what-if” scenarios for completing planned coursework, project a possible g.p.a. for planned coursework and to compare their academic history against the institutions academic degree plans to determine their best degree footing. In institutions without a detailed degree audit system in place, this process is usually handled by hand by many of the same personnel responsible for eligibility processing, thus adding to the already heavy paper-process workload. Forecasting the academic success (or failure) of a student-athlete is the single most important factor in preventing an infraction from occurring, or preparing the institution when studentathletes fail to clear their benchmarks. The forecasting data for student-athletes would never be reported as final and the certifying agent would always wait until the actual grades and g.p.a. calculations were available before reporting a student-athlete’s actual eligibility status. 6 Forecasting continuing student-athletes progress Being able to forecast the success or failure of student-athletes in the context of course degree applicability, g.p.a. and percentage of degree completed allows certain preventative measures to occur: Allows eligibility personnel to identify those student-athletes who will “clearly meet their benchmarks”, thus reducing the stress associated with reviewing these students Identifies those student-athletes who “clearly will not meet their benchmark” and those “on the bubble” allowing eligibility personnel to watch them more closely and encouraging academic tutors and advisors to meet with these student-athlete sooner Provides information so athletic advisors can more accurately advise student-athletes during early registration periods for courses needed to stay eligible Permits Athletic Compliance personnel to begin NCAA appeal and waiver processes earlier if it appears the student-athlete will not meet their benchmarks Allows more time so Media Relations personnel can prepare earlier to disseminate information about ineligible student-athletes Provides University administrators a “heads-up” regarding student-athlete eligibility status The institution demonstrates that it is proactive regarding eligibility issues Forecasting for prospective transfer students The forecasting of a transfer student-athlete during the recruitment phase allows the institution to determine which transfer student-athletes would or would not be eligible at Georgia Tech, and thus whether to offer them a scholarship though eligible at the time of the transfer, would soon be at risk of ineligibility after beginning Georgia Tech coursework Forecasting of transfer student-athletes should occur through the same machinery and process that is used to forecast continuing student-athletes. Usually this involves the Admissions Office creating a record for the recruit in the student information system and articulating their transfer coursework during the identification and recruitment phase, allowing for an earlier assessment. 2) Athletic certification application An additional technology piece that can be implemented is an application that takes the student information system and degree audit academic information and processes it through the NCAA benchmarks, summarizing the student-athlete’s eligibility standing for the athletic advisors and certifying personnel. Typically, this type of application will display the student-athlete’s standing in regards to the 18/24 hour rules, g.p.a. percentage rules, and calculating a percentage to degree in addition to applying institutional rules that may influence the certification process. These applications do not exist commercially and are typically built in-house as a module of the degree audit system. They are not complex systems and could be as simple as a population and display of the Georgia Tech’s Registrar’s “blue form” behind a secure interface for use by athletic, academic or Registrar personnel to initiate discussions and reviews. An in-house module can also provide electronic storage for non-academic data needed for athletic reporting that typically does not reside anywhere on student information systems or degree audit 7 systems. Elements regarding “qualifier status,” “seasons used,” “reasons for leaving the institution” and waivers that are used to accurately compute a student-athlete’s eligibility or are needed for yearly Academic Progress Rate (APR) reporting could be captured over time and held in this file. CAi The NCAA responded to institutions that needed technology help with their certification processes by developing an online application called Compliance Assistant interactive (CAi). This service can serve as a certification application system by allowing member institutions to upload student-athlete demographic, financial aid and academic information to the site for viewing by all assigned campus constituents. The CAi is a data-holding database that is an optional service provided by the NCAA with some pros and cons to be considered before using: Pros of CAi Fields available for demographic, financial aid and academic eligibility student-athlete data Once XML program is written, mapped and tested, upload capabilities are simple and can be automated Reporting function incorporated; both standard and ad-hoc reports available for download Data in CAi can be downloaded for institutional use in other applications Data held in CAi will be used in yearly APR reporting and can be migrated to the APP application, making for an easier APR process NCAA technical support is available and responsive A network of users at other institutions are willing to assist with technical issues Cons of CAi Security concerns of storing student-athlete data outside of university servers and security (The same data will have to be submitted eventually with the APR reporting) Requires XML programming knowledge and a high level of internal tech support during initial programming, mapping and testing Designed by NCAA for all member institutions; alterations for specific institutional needs is not available Authorization to CAi are maintained, granted and monitored by the institution The data uploaded and displayed is of actual student-athlete academic performance and does not include any forecasting of student-athlete status Does not facilitate the storage of all non-academic APR data Recommendations The Athletic Association should consider creating an IT resource position to be shared with the Registrar’s Office. OIT computing resources are shared by the entire campus and, even when fully staffed, are challenging to get assigned to Registrar initiatives. A dedicated technical resource, whose use would be prioritized by the Registrar’s Office and the Athletic Advising unit, could make headway on many technical initiatives until OIT resources are secured for larger projects. 8 A comprehensive degree audit system should be in place with an institutional commitment to initiate, support, and maintain the system. The system should have some forecasting capabilities, allowing students and advisors to determine the degree applicability of planned courses. The Registrar’s Office should own the system and the project to effectively roll out the product, maintain its accuracy, train its users and champion its usage should all reside within that office. An Assistant Registrar position for Degree Audits should be created and funded to oversee this cornerstone application. Georgia Tech should import data to the NCAA’s CAi application. Clear and detailed policies and procedures should be developed regarding upload timing, personnel access and data changes. The Athletic Association Compliance Office should be the campus contact for the institution and be charged with granting and monitoring access to the system. The Registrar’s Office should coordinate the upload of all data to CAi and address any data integrity issues. The Athletic Advising unit should continue to submit the APR data but should utilize the migration of data from the CAi system to take advantage of the smaller APR flat file upload. Georgia Tech should develop an in-house athletic certification application to assist in the monitoring and institutional controls associated with their student-athletes. Online versions of the eligibility forms, pre-populated with academic and degree audit information, with Georgia Tech academic rules included could be an effective and necessary first step. 9