Predicting Enrollments – Principles and Practices Page 1 Predicting Enrollments – Principles and Practices Lou McClelland, Planning, Budget, and Analysis, CU-Boulder Statewide Higher Education Budget Meeting, August 18, 2006 This document and accompanying Excel are posted at http://www.colorado.edu/pba/records/enrlproj.htm See links under “Methods used” University of Colorado at Boulder = CU-Boulder = Boulder = UCB. Background About 30,000 students in on-campus and continuing ed 85% undergraduate 69% Colorado residents Predominant unrestricted revenue sources: Out-of-state tuition, in-state tuition, COF, fee for service. Why predict? To manage Advance notice of need for more/fewer beds in dorms, instructors, etc. To meet formal constraints such as CCHE admission standard To meet goals To predict money Tuition COF, FTE Expenses – we do this very informally; not discussed here To answer questions from the press, administrators, others Reasons for you? What do you want/need to predict? Headcounts or credit hour counts or some mix Boulder: Heads, period. Most students are full-time and credit loads are stable. Enrolled when? Boulder: Fall census, period. Because Fall drives spring, and almost 90% of new students enter in fall Freshmen 98%, UG transfers 65%, grad level 91% It’s earlier than end of term, and people want info earlier Our end of term counts are very similar to census How far out? Boulder: Coming fall, plus 5-10 years after Cu-Boulder PBA: Lou.McClelland@colorado.edu -- D:\533566620.doc -- 02/16/16 - Page 1 Predicting Enrollments – Principles and Practices Page 2 Enrolled how? Boulder: Degree-seeking students not enrolled solely through continuing ed Study abroad and faculty-staff waivers also excluded “Enrollment management population” “In Boulder to study, vs. studying while in Boulder” Restrict because others are not critical to management, constraints, goals, or money How chopped up Boulder: Grad vs. undergrad Resident vs. non-resident Why? We are 1/3 non-resident, and non-res tuition is 5 times resident tuition, 3 times resident tuition plus COF New vs. continuing, with new freshmen and transfers separated We don’t project by college, or by full-part time, even though both affect tuition charges. Why? Distributions over college and full-part are stable. The smaller the group projected, the less accurate the projections. You might need: Non-degree. Continuing ed. By college, by when entered, by gender, by day/evening, by . . . . Depends on what outcomes are important to you. All these decisions determine what outcomes, what counts, you need Boulder needs only 10 counts. Always in this order, with these totals/subtotals, with Res, NR, All for each Undergrads in colleges A&S, business, engineering, EV, journalism, music, education Continuing and readmit New frosh New transfers All new UG (subtotal) All UG (subtotal) Graduate level in colleges GR, BG, Law Continuing and readmit New All grads (subtotal) Total degree/certificate students with reportable hours -- excludes non-degree, reciprocal, fac/staff, study abroad (grand total) Write down what you want/need to predict Cu-Boulder PBA: Lou.McClelland@colorado.edu -- D:\533566620.doc -- 02/16/16 - Page 2 Predicting Enrollments – Principles and Practices Page 3 Doing the predictions – Basic steps Identify inputs, partition students by inputs What’s used in predicting new freshmen may be useless for predicting seniors, grads, or repeating non-degree students Partitions may or may not be the same as the needed separate counts Develop a method for each partition Put effort on more important partitions Boulder: Continuing undergrads and new freshmen are by far the most important Project the same time point for each partition Add it all together, making sure there are no gaps and no overlaps or double-counts All this makes most sense by illustration! Boulder partitions and inputs New freshmen and transfers HS grads, admissions activity Continuing undergrads Students available to continue, by class level. Freshmen stick around, seniors don’t. New grads Continuing grads Students available to continue, by college. MBA, law, master’s, doctoral students continue differently. All: Plus residency, history, knowledge of changes History = What it looked like last year, last term, some prior period What partitions and inputs will you need? Illustration: Boulder cycle for an upcoming fall – say fall 03 Census fall ’02 around Sept 15 Oct 02, have all fall 02 census data. Formula prediction of fall 03 continuing undergrads. Biggest group! Base on current UG enrollment and fall 01 to fall 02 transition ratios by residency and class level. Assume transitions from fall 02 to fall 03 will be the same. Check error rates and trends. Committee hand adjusts if appropriate. Method: Ratios from individual-student data. See Excel for details. Formula prediction of fall 03 continuing grad level. Similar but much less sophisticated, using aggregate data only. Method: Ratios from counts. See Excel for details. Committee uses time trends, knowledge of current situation, knowledge of Univ. and environment changes, etc. to estimate/guess fall 03 new transfers, new grads Committee is Admissions, Registration, Aid, Bursar, Housing, Budget, PBA Estimate by on-the-spot Delphi Method: Extending time series. See Excel for details. Set starting guess or goal for freshmen Cu-Boulder PBA: Lou.McClelland@colorado.edu -- D:\533566620.doc -- 02/16/16 - Page 3 Predicting Enrollments – Principles and Practices Page 4 Oct-August, predict fall census freshmen weekly. Transfers Jan-August. We admit freshmen starting in October. App deadline January, admit by April 1, confirm by May 1. We have snapshot files for every week of the year for four years, with individual student data. We create a new snapshot every week. Use the snapshot from this-time-last-year, plus last-year finals, to calculate lastyear probabilities of completion, admission given completion, and matriculation given admission Based on the student’s then-current [same week last year] admission status, academic credentials, housing contract status, and residency. Admission status = incomplete, complete no decision, refused, postponed decision, admitted not confirmed, confirmed Apply the probabilities to this-year counts. Can adjust to accommodate Different expected N of total apps this year (used early in the season) Different admission probabilities from last year, for a status-credentialsresidency group. Expected increases or decreases in yield rates within groups Our rates vary between 6% and 60% over residency-credentials groups! February – Adjust continuing undergrad projection based on spring census Feb-May – Glance at new-grad activity. Revise estimates only if see earthquakes. May-July, Project all grads and continuing UG based on registration for coming fall. Start after all registration time assignments are past. August/Sept – Prep for census. Census. Wrap up files, start new cycle. Throughout the cycle, we issue 3 or 4 official “best guess” estimates – Oct or Nov, sometimes Dec/Jan, Feb after spring census, May before budget retreat Demonstration of pieces of the methods See demos in Excel http://www.colorado.edu/pba/records/enrlprojmeth.xls Includes tabs for Extending a time series Ratios from counts Ratios from individual student data Cu-Boulder PBA: Lou.McClelland@colorado.edu -- D:\533566620.doc -- 02/16/16 - Page 4 Predicting Enrollments – Principles and Practices Page 5 Longer term projections Emphasis is on a tool to project several years given different assumptions Enrollment management population only Basis of projections Continuing undergrads: Based on same transition ratios used in fall-to-fall estimates, by class level and residency. Can increase/decrease continuation rates if desired All others: Type ‘em in. Can tie freshmen to HS grads if want, or not. Update annually about November. Reconcile to next-fall projections. Outcomes Total enrollment by grad/UG, new/continuing, frosh/transfers, by residency Many percentages and plots See small example with formulas, and the real thing, in the Excel. Principles in developing methods Identify inputs, partition by inputs. Put your effort where it’s most important Determine your cycle and worry about time points. You must have data for multiple instances of the time point of interest. To use interim activity (apps, admits, registrations) you must have prior-cycle data for interim points too. Frozen snapshot files are nice. Matching interim time points over years or terms can be tricky, with holidays, some relative dates (first Monday in Sept), some absolute (May 1) Try it LOOK AT THE DATA, do reality checks Need calculation and display and error-tracking outputs Principles – Overall Know what you want/need to predict, and why Show everything in a standard array. Make a formal “best guess,” label it so, and don’t change it very often. Don’t issue new projections every week or month. In setting best guesses, consider the costs of estimating too high, and of estimating too low. We set best guesses so that equal chance actuals will be higher or lower. Track what happened. Calculate error rates. If you’re just starting, apply your methods on already-past cycles and calc error rates on those. Look at plots of actual vs. projected. Understand the processes that generate your inputs, and changes in them. Example: Application deadline changed by a month Example: Last year Orientation phoned no-shows, this year they didn’t. Affects cancellations. Cu-Boulder PBA: Lou.McClelland@colorado.edu -- D:\533566620.doc -- 02/16/16 - Page 5 Predicting Enrollments – Principles and Practices Page 6 Know plans, changes that might change the relationship between inputs and outcomes Example: A bunch of admits got $5000 scholarship offers this year; none did last year. Yield went up. Example: Probation policy changes Educate your users about error and assumptions Expose the error rates. With bands, labels, and admonitions, caution that projections are just estimates or guesses, have assumptions [list them], have error. Round. Your estimates aren’t precise; don’t present them that way. Recognize (and publicize) that in the middle of a cycle there’s no way to differentiate changes in overall numbers from changes in speed It’s Jan 1 and you have 20% fewer apps or registrations than last year. Is this because 20% fewer will apply/register ever, or because students are slower this year? You can’t tell. Realize and publicize that every projection involves many assumptions about Student/applicant behavior The college or university’s behavior The state’s behavior Cu-Boulder PBA: Lou.McClelland@colorado.edu -- D:\533566620.doc -- 02/16/16 - Page 6