Running head: PROGRESS THROUGH THE SEQUENCE Progress through the Basic Skills Sequence Rick Fillman Institutional Research Analyst Planning and Research Office January 2012 Progress through the Basic Skills Sequence 2 of 5 Introduction Success in college level course work depends on a certain level of literacy and numeracy. Incoming students, however, are often unprepared for college level courses. This report presents a compilation recent data that examines the basic skills pipeline at Cabrillo College. A student centric view Course success is possibly the most frequently examined measure at the college. Course success represents the outcomes from one classroom from one semester. Therefore, course success speaks to curriculum and to teaching. Student success, on the other hand, ought to take a longer view. Students may fail or withdraw in any single semester, and may repeat. A more interesting measure looks at what happens to individual students over several semesters. A longitudinal study looks at individual students’ progress over time. Usually, individual students are grouped into cohorts according to their start-year. Then, in order to be able to compare different cohorts with different start-years, a time window must be imposed. For example, outcomes are examined after three years for all cohorts1. This way, it becomes possible to compare the outcomes from various cohorts, even though they have different start-years. It also means that all cohorts must be allowed time to reach the endpoint of the time window. Methodology For this study, cohorts were assembled around the year of a student’s first math or English class2 and around the level of that course. Cohorts were thus assembled from enrollment records. Next, the members of these cohorts were ‘followed’ for three years, with each subsequent enrollment in English or math examined and tracked. Student Assessment/Placement records were also incorporated into the study. These records include equivalency credit for prerequisite courses taken at another institution. Thus, in combination with the 1 Most individual student activity in the sequence is concluded within three years, either through completion, or by stopping out at one of the levels along the way. 2 To establish first-time-in-subject, enrollment records were examined back to fall 2000. Page 2 Progress through the Basic Skills Sequence 3 of 5 enrollment records, it becomes possible to ascertain how a student became eligible for enrollment in a particular course. The cohorts examined in this study are data cohorts, formed for research convenience. For the most part, students from the several entry-cohorts did not attend together.3 The average classroom will consist of students who are at one point or another in their journey through the sequence. Students entering the sequence from the lowest level may do so without undergoing assessment testing; these students may therefore be regarded has having self-assessed. But from the next level forward, enrollment is controlled, and restricted to students meeting the prerequisite – either by the assessment, an equivalency from another institution, or by way of promotion, having passed the prerequisite course. Enrollment in an average classroom for courses in the sequence may consist of students who are in one of four categories: • the student qualifies via assessment/placement • the student qualifies by way of an equivalency • the student passed the prerequisite course • the student is repeating the course Figure 2a (English) and Figure 2b (math) illustrate the mix of Students that might be expected in the average section English and math basic skill sequence courses. Data are from 2007-08 through 2010-11. Attrition points The length or number of levels in a sequence has implications for longitudinal attrition. There are two opportunities for attrition at each level. Attrition obviously occurs when students (after possibly multiple attempts) do not satisfactorily pass a course. The second opportunity for attrition involves abstention, procrastination, or possible difficulty in enrolling in the next course in the sequence. Many students who are otherwise eligible for the next course in the sequence will stop out. Some amount of attrition is inevitable, even natural. The effects of attrition multiply with the number of opportunities. Imagine, for 3 Sections set aside for Learning Communities are a possible exception Page 3 Progress through the Basic Skills Sequence 4 of 5 example, a program where 80% of the cohort move forward at each attrition opportunity - a very successful program! After three levels (and six opportunities for attrition), only about one quarter of the original cohort would remain. The chart below illustrates how, even with an extremely enviable rate of progress to the next level, the throughput is small. What if attrition were merely 20% at each level? Conti nua ti on Ra te 80% 80% 80% 80% 80% 80% Res ul t 100 80 64 51 41 33 26 students in the entry cohort pass level 1, eligible to move ahead enroll level 2 pass level 2, eligible to move ahead enroll level 3 pass level 3 enroll in College level Figure 1a (English) and Figure 1b (math) show the actual attrition rates for Cabrillo College entry-cohorts in math and English. Students are grouped according to the level of their first course in the sequence and by year of entry. These data are averages from the four cohorts from academic year 2004-05 through 2007-08. More detail on progress through the sequence Table 1a (English) and Table 1b (math) reveal much more detail regarding the entry-cohorts and their progress through the developmental sequence. The following questions are answerable from the detail datasets. • • • How many students are entering at a particular level each academic year? How many [and what percent] of the entry-cohort successfully complete coursework at this level? On average, how many separate enrollments were observed at this level? In other words, what is the average number of repeats within this level? 4 4 In math, there may be two courses within one level. Students have the option of completing Essential Math in two semesters: one semester each of MATH-254A and MATH-254B. This study glosses over the distinction between repeats in MATH-254, and initial enrollments/repeats in MATH-254A/B. In other words, all enrollments within this level are counted as attempts. Further research might examine the efficacy of the MATH-254A/B pathway. Page 4 Progress through the Basic Skills Sequence 5 of 5 • How many [and what percent] of those who took courses in one level enroll in the next level in the sequence? Following the progress of the cohort from the start-year at the left, and moving across, left to right, these questions can be answered at each level. The headcount numbers (highlighted columns) show the actual number of cohort members persisting at each level in the sequence. For example, from Table 1b (Math), one might focus on the 2007-08 entry-cohort starting at 3 levels below transfer. The entry-cohort consists of 736 individuals. Of these, 61.3% (451) are successful after one or more enrollments at this level, and are eligible for the next course. However, only 44.6% (328) students attempt Elementary Algebra. The individual success rate in Elementary Algebra (after one or more attempts) for these students is 73.8%. Thus, 242 students successfully complete the course, and are eligible for Intermediate Algebra. However, only 145 continue in Intermediate Algebra, and so on. When it comes to transfer-level math, only 73 students from the original entry-cohort enroll. Thus, from the 2007-08 entry-court starting from three levels below, about one in ten enroll in transfer level math (within three years). Summary Student success in a course sequence is not just about what happens in the classroom, but is also about persisting to the next level. Sequenced courses ought to be examined sequentially, using longitudinal cohort analysis of student progress. Perhaps greater attention should be focused on the attrition opportunities between completion of one level and enrollment in the next. Page 5 Progress through the Basic Skills Sequence Figure 1a Students starting 2 levels below transfer: [ENGL-255] Basic English 80% 70% 60% 50% 40% 74% 30% 55% 45% 20% 29% 10% 0% Passed Basic English Enrolled Elements of Writing Passed Elements Enrolled Transfer of Writing level English Students starting 1 level below transfer: [ENGL-100] Elements of Writing 90% 80% 70% 60% 50% 40% 78% 30% 57% 20% 10% 0% Passed Elements of Writing Enrolled Transfer level English Starting from 100%, the percent of the entry cohort remaining is shown at each attrition opportunity. Data cohorts are from 2004-05 through 2007-08. Outcomes are examined after three years. 1/31/2012 Progress through the Basic Skills Sequence Figure 1b Students starting 3 levels below transfer: [MATH-254] Essential Math 70% 60% 50% 40% 30% 65% 47% 20% 34% 21% 10% 16% 11% 0% Passed Essential Math Enrolled Elementary Algebra Passed Elementary Algebra Enrolled Intermediate Algebra Passed Intermediate Algebra Enrolled Transfer Level Math Students starting 2 levels below transfer: [MATH-154] Elementary Algebra 80% 70% 60% 50% 40% 71% 30% 54% 20% 39% 27% 10% 0% Passed Elementary Algebra Enrolled Intermediate Algebra Passed Intermediate Algebra Enrolled Transfer Level Math Starting from 100%, the percent of the entry cohort remaining is shown at each attrition opportunity. Data cohorts are from 2004-05 through 2007-08. Outcomes are examined after three years. 1/31/2012 Progress through the Basic Skills Sequence Table 1a. Students, and their progress in the English core sequence Cohorts formed around students' starting level Elements of Writing Basic English Headcount (each student counted once) Academic Year 2004/05 2005/06 2006/07 2007/08 NN N N N N N 299 513 497 515 Individual (after one or more attempts) Success Rate % of cohort Average who number attempt of the next repeats Level NN NNNNN NNNNN N N NNNNNNN 77.6% 77.0% 72.6% 68.5% 1.3 1.3 1.3 1.2 Transfer level English Headcount (each student counted once) Individual (after one or more attempts) Success Rate % of Average cohort who number attempt of the next repeats Level NNNNNNN NNNNNNN N N N N NNN NNNNN NN 57.5% 59.5% 54.7% 51.1% 172 305 272 263 83.1% 84.3% 81.6% 78.3% 1.3 1.3 1.3 1.2 Headcount (each student counted once) Individual (after one or more attempts) Success Rate NNNNNNN NN N N N NN 43.0% 54.1% 52.6% 52.9% 74 165 143 139 Average number of repeats N N N N NNN CMicroLine 82.4% 81.8% 81.1% 68.3% 1.2 1.2 1.2 1.1 Students starting 2 levels below transfer [ENGL-255] Data is compiled 3 years from starting the first course in the sequence. Elements of Writing Academic Year 2004/05 2005/06 2006/07 2007/08 Transfer level English Headcount (each student counted once) Individual (after one or more attempts) Success Rate % of Average cohort who number attempt of the next repeats Level NNNNNNN NNNNNNN N NNNN N NN 1,150 1,021 962 1,062 78.8% 78.3% 78.0% 78.1% 1.2 1.2 1.2 1.2 Headcount (each student counted once) Individual (after one or more attempts) Success Rate NNNNNNN NN N NN NN 54.9% 57.9% 57.9% 58.0% 631 591 557 616 Average number of repeats NNNNNNN CMicroLine 79.9% 81.4% 80.6% 81.7% 1.2 1.3 1.2 1.1 Students starting 1 level below transfer [ENGL-100] Transfer level English Cohorts formed around the level and year of the student's first English enrollment. Outcomes within three years of first English enrollment. Academic Year 2004/05 2005/06 2006/07 2007/08 Headcount (each student counted once) Individual (after one or more attempts) Success Rate NNNNNNN NN N N N NN 1,008 1,056 950 1,101 Average number of repeats N CMicroLine 82.7% 82.3% 78.5% 77.0% 1.2 1.2 1.2 1.2 Students starting at transfer level 1/31/2012 Progress through the Basic Skills Sequence Table 1b. Students, and progress in the Math core sequence Cohorts formed around students' starting level Elementary Algebra Essential Math Headcount (each student counted once) Academic Year NNNNNNN 2004/05 2005/06 2006/07 2007/08 799 698 700 736 Individual (after one or more attempts) Success Rate Average number of attempts at this level* % of cohort who attempt the next Level NNNNNNN NNNNNNN NNNNNNN 64.7% 67.3% 66.0% 61.3% 1.5 1.6 1.5 1.5 Headcount (each student counted once) Individual (after one or more attempts) Success Rate N N NNNNN NNNNNNN N 44.7% 51.0% 50.1% 44.6% 357 356 351 328 72.8% 72.2% 70.9% 73.8% Average number of attempts at this level* Intermediate Algebra % of cohort who attempt the next Level Individual Headcount (after one or more (each attempts) Average student Success number of counted repeats Rate once) N N NNNNN NNNNNNN NNN N NNN 1.5 1.5 1.6 1.5 45.7% 42.4% 43.3% 44.2% NNNNNNN NNNNNNN 163 151 152 145 77.9% 74.2% 77.6% 73.8% 1.4 1.4 1.3 1.2 Transfer Level Math % of cohort who attempt the next Level NNNNNNN 52.8% 57.0% 45.4% 50.3% Headcount (each student counted once) Individual (after one or more attempts) Success Rate N N NNNNN NNNNNNN 86 86 69 73 Average number of repeats NNNNNNNCMicroLine} 75.6% 83.7% 79.7% 69.9% 1.6 1.5 1.6 1.4 Data is compiled 3 years from starting the first cours in the sequence. Students starting 3 levels below transfer [MATH 254] Data is compiled 3 years from starting the first course in the sequence. Elementary Algebra Academic Year Data is compiled 3 years from starting the first course in the sequence. Headcount (each student counted once) Individual (after one or more attempts) Success Rate NNNNNNN NNNNNNN 2004/05 2005/06 2006/07 2007/08 718 663 632 706 73.4% 72.7% 69.9% 67.4% Average number of attempts at this level* Intermediate Algebra % of cohort who attempt the next Level Individual Headcount (after one or more (each attempts) Average student Success number of counted repeats Rate once) N NNNNNNN NNNNNNN 1.3 1.3 1.3 1.3 51.3% 54.0% 56.2% 54.4% NNNNNNN NNNNNNN 368 358 355 384 73.9% 71.5% 71.8% 75.0% 1.4 1.4 1.3 1.3 Transfer Level Math % of cohort who attempt the next Level N N NNNNN 50.3% 50.3% 49.6% 49.5% Headcount (each student counted once) Individual (after one or more attempts) Success Rate NNNNNNN N N NNNNN 185 180 176 190 Average number of repeats NNN N NNNCMicroLine} 74.6% 75.0% 83.5% 78.4% 1.6 1.5 1.5 1.6 Students starting 2 levels below transfer [MATH154] Intermediate Algebra Cohorts formed around the level and year of the student's first math enrollment. Outcomes within three years of first math enrollment. *The two-semester versions, MATH-254A/B are treated as separate attempts within the same level. Transfer Level Math Individual % of Headcount (after one cohort who or more (each attempt attempts) Average student Success number of the next counted Level Rate repeats once) Academic Year 2004/05 2005/06 2006/07 2007/08 NNNNNNN 741 798 743 851 NNNN NNN NNNNNNN 77.9% 73.4% 72.8% 69.8% 1.4 1.4 1.4 1.5 NNN N NNN 57.2% 55.4% 55.3% 53.9% Headcount (each student counted once) Individual (after one or more attempts) Success Rate NNNNNNN NNNNNNN 424 442 411 459 80.9% 75.3% 77.1% 76.3% Average number of repeats N N N N NNNCMicroLine} 1.4 1.4 1.4 1.5 Students starting 1 level below transfer [MATH152] 1/31/2012 Progress through the Basic Skills Sequence Figure 2a. Average classroom composition English 255 Unknown, 23% Repeated, 13% Placed, 64% Equivalency, 1% English 100 Unknown, 6% Repeated, 19% Placed, 54% Promoted, 18% Equivalency, 3% English 1A Repeated, 16% Promoted, 37% Unknown, 4% Placed, 35% Equivalency, 8% Unknown: For the first course in the sequence, "Unknown" may be interpreted as "self-palced". Placed = the student qualifies via assessment/placement Equivalency = the student qualifies by way of an equivalency from another institution Promoted = the student passed the prerequisite course Repeated = the student is repeating the course Based on enrollments from four recent years: AY 2007-08 through AY 2010-11. Source: Cabrillo College Research Data Warehouse. 1/31/2012 Progress through the Basic Skills Sequence Figure 2b. Average classroom composition Math 254 Unknown, 21% Repeated, 16% Placed, 62% Equivalency, 1% Math 154 Unknown, 2% Repeated, 30% Placed, 39% Promoted, 22% Equivalency, 6% Unknown, 2% Repeated, 30% Promoted, 28% Math 152 Placed, 34% Equivalency, 7% Unknown: For the first course in the sequence, "Unknown" may be interpreted as "self-palced". Placed = the student qualifies via assessment/placement Equivalency = the student qualifies by way of an equivalency from another institution Promoted = the student passed the prerequisite course Repeated = the student is repeating the course Based on enrollments from four recent years: AY 2007-08 through AY 2010-11. Enrollments in two-semester sequence MATH-254A/B and MATH 154A/B were excluded . Source: Cabrillo College Research Data Warehouse. 1/31/2012