UPPER DIVISION WRITING REQUIREMENT EXECUTIVE SUMMARY In this project we analyzed how students meet the Upper-Division Writing Requirement. We compared the pass rates and identified differences in characteristics of students who take the Upper-Division Writing Examination (UDWE) and those who enroll in an upper-division writing course (W-Course) in the period between fall 2002 and fall 2007. • The percentage of students who passed the UDWE (64%) is noticeably lower compared to the percentage of those who passed a W-Course (92%) (Page 3). • The average UDWE pass rates vary by college from a low of 45% for Engineering to a high of 68% for Arts & Humanities (Page 7). • The average W-Course pass rates vary from 81% for CSB to 87% for Education and Engineering (Page 7). • Whites and females are more likely to take the UDWE (Page 8). • African-Americans are the least likely to pass the test (29%) and the course (78%) (Page 9). • Students with higher GPAs are more likely to take the UDWE (Page 10). • The average GPA of students who are failing the UDWE is at the level where students are likely to pass a W-Course (Page 10). • The average UDWE pass rates vary by major from a high of 90% for English to less than 40% for Kinesiology and Criminology (Page 15). • Undeclared and Pre-Business majors were least likely to pass the course (Page 16). UDWE Report Institutional Research, Assessment and Planning – Dmitri Rogulkin – 3/14/2008 1 Introduction All undergraduate students must demonstrate competency in writing skills at the upper division (junior/senior) level as a requirement for graduation. Students may meet this requirement in one of two ways: either pass the Upper-Division Writing Examination (UDWE), or obtain a “C”, “CR”, or higher grade in an approved upper-division writing course (W-Course). The purpose of this project is (1) to look at the characteristics of students enrolling in a W-course and those taking the UDWE, and (2) to compare the “success” rate of the UDWE versus W-course option. The success rate is identified as a pass / failure rate. UDWE is given five times each year in January, March, June, August and October. There were a total of 21 approved upper-division courses, identified in the catalog by the letter “W”. The analysis covered the period between fall 2002 and fall 2007. Following are the findings of the analysis. UDWE Report Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 2 Summary Statistics for the UDWE and W-Course Options. Fall 2002 – Fall 2007 Students who took UDWE Total Unique Count: 5,837 Passed: 3,323 (57%) Students who took only W-Course: Total Unique Count: 13,862 Failed: 2,514 (43%) Passed: 1st attempt: 11,860 (86%) Overall: 12,756 (92%) Failed: 825 (6%) Withdraw: 281 (2%) Retook UDWE second time: 992 (39%) Passed: 423 (43%) Took W-Course: 1,076 (43%) Passed: 1st attempt: 963 (89%) Overall: 1,023 (95%) Took W-Course: 444 (78%) Passed: 1st attempt: 383 (86%) Overall: 420 (95%) Failed: 569 (57%) Other 125: • Graduated: 20 • Enrolled*: 62 • Not Enrolled: 43 Total Fail/Withd: 1,106 • Not UGRD: 42 • Graduated: 49 (4%) • Enrolled*: 502 (45%) • Not Enrolled: “120+” CumUnits: 106 “0-119” CumUnits: 407 • 3,746 students eventually passed the UDWE, which is 64% of the total number who took the test. • Those who failed the test and then took the W-Course, passed the course at 95% rate, incl. 89% passing on the first course attempt. • 12,756 students eventually passed the W-course, which is 92% of the total number who selected the W-Course option; 86% passed the course on the first attempt. * Enrolled: students who were enrolled in spring 2007 and/or fall 2007. Not enrolled: students who were not enrolled in both spring and fall of 2007. Note: Pass includes: 114 or higher UDWE score, A, B, C, CR grades for W-Course. Fail includes: 113 or less UDWE score, D, F, NC, WU (Withdrawal Unauthorized, IC (Incomplete Charged) grades for W-Course. Withdraw includes: W (Withdrawal), I (Incomplete Authorized) grades for W-Course. UDWE Report Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 3 Proportion of Students Enrolled in UDWE and/or W-Course by Academic Year. UDWE and W-Course Enrollment by Academic Year. 28% 30% 26% 29% 30% 72% 70% 74% 71% 70% 2003-04 2004-05 2005-06 2006-07 Grand Total 34% 66% 3,336 3,043 2,952 2,702 1,202 2005-06 1,388 1,303 2004-05 1,153 1,405 UDWE-Test W-Course 1K 2006-07 2005-06 2004-05 2003-04 2002-03 2006-07 2003-04 2002-03 0K 2002-03 Students Count Duplicated 3K 2K UDWE Option W-Course 3,341 UDWE-Test 4K • Enrollment in W-Courses is growing, along with the university’s enrollment overall. • Overall, 70% of students fulfilling upper-division writing requirement select a W-Course, while 30% take the UDWE. UDWE Report Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 4 12% 12% 11% 11% 85% 84% 83% 84% 2003-04 2004-05 2005-06 2006-07 Total 83% 2002-03 Total 55% 2006-07 45% 57% 2005-06 43% 55% 2004-05 45% 56% 2003-04 44% 54% 2002-03 46% 13% * • The “Pass / Fail” ratio was consistent across the past five years for both the UDWE and W-Course options. • The proportion of the tests passed (55%) was considerably lower than the proportion of the W-Courses passed (84%). * The basis for the proportion is the number of all tests / w-courses taken (not the number of individual students). Note: The UDWE pass score is 114. The score includes 2 essays and a multiple-choice CAAP portion. Following is the score formula: (CAAP x 1.22) + ((Essay A + Essay B) x 2.5). Essays are graded by two readers on a scale from 1 to 6. Maximum score possible for an essay portion is: (12 + 12) x 2.5 = 60 UDWE Report Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 5 UDWE and W-Course Enrollment by College and Academic Year UDWE and W-Course Proportions by College and Academic Year UDWE and W-Course Enrollment by College and by Academic Year. UDWE-Test W-Course Null 24 15 27 23 23 174 168 180 181 217 AH 4 4 339 353 395 2 9 422 402 • AST 123 120 104 101 114 157 183 224 231 276 remained somewhat 750 740 768 803 850 consistent for the colleges in CSB 9 ED 406 6 265 3 233 6 the past five years, with the 8 440 216 522 exception of Agricultural 467 187 401 337 Sciences & Technology, where the UDWE-test ENG 38 57 79 79 74 157 155 144 134 125 proportion gradually declined and Engineering EXT HHS Overall, the proportions 12 14 8 23 73 47 320 271 353 307 377 427 150 159 138 185 251 221 245 10 7 6 4 9 56 47 25 169 136 180 169 210 218 277 301 15 22 264 207 173 SM 46 51 524 553 297 307 where it steadily increased. Note: Craig School of Business requires a specific “W” class. SPE SS 44 32 437 394 2002-03 2003-04 2004-05 2005-06 2006-07 2002-03 2003-04 2004-05 2005-06 2006-07 UDWE Report Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 6 Pass/Fail forthe theUDWE UDWE W-Course Options by College and Academic Pass/FailRatio Ratio for andand W-Course Options by College and by Academic Year. Year UDWE-Test W-Course Pass/Fail Other 28% 32% 37% 29% 32% 32% 72% 68% 63% 71% 68% 68% AH Fail 85% 84% 85% 84% 87% Pass 85% • Success rates for the UDWE and W-Course options are somewhat AST 57% 48% 55% 51% 48% 52% 43% 52% 45% 49% 52% 48% consistent across the past five years at 83% 84% 90% 87% 86% 86% 15% 19% 15% 15% 81% 77% 81% 81% Engineering were there were some 100% CSB ED * 14% 50% 33% 56% 50% 67% 50% 43% 46% 47% 46% 47% 50% 57% 54% 53% 54% 53% 44% the college level, with the exception of 88% 59% 83% 83% 41% variations in the pass rates for the UDWE option. • 85% 89% 86% 86% 86% 87% College of Arts & Humanities has the highest success rate for the UDWE (68%), while Engineering has the ENG 61% 54% 59% 44% 58% lowest (45%) 55% 83% 39% 46% 41% 56% 42% 45% 50% 52% 47% 46% 51% 49% 50% 48% 53% 54% 49% 51% 34% 37% 36% 39% 36% 36% 16% 66% 63% 64% 61% 64% 64% 79% 45% 43% 44% 43% 56% 57% 90% 85% 90% 85% 87% • Craig School of Business has the lowest W-Course success rate (81%), HHS 83% 82% 85% 85% 84% 84% while Education and Engineering have the highest (87%). SM 88% 88% 88% 84% 85% * UDWE ratio for CSB is not shown due to the small number of students 48% 45% SS 55% 57% 52% 2002-03 2003-04 2004-05 2005-06 2006-07 UDWE Report 55% Total 86% 85% 82% 83% 82% 2002-03 2003-04 2004-05 2005-06 2006-07 83% who took the test in that school. Total Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 7 UDWE and W-Course Enrollment by Student Level (Fall 2002 – Fall 2007) UDWE-Test W-Course Males are less likely to take the UDWE • White students constitute half of the 3,984 UDWE takers (but the proportion of whites in the total undergraduate student body is only 100 N/A Senior PBAC 78 1,733 Junior • 36%). 127 Sophomore 0K Freshmen 16 Students Count Unduplicated 6K 2K Most of the students take the UDWE and/or W-Course at their senior or junior level. 8K 4K • UDWE and W-Course Enrollment by Gender (Fall 2002 – Fall 2007) UDWE and W-Course Enrollment by Ethnicity (Fall 2002 – Fall 2007) 100% 15% 8% 23% 50% 51% 0% UDWE-Test UDWE Report Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 8 Pass/Fail Ratio for the UDWE and WCourse by Gender Pass/Fail Ratio for the UDWE and W-Course by Student Level UDWE-Test W-Course 7% 47% 46% 45% 20% 15% 73% 80% UDWE-Test 11% 13% W-Course 14% 48% 10% 44% Pass/Fail Other Fail Pass 67% 53% 54% 55% Soph.. Junior Senior 85% 83% 52% 56% Male Female 81% 86% Male Female 33% Fresh.. Fresh.. Soph.. Junior Senior Pass/Fail Ratio for the UDWE and W-Course by Ethnicity UDWE-Test W-Course 10% 35% 37% 62% 71% 63% White Hispanic 29% Black 41% 16% 14% 16% Other Fail Pass 86% 82% 78% 82% White Hispanic Black Asian 82% 85% 59% 42% Asian Native- Unknown American Native- Unknown American • Whites and females have the highest percentage of passing the UDWE test and the W-Course. • African-Americans are the least likely to pass the test and the course. UDWE Report 10% 58% 65% 38% 12% Pass/Fail Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 9 Average Cumulative GPA* for UDWE and W-Course Options by Pass / Fail W-Course Avg Cumulative GPA 2.96 2.43 Pass Fail 2.62 Other 2.88 Total • Average cumulative GPA for students taking the UDWE is higher than for the W-Course option (3.13 vs. 2.88). • Students who failed the UDWE had an average cumulative GPA of 2.97, which is at the level where students were likely to have passed the W-Course. * Data includes fall 2002 – fall 2007 period. UDWE Report Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 10 UDWE and W-Course Enrollment by Course and by Term. Total UDWE* Total W-Course AAIS 104W ANTH 105W ANTH 116W ASP 105AW ASP 105BW BA 105W, IS 105W ECON 102W ENGL 115W ENGL 160W ENGR 105W ESL 110W ETHS 104W GEOG 189W IE 182W IT 198W LING 110W LING 111W MCJ 102W PHIL 133W PLANT 110W SOC 130W Fall 2002 497 1,324 Spr 2003 908 1,378 Fall 2003 466 1,494 Spr 2004 687 1,458 134 5 217 52 172 7 112 170 Fall 2004 472 1,515 72 86 214 1 Spr 2005 831 1,528 76 79 164 Fall 2005 434 1,619 101 86 234 3 Spr 2006 768 1,722 82 140 249 Fall 2006 440 1,636 99 143 172 3 487 4 429 498 6 458 432 5 496 420 2 452 405 27 319 12 329 8 360 2 332 18 326 16 335 10 366 21 340 11 433 46 56 41 120 35 95 33 60 27 37 38 28 83 33 57 22 57 70 63 45 24 114 92 139 202 60 14 23 43 17 44 19 49 48 14 49 21 42 75 24 55 33 50 54 20 58 16 38 90 25 49 33 40 51 12 38 25 28 43 45 17 39 46 Spr 2007 948 1,700 76 112 167 5 454 13 Fall 2007 383 1,855 102 134 210 2 471 389 15 19 430 28 230 33 44 52 13 46 51 215 10 28 46 26 46 88 8 156 23 25 61 16 30 59 Total 6834 17,229 608 944 2,103 21 22 5,002 13 144 3,959 43 285 331 20 284 1,318 66 197 557 233 431 648 • The largest W-course enrollment is in BA 105W (formerly IS 105W) (29%), ENGL 160W (23%), and ANTH 116W (12%). • There has been a noticeable growth in enrollment in Engl 160W and IT 198W. Percent 100% 4% 5% 12% 0% 0% 29% 0% 1% 23% 0% 2% 2% 0% 2% 8% 0% 1% 3% 1% 3% 4% * Note: UDWE January, March, and June sessions are reported under spring terms; August and October sessions are under fall terms. UDWE Report Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 11 Average Cumulative GPA and Pass/Fail Ratio by W-Course and UDWE (Fall 2002 – Fall 2007) Pass Fail UDWE Grand Total 2.97 3.26 AAIS 104W 2.90 ANTH 105W 3.02 ANTH 116W 3.03 ASP 105AW 2.40 2.41 2.55 2.89 ASP 105BW 2.96 ECON 102W 3.18 ENGL 160W 2.94 ENGR 105W 2.91 ESL 110W 3.06 ETHS 104W 2.87 GEOG 189W 3.24 IE 182W 2.84 IT 198W 2.95 LING 110W 3.03 LING 111W 3.02 MCJ 102W 3.01 PHIL 133W 3.10 PLANT 110W 2.83 SOC 130W 2.93 1 2.98 2.97 45% Pass/Fail 91% Other 90% Fail 83% 3.07 2.42 2.76 ENGL 115W 55% 2.88 Pass 2.89 3.07 BA 105W, IS 105W 3.13 Pass / Fail Ratio 2.86 91% 18% 77% 2.76 2.49 2.39 2.65 2.34 2.38 2.68 2.33 2.53 2.52 2.19 3.07 95% 2.97 86% 2.83 2.98 2.79 2.90 88% 40% 45% 87 % 85% 2.97 83% 2.96 87% 2.98 2.51 2.97 2.38 87 % 2.90 2.46 2.31 76% 2.89 2.81 2.89 92% 73% 20% 91% 87% 2 3 41 2 3 41 2 3 4 Avg Cumulative GPA Avg Cumulative GPA Avg Cumulative GPA • Students enrolled in the UDWE had a higher average GPA (3.13) than any of the W-Courses. • AAIS 104W, PLANT 110W, ENGR 105W, ASP 105AW, and ECON 102W had some of the highest pass rates (91%-100%), while their students’ GPA was at some of the lowest levels (2.76 – 2.90). • GEOG 189W, PHIL 133W, ENGL 115W, and BA 105W had the lowest pass rates. UDWE Report Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 12 5 UDWE Report 2.56 2.70 Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 3.47 147 145 144 3.40 3.40 3.50 3.45 3.51 3.43 3.40 3.62 3.57 3.49 143 3.28 3.24 3.39 3.45 3.38 142 140 139 138 137 135 134 133 3.39 3.33 3.74 GPA at the level of passing a W-Course 132 131 130 129 128 127 126 3.31 3.31 125 3.28 123 124 3.31 3.20 3.35 122 121 120 3.18 3.22 118 119 3.21 3.16 117 3.29 3.62 3.28 3.50 3.40 3.40 3.74 3.45 3.51 3.49 3.39 3.47 3.57 3.40 3.43 3.24 3.39 3.38 3.45 3.29 3.33 3.31 3.20 3.35 3.31 3.12 3.18 3.22 3.02 3.02 3.16 3.31 3.12 3.01 3.00 3.28 2.91 300 116 3.06 3.4 115 2.90 2.97 3.21 3.06 400 114 113 3.12 3.12 3.02 3.10 2.82 2.89 2.94 350 112 111 3.02 109 3.10 3.01 108 110 3.00 2.91 2.82 2.97 2.90 2.82 250 107 106 105 104 2.94 2.86 2.92 2.74 2.73 Number of Students 200 103 102 2.89 2.86 2.92 2.84 2.56 2.70 2.94 2.89 150 101 100 99 2.82 2.84 2.94 2.83 2.93 2.71 2.89 2.81 2.66 3.17 2.63 2.52 2.91 2.83 2.97 3.53 3.70 100 98 2.74 2.0 97 2.2 2.73 2.4 96 95 94 93 92 2.89 2.83 2.93 2.89 2.81 2.71 2.66 3.17 3.70 3.71 3.42 50 91 90 89 88 87 86 2.8 85 2.63 2.91 2.83 3.2 84 83 2.52 2.6 82 81 80 76 2.97 3.0 72 3.53 3.6 40 3.71 3.8 30 3.42 0 18 Avg. Cumulative GPA Distribution of UDWE test scores and Average Cumulative GPA (Fall 2002 – Fall 2007) 4.0 • Students with higher GPA are likely to get higher scores on their UDWE. • Students who scored 107 or more on the UDWE had GPA”3.00 +” and were likely to have passed a W-Course (1,683 students). 13 40 72 82 83 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 132 133 134 0 UDWE Report 2 2 3 2 1 5 9 51 52 60 58 67 70 78 80 2 9 43 62 1 1 1 2 11 64 78 80 66 62 60 99 97 100 46 50 10 53 106 121 114 120 18 17 22 14 16 14 40 34 41 41 40 28 29 20 14 18 12 10 First Test Number of Students 60 4 14 15 15 15 20 1 7 20 5 1 2 3 5 6 5 6 4 7 3 9 2 1 1 1 1 1 0 1 1 3 1 1 2 Second Test Number of Students Distribution of Scores for students who took the UDWE twice. (Fall 2002 – Fall 2007) • Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 On average, students were able to improve the scores by 5% when they took the second test. 120 100 14 UDWE Pass Rate and Enrollment by Major* for students who selected the UDWE Option (Fall 2002 – Fall 2007) Pass Rate Liberal Studies-Blended Pgm Liberal Studies 69% Nursing 70% Crim-Law Enforcement 55% History 80% English 90% Social Work 41% Health Sci-Comm Health 48% Agricultural Business 54% Communication 69% English-Cred Pgm 84% Child Development 46% Kinesiology-Exercise Science 56% Pre-Physical Therapy 76% Comm Disorders - Spch Path 67% Construction Mgt 52% Political Science 82% 39% Crim-Victimology 51% Rec Adm-Leisure Serv Mgt Emph 57% Art 70% Interior Design 76% Mathematics 81% Undeclared 43% Civil Engineering 53% Art - Graphic Design Option Kinesiology-General Kines 59% 37% Kinesiology-Physical Ed 58% Biol-Physiology & Anatomy 76% Chemistry 71% Electrical Engineering 51% Sociology 72% Geomatics Engineering 47% Pre-Nursing 43% Ag Ed-Teacher Prep 58% Comm Disorders - Deaf Educatin 70% Biol-Organismic & General 79% Pre-Psychology 61% Nursing-Rn 54% Food & Nutr Sciences-Diet & Fd 54% Theatre Arts - Acting 82% M Comm & Journ-Advertising 76% Comm Disorders - Interpreting 77% Economics 58% 0% UDWE Report 21% 21% 14% 15% 21% 12% 6% 20% 26% 21% 15% 16% 20% 15% 22% 20% 15% 8% 28% 25% 18% 14% 11% 10% 41% 21% 18% 22% 21% 20% 16% 12% 12% 17% 20% 7% 12% 12% 7% 21% 19% 21% 24% 23% 13% 57% Psychology Crim-Corrections Students who took UDWE twice 65% 50% % of Total 100% 0% 20% Total Count of Students who took the UDWE Example of how to read the chart: • 337 Psychology majors took the UDWE; 69% of them eventually passed the UDWE, and 14% took the UDWE twice. • English majors had the highest UDWE pass rate (90%), while General Kinesiology and Crim-Corrections had rates below 40%. * Majors with 31 and more students who took the UDWE in the past 5 years. 40% Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 15 W-Course Pass Rate and Enrollment by Major* for students who selected W-Course Option (Fall 2002 – Fall 2007) Business - Restricted 87% Liberal Studies-Blended Pgm 1,610 93% Pre-Business 1,052 77% Liberal Studies 94% Social Work 94% Bus Ad-Accountancy 94% Psychology 739 89% History 89% Bus Ad-Marketing 95% 92% Communication 91% 205 Bus Ad-Finance-General 94% 201 92% Pre-Nursing 180 80% 178 91% 174 Construction Mgt 90% 168 Agricultural Business 92% UGRD 96% Bus Admin-Information Systems 92% 141 Civil Engineering 96% 138 Bus Ad-Entrepreneurship 96% 137 Child Development 96% 136 M Comm & Journ-Broadcast Journ 94% 136 English 92% 123 Crim-Victimology 91% 122 Art 91% 117 143 Spanish 95% 117 Electrical Engineering 94% 116 M Comm & Journ-Advertising 92% 115 Political Science 89% 114 Biol-Physiology & Anatomy 91% 110 Mathematics 87% UDWE Report 109 96% 50% % of Total students in the past five years. 156 90% 0% enrollment of 100 and more 160 Art - Graphic Design Option Bus Ad-Human Resource Mgt * Majors with W-Course 165 74% Nursing likely to fail. 182 88% Undeclared and Pre- Business majors were most 200 Crim-Corrections Undeclared • 189 96% Pre-Psychology passed the course. 223 206 75% M Comm & Journ-Public Relation the W-Course option eventually 254 247 Bus Ad-Management 87% of 1,610 “Business- Restricted” majors who selected 429 386 Health Sci-Comm Health Sociology • 542 466 96% Undeclared chart: 708 95% Crim-Law Enforcement Example of how to read the 100 100% 0 200 400 600 800 1000 1200 1400 Students Count Unduplicated 1600 1800 Institutional Research, Assessment and Planning – Dmitri Rogulkin - 3/14/2008 16