Regular Item (Resolution 15-10-53) October 29, 2015 Tab 7 Consideration of student achievement awards Brief description Through the Student Achievement Initiative (SAI) the Board awards funding to colleges for their annual performance in meeting key milestones for student success. The Washington State Legislature appropriated $10,500,000 for the Initiative in the 2013-15 biennium. The Board will be awarding $4,684,626 million for college performance in 2014-15. How does this link to the State Board goals and policy focus The Student Achievement Initiative is the framework that supports the Board’s goals and policy focus for promoting student achievement and success. It is also a key component of the new allocation model that the Board approved in September 2015. Background information and analysis Student Achievement milestones measure progress for nearly all students that colleges serve. The points are used to gauge system and college progress for basic education students transitioning to college level programs, improving college math achievement, and preparing more students for work and transfer. Point accumulation also been used to identify where colleges are doing well in order to identify practices that can be shared with others. Under the Student Achievement Initiative, colleges are awarded performance funds for completions as well as intermediate progress on the way towards completion. Funds award volume (total completions and total points less completions) and effectiveness (points per student). An analysis for 2014-15 performance (Attachment A) and the funding recommendations (Attachment B) are attached. Potential questions How did the system perform in 2014-15? Recommendation/preferred result Approval of 2015 Student Achievement Funding Resolution 15-10-53 Policy Manual Change Yes ☐ No ☒ Prepared by: David Prince, research director (360) 704-4347, dprince@sbctc.edu State of Washington State Board for Community and Technical Colleges Resolution 15-10-53 A resolution relating to the Student Achievement Initiative Awards. WHEREAS, the Board established the Student Achievement Initiative to reward colleges for improvements in increasing student success and to shift a portion of funding from enrollments to performance; and WHEREAS, the Student Achievement Initiative measures colleges for the intermediate outcomes that students achieve, leading to and completing college certificates and degrees; and WHEREAS, state funds for Student Achievement were given a proviso in the 2013-15 budget to the State Board for Community and Technical Colleges; and WHEREAS, performance for all 34 colleges was measured for three performance areas for each colleges share of (a) total points less completions, (b) points per student and (c) completions in the 201415 performance year; and WHEREAS, funds are awarded to the colleges based on their performance in each of these areas and; THEREFORE BE IT RESOLVED that the State Board for Community and Technical Colleges approves the 2015 distribution of $4,684,626 to support the Student Achievement Initiative as follows: 45% or $2,108,082 for total points less completions; 45% or $2,108,082 for points per student; and 10% or $468,463 for completions. BE IT FURTHER RESOLVED that 2015 performance awards are based on each college’s share of system performance for total points less completions, points per FTE and completions. BE IT FURTHER RESOLVED that the State Board for Community and Technical Colleges authorizes the Executive Director to make adjustments, as necessary, for actions taken by the Governor, computational errors, data corrections, externally imposed restrictions or guidelines, legislative appropriation provisos, restrictions, guidelines, uniform accounting and reporting requirements, and unanticipated changes in state or federal funding. APPROVED AND ADOPTED on October 29, 2015. ATTEST: _______________________________ Marty Brown, Secretary __________________________________ Shaunta Hyde, Chair Tab 7 Attachment A System Performance in 2014-15 Analysis of Student Achievement Points Background The purposes of the Student Achievement Initiative are to improve public accountability by more accurately describing what students achieve and to shift a portion of colleges’ funding from enrollments to performance. Points are awarded for every evidence-based college milestone that students reach. The milestones begin in basic education and pre-college and include incentives for quickly moving these students to college-level coursework. Points are awarded when students have earned their first 15 and 30 college credits, and when they reach 45 college credits specific for college transfer or workforce education. Returning students who continue to make progress are awarded retention points. Points lead up to and include completion. Funds are awarded for effectiveness (points per student) and volume (total points less completions and total completions). Effectiveness accounts for 45 percent of funds awarded and it also influences another 5-7 percent of the funds awarded for points and completions. Colleges that can advance more students further will take better advantage of their college’s points produced. Therefore this metric is critical for measuring system progress towards the Board’s goal for increasing student achievement and success. In total about 50-52 percent of funds are awarded on the basis of effectiveness. The remaining funds are awarded based solely on volume (i.e. college size) under the principle that larger institutions need larger awards in order for the awards to be relatively meaningful. This analysis will focus on points per student. This metric captures all current and former basic education students and all students likely to be pursuing credentials, and accounts for 90 percent of all points achieved. Key Findings for 2014-15 Performance While overall points fell because enrollments declined from one year prior, the system improved its performance effectiveness to 171 points per 100 students from 169 points in 2013-14. Smaller institutions continue to perform better than larger institutions in points per student; however, improvement was spread across 16 institutions of varying sizes. Institutions that improve garner greater shares of performance funding compared to the year prior. Across the system, effectiveness improved in completions, college math and 45 college credits milestones. Closer analysis of colleges responsible for the improvements shows that they improved in pre-college math, 15 and 30 college credit points and retention. Improvements were more focused on transfer versus workforce students (as the latter are more influenced by the economic recovery and work). Adult basic education and high school credential students along with English as a Second Language students accounted for a smaller share of points achieved than in the prior year. Headcount in basic education for adults dropped 17 percent, much steeper than overall student decline. However, relatively flat FTE enrollments (not taken into account in the SAI) suggest that students who do attend are participating longer. Transition (defined as 1 Tab 7 Attachment A earning an achievement point beyond basic skills) was 24 percent for adult basic education and high school credential students, the third straight year of incremental improvement. Transition was 4 percent for English as a Second Language, a rate that has held constant for the past three years. College Effectiveness The table below compares 2014-15 to 2013-14 for system effectiveness. The total number of students decreased 4 percent, which resulted in a 3 percent decrease in their total points. The difference was ameliorated by a 1 percent increase in effectiveness. Areas of gain were the 45 credit milestone, college math and completions. Year Headcount in PPS 2013-14 290,011 69,470 35,744 2014-15 278,287 63,600 Change -11,724 -4% % Change Basic Skills College Ready English College Ready Math 15 College Credits 30 College Credits 45 College Credits College Math Point Retention Completion Total Points Points per 100 students 78,530 65,808 52,942 36,524 37,826 82,215 31,421 169 29,223 78,497 65,354 52,282 37,424 39,228 79,719 31,502 -5,870 -6,521 -33 -454 -660 900 1,402 -2,496 81 490,48 0 476,82 9 -13,651 -8% -18% 0% -1% -1% 2% 4% -3% 0% -3% 1% College Differences in Points Per Student The chart below shows 2014-15 points per student for colleges arranged in ascending order by college size. The system average was 171 points per 100 students. Colleges above that line garner larger shares of that performance funding pool. Effectiveness in points per student (moving students further and faster in the given year) also helps colleges that are above the system average to maximize the total points they garner. To a certain extent smaller colleges perform better in points per student. One-Year Change in Points per Student Sixteen colleges increased their points per student value in 2014-15 compared to 2013-14. Improvement is critical to garnering a larger share of every funding pool as a college’s award is a relative share of the performance of the other institutions. Improvement in effectiveness as measured by points per student is size neutral as shown in the chart below. Colleges are again 2 171 2 Tab 7 Attachment A arranged in ascending order by student headcount. The two largest spikes are due to coding corrections that were applied to all colleges but were particularly relevant to these two cases. Examples of colleges that showed one-year increase in points per student This section focuses on colleges that improved with examples of where they increased student achievement. South Puget Sound Community College improved points per student by 14 percent in 2014-15 compared to 2013-14. The chart below shows changes in student headcount and achievement points. The 45 credit point is disaggregated for workforce and transfer students. 7,544 students were measured in 2014-15. This was a 7 percent decrease in headcount over the year prior. Despite the decrease, South Puget Sound increased total points by 6 percent. They accomplished this by raising their points per 100 students from 174 to 199 points. Points increased for every achievement milestone except retention. Even in retention the fall-off was less than the fall-off in students, demonstrating that retention contributed to their overall improvement in points per student. Most of their improvement centered on transfer students. It started in pre-college and continued strongly through the transfer-ready 45 credit milestone and completions. Increasing college math from pre-college to the college math point was a critical component of their improvement. One-Year Changes in Students and Points South Puget Sound Community College 18% 15% 9% 9% 7% 6% 5% 4% 3% 1% -2% -7% 3 Tab 7 Attachment A Olympic College’s student headcount increased by 4 percent from 11,352 to 11,808 students. The college increased their total points by 15 percent, and increased their points per student from 153 to 158 points per 100 students. Olympic College made substantial gains in completions, spearheaded by workforce students. College math including pre-college gains and student retention all added to their improvements. One-Year Changes in Students and Points Olympic College 24% 18% 15% 15% 9% 5% 4% 0% -2% -2% 5% -9% Current and Former Basic Skills Students Students are identified as current or former basic skills if they received instruction in the current or preceding two academic years. These students are awarded one additional point for each milestone they achieve beyond basic skills. English as a Second Language: In 2014 colleges served 25,112 ESL students. They increased their total points (basic skills + any points beyond) per 100 students from 195 in 2013-14 to 197 in 2014-15. Nine in ten (90 percent) are current ESL students. Current ESL students increased their basic skills point gains from 164 to 171 points per 100 students, accounting for all of the overall increase in points per student. Four percent of current and former ESL students transitioned to earn an achievement point beyond basic skills. This transition rate has held constant for the past three years. Adult basic education and high school credential: In 2014 colleges served 22,421 ABE/GED students. Their total points (basic skills + any points beyond) per 100 students decreased from 247 in 2013-14 to 242 in 2014-15. Nearly eight in ten (79 percent) are current ABE/GED students. Current students had a decrease in their basic skills point gains from 153 to 142 points per 100 students, accounting for all of the decrease in points per student. Nearly one in four (24 percent) current and former students advanced to earn college level points. This transition rate has incrementally been improving each year for the past three years. 4 Tab 7 Attachment B College Bates Bellevue Bellingham Big Bend Cascadia Centralia Clark Clover Park Columbia Basin Edmonds Everett Grays Harbor Green River Highline Lake Washington Lower Columbia Olympic Peninsula Pierce District Renton Seattle Shoreline Skagit Valley South Puget Sound Spokane Tacoma Walla Walla Wenatchee Valley Whatcom Yakima Valley System Total Total Award Total Points less Points per Completions Completions Student Total Award $10,655 $35,877 $72,952 $119,484 $25,021 $125,823 $51,126 $201,971 $9,112 $26,858 $70,915 $106,885 $6,434 $34,489 $80,105 $121,028 $6,230 $36,838 $69,189 $112,257 $7,671 $29,360 $64,336 $101,367 $26,972 $120,030 $59,888 $206,890 $12,867 $46,103 $70,736 $129,707 $17,278 $74,280 $59,745 $151,302 $14,439 $86,446 $57,026 $157,912 $18,850 $106,857 $54,232 $179,938 $5,633 $25,284 $77,591 $108,508 $20,451 $83,044 $59,487 $162,982 $15,400 $93,330 $49,775 $158,505 $10,247 $47,765 $76,633 $134,646 $9,825 $47,013 $71,486 $128,324 $21,950 $81,600 $56,462 $160,012 $7,700 $27,735 $74,499 $109,935 $25,152 $119,213 $72,455 $216,821 $12,591 $46,127 $61,491 $120,208 $37,452 $190,620 $152,587 $380,659 $17,511 $51,460 $55,528 $124,499 $11,747 $54,097 $59,325 $125,169 $14,570 $65,428 $71,095 $151,093 $19,767 $97,415 $65,938 $183,120 $17,525 $92,773 $69,340 $179,638 $11,281 $39,076 $62,520 $112,876 $12,431 $42,376 $67,309 $122,116 $13,537 $53,354 $63,824 $130,715 $12,562 $65,117 $68,744 $146,423 $468,463 $2,108,082 $2,108,082 $4,684,627 1 Tab 7 Attachment B Student Achievement Points Academic Year 2014-15 Final College Bates Bellevue Bellingham Big Bend Cascadia Centralia Clark Clover Park Columbia Basin Edmonds Everett Grays Harbor Green River Highline Lake Washington Lower Columbia Olympic Peninsula Pierce District Renton Seattle Central Seattle North Seattle South Shoreline Skagit Valley South Puget Sound Spokane Spokane Falls Tacoma Walla Walla Wenatchee Valley Whatcom Yakima Valley System Total College College Total Readiness - Readiness Headcount Basic Skills English Math 5,624 1,061 421 996 20,877 2,696 1,316 3,209 4,011 386 289 846 3,532 962 698 2,020 4,318 883 501 1,796 4,938 783 519 932 16,975 3,040 1,776 4,559 6,824 1,121 945 1,549 10,859 2,212 1,132 3,040 13,310 3,390 572 3,408 16,089 2,865 1,324 3,354 2,913 795 577 1,102 11,587 2,497 489 3,430 15,269 4,708 726 3,354 6,215 3,215 565 864 5,634 1,489 1,013 2,480 12,279 803 1,496 4,195 3,314 718 530 1,231 13,600 1,753 2,203 4,914 9,435 3,890 287 719 11,484 3,472 1,185 2,465 11,221 1,810 467 1,426 11,451 2,701 456 1,349 8,633 1,415 181 1,636 9,155 1,537 853 1,908 7,736 1,232 1,005 2,997 18,259 5,369 1,547 2,802 8,387 196 1,129 2,561 11,092 1,634 1,362 5,306 5,848 715 652 1,623 5,386 771 835 1,826 7,066 1,039 613 2,502 7,865 2,442 1,719 2,684 311,186 63,600 29,383 79,083 1st 15 Credits 1,603 5,034 979 907 1,160 880 3,540 1,760 2,158 2,870 3,848 681 2,777 2,725 1,179 1,048 2,397 781 3,704 1,267 2,316 2,256 2,462 2,095 1,739 2,123 2,851 2,523 2,734 1,181 1,311 1,747 1,562 68,198 2 1st 30 45 Quantitative/ Credits Credits Computation 1,200 780 378 3,847 2,249 3,189 815 691 684 733 531 574 908 485 906 744 610 708 3,057 2,296 2,314 1,320 967 574 1,831 1,252 1,266 1,985 1,315 1,697 2,871 1,682 2,546 574 454 464 2,286 1,525 1,508 2,099 1,400 1,446 1,024 907 699 948 792 718 2,086 1,620 1,565 670 563 570 2,908 3,177 2,584 985 815 407 1,780 1,146 1,065 1,430 711 1,108 1,440 935 1,136 1,526 947 995 1,420 1,034 1,122 1,681 1,231 1,429 2,362 1,742 1,417 2,073 1,175 1,282 2,194 1,390 1,831 1,043 852 780 1,117 837 687 1,373 887 1,127 1,283 1,014 943 53,613 38,012 39,719 Retention Completion Point Point 1,290 732 5,566 1,719 1,096 626 1,005 442 1,297 428 1,149 527 5,276 1,853 1,696 884 3,111 1,187 3,386 992 4,530 1,295 800 387 3,378 1,405 3,648 1,058 1,837 704 1,640 675 3,417 1,508 912 529 4,439 1,728 1,567 865 2,830 971 2,534 649 2,585 953 2,291 1,203 2,041 807 2,397 1,001 2,896 1,358 2,481 1,072 3,535 1,204 1,572 775 1,745 854 2,206 930 2,381 863 82,534 32,184 Total Points 8,461 28,825 6,412 7,872 8,364 6,852 27,711 10,816 17,189 19,615 24,315 5,834 19,295 21,164 10,994 10,803 19,087 6,504 27,410 10,802 17,230 12,391 14,017 12,289 12,461 15,096 22,344 14,492 21,190 9,193 9,983 12,424 14,891 486,326 Tab 7 Attachment B Student Achievement Completion Points Academic Year 2014-15 Final College Bates Bellevue Bellingham Big Bend Cascadia Centralia Clark Clover Park Columbia Basin Edmonds Everett Grays Harbor Green River Highline Lake Washington Lower Columbia Olympic Peninsula Pierce District Renton Seattle Shoreline Skagit Valley South Puget Sound Spokane Tacoma Walla Walla Wenatchee Valley Whatcom Yakima Valley System Total Completion Point 732 1,719 626 442 428 527 1,853 884 1,187 992 1,295 387 1,405 1,058 704 675 1,508 529 1,728 865 2,573 1,203 807 1,001 2,430 1,204 775 854 930 863 32,184 *Includes Seattle Vocational Institute 3 Total Funds $468,463 Share of System Total 2.3% 5.3% 1.9% 1.4% 1.3% 1.6% 5.8% 2.7% 3.7% 3.1% 4.0% 1.2% 4.4% 3.3% 2.2% 2.1% 4.7% 1.6% 5.4% 2.7% 8.0% 3.7% 2.5% 3.1% 7.6% 3.7% 2.4% 2.7% 2.9% 2.7% 100% College Award $10,655 $25,021 $9,112 $6,434 $6,230 $7,671 $26,972 $12,867 $17,278 $14,439 $18,850 $5,633 $20,451 $15,400 $10,247 $9,825 $21,950 $7,700 $25,152 $12,591 $37,452 $17,511 $11,747 $14,570 $35,371 $17,525 $11,281 $12,431 $13,537 $12,562 $468,463 Tab 7 Attachment B Student Achievement Points (Less Completions) Academic Year 2014-15 Final Total Funds $2,108,082 College Bates Bellevue Bellingham Big Bend Cascadia Centralia Clark Clover Park Columbia Basin Edmonds Everett Grays Harbor Green River Highline Lake Washington Lower Columbia Olympic Peninsula Pierce District Renton Seattle Shoreline Skagit Valley South Puget Sound Spokane Tacoma Walla Walla Total Points Less Completions 7,729 27,106 5,786 7,430 7,936 6,325 25,858 9,932 16,002 18,623 23,020 5,447 17,890 20,106 10,290 10,128 17,579 5,975 25,682 9,937 41,065 11,086 11,654 14,095 34,406 19,986 8,418 Share of System Total 1.7% 6.0% 1.3% 1.6% 1.7% 1.4% 5.7% 2.2% 3.5% 4.1% 5.1% 1.2% 3.9% 4.4% 2.3% 2.2% 3.9% 1.3% 5.7% 2.2% 9.0% 2.4% 2.6% 3.1% 7.6% 4.4% 1.9% College Award $35,877 $125,823 $26,858 $34,489 $36,838 $29,360 $120,030 $46,103 $74,280 $86,446 $106,857 $25,284 $83,044 $93,330 $47,765 $47,013 $81,600 $27,735 $119,213 $46,127 $190,620 $51,460 $54,097 $65,428 $159,709 $92,773 $39,076 Wenatchee Valley Whatcom Yakima Valley System Total 9,129 11,494 14,028 454,142 2.0% 2.5% 3.1% 100.0% $42,376 $53,354 $65,117 $2,108,082 *Includes Seattle Vocational Institute 4 Tab 7 Attachment B Student Achievement Points Per Student Academic Year 2014-15 Final College Bates Bellevue Bellingham Big Bend Cascadia Centralia Clark Clover Park Columbia Basin Edmonds Everett Grays Harbor Green River Highline Lake Washington Lower Columbia Olympic Peninsula Pierce District Renton Seattle Shoreline Skagit Valley South Puget Sound Spokane Tacoma Walla Walla Wenatchee Valley Whatcom Yakima Valley Total Points 7,566 28,804 6,370 7,845 8,350 6,741 27,657 10,287 16,777 19,026 24,170 5,803 19,263 20,881 10,605 10,767 18,703 6,460 27,001 10,545 40,093 11,817 12,239 15,046 22,225 20,946 9,171 9,951 12,399 14,834 476,829 Countable Students 3,697 20,083 3,202 3,491 4,302 3,735 16,462 5,184 10,010 11,893 15,887 2,666 11,543 14,954 4,933 5,369 11,808 3,091 13,284 6,113 27,833 7,586 7,354 7,544 12,015 10,768 5,229 5,270 6,925 7,692 278,287 System Total for Share Total Funds $2,108,082 Share Points Per of Student System (x100) Total 205 3.5% 143 2.4% 199 3.4% 225 3.8% 194 3.3% 180 3.1% 168 2.8% 198 3.4% 168 2.8% 160 2.7% 152 2.6% 218 3.7% 167 2.8% 140 2.4% 215 3.6% 201 3.4% 158 2.7% 209 3.5% 203 3.4% 173 2.9% 428 7.2% 156 2.6% 166 2.8% 199 3.4% 185 3.1% 195 3.3% 175 3.0% 189 3.2% 179 3.0% 193 3.3% 171 100.0% 5,914 *Includes Seattle Vocational Institute 5 College Award $72,952 $51,126 $70,915 $80,105 $69,189 $64,336 $59,888 $70,736 $59,745 $57,026 $54,232 $77,591 $59,487 $49,775 $76,633 $71,486 $56,462 $74,499 $72,455 $61,491 $152,587 $55,528 $59,325 $71,095 $65,938 $69,340 $62,520 $67,309 $63,824 $68,744 $2,108,082