State Accountability Update TETN Session #18319 | November 14, 2013 | 1:00-3:00 p.m. Texas Education Agency | Office of Assessment and Accountability Division of Performance Reporting Shannon Housson, Director Final Accountability Ratings Final 2012-13 Accountability Ratings 3 Final accountability ratings were released on November 7, 2013, based on outcomes of 2013 appeals. TEA received 85 appeals in 2013 compared to 202 in 2011. Four of the 19 school district appeals (21 percent) and eleven of the 66 campus appeals (17 percent) were granted. In addition to the rating changes due to granted appeals, the final ratings for two charter campuses and one charter district were revised due to data integrity issues. Performance Reports 2012-13 Texas Academic Performance Reports (TAPR) 5 The 2012-13 TAPR will be released on the confidential Texas Education Agency Secure Environment (TEASE) website on November 21, 2013. District and campus TAPR will be posted to the TEA public website on December 5. Email notifications will be sent to district superintendents and ESC directors. The TEASE release provides the information that districts need to fulfill publishing and notification requirements for the TAPR. The TAPR Guidelines will provide details about district responsibilities 2012-13 Texas Academic Performance Reports (TAPR) 6 Publishing MUST publish: Performance and profile sections of district and campus TAPR reports MAY publish: Glossary (English Glossary will be available on November 21. Spanish translation will be available in January 2014.) MUST ADD and publish: o Campus performance objectives; o Report of violent or criminal incidents; and o Information from THECB about performance of students in postsecondary institutions 2012-13 Texas Academic Performance Reports (TAPR) 7 District Responsibilities – Hearing for Public Discussion Must be held within 90 calendar days after the November 21, 2013, TEASE release. District winter break days do not count towards the 90 days. TAPR must be disseminated within 2 weeks after the hearing. Reporting Changes in TAPR 8 Statutory requirements for indicators included in performance reports relatively unchanged from AEIS reports. Significant differences from previous AEIS reports include: o STAAR Proficiency and STAAR Progress Measures Results o Inclusion of two new postsecondary indicators o Replacement of financial profile section with direct link to 2011-12 Financial Actual Report for respective district or campus. 2012-13 School Report Card 9 In the 2011-12 school year, the reporting requirements for the School Report Card were suspended during the transition from TAKS to STAAR since no state ratings were assigned in 2012. A newly-designed School Report Card for the 2012-13 school year will be released in January 2014. Public Education Grant (PEG) 10 A statutorily-mandated program of school choice (TEC Ch. 29, Subchapter G,§29.201-§29.205) was not affected by changes made by the Texas Legislature in HB 3 in 2009. Partially aligned with accountability ratings, but not fully aligned with the state system. Statute requires districts to notify parents of the 2014-15 list by February 1, 2014. Public Education Grant (PEG) Criteria 11 Released by End of Applies to School Year 2013 2014-2015 2014 2015-2016 2015 2016-2017 Identifying Criteria for a School to be Placed on Public Education Grant (PEG) List TAKS/STAAR passing rate ≤ 50% in two of the three preceding years (2011: TAKS: Grades 3-11, 2012: STAAR at TAKS Equivalency for grades 3-8, and TAKS at grade 10, 2013: STAAR (Index 1) OR Rated Academically Unacceptable or Improvement Required in 2011 or 2013. STAAR passing rate ≤ 50% in two of the three preceding years (2012: STAAR at TAKS Equivalency for grades 3-8, and TAKS at grade 10, 2013: STAAR (Index 1), 2014: STAAR (Index 1) OR Rated Improvement Required in 2013 or 2014. STAAR passing rate ≤ 50% in two of the three preceding years (STAAR (Index 1): 2013, 2014, 2015) OR Rated or Improvement Required in 2013, 2014, or 2015. 2014 Accountability Development 2013 Accountability Ratings and Designations 13 Accountability Rating (Districts and Campuses) Distinction Designations (Campuses Only) Met Standard Top 25%: Student Progress and/or Academic Achievement: Reading/ELA and/or Academic Achievement: Mathematics Met Alternative Standard (assigned to charter operators and alternative education campuses (AECs) evaluated under alternative education provisions) N/A Improvement Required N/A 2014 Accountability Ratings and Designations 14 Accountability Rating (Districts and Campuses) Distinction Designations (Districts and Campuses) Postsecondary Readiness Met Standard Distinction Designations (Campuses Only) Top 25%: Student Progress and/or Top 25%: Closing Achievement Gaps and/or Academic Achievement: Reading/ELA and/or Academic Achievement: Mathematics and/or Academic Achievement: Science and/or Academic Achievement: Social Studies Met Alternative Standard (assigned to charter operators and alternative education campuses (AECs) evaluated under alternative education provisions) N/A Improvement Required N/A 2013 Performance Index Targets 15 2013 Index Targets for Non-AEA Campuses and Districts To receive a Met Standard rating, non-AEA campuses and districts had to meet the following accountability targets on all indexes for which they had performance data in 2013. Performance Index Index 1: Student Achievement Index 2: Student Progress Campuses Districts 50 50 High Schools: 17 Middle Schools: 29 Elementary Schools: 30 21 Index 3: Closing Performance Gaps 55 55 Index 4: Postsecondary Readiness 75 75 2014 Performance Index Targets 16 2014 Index Targets for Non-AEA Campuses and Districts The 2014 Index targets will be finalized in spring 2014 by the commissioner based on recommendations from accountability advisory groups that will convene in early winter 2013. Performance Index Index 1: Student Achievement Campuses Districts TBD TBD High Schools: Index 2: Student Progress TBD Middle Schools: TBD Elem. Schools: TBD TBD Index 3: Closing Performance Gaps TBD TBD Index 4: Postsecondary Readiness TBD TBD 2013 Index 1: Student Achievement 17 Index 1 Student Achievement provides an overview of student performance based on satisfactory student achievement across all subjects for all students. Subjects: Combined over Reading, Mathematics, Writing, Science, and Social Studies. Student Groups: All Students only Performance Standards: Phase-in 1 Level II (Satisfactory) 2014 Index 1: Student Achievement 18 Index 1 Student Achievement provides an overview of student performance based on satisfactory student achievement across all subjects for all students. Subjects: Combined over Reading, Mathematics, Writing, Science, and Social Studies. Student Groups: All Students only Performance Standards: Phase-in 1 Level II (Satisfactory) STAAR EOC Assessments: Algebra I, Biology, English I, English II, U.S. History 2013 Index 2: Student Progress 19 Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners. By Subject Area: Reading, Mathematics, and Writing for available grades. Credit based on weighted performance: o One point credit given for each percentage of students at the Met growth expectations level. o Two point credit given for each percentage of students at the Exceeded growth expectations level. 2014 Index 2: Student Progress 20 Index 2: Student Progress focuses on actual student growth independent of overall achievement levels for each race/ethnicity student group, students with disabilities, and English language learners. By Subject Area: Reading, Mathematics, and Writing for available grades. Credit based on weighted performance: One point credit given for each percentage of students at the Met growth expectations level. Two point credit given for each percentage of students at the Exceeded growth expectations level. Additional Progress Measures Included in 2014: the new ELL Progress Measure. STAAR-M, STAAR-Alt, and 2014 Index 2: Student Progress 21 Enhancements to STAAR Progress Measure for 2013-14 posted on Student Assessment website on October 1 under STAAR General Resources heading at following link: http://www.tea.state.tx.us/student.assessment/staar/ Additional STAAR Progress Measure results that will be included in 2014 accountability include: o Students tested on STAAR M o Students tested on STAAR-Alt o Students who do not test in consecutive grades/courses from year to year in a single content area o Students who move from English to Spanish and Spanish to English in mathematics only. o Students who take an EOC test in Summer 2013 or Fall 2013 for the first time. 2014 Index 2: Student Progress 22 New ELL Progress Measures results will be reported in spring 2014 and included in 2014 accountability results. The latest information on the ELL Progress Measure was posted on Student Assessment website on October 22 under STAAR General Resources heading at following link: http://www.tea.state.tx.us/student.assessment/staar/ Accountability advisory groups will make recommendations on the appropriate inclusion of the ELL Progress Measure results in the respective performance indexes. 2013 Index 3: Closing Performance Gaps 23 Index 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two lowest performing race/ethnicity student groups. Credit based on STAAR performance: o Phase-in 1 Level II satisfactory performance One point for each percent of students at the phase-in 1 Level II satisfactory performance standard. 2014 Index 3: Closing Performance Gaps 24 By Subject Area: Reading, Mathematics, Writing, Science, and Social Studies. Student Groups o Socioeconomic: Economically Disadvantaged o Lowest Performing Race/Ethnicity: The two lowest performing race/ ethnicity student groups on the campus or district, based on 2013 assessment results reported on 2013 Index 1: Student Achievement Data Table released on August 8, 2013 2014 Index 3: Closing Performance Gaps 25 Index 3: Closing Performance Gaps emphasizes advanced academic achievement of economically disadvantaged students and the two lowest performing race/ethnicity student groups. Credit based on STAAR weighted performance: o Phase-in 1 Level II satisfactory performance One point for each percent of students at the phase-in 1 Level II satisfactory performance standard. o Level III advanced performance Two points for each percent of students at the Level III advanced performance standard. 2013 Index 4: Postsecondary Readiness 26 Index 4: Postsecondary Readiness emphasizes the importance for students to receive a high school diploma that provides them with the foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and middle schools in preparing students for high school. Graduation Score: Combined performance across the graduation and dropout rates for: oGrade 9-12 Four-Year Graduation Rate for All Students and all student groups OR oGrade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index. RHSP/DAP Graduates for All Students and race/ethnicity student groups 2014 Index 4: Postsecondary Readiness 27 Index 4: Postsecondary Readiness emphasizes the importance for students to receive a high school diploma that provides them with the foundation necessary for success in college, the workforce, job training programs, or the military; and the role of elementary and middle schools in preparing students for high school. Graduation Score is the combined performance across the graduation and dropout rates for: o Grade 9-12 Four-Year Graduation Rate for All Students and all student groups OR o Grade 9-12 Five-Year Graduation Rate for All Students and all student groups, whichever contributes the higher number of points to the index. RHSP/DAP Graduates for All Students and race/ethnicity student groups STAAR Score: STAAR Percent Met Final Level II on One or More Tests for All Students and race/ethnicity student groups 2014 Index 4: Postsecondary Readiness 28 Additional Indicators Required by House Bill 5 (83rd Texas Legislature, 2013) Texas Success Initiative (TSI) college readiness benchmarks Number of students who earn postsecondary credit required for the foundation high school program, an associate’s degree, or an industry certification. Accountability advisory groups will develop recommendations on how and when these indicators will be evaluated in 2014 and beyond. Distinction Designations 2013 Distinction Designations 30 Campus Top Twenty-Five Percent Distinction Designations o Top 25% Student Progress. Based on performance on Index 2: Student Progress. Campuses in the top quartile of their campus comparison group in performance on Index 2 earn this distinction designation. Academic Achievement Distinction Designations o Reading/ELA o Mathematics 2014 Distinction Designations 31 Campus Top Twenty-Five Percent Distinction Designations o Top 25% Student Progress. Based on performance on Index 2: Student Progress. Campuses in the top quartile of their campus comparison group in performance on Index 2 earn this distinction designation. o Top 25% Closing Achievement Gaps. Based on performance on Index 3: Closing Performance Gaps. Campuses in the top quartile of their campus comparison group in performance on Index 3 earn this distinction designation. Academic Achievement Distinction Designations o Reading/ELA o Mathematics o Science o Social Studies 2014 Distinction Designations 32 New Academic Achievement Distinction Designations (AADD) Indicators in Reading/ELA and Mathematics Grade 10 (PSAT and PLAN) and Grade 11 (PSAT) Participation. PSAT Grade 10 and Grade 11 Performance Indicators: ELA and Mathematics. PLAN Grade 10 Performance Indicators: English and Mathematics. 2014 Distinction Designations 33 New Districts and Campus Postsecondary Readiness Distinction Designations House Bill (HB) 5 (83rd Texas Legislature, 2013) expanded distinction designations to both districts and campuses for outstanding performance in attainment of postsecondary readiness. Criteria for this distinction must include indicators based on percentages of students who: o Achieve college-readiness standards on STAAR; o Earn nationally or internationally recognized business or industry certification; o Complete a coherent sequence of CTE courses; o Complete dual credit courses or a postsecondary course for local credit; o Achieve college readiness standards on SAT, ACT, PSAT, or ACT-PLAN; and o Earn college credit based on performance on AP/IB examinations. Legislative Updates 2014 Accountability Development Topics Related to House Bill 5 35 Expands the postsecondary readiness indicators evaluated for state accountability to include Texas Success Initiative (TSI) college readiness benchmarks and the number of students who earn postsecondary credit required for the foundation high school program, an associate’s degree, or an industry certification. Expands distinction designations to districts and campuses for outstanding performance in attainment of postsecondary readiness. Beginning in the 2016-17 school year, requires TEA to assign ratings of A, B, C, D, or F to districts, and ratings of exemplary, recognized, acceptable, or unacceptable to campuses. HB 5 – Community and Student Engagement (TEC Section 39.0545) 36 Beginning with the 2013-14 school year, districts will be required to evaluate community and student engagement compliance for the district and each of their campuses and assign a rating. The ratings are required to be reported to TEA by August 8, 2014. Statute requires that districts assign a performance rating of exemplary, recognized, acceptable, or unacceptable based on locally-determined criteria. These performance ratings must be based on criteria developed by a local committee. Statute does not permit the Agency to determine the criteria that can be used for these evaluations. TEA is developing a proposal to collect the locally-determined ratings in PEIMS Submission 3 for the 2013-14 school year. TEA is also required to report these ratings publicly by October 1, 2014. Senate Bill (SB) 1538 37 New requirements that require the evaluation of dropout recovery schools that are defined as: o serves students in grades 9-12; o has enrollment of which at least 50 percent of the students are 17 years of age or older as of September 1 of the school year; and o meets the eligibility requirements for and is registered under alternative education accountability procedures adopted by the commissioner. Further modifications to the applicable indexes will be reviewed with the accountability advisory groups in fall 2013 to ensure all SB 1538 requirements are met. State and Federal System Safeguards 2013 State Accountability System Safeguards 39 o o o o Systems safeguards are designed to evaluate the disaggregated performance results of the state accountability system to ensure that poor performance in one area or one student group is not masked in the performance index. Performance rates for system safeguards are calculated from the assessment results used to calculate performance rates in Index 1. Targets for the disaggregated results are: STAAR performance target corresponds to Index 1 (50%); STAAR participation target required by federal accountability (95%); Federal graduation rate targets and improvement calculations for 4-year rate (78%) and 5-year rate (83%); and Federal limit on use of alternate assessments (1% and 2%). 2013 State Accountability System Safeguards 40 Participation Rates differ from prior federal accountability participation rate criteria: o For end of course (EOC) tests , the best test for each course within a subject is selected first then counted in participation; o Multiple EOC tests within a subject are included multiple times; o Test score code “O” are considered non-participants; and o Students tested and scored on TELPAS are credited as participants for Reading only. Performance rates for system safeguards are calculated from the assessment results used to calculate performance rates in Index 1. 2014 targets for the state accountability system safeguard disaggregated results will be finalized in spring 2014. 2013 Federal Accountability System Safeguards 41 November 1, 2013, Correspondence from the Agency explaining the approved USDE Flexibility Waiver was posted at: http://www.tea.state.tx.us/index4.aspx?id=25769808031 Federal AYP results are no longer evaluated. Detailed information on the 2013 System Safeguard information used for the identification of Focus and Priority Schools will be available soon from the Division of Program Monitoring and Interventions. As detailed in the currently approved waiver: o Performance rates for system safeguards are calculated from the assessment results used to calculate performance rates in Index 1. 2013 Federal Accountability System Safeguards 42 Also detailed in the currently approved waiver: o Performance, Participation, and Graduation Rates are evaluated for: o Only seven student groups All, African American, Hispanic, and White, Economically Disadvantaged, Special Education and ELL students; o Reading and Mathematics subjects only. o o o o Targets or Annual Measureable Achievement Objectives (AMOs) approved by the USDE for the disaggregated federal system safeguards results are: STAAR performance target approved (75%); STAAR participation target required by federal accountability (95%); Federal graduation rate targets and improvement calculations for 4-year rate (78%) and 5-year rate (83%); and Federal limit on use of alternate assessments (1% and 2%). 2014 Accountability Development Topics Related to House Bill 5 and Federal Requirements 43 USDE federal accountability policy requires states to assess students in mathematics at the high school level. HB 5 reduces end-of-course mathematics assessments to Algebra I, which may also be administered to middle school students. About 80,000 students take Algebra I in middle school. Currently, these students take no other mathematics assessment in high school. The Commissioner submitted a request to USDE on November 6, 2013, to amend the approved Flexibility Waiver. If approved, test results of students taking Algebra I at the middle school level will be attributed to the middle school. Advisory Committees 44 December 2013 to early spring 2014 – Accountability advisory groups convene to develop recommendations to Commissioner for accountability ratings criteria and labels for 2014 and beyond and performance index targets for 2014, 2015, and 2016 accountability ratings. Spring 2014 – Commissioner announces accountability ratings criteria for 2014 and beyond and final 2014 targets, preliminary 2015 targets, and preview 2016 targets. Calendar 45 November 7, 2013 November 21, 2013 Final accountability ratings released based on outcomes of 2013 appeals. 2013 Texas Academic Performance Reports (TAPR) released on TEASE (formerly known as Academic Excellence Indicator System) Early December 2013 2013 Texas Academic Performance Reports released on TEA website Mid December 2013 Public Education Grant (PEG) list posted on public website Expanded TAPR Results posted on TEASE and public website January 2014 2013 School Report Cards posted on public website 2013 Federal Report Cards for Texas Public Schools posted on public website (formerly known as NCLB Report Cards) Resources 46 2013 Accountability Manual http://ritter.tea.state.tx.us/perfreport/account/2013/index.html Frequently Asked Questions (FAQs) http://ritter.tea.state.tx.us/perfreport/account/2013/faq.html STAAR Progress Measure Documents http://www.tea.state.tx.us/student.assessment/staar/ Performance Reporting Home Page http://www.tea.state.tx.us/perfreport Performance Report Telephone Number (512) 463-9704