Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Massachusetts Part B Annual Performance Report for FFY 2008 Submitted to the Office of Special Education Programs December 1, 2005 Revised February 1, 2010 Massachusetts Department of Elementary and Secondary Education 75 Pleasant Street, Malden, MA 02148-4906 Phone 781-338-3000 TTY: N.E.T. Relay 800-439-2370 www.doe.mass.edu This document was prepared by the Massachusetts Department of Elementary and Secondary Education Mitchell D. Chester, Ed.D. Commissioner Board of Elementary and Secondary Education Members Ms. Maura Banta, Chair, Melrose Ms. Harneen Chernow, Jamaica Plain Mr. Gerald Chertavian, Cambridge Mr. Michael D’Ortenzio, Jr., Chair, Student Advisory Council, Wellesley Dr. Thomas E. Fortmann, Lexington Ms. Beverly Holmes, Springfield Dr. Jeff Howard, Reading Ms. Ruth Kaplan, Brookline Dr. Dana Mohler-Faria, Bridgewater Mr. Paul Reville, Secretary of Education, Worcester Dr. Sandra L. Stotsky, Brookline Mitchell D. Chester, Ed.D., Commissioner and Secretary to the Board The Massachusetts Department of Elementary and Secondary Education, an affirmative action employer, is committed to ensuring that all of its programs and facilities are accessible to all members of the public. We do not discriminate on the basis of age, color, disability, national origin, race, religion, sex or sexual orientation. Inquiries regarding the Department’s compliance with Title IX and other civil rights laws may be directed to the Human Resources Director, 75 Pleasant St., Malden, MA 02148 781-338-6105. © 2010 Massachusetts Department of Elementary and Secondary Education Permission is hereby granted to copy any or all parts of this document for non-commercial educational purposes. Please credit the “Massachusetts Department of Elementary and Secondary Education.” This document printed on recycled paper Massachusetts Department of Elementary and Secondary Education 75 Pleasant Street, Malden, MA 02148-4906 Phone 781-338-3000 TTY: N.E.T. Relay 800-439-2370 www.doe.mass.edu Massachusetts Part B State Performance Plan (MA SPP) for FFY 2005-2010 and Massachusetts Part B Annual Performance Report (MA APR) for FFY 2008 Note: This document contains both the Massachusetts State Performance Plan (MA SPP) for FFY 20052010 and the Massachusetts Annual Performance Report (MA APR) for FFY 2008. The MA SPP presents information for all 20 indicators, including baseline data, targets, and improvement activities. The MA APR contains progress data for Indicators 1, 2, 3, 4a, 5, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, and 20 as required by the Office of Special Education Programs (OSEP). Table of Contents Cover Letter / Overview of Development .................................................................................................. 3 ● SPP ............................................................................................................................................ 3 ● APR ........................................................................................................................................... 4 Monitoring Priority: FAPE in the LRE ....................................................................................................... 5 Indicator 1: Graduation Rates ............................................................................................................. 5 ● SPP ............................................................................................................................................ 5 ● APR ......................................................................................................................................... 10 Indicator 2: Dropout Rates ................................................................................................................ 14 ● SPP .......................................................................................................................................... 14 ● APR ......................................................................................................................................... 19 Indicator 3: Assessment ................................................................................................................... 23 ● SPP .......................................................................................................................................... 23 ● APR ......................................................................................................................................... 33 Indicator 4: Suspension/Expulsion ................................................................................................... 42 ● SPP .......................................................................................................................................... 42 ● APR ......................................................................................................................................... 48 Indicator 5: School Age LRE ............................................................................................................ 53 ● SPP .......................................................................................................................................... 53 ● APR ......................................................................................................................................... 60 Indicator 6: Preschool LRE ............................................................................................................... 67 ● SPP .......................................................................................................................................... 67 ● APR ......................................................................................................................................... 72 Indicator 7: Preschool Outcomes ..................................................................................................... 73 ● SPP .......................................................................................................................................... 73 ● APR ......................................................................................................................................... 84 Indicator 8: Parent Involvement ........................................................................................................ 85 ● SPP .......................................................................................................................................... 85 ● APR ......................................................................................................................................... 90 Monitoring Priority: Disproportionality ................................................................................................... 93 Indicator 9: Disproportionality – Child with a Disability ..................................................................... 93 ● SPP .......................................................................................................................................... 93 ● APR ......................................................................................................................................... 96 Indicator 10: Disproportionality – Eligibility Category ....................................................................... 98 ● SPP .......................................................................................................................................... 98 ● APR ....................................................................................................................................... 101 Monitoring Priority: Effective General Supervision / Child Find ........................................................ 103 Indicator 11: Initial Evaluation Timelines ........................................................................................ 103 ● SPP ........................................................................................................................................ 103 ● APR ....................................................................................................................................... 107 Monitoring Priority: Effective General Supervision / Effective Transition ........................................ 111 Indicator 12: Early Childhood Transition ......................................................................................... 111 ● SPP ........................................................................................................................................ 111 ● APR ....................................................................................................................................... 115 Indicator 13: Secondary Transition ................................................................................................. 119 ● SPP ........................................................................................................................................ 119 ● APR ....................................................................................................................................... 124 Indicator 14: Post-School Outcomes .............................................................................................. 129 ● SPP ........................................................................................................................................ 129 ● APR ....................................................................................................................................... 136 Monitoring Priority: Effective General Supervision / General Supervision ...................................... 142 Indicator 15: Identification and Correction of Noncompliance ........................................................ 142 ● SPP ........................................................................................................................................ 142 ● APR ....................................................................................................................................... 147 Indicator 16: Complaint Timelines .................................................................................................. 151 ● SPP ........................................................................................................................................ 151 ● APR ....................................................................................................................................... 154 Indicator 17: Due Process Timelines .............................................................................................. 158 ● SPP ........................................................................................................................................ 158 ● APR ....................................................................................................................................... 160 Indicator 18: Hearing Requests Resolved by Resolution Sessions ............................................... 163 ● SPP ........................................................................................................................................ 163 ● APR ....................................................................................................................................... 165 Indicator 19: Mediation Agreements ............................................................................................... 167 ● SPP ........................................................................................................................................ 167 ● APR ....................................................................................................................................... 169 Indicator 20: State Reported Data .................................................................................................. 170 ● SPP ........................................................................................................................................ 170 ● APR ....................................................................................................................................... 173 Appendices .............................................................................................................................................. 174 ● Appendix A: Description of Selected Cross-Cutting Improvement Activities ........................ 174 ● Appendix B: Massachusetts Parent Survey for Indicator #8 ................................................. 186 ● Appendix C: MA Post-School Outcomes Survey for Indicator #14 ....................................... 188 ● Appendix D: MA Post-School Outcomes Survey for Indicator #14 – FFY 2008 ................... 189 ● Appendix E: Correction of Noncompliance Data for FFY 2004 ............................................. 191 ● Appendix F: Indicator #15 Worksheet for FFY 2008 ............................................................. 193 ● Appendix G: Attachment 1 – Report of Dispute Resolution for FFY 2004 ............................ 196 ● Appendix H: Table 7 – Report of Dispute Resolution for FFY 2008...................................... 197 ● Appendix I: Indicator #20 Scoring Rubric for FFY 2004 ........................................................ 198 ● Appendix J: Indicator #20 Scoring Rubric for FFY 2008 ....................................................... 201 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Cover Letter / Overview of Development Revised February 1, 2010 Cover Letter / Overview of Development Submitted December 1, 2005; Revised January 3, 2006, February 1, 2007, May 21, 2007, February 1, 2008, April 14, 2008, February 2, 2009, and January 29, 2010 SPP ATTN: Janet Scire U.S Department of Education Office of Special Education Programs Potomac Center Plaza Mail Stop 2600, Room 4129 550 12th Street S.W. Washington, DC 20202 Dear Ms. Scire: Enclosed is the Massachusetts State Performance Plan (MA SPP). The MA SPP was developed in accordance with 20 U.S.C. 1416(b)(1), which states that “not later than 1 year after the date of enactment of the Individuals with Disabilities Education Improvement Act of 2004, each State must have in place a performance plan that evaluates the State’s efforts to implement the requirements and purposes of Part B and describes how the State will improve such implementation.” The MA SPP responds directly to the 20 indicators identified by the Office of Special Education Programs (OSEP) in Information Collection 1820-0624, Part B State Performance Plan (SPP) and Annual Performance Report (APR). The Massachusetts Department of Elementary and Secondary Education (MASSDE) has engaged in a variety of activities to obtain broad input from stakeholders on the development of the Massachusetts State Performance Plan (MA SPP). An overview of the MA SPP was first presented to the Special Education Advisory Council (SAC), and was also presented to key stakeholders within MASSDE. As a next step, the Massachusetts Statewide Special Education Steering Committee – which consists of SAC members, key MASSDE personnel, local education officials, parents, advocates, and representatives from higher education, charter schools, approved private special education schools, and adult service agencies – met to identify targets, methodologies, and key activities as appropriate for each of the 20 MA SPP indicators. Additionally, I have met with a number of other groups as we have been preparing and revising the MA SPP and Annual Performance Report (APR), and have solicited input and described the activities to date to stakeholders broadly across the state. The continued input and feedback from the Steering Committee and other groups have been keys in the development of the MA SPP. In addition to discussing targets, methodologies, and improvement activities, Steering Committee members have also discussed dissemination of information about the MA SPP within their respective organizations. Additionally, Steering Committee members signed up to participate in targeted interest groups focused on each indicator. These interest groups incorporate additional members and will meet throughout the upcoming years to help guide Massachusetts’ work in each area. Regarding public dissemination, the completed MA SPP will be made widely available for public discussion. This will be accomplished by broad discussion in interest groups (as previously mentioned) and at the Statewide Advisory Council meeting and other conference and group discussion opportunities. Additionally, MASSDE will post the MA SPP on the MASSDE website at http://www.doe.mass.edu/sped/spp/, and distribute hard copies of the report to key constituents and the media. MASSDE has provided detail and commentary that addresses concerns raised in previous correspondence from OSEP regarding the MA SPP. Where concerns were raised, the response is incorporated fully into the actions that MASSDE describes for the present or future in various sections throughout the MA SPP, as applicable. Please note that the following revisions have been made since the initial submission on December 1, 2005 – 1) Indicator 4a was revised on January 3, 2006; 2) Indicators 1, 2, 4A, 4B, 5, 6, 7, 8, 9, 10, 11, 13, 14, and 18 were revised on February 1, 2007; 3) Indicators 9 and 10 were revised on May 21, 2007 at the request of OSEP; 4) Indicators 1, 2, 3, 4A, 5, 7, 9, 10, 14, and 20 were revised on February 1, 2008; 5) Indicators 7, 9 and 10 were revised on April 14, 2008 at the request of OSEP; 6) Indicator 7 was revised according to the SPP submission instructions, the baseline data for Indicator 1 were revised, and improvement activities for Indicators 1, 2, 3, 4A, 5, 6, 8, 9, 10, 11, 13, 14, 15, 16, 17 and 20 were revised on February 2, 2009; 7) Indicators 1, 2, 3, 4, 5, 7, 11, 12, 16, 17 and 18 were revised, and improvement activities were revised for Indicators 1, 2, 4, 4, 5, 8, 11, 12, 13, 14, 18 and 19 on February 1, 2010. If you have questions or need additional clarification regarding the MA SPP, please contact me at 781.338.3388 or mmmittnacht@doe.mass.edu. Sincerely, Marcia Mittnacht State Director of Special Education Special Education Planning and Policy Development Office Massachusetts Department of Elementary and Secondary Education Cc: Mitchell D. Chester, Ed.D., Commissioner, Massachusetts Department of Elementary and Secondary Education 3 Massachusetts Part B Annual Performance Report for FFY 2008 Cover Letter / Overview of Development Submitted February 1, 2010 APR Submitted February 1, 2010 U.S Department of Education Office of Special Education Programs Potomac Center Plaza Mail Stop 2600, Room 4129 550 12th Street S.W. Washington, DC 20202 Re: Massachusetts Part B Annual Performance Report (MA APR) for FFY 2008 Dear Sir or Madam: On behalf of the Massachusetts Department of Elementary and Secondary Education (MASSDE), I have enclosed the Massachusetts Annual Performance Report (MA APR) for FFY 2008. The MA APR responds directly to the indicators identified by the Office of Special Education Programs (OSEP) in Information Collection 1820-0624, Part B State Performance Plan (Part B-SPP) and Annual Performance Report (Part B-APR), and described in the OSEP Memorandum 10-3, submitted to state on December 3, 2009. The MA APR contains individual reports for Indicators 1, 2, 3, 4A, 5, 8, 9, 10, 11, 12, 13 (report not required in FFY 2008 but submitted voluntarily), 14 (report not required in FFY 2008 but submitted voluntarily), 15, 16, 17, 18, 19, and 20. Each report also contains information responsive to the areas identified in the Massachusetts Part B FFY 2007 SPP/APR Letter and Response Table on June 1, 2009, and to the OSEP Verification Visit letter of March 5, 2009. In FFY 2008 and since the date of the last report to OSEP, MASSDE has continued to work with stakeholders including the Statewide Special Education Steering Committee, the Statewide Advisory Council, statewide advocacy groups and parent organizations, and other state and local agencies that share MASSDE’s priority for improving our work on behalf of children with disabilities, their families, and their educators. New and updated inter- and intra-agency initiatives have refined MASSDE’s data collection methods, technical assistance available to and resources provided for local education agencies (LEAs), and methods for verifying correction noncompliance, among other things. The positive effects of these initiatives are demonstrated in the improvement shown in the MA APR’s indicator areas. MASSDE has continued to make progress toward or continued to meet measurable and rigorous targets, despite the unique challenges during FFY 2008 and beyond that have significantly affected these efforts. The demands presented to state and local governments associated with the severe economic downturn, and the resulting reallocation of funding priorities and administrative resources toward stimulus spending, has affected the traditional ways in which MASSDE has supported school districts in meeting state and federal education requirements for students with disabilities. However, these competing mandates did not lessen the focus of MASSDE’s work toward meeting our goals for special education. Consistent with prior years’ public reporting efforts, the completed MA APR will be made widely available for public review and discussion. MASSDE will share this with the various interest groups referred to above, at the Statewide Advisory Council meeting(s), and other conferences and meetings throughout the year. Also, MASSDE makes this report and the underlying data available on the agency’s website at http://www.doe.mass.edu/sped/spp/ and distributes hard copies of the report to key constituents and to the media. Districts’ indicator data are publicly reported at http://profiles.doe.mass.edu/special_ed.aspx; this information is being updated currently for FFY 2008. Per instruction from Massachusetts Part B State Contact Ken Kienas, I am sending to his attention under separate cover hard copies of the additional documentation that MASSDE is required to submit with this APR submission – Attachments 1, 2, 3, and 4. OSEP instructed MASSDE in the Verification Visit Letter of March 5, 2009, to submit this documentation with the FFY 2008 APR. Please contact me at 781.338.3388 or mmmittnacht@doe.mass.edu, if you have any questions or if you need additional information. Sincerely, Marcia Mittnacht State Director of Special Education Special Education Planning and Policy Development Office Massachusetts Department of Elementary and Secondary Education Cc: Mitchell D. Chester, Ed.D, Commissioner, Massachusetts Department of Elementary and Secondary Education 4 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 1 Revised February 1, 2010 Monitoring Priority: FAPE in the LRE Indicator 1: Graduation Rates SPP Monitoring Priority: FAPE in the LRE Indicator 1: Percent of youth with IEPs graduating from high school with a regular diploma. (20 U.S.C. 1416 (a)(3)(A)) Measurement: States must report using the graduation rate calculation and timeline established by the Department under the ESEA. Overview of Issue/Description of System or Process: In Massachusetts the measurement for the statewide graduation rate is the number of students in a cohort who graduate in four years or less, divided by the number of first-time entering 9th graders in that cohort. The denominator is adjusted so that students who transfer into Massachusetts’ public schools are added to the original cohort, and students who transfer out or who are now deceased, are subtracted from the original cohort. The quotient is multiplied by 100 to express the graduation rate as a percentage. The measurement for all youth, regardless of IEP status, is the same. For students in the 2005-2006 cohort, Massachusetts is calculating and reporting a statewide Graduation Rate for the first time. This cohort includes all students who entered 9th grade in Massachusetts’ public schools for the first time in the fall of 2002, plus all students who transferred into the cohort during the four years, minus all students who transferred out of the cohort or who were deceased during the four years. Students who earned their Competency Determination, met all local graduation requirements, and received a diploma from a Massachusetts public high school in four years or less were counted as graduates. Summer graduates were included as if they graduated in the June preceding the summer. The data used to calculate the Graduation Rate are obtained through the Student Information Management System (SIMS) scheduled reports that are submitted by school districts throughout the year. Because this is the first time MASSDE has calculated the graduation rate, and because the data come from the initial years of SIMS when districts were still becoming familiar with the system, MASSDE has allowed for the possibility of a limited number of corrections. Initial student-level data for the 2005-2006 cohort were released to districts in November of 2006, and district staff had one month to review the data and request corrections. MASSDE then reviewed all requests and made appropriate corrections. For subsequent years, it is anticipated that the number and type of corrections allowed will decrease. MASSDE’s calculation method is based on the formula set forth in the National Governors’ Association (NGA) Compact, and meets the No Child Left Behind (NCLB) definition of Graduation Rate for use in determining Adequate Yearly Progress (AYP) for secondary schools. However, MASSDE acknowledges that a significant number of students require more than four years to graduate, so a Five-Year Graduation Rate has also been calculated. Although Massachusetts’ formal SPP targets are based on the Four-Year graduation rate, Massachusetts will continue to generate both rates for the entire student population of each cohort and for individual student subgroups at the state, district, and school level. Additional information on the calculation of graduation rates is available on MASSDE’s website at the following link: http://www.doe.mass.edu/infoservices/reports/gradrates/ 5 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 1 Revised February 1, 2010 Baseline Data for FFY 2005 (2005-2006): IEP Non-IEP All Students # of Students in 2005-06 cohort # of Students who graduated in four years or less 2005-2006 Graduation Rate 13,814 60,934 74,380 8,440 51,149 59,440 61.1% 83.9% 79.9% Discussion of Baseline Data: The data provided in the above table show that students with disabilities in Massachusetts’ public schools are graduating from high school in four years at a lower rate than their non-disabled peers. Based on the cohort formula for calculating Graduation Rate, 61.1% of students with disabilities in the 2005-06 cohort graduated from high school in four years or less while the Graduation Rate is 83.9% for non-disabled students in the same cohort, and is 79.9% for all students in the cohort. The Five-Year Graduation Rate for students in the 2005-06 cohort is 67.0% for students with disabilities, 86.2% for non-disabled students, and 82.7% overall. This means that 5.9% of students with disabilities in the cohort, and 2.3% of students without disabilities, graduated in five years instead of four. MASSDE recognizes that it is appropriate for some students to take longer than four years to complete high school, and so Massachusetts will continue to calculate and publicly report the Five-Year Rate for subsequent cohorts as an additional measure of year-to-year progress. This disparity between the Graduation Rates for disabled and for non-disabled students in Massachusetts reflects a national trend. The report on SPP Indicator 1 prepared by the National Dropout Prevention Center for Students with Disabilities (NDPC-SD) for the Regional Resource and Federal Center Network’s Part B SPP/APR Indicator Analysis shows that of 36 states that reported Graduation Rates for both student with disabilities and all students, 35 states had a positive gap between the all-student rate and the rate for students with disabilities. One state actually had a negative gap between the all-student rate and the rate for students with disabilities, and the gaps for the other 35 states ranged from approximately one percentage point to approximately 45 percentage points. Massachusetts, with a gap of 18.2 percentage points, appears to be on par with many of the states reporting Graduation Rates for both students with disabilities and all students, although it should be noted that many states used an “event” calculation which cannot be directly compared to Massachusetts’ “cohort” calculation. Massachusetts is committed to closing the gap between the graduation rate of students with disabilities and the graduation rate of students without disabilities over a ten-year period. Our SPP targets set in December 2009 reflect a graduation rate for all students at or above 95% by FFY 2018. The plan is to increase the Graduation Rate of all students with disabilities by approximately 5% every two years as follows: FFY Measurable and Rigorous Target 2005 (2005-2006) Baseline Year- 61.1% 2006 (2006-2007) 61.7% 6 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 1 Revised February 1, 2010 FFY Measurable and Rigorous Target 2007 (2007-2008) 65.0%1 2008 (2008-2009) 70.0% 2009 (2009-2010) 70.0% 2010 (2010-2011) 75.0% Improvement Activities/Timelines/Resources: Please note that many of the activities presented below impact across multiple indicator areas. For these activities, a full description of the activity is available in Appendix A. Timelines (FFY) 2005 - 2007 Improvement Activity Project FOCUS Academy (Additional Indicators Impacted: 2, 3, 4, 5, 8, 13, 14) See Appendix A for a complete description. 2005 - 2010 Collaboration with Stakeholders (Impacts all Indicators) Resources MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston, Education Development Center), LEA staff time MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Summer Institutes (Additional Indicators Impacted: 2, 3, 4, 5, 6, 8, 11, 13, 14) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Special Education Website (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 1 For more information about the revised targets for FFY 2007 through FFY 2010, see the Massachusetts Part B Annual Performance Report (MA APR) for FFY 2008 7 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 1 Timelines (FFY) 2008 - 2010 Improvement Activity Trauma Sensitive Schools Initiative (Additional Indicators Impacted: 2, 4) Revised February 1, 2010 Resources MASSDE staff time, LEA staff time See Appendix A for a complete description. 2007 - 2010 Massachusetts FOCUS Academy (Additional Indicators Impacted: 2, 3, 4, 5, 8, 13, 14) See Appendix A for a complete description. 2008 - 2010 Secondary Transition – Transition Works: Innovative Strategies for Transitioning Youth with Disabilities from School to Work (Additional Indicators Impacted: 2, 13, 14) MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston), LEA staff time MASSDE staff time, Massachusetts Rehabilitation Commission staff time See Appendix A for a complete description. 2008 - 2010 Graduation and Dropout Prevention and Recovery Commission (Additional Indicators Impacted: 2, 14) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Dropout Prevention and Recovery Work Group (Additional Indicators Impacted: 2, 4, 14) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2008 - 2010 Dropout Prevention, Intervention, and Recovery Website (Additional Indicators Impacted: 2, 14) MASSDE staff time See Appendix A for a complete description. 2007 - 2008 Massachusetts Online Resource Library (Additional Indicators Impacted: 2, 3, 4, 5, 6, 8, 13, 14) MASSDE staff time See Appendix A for a complete description. 2007 - 2008 SPecial EDition Newsletter (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 8 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 1 Timelines (FFY) 2008 - 2010 Improvement Activity Educational Proficiency Plan (EPP) (Additional Indicators Impacted: 2, 3, 13, 14) Revised February 1, 2010 Resources MASSDE staff time, LEA staff time See Appendix A for a complete description 2008-2010 ARRA Title II-D Technology Competitive Grants (Additional Indicators Impacted: 2) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2008-2010 Interagency Regional Summit Meetings Funded in part from an America's Promise grant and are co-organized by MASSDE, MA Executive Office of Education, MA Executive Office of Labor and Workforce Development, MA Executive Office of Health and Human Services, and Commonwealth Corporation. These summits are intended to support regional teams in understanding and using youth-related data including student graduation, dropout, youth employment, and state and regional labor market information to promote timely graduation and college and career readiness. 2008 - 2010 Curriculum, Instruction, and Assessment Summit (Additional Indicators Impacted: 2, 3, 8) MASSDE, MA Executive Office of Education, MA Executive Office of Labor and Workforce Development, MA Executive Office of Health and Human Services, and Commonwealth Corporation staff time MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Secondary School Reading Grant (Additional Indicators Impacted: 2, 3, 5, 14) See Appendix A for a complete description. 9 MASSDE staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 1 Submitted February 1, 2010 Indicator 1 – Annual Performance Report for FFY 2008 APR FFY 2007 Measurable and Rigorous Target Students with IEPs Graduation Rate: 65.0% Actual Target Data for FFY 2007 (as reported in the FFY 2008 Annual Performance Report (MA APR) based on the instructions for a one year data lag): Students with IEPs # of Students in 2007-08 cohort # of Students in 2007-2008 cohort who graduated in four years or less 2007-2008 Graduation Rate 14,629 9,376 64.1% Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2007 (2007-2008): Explanation of Progress or Slippage The revised Part B SPP/APR Indicator 1 information collection requirements, approved by OMB on February 25, 2009, specify that States are no longer required to compare the graduation data for youth with disabilities to that of all students; States must report using the graduation rate calculation and timeline established by the Department under Title I of the ESEA. Additionally, States’ reports are now subject to a one year data lag, which requires reporting of actual target data for FFY 2007 against the FFY 2007 measurable and rigorous target. As a result, this is the same data reported in last year’s Indicator 1 APR. In response to the new requirements, this report uses the graduation data for students with IEPs using FFY 2007 graduation rate data for students with IEPs (reflecting the data lag requirement), and uses revised graduation rate targets approved by MASSDE in December 2009. This modification of statewide targets represents the third consecutive year that MASSDE has chosen to increase the state’s graduation rates standard. In addition, the Massachusetts Board of Elementary and Secondary Education adopted the new targets of 95% percent for the statewide four-year graduation rate and 100% for the statewide five-year graduation rate to be achieved by 2018. MASSDE has modified the FFY 2007 target in this report and in the Massachusetts State Performance Plan (MA SPP) to reflect the new targets. By way of background, in order to receive a diploma from a Massachusetts public high school, all students must earn a Competency Determination (earned by achieving a specified level of proficiency on the Grade 10 English Language Arts and Mathematics statewide assessments administered through the Massachusetts Comprehensive Assessment System (MCAS), or on the MCAS-Alt), and meet local graduation requirements. (Note: Students who receive a diploma in four years or less are counted as graduates for purposes of reporting these data in the Massachusetts State Performance Plan (SPP) and Annual Performance Report (APR).) 10 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 1 Submitted February 1, 2010 Graduation Rate: Students with IEPs Graduation Rate: Students with IEPs 64.5% 64.0% 63.5% 63.0% 62.5% 62.0% 61.5% 61.0% 60.5% 60.0% 59.5% Graduation Rate: Students with IEPs FFY2005 FFY2006 FFY2007 61.1% 62.8% 64.1% From FFY 2005 to FFY 2007, the graduation rate for students with disabilities in Massachusetts increased from 61.1% to 64.1%. While MASSDE did not meet the measurable and rigorous target of 65.5% in FFY 2007, the 3.0% improvement of graduation rate for students with IEPs shows continued progress. Additionally, MASSDE notes that since the targets for students with disabilities are set high in order to close the gap between students with and without disabilities, MASSDE notes continued progress in this area. The progress toward the target is attributable in part to a number of improvement activities that were completed in this period, including further development of public reporting of special education data, a variety of professional development initiatives for educators, and certain initiatives and programs described in Appendix A and below. During the current reporting year MASSDE continued to focus on previously identified improvement activities, and increased the number and intensity of improvement activities that directly affect students’ graduation rates. These projects are also described below. Although MASSDE is not required to use a five-year graduation rate, MASSDE regularly calculates this rate because a significant number of students require more than four years to meet graduation standards. The five-year graduation rate for students with IEPs in the FFY 2007 cohort is 68.3%; 1.1% of students with IEPs in this cohort graduated in five years instead of four. MASSDE would have met its target using a five-year graduation rate. Massachusetts will continue to calculate and publicly report the five-year rate for subsequent cohorts as an additional measure of year-to-year progress for students with and without IEPs. Improvement Activities MASSDE’s Student Support, Career, and Education Services Unit (SSCE); Special Education Planning and Policy Development Office (SEPP); and the Massachusetts Rehabilitation Commission (MRC) have engaged in the following improvement activities that directly affect graduation rates for students with IEPs: The Graduation and Dropout Prevention and Recovery Commission (SSCE) was charged with examining current statewide policies and making recommendations on how to retain at-risk students. The Commission’s focus was on all students, and included an examination of issues related to students with disabilities. The Commission’s final report, Making the Connection, was released in October 2009 and is available at http://www.mass.gov/Eeoe/doc/Dropout_Commission_Report_10_21_2009.pdf. 11 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 1 Submitted February 1, 2010 The Dropout Prevention and Recovery Work Group’s (SSCE) focus is to support district team action planning and to facilitate the sharing of promising practices in order to prevent student dropout thereby increasing the graduation rate. The Dropout Prevention, Intervention, and Recovery Website (SSCE) includes an extensive collection of graduation and dropout prevention related news and trainings, articles/reports, and websites for students, parents, and educators. Educational Proficiency Plans (EPP) (SSCE) - The purpose of the EPP is to increase the support students need to stay in school to meet graduation standards, and will have the requisite skills needed for post-secondary success. Trauma Sensitive Schools Initiative (SSCE) – Through this initiative MASSDE is working to bring “trauma sensitive” practices to schools across the Commonwealth. These efforts include annual trainings and technical assistance around safe and supportive student learning environments by reducing barriers that may affect classroom behavior, relationships, and academic performance thereby creating a climate that encourages students to stay in school. . The ARRA Title II-D Technology competitive grants (SSCE) funding will support 69 school districts in implementing 34 projects to create robust, technology-infused environments to strengthen education, drive reforms, and improve results for students. The 34 sustainable projects will provide another avenue for at-risk students to graduate on time. Massachusetts FOCUS Academy (MFA) (SEPP) provides online, graduate level coursework to middle and high school educators across the state. One content area, Universal Design for Learning (UDL), has a significant effect on supporting improved graduation rates for students with disabilities. The courses help educators gain a better understanding of how disability affects student learning, and provides educators with improved skills in the areas of curriculum design, instruction, and technology; these skills translate into improved student outcomes, which will lead to higher graduation rates. Since the introduction of the UDL courses in FFY 2007, 155 educators from 50 districts participated in them. Additional MFA courses that positively affect student success and promote increased graduation rates include Positive Behavioral Supports, Family Engagement, and Post-Secondary Transition. Secondary Transition: Transition Works: Innovative Strategies for Transitioning Youth with Disabilities from School to Work (MRC)– The Transition Works grant, awarded to the MRC by the U.S. Department of Education, is intended to help support transitioning youth with disabilities from school to work and post-secondary planning and improve outcomes for students with disabilities. A member of the SEPP office participates on the grant’s advisory board. Many of the factors that contribute to student graduation are consistent for students with disabilities and their non-disabled peers. Therefore, MASSDE has combined efforts within the agency and with other key stakeholders to develop a series of graduation initiatives targeted toward at-risk youth and the communities in which they reside. The following list is of activities that are underway as well as projects planned for the future. Each of the initiatives allows for inter/intra-agency collaboration, program development for students with disabilities, and professional development. American Recovery and Reinvestment Act: Saving and Creating Jobs and Reforming Education (ARRA) – IDEA Collaboration with Stakeholders Curriculum, Instruction, and Assessment Summit Secondary School Reading Grant Special Education Professional Development Institutes For detailed information about these activities, please see Appendix A. MASSDE continues to report graduation data publicly, and data are available at http://profiles.doe.mass.edu/state_report/special_ed.aspx. Updates to the mapping portion of the public 12 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 1 Submitted February 1, 2010 website will be available soon. Please note that pursuant to OSEP’s instructions for a data lag, the FFY 2008 data for Indicator 1 will be discussed in the FFY 2009 Annual Performance Report (MA APR), to be submitted in February 2011. MASSDE will continue to focus its efforts on improving the graduation rate for students with IEPs, and looks forward to reporting on the results of these efforts in the FFY 2009 APR for Indicator 1. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): The Part B State Performance Plan (SPP) and Annual Performance Report (APR) have been amended to reflect the changed requirements for Indicator 1 and its measurement, including alignment with the annual graduation rate target under Title 1 of the Elementary and Secondary Schools Education Act (ESEA), and elimination of data comparing graduation rates for students with and without IEPs. For this reason, reported data now include only students who have IEPs. MASSDE has revised measurable and rigorous targets for Indicator 1 in the MA SPP and APR to reflect the changes, and has revised Improvement activities to include updated activities and revised activity titles. See the MA SPP for changes. 13 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 2 Revised February 1, 2010 Indicator 2: Dropout Rates SPP Monitoring Priority: FAPE in the LRE Indicator 2: Percent of youth with IEPs dropping out of high school. (20 U.S.C. 1416 (a)(3)(A)) Measurement: States must report using the dropout data used in the ESEA graduation rate calculation and follow the timeline established by the Department under the ESEA. Overview of Issue/Description of System or Process: A dropout is defined as a student in grades 9-12 in Massachusetts public schools who leaves school prior to graduation for reasons other than to transfer to another school, and does not re-enroll before the following October 1. The data used to calculate the dropout rate are obtained through the Student Information Management System (SIMS) scheduled reports that are submitted by school districts throughout the year. The end-of-year collection period includes a count of students who dropped out. This figure is then amended after districts submit their first SIMS report for the following school year (the October 1st collection). Students who were reported as a “dropout” at the end of the year and then were enrolled in a district at the subsequent October 1st count (i.e., “returned dropouts”), are removed from the data set. Students who drop out of high school but earn a GED are also removed from this data set. Students who were reported as enrolled at the end of the year but were not reported in the next October 1st SIMS collection (i.e., “summer dropouts”) are added back in to the count and are applied towards the grade in which they failed to enroll. The remaining figure is then divided by the total enrollment of students that were reported in the October 1st data collection during the July 1st to June 30th twelve-month period for which the dropout count is being calculated. For additional information on the dropout calculation, see the flowchart available at the following link: http://www.doe.mass.edu/infoservices/data/guides/dropouts.html Baseline Data for FFY 2004 (2004-2005): # of Students Enrolled (Grades 9-12) # of Dropouts (Grades 9-12) 2004-2005 Dropout Rate IEP 42,647 2,369 5.6% Non-IEP 250,752 8,776 3.5% All Students 293,399 11,145 3.8% Discussion of Baseline Data: The data provided in the above table show that students with disabilities in Massachusetts’ public schools are dropping out of high school at a higher rate than their non-disabled peers. Based on this formula for calculating Dropout Rate, which is an “event” or “annual” rate calculation, 5.6% of students with disabilities dropped out of high school in 2004-2005. The Dropout Rate was 3.5% for non-disabled students, and was 3.8% for all students, in 2004-2005. This disparity between the Dropout Rates for disabled and for non-disabled students in Massachusetts reflects a national trend. The report on SPP Indicator 2 prepared by the National Dropout Prevention Center for Students with Disabilities (NDPC-SD) for the Regional Resource and Federal Center Network’s 14 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 2 Revised February 1, 2010 Part B SPP/APR Indicator Analysis shows that of 37 states that reported Dropout Rates for both student with disabilities and all students, the majority of states had a positive gap between the all-student rate and the rate for students with disabilities, with gaps ranging between a fraction of one percentage point and approximately 18 percentage points. Massachusetts, with a gap of 1.8 percentage points, appears to be on par with many of the states reporting Dropout Rates for both students with disabilities and all students, although it should be noted that many states used a “cohort” calculation which cannot be directly compared to Massachusetts’ “event” calculation. Massachusetts is committed to closing the gap between the dropout rate of students with disabilities and the dropout rate of students without disabilities over a ten-year period. Our SPP targets reflect a ten-year goal for FFY 2015 of a dropout rate for students with disabilities at or below 3.5%. Our ten-year plan is to decrease the Dropout Rate of students with disabilities by approximately half of one percentage point every two years as follows: FFY 2005 & FFY 2006: 5.6% FFY 2007 & FFY 2008: 5.1% FFY 2009 & FFY 2010: 4.7% FFY 2011 & FFY 2012: 4.3% FFY 2013 & FFY 2014: 3.9% FFY 2015: 3.5% FFY Measurable and Rigorous Target 2005 (2005-2006) Students with IEPs Dropout Rate: 5.6% 2006 (2006-2007) 5.6% 2007 (2007-2008) 5.1% 2008 (2008-2009) 5.1% 2009 (2009-2010) 4.7% 2010 (2010-2011) 4.7% 15 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 2 Revised February 1, 2010 Improvement Activities/Timelines/Resources: Please note that many of the activities presented below impact across multiple indicator areas. For these activities, a full description of the activity is available in Appendix A. Timelines (FFY) 2005 - 2007 Improvement Activity Resources Project FOCUS Academy (Additional Indicators Impacted: 1, 3, 4, 5, 8, 13, 14) MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston, Education Development Center), LEA staff time See Appendix A for a complete description. 2005 - 2010 Special Education Summer Institutes (Additional Indicators Impacted: 1, 3, 4, 5, 6, 8, 11, 13, 14) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Special Education Website (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 National Association of State Directors of Special Education (NASDSE) Professional Development Series (Additional Indicators Impacted: 3, 5, 13, 14 ) MASSDE staff time See Appendix A for a complete description. 2007 - 2010 Massachusetts FOCUS Academy (Additional Indicators Impacted: 1, 3, 4, 5, 8, 13, 14) See Appendix A for a complete description. 16 MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMassBoston), LEA staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 2 Timelines (FFY) 2007 - 2010 Improvement Activity Communities of Care Positive Behavioral Interventions (PBIS) Grant (Additional Indicators Impacted: 4, 5) See Appendix A for complete description 2008 - 2010 Graduation and Dropout Prevention and Recovery Commission (Additional Indicators Impacted: 1, 14) Revised February 1, 2010 Resources MASSDE staff time, grant partners (Central Massachusetts Communities of care, national center for positive behavioral intervention and supports trainers), LEA staff time MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Dropout Prevention and Recovery Work Group (Additional Indicators Impacted: 1, 4, 14) See Appendix A for a complete description. 2007-2008 Massachusetts Online Resource Library (Additional Indicators Impacted: 1, 3, 4, 5, 6, 8, 13, 14) MASSDE staff time, New England Comprehensive Center staff time, LEA staff time MASSDE staff time See Appendix A for a complete description. 2007 - 2008 SPecial EDition Newsletter (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Dropout Prevention, Intervention, and Recovery Website (Additional Indicators Impacted: 1, 14) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 ARRA Title II-D Technology Competitive Grants (Additional Indicators Impacted: 1) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2008 - 2010 Curriculum and Instruction and Assessment Summit (Additional Indicators Impacted: 1, 3, 8) See Appendix A for a complete description. 17 MASSDE staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 2 Timelines (FFY) 2008 - 2010 Improvement Activity District and School Assistance Centers (DSAC) (Additional Indicators Impacted: 3, 5, 13) Revised February 1, 2010 Resources MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Educational Proficiency Plans (Additional Indicators Impacted: 1, 3, 13, 14) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Secondary School Reading Grant (Additional Indicators Impacted: 1, 3, 5, 14) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Secondary Transition – Transition Works: Innovative Strategies for Transitioning Youth with Disabilities from School to Work (Additional Indicators Impacted: 1, 13, 14) MASSDE staff time, Massachusetts Rehabilitation Commission staff time See Appendix A for a complete description. 2008 - 2010 Trauma Sensitive Schools Initiative (Additional Indicators Impacted: 1, 4) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Work-Based Learning Plans for Students with Disabilities, (Additional Indicators Impacted: 13, 14) See Appendix A for a complete description. 18 MASSDE staff time, LEA staff time, Workforce Development staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 2 Submitted February 1, 2010 Indicator 2 – Annual Performance Report for FFY 2008 APR FFY 2007 Measurable and Rigorous Target Students with IEPs Dropout Rate of 5.1% Actual Target Data for FFY 2007 (as reported in the FFY 2008 Annual Performance Report (MA APR) based on the instructions for a one year data lag): FFY 2007 # of Students Enrolled (Grades 9-12) # of Dropouts (Grades 9-12) FFY 2007 Dropout Rate 44,448 2,429 5.5% Students with IEPs Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2007 (2007-2008): Explanation of Progress or Slippage The revised Part B SPP/APR Indicator 2 information collection requirements, approved by OMB on February 25, 2009, specify that States are no longer required to compare the data for youth with disabilities to that of all students; States must report data source and measurement aligned with Title I of the ESEA. Additionally, States’ reports are now subject to a one year data lag, which requires reporting of actual target data for FFY 2007 against the FFY 2007 measurable and rigorous target. As a result, for Massachusetts, this is the same data reported in last year’s Indicator 2 APR. (Please note that last year MASSDE identified the data as “preliminary.” The data have since been verified as valid and reliable for this period.) Since there has been a change in both the indicator language and the measurement, this report will focus on the dropout data for students with IEPs rather than report on statistics for all students, as required in prior reporting years. In Massachusetts, a dropout is defined as a student in grades 9-12 in a public school who leaves school prior to graduation for reasons other than a transfer to another public school, and does not re-enroll before the following October 1. MASSDE amends dropout data used to calculate this rate, obtained through the Student Information Management System (SIMS), after districts submit their reports on October 1, and omits from the final count students identified as enrolled on October 1 students who earned a GED. “Summer dropouts” are also identified and their totals are added into the count. For additional information, see the overview of Indicator 2 in the Massachusetts Part B State Performance Plan (SPP) for FFY 2005-2010. In FFY 2007, the dropout rate for students with IEPs was 5.5%, a decrease from the FFY 2006 rate of 5.8%. As illustrated in the graph below, there has been fluctuation in dropout rates for students with IEPs since MASSDE reported baseline data for FFY 2004. This fluctuation mirrors that of students without IEPs, and can be attributed to several changes in MASSDE’s method of collecting data. Starting in FFY 2005, the state began to cross reference data from the Student Information Management System (SIMS) with the General Educational Development (GED) Testing Service data. As a result, MASSDE was able to track students who previously had been calculated as a dropout, thereby contributing to the decrease in dropout rates between FFY 2004 and FFY 2005. In FFY 2006 MASSDE implemented a wider range of reporting codes and verification procedures in SIMS that resulted in additional fluctuation. In the past, districts often incorrectly listed some dropouts as “transfer students” when they students had dropped out 19 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 2 Submitted February 1, 2010 without notice to the district. The new SIMS codes require districts to verify the location of each transfer student, a clarification that results in confirmation of students’ actual enrollment status and allows MASSDE to determine whether those students are reported in other districts’ enrollment in SIMS. These new codes may have contributed to the increase in dropout rates between FFY 2005 and FFY 2006 since the changes resulted in fewer dropouts being identified incorrectly as transfers. Through these refinements to the data collection and verification processes, MASSDE has been able to collect more accurate data on dropouts. MASSDE notes a decrease in dropout rates from FFY 2006 to FFY 2007. MASSDE and its partners will continue to focus on improvement activities focused on reducing the dropout rate for students with IEPs. We look forward to reporting continued improvement in the FFY 2009 reporting period. Improvement Activities MASSDE’s Student Support, Career, and Education Services Unit (SSCE); Special Education Planning and Policy Development Office (SEPP); and the District and School Accountability and Assistance Office (DSAA) have engaged in the following improvement activities that directly affect graduation rates for students with IEPs: The Graduation and Dropout Prevention and Recovery Commission (SSCE) was charged with examining current statewide policies and making recommendations on how to retain at-risk students. The Commission’s focus was on all students, and included an examination of issues related to students with disabilities. The Commission’s final report, Making the Connection, was released in October 2009 and is available at http://www.mass.gov/Eeoe/doc/Dropout_Commission_Report_10_21_2009.pdf. The Dropout Prevention and Recovery Work Group’s (SSCE) focus is to support district team action planning and to facilitate the sharing of promising practices in order to prevent student dropout thereby increasing the graduation rate. The Dropout Prevention, Intervention, and Recovery Website (SSCE) includes an extensive collection of graduation and dropout prevention related news and trainings, articles/reports, and websites for students, parents, and educators. 20 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 2 Submitted February 1, 2010 Educational Proficiency Plans (EPP) (SSCE) - The purpose of the EPP is to increase the support students need to stay in school to meet graduation standards, and will have the requisite skills needed for post-secondary success. Trauma Sensitive Schools Initiative (SSCE) – Through this initiative MASSDE is working to bring “trauma sensitive” practices to schools across the Commonwealth. These efforts include annual trainings and technical assistance around safe and supportive student learning environments by reducing barriers that may affect classroom behavior, relationships, and academic performance thereby creating a climate that encourages students to stay in school. . The ARRA Title II-D Technology competitive grants (SSCE) funding will support 69 school districts in implementing 34 projects to create robust, technology-infused environments to strengthen education, drive reforms, and improve results for students. The 34 sustainable projects will provide another avenue for at-risk students to graduate on time. Worked-Based Learning Plans (WBLP) for Students with Disabilities (SSCE) - Through work-based learning experiences, students have an opportunity to learn about various career areas and try different work styles, find out what type of work they enjoy, find out how they learn best in a workplace setting, and find out what natural supports are available. By providing the opportunity to explore a variety of career areas and discover what type of work they enjoy in the context of their academic environment, the WBLP promotes students with disabilities staying in school. In partnership with the Central Massachusetts Communities of Care (CMCC) Positive Behavioral Interventions (PBIS) Grant, MASSDE provided grant funds to support districts in Worcester County with the development and implementation of Positive Behavioral Interventions and Supports (PBIS) and with developing “wrap-around” mental health services and supports. The participating districts receive professional development as well as onsite assistance in developing and implementing the principles of PBIS. In the first year of the program, four districts totaling six schools and over 50 school personnel (including teachers, administrators, related service providers, paraprofessional, parents, and students) participated. In the second year, this first cohort of districts moved from the planning stage to implementation, and the second cohort of six districts entered the first stage. Now, in the third year of the grant, the second cohort is completing the implementation stage and a third cohort of four districts and six schools is participating in the initial, planning stage. This professional development opportunity is intended to help teachers provide services that will keep students with disabilities in school. Massachusetts FOCUS Academy (MFA) (SEPP) provides online, graduate level coursework to middle and high school educators across the state. One content area, Universal Design for Learning (UDL), has a significant effect on supporting improved graduation rates for students with disabilities. The courses help educators gain a better understanding of how disability affects student learning, and provide educators with improved skills in the areas of curriculum design, instruction, and technology; these skills translate into improved student outcomes, which will lead to higher graduation rates. Since the introduction of the UDL courses in FFY 2007, 155 educators from 50 districts participated in them. Additional MFA courses that positively affect student success and promote decreased dropout rates include Positive Behavioral Supports, Family Engagement, and Post-Secondary Transition. National Association of State Directors of Special Education (NASDSE) Satellite Series (SEPP) - The National Association of State Directors of Special Education (NASDSE), with support from the Pennsylvania Department of Education and the Pennsylvania Training and Technical Assistance Network (PaTTAN), provides the NASDSE Satellite Series. These telecasts bring nationally recognized experts to the state using technology, providing an affordable means of quality personnel development for a variety of stakeholders. This year MASSDE participated in a telecast on bullying that was relevant to the topic of dropout prevention. 21 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 2 Submitted February 1, 2010 District and School Assistance Centers (DSACs) – MASSDE has opened six regionally-based DSACs to help identified districts and their schools strategically access and use professional development and targeted assistance to improve instruction and raise achievement for all students. MFA courses (see above), including UDL Creating Positive Classroom Environments, and Transition Planning have been integrated into the menu of professional development options available to districts. Many of the factors that contribute to student dropout are consistent for students with disabilities and their non-disabled peers. Therefore, MASSDE has combined efforts within the agency and with other key stakeholders to develop a series of dropout initiatives targeted toward at-risk youth and the communities in which they reside. The following summarizes the activities that are underway as well projects planned for the future. Each of the initiatives allows for inter/intra-agency collaboration, program development for students with disabilities, as well as professional development. American Recovery and Reinvestment Act: Saving and Creating Jobs and Reforming Education (ARRA) – IDEA Collaboration with Stakeholders Curriculum, Instruction and Assessment Summit Secondary School Reading Grant Secondary Transition- TransitionWorks: Innovative Strategies for Transitioning Youth with Disabilities from School to Work Special Education Professional Development Institutes For detailed information about these activities, please see Appendix A. MASSDE continues to report dropout data publicly, and data are available at http://profiles.doe.mass.edu/state_report/special_ed.aspx. Updates to the mapping portion of the public website will be available soon. Please note that pursuant to OSEP’s instructions for a data lag, the FFY 2008 data for Indicator 2 will be discussed in the FFY 2009 Annual Performance Report (MA APR), to be submitted in February 2011. MASSDE will continue to focus its efforts on improving the dropout rate for students with IEPs, and looks forward to reporting the results of these efforts in the FFY 2009 APR. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): The Part B State Performance Plan (SPP) and Annual Performance Report (APR) have been amended to reflect the changed requirements for Indicator 2 and its measurement, including alignment with targets established under Title 1 of the Elementary and Secondary Schools Education Act (ESEA), and elimination of the requirement to compare dropout rates for students with and without IEPs in the Commonwealth. For this reason, reported data now include only students who have IEPs. MASSDE has revised measurable and rigorous targets for Indicator 2 in the MA SPP and APR to reflect the changes, and has revised Improvement activities to include updated activities and revised activity titles. See the MA SPP for changes. 22 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 3 Revised February 1, 2010 Indicator 3: Assessment SPP Monitoring Priority: FAPE in the LRE Indicator 3: Participation and performance of children with disabilities on statewide assessments: A. Percent of the districts with a disability subgroup that meets the State’s minimum “n” size that meet the State’s AYP targets for the disability subgroup. B. Participation rate for children with IEPs. C. Proficiency rate for children with IEPs against grade level, modified and alternate academic achievement standards. (20 U.S.C. 1416 (a)(3)(A)) Measurement: A. AYP percent = [(# of districts with a disability subgroup that meets the State’s minimum “n” size that meet the State’s AYP targets for the disability subgroup) divided by the (total # of districts that have a disability subgroup that meets the State’s minimum “n” size)] times 100. B. Participation rate percent = [(# of children with IEPs participating in the assessment) divided by the (total # of children with IEPs enrolled during the testing window, calculated separately for reading and math)]. The participation rate is based on all children with IEPs, including both children with IEPs enrolled for a full academic year and those not enrolled for a full academic year. C. Proficiency rate percent = ([(# of children with IEPs enrolled for a full academic year scoring at or above proficient) divided by the (total # of children with IEPs enrolled for a full academic year, calculated separately for reading and math)]. Overview of Issue/Description of System or Process: ADEQUATE YEARLY PROGRESS (AYP) MASSDE requires that each district receive a positive Adequate Yearly Progress (AYP) determination each year. AYP calculations were designed by MASSDE to monitor the progress of the public schools toward meeting the goal of high achievement for all students. AYP measures elements of participation, performance, improvement, and attendance to determine if schools are meeting the yearly target that aligns with the overarching goal of the No Child Left Behind Act that all students attain academic proficiency by school year 2014. The targets for all student subgroups are the same in Massachusetts in that each subgroup is held to the same level of expectation and the same participation and achievement standards. In order to achieve AYP in school year 2004-2005, a student subgroup must have met a student participation requirement of 95% or greater and an attendance target (92% or greater attendance rate or 1% improvement over previous year). Next, the subgroup had to either meet the State’s Mid-Cycle IV performance target, a Composite Performance Index (CPI) score of 80.5 for MCAS English Language Arts (ELA) and 68.7 for Mathematics, or the subgroup had to meet their Mid-Cycle IV improvement target. For additional details on the AYP determination process, refer to the School Leaders’ Guide to the 2005 Mid-Cycle IV Adequate Yearly Progress Reports (http://www.doe.mass.edu/sda/ayp/cycleIVmid/schleadersguide.doc). MASSACHUSETTS COMPREHENSIVE ASSESSMENT SYSTEM (MCAS) MASSDE requires that all publicly funded students, including those students with disabilities, participate in the grade level Massachusetts Comprehensive Assessment System (MCAS) tests. Although the participation requirement is the same for general education students, students with disabilities can participate in either the standard MCAS or the MCAS Alternate Assessment (MCAS-Alt), depending on the nature and complexity of their disability. The MCAS-Alt is a portfolio-based assessment that measures the same learning standards of the Massachusetts Curriculum Frameworks as are measured in the 23 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 3 Revised February 1, 2010 standard MCAS tests. For additional information on MCAS participation requirements, please refer to the Requirements for the Participation of Students with Disabilities in MCAS: Spring 2006 Update http://www.doe.mass.edu/mcas/alt/spedreq.pdf. In school year 2004-2005 and in previous years, students were required to take the English Language Arts (ELA) exam in grades 3, 4, 7, and 10. The Mathematics test was administered to students in grades 4, 6, 8, and 10. In order to fulfill the requirements of the No Child Left Behind Act, beginning in the 20052006 school year, both the MCAS ELA and Mathematics tests will be administered annually in grades 3-8 and grade 10. % Districts Meeting AYP for Disability Subgroup (Indicator 3A) English/ Language Arts Mathematics # Districts with Special Education Subgroup 222 225 # Districts Making AYP for Special Education Subgroup 99 83 % Districts Making AYP for Special Education Subgroup 45% 37% Baseline Data for FFY 2004 (2004-2005): Participation Rate for Students with IEPs (Indicator 3B) English/ Language Arts Mathematics # of students with IEPs participating in regular assessment* 46,697 47,782 # of students with IEPs participating in alternate assessment 3,354 3,385 24 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 3 Revised February 1, 2010 Participation Rate for Students with IEPs (Indicator 3B) English/ Language Arts Mathematics Total # of Students with IEPs Assessed (sum of above three lines) 50,051 51,167 Total # of Students with IEPs Enrolled in Assessed Grades 50,394 51,495 % of Students with IEPs Participating in Statewide Assessment 99.3% 99.4% *Note: At the time of reporting, the MCAS accommodation file is not yet available. MASSDE will submit detailed information on student participation by accommodation status through the February 2006 submission of Table 6. Since the inception of the MCAS, Massachusetts has held a high standard for all students seeking to demonstrate proficiency. To demonstrate proficiency on the MCAS, students must demonstrate a solid understanding of challenging subject matter and solve a wide variety of problems. A “proficient” score on the MCAS indicates that a student has demonstrated appreciably more than the basic skills needed to succeed in a subject area. By setting the bar high, MASSDE expects all students to achieve high levels of academic success. Proficiency Rate for Students with IEPs (Indicator 3C) English/ Language Arts Mathematics # of students with IEPs scoring Proficient or above on regular assessment* 11,984 7,299 # of students with IEPs scoring Proficient or above on alternate assessment 2 2 11,986 7,301 Total # of Students with IEPs scoring Proficient or above (sum of above three lines) 25 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 3 Revised February 1, 2010 Proficiency Rate for Students with IEPs (Indicator 3C) English/ Language Arts Mathematics Total # of Students with IEPs Assessed 50,051 51,167 % of Students with IEPs Scoring Proficient or Above on Statewide Assessment 23.9% 14.3% 65 49.5 Actual data for baseline year CPI (see below for description) Discussion of Baseline Data: % Districts Meeting AYP for Disability Subgroup (Indicator 3A) The baseline data for English Language Arts indicates that of the 222 districts with a special education subgroup, 99 districts (45%) made AYP for that subgroup in English Language Arts (ELA). In Mathematics, there were 225 districts with a special education subgroup, and 83 (37%) made AYP (the “n” size for a subgroup is 40 students). Since the “n” size for subgroups has changed over the past three years (from 20 in 2002-2003 to 40 for the following two years), it is difficult to identify trends. However, it should be noted that the percentage of districts making AYP for the special education subgroup has decreased over the past three years as the targets in each of the subject areas have increased. In ELA, the percentage has dropped from 69% in 2002-2003, to 56% in 2003-2004, to 45% in 2004-2005. For Mathematics, the percentage decreased from 54% in 2002-2003, to 36% in 2003-2004, and remained stable at 37% for 2004-2005. Massachusetts has not yet developed a methodology to incorporate the additional 2% flexibility provided by the USDOE and anticipates that some of these findings will be revised once the 2% flexibility methodology is designed and approved. MASSDE’s AYP results are also influenced by our high standards and our alternate assessment that is scored against those same standards. Participation Rate for Children with IEPs (Indicator 3B) As indicated by the baseline data, the participation rate for students with IEPs on statewide assessments is almost 100%. The participation rate on the ELA assessment was 99.3%, and was 99.4% on the Mathematics assessment. These rates are consistent with past years, as Massachusetts has had a 99% participation rate for students with IEPs on both the ELA and Mathematics assessments in each of the past three years (beginning in 2002-2003). If a student did not participate in the statewide assessments, it was due to one of three reasons: 1) the student was absent during testing opportunities; 2) the student received a medical exemption; or 3) the student first enrolled in a U.S. school after October 1 and could not engage meaningfully in the assessment process due to limited English proficiency. 26 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 3 Revised February 1, 2010 Proficiency Rate - CPI for Children with IEPs (Indicator 3C) Massachusetts’s data and targets for Indicator 3C are based on the state performance targets identified in No Child Left Behind (NCLB), the Composite Performance Index (CPI) calculation for each year. CPI is a 100-point index that assigns 100, 75, 50, 25, or a 0 points to each student participating in MCAS/MCAS-Alt tests based on their performance. A school or district’s CPI is calculated by combining points generated by students who take the standard MCAS tests (the “proficiency index”) with points generated by students who take the MCAS-Alt (“MCAS-Alt Index”). The total points assigned to each student are added together and the sum is divided by the total number of students assessed. The state performance targets are outlined in the graph below: The charts included below provide a detailed breakdown of the actual Composite Performance Index (CPI) for students on an IEP, over the past five years. As evident in these charts, students with IEPs have consistently improved, but did not meet the state performance targets. 27 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 3 Revised February 1, 2010 The Massachusetts Steering Committee unanimously recommended that our initial target setting be modest, however, in any area where the state has set targets for students as a whole those same targets are adopted for students with disabilities. The Steering Committee intends to allow our interest groups to review the data and consider local performance as well as state performance to effectively close the gap in this performance indicator. The following targets have been set for this first six-year period. The Proficiency rate (CPI) targets are the state performance targets identified in No Child Left Behind (NCLB), the Composite Performance Index (CPI). FFY Measurable and Rigorous Targets % Districts Meeting AYP for Disability Subgroup (3A) 2005 Participation Rate for Students with IEPs (3B) Proficiency Rate (CPI) for Students with IEPs (3C) ELA MATH ELA MATH 45% 37% 80.5 68.7 45% 37% 85.4 76.5 46% 38% 85.4 76.5 50% 40% 90.2 84.3 52% 42% 90.2 84.3 52% 45% 95.1 92.2 (2005-2006) 2006 (2006-2007) 2007 (2007-2008) 2008 (2008-2009) 2009 (2009-2010) 2010 MASSDE considers that its current participation rate of better than 99% is synonymous with full participation. Therefore MASSDE seeks to maintain this full participation level. MASSDE considers that its current participation rate of better than 99% is synonymous with full participation. Therefore MASSDE seeks to maintain this full participation level. (2010-2011) 28 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 3 Revised February 1, 2010 Improvement Activities/Timelines/Resources: In order to meet the goal of students with disabilities achieving academic success, MASSDE works with districts and schools to analyze student assessment data and implement effective improvement plans. In addition, best practices from schools winning the Compass awards (provided to recognize and reward districts for improvements in academic achievement; see also http://www.doe.mass.edu/sda/compass) are disseminated and shared with all low performing districts. Each district and school in Massachusetts is provided annually with their AYP results detailing outcomes for each subgroup and assistance is provided by MASSDE to assist districts in determining areas of needed improvement and how that improvement could be achieved. In addition to the AYP results, districts and schools also receive detailed MCAS item-analysis charts to facilitate in determining patterns, identify weakness and relevant relationships across student subgroups, performance levels, and subject areas and inform staff professional development. The activities listed above and additional activities are provided in the chart below and encompass Indicator 3 (A-C). Please note that many of the activities presented below impact across multiple indicator areas. For these activities, a full description is available in Appendix A. Improvement Activity Resources Timelines (FFY) 2005 - 2006 Emergent Literacy Grant (Additional Indicators Impacted: 5, 6) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2007 Project FOCUS Academy (Additional Indicators Impacted: 1, 2, 4, 5, 8, 13, 14) See Appendix A for a complete description. 2005 - 2008 Special Education Program Improvement Grants – Fund Code 274 (Additional Indicators Impacted: 4, 5, 11) MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston, Education Development Center), LEA staff time MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Program Improvement Grants – Fund Code 249 (Additional Indicators Impacted: 4, 5, 13) MASSDE staff time See Appendix A for a complete description 2005 - 2010 Secondary School Reading Grant (Additional Indicators Impacted: 1, 2, 5, 14) See Appendix A for a complete description. 29 MASSDE staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 3 Improvement Activity Revised February 1, 2010 Resources Timelines (FFY) 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Website (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Leadership Academies and Seminars (Additional Indicators Impacted: 5, 8, 11) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Special Education Summer Institutes (Additional Indicators Impacted: 1, 2, 4, 5, 6, 8, 11, 13, 14) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Comprehensive System of Personnel Development Training Project (CSPD) (Additional Indicators Impacted: 5, 11, 13, 14) MASSDE staff time, CSPD trainer time, CSPD district staff time See Appendix A for a complete description. 2005 - 2010 National Association of State Directors of Special Education (NASDSE) Satellite Series (Additional Indicators Impacted: 2, 5, 6, 13, 14) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Data Analysis MASSDE staff time MASSDE will analyze data both at the district and school level to determine appropriate technical assistance, and provide resources for increasing participation and improving performance of students with disabilities on statewide assessments. 30 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 3 Improvement Activity Revised February 1, 2010 Resources Timelines (FFY) 2005 - 2010 Web-based Resources on the Participation of Students with Disabilities in MCAS MASSDE staff time MASSDE will provide an annually updated guide for educators and parents/guardian on MCAS participation, and continues to MASSDE maintains web based resources for professionals including MCAS-Alt Newsletters, the Resource Guide, Educator's Manual, MCAS-Alt Forms and Graphs, and order forms. 2005 - 2010 On-going Technical Assistance from the Office of Accountability and Targeted Assistance MASSDE staff time MASSDE will provide on-going technical assistance related to school and district accountability processes and school improvement initiatives. The supports include creating and issuing data files, providing guidance to districts, assisting identified districts in school improvement planning and identifying exemplary schools and best practices. 2007 - 2009 Sign Language Video Resource Library (Additional Indicator Impacted: 5) MASSDE staff time See Appendix A for a complete description. 2007 - 2010 Partnership for Online Professional Development (POPD) MASSDE staff time This pilot program will offer online professional development courses to educators across the state in content areas such as instructional design, mathematics, and reading comprehension strategies. 2007 - 2010 Massachusetts FOCUS Academy (Additional Indicators Impacted: 1, 2, 4, 5, 8, 13, 14) See Appendix A for a complete description. 31 MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston), LEA staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 3 Improvement Activity Revised February 1, 2010 Resources Timelines (FFY) 2008 - 2010 Revision of “Ten Step Guide for Comprehensive Educational System of Students with Visual Impairments (Additional Indicators Impacted: 5, 6, 11, 13) MASSDE staff time, stakeholder groups See Appendix A for a complete description. 2008 Revision of “Is Special Education the Right Service?” (ISERS) (Additional Indicators Impacted: 6, 8, 10, 11, 12, 13, 14) MASSDE staff time, stakeholder groups See Appendix A for a complete description. 2007 - 2008 SPecial EDition Online Newsletter (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2007 - 2008 Massachusetts Online Resource Library (Additional Indicators Impacted: 1, 2, 4, 5, 6, 8, 13, 14) MASSDE staff time See Appendix A for a complete description. 2008 – 2010 Collaboration between MASSDE Curriculum and Instruction Math Office and Special Education Planning and Policy Development Office (SEPP) (Additional Indicators Impacted: 5) MASSDE staff time See Appendix A for a complete description 2008 – 2010 Collaboration with Federation for Children with Special Needs (Additional Indicators Impacted: 5, 8, 13) MASSDE staff time; Federation for Children with Special Needs See Appendix A for a complete description 2008 - 2010 2008 – 2010 Curriculum, Instruction, and Assessment Summit (Additional Indicators Impacted: 1, 2, 8) See Appendix A for a complete description District and School Assistance Centers (DSACs) (Additional Indicators Impacted: 2, 5, 13) MASSDE staff time MASSDE staff time See Appendix A for a complete description 2008 - 2010 Educational Proficiency Plans (EPP) (Additional Indicators Impacted: 1, 2, 13, 14) See Appendix A for a complete description 32 MASSDE staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 3 Submitted February 1, 2010 Indicator 3 – Annual Performance Report for FFY 2008 APR Measurable and Rigorous Targets FFY 2008 (2008-2009) Targets Actual Data % Districts Meeting AYP for Disability Subgroup (3A) Participation Rate for Students with IEPs (3B) Proficiency Rate (CPI) for Students with IEPs (3C) ELA MATH ELA MATH ELA MATH 50% 40% 99% 99% 90.2 84.3 68.3% 51.4% 98.1% 98.3% 67.9 56.9 Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 (2008-2009): Explanation for Progress or Slippage for 3A – Percent of districts that have a disability subgroup that meets the State’s minimum “n” size meeting that State’s Adequate Yearly Progress (AYP) targets for disability subgroups. To receive a positive AYP determination in FFY 2008, schools and districts must meet a state-established student participation requirement, a student attendance or graduation requirement, and either the State’s FFY 2008 performance target for that subject or the district, school, or subgroup’s own FFY 2008 improvement target. (See Table 1 on the following page for Massachusetts’ calculation of AYP determinations.) Table 1 – Calculation of AYP Determinations A + (B or C) + D = Affirmative AYP Determination MCAS Participation Rate A 95% or greater participation in Massachusetts Comprehensive Assessment System (MCAS) MCAS-Alternate Assessment (MCAS-Alt) tests and + B MCAS Performance 90.2 or greater Composite Performance Index (CPI) in English language arts (ELA); 84.3 or greater CPI in mathematics OR C MCAS Improvement* Meet or exceed 2009 improvement target (Specific to schools, districts and student groups) + D Additional Indicator Grades 1-8: 92% or higher attendance rate, or 1% improvement over 2008 High Schools: 4-year graduation rate of 65 percent applied to the 2008 graduation cohort, or 5year graduation rate of 70 percent applied to the 2007 graduation cohort, or 2 percentage point increase in 4-year graduation rate from the 2007 cohort to 2008 cohort. *NOTE: A group can also make AYP for improvement by reducing the percentage of non-proficient students by 10% from 2008 to 2009 (NCLB's safe harbor provision). 33 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 3 Submitted February 1, 2010 Following is the actual data and calculation for the determination of the number of districts that have a disability subgroup that met AYP targets for the subgroup in FFY 2008. LEAs Meeting AYP for Disability Subgroup Number of LEAs with disability subgroup Number of LEAs with disability subgroup meeting AYP Percent of LEAs with disability subgroup meeting AYP ELA Math ELA Math ELA Math 290 292 198 150 68.3% 51.4% For FFY 2008, there were 290 LEAs with a disability subgroup for English Language Arts (ELA) and 292 LEAs with a disability subgroup for Mathematics in Massachusetts for whom MASSDE made AYP determinations. MASSDE calculated AYP determinations for the disability subgroup if the group consisted of: (1) 40 students or more assessed in each year for which performance data were being analyzed and the number of subgroup members was at least 5% of the number of students whose assessment results were included in the school or district's aggregate AYP calculation; OR (2) 200 or more members. Using the above criteria, of the school districts with a disability subgroup for ELA, 68.3% (or 198) received a positive AYP determination. Of the school districts with a disability subgroup for Mathematics, 51.4% (or 150) received a positive AYP determination. The measurable and rigorous targets for FFY 2008 are increased by four percentage points above the FFY 2007 target for ELA (to 50% from 46%), and two percentage points above the FFY 2007 target for Mathematics (to 40% from 38%). Massachusetts reports an increase in the percentage of districts making AYP for students with disabilities in both ELA and Mathematics from FFY 2007 to FFY 2008 using this new methodology. MASSDE will continue to work to identify the performance gaps in our schools and districts, and to provide them with appropriate resources so that the performance of Massachusetts’ students with disabilities continues to improve. MASSDE met its measurable and rigorous target for FFY 2008. The chart below illustrates the actual data from FFY 2005 to FFY 2008 for this indicator, and compares the data to the actual target for FFY 2008. The aggregate increase from FFY 2005 to FFY 2008 is 43.3 and 32.4 percentage points in ELA and Mathematics, respectively. As described in the Massachusetts FFY 2007 APR for Indicator 3, there was an increase in the number of school districts making AYP for special education subgroups from FFY 2005 to FFY 2006 because of a change in MASSDE’s method of calculating AYP determinations. The changes, which were approved by the U.S. Department of Education in 2006, relate to the identification of a district for improvement or corrective action only if the district fails to make AYP in the same subject area for each of the elementary, middle, and high school grade-spans for students in the aggregate or any subgroup for two consecutive years; reporting AYP determinations separately for three-grade spans (grades 3-5, 6-8, and 9-12); and changes in the calculation of AYP that simplified the process for calculating AYP. More information about these changes is available in the Massachusetts FFY 2007 Annual Performance Report (APR) for Indicator 3. 34 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 3 Submitted February 1, 2010 Explanation for Progress or Slippage for 3B – Participation rate for children with IEPs The participation rate for students with IEPs for FFY 2008 is the number of students included in the disability subgroup who participated in MCAS and MCAS-Alt tests divided by the number of students included in the disability subgroup enrolled on the date the tests were administered. Students absent during testing, including those with a medical excuse, were counted in school and district participation rates as non-participants. A student was neither a participant nor a non-participant (i.e., excluded from both the numerator and the denominator in participation rate calculations) if all of the following statements were true: (1) the student transferred during the testing window (between the first day of ELA testing and the last day of testing for Mathematics or Science); (2) the student missed at least one entire session of the test in question; and (3) the student was not medically excused or absent for the test in question. Following is the actual data and calculation for the determination of the FFY 2008 participation rate for students with IEPs in the ELA and Mathematics tests. FFY 2008 Participation Count Number of students with IEPs in grades assessed Number of students with IEPs in regular assessment with or without accommodations (a) (b) & (c) Number of students with IEPs in alternate assessment against grade level and alternate achievement standards (d) & (e) ELA Math ELA Math ELA Math Grades* 3-5 38,824 38,850 34,634 34,749 3,811 3,809 Grades 6-8 40,714 40,703 36,489 36,337 3,475 3,706 35 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 3 Submitted February 1, 2010 Number of students with IEPs in grades assessed Number of students with IEPs in regular assessment with or without accommodations (a) (b) & (c) Number of students with IEPs in alternate assessment against grade level and alternate achievement standards (d) & (e) ELA Math ELA Math ELA Math Grade 10 11,994 12,008 10,577 10,591 838 840 State Total 91,532 91,561 81,700 81,677 8,124 8,355 *Note: The data presented above are presented by the grade spans used for making AYP determinations (as described in Indicator 3A). ELA and Math – Participation Rate Overall percent = [(b + c + d + e) divided by (a) X 100]. (b) & (c) (d) & (e) (a) Overall Percent ELA 81,700 + 8,124 ÷ 91,532 = 98.1% MATH 81,677 + 8,355 ÷ 91,561 = 98.3% In FFY 2008, of the 91,532 students with IEPs enrolled in all grades assessed for ELA, 81,700 participated in the regular assessment and 8,124 participated in an alternate assessment. The total participation rate for ELA was 98.1%. In Mathematics, 91,561 students with IEPs enrolled in all grades assessed, and of those students, 81,677 participated in the regular assessment and 8,355 participated in an alternate assessment. The total participation rate for Mathematics was 98.3%. The difference of 29 students with IEPs in grades assessed from Mathematics (91,561) to ELA (91,532) may have included cases in which a student was repeating 10th grade who previously took MCAS, a student was removed from the calculation on appeal (e.g., a student with a medically-documented absence whose non-participation caused a school as a whole to not make AYP), and a student transferred in or out of the district during the testing period and therefore did not complete testing in that year. The following graph illustrates the increase in participation rates of students with disabilities in statewide assessments from FFY 2005 to FFY 2008. 36 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 3 Submitted February 1, 2010 The measurable and rigorous target for participation rate for students with IEPs in FFY 2008 remained at 99%. In this period the participation rate for students with IEPs on statewide assessments was 98.1% for ELA and 98.3% for Mathematics. This is an increase of 0.2 percentage points above the FFY 2007 participation rate for ELA, and an increase of 0.3 percentage points for Mathematics. Participation rates since FFY 2005 have increased by at least 0.5%, and high rates of participation by students with disabilities on statewide assessments have continued. Explanation for Progress or Slippage for 3C – Proficiency rate for children with IEPs against grade level standards and alternate academic achievement standards. To calculate proficiency rate, Massachusetts uses the CPI, a 100-point index that assigns 100, 75, 50, 25, or 0 points to each student participating in the Massachusetts Comprehensive Assessment System (MCAS) and MCAS Alternate Assessment (MCAS-Alt) tests based on their performance. The total points assigned to each student are added together and the sum is divided by the total number of students assessed. The result is a number between 0 and 100, which constitutes a district, school, or subgroup’s CPI for that subject and student group. CPIs are generated separately for ELA and Mathematics, and at all levels – state, district, school, and student subgroup. For additional details on the CPI, please see the School Leaders’ Guide to the 2009 AYP Reports (http://www.doe.mass.edu/sda/ayp/2009/schleadersguide.doc ). Following are the data and calculation for the FFY 2008 proficiency rate for children with IEPs. 37 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 3 Submitted February 1, 2010 Proficiency Count and Rate Number of students with IEPs in grades assessed (a) Number of students with IEPs in grades assessed who are proficient or above as measured by the regular assessment with or without accommodations and by the alternate assessment against grade level or alternate achievement standards (b), (c), (d) & (e) Percent of students with IEPs scoring proficient or above on statewide assessment Actual target data for students with IEPs (Composite Performance Index) [(b),(c), (d). & (e)] divided by (a) times 100 ELA Math ELA Math ELA Math ELA Math Grades 3-5 38,445 38,558 8,117 7,919 21.1% 21.1% 64.0 59.5 Grades 6-8 39,964 40,043 12,445 5,807 31.1% 13.7% 69.2 50.8 Grade 10 11,415 11,431 4,840 4,225 42.4% 32.8% 76 69.5 State Total 89,824 90,032 25,402 17,951 28.3% 19.9% 67.9 56.9 For FFY 2008, 89,824 students with IEPs in all grades were assessed for ELA, and of those students, 25,402 students scored proficient or above as measured by the regular and alternate assessment. The percent of students with IEPs scoring proficient or above on the ELA statewide assessment was 28.3%, and the Composite Performance Index (CPI) for students with disabilities was 67.9. In Mathematics, 90,032 students with IEPs in all grades were assessed, and of those students, 17,951 scored proficient or above as measured by the regular and alternate assessment. The percent of students with IEPs scoring proficient or above on the Mathematics statewide assessment was 19.9%, and the CPI for students with disabilities was 56.9. MASSDE has continued to set targets for students with IEPs that are the same as the targets for all students. In FFY 2008, the target CPI for all students was 90.2 in ELA, and 84.3 in Mathematics. Actual FFY 2008 data show that the CPI for student with disabilities (67.9 in ELA and 56.9 in Mathematics) fell short of these targets. Nonetheless, there has been continued progress for the disability subgroup this year. The FFY 2008 data reflect an increase of 2.0 points over FFY 2007 totals in ELA and 1.5 points in Mathematics. Also, since FFY 2005, the CPI for this subgroup has increased 5.4 points in Mathematics and 3.1 points in ELA. These increases are reported in the graphs below. MASSDE will continue to work to improve results students with disabilities in this area in FFY 2009. 38 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 3 Submitted February 1, 2010 Improvement Activities In FFY 2008 MASSDE engaged in intra-agency activities and initiatives intended to improve outcomes for all students. SEPP’s presence in the planning and implementation stages of these activities has ensured that the needs of students with IEPs are addressed. SEPP staff is participating in discussions and program development in cooperation with the following units in MASSDE (see Appendix A for specific activities): School and District Accountability and Assistance Curriculum and Instruction Secondary School Services Elementary School Services Student Support Services Student Assessment In FFY 2008, MASSDE also engaged in a number of improvement activities to improve results for students with disabilities on statewide assessment. The following activities had a direct affect on Indicator 3. MASSDE has a long standing relationship with the Federation for Children with Special Needs (FCSN), the Parent Training and Information Center federally funded to provide free information, support, technical assistance, and workshops to Massachusetts’ families who have children with disabilities. FCSN provides training and technical assistance to families throughout Massachusetts on behalf of MASSDE. In FFY 2008 training topics included Parent’s Rights, IEPs, and The Massachusetts Comprehensive Assessment System (MCAS). Collaboration between MASSDE Curriculum and Instruction Mathematics Office and Special Education Planning and Policy Development Office (SEPP) was initiated in FFY 2008 after the MA Urban Math Liaisons network (math directors who provide guidance and support around mathematics in Massachusetts public schools) identified the need to support better 39 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 3 Submitted February 1, 2010 students with disabilities as a critical priority in urban districts. In response to this need, meetings of the Math Specialist Support group at MASSDE will be dedicated to developing a district level collaboration between special educators and mathematics specialists. This will have a direct affect on access and success of students with IEPs on statewide Mathematics assessments. MASSDE holds an annual Curriculum, Instruction, and Assessment Summit, the purpose of which is to share MASSDE resources for strengthening curriculum, instruction and assessment, identify needs for future development of curriculum resources and technical assistance, and build capacity of the department, districts, and schools through regional partnerships. In FFY 2008, the topics from the Summit that related to statewide assessment were: Starting Out Right: Preventing and Closing the Achievement Gap; Curriculum Alignment; Online Courses and Resources for Standards-Based Teaching and Learning; Narrowing Achievement Gaps in Reading and Writing; Addressing the Achievement Gap: Parents as Teachers and Partners; Effective Math Instruction for English Language Learners; The Integration of Science and Literacy; The Role of the Arts in Raising Academic Achievement; Tools for Differentiated Curriculum and Instruction; Implementing a Balanced Assessment System; Supporting Student Achievement in Science and Technology/Engineering; and Math Learning Communities in Practice. District and School Assistance Centers (DSACs) - MASSDE has opened six regionally-based DSACs to help identified districts and their schools strategically access and use professional development and targeted assistance to improve instruction and raise achievement for all students. MFA courses (see below), including UDL Creating Positive Classroom Environments, and Transition Planning have been integrated into the menu of professional development options available to districts. Educational Proficiency Plans (EPP) - School districts must develop an EPP for any student in the class of 2010 who does not score at 240 or above on the grade 10 ELA and Mathematics MCAS tests. The EPP must identify the student's strengths and weaknesses, based on MCAS and other assessment results, coursework, grades, and teacher, student, and counselor input. The purpose of the requirement is to increase the likelihood that students will meet state and local standards to graduate from high school, including achieving success on the MCAS tests, and will have the requisite skills needed for post-secondary success. The Secondary School Reading grant is a grant program that selects middle schools, high schools, and vocational schools with poor MCAS performance or unusually large special education populations to receive four years of funding to develop and implement a school-wide approaches to improving reading achievement across content areas, including: involvement of and training for all professional and paraprofessional staff, reading across content areas, multiple targeted intervention programs for struggling readers, adequate time for reading instruction, assessment that drives instruction, flexible grouping patterns, and leadership structures that provide ongoing support and guidance for all students. These efforts have a direct affect on student participation in and performance on the ELA MCAS tests. Special Education Professional Development Summer Institutes offered professional development opportunities to educators in FFY 2008 in a variety of areas to allow educators to improve their capacity to provide differentiated, responsive classroom instruction, which in turn will lead to improved academic outcomes for students with disabilities. Some of the topics related to statewide assessment included Access to Print: A Framework for All Learners; Assessing English Language Learners (ELL) with Disabilities; Managing Behavior in an Inclusive Classroom; Mathematics and/or Science and Technology; American Sign Language (ASL) and Other Signed Systems; Topics in Teaching Literacy to Students Who Are Deaf or Hard-of-Hearing; and Special Education Professional Development Seminar for Educators of Students Who Are Deaf or Hardof-Hearing. The Special Education Program Improvement Grants – Fund Code 274 offered to every LEA in 2008 included Curriculum Development, Assessment, and Instruction. The goal of this priority was to assist the skills and capacity of educators to meet the diverse instructional and curricular 40 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 3 Submitted February 1, 2010 needs of students with disabilities. Districts were able to use funds provided through this grant to provide on-going professional development to general and special educators. Massachusetts FOCUS Academy (MFA) provides online, graduate level coursework to middle and high school educators across the state. One content area, Universal Design for Learning (UDL), has a significant effect on providing access for students with disabilities. The courses help educators gain a better understanding of how disability affects student learning, and provides educators with improved skills in the areas of curriculum design, instruction, and technology; these skills translate into improved student outcomes. Since the introduction of the UDL courses in FFY 2007, 155 educators from 50 districts participated in them. MASSDE also participated in and supported professional development opportunities provided through the National Association of State Directors of Special Education (NASDSE) whereby national experts provide information via telecast on a variety of high-interest topics, including improvement of instruction, increasing student engagement, and improving methods of participation for students with disabilities on statewide assessments. Numerous activities focused on student assessment contributed to the state’s continued success in meeting its target for Indicator 3. The MASSDE Special Education Planning and Policy Development Office (SEPP) works to ensure students with disabilities needs are addressed by the following improvement activities: American Recovery and Reinvestment Act: Saving and Creating Jobs and Reforming Education (ARRA) – IDEA Collaboration with Stakeholders Secondary Transition- TransitionWorks: Innovative Strategies for Transitioning Youth with Disabilities from School to Work Sign Language Video Resource Library Special Education Leadership Academies and Seminars Special Education Program Improvement Grants – Fund Code 249 For detailed information about the activities listed above, please see Appendix A. In addition to the improvement activities described above, MASSDE maintained web-based resources for professionals including MCAS-Alt Newsletters, resource guides, and educators’ manuals, including an updated Requirements for the Participation of Students with Disabilities in MCAS guide. The purpose of this document is to provide guidelines for the participation of students with disabilities in statewide tests and to familiarize educators, and parents and guardians, with available test accommodations. Also, the Student Assessment Services unit in MASSDE holds annual sessions for school personnel about conducting the MCAS-Alt tests for students. MASSDE continues to report publicly assessment data. This information can be viewed at http://profiles.doe.mass.edu/state_report/special_ed.aspx MASSDE will continue to focus its efforts on improving outcomes for students with IEPs, and looks forward to reporting the results of these efforts in the FFY 2009 for Indicator 3. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): The Part B State Performance Plan (SPP) and Annual Performance Report (APR) have been amended to reflect the changed requirements for Indicator 3 and its measurement, including alignment with the Title 1 of the Elementary and Secondary Schools Education Act (ESEA). MASSDE has revised improvement activities to in the SPP to include updated activities and revised activity titles and timelines. See the MA SPP for changes. 41 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 4 Revised February 1, 2010 Indicator 4: Suspension/Expulsion SPP Monitoring Priority: FAPE in the LRE Indicator 4: Rates of suspension and expulsion: A. Percent of districts that have a significant discrepancy in the rate of suspensions and expulsions of greater than 10 days in a school year for children with IEPs; and B. Percent of districts that have: (a) a significant discrepancy, by race or ethnicity, in the rate of suspensions and expulsions of greater than 10 days in a school year for children with IEPs; and (b) policies, procedures or practices that contribute to the significant discrepancy and do not comply with requirements relating to the development and implementation of IEPs, the use of positive behavioral interventions and supports, and procedural safeguards. (20 U.S.C. 1416(a)(3)(A); 1412(a)(22)) Measurement: A. Percent = [(# of districts that have a significant discrepancy in the rates of suspensions and expulsions for greater than 10 days in a school year of children with IEPs) divided by the (# of districts in the State)] times 100. B. Percent = [(# of districts that have: (a) a significant discrepancy, by race or ethnicity, in the rates of suspensions and expulsions of greater than 10 days in a school year of children with IEPs; and (b) policies, procedures or practices that contribute to the significant discrepancy and do not comply with requirements relating to the development and implementation of IEPs, the use of positive behavioral interventions and supports, and procedural safeguards) divided by the (# of districts in the State)] times 100. Massachusetts’ definition of “significant discrepancy” is suspension/expulsion rate of five times the state rate for two consecutive years. Overview of Issue/Description of System or Process: Indicator 4A: A comparison of the district rate of students with an IEP who were expelled or suspended for > 10 school days in a school year versus the state rate of students with an IEP who were expelled or suspended for > 10 school days in a school year was used for the purpose of determining the existence of a numeric discrepancy. Districts with fewer than 30 students in special education were removed from this part of the analysis since small numbers of students with disabilities may distort percentages. A comparison of suspensions and expulsions rates for students with disabilities to rates for students without disabilities is not possible, since comparable data, such as suspensions or expulsions for greater than 10 days, is not an analysis that is used for students without disabilities. Data is gathered through a discrete incident reporting procedure used by each district in reporting to the state through a web-based system. This report is called the School Safety and Discipline Report (SSDR). The SSDR is coordinated with the Student Information Management System (SIMS) through use of the individual student identification number. All SSDR reports for the school year must be submitted by July 28 th. A district is cited as having a significant discrepancy in the rate of suspension and expulsion for students with an IEP if their rate of suspension and expulsion is five times the state rate for two consecutive years. MASSDE feels strongly that districts should be cited after two consecutive years of having a suspension and expulsion rate that is five times the state rate because the data obtained for this indicator appears to have significant data collection variation and, therefore, initial activities for this indicator will also include significant data verification activity. 42 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 4 Revised February 1, 2010 Baseline Data for FFY 2004 (2004-2005): Indicator 4A: 2004-05 Special Education Enrollment 2004-05 State Suspension/ Expulsion Rate % of districts with suspension/ expulsion rate that is five times State Rate* % of districts with a finding of “significant discrepancy” 1.8% 0% (6 districts) (0 districts) *Districts with fewer than 30 students in special education were removed from this part of the analysis. 157,111 0.514% Discussion of Baseline Data: Indicator 4A: The SSDR reports individual level data on the disciplinary action received by a student for a drug or violence related incident, the disciplinary action received by a student with an IEP for any infraction, and an expulsion or suspension of more than 10 consecutive school days of a student without an IEP for nondrug or violence related activities. In-school suspensions, out-of-school suspensions, and removals to alternative educational settings are all counted. If the same student is disciplined on more than one occasion, he/she is counted separately for each infraction. MASSDE has noted significant variation anecdotally in how or if suspensions are reported across school districts, therefore, we present this baseline data with caution. Although 1.8% (6) of the districts in Massachusetts had a suspension/expulsion rate five times the state rate for students with an IEP for greater than 10 days in FFY 2004, none of these districts exceeded the “five times the state rate” threshold for two consecutive years (none of these districts had exceeded the threshold in FFY 2003). Therefore, 0 districts (0%) were identified as having a significant discrepancy in the rates of suspensions and expulsions for students with disabilities in FFY 2004. MASSDE is concerned that districts may under-report or mis-report suspension activities because of public perception issues, inconsistency in reporting procedures at the local level, and confusion over the use of the term “in-school suspension.” Therefore, MASSDE will develop improvement activities aimed at improving the quality and accuracy of the data collected. Since no findings of significant discrepancy were made in this baseline year, our targets are 0% for all years. FFY Measurable and Rigorous Target 2005 (2005-2006) The % of districts with a significant discrepancy finding will be 0% 2006 (2006-2007) The %of districts with a significant discrepancy finding will be 0% 2007 (2007-2008) The % of districts with a significant discrepancy finding will be 0% 2008 (2008-2009) The % of districts with a significant discrepancy finding will be 0% 2009 (2009-2010) The % of districts with a significant discrepancy finding will be 0% 2010 (2010-2011) The % of districts with a significant discrepancy finding will be 0% 43 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 4 Revised February 1, 2010 Improvement Activities/Timelines/Resources: Indicator 4A: Please note that many of the activities presented below impact across multiple indicator areas. For these activities, a complete description is available in Appendix A. Timelines (FFY) 2005 - 2007 Improvement Activity Resources Project FOCUS Academy (Additional Indicators Impacted: 1, 2, 3, 5, 8, 13, 14) MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMassBoston, Education Development Center), LEA staff time See Appendix A for a complete description. 2005 - 2008 Special Education Program Improvement Grants – Fund Code 274 (Additional Indicators Impacted: 3, 5, 11) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Program Improvement Grants – Fund Code 249 (Additional Indicators Impacted: 3, 5, 13 ) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Summer Institutes (Additional Indicators Impacted: 1, 2, 3, 5, 6, 8, 11, 13, 14) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Special Education Website (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 44 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 4 Timelines (FFY) 2006-2010 Improvement Activity Suspension/Expulsion Forum Revised February 1, 2010 Resources MASSDE staff time, LEA staff time MASSDE will host a forum for districts identified with suspension rates above the state average as well as districts identified with rates below state average. The group will work to a) identify current definitions of suspension among the LEAs in attendance and the differences among them; b) review and analyze data from the most recent data collections; c) identify practices among LEAs regarding services provided to students with disabilities during suspension; and d) identify current reporting practices through SIMS and the SSDR. 2007 - 2010 Massachusetts FOCUS Academy (Additional Indicators Impacted: 1, 2, 3, 5, 8, 13, 14) See Appendix A for a complete description. 2007 - 2010 Central Massachusetts Communities of Care Positive Behavioral Interventions (PBIS) Grant (Additional Indicators Impacted: 2, 5) See Appendix A for complete description. 2008-2010 Suspension/Expulsion Technical Assistance Seminar Participants will include staff of LEAs that have either been identified as significantly discrepant or that are at risk for being identified as significantly discrepant in the next data collection. The objectives of the Suspension/Expulsion Technical Assistance Seminar are to: clarify appropriate definition of suspension; increase awareness of current district data collection systems; analyze disaggregated data provided by MASSDE to identify trends within each district; and identify programmatic services that may be provided rather than having a student experience in-school suspension (ISS). 45 MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMassBoston), LEA staff time MASSDE staff time, grant partners (Central Massachusetts Communities of care, national center for positive behavioral intervention and supports trainers), LEA staff time MASSDE staff time, LEA staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 4 Timelines (FFY) 2008 - 2010 Improvement Activity Data Collection and Practice Improvement Self Assessment Revised February 1, 2010 Resources MASSDE staff time MASSDE will develop a guidance document to provide technical assistance around the programmatic and determination requirements of inschool-suspension as well as logistical guidance and training on the differences between the Student Information Management System (SIMS) and the School Safety Discipline Report (SSDR) will be included. Aspects of this initiative will focus on effective review policies and procedures, and timely verification of correction of noncompliance by MASSDE. 2007 - 2008 Massachusetts Online Resource Library (Additional Indicators Impacted: 1, 2, 5, 6, 8, 13, 14) MASSDE staff time See Appendix A for a complete description. 2007 - 2008 SPecial EDition Online Newsletter (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Collaboration with PQA MASSDE staff time The special education unit will meet with members of the Program Quality Assurance (PQA) unit to identify district trends in findings of non-compliance regarding documentation and tracking of suspensions and expulsions. 2008 - 2010 2008 - 2010 Dropout Prevention and Recovery Workgroup (Additional indicators impacted: 1, 2, 14) See Appendix A for a complete description. Secondary School Reading Grant (Additional Indicators Impacted: 1, 2, 3, 5, 14) See Appendix A for a complete description. 46 MASSDE staff time MASSDE staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 4 Timelines (FFY) 2008 – 2010 Improvement Activity Disability Workgroups Revised February 1, 2010 Resources MASSDE staff time; stakeholders The disability – specific workgroups are comprised of a variety of experts for each disability, including: district personnel, family members, related services disciplines, higher education, and staff from MASSDE’s SEPP unit. The workgroups provide consultation and technical assistance to SEPP, collaborate on special projects and assist in the creation of professional documents and advisories. Central to the groups’ discussions were issues related to the suspension of students with specific disabilities. 2008 - 2010 Trauma Sensitive Schools Initiative (Additional Indicators Impacted: 1 ,2) See Appendix A for a complete description. 47 MASSDE staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 4 Submitted February 1, 2010 Indicator 4 – Annual Performance Report for FFY 2008 APR Indicator 4A FFY Measurable and Rigorous Target FFY2007 The % of districts with a significant discrepancy finding will be 0% Actual Target Data for FFY 2007 (as reported in the FFY 2008 Annual Performance Report (MA APR) based on the instructions for a one year data lag): 2007-2008 Special Education Enrollment 2007-2008 State Suspension/ Expulsion Rate 164,298 1.2% % of districts with suspension/ expulsion rate that is five times State Rate* % of districts with a finding of “significant discrepancy”** 1.4% (5 districts) 0.57% (2 districts) *The 348 districts with more than 30 students receiving special education services were statistically reviewed in the above analysis. ** The calculation is (2 / 348) x 100. Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 ((based on 2007-2008 data reflecting one year data lag): Explanation of Progress or Slippage: The revised Part B SPP/APR Indicator 4 information collection requirements approved by OMB on February 25, 2009, specify that States’ reports are now subject to a one year data lag, which requires reporting of actual target data for FFY 2007 against the FFY 2007 measurable and rigorous target. As a result, this is the same data reported in last year’s Indicator 4 APR. The data are based on the state’s definition of “significant discrepancy” -- a district having a suspension/expulsion rate of five times the state rate for two consecutive years. In the FFY 2007 reporting year, two districts (0.57% of all districts) met the threshold of determining significant discrepancy. For districts found to be significantly discrepant, MASSDE reviews the districts’ policies, procedures, and practices related to the development and implementation of IEPs; the use of positive behavioral interventions and supports; and procedural safeguards; and has required the LEAs to revise their policies, practices, and procedures as appropriate. Using this process, MASSDE conducted reviews for the two LEAs identified as significantly discrepant. Both have corrected their identified areas of noncompliance (see section below titled “Massachusetts Response to the OSEP Part B FFY 2007 SPP/APR Letter and Review Table”). MASSDE notes that 42 districts in the state have fewer than 30 students identified as eligible for special education. Although each of these districts was individually considered, no findings of discrepancy were made and the numbers were deemed too small for statistical analysis. Over the past four years, a trend has emerged in school districts’ rates of long-term suspension and expulsion for students with IEPs, and the data demonstrates that the state’s rate for students with disabilities has increased (Figure 1). In FFY 2004, the rate was 0.514%; 0.916% in FFY 2005; 1.0% in FFY 2006; and 1.2% in FFY 2007. MASSDE’s analysis of and response to the increase continues to focus on activities that ensure that the data are accurate, as well as seeking methods of obtaining comparable data for students without disabilities (see description of improvement activities below). 48 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 4 Submitted February 1, 2010 The following chart illustrates the trend from FFY 2004 to FFY 2007. Despite the increase in the statewide suspension/expulsion rates, the number of districts identified with a suspension/expulsion rate that is five times greater than the state rate in a given year has been relatively consistent. There were six districts in FFY 2004, four in FFY 2005 and FFY 2006, and five in FFY 2007. MASSDE considers this variation in data to be a result of inconsistent district definitions, policies, and procedures related to suspension and expulsion, and will continue to work with districts to increase consistency in the future. Indicator 4B States are not required to report on Indicator 4B in the Part B Annual Performance Report for FFY 2008. Improvement Activities The majority of MASSDE’s improvement activities for Indicator 4 in FFY 2008 were focused on (1) analyzing the comments and recommendations from meetings with LEAs and advisory groups held in FFY 2006 and FFY 2007 regarding rates of suspension and expulsion of students with IEPs, (2) formulating policies and technical assistance for districts to address the identified issues in a manner consistent with MASSDE guidelines, and (3) ensuring that the two districts identified with significant discrepancies in FFY 2007, one of which was also found to be significantly discrepant in 2006, were in compliance as required by 34 CFR § 300.170(b). MASSDE’s Student Support, Career, and Education Services unit (SSCE); Special Education Planning and Policy Development Office (SEPP); and the Program Quality Assurance (PQA) unit have engaged in the following improvement activities that directly affect suspension/expulsion rates for students with IEPs: The Dropout Prevention and Recovery Workgroup (SSCE) is designed to target assistance to districts for special populations. The Workgroup includes 18 urban districts that account for nearly half of the State’s students who drop out. This year’s focus is to review and analyze district policies regarding discipline, homework, and attendance, which have are significant issues relative to suspension and expulsion of students with IEPs. 49 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 4 Submitted February 1, 2010 Trauma Sensitive Schools Initiative (SSCE) – Through this initiative MASSDE is working to bring “trauma sensitive” practices to schools across the Commonwealth. These efforts include annual trainings and technical assistance around safe and supportive student learning environments by reducing barriers that may affect classroom behavior, relationships, and academic performance thereby creating a climate that encourages students to stay in school. Disability Workgroups (SEPP) – MASSDE convened disability workgroups were in March 2009, which were comprised of a range of experts in the field of each disability category. Although the workgroups’ agendas were broad and not limited to issues regarding suspension and expulsion, central to the groups’ discussions were issues about the suspension of students with specific disabilities, such as Asperger syndrome, Tourette syndrome, and other neurodevelopmental disabilities characterized by atypical behaviors. Data Collection and Practices Improvement Self Assessment (SEPP)- Based on the feedback and expertise of the participants in the many stakeholder group meetings, MASSDE is working to create an advisory document on data collection and program improvement self assessment that districts can use to assist them in developing and implementing practices consistent with federal and state regulations regarding the reporting of student discipline. The results of these efforts will allow districts to more accurately report data regarding the removal of a student with an IEP from his/her classroom(s), and will help districts determine whether such removal constitutes an in-school suspension. The advisory is presented in two parts: (1) guidelines for determining whether a removal of a student with an IEP constitutes an in-school suspension, and (2) assistance in developing data collection practices for in-school suspensions and reporting them to MASSDE through the School Safety and Discipline Report (SSDR) and the Student Information Management Systems (SIMS). It is expected that the Data Collection and Practices Improvement Self Assessment will increase awareness of current, district-specific suspension programs, alternatives to suspension, and the affects of suspension data. MASSDE will pilot the tool with a select, cross-section of districts with and without significant discrepancies in their rates of suspensions and expulsions of students with IEPs, and will include it as part of its Technical Assistance Advisory to all districts. This will help to support districts’ timely correction of noncompliance. MASSDE is currently developing a Suspension/Expulsion Technical Assistance Seminar (SEPP) to be held in FFY 2009 that will include staff from the significantly discrepant LEAs identified in FFY 2007 and in the FFY 2008 data collection, and districts identified as having a rate that is five times the state rate for a single year. The objectives of the seminar are to clarify appropriate definitions of in-school suspension, increase awareness of current district data collection systems through use of the Data Collection and Program Improvement Self Assessment tool, analyze disaggregated data provided by MASSDE to identify trends within each district, and identify programmatic services that may be provided rather than having a student experience in-school suspension. Providing LEAs with this information will assist in the selfassessment process and begin to increase awareness of the data being reported to MASSDE. In addition to data analysis, the significantly discrepant LEAs will be encouraged to pilot the Data Collection and Practice Improvement Self Assessment developed by MASSDE in an effort to begin the restructuring of suspension programs and the logistical coordination of reporting data to MASSDE. MASSDE was awarded a State Personnel Development grant to continue and build upon the previous success of Project FOCUS Academy. The Massachusetts FOCUS Academy (MFA)’s (SEPP) purpose is to enhance Massachusetts educators’ skills and knowledge for creating environments that encourage positive behavior in addition to providing professional development that fosters sound instructional and assessment methodologies to improve outcomes of students with IEPs. MFA is an online network offering college-level, course work in a variety of key areas, four of which are especially relevant to suspension and expulsion of students with IEPs: Universal Design for Learning (UDL): Meeting the Needs of Diverse Learners; Creating Positive Learning Environments (CPLI) I and II; Differentiated Instruction; and The Collaborative/Co-Teaching Model. 50 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 4 Submitted February 1, 2010 In partnership with the Central Massachusetts Communities of Care (CCMC) Positive Behavioral Interventions (PBIS) Grant (SEPP), MASSDE provided grant funds to support districts in Worcester County with the development and implementation of Positive Behavioral Interventions and Supports and with developing “wrap-around” mental health services and supports. The participating districts receive professional development as well as onsite assistance in the development and implementation of the principles of PBIS. In the first year of the program, four districts totaling six schools and over 50 school personnel (including teachers, administrators, related service providers, paraprofessional, parents, and students) participated. In the second year, this first cohort of districts moved from the planning stage to implementation, and the second cohort of six districts entered the first stage. Now, in the third year of the grant, the second cohort is completing the implementation stage and a third cohort of four districts and six schools is participating in the initial, planning stage. Special Education Professional Development Summer Institutes (SEPP) offered professional development opportunities to educators in FFY 2008 in a variety of areas to allow educators to improve their capacity to provide differentiated, responsive classroom instruction, which in turn will lead to improved academic outcomes for students with disabilities. Specifically related to suspension/expulsion was the course titled Managing Behavior in an Inclusive Classroom, The Special Education Program Improvement Grants – Fund Code 274 (SEPP) offered to every LEA in 2008 included Meeting the Behavioral and Social Needs of a Diverse Student Population. The goal of this priority was to assist educators in developing the skills and capacity in order meet the diverse behavioral and social needs of students with disabilities. Districts were able to use funds provided through this grant to provide ongoing professional development to general and special educators. SEPP has collaborated with the Program Quality Assurance/Comprehensive Program Review (PQA) unit of MASSDE, specifically around analyzing policies and procedures regarding in-school suspensions. Because PQA personnel are in school districts on a routine basis, they are afforded an insider’s view of district policies and how they are implemented at the local level. PQA’s experience in reviewing districts’ practices has underscored MASSDE’s understanding that the accuracy of the data reported to MASSDE is affected by lack of clarity about definitions as well as lack of identified personnel to report the data. Numerous activities focused on suspension/expulsion contributed to the state’s continued success in meeting its target for Indicator 4. The MASSDE Special Education Planning and Policy Development Office (SEPP) works to ensure students with disabilities are supported by the following improvement activities: American Recovery and Reinvestment Act: Saving and Creating Jobs and Reforming Education (ARRA) – IDEA Collaboration with Stakeholders Special Education Professional Development Institutes Special Education Program Improvement Grants – Fund Code 249 For detailed information about the activities listed above, please see Appendix A. MASSDE has continued to report suspension/expulsion data publicly, and data for Indicator 4A are reported through tables available at http://profiles.doe.mass.edu/state_report/special_ed.aspx. From this table, viewers can select a specific district to access more detailed data. Additional updates to the special education data on MASSDE’s public website are forthcoming. Please note that pursuant to OSEP’s instructions for a data lag, the FFY 2008 data for Indicator 4 will be discussed in the FFY 2009 Annual Performance Report (MA APR), to be submitted in February 2011. Massachusetts Response to the OSEP Part B FFY 2007 SPP/APR Letter and Response Table OSEP instructed MASSDE to include in its FFY 2008 APR for Indicator 4 a report on its review, and if appropriate, revision, of policies, procedures, and practices related to the development and 51 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 4 Submitted February 1, 2010 implementation of IEPs and procedural safeguards to ensure compliance with the IDEA for the LEAs identified with significant discrepancies for suspension and expulsion in both FFY 2006 and FFY 2007. Correction of Significant Discrepancy from FFY 2006 and FFY 2007 As noted in the FFY 2006 APR, the LEA identified as significantly discrepant in its rates of suspension and expulsions of students with IEPs had fully corrected areas of noncompliance related to the use of positive behavioral interventions and supports, but only partially corrected areas related to (1) the development and implementation of IEPs, and (2) procedural safeguards to ensure compliance with the IDEA. This same district was similarly identified in the FFY 2007 as demonstrating significant discrepancy. At the time of the FFY 2007 report, MASSDE was reviewing the district’s response to the partially completed procedures. Following completion of this review, MASSDE found that the LEA had successfully corrected most but not all areas of noncompliance and requested additional documentation of the LEA’s policies, procedures, and practices relating to the development and implementation of IEPs and procedural safeguards. MASSDE required the LEA to submit a Corrective Action Progress Report by January 2008. MASSDE conducted detailed analyses of the requested documentation and performed additional onsite visits to the LEA to ensure that the policies, procedures, and practices were being implemented. After extensive review of the additional information, MASSDE determined in June 2008 that the LEA had corrected all noncompliance for FFY 2006 and FFY 2007; the noncompliance identified in FFY 2007 was corrected within one year. A second LEA was identified with a significant discrepancy in its rates of suspensions and expulsions of students with IEPs for greater than 10 days in FFY 2007. MASSDE reviewed the district’s policies, procedures, and practices relating to the development and implementation of IEPs, the use of positive behavior interventions and supports, and procedural safeguards to ensure compliance with the IDEA. As a result of this review, MASSDE determined the LEA was not fully compliant in all of its policies, procedures, and practices relating to two areas: (1) the development and implementation of IEPs, and (2) procedural safeguards to ensure compliance with the IDEA. MASSDE required the LEA to submit a Corrective Action Plan for these areas. After reviewing this plan, MASSDE determined in September 2009 that the LEA had successfully corrected the noncompliance for FFY 2007. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): MASSDE has revised improvement activities in the MA SPP for Indicator 4 to include updated activities, including revised activity titles. See the MA SPP for the revised activities. MASSDE has also revised the indicator measurement table to reflect the revised Part B SPP/APR information collection that was approved by OMB on February 25, 2009, to be used through February 29, 2012, and the data lag instructions for Indicator 4A. 52 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 5 Revised February 1, 2010 Indicator 5: School Age LRE SPP Monitoring Priority: FAPE in the LRE Indicator 5: Percent of children with IEPs aged 6 through 21 served: A. Inside the regular class 80% or more of the day; B. Inside the regular class less than 40% of the day; and C. In separate schools, residential facilities, or homebound/hospital placements. (20 U.S.C. 1416(a)(3)(A)) Measurement: A. Percent = [(# of children with IEPs served inside the regular class 80% or more of the day) divided by the (total # of students aged 6 through 21 with IEPs)] times 100. B. Percent = [(# of children with IEPs served inside the regular class less than 40% of the day) divided by the (total # of students aged 6 through 21 with IEPs)] times 100. C. Percent = [(# of children with IEPs served in separate schools, residential facilities, or homebound/hospital placements) divided by the (total # of students aged 6 through 21 with IEPs)] times 100. Overview of Issue/Description of System or Process: MASSDE made changes to its regulations and placement descriptors to align with federal definitions in 2000. MASSDE’s former descriptions were most divergent in the full inclusion category and practice changes at the local level have slowly, but surely, begun to reflect more appropriately actual placements consistent with the federal definitions. MASSDE has provided technical assistance to implement the data collection changes built into the Student Information Management System (SIMS), and professional development has been provided to Special Education Administrators since the realignment activity began. However, there remains a difference between the Massachusetts data and National Baseline Data in the Out-of-District placement category. The data below indicates that 6.2% of Massachusetts students with disabilities are in out-of-district settings, with the vast majority in public and private day schools, 2.3% and 3.0% respectively. National baseline information indicates that only 2.9% of students are in out-of-district settings. Massachusetts has attempted to review the use of out-of-district placements along with the other states in the Northeast region, as this region of the U.S. has many more day and residential school options available to students, so we are somewhat unclear as to whether the national data is the most representative when reviewing practice in states with many out-of-district alternatives. This is somewhat on the principle of “if you build them they will come,” so part of our interest at this time is to review our data in detail and determine the extent to which states most comparable to Massachusetts look in relation to our performance. Breakdown of ‘Out-of-District’ Setting Data Setting Public Day Private Day Residential Facilities Home/Hospital # of students 3,677 4,635 1,294 207 Rate 2.3% 3.0% 0.8% 0.1% 53 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 5 Revised February 1, 2010 Massachusetts has a long history with Special Education Approved Private Schools (APS). Program Quality Assurance oversees compliance with education requirements in private day and residential special education schools through the Massachusetts Private Special Education School Program Review System. There are presently 144 APS; each self identifies the population they serve by disability, age, and gender. Most are members of the Massachusetts Association of Chapter 766 Approved Private Schools (MAAPS) whose mission is to represent private, special-education schools in their goal of providing the highest-quality education to students with special needs. At the November 2005 Massachusetts Special Education Steering Committee meeting, when participants reviewed the data related to LRE, the following questions surfaced: To what extent are students being educated in settings that provide the needed services; What does it look like when districts provide FAPE in the LRE; and Is there a danger in assuming that higher or lower percentages are meaningful? Others noted that research shows the closer students are to the general education classroom, with supports, there are more positive outcomes. While all agreed that we are provided with an opportunity to problem solve, there was a definite tension and decision not to seek change without careful consideration of what change represents. Baseline Data for FFY 2004 (2004-2005): Indicator 5: % of students with IEPs aged 6 through 21 in a) full inclusion; b) substantially separate placements; and c) in out-of-district placements Ages 6-21 2002-03 2003-04 2004-05 a) Full Inclusion 13% 33.7% 43.4% National Baseline 2002-03 48% Partial Inclusion 66% 43% 33.6% 29% b) Substantially Separate 15% 16.4% 16.2% 19% c) Out-of District 6.7% 5.5% 6.8% 2.9% Source of Data: 2004-05 Annual Report of Students Served Student Information Management System (SIMS) Discussion of Baseline Data: As noted in MASSDE’s response to the OSEP October 2003 Data Verification Visit letter, MASSDE has made changes to its definitions related to full inclusion and its data collection for section 618 that has resulted in more reliable and accurate data. Ongoing technical assistance is provided to districts on the data elements of SIMS, including the special education data elements. As districts continue to work with the new definitions and become even more familiar with the data elements related to LRE, it is anticipated that we will continue to move closer to the national baseline for ‘Full Inclusion’, ‘Partial Inclusion’, and ‘Substantially Separate’ placements. As noted above, there remain many issues related to ‘Out-of District’ placements. MASSDE has, in the past, relied on its monitoring system to collect district level data on LRE practices. To date, CPR teams have reviewed SE20: Least Restrictive Program Selected, which measures compliance on: 1. The program selected is the least restrictive environment for students, with consideration 54 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 5 Revised February 1, 2010 given to any potential harmful effect on the student or on the quality of services that he or she needs. 2. If the student is removed from the general education classroom at any time, the Team states why the removal is considered critical to the student’s program and the basis for its conclusion that education of the student in a less restrictive environment, with the use of supplementary aids and services, could not be achieved satisfactorily. 3. The district does not remove an eligible child from the general education classroom solely because of needed modification in the curriculum. 4. If a student’s IEP necessitates special education services in a day or residential facility or an out-of-district educational collaborative program, the IEP Team considers whether the student requires special education services and support to promote the student’s transition to placement in a less restrictive environment. MASSDE continues procedural compliance activities through an ongoing Coordinated Program Review (CPR) schedule. CPR team members utilize comprehensive data reports for each district being monitored through the CPR system in 2004-05. These reports include detailed placement data. With the greater availability of individual student level data, the lens on LRE may shift from district level policies and procedures to district level performance in relation to child placement outcomes. The Massachusetts Steering Committee unanimously recommended that our initial target setting be modest for Indicator 5B and 5C, in order to allow our interest groups to more deeply review the data and consider local performance as well as state performance to effectively close the gap in this performance indicator, as well as to carefully consider the impact of such targets. It is thought that the improvement activities focused on increasing full inclusion will create a meaningful impact and thus target setting is more substantial. Therefore the following targets have been set for this first six-year period. Measurable and Rigorous Target FFY % of students with IEPs aged 6 through 21 in full inclusion (Indicator 5A) % of students with IEPs aged 6 through 21 in substantially separate placements (Indicator 5B) % of students with IEPs aged 6 through 21 in outof-district placements (Indicator 5C) 2005 (2005-2006) 43.4% 16.2% 6.8% 2006 (2006-2007) 43.4% 16.2% 6.8% 2007 (2007-2008) 54.3% 15.1% 6.2% 2008 (2008-2009) 55.5% 14.9% 6.2% 2009 (2009-2010) 56.8% 14.7% 5.9% 2010 (2010-2011) 58% 14.5% 5.5% 55 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 5 Revised February 1, 2010 Improvement Activities/Timelines/Resources: Please note that many of the activities presented below impact across multiple indicator areas. For these activities, a full description of the activity is available in Appendix A. Timelines (FFY) 2005 - 2006 Improvement Activity Emergent Literacy Grant (Additional Indicators Impacted: 3, 6) Resources MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2007 Project FOCUS Academy (Additional Indicators Impacted: 1, 2, 4, 8, 13, 14) See Appendix A for a complete description. 2005 - 2010 Secondary School Reading Grant (Additional Indicators Impacted: 1, 2, 3, 14) MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston, Education Development Center), LEA staff time MASSDE staff time See Appendix A for a complete description. 2005 - 2008 Special Education Program Improvement Grants – Fund Code 274 (Additional Indicators Impacted: 3, 4, 11) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Program Improvement Grants – Fund Code 249 (Additional Indicators Impacted: 3, 4, 13) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Leadership Academies and Seminars (Additional Indicators Impacted: 3, 8, 11) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Special Education Summer Institutes (Additional Indicators Impacted: 1, 2, 3, 4, 6, 8, 11, 13, 14) See Appendix A for a complete description. 56 MASSDE staff time, LEA staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 5 Timelines (FFY) 2005 - 2010 Improvement Activity Special Education Website (Impacts All Indicators) Revised February 1, 2010 Resources MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Student Information Reporting and Management MASSDE staff time MASSDE will analyze data trends at the student, district and state level. The resulting analyses will be presented to LRE stakeholders and used to inform technical assistance and professional development activities. 2005 - 2010 MASSDE Grants that Foster Responsive Educational Environments MASSDE staff time, technical assistance and professional development providers SEPP staff will participate in program development and connect with offices across MASSDE to offer improvement activities that positively affect LRE. Numerous grant programs are funded for this purpose. LRE related programs will include: Exploring the Options for Children with Autism; Mental Health Project for Preschool through Grade Three; Safe and Supportive Learning Environments; and Even Start Family Literacy Program. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) MASSDE staff time, MEEC staff time See Appendix A for a complete description. 2005 - 2010 Comprehensive System of Personnel Development Training Project (Additional Indicators Impacted: 3, 11, 13, 14) MASSDE staff time, CSPD trainer time, CSPD district staff time See Appendix A for a complete description. 2005 - 2010 Inclusive Schools Week MASSDE staff time, LEA staff time To promote awareness of this initiative, MASSDE will encourage districts to highlight the accomplishments of students, families, school personnel, and community members in promoting inclusive education for all students. 2005 - 2010 National Association of State Directors of Special Education (NASDSE) Satellite Series (Additional Indicators Impacted: 2, 5, 6, 13, 14) See Appendix A for a complete description. 57 MASSDE staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 5 Timelines (FFY) 2006 - 2010 Revised February 1, 2010 Improvement Activity Resources Inclusive Concurrent Enrollment Partnership Program for Students with Disabilities (Additional Indicators Impacted: 13, 14) MASSDE staff time, LEA staff time, technical assistance providers See Appendix A for a complete description. 2007 - 2010 Central Massachusetts Communities of Care Positive Behavioral Interventions (PBIS) Grant (Additional Indicators Impacted: 2, 4) See Appendix A for complete description. 2007 - 2010 Massachusetts FOCUS Academy (Additional Indicators Impacted: 1, 2, 3, 4, 8, 13, 14) See Appendix A for a complete description. 2008 - 2010 Revision of “Ten Step Guide for Comprehensive Educational Assessment of Students with Visual Impairments” (Additional Indicators Impacted:3, 6, 11, 13) MASSDE staff time, grant partners (Central Massachusetts Communities of care, national center for positive behavioral intervention and supports trainers), LEA staff time MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston), LEA staff time MASSDE staff time, stakeholder groups See Appendix A for a complete description. 2007 - 2010 Least Restrictive Environment SelfAssessment Tool MASSDE will develop a district and school level Least Restrictive Environment self-assessment tool. This tool is intended to create continuous improvement in educational options for students with disabilities in the LRE. 2007- 2008 Massachusetts Online Resource Library (Additional Indicators Impacted: 1, 2, 3, 4, 6, 8, 13, 14) MASSDE staff time, LEA staff time, OSEP funded Technical Assistance and Dissemination Resources MASSDE staff time See Appendix A for a complete description. 2007-2008 SPecial EDition Online Newsletter (Impacts All Indicators) See Appendix A for a complete description. 58 MASSDE staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 5 Timelines (FFY) Improvement Activity 2008 – 2010 Collaboration between MASSDE Curriculum and Instruction Math Office and Special Education Planning and Policy Development Office (SEPP) (Additional Indicators Impacted: 3) Revised February 1, 2010 Resources MASSDE staff time See Appendix A for a complete description 2008 – 2010 Collaboration with Federation for Children with Special Needs (Additional Indicators Impacted: 3, 8, 13) MASSDE staff time; Federation for Children with Special Needs See Appendix A for a complete description 2008 – 2010 Community/Residential Education Project – (Additional Indicators Impacted: 13, 14) MASSDE staff time; Department of Developmental Services See Appendix A for a complete description 2008 – 2010 District and School Assistance Centers (DSACs) (Additional Indicators Impacted: 2, 3, 13) MASSDE staff time See Appendix A for a complete description 2008 – 2010 District and School Accountability and Assistance Office – Center for School and District Accountability – ESE MASSDE staff time The District and School Accountability and Assistance Office within the Center for School and District Accountability reviews districts, focusing on how district systems and practices affect each of four groups of students: students with disabilities, English language learners, lowincome students, and students who are members of racial minorities. In FFY 2008, the focus of the district reviews related to students with disabilities. 2008 – 2010 Sign Language Video Resource Library (Additional Indicators Impacted: 3) See Appendix A for a complete description 59 MASSDE staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 5 Submitted February 1, 2010 Indicator 5 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target Indicator 5A % of children with IEPs aged 6 through 21 served inside the regular class 80% or more of the day (Full Inclusion) Indicator 5B % of children with IEPs aged 6 through 21 served inside the regular class less than 40% of the day (substantially separate placements) Indicator 5C % of children with IEPs aged 6 through 21 served in separate schools, residential facilities, or homebound/hospital placements (out-of-district placements) 55.5% 14.9% 6.2% 2008 (2008-2009) Actual Target Data for FFY 2008 (2008-2009): Actual Data Indicator 5A % of children with IEPs aged 6 through 21 served inside the regular class 80% or more of the day (Full Inclusion) Indicator 5B % of children with IEPs aged 6 through 21 served inside the regular class less than 40% of the day (substantially separate placements) Indicator 5C % of children with IEPs aged 6 through 21 served in separate schools, residential facilities, or homebound/hospital placements (out-of-district placements) 56.8% 15.4% 6.8% Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 (2008-2009): Explanation of Progress or Slippage 5A – Full Inclusion The total number of students with IEPs ages 6 through 21 in Massachusetts for FFY 2008 was 151,283. Of those students, 56.8% were served in the general education classroom 80% or more of the day (full inclusion). This exceeds the measurable and rigorous target of 55.5%, and is an increase of 1.1 percentage points over FFY 2007 (55.7%). MASSDE met its target for Indicator 5A in FFY 2008, and continues to demonstrate progress in this area. Improvement can be attributed to the fact that districts are implementing practices that promote full inclusion of all students. 5B – Substantially Separate Placements In FFY 2008, 15.4% of students with IEPs ages 6 through 21 were served inside the general education class less than 40% of the day (substantially separate placements). This is greater than the rigorous target of 14.9%. MASSDE anticipated that many students in substantially separate placements would move to a less restrictive setting as MASSDE pursued this least restrictive environment (LRE) initiative; however, the majority of students who are moving to full inclusion are coming from the partial inclusion 60 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 5 Submitted February 1, 2010 subgroup. MASSDE’s longitudinal analysis of the data shows that substantially separate placements have remained consistent over time, as represented in the State Trends in Educational Environments FFY 2005 – FFY 2008 chart below. 5C – Out-of-district Placements The percent of children with IEPs aged 6 through 21 served in separate schools, residential facilities, or homebound/hospital placements (out-of-district placements) in FFY 2008 was 6.8. While MASSDE did not meet the measurable and rigorous target for this indicator, MASSDE is pleased to report that a longitudinal analysis of the data shows that there is no increase over time. Rather, MASSDE reports a consistent rate of out-of-district placements from FFY 2005 (6.7%) to FFY 2008 (6.8%). In order to understand better this data over time, MASSDE has produced the following charts and tables demonstrating trends in educational settings for the period FFY 2005 to FFY 2008. The chart on the following page illustrates the trends in educational environments to date, and demonstrates an increase over time in full inclusion environments, with a commensurate decrease in partial inclusion, while more separate environments have stayed relatively stable. State Trends in Educational Environments FFY 2005 - 2008 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 0% Full Inclusion Partial Inclusion Substantially Separate Out of District FFY 2005 FFY 2006 FFY 2007 FFY 2008 Further analysis of the data by disability category from FFY 2005 through FFY 2008 indicates that rates of full inclusion increased for all disability categories over this time period, while at the same time the rate of partial inclusion decreased in all but one disability category. The disability category that did not conform to this trend was sensory/hard-of-hearing. Since 2005, the rates of full inclusion and partial inclusion for this disability category have increased by 4.7 percentage points and 0.5 percentage points, respectively, and have shown decreases in the rates for substantially separate and out-of-district placements, by 3.7 percentage points and 1.6 percentage points, respectively. The graph below that shows the actual percentage point changes for full inclusion in all disabilities categories for the period FFY 2005 to FFY 2008. During this period, there has been an increase in full inclusion across all disability groups. 61 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 5 Submitted February 1, 2010 A ut is N m eu D ev ro lo el op gi ca m l en tD el ay In te lle ct ar ua d of l S H en C e a om so rin ry m g un V is i c io at n io Im n pa ir m en E t m ot io na l S P pe h ci ys fic ic al Le ar ni H ea ng lth D i S sa en b ilit so ie ry s M D ul e tip af bl le in D d is ab ilit ie s en so ry S Full_Inclusion 10.0 9.0 8.0 7.0 6.0 5.0 4.0 3.0 2.0 1.0 0.0 H Percentage Point Change Changes in Full Inclusion from FFY 2005 - FFY 2008 Disability The highest percent changes in full inclusion from FFY 2005 to FFY 2008 were the categories of specific learning disabilities (9.2 percentage point increase), physical (8.5 percentage point increase), and sensory vision impairment (7.7 percentage point increase). Further analysis revealed five disability categories that increased in full inclusion and decreased in all other placement categories (partial inclusion, substantially separate, and out of district) from FFY 2005 to FFY 2008. These figures are illustrated in the table below. Percentage Point Change from FFY 2005 – FFY 2008 Sensory Vision Emotional Health Specific Learning Sensory Deafblind Full Inclusion 7.7 6.1 7.6 9.2 3.2 Partial Inclusion -4.4 -1.6 -7.4 -8.9 -0.8 Substantially Separate -1.6 -2.9 -0.3 -0.3 -1.3 Out of District -1.6 -1.6 -0.1 0.0 -1.1 62 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 5 Submitted February 1, 2010 The following chart illustrates the change in percentage points in out of district placements for all disability categories from FFY 2005 through FFY 2008. Changes in Out of District Placement from FFY 2005 - FFY 2008 Percentage Point Change 1.5 1.0 1.3 1.2 0.9 0.3 0.4 0.5 0.3 0.1 0.0 0.0 -0.1 -0.5 -1.0 -1.1 -1.5 -1.6 -1.6 -1.6 ent D el ay Deve l opm al Neur ologic Aut is m le Di sabi li ti es Mul tip d Sens ory D eafbli n bilit ie s Healt h Spec i fic L earn i ng D isa Phys i cal E mo ti ona l at ion Sens ory V isi on Impa ir men t munic Com ar d-o f- Hea r ing Sens ory/H Intell e ctual -2.0 The disability categories with the largest percentage point decreases in out of district placements from FFY 2005 to FFY 2008 were sensory/hard-of-hearing, physical, and health (all with a 1.6 percentage point decrease). The disability categories with the largest percentage point increases in out of district placements from FFY 2005 to FFY 2008 were multiple disabilities (1.3 percentage point increase), autism (1.2 percentage point increase), and intellectual (0.9 percentage point increase). Improvement Activities In FFY 2008, MASSDE engaged in numerous activities around the educational environment that contributed to the state’s increase in full inclusion. The Special Education Planning and Policy Development Office (SEPP) works to ensure students with disabilities and their educators are positively affected by the improvement activities sponsored across MASSDE. This coordination of efforts and initiatives has a positive effect on MASSDE’s ability to meet the needs of these populations. SEPP staff is participating in discussions and program development in cooperation with the following offices in MASSDE (see Appendix A for specific activities): School and District Accountability and Assistance Literacy Curriculum and Instruction Secondary School Services Elementary School Services Student Assessment English Language Acquisition Program Quality Assurance Educator Policy, Preparation, and Licensure 63 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 5 Submitted February 1, 2010 In FFY 2008, MASSDE engaged in a number of improvement activities to support IEP Teams in making appropriate placement decisions so that students with disabilities are educated in the LRE. The following improvement activities had a direct effect on Indicator 5. Inclusive Schools Week™ highlights and celebrates the progress our schools have made in providing a supportive and quality education to all students, particularly those who have disabilities and those from culturally and linguistically diverse backgrounds. It also provides an important opportunity for educators, students, and parents to discuss what else needs to be done in order to ensure that their schools continue to improve their ability to successfully educate all students and youth. To promote awareness of this initiative, MASSDE encourages districts to highlight the accomplishments of students, families, school personnel, and community members in promoting inclusive education for all students. The following additional FFY 2008 improvement activities directly affect LRE and other indicator areas (see Appendix A): Through the Comprehensive System of Personnel Development (CSPD) Training Project, MASSDE offers online training modules and face-to-face training to Massachusetts educators in a variety of topics. There are three training modules that provide content designed to provide resources to help educators and IEP Teams make appropriate placement decisions and to facilitate student inclusion: The Massachusetts IEP Process, A Principal's Role and Special Education in Massachusetts, Is Special Education the Right Service?, and The Massachusetts Transition Planning Chart and Effective Transition Planning. The Massachusetts FOCUS Academy (MFA) provides online, graduate level coursework to middle and high school educators across the state. Of the content areas offered in FFY 2008, universal design in learning (UDL) will have the greatest affect on Indicator 5. The courses help educators gain a better understanding of how disability affects student learning and provides them with improved skills in the areas of curriculum design, instruction, and assistive technology. This knowledge and skill-base better enable educators to address individual student needs in the LRE. In partnership with the Central Massachusetts Communities of Care (CMCC) Positive Behavioral Interventions (PBIS) Grant, MASSDE provided grant funds to support districts in Worcester County with developing and implementing Positive Behavioral Interventions and Supports (PBIS), and with developing “wrap-around” mental health services and supports. One of the priorities of the school district-CMCC partnership is to provide professional development and onsite assistance for PBIS. By increasing the use of PBIS, students with mental health concerns are more likely to receive the supports needed to participate in less restrictive environments. Special Education Professional Development Summer Institutes were sponsored by the MASSDE in partnership with school districts, educational collaboratives, institutions of higher education, and professional associations. The Institutes that directly affect Indicator 5 are designed to support districts’ efforts to ensure students are educated in the most appropriate, least restrictive environment for their educational needs. Courses included in the FFY 2008 Summer Institutes were: Managing Behavior in an Inclusive Classroom; Occupational Therapy Services in Educational Settings; Strategies for Students with Sensory Integration Dysfunction in an Inclusive Classroom; Sustaining Braille Proficiency of Licensed Teachers of Students with Visual Impairments; Topics in Teaching Literacy to Students who are Deaf of Hard-of-Hearing; Mathematics and/or Science and Technology; American Sign Language (ASL) and Other Signed Systems; and Special Education Professional Development Seminar for Educators of Students who are Deaf or Hard-of-Hearing. The Special Education Leadership Academies and Seminars for special education administrators offered activities focused on instructional program design and improvement and access to the general education curriculum based on the Massachusetts Curriculum Frameworks. 64 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 5 Submitted February 1, 2010 In order to facilitate students’ with disabilities access to the general education curriculum in the LRE, MASSDE funded the Secondary School Reading Grant. Approaches in the grant program include involvement and training for all professional and paraprofessional staff, reading across content areas, multiple targeted intervention programs for struggling readers, adequate time for reading instruction, assessment that drives instruction, a variety of flexible grouping patterns, and leadership structures that provide ongoing support and guidance. Collaboration between MASSDE Curriculum and Instruction Mathematics Office and Special Education Planning and Policy Development Office (SEPP) was initiated in FFY 2008. The MA Urban Math Liaisons network (math directors who provide guidance and support around mathematics in Massachusetts public schools) identified the need to better support students with disabilities in mathematics as a critical priority in the urban districts. In response to this need, this year the Math Specialist Support meetings will be dedicated to developing a district level collaboration between special educators and mathematics specialists. This will directly affect the participation of students with disabilities in the LRE. MASSDE has a longstanding Collaboration with Federation for Children with Special Needs (FCSN), which is the Parent Training and Information Center that is federally funded to provide free information, support, technical assistance and workshops to Massachusetts families who have children with disabilities. This year topics that relate to LRE included: Transition from Early Intervention to Special Education, Parent’s Rights, IEPs, and Understanding My Child’s Learning Style. The Community/Residential Education Project was developed through an interagency agreement between MASSDE and the Massachusetts Department of Developmental Services (MDDS). This project supports less restrictive, more cost effective residential options, special education services, and community based supports. The District and School Accountability and Assistance Office within the MASSDE’s Center for School and District Accountability reviews districts, with emphasis on how district systems and practices affect each of four groups of students: students with disabilities, English language learners, low-income students, and students who are members of racial minorities. District and School Assistance Centers (DSACs) – MASSDE has opened six regionally based DSACs to help identified districts and their schools strategically access and use professional development and targeted assistance to improve instruction and raise achievement for all students. MFA courses (see above) have been integrated into the menu of professional development options available to districts. The Inclusive Concurrent Enrollment Partnership Programs for Students with Disabilities (ICE) provides funding to establish and sustain partnerships between Massachusetts public high schools and public institutions of higher education to support students with severe disabilities, ages 18-22, who have not been able to earn a competency determination and do not have typical high school prerequisites, to enroll in post-secondary credit and non-credit classes with their nondisabled peers. The revision of the “Ten Step Guide for Comprehensive Educational Assessment of Students with Visual Impairments” is in process and will include a new section describing the “hidden” characteristics of a vision loss that affect academic and social factors. Understanding these characteristics will enable non-vision specialists to facilitate meaningful inclusion and participation of students with visual impairments throughout the school day. The purpose of the Sign Language Video Resource Library project is to develop mathematics and science/technology vocabulary reference tools that educational interpreters and teachers of students who are deaf or hard-of-hearing may incorporate into their instruction. This will support the education of students in the LRE. 65 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 5 Submitted February 1, 2010 The Special Education Program Improvement Grants - Fund Code 249 offers funding to approved private special education schools for professional development activities that help improve the capacity of educators to meet the diverse needs of students with disabilities. Topics for professional development under the three priority areas for the FFY 2008 grant included a) Educator Quality and Effectiveness: Induction, Mentoring, and Retention; b) Supporting Schools and Students: Curriculum Development, Instructional Practices, and Classroom Assessment; and c) College and Career Readiness: Secondary Transition Planning. The three priorities will enable educators to provide quality instruction and responsive learning environments, thus allowing students with disabilities to access more inclusive environments. The Special Education Program Improvement Grants – Fund Code 274 offered to every LEA in 2008 included: Serving Students with Autism Spectrum Disorders in Inclusive Settings; Curriculum Development, Assessment, and Instruction; and Meeting the Behavioral and Social Needs of a Diverse Student Population. The goal of these grant priorities was to increase the skills and capacity of educators to meet the diverse needs of students with disabilities within the LRE. Districts were able to use funds provided through this grant to provide ongoing professional development to general and special educators. The following activities focused on promoting inclusive practices and contributed to the state’s continued success in meeting its target for Indicator 5: American Recovery and Reinvestment Act: Saving and Creating Jobs and Reforming Education (ARRA) – IDEA Collaboration with Stakeholders National Association of State Directors of Special Education (NASDSE) Satellite Series More information about these initiatives is available in Appendix A. MASSDE has continued to report school age LRE data publicly. This information, which is currently being updated, is available at http://profiles.doe.mass.edu/state_report/special_ed.aspx MASSDE will continue to focus its efforts on improving outcomes for students with IEPs, and looks forward to reporting the results of these efforts in the FFY 2009 APR. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): The Part B State Performance Plan (SPP) and Annual Performance Report (APR) have been amended to reflect the changed requirements for Indicator 5 and its measurement. MASSDE has revised improvement activities to in the SPP to include updated activities and revised activity titles. See the MA SPP for changes. 66 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 6 Revised February 1, 2010 Indicator 6: Preschool LRE SPP Monitoring Priority: FAPE in the LRE Indicator 6: Percent of children aged 3 through 5 with IEPs attending a: A. Regular early childhood program and receiving the majority of special education and related services in the regular early childhood program; and B. Separate special education class, separate school or residential facility. (20 U.S.C. 1416(a)(3)(A)) Measurement: A. Percent = [(# of children aged 3 through 5 with IEPs attending a regular early childhood program and receiving the majority of special education and related services in the regular early childhood program) divided by the (total # of children aged 3 through 5 with IEPs)] times 100. B. Percent = [(# of children aged 3 through 5 with IEPs attending a separate special education class, separate school or residential facility) divided by the (total # of children aged 3 through 5 with IEPs)] times 100. Overview of Issue/Description of System or Process: There are two different methods in which MASSDE has collected data to determine the placement of students with disabilities at the preschool level. The first method is collected by the Massachusetts Department of Early Education and Care (MEEC) through the Fund Code 262 Early Childhood Special Education Allocation grant. The second collection method is based on the MASSDE Student Information Management System (SIMS) data collection system. The 618 data provided to the USDOE comes from the second method, the SIMS data collection, and is used here in the provision of baseline data. Baseline Data for FFY 2004 (2004-2005): Total # of preschool students with IEPs 13,384 Total # of preschool students with IEPs in inclusive settings 10,498 Percent of preschool students with IEPs in inclusive settings 78.4% Discussion of Baseline Data: In considering the baseline data, we additionally reviewed the data collected through the Early Childhood Special Education Allocation grant. The grant application includes a statistical information gathering section. Recipients are asked to identify the number of preschool-aged students in the community with IEPs, the number of students who received special education services (not only in the context of a preschool program) for either less than five hours of special education services per week or more than five hours of special education services per week, the number of students who participated in a program in a substantially separate setting, and the number of students who participated in inclusive program. The following is information provided by the 2004-05 Early Childhood Special Education Allocation grant: Data is for 246 out of a potential 273 grants (90%). 13,971 preschool students have an IEP. 67 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 6 Revised February 1, 2010 13,205 (95%) of the students with IEPs are being served in an inclusive setting. Of the students being served in an inclusive setting: o 462 (3%) are being served in a Head Start program. o 745 (6%) are being served in a child care center. o 315 (2%) are being served in a family child care. o 9410 (71%) are being served in a public school preschool. o 3,231 of the 13, 205 (24%) students are being served in inclusive settings are receiving related services only for less than 5 hours per week. The data from the MEEC collection provided above differs from the data collected from the MASSDE SIMS collection. Future activities in this area would include aligning the systems of the two departments to gather information in a consistent manner such that the comparison does not raise questions – as this comparison currently does. The data collected by the Early Childhood Special Education Allocation Grant indicates that 95% of preschool students with disabilities are being served in inclusive settings and identifies the types of inclusive settings in which they are served. The data collected through SIMS indicates that in the 2004-05 school year, 70.1% of preschool students with disabilities were served in inclusive settings, and 8.3% of students were served in partial inclusion settings, for a total of 78.4%. The below targets were set based on the baseline data of 78.4%, which is the percentage students with disabilities that spend the majority of their day receiving special education and related services in settings with typically developing peers, and acquired through the MASSDE SIMS data. The Massachusetts Steering Committee unanimously recommended that our initial target setting be modest in order to allow our interest groups to more deeply review the data and consider local performance as well as state performance to effectively identify appropriate improvement for this performance indicator, and therefore the following targets have been set for this first six-year period. Additionally, the targets were chosen to allow time for early childhood programs to implement effective inclusive practices. FFY Measurable and Rigorous Target 2005 (2005-2006) 78.4% 2006 (2006-2007) 79% 2007 (2007-2008) 79% 2008 (2008-2009) 80% 2009 (2009-2010) 80% 2010 (2010-2011) 81% 68 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 6 Revised February 1, 2010 Improvement Activities/Timelines/Resources: Please note that many of the activities presented below impact across multiple indicator areas. For these activities, a full description of the activity is available in Appendix A. Timelines (FFY) 2005 - 2006 Improvement Activity Emergent Literacy Grant (Additional Indicators Impacted: 3, 5) Resources MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) MASSDE staff time, MEEC staff time See Appendix A for a complete description. 2005 - 2010 Special Education Website (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Summer Institutes (Additional Indicators Impacted: 1, 3, 4, 5, 8, 11, 13, 14) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 National Association of State Directors of Special Education (NASDSE) Satellite Series (Additional Indicators Impacted: 3, 5, 13, 14) MASSDE staff time See Appendix A for a complete description. 2006 - 2007 Revisions to SIMS Data Collection MASSDE staff time, MEEC staff time MASSDE and MEEC will review and revise SIMS data collection and forms to more accurately collect data on preschool placements, including creating standard definitions for preschool settings and codes to meet new OSEP requirements. 2006 - 2010 Training and Technical Assistance to LEAs MASSDE and MEEC will provide on-going training and technical assistance to districts on data reporting requirements and on how to communicate with families and communities in order to develop a cohesive service delivery model for preschoolers with disabilities. 69 MASSDE staff time, MEEC staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 6 Timelines (FFY) 2008 Improvement Activity Revision of “Ten Step Guide for Comprehensive Educational Assessment of Students with Visual Impairments” (Additional Indicators Impacted: 3, 5) Revised February 1, 2010 Resources MASSDE staff time, stakeholder groups See Appendix A for a complete description. 2008 - 2009 Assessment Institute MASSDE staff time, MEEC staff time, LEA staff time Districts along with community-based providers will be invited to participate in an assessment institute that will focus on on-going, formative assessment of young children, including students with disabilities and how programs can use assessment data to guide program improvement and instructional practices. 2008 - 2009 Data Analysis and Verification Visits MASSDE staff time, MEEC staff time MASSDE and MEEC will analyze data on preschool environments and will conduct site visits to a sample of districts that report lower than targeted inclusion rates to further determine why preschool students with IEPs are place in certain educational environments. Visits will also include verification that districts are collecting and reporting data accurately. 2008 - 2009 Statewide Birth-Five Leadership Team MASSDE staff time, MEEC staff time MEEC will participate in a SpecialQuest grant designed to develop a Statewide Birth-Five Leadership Team to improve the inclusive opportunities for students with disabilities birth to five. 2008 - 2009 Revision of “Is Special Education the Right Service?” (ISERS) (Additional Indicators Impacted: 3, 5) MASSDE staff time, stakeholder groups See Appendix A for a complete description. 2008 - 2010 SPecial EDition Online Newsletter (Additional Indicators Impacted: 1-5, 7-14) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Massachusetts Online Resource Library (Additional Indicators Impacted: 1, 2, 3, 4, 5, 8, 13, 14) See Appendix A for a complete description. 70 MASSDE staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 6 Timelines (FFY) 2008 - 2010 Improvement Activity PreK-Grade 3 Curriculum, Instruction and Assessment Alignment Pilot Project Through this project, MASSDE and MEEC will work closely with 18 LEAs on service delivery models, differentiated instruction, developmentally appropriate practice, and continuity through the early grades. 71 Revised February 1, 2010 Resources MASSDE staff time, MEEC staff time, LEA staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 6 Submitted February 1, 2010 Indicator 6 – Annual Performance Report for FFY 2008 APR Note: States are not required to report on Indicator 6 in the FFY 2008 Annual Performance Report. MASSDE has amended the Part B State Performance Plan (MA SPP) for Indicator 6 to reflect the new indicator and measurement. Pursuant to OSEP’s instructions, in the FFY 2009 submission, due February 1, 2011, MASSDE will establish a new baseline, targets, and, as needed, improvement activities for this indicator using the 2009-2010 data. 72 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 Revised February 1, 2010 Indicator 7: Preschool Outcomes SPP Monitoring Priority: FAPE in the LRE Indicator 7: Percent of preschool children aged 3 through 5 with IEPs who demonstrate improved: A. Positive social-emotional skills (including social relationships); B. Acquisition and use of knowledge and skills (including early language/ communication and early literacy); and C. Use of appropriate behaviors to meet their needs. (20 U.S.C. 1416 (a)(3)(A)) Measurement: Outcomes: A. Positive social-emotional skills (including social relationships): B. Acquisition and use of knowledge and skills (including early language/communication and early literacy); and C. Use of appropriate behaviors to meet their needs. Progress categories for A, B and C: a. Percent of preschool children who did not improve functioning = [(# of preschool children who did not improve functioning) divided by the (# of preschool children with IEPs assessed)] times 100. b. Percent of preschool children who improved functioning but not sufficient to move nearer to functioning comparable to same-aged peers = [(# of preschool children who improved functioning but not sufficient to move nearer to functioning comparable to same-aged peers) divided by the (# of preschool children with IEPs assessed)] times 100. c. Percent of preschool children who improved functioning to a level nearer to same-aged peers but did not reach it = [(# of preschool children who improved functioning to a level nearer to same-aged peers but did not reach it) divided by the (# of preschool children with IEPs assessed)] times 100. d. Percent of preschool children who improved functioning to reach a level comparable to same-aged peers = [(# of preschool children who improved functioning to reach a level comparable to same-aged peers) divided by the (# of preschool children with IEPs assessed)] times 100. e. Percent of preschool children who maintained functioning at a level comparable to same-aged peers = [(# of preschool children who maintained functioning at a level comparable to same-aged peers) divided by the (# of preschool children with IEPs assessed)] times 100. 73 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 Revised February 1, 2010 Summary Statements for Each of the Three Outcomes (use for FFY 2008-2009 reporting): Summary Statement 1: Of those preschool children who entered the preschool program below age expectation in each Outcome, the percent who substantially increased their rate of growth by the time they turned 6 years of age or exited the program. Measurement for Summary Statement 1: Percent = # of preschool children reported in progress category (c) plus # of preschool children reported in category (d) divided by [# of preschool children reported in progress category (a) plus # of preschool children reported in progress category (b) plus # of preschool children reported in progress category (c) plus # of preschool children reported in progress category (d)] times 100. Summary Statement 2: The percent of preschool children who were functioning within age expectations in each Outcome by the time they turned 6 years of age or exited the program. Measurement for Summary Statement 2: Percent = # of preschool children reported in progress category (d) plus [# of preschool children reported in progress category (e) divided by the total # of preschool children reported in progress categories (a) + (b) + (c) + (d) + (e)] times 100. Overview of Issue/Description of System or Process: The Massachusetts Department of Early Education and Care (MEEC) and MASSDE collaboratively selected a cohort model for the purposes of this indicator’s activities. In Cycle I Year 1, 74 districts participated. In Year 2, 69 districts participated, and an additional 117 districts participated in Year 3. In Cycle II (Year 1 (FFY 2009)), 72 districts participated. The 387 LEAs were divided into four cohorts that are representative of the state as a whole. This cohort model plan for data collection was approved by OSEP. Over a three-year period, every district in the state with preschool-aged students will have started the data collection activities for this indicator. Because it has an average daily membership of over 50,000 students, Boston participates in all activities every year. Further information on the cohort model can be found at http://www.doe.mass.edu/sped/2006/0522idea.html. Data collection and reporting for the participating districts will continue for approximately three years until all the students who were originally assessed at baseline have exited from or terminated early childhood special education services. Once all the children from the local cohort have exited from early childhood special education, the districts will participate in the Cycle II data collection efforts with a new cohort of children. In each cohort year, the districts are trained by staff from the Early Childhood Outcomes (ECO) Center in collaboration with staff from MEEC and MASSDE on how to use the Child Outcomes Summary Form. In December 2006, districts reported entry data based on local observation and on formal and informal assessment information for a maximum of 40 preschool students with disabilities. In selecting students at the local level, priority was given to preschool students who initially started their early childhood special education services between July 1 and September 30, 2006. Districts in the Year 1 cohort (n=74) reported entry data for 1,651 preschool students with disabilities. 74 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 Revised February 1, 2010 Baseline Data Collection for FFY 2006 (2006-2007) – Year 1 Cohort Entry Data % AGE APPROPRIATE % NOT AGE APPROPRIATE A. Positive social-emotional skills (including social relationships) 20% 80% B. Acquisition and use of knowledge and skills (including early language/communication and early literacy) 21% 79% C. Use of appropriate behaviors to meet needs 33% 67% OUTCOME In the spring of 2007, MEEC and MASSDE trained the Year 1 cohort of districts to conduct progress assessments2. Districts reported assessment data in June 2007. MASSDE analyzed the data and extracted information on those students who exited early childhood special education prior to the submission of this report. The following table summarizes the exit data for the Year 1 cohort: Exit Data3 The categories in the table below are defined as follows: Progress category (a): The percent of preschool children who did not improve functioning. Progress category (b): The percent of preschool children who improved functioning but not sufficient to move nearer to functioning comparable to same-aged peers. Progress category (c): The percent of preschool children who improved functioning to a level nearer to same-aged peers but did not reach it. Progress category (d): The percent of preschool children who improved functioning to reach a level comparable to same-aged peers. Progress category (e): The percent of preschool children who maintained functioning at a level comparable to same-aged peers. OUTCOME A. Positive socialemotional skills (including social relationships) Progress category (a) Progress category (b) Progress category (c) Progress category (d) Progress category (e) No imp. Some imp. Near peers Comparable to peers Maintain 4% (27/724) 25% (183/724) 33% (242/724) 18% (129/724) 20% (143/724) 2 MASSDE and MEEC strongly believe that ongoing assessment of preschool children, including students with disabilities, is important in order for the assessment data to be used properly to inform instruction and improve service delivery for children in a timely and responsive way. For that reason, Massachusetts has designed its progress data collections to be conducted for all students on an annual basis, whether or not the child is officially terminating early childhood special education services. 3 Of the 1,651 students sampled in Year 1, 54% exited early childhood special education (i.e., moved out of the district, moved on to kindergarten, or met their IEP goals). The exit data are reflective of the preschool children who received at least 6 months of early childhood special education services between baseline and exit assessments. These preschool children represent nearly 93% of the exiting subset. MASSDE and MEEC have progress data, based on the same five reporting categories, for the remaining children who continue to receive early childhood special education services. 75 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 OUTCOME Revised February 1, 2010 Progress category (a) Progress category (b) Progress category (c) Progress category (d) Progress category (e) No imp. Some imp. Near peers Comparable to peers Maintain B. Acquisition and use of knowledge and skills (including early language/communication and early literacy) 4% (30/727) 25% (180/727) 32% (232/727) 19% (139/727) 20% (146/727) C. Use of appropriate behaviors to meet needs 4% (26/728) 18% (133/728) 29% (211/728) 17% (128/728) 32% (230/728) In the fall of 2007, MEEC and MASSDE trained its Year 2 cohort of districts (n=69) on the activities related to Indicator 7. The training followed the same format as that of the Year 1 cohort. The districts were trained on how to use the Child Outcomes Summary Form by staff from the two agencies. Districts reported entry data based on local observation and on formal and informal assessment information for a maximum of 40 preschool students with disabilities. In selecting students at the local level, priority was given to preschool students who initially started their early childhood special education services between July 1 and September 30, 2007. Districts in the Year 2 cohort reported entry data for 1,624 preschool students with disabilities. Baseline Data Collection for FFY 2007 (2007-2008) – Year 2 Cohort Entry Data % AGE APPROPRIATE % NOT AGE APPROPRIATE A. Positive social-emotional skills (including social relationships) 20% 80% B. Acquisition and use of knowledge and skills (including early language/communication and early literacy) 21% 79% C. Use of appropriate behaviors to meet needs 32% 68% OUTCOME Exit Data4 The categories in the table on the following page are defined as follows: Progress category (a): The preschool percent of children who did not improve functioning. Progress category (b): The percent of preschool children who improved functioning but not sufficient to move nearer to functioning comparable to same-aged peers. Progress category (c): The percent of preschool children who improved functioning to a level nearer to same-aged peers but did not reach it. 4 Of the 2,758 preschool students sampled in Year 1 and Year 2, 42% exited early childhood special education (i.e., moved out of the district, moved on to kindergarten, or met their IEP goals) during FFY 2007. The exit data are reflective of the children who received at least 6 months of early childhood special education services between baseline and exit assessments. MASSDE and MEEC have progress data, based on the same five reporting categories, for the remaining children who continue to receive early childhood special education services. 76 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 Revised February 1, 2010 Progress category (d): The percent of preschool children who improved functioning to reach a level comparable to same-aged peers. Progress category (e): The percent of preschool children who maintained functioning at a level comparable to same-aged peers. 77 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 OUTCOME Revised February 1, 2010 Progress category (a) Progress category (b) Progress category (c) Progress category (d) Progress category (e) No imp. Some imp. Near peers Comparable to peers Maintain A. Positive socialemotional skills (including social relationships) 1% (12/1169) 17% (199/1169) 33% (385/1169) 29% (339/1169) 20% (234/1169) B. Acquisition and use of knowledge and skills (including early language/communication and early literacy) 2% (23/1169) 17% (199/1169) 31% (362/1169) 27% (316/1169) 23% (269/1169) C. Use of appropriate behaviors to meet needs 1% (12/1169) 15% (175/1169) 23% (269/1169) 30% (351/1169) 31% (362/1169) In the fall of 2008, MEEC and MASSDE trained its Year 3 cohort of districts (n=117) on the activities related to Indicator 7. The training followed the same format as that of the Year 1and 2 cohorts. Staff from the two agencies trained the districts on how to use the Child Outcomes Summary Form. Districts reported entry data based on local observation, and formal and informal assessment information on a maximum of 40 preschool students with disabilities. In selecting students at the local level, priority was given to preschool students who initially started their early childhood special education services between July 1 and September 30, 2008. Districts in the Year 3 cohort reported entry data for 2,940 preschool students with disabilities. Baseline Data Collection for FFY 2008 (2008-2009) Entry Data % AGE APPROPRIATE % NOT AGE APPROPRIATE A. Positive social-emotional skills (including social relationships) 22% (647/2940) 78% (2293/2940) B. Acquisition and use of knowledge and skills (including early language/communication and early literacy) 25% (735/2940) 75% (2205/2940) C. Use of appropriate behaviors to meet needs 33% (970/2940) 67% (1970/2940) OUTCOME 78 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 Revised February 1, 2010 Exit Data5 The categories in the table on the following page are defined as follows: Progress category (a): The percent of preschool children who did not improve functioning. Progress category (b): The percent of preschool children who improved functioning but not sufficient to move nearer to functioning comparable to same-aged peers. Progress category (c): The percent of preschool children who improved functioning to a level nearer to same-aged peers but did not reach it. Progress category (d): The percent of preschool children who improved functioning to reach a level comparable to same-aged peers. Progress category (e): The percent of preschool children who maintained functioning at a level comparable to same-aged peers. Progress category (a) Progress category (b) Progress category (c) Progress category (d) Progress category (e) No imp. Some imp. Near peers Comparable to peers Maintain A. Positive socialemotional skills (including social relationships) 2% (32/1798) 23% (423/1798) 24% (425/1798) 25% (457/1798) 26% (461/1798) B. Acquisition and use of knowledge and skills and (including early language/communication and early literacy) 2% (32/1700) 21% (407/1800) 23% (399/1800) 26% (453/1800) 28% (509/1800) C. Use of appropriate behaviors to meet needs 2% (25/1700) 18% (298/1700) 17% (311/1700) 26% (439/1700) 37% (627/1700) OUTCOME In the fall of 2009, MASSDE and MEEC began the second cycle of data collection for Indicator 7. Seventy-two districts that participated in prior cohorts were notified that they would participate in data collection activities for a second time. MASSDE and MEEC initiated conference calls with participating districts to revisit the required data collection activities, and to provide new district staff with the foundational understanding of measuring outcomes in preschool children with disabilities necessary. These efforts will assist with ensuring the reporting of valid and reliable data. Districts in the Cycle II – Year 1 cohort reported entry data on 1,362 preschool children with disabilities. Baseline Data Collection for FFY 2009 (2009-2010) Entry Data OUTCOME A. Positive social-emotional skills (including social relationships) 5 % AGE APPROPRIATE % NOT AGE APPROPRIATE 17% 83% Of the 4,584 students sampled in Years 1 and 2, 40% exited early childhood special education (i.e., moved out of the district, moved on to kindergarten or met their IEP goals) during FFY 2008. The exit data are reflective of the children, who received at least 6 months of early childhood special education services between baseline and exit assessments. MASSDE and MEEC have progress data, based on the same five reporting categories, for the remaining children who continue to receive early childhood special education services. 79 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 Revised February 1, 2010 B. Acquisition and use of knowledge and skills (including early language/communication and early literacy) 19% 81% C. Use of appropriate behaviors to meet needs 30% 70% Discussion of Baseline Data for FFY 2006 – FFY 2008: Entry Data The data reported at entry between Cycle I - Year 1 cohort districts and Cycle I - Year 2 cohort districts are consistent, with the exception of the third outcome (C): Use of appropriate behaviors to meet needs. In this outcome, the percentages changed by 1%. That data reported by the Cycle II - Year 3 cohort again mirrors that of the Cycle I cohorts. The percentage points between the outcomes across Cycle I range from 0-4%. With the submission of Cycle II – Year I data, the analysis continues to demonstrate consistency across the years. MASSDE and MEEC consider the duplication of the entry data across the three years as confirmation of the success of the cohort model and the within-district sampling model in producing valid and reliable data each year for a representative sample of preschool students with disabilities. Exit Data Given the commitment of the two agencies to make the assessment data useful to the local agencies, MASSDE collected progress assessment data on the entire Year 1, Year 2, and Year 3 cohorts of children in the spring of 2009. For the purposes of the MA SPP, only data for those children who exited early childhood special education and had at least 6 months of early childhood special education services between entry and exit assessments are reported in this SPP. Cycle I – Year 2 data reveal a shift from OSEP Progress category (a) (the percent of children who did not improve functioning) and Progress category (b) (the percent of children who did improve functioning but not sufficient to move closer to functioning comparable to same-aged peers) to Progress categories (c) (the percent of children who improved functioning to a level nearer to same-aged peers but did not reach it), (d) (the percent of children who improved functioning to reach a level comparable to same-aged peers), and (e) (the percent of children who maintained functioning at a level comparable to same-aged peers). We believe that this is a result of children having received early childhood special education services for a longer period of time between entry and exit assessments. There are shifts in data between the year 2 and year 3 collections where the percentages of children in OSEP Progress categories (b) and (c) are higher than those children in OSEP Progress categories (d) and (e). In cases where percentages of OSEP Progress categories (b) and (c) increased between year 2 and 3 data, our analysis indicates that this may be the result of bringing two cohorts of districts into year 3 activities; thus, generating data for many more children that may have only had 6 months of services between entry and exit assessments. While data in the Year 3 cohort reveal a shift in OSEP Progress categories (b), (c), (d), and (e), in general, the percentages of children who made some progress [Progress categories (b) + (c)] and those that made significant progress and/or exited demonstrating age appropriate skills and behaviors [Progress categories (d) + (e)] are fairly consistent. The consistency in these categories is believed to be a result of having significant numbers of children from our Year 1 and Year 2 cohorts who received early childhood special education services for a longer period of time between entry and exit. MEEC, in collaboration with MASSDE, randomly sampled from the Year 1 and Year 2 cohorts 15% of those preschool children with disabilities who exited early childhood special education to ensure appropriate use of the Child Outcomes Summary Form (COSF) and accuracy of data reporting to MASSDE. MEEC notified 94 districts of their selection to provide randomly selected COSFs for 246 80 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 Revised February 1, 2010 children who exited their preschool program between June 2008 and August 2008. At the time of this writing, 72 districts have responded to this notice and have submitted 163 records for review. Agency review of the COSFs has yielded information to be used in future training for LEAs on Indicator 7. For example, MEEC will remind school districts about the need to include detailed information in the COSF, to access and refer to multiple sources of data to obtain complete and accurate information, and the importance of parent involvement in the process of data collection. MEEC, in collaboration with MASSDE, will conduct an additional review of at least 10% of the COSFs for children who exited early childhood special education between June 2009 and August 2009, prior to spring 2010 LEA training. The agencies anticipate that the results of these reviews and the refinement of training topics will increase the effectiveness of upcoming trainings of LEAs on Indicator 7 and related data collections. Discussion of Baseline and Measurable and Rigorous Targets MASSDE has established what may be perceived to be conservative targets for FFY 2009 and FFY 2010. This has to do, in part, with the cohort model used and the method of sampling within local school districts. As discussed above, in this selected cohort model school districts with more than 40 preschool children with disabilities identify from their population 40 children to be included in the local cohort. Districts with fewer than 40 children must report entry and progress/exit data on all preschool children with disabilities who receive services in the year in which the school district participates in the data collection activities. This model provides MEEC and MASSDE with a representative sample of data on preschool children with disabilities each year; and it also results in data for age diversity within the population of children represented in the selected cohort. While districts that sample must prioritize children who are as close to age 3 or entry to early childhood special education, many children in the cohort are 4, and others whose birthdays fall later than the locally established cut-off date for kindergarten enrollment age are 5 years old. As a result, the period of time children receive services prior to exit may be from 6 months to nearly 3 years. This variance in ages and duration of services is accounted for in the data collection and in the established targets. One identified improvement activity is to review entry, progress, and exit data for children of various ages. Absent this data analysis, MASSDE has determined that conservative targets in this shortened SPP period are appropriate until the impact of age on the Indicator 7 results is known. In establishing these targets, MASSDE considered the results of its review of data for children who exited early childhood special education in 2008. In this review process, MEEC and MASSDE identified the need to continue to reinforce for school districts the principles behind Indicator 7, namely, having a clear understanding of age expected skills and behaviors for each of the outcome areas; involving parents in the discussion of the assessment information; using multiple data sources to understand the consistency of skills and behaviors across settings; and the critical need for clear administrative record-keeping by school districts. MASSDE recognizes the need for improvements in the data collection process, and this is the focus of the second improvement activity listed below. In the spring and the fall of 2010, MASSDE, in collaboration with MEEC, will conduct training on progress/exit data collection activities and entry data collection activities. Results of the continued supplemental data review of COSFs will inform future trainings. MASSDE will also alert school districts to the schedule of the random supplemental file review. All of these efforts will help MASSDE ensure the validity and reliability of data submitted by school districts. MASSDE will be focusing its efforts during this short SPP period on conducting more in-depth analysis of the data. Agency staff participated in the one-day Indicator 7 training prior to the 2009 OSEP Early Childhood Leadership Conference. With the learnings from this training and the use of new tools for high quality data analysis designed by the Early Childhood Outcomes Center, MASSDE intends to analyze the data using additional data variables. For example, MASSDE will conduct more analyses on the entry and exit data sets using differences across variables including disability category, educational setting, and intensity of services. In collaboration with MEEC, MASSDE is planning to review the data in light of other demographic variables that can be linked with the Student Information Management System (SIMS), such as gender, ethnicity, income, and English language learner status. Another possible area of study is examining data in the context of children’s growth and progress over a period of time. Because of the unique model of collecting data for Indicator 7 using multiple data points (entry, progress, exit), MASSDE has the opportunity to consider the growth that young children with disabilities make over a year, two 81 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 Revised February 1, 2010 years, and/or three years, and how those data can be used to enhance the child’s development and inform service delivery and program quality. These more in-depth analyses will provide MASSDE with important information that will be used to determine how best to progress with target setting in the next SPP cycle. MASSDE looks forward to working with MEEC and local school districts to further develop data analysis under Indicator 7 to understand better the extent to which preschool children with disabilities make progress in early childhood special education programs and to use that information to inform programs and services. FFY Measurable and Rigorous Target 2006 (2006-2007) N/A 2007 (2007-2008) N/A 2008 (2008-2009) Baseline 2009 (2009-2010) 2010 (2010-2011) Outcome A Outcome B Summary Statement 1 66% Summary Statement 2 51% Summary Statement 1 Summary Statement 2 Outcome A Outcome B Outcome C Summary Statement 1 67% Summary Statement 2 51.5% Summary Statement 1 65.5% Summary Statement 2 53.5% Summary Statement 1 Summary Statement 2 Outcome A Outcome B Outcome C Summary Statement 1 Summary Statement 2 67% 52% Summary Statement 1 Summary Statement 2 Outcome C 65% 53% 66% 54% Summary Statement 1 Summary Statement 2 Summary Statement 1 Summary Statement 2 Improvement Activities/Timelines/Resources: Timelines (FFY) 2005 - 2010 Improvement Activity Collaboration with Stakeholders (Impacts All Indicators) Resources MASSDE staff time, MEEC staff time See Appendix A for a complete description. 2006 - 2010 Training on Data Collection Activities Districts in each cohort will receive training on data collection activities related to entry and progress/exit data for Indicator 7, as well as on the use of the Child Outcomes Summary Form. 82 MASSDE staff time, MEEC staff time, LEA staff time 68% 62% 68.25% 62.25% 68.5% 62.5% Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 7 Timelines (FFY) 2006 - 2010 Improvement Activity Technical Assistance and Support Revised February 1, 2010 Resources MASSDE staff time, MEEC staff time, LEA staff time Districts in each cohort will receive ongoing technical assistance and support related to entry and progress/exit data collection activities. 2009-2010 Assessment Institute MEEC staff time, LEA staff time Districts along with community-based providers will be invited to participate in an assessment institute that will focus on ongoing, formative assessment of young children, including children with disabilities and how programs can use assessment data to guide program improvement and instructional practices. 2009-2010 Data Analysis – Introduction of Variables MASSDE, with MEEC, will review and refine data analysis with special emphasis on conducting additional analyses on the entry and exit data sets using differences across variables (e.g., disability category, educational setting, and intensity of services); using additional demographic variables (e.g., gender, ethnicity, income, and English language learner status); and/or examining data in the context of children’s growth and progress over a period of time. 83 MASSDE staff time, MEEC staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 7 Submitted February 1, 2010 Indicator 7 – Annual Performance Report for FFY 2008 APR Note: States are not required to report on Indicator 7 in the FFY 2008 Annual Performance Report. MASSDE has established a new baseline and targets for Indicator 7, and has reported them in the State Performance Plan (MA SPP) for 2005-2010 submitted on February 1, 2010. Pursuant to OSEP’s instructions, MASSDE will submit the MA APR for Indicator 7 in the FFY 2009 submission, due February 1, 2011. . 84 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 8 Revised February 1, 2010 Indicator 8: Parent Involvement SPP Monitoring Priority: FAPE in the LRE Indicator 8: Percent of parents with a child receiving special education services who report that schools facilitated parent involvement as a means of improving services and results for children with disabilities. (20 U.S.C. 1416(a)(3)(A)) Measurement: Percent = [(# of respondent parents who report schools facilitated parent involvement as a means of improving services and results for children with disabilities) divided by the (total # of respondent parents of children with disabilities)] times 100. Overview of Issue/Description of System or Process: In order to collect data for this indicator, MASSDE selected the Part B Parent Survey – Special Education, created by the National Center for Special Education Accountability Monitoring (NCSEAM) as its survey tool. In its development, the survey items proved to be statistically valid with high correlations across outcome areas. The NCSEAM survey was validated for students’ ages birth to three, and five to 21. MASSDE used the survey with parents of school age students. The first scale of the survey, containing 25 questions on “Schools’ Efforts to Partner with Parents”, was used. These survey items showed high correlation between schools’ efforts to partner with parents and the quality of services. Upon meeting with stakeholders and reviewing the survey questions, some items were changed (or “swapped”) for others. This was done in accordance with the rules set forth by NCSEAM for use of their “Item Bank” (See Appendix B for the Massachusetts Parent Survey for Special Education). Once the survey was finalized, three districts were solicited to pilot the process. During the pilot phase, the cover letter and survey were provided to parents in English only. The cover letter included a link to an online version of the English survey, if parents preferred to respond in that manner. The results from the survey pilot were deemed acceptable and were folded into the overall results from the “official” survey round in the fall. To ease the data collection activity burden for districts, MASSDE divided its 387 LEAs into four cohorts that are representative of the state as a whole, and will collect and report data on this indicator based on a four-year cycle (2005-2006 through 2008-2009). This cohort model and plan for data collection was approved by OSEP on April 20, 2006. Over a four-year period, every district in the state will have participated in the data collection activities for this indicator. Because it has an average daily membership of over 50,000 students, Boston participates in all activities every year. Further information on the cohort model can be found at: http://www.doe.mass.edu/sped/2006/0522idea.html. At least initially, MASSDE contracts with an external organization for all phases of the process. This includes: survey distribution, data collection/input/processing/cleaning, data analysis, producing a report based on the data at both the district and state levels, and returning the clean data files to MASSDE. We currently contract with ORC Macro and Ashton Associates as the provider of these services. For the full distribution of the survey in fall 2006, MASSDE issued the parent cover letter and survey in the two languages of highest prevalence in Massachusetts: Spanish and Portuguese. MASSDE contracted with JTG Inc. to provide these translations. Additionally, in the fall survey round, the online version of the survey was discontinued, as there was a very low response rate from the pilot districts in using this tool. As in the survey pilot, the fall mailing was done for all parents of students ages five and above (kindergarten and above) who currently receive special education services. 85 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 8 Revised February 1, 2010 Baseline Data for FFY 2005 (2005-2006): 76% of parents with a child receiving special education services reported that schools facilitated parent involvement as a means of improving services and results for students with disabilities Discussion of Baseline Data: In combining the pilot and fall survey rounds, parents in a total of 97 LEAs were surveyed. A total of 37,086 surveys were sent out across the three languages (English, Spanish, and Portuguese). A total of 6,076 surveys were returned across the three languages (English, Spanish, and Portuguese). This made for an overall return rate of 16.9% which is deemed sufficient to constitute a representative response for the state as a whole. The breakdown by language is as follows: English: 34,951 surveys were sent out and 5,966 were returned. Return rate: 17.1%. Spanish: 1,893 surveys were sent out and 99 were returned. Return rate: 5.2%. Portuguese: 242 surveys were sent out and 11 were returned. Return rate: 4.5%. To calculate our baseline data for 2005-2006, we conducted an item analysis of the 25 selected questions of the NCSEAM survey. We considered the responses of parents for each item where “very strongly agree,” “strongly agree,” or “agree” was the response. We determined that the measure at which MASSDE considered that the parent “felt that schools facilitated parent involvement as a means of improving services and results for students with disabilities” was with agreement to at least 50% of the survey items (13 of 25). For this baseline year, the level of agreement was reached by 75% of the parents who responded to the survey. Although all items are critically important to consider, our Massachusetts stakeholder group identified the three most important survey statements that stakeholders felt were most critical to the establishment of good parent partnership. The three items were the following (in order of importance): 1. My child’s teachers give me enough time and opportunities to discuss my child’s needs and progress (question #4 on our survey). 85% of all surveyed parents agreed with this item. 2. Teachers and administrators encourage me to participate in the decision-making process (question #16 on our survey). 80% of all surveyed parents agreed with this item. 3. Teachers are available to speak with me (question #11 on our survey). 89% of all surveyed parents agreed with this item. MASSDE believes that this high level of agreement with these three key statements is a very positive statement for parent partnership in Massachusetts. Additionally, more than half of all parents surveyed agreed with 21 of the 25 survey items. The MASSDE Steering Committee and the stakeholder group for this Indicator were unanimous in recommending modest targets as we introduce this survey to Massachusetts parents. 86 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 8 Revised February 1, 2010 FFY Measurable and Rigorous Target 2006 (2006-2007) 76% (of parents agree with more than half of the survey items) 2007 (2007-2008) 76% 2008 (2008-2009) 76% 2009 (2009-2010) 78% 2010 (2010-2011) 80% Improvement Activities/Timelines/Resources: Please note that some of the activities presented below impact across multiple indicator areas. For these activities, a full description of the activity is available in Appendix A. Timelines (FFY) 2005 - 2007 Improvement Activity Project FOCUS Academy (Additional Indicators Impacted: 1, 2, 3, 4, 5, 13, 14) See Appendix A for a complete description. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) Resources MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston, Education Development Center), LEA staff time MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Website (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Leadership Academies and Seminars (Additional Indicators Impacted: 3, 5, 11) See Appendix A for a complete description. 87 MASSDE staff time, LEA staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 8 Timelines (FFY) 2005 - 2010 Improvement Activity Special Education Summer Institutes (Additional Indicators Impacted: 1, 2, 3, 4, 5, 6, 11, 13, 14) Revised February 1, 2010 Resources MASSDE staff time, LEA staff time See Appendix A for a complete description. 2008 - 2010 Collaboration with Federation for Children with Special Needs (Additional Indicators Impacted: 3, 5,13) MASSDE staff time, FCSN staff time See Appendix A for complete description. 2006 - 2010 Technical Assistance to LEAs MASSDE staff time MASSDE will provide technical assistance to LEAs regarding survey results, including guidance documents and teleconference to assist districts in interpreting and utilizing their results. 2007 - 2010 Massachusetts FOCUS Academy (Additional Indicators Impacted: 1, 2, 3, 4, 5, 13, 14) See Appendix A for a complete description. 2008 National Center for Special Education Accountability Monitoring (NCSEAM) Training for LEAs MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston), LEA staff time MASSDE staff time, NCSEAM trainers MASSDE will host trainers from NCSEAM to provide technical assistance on the use of NCSEAM training modules to districts from across the state. 2007-2008 SPecial EDition Online Newsletter (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2007-2008 Massachusetts Online Resource Library (Additional Indicators Impacted: 1, 2, 3, 4, 5, 6, 13, 14) See Appendix A for a complete description. 88 MASSDE staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 8 Timelines (FFY) 2008 - 2010 Improvement Activity Curriculum, Instruction, and Assessment Summit (Additional Indicators Impacted: 1, 2, 3) See Appendix A for a complete description 89 Revised February 1, 2010 Resources MASSDE staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 8 Submitted February 1, 2010 Indicator 8 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 76% Actual Target Data for FFY 2008 (2008-2009): # of Surveys Issued # of Surveys Returned % of Surveys Returned # of Surveys Meeting Standard* % of Surveys Meeting Standard 41,192 7,190 17.5% 5,555 77.3% *The standard adopted to demonstrate “that schools facilitated parent involvement as a means of improving services and results for students with disabilities” requires the survey respondent to agree, strongly agree, or very strongly agree on at least 50% of the survey items (13 of 25). Massachusetts met its measurable and rigorous target for FFY 2008. Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 (2008-2009): Explanation of Progress or Slippage In order to collect data for this indicator, MASSDE uses the “School’s Efforts to Partner with Parents” scale from the Part B survey instrument developed by the National Center for Special Education Accountability Monitoring (NCSEAM). In FFY 2008, this 25-item survey was mailed to every parent of a student with an IEP in grades kindergarten and above in 98 districts across Massachusetts. See Appendix B for a copy of the Massachusetts Parent Involvement Survey. 90 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 8 Submitted February 1, 2010 In FFY 2008, 77.3% of parents reported that schools facilitated their involvement as a means of improving services and results for students with disabilities. As noted in the chart below, this is a slight decrease from the data reported in FFY 2007 (- 0.2 percentage points), although it is an increase from the data reported in FFY 2005 (+ 1.3 percentage points) and in FFY 2006 (+ 0.3 percentage points). MASSDE does not consider this slight decrease from FFY 2007 to be significant; Massachusetts again exceeded its measurable and rigorous target. MASSDE intends to continue working with districts and stakeholder groups to increase districts’ efforts to facilitate parent involvement as a means of improving services and results for students with disabilities. As a means of analyzing the survey results and targeted improvement activities, MASSDE stakeholder groups have identified the three survey statements that they believe are most crucial to the establishment of good parent partnerships. In order of importance, the FFY 2008 results are: 1. My child’s teachers give me enough time and opportunities to discuss my child’s needs and progress – 84%; 2. Teachers and administrators encourage me to participate in the decision-making process – 78%; and 3. Teachers are available to speak with me – 88%. Of the 41,192 surveys issued in three languages in FFY 2008 – English, Spanish, and Portuguese – the overall return rate was 17.5%. This is a higher return rate than in previous years (2.0 percentage points over FFY 2007; 0.9 percentage points over FFY 2006, and 0.5 percentage points over FFY 2005). Following are the return rates for the surveys issued in the different languages in FFY 2008: English: 37,571 sent and 6,870 returned. Return rate = 18.3%. Spanish: 3,170 sent and 297 returned. Return rate = 9.4%. Portuguese: 338 sent and 23 returned. Return rate = 6.8%. MASSDE collects data for Indicator 8 through a cohort model approved by OSEP. The 98 districts participating in the survey for FFY 2008 are representative of the state as a whole, and include one LEA (Boston) with an average daily membership of over 50,000 students; this district is included in each cohort. Information on the cohort model can be found at: http://www.doe.mass.edu/sped/spp/datacollection.html. Additional review of FFY 2008 respondent data by geography, race/ethnicity, and disability category indicates that these data are representative of the state as a whole. Improvement Activities MASSDE engaged in several improvement activities in FFY 2008 that were designed to improve survey return rates and results, and to enable educators to effectively facilitate parent involvement. Those activities are described below: Technical assistance teleconferences were held throughout the year by MASSDE with districts regarding participating districts’ survey results. Once the surveys are returned and the results are analyzed by MASSDE, MASSDE sends each district a detailed report providing its survey results. The reports include information on respondent demographics, survey results by demographic group, and item-by-item results. MASSDE provides guidance to assist districts in interpreting and using these results, and holds periodic teleconferences with districts to discuss potential strategies for disseminating survey results and identifying areas of improvement. MASSDE provides a variety of online resources for parents and educators. The “Parent’s Rights in Special Education” online module (http://www.doe.mass.edu/sped/training.html) gives districts and Parent Advisory Councils materials to use in leading annual workshops on the state and federal special education laws and regulations. In addition, the “Parent Information” section of the MASSDE special education website (http://www.doe.mass.edu/sped/parents.html) offers a variety of resources for parents and educators, including the “Parent’s Guide to Special Education.” This technical assistance document, which was written in collaboration with the 91 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 8 Submitted February 1, 2010 Federation for Children with Special Needs, the Massachusetts Parent Training and Information Center (PTI), continues to be used by parents and district personnel to provide information on the special education process to parents and schools. In addition to the improvement activities described above, MASSDE engaged in other improvement activities in FFY 2008 that addressed multiple indicator areas and had components that directly affected the ability of districts to facilitate parent involvement. Please note that only the components that directly relate to Indicator 8 are included below. For a more information about these activities, please see Appendix A. Through MASSDE’s federal State Personnel Development Grant – Massachusetts FOCUS Academy (MFA) – two online courses in the area of family involvement were developed during FFY 2008. These courses are designed to equip educators with the knowledge and skills required to develop and strengthen collaborative partnerships with families of middle and high school students with disabilities, in order to assist students to successfully transition to adult life. The first course was offered in the fall of 2008 and the second course will be offered in the spring of 2009. MASSDE has a long-standing Collaboration with the Federation for Children with Special Needs (FCSN), the federally-funded Parent Training and Information Center. This year’s jointly sponsored workshops for parents included sessions on Transition from Early Intervention to Special Education, Parent’s Rights, IEPs, The Massachusetts Comprehensive Assessment System (MCAS), Transition 101, and Understanding My Child’s Learning Style. Numerous intra-agency activities focused on parent involvement contributed to the state’s continued success in meeting its target for Indicator 8. The MASSDE Special Education Planning and Policy Development Office (SEPP) works to ensure students with disabilities and their parents receive positive results from the following improvement activities: American Recovery and Reinvestment Act: Saving and Creating Jobs and Reforming Education (ARRA) – IDEA Collaboration with Stakeholders Curriculum, Instruction and Assessment Summit Special Education Leadership Academies and Seminars Special Education Professional Development Institutes For detailed information about the activities listed above, please see Appendix A. MASSDE has continued to reporting publicly parent involvement data. During FFY 2008, MASSDE worked with stakeholder groups and staff from a number of school districts to determine the best way to report data for Indicator 8 at an LEA level. In order to meet the public reporting requirement, MASSDE added data for Indicator 8 to the “Special Education Results” web page that is a part of each district’s profile on the agency’s website. The information is available at http://profiles.doe.mass.edu/state_report/special_ed.aspx. From this table, viewers can select a specific district to access more detailed data. MASSDE will continue to focus its efforts on improving parent involvement for students with IEPs, and looks forward to reporting on the results of these efforts in the FFY 2009 APR. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): MASSDE has revised improvement activities in the MA State Performance Plan (MA SPP) for Indicator 8 to include updated activities and changes to activity titles. See the MA SPP for the revised activities including updated activity titles and timelines. 92 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 9 Revised February 1, 2010 Monitoring Priority: Disproportionality Indicator 9: Disproportionality – Child with a Disability SPP Monitoring Priority: Disproportionality Indicator 9: Percent of districts with disproportionate representation of racial and ethnic groups in special education and related services that is the result of inappropriate identification. (20 U.S.C. 1416(a)(3)(C)) Measurement: Percent = [(# of districts with disproportionate representation of racial and ethnic groups in special education and related services that is the result of inappropriate identification) divided by the (# of districts in the State)] times 100. State’s definition of “disproportionate representation”: Massachusetts defines “disproportionate representation” using a calculation of weighted or alternate risk ratio and a review of the appropriateness of a district’s policies and procedures for identifying students as disabled. MASSDE calculates a weighted or alternate risk ratio for each school district using the techniques described in detail in Westat’s “Methods for Assessing Racial/Ethnic Disproportionality in Special Education” (http://www.nichcy.org/training/B-resources.pdf). The state uses a minimum cell size of 20 for each race/ethnic group in every district. Cells less than 20 are individually reviewed to see if data irregularities for specific racial and ethnic groups in these districts would suggest disproportionate representation due to inappropriate identification. Once the calculation is made for each district, the weighted risk ratios are compared to the two previous years’ weighted risk ratios. Districts are flagged if for 3 consecutive years, they exhibit a weighted risk ratio of 3.0 or greater for possible over-representation, and of 25 or less for possible under-representation. All districts identified by way of this quantitative analysis are then subject to a review of the appropriateness of their policies, practices, and procedures (PPPs) for special education eligibility determination and disability identification. Description of determination that disproportionate representation is due to inappropriate identification: Any district identified using the measurement techniques described above submitted their current PPPs to MASSDE where they were reviewed by a committee of policy analysts and compliance specialists. If the committee concluded that the PPPs were inappropriate or otherwise inconsistent with federal and state regulations, and concluded that the PPPs likely caused the disproportionate representation at least to some degree, then a district was identified as having disproportionate representation due to inappropriate identification. Overview of Issue/Description of System or Process: Past monitoring for disproportionality through the CPR system: PQA has used Coordinated Program Reviews (CPRs) to monitor for disproportionality in the representation of racial/ethnic minority students in special education since at least 1998. Originally, this monitoring was done through interview questions and the examination of lists of special education students provided by the district or charter school, with race and ethnicity (as well as gender and linguistic minority status) designated. Gradually, MASSDE has developed a more data-oriented approach. In 2004, for the first time, the MASSDE Data Collection, Processing, and Reporting unit developed the ability to use student-level data collected through Student Information Management System (SIMS) to report on disproportionality on a number of bases (including race/ethnicity as well as gender, primary language, 93 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 9 Revised February 1, 2010 LEP status, and IEP status) in a variety of categories (including special education enrollment, disability categories, and special education educational environments, among others). Up through FFY 2005, this data-oriented approach to monitoring disproportionality has continued to be used in the context of the CPR system. In the CPR system PQA monitors more than 350 public school districts and charter schools in the Commonwealth for compliance with laws and regulations in the areas of special education, English learner education, civil rights, and some other areas of general education, as well as, in certain districts, career/vocational technical education. It has a six-year cycle for this monitoring, meaning that it monitors each of those districts and charter schools in all those areas once during that six-year cycle. During every CPR, PQA sends a team to spend from several days to over a week in the district or charter school being reviewed, interviewing its personnel and observing classes. Before the onsite visit, the team surveys parents and scrutinizes selected student records and extensive documentation provided by the school or district. In addition, PQA sends a team midway through the sixyear cycle to complete an onsite special education follow-up Mid-cycle Review (MCR), again consisting of onsite interviews and observations as well as examination of documentation and records. After both CPRs and MCRs PQA issues a public report of the team’s findings in the school or district. Future monitoring for disproportionality: MASSDE has recently made the decision to take the monitoring of disproportionality out of the CPR/MCR system. Since under this system only one-sixth of the Commonwealth’s districts and charter schools are monitored de novo each year, it does not allow MASSDE to calculate each year the “percent of districts with disproportionate representation of racial and ethnic groups in special education and related services that is the result of inappropriate identification.” Instead, MASSDE will examine disproportionality data for every school district and charter school every year starting with the FFY 2005 submission. Starting in FFY 2005, MASSDE will examine the data on the distribution of racial/ethnic groups in special education for every district and charter school in the Commonwealth, not just those slated for review under the CPR system. It will use the definition of “disproportionate representation” given above and it will use a multi-tiered approach to determine whether disproportionate representation of racial and ethnic groups in special education and related services is the result of inappropriate identification. Baseline Data for FFY 2005 (2005-2006): Because zero districts met the criteria for the determination of over-representation and underrepresentation in FFY 2005, MASSDE met its measurable and rigorous target of 0%. Discussion of Baseline Data: Calculating the weighted risk ratios for FFY 2005 over-representation produced zero districts that met the criteria of three consecutive years of a WRR of 3.0 or higher. In terms of FFY 2005 under-representation, the calculation yielded zero districts with a WRR of .25 or lower for three consecutive years. FFY Measurable and Rigorous Target 2005 (2005-2006) 0% 2006 (2006-2007) 0% 2007 (2007-2008) 0% 94 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 9 Revised February 1, 2010 FFY Measurable and Rigorous Target 2008 (2008-2009) 0% 2009 (2009-2010) 0% 2010 (2010-2011) 0% Improvement Activities/Timelines/Resources: Timelines (FFY) 2005 - 2010 Improvement Activity Collaboration with Stakeholders (Impacts All Indicators) Resources MASSDE staff time See Appendix A for a complete description. 2007 - 2010 Online Resources Relating to Disproportionality MASSDE staff time, national technical assistance providers MASSDE will develop web-based resources devoted to providing the latest data and research on the topic of disproportionality. Included in this online resource will be a research report that MASSDE will publish on the state of disproportionality in Massachusetts. The research report will examine national trends, examine Massachusetts’ trends, and provide the MASSDE with a contextual framework through which it can improve its assistance to districts and students. 2008 Technical Assistance Summer Institute Research MASSDE staff time, national technical assistance providers MASSDE will explore possibility of a technical assistance summer institute for Massachusetts charter schools and districts on the subject of disproportionality and understanding data relevant to it. 2008 - 2010 Self-Assessment Tool for LEAs MASSDE will develop a self-assessment tool for districts that are ‘flagged’ for potential disproportionality. Districts will use the selfassessment tool to examine their own policies and procedures regarding special education eligibility and disability definition. 95 MASSDE staff time, national technical assistance providers, LEA staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 9 Submitted February 1, 2010 Indicator 9 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 0% Actual Target Data for FFY 2008 (2008-2009): Districts with Disproportionate Representation of Racial and Ethnic Groups That was the Result of Inappropriate Identification Year Total Number of Districts Number of Districts with Disproportionate Representation Number of Districts with Disproportionate Representation of Racial and Ethnic Groups that was the Result of Inappropriate Identification Percent of Districts FFY 2008 (2008-2009) 380 0 0 0.00% Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 (2008-2009): Explanation of Progress or Slippage Massachusetts used the October 1, 2008 enrollment and child count data to calculate disproportionality for the FFY 2008 Annual Performance Report (MA APR) submission. Using the criteria established above, MASSDE determined that zero out of 380 LEAs met the data threshold for disproportionate representation of racial and ethnic groups in special education and related services. As a result, MASSDE did not receive or review PPPs from school districts for its review of data for Indicator 9. MASSDE met its measurable and rigorous target. Improvement Activities Over this past year, MASSDE continued its communication with its stakeholder working group and staff from a number of school districts to determine the best way to publicly report data for Indicators 9 and 10 at the LEA level. Disproportionality information on the MASSDE’s public website has been updated (see http://profiles.doe.mass.edu/state_report/special_ed.aspx). Through this website a user can select a specific district to access data on Indicators 9 and 10. In support of efforts to strengthen the communications with and input from stakeholders, members of the stakeholder group participated in five webinars over the course of the spring and summer on the topic of disproportionality. The events were hosted by the Northeast Regional Resource Center (NERRC). MASSDE is continuing to engage in a process for reviewing and refining the formula for calculating disproportionality. As identified by OSEP in its visit to Massachusetts in October 2008, MASSDE is reviewing ways to include in its calculation consideration of exceptional circumstances for school districts that receive many of their students with disabilities from other districts. The OSEP team suggested that MASSDE consider giving different weights to different districts based on their populations (i.e., regional vocational/technical school districts, regional secondary school districts, regional secondary charter schools). In FFY 2008, MASSDE sought technical assistance from NERRC and Westat to improve the calculation method, and researched ways in which the formula could be modified. The process of review and refinement is ongoing. 96 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 9 Submitted February 1, 2010 Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): The targets, timelines, and improvement activities for Indicator 9 described in the Massachusetts Part B State Performance Plan (MA SPP) for FFY 2005-2010 remain appropriate. 97 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 10 Revised February 1, 2010 Indicator 10: Disproportionality – Eligibility Category SPP Monitoring Priority: Disproportionality Indicator 10: Percent of districts with disproportionate representation of racial and ethnic groups in specific disability categories that is the result of inappropriate identification. (20 U.S.C. 1416(a)(3)(C)) Measurement: Percent = [(# of districts with disproportionate representation of racial and ethnic groups in specific disability categories that is the result of inappropriate identification) divided by the (# of districts in the State)] times 100. State’s definition of “disproportionate representation”: Massachusetts defines “disproportionate representation” using a calculation of weighted or alternate risk ratio and a review of the appropriateness of a district’s policies and procedures for identifying students as disabled. MASSDE calculates a weighted or alternate risk ratio for every school district in each of the six required disability categories (intellectual impairments, specific learning disabilities, emotional disturbance, speech/language impairments, other health impairments, autism) using the techniques described in detail in Westat’s “Methods for Assessing Racial/Ethnic Disproportionality in Special Education” (http://www.nichcy.org/training/B-resources.pdf). The state uses a minimum cell size of 10 for each racial/ethnic disability group in every district. Cells less than 10 are individually reviewed to see if data irregularities for specific racial and ethnic groups in these districts would suggest disproportionate representation due to inappropriate identification. Once the calculation is made for each district, the weighted risk ratios are compared to the two previous years’ weighted risk ratios. Districts are flagged if for 3 consecutive years, they exhibit a weighted risk ratio of 4.0 or greater for possible over-representation, and of .20 or less for possible under-representation. All districts identified by way of this quantitative analysis are then subject to a review of the appropriateness of their policies, practices, and procedures (PPPs) for special education eligibility determination and disability identification. Description of determination that disproportionate representation is due to inappropriate identification: Districts identified using the measurement techniques described above submitted their current PPPs to the MASSDE (or MASSDE verified recent compliance information/reviews) where the PPPs were reviewed by a committee of policy analysts and compliance specialists. If the committee concluded that the PPPs were inappropriate or otherwise inconsistent with federal and state regulations, and concluded that the PPPs likely caused the disproportionate representation at least to some degree, then a district was identified as having disproportionate representation due to inappropriate identification. Overview of Issue/Description of System or Process: The descriptions and processes described in Indicator #9 are applicable to Indicator #10. The only difference between these two indicators is that Indicator #10 measures the number of districts with disproportionate representation of racial and ethnic groups in six specific disability categories (intellectual impairments, specific learning disabilities, emotional disturbance, speech/language impairments, other health impairments, autism) that is the result of inappropriate identification, whereas as Indicator #9 measures the number of districts with disproportionate representation of racial and ethnic groups in special education and related services that is the result of inappropriate identification. 98 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 10 Revised February 1, 2010 Baseline Data for FFY 2005 (2005-2006): Because zero districts met the criteria for the determination of over-representation and underrepresentation in FFY 2005, MASSDE met its measurable and rigorous target of 0%. Discussion of Baseline Data: Calculating the weighted risk ratios for FFY 2005 over-representation produced seven districts that met the criteria of three consecutive years of a WRR of 4.0 or higher. Using the existing PPP information from recent Coordinated Program Reviews and Mid-Cycle Coordinated Program Reviews, MASSDE determined that none of these districts had inappropriate special education identification procedures. In terms of FFY 2005 under-representation, the calculation yielded 11 districts with a WRR of .20 or lower for three consecutive years. Using the existing PPP information from recent Coordinated Program Reviews and Mid-Cycle Coordinated Program Reviews, MASSDE determined that none of these districts had inappropriate special education identification procedures. FFY Measurable and Rigorous Target 2005 (2005-2006) 0% 2006 (2006-2007) 0% 2007 (2007-2008) 0% 2008 (2008-2009) 0% 2009 (2009-2010) 0% 2010 (2010-2011) 0% 99 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 10 Revised February 1, 2010 Improvement Activities/Timelines/Resources: Timelines (FFY) 2005 - 2010 Improvement Activity Collaboration with Stakeholders (Impacts All Indicators) Resources MASSDE staff time See Appendix A for a complete description. 2007 - 2010 Online Resources Relating to Disproportionality MASSDE staff time, national technical assistance providers MASSDE will develop web-based resources devoted to providing the latest data and research on the topic of disproportionality. Included in this online resource will be a research report that MASSDE will publish on the state of disproportionality in Massachusetts. The research report will examine national trends, examine Massachusetts’ trends, and provide the MASSDE with a contextual framework through which it can improve its assistance to districts and students. 2008 Technical Assistance Summer Institute Research MASSDE staff time, national technical assistance providers MASSDE will explore possibility of a technical assistance summer institute for Massachusetts charter schools and districts on the subject of disproportionality and understanding data relevant to it. 2008 - 2010 Self-Assessment Tool for LEAs MASSDE will develop a self-assessment tool for districts that are ‘flagged’ for potential disproportionality. Districts will use the selfassessment tool to examine their own policies and procedures regarding special education eligibility and disability definition. 100 MASSDE staff time, national technical assistance providers, LEA staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 10 Submitted February 1, 2010 Indicator 10 – Annual Performance Report for FFY 2008 APR Actual Target Data for FFY 2008: FFY Measurable and Rigorous Target 2008 (2008-2009) 0% Districts with Disproportionate Representation of Racial and Ethnic Groups in Specific Disability Categories That was the Result of Inappropriate Identification Year Total Number of Districts Number of Districts with Disproportionate Representation FFY 2008 380 18 Number of Districts with Disproportionate Representation of Racial and Ethnic Groups in specific disability categories that was the Result of Inappropriate Identification Percent of Districts 0 0.00% Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008: Explanation of Progress or Slippage MASSDE used the October 1, 2008 enrollment and child count data to calculate disproportionality for the FFY 2008 APR submission. Using the criteria established above, the state determined that 11 of 380 LEAs were identified as meeting the data threshold for disproportionate over-representation of racial and ethnic groups in the six disability categories. Additionally, the state determined that 7 of 380 LEAs met the data threshold for disproportionate under-representation of racial and ethnic groups in the six disability categories. Upon additional review of policies, practices, and procedures using the process described above, MASSDE determined that 0% of the districts had disproportionate over- or underrepresentation of racial and ethnic groups in specific disability categories that was due to inappropriate identification. In FFY 2008, MASSDE met its measurable and rigorous target of 0%. Improvement Activities In FFY 2008 MASSDE continued its communication with its stakeholder working group and staff from a number of school districts to determine the best way to publicly report data for Indicators 9 and 10 at the LEA level. Disproportionality information on the public website was updated (http://profiles.doe.mass.edu/state_report/special_ed.aspx), where users can select a specific district to access data on Indicators 9 and 10. Members of the stakeholder group also participated in 5 webinars hosted by the Northeast Regional Resource Center. Due to fiscal conditions however, MASSDE was unable to hold a semi-annual conference to meet with stakeholders in person as it has in years past. As identified in the MA APR for Indicator 9, MASSDE is continuing to engage in a process for reviewing and refining the formula for calculating disproportionality. As identified by OSEP in its visit to Massachusetts in October 2008, MASSDE is reviewing ways to include in its calculation consideration of exceptional circumstances for school districts that inherit many of their students with disabilities from 101 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 10 Submitted February 1, 2010 other districts. The OSEP team suggested that MASSDE consider giving different weights to different districts based on their populations (i.e., regional vocational/technical school districts, regional secondary school districts, regional secondary charter schools). In FFY 2008 MASSDE sought technical assistance from NERRC and Westat to improve the calculation method, and researched ways in which the formula could be modified. This process of review and refinement is ongoing. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): The targets, timelines, and improvement activities for Indicator 9 described in the Massachusetts Part B State Performance Plan (MA SPP) for FFY 2005-2010 remain appropriate. 102 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 11 Revised February 1, 2010 Monitoring Priority: Effective General Supervision / Child Find Indicator 11: Initial Evaluation Timelines SPP Monitoring Priority: Effective General Supervision Part B / Child Find Indicator 11: Percent of children who were evaluated within 60 days of receiving parental consent for initial evaluation or, if the State establishes a timeframe within which the evaluation must be conducted, within that timeframe. (20 U.S.C. 1416(a)(3)(B)) Measurement: a. # of children for whom parental consent to evaluate was received. b. # of children whose evaluations were completed within 60 days (or State-established timeline). Account for children included in (a) but not included in (b). Indicate the range of days beyond the timeline when the evaluation was completed and any reasons for the delays. Percent = [(b) divided by (a)] times 100. Overview of Issue/Description of System or Process: For the SPP submitted in February 2006, OSEP defined this indicator as being “percent of children with parental consent to evaluate, who were evaluated and eligibility determined within 60 days (or State established timeline).” MASSDE’s state established timeline is inclusive of both evaluation and eligibility determination and our data collection efforts for this indicator includes both of those activities. As such, Massachusetts does not have the capacity to collect and report data on the evaluation timeline separately from the eligibility determination timeline. While some districts’ tracking systems are able to report the date that the evaluation was completed, many of the systems are designed to track the 45-day timeline for evaluation and eligibility as a single element. Therefore, the data reported for this indicator is reflective of districts’ ability to meet the state established timeline of 45 school working days after receipt of parental consent to conduct an initial evaluation and make an eligibility determination. To ease the data collection activity burden for districts, MASSDE divided its 387 LEAs into four cohorts that are representative of the state as a whole, and will collect and report data on this indicator based on a four-year cycle (2005-06 through 2008-09). This cohort model and plan for data collection was approved by OSEP on April 20, 2006. Over a four-year period, every district in the state will have participated in the data collection activities for this indicator. Because it has an average daily membership of over 50,000 students, Boston participates in all activities every year. Further information on the cohort model can be found at: http://www.doe.mass.edu/sped/2006/0522idea.html. This data collection effort focused on obtaining data from 98 districts, including 10 districts that participated in a pilot program during Summer 2006. All districts were required to submit data from the months of October, November, and December of 2005. On October 17, 2006, both hard and electronic copies were mailed to 88 districts in the first cohort (10 districts had previously completed the activity during the pilot data collection) informing them of the data collection effort, and providing them with a spreadsheet and code sheet, as well as instructions on how districts can upload their data (once compiled) into the MASSDE’s Security Portal. Districts were given six weeks to respond to the data collection effort. On November 14, 2006, a follow-up letter of correspondence was sent to the participating districts reminding them of the data collection effort. Upon successful completion of the data collection and uploading into the Security Portal, districts were notified that they had met all of the requirements through electronic mail. 97 out of 98 districts have provided the data to-date. MASSDE is continuing efforts to get the full cohort response as soon as possible. 103 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 11 Revised February 1, 2010 Baseline Data for FFY 2005 (2005-2006): Based on 97 districts reporting on initial evaluations begun in the months of October, November, and December of 2005: a. 2768 initial evaluations were conducted following parental consent to evaluate b. 952 students had initial evaluations completed within the State established timeline and were found not eligible for special education services c. 1498 students had initial evaluations completed within the State established timeline and were found eligible for special education services % of students with parental consent to evaluate, who were evaluated within the State established timeline: 88.5% =(952+1498)/2768 * 100 Discussion of Baseline Data: The figure of 88.5% includes cases where the evaluation was completed within the State established timeline, and also includes cases in which the district had an acceptable reason for not meeting the timeline. These are reasons that were beyond the district’s control, including school cancellation due to weather, parent scheduling needs, and significant student absenteeism. In examining the 318 cases in which a district did not meet the timeline and did not have an acceptable reason, the most common reason was due to district scheduling conflicts (33.6% of the missed timelines). Insufficient staff availability and/or availability of outside evaluators was the second most common reason (30.8%), and “excessive caseload” was the other most common reason (13.8%). Of these cases that missed the timeline, the average number of days beyond the 45-day timeline for evaluation and eligibility determination was 17.5 school working days. A second cohort of districts will participate in data collection for this indicator in the Spring of 2007. MASSDE will refine its data collection instrument to collect more detailed information from districts regarding barriers to meeting State established timelines, and will use this information to assist districts in their efforts to achieve 100% compliance. As this is a “compliance” indicator, the targets are not within MASSDE’s capacity to set and are automatically set at 100%. FFY Measurable and Rigorous Target 2006 (2006-2007) 100% 2007 (2007-2008) 100% 2008 (2008-2009) 100% 2009 (2009-2010) 100% 2010 (2010-2011) 100% 104 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 11 Revised February 1, 2010 Improvement Activities/Timelines/Resources: Please note that many of the activities presented below impact across multiple indicator areas. For these activities, a full description of the activity is available in Appendix A. Timelines (FFY) 2005 - 2008 Improvement Activity Special Education Program Improvement Grants – Fund Code 274 (Additional Indicators Impacted: 3, 4, 5) Resources MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Leadership Academies and Seminars (Additional Indicators Impacted: 3, 5, 8) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Special Education Summer Institutes (Additional Indicators Impacted: 1, 2, 3, 4, 5, 6, 8, 13, 14) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Comprehensive System of Personnel Development Training Project (Additional Indicators Impacted: 3, 5, 13, 14) MASSDE staff time, CSPD trainer time, CSPD district staff time See Appendix A for a complete description. 2005 - 2010 Special Education Website (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2006 - 2010 Data Collection and Analysis MASSDE staff time MASSDE will continue to review and refine data collection instruments to collect more detailed information from districts including barriers to meeting State established timelines. MASSDE will analyze reasons for any non-compliance and barriers to timely correction on an on-going basis. 105 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 11 Timelines (FFY) 2007 - 2010 Improvement Activity Specific Learning Disability Training Module MASSDE will develop a training module related to determining eligibility under specific learning disability. The module will address evaluation timelines when determining eligibility for special education under specific learning disability. The module will be posted and online and districts will be able to access training on the topic. 2007 - 2010 Self-Assessment Tool for LEAs Revised February 1, 2010 Resources MASSDE staff time, CSPD trainer time, CSPD district staff time MASSDE staff time, LEA staff time MASSDE will develop a self-assessment tool for LEAs to self-identify barriers impeding their capacity to meet State established timelines. 2007 - 2008 SPecial EDition Online Newsletter (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Revision of “Ten Step Guide for Comprehensive Educational Assessment of Students with Visual Impairments” (Additional Indicators Impacted: 3, 5, 6, 13) See Appendix A for a complete description. 106 MASSDE staff time, stakeholder groups Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 11 Submitted February 1, 2010 Indicator 11 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 100% Actual Target Data for FFY 2008: a. Number of children for whom parental consent to evaluate was received 2713 b. Number of children whose evaluations were completed within 60 days (or Stateestablished timelines) 2657 Percent of children with parental consent to evaluate, who were evaluated within 60 days (or State established-timeline) 98% Percent = [2657 divided by 2713] times 100. The FFY 2008 data is based on a cohort of 103 school districts reporting on initial evaluations begun in the months of October, November, and December, 2008. During this period, districts received parental consent for initial evaluation for 2,713 students. Initial evaluations were completed for 2,657 students. Of those, 1,088 students were found not eligible for special education services, and 1,559 were determined to be eligible for special education services. For FFY 2008, the percentage of students with parental consent for initial evaluation who were evaluated within the state established timeline is 98%. Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that Occurred for FFY 2008: Explanation of Progress or Slippage The FFY 2008 result of 98% includes cases where the evaluation was completed within the state established timeline or cases in which the district had an acceptable reason for not meeting the timeline. Acceptable reasons for extending the timeline are those that are beyond the district’s control, including school cancellation due to weather, parent scheduling needs, and significant student absenteeism. In order to obtain student level data, MASSDE required each district selected for this monitoring activity in FFY 2008 to collect information and report data on all initial evaluations conducted during October, November, and December, 2008. The MA SPP for this indicator provides additional information on OSEP’s approval of the cohort data collection for Indicator 11. Since first reporting on Indicator 11, MASSDE has seen a rise in the percentage of students for whom initial evaluations were conducted within the state established timeline: FFY 2005 - 89%, FFY 2006 94%, FFY 2007 - 95%, and FFY 2008 - 98%. This year’s data show an increase of 3 percentage points over the FFY 2007 total, and 9 percentage points over the baseline established in FFY 2005. MASSDE reports continued progress toward meeting the state’s measurable and rigorous target. 107 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 11 Submitted February 1, 2010 As described Table 1 below, LEAs cited several reasons for inability to complete initial evaluations in a timely manner in the 56 cases where a district did not meet the state established timeline, and did not have an acceptable reason for extending it. Table 1: Percentage of Non Acceptable Reasons for Not Meeting Timelines Insufficient staff availability to complete the evaluation on time (excessive caseload) 50% Delay due to district’s scheduling need 16% Delay due to evaluator reports not received on time 16% Other reasons determined within the district’s control (e.g., staff member unavailable at the time of meeting) 14% Delay due to lack of qualified staff to complete the evaluation on time 4% In these cases, the most common reason for failure to meet state established timelines for evaluation was a delay due to staff not being available to complete the evaluation on time (i.e., excessive caseload). The next most common reasons for delay were the district’s scheduling need, and/or evaluator reports not received on time. MASSDE continues to work with school districts to ensure that extension of state established timelines is limited to cases only where there are acceptable extenuating circumstances. MASSDE recognizes and is working with school districts to help them recognize that staff availability and district resources are not appropriate reasons for extending evaluation timelines. Of the cases that did not meet the state established timeline, the average number of days beyond the Massachusetts 45-day timeline for evaluation and eligibility determination was 10 school working days. This is a reduction in the average number of days delay that was reported in FFY 2007 (14.9 working days), FFY 2006 (15 working days), and the first data collection effort in FFY 2005 (17.5 working days). This reduction in the average number of days beyond established timelines represents continued efforts by MASSDE to ensure that districts meet required timelines for evaluation. 108 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 11 Submitted February 1, 2010 Of the LEAs that submitted data in the FFY 2008 reporting period, two received a finding of noncompliance via a letter dated December 14, 2009 and were required to complete corrective actions related to their policies, practices, or procedures that resulted in not meeting timelines for initial evaluations. MASSDE has verified that one LEA corrected the noncompliance within one year of the notice of the finding. The other LEA continues to work with MASSDE to remedy noncompliance and complete its corrective action. MASSDE anticipates that this noncompliance will be verified as corrected within one year of identification, and will report on this in the FFY 2009 APR for Indicator 11. Improvement Activities During FFY 2008, MASSDE completed several improvement activities in an effort to provide LEAs with additional resources for meeting required timelines for conducting an initial evaluation to determine eligibility for special education services. MASSDE first reported in the FFY 2007 APR for Indicator 11 its work in developing self-assessment tools that LEAs can use to self-identify barriers to their ability to meet state established timelines for evaluation. One tool focuses on the reasons for not meeting state established timelines, and the other helps LEAs to identify trends in personnel and professional disciplines (e.g., speech and language pathology, psychologists, occupational therapists, special educators, etc.) that are involved in the initial evaluation process. Using these tools, districts can identify relevant discipline areas for the initial evaluation/assessment and determine whether the professional personnel in that discipline area are meeting required timelines. LEAs can then use this information to focus their improvement activities on ways to address needs in specific disability areas and personnel timelines. MASSDE has received positive feedback from stakeholders on these tools, and has used the input of stakeholders to revise the tools as needed. During FFY 2008, 13 LEAs participated in a pilot program using these selfassessment tools. Based on MASSDE’s review of this pilot project, MASSDE will further refine them and anticipates offering these tools to more LEAs during FFY 2009. This self-assessment tool was well received by the districts that participated in this pilot process. Other MASSDE improvement activities for Indicator 11 included professional development opportunities. As part of these professional development initiatives, special education administrators and school district staff participated in activities to generate effective systems change for compliance areas, including Indicator 11. See Appendix A for complete descriptions of these activities. The Special Education Leadership Academies and Seminars for special education administrators offered activities focused on a number of areas related to special education laws, regulations, and compliance, including initial evaluation timelines. MASSDE revised the “Ten Step Guide for Comprehensive Educational Assessment of Students with Visual Impairments” publication that, among other things, recommends types of assessments that may be useful in making a determination of eligibility for a student with a visual impairment for the initial eligibility determination or three-year reevaluation. It also helps to ensure a common understanding of the purpose and complexity of conducting the specialized educational assessment of students with visual impairments. Special Education Summer Institutes offered the professional course titled Effective Evaluation of Special Education Programs, focused on building the capacity of special education directors and district teams in evaluating a component or service of their special education programs. Participants gained increased ability to design and conduct program evaluations that inform school/district decision makers about their programs, build buy-in for the programs among participants, engage colleagues in collaborative study and learning that focus on programs they undertake to improve student outcomes, and document lessons learned and accomplishments. The Special Education Program Improvement Grants – Fund Code 274 continued to offer funding in 2008 to every LEA for professional development activities that improved the skills and capacity of educators to meet the diverse instructional and curricular needs of students with disabilities. Topics for professional development under one of four grant priorities included district 109 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 11 Submitted February 1, 2010 special education policies and procedures, federal and state special education legislation and regulations, and IEP development and process. These areas continue to assist special education personnel in completing initial evaluations in a timely manner. The following activities focused on improving compliance with initial evaluation timelines and contributed to the state’s continued success in meeting its target for Indicator 11: American Recovery and Reinvestment Act: Saving and Creating Jobs and Reforming Education (ARRA) – IDEA Collaboration with Stakeholders MASSDE has continued to pursue its public reporting of initial evaluation timelines data. This information can be viewed at http://profiles.doe.mass.edu/state_report/special_ed.aspx MASSDE will continue to focus its efforts on improving outcomes for students with IEPs, and looks forward to reporting on the results of these efforts in the FFY 2009 APR for Indicator 11. Verification of Noncompliance Identified in FFY 2007 The OSEP Part B FFY 2007 SPP/APR Letter and Response Table required MASSDE to report correction of the noncompliance in FFY 2007 regarding Indicator 11. In FFY 2007, five of 98 LEAs in the cohort group were determined to be noncompliant with state established timelines for evaluation. MASSDE required each LEA to complete corrective actions related to its policies, practices, or procedures that interfered with meeting timelines for initial evaluations and determinations of eligibility. MASSDE has determined and verified that the five LEAs have made required corrections, and have completed all individual initial evaluations and amended practices as necessary. Four of the five LEAs made such corrections within the one year time frame and one LEA made such corrections, but not within the one year timeframe. There are no outstanding findings of noncompliance from FFY 2007. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): MASSDE has revised the measurement for Indicator 11 in the Part B State Performance Plan (MA SPP) for FFY 2005-2010 and the Annual Performance Report (APR) to reflect the simplified measurement (collapsing of former (b) and (c)). MASSDE has revised improvement activities in the MA SPP to include updated activities, new activities, and changes to activity titles. 110 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 12 Revised February 1, 2010 Monitoring Priority: Effective General Supervision / Effective Transition Indicator 12: Early Childhood Transition SPP Monitoring Priority: Effective General Supervision Part B / Effective Transition Indicator 12: Percent of children referred by Part C prior to age 3, who are found eligible for Part B, and who have an IEP developed and implemented by their third birthdays. (20 U.S.C. 1416(a)(3)(B)) Measurement: a. # of children who have been served in Part C and referred to Part B for Part B eligibility determination. b. # of those referred determined to be NOT eligible and whose eligibilities were determined prior to their third birthdays. c. # of those found eligible who have an IEP developed and implemented by their third birthdays. d. # of children for whom parent refusal to provide consent caused delays in evaluation or initial services. e. # of children who were referred to Part C less than 90 days before their third birthdays. Account for children included in a but not included in b, c, d, or e. Indicate the range of days beyond the third birthday when eligibility was determined and reasons for the delays. Percent = [(c) divided by (a – b – d- e)] times 100. Overview of Issue/Description of System or Process: MASSDE notes that the measurement for this indicator, as currently described, does not take into account the need for the referral to occur with sufficient time for the district to conduct the eligibility determination. Thus, a referral for a child served under Part C that occurs on or after the child’s third birthday will inevitably not be found eligible prior to the third birthday. MASSDE will incorporate into its data system the ability to determine if the referral is received within 45 days (the State established timeline) of the 3rd birthday. The Massachusetts Department of Early Education and Care (MEEC), through an ISA with MASSDE, distributes its 619 funds to all LEAs through a grant process. In 2004-05, the grant application asked districts to provide statistical information by asking the following questions: 1. Number of children referred from Early Intervention (EI) during FY2005. 2. Of the number provided in question 1, indicate the number of children who were subsequently found eligible for special education services. 3. Of the number provided in question 2, indicate the number of children who received services from the public school: a. prior to their 3rd birthday _____ b. on their 3rd birthday* c. after their 3rd birthday _____ _____ * children with summer birthdays and birthdays that fall on days different than the program schedule should be counted here if services began on the first scheduled day of the program after the child’s third birthday. In the narrative section of the grant, districts were asked to describe their referral and eligibility determination process and to explain their transition activities and practices for children transitioning from EI to preschool and preschool to Kindergarten. In addition we asked for brief commentary and/or reasons 111 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 12 Revised February 1, 2010 why a child eligible for special education services would not receive services on or before their third birthday. We did not ask how many days after they turn three did services start. Baseline Data for FFY 2004 (2004-2005): Based on 249 grants (out of 273 possible applicants -- 91%) received and processed to date (as of 11/08/05): 5,938 children were referred from EI in 2004-05 4,311 of the 5,938 (73%) referred were found eligible for services Of those found eligible to receive services: o 216 (5%) received services prior to their 3rd birthday o 3,141 (72%) received services on their 3rd birthday o 991 (23%) received services after their 3rd birthday % of children referred by Part C prior to age 3, who are found eligible for Part B, and who have an IEP developed and implemented by their third birthdays: 77% Discussion of Baseline Data: While the current figures show that 77% of children eligible for special education receive services on or before their third birthdays, these data may not be accurate. When asked to provide narrative reasons for why services were not initiated by a child’s third birthday, school districts gave reasons described within the definition of “on their third birthday” under the asterisk implying districts may not have read the question fully. For example, of the 249 grants received, 124 reported at least one child served after their third birthday. A random sample of one-third of the 124 grants listed the following reasons a child would not have received services on or before their third birthday (41% districts listed multiple reasons): 34% listed birthday related delays (during school vacation, summers) 49% parent related delays (parent refused services, was late returning required forms, postponed Team meeting) 7% district related delays (staffing, caseload) 17% EI or other agency delays 24% other reasons (medical condition of child, inclement weather, new coordinator, lack of capacity) 22% did not respond to question In 29 districts, it was one student that failed to receive services on or before turning three. 63 districts reported between two and nine eligible children receiving services after they turned three. 18 districts reported between 10-20 eligible children; and seven districts reported between 21-29; the remaining seven reported between 30-93 eligible children receive services after their third birthdays. Across the sample, the percentage of students within a district that did not receive services on or before turning three ranged from 2% (1 out of 66 eligible children) to 100% (15 districts reported all students started after turning three). FFY Measurable and Rigorous Target 2005 (2005-2006) 100% 2006 (2006-2007) 100% 112 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 12 Revised February 1, 2010 FFY Measurable and Rigorous Target 2007 (2007-2008) 100% 2008 (2008-2009) 100% 2009 (2009-2010) 100% 2010 (2010-2011) 100% Improvement Activities/Timelines/Resources: Timelines (FFY) 2005 Improvement Activity GSEG Application to Develop Data Sharing System Resources MASSDE staff time, MEEC staff time, DPH staff time Massachusetts will submit a GSEG application to develop a data sharing system between the three agencies that serve young children with disabilities: DPH, MEEC and MASSDE. This will allow the State to better track referrals from EI, the districts’ responses within timelines, and ultimately provide for smoother transition for young children and their families. 2005 Update Interagency Agreement MASSDE staff time, MEEC staff time MEEC and MASSDE will update interagency agreement around early childhood transition requirements under IDEA. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) MASSDE staff time, MEEC staff time See Appendix A for a complete description. 2005 - 2010 Data Collection and Analysis MASSDE staff time, MEEC staff time MEEC and MASSDE will review and refine data collection instruments on an on-going basis to collect more detailed information from districts. MEEC will analyze reasons for any noncompliance and barriers to timely compliance on an on-going basis. Starting in FFY 2009, MEEC and MASSDE will align data collection practices with the cohort model used by MASSDE to collect data for other early childhood indicators. 113 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 12 Timelines (FFY) 2005 - 2010 Improvement Activity Technical Assistance and Support Revised February 1, 2010 Resources MASSDE staff time, MEEC staff time, LEA staff time MEEC and MASSDE will provide on-going technical assistance and support to poor performing districts to identify and overcome barriers that currently prevent them from serving children on or before turning three. 2005 - 2010 District Compliance Monitoring MASSDE staff time, MEEC staff time, LEA staff time MEEC and MASSDE will monitor district compliance through the Coordinated Program Review (CPR) system (see Indicator 15 for additional information on monitoring policies and procedures). 2008-2010 Procedures for Verification of Correction of Noncompliance MEEC and MASSDE will review and revise procedures for notifying districts of noncompliance and verifying correction of noncompliance, in accordance with OSEP Memorandum 09-02. 114 MASSDE staff time, MEEC staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 12 Submitted February 1, 2010 Indicator 12 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 100% Actual Target Data for FFY 2008 (2008-2009): a. # of children who have been served in Part C and referred to Part B for Part B eligibility determination = 5873 b. # of those referred determined to be NOT eligible and whose eligibility was determined prior to their third birthdays = 985 c. # of those found eligible who have an IEP developed and implemented by their third birthdays = 3137 d. # of children for whom parent refusal to provide consent caused delays in evaluation or initial services = 719 e. # of children who were referred to Part C less than 90 days before their third birthdays = 626 Percent = [3137 / (5873 – 985 – 719 – 626)] X 100 = 88.5% Please note that states are not required to include (e) in the calculation in the FFY 2008 APR submission for Indicator 12. This number has been included in Massachusetts’ calculation in prior years and, therefore, is included in this report. States are also required to indicate the range of days beyond the third birthday when eligibility was determined and the IEP developed, and the reasons for the delays, for children included in (a) but not included in (b), (c), (d) or (e). MASSDE conducted a representative survey of districts regarding the time periods and reasons for delay. The results are as follows: Eligibility was determined and the IEP was developed: no more than 10 days after the child’s third birthday – 13% more than 10 days but less than one month after the child’s third birthday – 29% more than one month after the child’s third birthday – 58%. Reasons for delays included staff unavailability to complete evaluations on time, delay due to scheduling need or unavailability of staff at the time of meeting, and delay due to evaluator reports not received on time. Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 (2008-2009): Explanation of Progress or Slippage As noted in the MA SPP, the Massachusetts Department of Early Education and Care (MEEC) distributes 619 funds to all LEAs through a grant process pursuant to an interagency services agreement (ISA) with MASSDE. Under the present agreement, MEEC is responsible for data collection, monitoring, verification of correction of noncompliance, and reporting regarding Indicator 12, in cooperation with MASSDE. In FFY 2008, Massachusetts’ performance on Indicator 12 improved 5.6 percentage points over the FFY 2007 rate of 82.9%. Although MASSDE has not reached its measurable and rigorous target, MASSDE is pleased to demonstrate improvement in this area, and attributes improvement to the technical assistance and resources available to improve school districts’ practices, and to the improvements MEEC made to its data collection process, including use of a new online data collection tool. 115 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 12 Submitted February 1, 2010 Improvement Activities Massachusetts’ Response to the OSEP Part B FFY 2007 SPP/APR Letter and Response Table OSEP instructed MASSDE to include in its FFY 2008 APR for Indicator 12 a report on the status of its verification of correction of noncompliance regarding the noncompliance reported in the FFY 2007 APR. Noncompliance reported in FFY 2006 As noted in the FFY 2007 APR for Indicator 12, nine school districts cited for noncompliance in FFY 2006 verified correction of noncompliance as of the date of the FFY 2007 report. MEEC sent Corrective Action Reports citing noncompliance to those districts on February 8, 2008, and districts were asked to revise their data and provide current data demonstrating correction of noncompliance. MEEC has verified correction of noncompliance for each district and there are no outstanding findings of noncompliance from FFY 2006. Noncompliance reported in FFY2007 Of the districts identified as noncompliant with the requirements under Indicator 12 in FFY 2007, all but six districts have submitted required information and correction of noncompliance has been verified within the one year timeframe. Because these districts were notified of their compliance status for FFY 2007 on March 18, 2009, MEEC anticipates full correction of noncompliance for the remaining six districts no later than March 18, 2010, consistent with OSEP Memorandum 09-02. MASSDE will report on the results of its verification of correction for the remaining six districts in the FFY 2009 APR for Indicator 12. Noncompliance reported in FFY 2008 On December 23, 2009, MEEC notified school districts of their FFY 2008 noncompliance status. These districts are in the process of reviewing and revising data to provide current information demonstrating correction of noncompliance to MEEC, and MEEC anticipates that verification will be completed in a timely manner. MEEC will report on the results of its verification of correction in the next Indicator 12 APR. Massachusetts Part B FFY 2007 SPP/APR Response Table Technical Assistance Because OSEP identified Massachusetts as being in need of technical assistance for two consecutive years based on results for Indicator 12, OSEP advised Massachusetts in the Part B FFY 2007 SPP/APR Response Table of available technical assistance and required the state to report on (1) the technical assistance sources from which the state received assistance; and (2) the actions that Massachusetts took as a result of that technical assistance. In response to this instruction, MEEC engaged in the following activities since its last APR report: MEEC participated in a series of webinars and technical assistance calls on transition, and reviewed a variety of resources available from the National Early Childhood Transition Center (NEATC), the National Early Childhood Technical Assistance Center (NECTAC), SpecialQuest, and the Regional Resource and Federal Centers (RRFC) Network. At the National Inclusion Conference in July, 2009, MEEC participated in several sessions on transition. MEEC has used these resources to research further best practices for transition, to share ideas with colleagues in other states, and to develop resources to assist school districts in drafting transition protocol plans. MEEC has continued to collaborate with the Massachusetts Department of Public Health (MDPH) (the lead agency for Part C in Massachusetts), in consultation with the North Central Regional 116 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 12 Submitted February 1, 2010 Resource Center (NCRRC), to develop online modules on transition, and a training program for districts and early intervention providers on developing appropriate transition protocols. Since the submission of the FFY 2007 APR for Indicator 12 to date, MEEC staff has participated in a variety of technical assistance activities that have overlapping affect on each of the Early Childhood Indicators – B6, B7, and B12. Staff gained knowledge and information through websites, articles, webinar trainings, conferences, committee work, and networking opportunities sponsored by OSEP, MDPH, the North Central Regional Resource Center, NASDSE, the National Early Childhood Transition Center (NECTAC), and SpecialQuest, These resources have informed the trainings MEEC provides for school districts across the Commonwealth to improve outcomes for young children with disabilities. In coordination with MASSDE, MEEC has adopted the “cohort model” previously used for other indicators and accepted by OSEP as appropriately reflecting the state as a whole for subsequent data collection for this indicator. Technical assistance related to this indicator has assisted in identifying major difficulties related to correcting and verifying correction of data for this indicator because of the use of aggregate numbers in reporting the data. For this APR and previous APRs, there has been no means of identifying individual students and tracking down sufficiently precise information on barriers to meeting the timelines. These have been challenges in determining root causes of noncompliance. With the cohort model, MEEC will be able to identify and track the experience of individual students. MASSDE and MEEC anticipate that this will significantly improve outcomes for this Indicator. Completed Improvement Activities As identified in the FFY 2007 APR, in February 2008 MEEC was awarded the multi-year SpecialQuest grant to develop a Statewide Birth-Five Leadership Team to improve the inclusive opportunities for children with disabilities birth to five. Activities to date include roll-out of professional development at the statewide level to address systems of inclusive services, including transitions of young children with disabilities from Early Intervention (EI) to Early Childhood Special Education. In addition, our national technical assistance experts, in collaboration with the state leadership team, have supported the work of local systems development in several communities where transitions between Part C and Part B have been a focus. In November and December 2009, MEEC hosted its Communities of Practice with the topic “Response to Intervention-RTI for Pre-K.” This program is available at no cost to the early childhood field. Participants from child care organizations, Head Start, Coordinated Family Community Engagement Grantees, school districts, and state agencies participated. MEEC program staff shared information on Response to Intervention (RtI) and showed a webinar on Recognition and Response findings from the Frank Porter Graham Child Development Institute. Participants were able to network and share their best practice strategies and strengths/concerns with each other, and to brainstorm ways to begin this model in their programs. The next focus of the Communities of Practice program will be on transition and common issues identified through districts’ corrective action plans. MEEC also used online transition training models in the fall of 2008. In response to feedback from stakeholder groups that Indicator 12 improvement activities focus on ways to foster improved communication and partnerships between EI providers and LEAs, MEEC and MDPH created an online three unit training program on Transition from Part C to Part B. The agencies are making this a requirement for meeting EI competencies and a required activity for districts that are determined to be noncompliant with transition requirements. The modules look at transition from the perspectives of Part C and Part B, and the responsibilities agencies have in the transition process. Technical assistance from the lead agencies is a required element of each unit. The module Connecting the Dots: Massachusetts’ Early Childhood Transition Training was debuted in the fall of 2009 at a Transition Forum hosted by MEEC and MDPH. For more information please see http://guest.cvent.com/EVENTS/info/summary.aspx?e=d760ebdf-0573-495b-9354-ba138358874c. 117 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 12 Submitted February 1, 2010 MEEC continues to collaborate with MASSDE’s Program Quality Assurance (PQA) unit on annual scheduled compliance reviews. MEEC participates as a member of the PQA monitoring teams that visit school districts that as part of the 6 year monitoring cycle to examine issues under Indicator 12. MEEC staff reviews transition practices/timelines and children’s records, interviews district staff, and makes needed compliance findings and recommendations for improvement activities to improve school districts’ practice in this area. This helps to ensure that noncompliance is identified early, and timely correction is made. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2009 (2009-2010): MASSDE/MEEC have revised the measurement table for Indicator 12 in the Part B State Performance Plan (MA SPP) for FFY 2005-2010 and the Annual Performance Report (APR) to reflect the additional exceptions to the timeline. Also, MASSDE/MEEC has revised improvement activities in the MA SPP to include updated and new activities. 118 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 13 Revised February 1, 2010 Indicator 13: Secondary Transition SPP Monitoring Priority: Effective General Supervision Part B / Effective Transition Indicator 13: Percent of youth aged 16 and above with transition planning that includes coordinated goals and transition services that will reasonably enable the student meet his/her post-secondary goals in the identified areas. (20 U.S.C. 1416(a)(3)(B)) Measurement: Percent = [(# of youth with disabilities aged 16 and above with an IEP that includes coordinated, measurable, annual IEP goals and transition services that will reasonably enable the student meet the post-secondary goals) divided by the (# of youth with an IEP age 16 and above)] times 100. Overview of Issue/Description of System or Process: In order to obtain student-level data, MASSDE required each district selected for this monitoring activity to collect information on a representative sample of students aged 16-21 with IEPs. The sample student files were reviewed for evidence of full transition planning discussions. A review sheet allowed districts to assess a student record for evidence of appropriate transition planning. Evidence of transition planning that includes coordinated annual goals and transition services that will reasonably enable the student to meet his/her post-secondary goals in the identified areas resulted in a finding of appropriate transition planning for the student record being reviewed. Appropriate evidence included the completion of a MASSDE Transition Planning Chart (documenting full transition planning discussion), or a record review (with appropriate IEP documentation) indicating an appropriate transition planning discussion. If such documentation was not found in the student record or IEP, then the student was not considered to have received appropriate transition planning. Districts were encouraged to provide optional comments detailing any aspect of the student’s transition plan. To ease the data collection activity burden for districts, MASSDE divided its 387 LEAs into four cohorts that are representative of the state as a whole, and will collect and report data on this indicator based on a four-year cycle (2005-06 through 2008-09). This cohort model and plan for data collection was approved by OSEP on April 20, 2006. Over a four-year period, every district in the state will have participated in the data collection activities for this indicator. Because it has an average daily membership of over 50,000 students, Boston participates in all activities every year. Further information on the cohort model can be found at: http://www.doe.mass.edu/sped/2006/0522idea.html. Districts with 30 or fewer students with IEPs aged 16-21 reviewed all records, and districts with 30 to 150 students with IEPs aged 16-21 selected and reviewed 30 records that the district considered reasonably representative across disabilities, ages and special education placements. In order to ensure a representative selection of students, districts with 150 students or more with IEPs aged 16-21 received a pre-selected list of 30 students generated by the Student Information Management Systems (SIMS) for the record review process. Districts with only elementary school aged students did not collect data. Following a pilot in the spring, districts were informed of the data collection process in June and again in October via mailed and electronic correspondence. Districts were encouraged to review and use the Massachusetts Transition Planning Chart to inform and document the discussion in detail. A record review form was developed along with informational letters detailing how to collect data. A spreadsheet for the recording of information was created and accessible to districts through the MASSDE Security Portal and uploaded to MASSDE via the Security Portal once completed. Members of a district’s Special Education department assessed student records for transition planning for evidence of coordinated annual goals and transition services that will reasonably enable the student to meet his/her post- 119 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 13 Revised February 1, 2010 secondary goals in the identified areas and completed review sheets. Information from these sheets was transferred to the spreadsheet and submitted to MASSDE via the Security Portal. The MASSDE data group analyzed spreadsheet data. Baseline Data for FFY 2005 (2005-2006): # of Student Records reviewed 1,901 # of Student Records with transition planning that included coordinated annual goals and transition services 1,592 2005-06 Percentage of student records in compliance 83.8% Discussion of Baseline Data: The data indicate that of the 1,901 student records reviewed from 2005-06, almost 84% include transition planning that includes coordinated annual goals and transition services that will reasonably enable the student to meet his/her post-secondary goals in the identified areas. Although this is a reasonably high percentage, this is a compliance indicator and Massachusetts takes seriously the importance of appropriate transition planning. To that end, you will see in our improvement activities the decision to issue a Transition Planning Chart that will be used as a mandated form and will be required for each student eligible for transition planning in Massachusetts. FFY Measurable and Rigorous Target 2006 (2006-2007) 100% 2007 (2007-2008) 100% 2008 (2008-2009) 100% 2009 (2009-2010) 100% 2010 (2010-2011) 100% 120 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 13 Revised February 1, 2010 Improvement Activities/Timelines/Resources: Please note that many of the activities presented below impact across multiple indicator areas. For these activities, a full description of the activity is available in Appendix A. Timelines (FFY) 2005 - 2007 Improvement Activity Project FOCUS Academy (Additional Indicators Impacted: 1, 2, 3, 4, 5, 8, 14) See Appendix A for a complete description. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) Resources MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston, Education Development Center), LEA staff time MASSDE staff time See Appendix A for a complete description. 2005 - 2010 2005 - 2010 Comprehensive System of Personnel Development Training Project (CSPD) (Additional Indicators Impacted: 3, 5, 11, 14) See Appendix A for a complete description . Special Education Summer Institutes (Additional Indicators Impacted: 1, 2, 3, 4, 5, 6, 8, 11, 14) MASSDE staff time, CSPD trainer time, CSPD district staff time MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Special Education Website (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 National Association of State Directors of Special Education (NASDSE) Satellite Series (Additional Indicators Impacted: 2, 3, 5, 6, 14) MASSDE staff time See Appendix A for a complete description. 2006 - 2010 Massachusetts Transition Planning Form (TPF 28M/9) MASSDE will revise existing Transition Planning Chart in order to develop the mandated Massachusetts Transition Planning Form (TPF 28M/9). On-going training and technical assistance will be available to districts on the use of the TPF. 121 MASSDE staff time, CSPD trainers, LEA staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 13 Timelines (FFY) 2006 - 2010 Revised February 1, 2010 Improvement Activity Resources Inclusive Concurrent Enrollment Partnership Program for Students with Disabilities (Additional Indicators Impacted: 5, 14) MASSDE staff time, LEA staff time, technical assistance providers See Appendix A for a complete description. 2007 - 2010 Massachusetts FOCUS Academy (Additional Indicators Impacted: 1, 2, 3, 4, 5, 8, 14) See Appendix A for a complete description. 2008 Passage of Chapter 285 of the Acts of 2008 – Change in Transition Planning Age to 14 Years Old MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston), LEA staff time MASSDE staff time, LEA staff time With the passage of Chapter 285, transition planning for students with disabilities in Massachusetts will begin when the student is 14 years of age. Therefore, Massachusetts will require that beginning when the eligible student is 14, the school district must plan for the student's need for transition services and the school district must document this discussion annually using the Massachusetts Transition Planning Form (TPF 28M/9). To support LEAs in the implementation of the new age requirement, MASSDE will develop a training module on the transition planning process that schools may use to assist staff in understanding this process. 2007 - 2008 Massachusetts Online Resource Library (Additional Indicators Impacted: 1, 2, 3, 4, 5, 6, 8, 14) MASSDE staff time See Appendix A for a complete description 2007 - 2008 SPecial EDition Online Newsletter (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Collaboration with Federation for Children with Special Needs (Additional Indicators Impacted: 3, 5, 8 ) See Appendix A for a complete description. 122 MASSDE staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 13 Timelines (FFY) 2008 - 2010 Improvement Activity Community/Residential Education Project – (Additional Indicators Impacted: 5, 14) Revised February 1, 2010 Resources MASSDE staff time, DDS staff time, LEA staff time See Appendix A for a complete description. 2008 - 2010 Educational Proficiency Plans (Additional Indicators Impacted: 1, 2, 3, 14 ) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Secondary Transition – TransitionWorks: Innovative Strategies for Transitioning Youth with Disabilities from School to Work (Additional Indicators Impacted: 1, 2, 14 ) MASSDE staff time, Massachusetts Rehabilitation Commission staff time See Appendix A for a complete description. 2008 - 2010 Work-Based Learning Plans for Students with Disabilities, (Additional Indicators Impacted: 2, 14) MASSDE staff time, LEA staff time, Workforce Development staff time See Appendix A for a complete description. 2008 - 2010 District and School Assistance Centers (DSAC) (Additional Indicators Impacted: 2, 3, 5) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Special Education Program Improvement Grants – Fund Code 249 (Additional Indicators Impacted: 3, 4, 5) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Revision of “Ten Step Guide for Comprehensive Educational Assessment of Students with Visual Impairments” (Additional Indicators Impacted: 3, 5, 6, 11) See Appendix A for a complete description. 123 MASSDE staff time, Vision Impairment Disability Workgroup time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 13 Submitted February 1, 2010 Indicator 13 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 100% The change requiring Part B SPP/APR Indicator 13 language and measurement realignment with secondary transition requirements under the Individuals with Disabilities Education Act (IDEA) does not become effective until FFY 2009; States are not required to report data for new Indicator 13 until the FFY 2010 APR. MASSDE is voluntarily reporting on Indicator 13 for FFY 2008 in order to conclude its cohort cycle and ensure data consistency with the previous cohort years. FFY 2008 marked the last year of a four-year cohort cycle in Massachusetts to collect and report data regarding effective transition planning for students with IEPs. The cohort model for data collection was approved by OSEP on April 20, 2006. With this reporting cycle, every district in Massachusetts has now participated in data collection activities for Indicator 13. The following report for FFY 2008 retains the language and measurement of former Indicator 13. As instructed by OSEP, required changes to the indicator and measurement will be reflected in a revised SPP for FFY 2009, and MASSDE’s first APR reporting for the revised indicator will be in FFY 2010. Actual Target Data for FFY 2008 (2008-2009): # of Student Records reviewed # of Student Records with transition planning that included coordinated annual goals and transition services Percentage of student records in compliance 2,029 2,020 99.5% Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 (2008-2009): Explanation of Progress or Slippage In order to obtain student-level data for Indicator 13, MASSDE required each district selected for this monitoring activity to collect information on a representative sample of students with IEPs, ages 16 though 21. Consistent with the data collection methods used in previous reporting years, MASSDE required participating school districts to use a review sheet created by MASSDE to assess student records for evidence of appropriate transition planning. If a school district does not find in each student’s file a completed Massachusetts Transition Planning Form (TPF 28M/9) documenting full transition planning discussion, then the district is required to find that there is no evidence of appropriate transition planning. Of the 2,029 student records cohort 4 school districts reviewed during FFY 2008, 99.5% contained evidence of appropriate transition planning, including coordinated annual goals and transition services to reasonably enable the student to meet his/her post-secondary goals in the identified areas. As noted in the graph below, the percentage of student records with appropriate transition planning has continued to grow since MASSDE established baseline for Indicator 13 in FFY 2005. Although MASSDE did not meet its measurable and rigorous target of 100% for FFY 2008, MASSDE continues to demonstrate a high rate of compliance for this indicator. Only 0.5% of cohort districts failed 124 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 13 Submitted February 1, 2010 to meet this year’s target, which is an increase over last year’s results. This success may be attributable to LEAs using the required Massachusetts Transition Planning Form, issued by MASSDE in February 2007. The form must be used for every student of transition age with an IEP. Of the LEAs that submitted data in the FFY 2008 reporting period, three LEAs received a systemic finding of noncompliance from MASSDE and were required to complete corrective actions related to their policies, practices, or procedures that interfered with appropriately meeting timelines for transition planning. In addition to a systemic finding of noncompliance in the three identified LEAs, MASSDE made nine individual findings. All identified districts, after completing necessary corrective actions, ensured that the district has appropriate policies, practices, and procedures in place to make certain that the Massachusetts Transition Planning Form (TPF 28M/9) is used to develop a transition plan for every student with an IEP of transition age, and that transition planning has taken place for each student who had been reported previously as not having transition planning provided. MASSDE reviewed all completed corrective action reports and selected submitted plans to determine if the issues were corrected successfully. All identified districts (100%) completed their corrective actions and successfully remedied any noncompliance, including the individual findings, within one year of the notice of the finding of non-compliance. Information from the review of individual and district-level data is provided to the MASSDE compliance unit (Program Quality Assurance) to inform its decision-making in future monitoring activities. Improvement Activities In FFY 2008, MASSDE engaged in several activities for maintaining high levels of compliance related to effective transition. MASSDE continued to focus its efforts on professional development and creating tools and resources to support educators’ efforts to engage in effective transition planning for students as districts respond to the revised language and measurement for Indicator 13. Massachusetts FOCUS Academy (MFA) - MASSDE’s State Personnel Development Grant continues to offer several online courses in a variety of key areas, including Post-Secondary Transition Planning. The FCSN provided a course for educators on Parent and Professional Partnerships: Transition Planning for Students with Disabilities in Middle and High School. Additionally, MASSDE added a two-part course on post-secondary education for educators 125 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 13 Submitted February 1, 2010 designed to instruct educators, family members, and adult agency personnel on the principle policies and practices related to transition planning for students with disabilities from the ages of 14 to 22 years old. The Inclusive Concurrent Enrollment Partnership Programs for Students with Disabilities grant program is focused on building partnerships between high schools and state public institutions of higher education to offer inclusive concurrent enrollment opportunities for students with severe disabilities. As part of the technical assistance provided to the 35 participating high schools, school personnel learned how to conduct person-centered planning for students with disabilities. This transition planning approach is student-led and promotes greater selfdetermination and self-advocacy skills in youth with disabilities. As part of the improvement and expansion of these programs, partnerships continue to develop their programs to include individualized community-based integrated employment opportunities that align with participating student career goals and course selection. Secondary Transition – Transition Works: Innovative Strategies for Transitioning Youth with Disabilities from School to Work is a five-year grant from the U.S. Department of Education awarded to the Massachusetts Rehabilitation Commission (MRC) that will help support transitioning youth with disabilities from school to work. As part of this initiative vocational rehabilitation counselors are collaborating with local school districts to support youth with disabilities in their transitions from school to work, post-secondary education, and independent living. Work-Based Learning Plans (WBLP) for Students with Disabilities – Through work-based learning experiences, students have an opportunity to learn about various career paths, explore different work styles, and learn about the environmental supports that are available. Additionally, they allow students to discover the type of work they enjoy, and how they learn best in a workplace setting. The WBLP assists district personnel and families to improve transition outcomes for students with disabilities. The WBLP contains a scoring rubric that serves as a student performance evaluation guide to facilitate employer assessment of each participating student’s WBLP Foundation Skills. Beginning in FFY 2008, SEPP began collaborating with the Student Support, Career and Education Service unit at MASSDE to develop a one page guidance document entitled Using the Massachusetts Work-Based Learning Plan In Transition Planning Activities for Students with Disabilities and to enhance the WBLP Scoring Rubric. The one page document is intended to encourage the inclusion of students with disabilities in WBLP programs; be used as an option for individual student transition planning; and support educators, employers, Connecting Activities field staff, Workforce Investment Boards, One Stop Career Centers, and Local School-to-Career Partnerships in the implementation of quality work-based learning for students with disabilities. Comprehensive System of Personnel Development (CSPD) Training Project was developed to supplement ongoing personnel preparation activities provided within school districts and other agencies. Two topic areas relate directly to secondary transition planning: 1) Transition from Adolescence into Adulthood in Massachusetts and 2) The Massachusetts Transition Planning Chart and Effective Transition Planning. MASSDE offered distance-learning opportunities via satellite from the National Association of State Directors of Special Education (NASDSE) at no cost to school districts and educational organizations in Massachusetts. In December 2008, a presentation titled Partners in Progress: Youth/Young Adult Leaders for Systems Change was provided to special educators across the state. Forty-three districts participated. MASSDE has a long standing Collaboration with Federation for Children with Special Needs (FCSN), which is the federally-funded Parent Training and Information Center that provides free information, support, technical assistance, and workshops to Massachusetts’ families who have children with disabilities. This year’s topics that relate to transition included Parent’s Rights, IEPs, and Transition 101. 126 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 13 Submitted February 1, 2010 Educational Proficiency Plan (EPPs) - The purpose of the EPP is to increase the support students need to stay in school to meet graduation standards and to have the requisite skills needed for post-secondary success. The Special Education Program Improvement Grants – Fund Code 249 offered funding to approved private special education schools for professional development activities that helped improve the capacity of educators to meet the diverse needs of students with disabilities. The topic for professional development under one of the three priority areas for the grant related to secondary transition included College and Career Readiness: Secondary Transition Planning. This priority area will enable educators to provide quality instruction and transition planning, thus allowing students with disabilities to access to more inclusive environments, and to have appropriate transition plans in place. The revision of “Ten Step Guide for Comprehensive Educational Assessment of Students with Visual Impairments” includes a new section describing the “hidden” characteristics of a vision loss that affect academic and social factors. Important to secondary transition planning, the revision of the document provides resources to help educators meet the unique needs of students with visual impairments and to prepare them for further education, employment, and independent living. Community/Residential Education Project - The goal of this project is to facilitate effective transitions from school life to more independent life within the community for students receiving publicly-funded special education services who also meet the Massachusetts Department of Disability Services (MDDS) eligibility criteria for services. This goal is accomplished by supporting less restrictive, more cost effective residential options, special education services, and community based supports. District and School Assistance Centers (DSACs) – MASSDE has opened six regionally-based DSACs to help identified districts and their schools strategically access and use professional development and targeted assistance to improve instruction and raise achievement for all students. MFA courses (see above), including UDL Creating Positive Classroom Environments, and Transition Planning have been integrated into the menu of professional development options available to districts. Additionally, MASSDE/SEPP has engaged in the following planning activities that will inform next year’s work: MASSDE is developing three new technical assistance documents that will assist educators better understand the revised Indicator 13 language and improve transition planning for students. These tools are the Transition Planning Flow Chart, the Transition Self-Evaluation Sheet, and the Individual File Review Teacher Checklist. MASSDE plans to pilot the tools with selected districts, solicit feedback, and roll-out the tools for use in the 2010-2011 school-year. MASSDE staff and representatives from the Federation for Children with Special Needs and the Institute for Community Inclusion participated in the 3rd Annual Secondary Transition State Planning Institute. The Institute, sponsored by: the National Dropout Prevention Center for Students with Disabilities (NDPC-SD); the National Post-School Outcomes Center (NPSO); and the National Secondary Transition Technical Assistance Center (NSTTAC) in conjunction with the IDEA Partnership, provided professional development on 1) secondary transition education and services, 2) school completion strategies, and 3) post-school outcome data. Of particular interest to the Massachusetts team were the content sessions related to transition assessment, studentfocused planning, and interagency collaboration. During the institute, the Massachusetts team had the opportunity to meet with experts in the field and explore possible training opportunities. MASSDE is presently planning a transition summit to be held in FFY 2009. 127 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 13 Submitted February 1, 2010 The following activities focused on improving effective transition and contributed to the state’s continued success in meeting its target for Indicator 13: American Recovery and Reinvestment Act: Saving and Creating Jobs and Reforming Education (ARRA) - IDEA Collaboration with Stakeholders Special Education Professional Development Summer Institutes MASSDE has continued to report transition data publicly. This information, which is in the process of being updated, can be viewed at http://profiles.doe.mass.edu/state_report/special_ed.aspx MASSDE will continue to focus its efforts on improving the transition planning for students with IEPs, and looks forward to reporting on the results of these efforts in the FFY 2009 APR. Massachusetts Response to the OSEP Part B FFY 2007 SPP/APR Letter and Response Table OSEP instructed MASSDE to include in its FFY 2008 APR for Indicator 13 a report on the compliance activities of LEAs participating in data activities for this Indicator in FFY 2007 and FFY 2008. Compliance activities for FFY 2008 are described in the explanation of progress and slippage above. As reported in the Annual Performance Report (MA APR) for FFY 2007, of the LEAs that submitted data in FFY 2007, two were identified as not in compliance with Indicator 13. These findings involved 16 individual students. As noted in the FYY2007 report, using the methods described above for correction of noncompliance, MASSDE verified that both districts (100%) completed their corrective actions and successfully remedied any noncompliance within one year of the notice of the finding of noncompliance. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): MASSDE has revised improvement activities in the MA SPP to include updated activities. See the MA SPP for the revised activities and amended activity titles and timelines. In response to the new Indicator 13, MASSDE will establish new baseline data, revise and review new targets, timelines, and activities, for the FFY 2009 SPP due February, 2011. MASSDE will begin reporting against the new Indicator 13 with the FFY 2010 report due February, 2012. 128 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 14 Revised February 1, 2010 Indicator 14: Post-School Outcomes SPP Monitoring Priority: Effective General Supervision Part B / Effective Transition Indicator 14: Percent of youth who had IEPs, are no longer in secondary school and who have been competitively employed, enrolled in some type of postsecondary school, or both, within one year of leaving high school. (20 U.S.C. 1416(a)(3)(B)) Measurement: Percent = [(# of youth who had IEPs, are no longer in secondary school and who have been competitively employed, enrolled in some type of postsecondary school, or both, within one year of leaving high school) divided by the (# of youth assessed who had IEPs and are no longer in secondary school)] times 100. Overview of Issue/Description of System or Process: Generally, students with disabilities access postsecondary education and gain employment in the competitive job market at lower rates than their non-disabled peers. In the spring of 2007, students with disabilities who exited high school within the 2005-06 school year were surveyed regarding the students’ postsecondary activities within one year of leaving high school. Respondents reported whether they enrolled in postsecondary education and/or were employed in the competitive job market. MASSDE analyzed the results of this initial data to establish a baseline percentage of students with disabilities who participate in postsecondary education and/or competitive employment within one year of leaving high school. Using this baseline data, MASSDE developed targets and improvement activities for this indicator. Definitions MASSDE defines exiters as students with disabilities who graduated high school with a diploma or a certificate of attainment, aged out of special education, or dropped out of high school. MASSDE adopts the competitive employment definition stated under the Rehabilitation Act: “Competitive employment means work- (i) In the competitive labor market that is performed on a full-time or part-time basis in an integrated setting; and (ii) For which an individual is compensated at or above the minimum wage, but not less than the customary wage and level of benefits paid by the employer for the same or similar work performed by individuals who are not disabled”. (Authority: Sections 7(11) and 12(c) of the Act; 29 U.S.C. 705(11) and 709(c)) MASSDE recognizes full-time military service and supported employment positions as competitive employment. MASSDE defines part-time employment as employment that is less than thirty-five hours per week, and defines full-time employment as employment that is thirty-five or more hours per week. MASSDE defines postsecondary school enrollment as full-time or part-time enrollment in the following types of programs: a technical school, a vocational school, a two-year college or university, and a fouryear college or university. MASSDE allows the definition of full-time and part-time enrollment to be dictated by postsecondary school program descriptions. Cohort Model To ease the data collection activity burden for districts, MASSDE divided its 387 LEAs into four cohorts that are representative of the state as a whole, and will collect and report data on this indicator based on a four-year cycle (2005-06 through 2008-09). This cohort model and plan for data collection was approved by OSEP. Over a four-year period, every district in the state will have participated in the data collection activities for this indicator. Because it has an average daily membership of over 50,000 students, Boston participates in all activities every year. Further information on the cohort model can be found at: http://www.doe.mass.edu/sped/spp/datacollection.html. 129 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 14 Revised February 1, 2010 Over this four-year period, every district in the state will collect contact information for exiting students with disabilities and survey the students in the following spring. The first cohort of districts collected contact information for exiting students with disabilities in the spring of 2006, and surveyed the students in the spring of 2007. This cohort consists of 71 districts with a total of 2,610 exited students with disabilities. The second cohort of districts collected contact information for exiting students with disabilities in the spring of 2007 and will survey the students in 2008. The final two cohorts will collect contact information for exiting students with disabilities in the spring of 2008 and survey the students in 2009. Data Collection Protocol MASSDE created a two-step data collection protocol to assist districts with data collection for this indicator. The year before districts survey exiting students with disabilities, districts collect student contact information for use during the survey process. MASSDE notifies districts of their responsibility to collect student contact information via mailed and electronic correspondence. MASSDE provides an optional Student Contact Information Form for districts’ use and provides technical assistance regarding the districts’ responsibility to collect student contact information. The following year, the same districts utilize the “Post-Secondary Outcomes Survey” instrument to collect data on the postsecondary activities students with disabilities participate in within one year of leaving high school. MASSDE notifies districts of their responsibility to conduct the survey via mailed and electronic correspondence. MASSDE provides the “Post-Secondary Outcomes Survey” instrument for districts’ use and provides technical assistance regarding the districts’ responsibility to complete the data collection activity. District personnel administer the “Post-Secondary Outcomes Survey” instrument. Districts choose the data collection method utilized (i.e.) mailings, telephone surveys and the personnel responsible for completing the data collection activity. MASSDE asks districts to complete the data collection activity between April and mid-July. Districts upload the respondents’ answers to the survey questions directly to the MASSDE, using a spreadsheet accessible to districts through the MASSDE Security Portal. MASSDE then completes an aggregate data collection and analysis. This year, MASSDE utilized the results from the data analysis to calculate the baseline percentage and to establish the targets and improvement activities listed below. In addition to the use of the “Postsecondary Outcomes Survey” instrument, MASSDE coordinated data collection for this indicator with the existing data collection activities for Career/Vocational Technical Education (CVTE) programs. MASSDE’s CVTE unit annually conducts a follow-up survey for each graduating class, responding to the Carl D. Perkins Vocational and Technical Education Act of 1998 requirement that each state receiving a federal grant establish a performance accountability system to assess the effectiveness of career and technical education. The students surveyed are part of a district state-approved vocational technical education program, known as Chapter 74, and/or other career/vocational technical education programs known as non-Chapter 74 career & technical education (CTE) program. This year, MASSDE captured the data from the CVTE follow-up survey for students with disabilities who exited from CVTE programs within the 2005-2006 school year. Survey Instrument MASSDE created the “Post-Secondary Outcomes Survey” instrument, in collaboration with the statewide Transition Taskforce Workgroup and through participation in the Post-School Outcomes Community of Practice, to collect and record data on the activities students with disabilities participate in within one year of leaving high school. The survey consists of six multiple-choice questions pertaining to the students’ educational and employment status since leaving high school. The survey instrument asks respondents to provide details about their educational status, such as postsecondary program setting and enrollment level. The survey allows respondents to provide a short written description of a postsecondary program not listed on the survey instrument. Additionally, the survey instrument asks respondents to provide details about their employment status, such as employment setting and hours per week of employment. Please see Appendix C for the Massachusetts Post-School Outcomes Survey. 130 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 14 Revised February 1, 2010 Baseline Data for FFY 2006 (2006-2007): Number of Students with Disabilities in the cohort who exited high school (2005-06 school year) 2,610 Number of Students Contacted Percentage of Students Contacted Number of Respondents Percentage of Respondents Response Rate 2,015 77% 1,028 51% 39% Number of Respondents who have been competitively employed Number of Respondents who have been enrolled in postsecondary education 316 177 Number of Respondents who have been enrolled in postsecondary education and competitively employed 461 Percentage of Respondents who have been competitively employed and/or enrolled in postsecondary education 93% Discussion of Baseline Data: The data indicate that of the 1,028 respondents to the “Post-Secondary Outcomes Survey” instrument, 93% of the respondents have been competitively employed, enrolled in postsecondary education, or both competitively employed and enrolled in postsecondary education within one year of leaving high school. 31% of the respondents have been competitively employed within one year of leaving high school. 17% of the respondents have been enrolled in postsecondary education within one year of leaving high school. 45% of the respondents have been competitively employed and enrolled in postsecondary education within one year of leaving high school. Overall, districts in this first cohort contacted 77% of the students with disabilities who exited high school within the 2005-2006 school year. Over 50% of the students contacted completed the “Post-Secondary Outcomes Survey” instrument. The response rate of all exiting students with disabilities was 39%. While the response rate was 39%, respondents to the “Post-Secondary Outcomes Survey” appear to be representative of the students with disabilities who exited high school within the 2005-2006 school year. MASSDE compared the validity of the respondents reported by districts to the SIMS database. The respondents reported by districts are an appropriate representation of students with disabilities who exited high school within the 2005-2006 school year with regards to various factors such as race and ethnicity, gender, disability, level of need, and program placement. Therefore, the respondents appear to represent the target population of students with disabilities who exited high school within the 2005-2006 school year. Nonetheless, MASSDE recognizes some exiter subgroups may not be as well represented as others in this first data collection and, thus, the validity of the respondent group may be affected somewhat. For example, exiters who are not satisfied with their postsecondary activities may have been less likely to participate in a survey about postsecondary activities because of their dissatisfaction. In another example, students with disabilities who dropped out of high school may not be adequately represented in this first data collection because districts may have had difficulty contacting these students if districts did not have updated student contact information upon the students’ departures. Therefore, the representativeness of the respondents may be affected somewhat. Additionally, four districts in the cohort did not administer the “Post-Secondary Outcomes Survey” instrument. The missing data also affects the representativeness of the respondents somewhat. The four districts have been reassigned to the cohorts completing the student contact information activity in spring 2008 and will survey these students in spring 2009. 131 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 14 Revised February 1, 2010 MASSDE intends to review and revise the data collection protocol as necessary to assist districts in contacting a higher percentage of students with disabilities who exited high school to ensure the validity of the respondent group. For example, MASSDE will evaluate whether we should provide additional guidelines to districts regarding the choice of a data collection method in order to increase the number of students with disabilities who exited high school districts contact to complete the “Post-Secondary Outcomes Survey.”. An increase in the number of students with disabilities who exited high school that districts contact to complete the “Post-Secondary Outcomes Survey” will increase the number of respondents to the “Post-Secondary Outcomes Survey” and, thus, improve the response rate and the participation of all exiter subgroups in the data collection activity. Review of Data Collection Protocol Currently, MASSDE is reviewing carefully this first data collection to determine whether changes to the data collection protocol are necessary to increase the overall response rate and to increase the participation of all exiter subgroups in the data collection activity. For example, the CVTE follow-up survey only collects data from students who graduated from high school. The survey audience does not include students with disabilities involved in vocational/technical programs who aged out of their special education programs or who dropped out of high school. Therefore, MASSDE will evaluate how better to capture data from students with disabilities involved in vocational/technical programs in order to increase the participation of all exiter subgroups in the survey process. Additionally, the CVTE follow-up survey only collects data on the activities students are completing at the time of the survey. The CVTE follow-up survey does not account for any previous competitive employment and/or postsecondary education students completed earlier in the year. Therefore, MASSDE will evaluate how better to capture data from students with disabilities involved in vocational/technical programs in order to illustrate the students’ postsecondary activities more comprehensively, accounting for present and previous student involvement in competitive employment and postsecondary education within one year of leaving high school. MASSDE will also evaluate the data collection protocol to determine its ease of use for districts completing the data collection activity. MASSDE received feedback from the first cohort of districts to complete the data collection activity for this indicator and will review the data collection protocol for any necessary changes. For example, MASSDE will clarify for districts which district is responsible for completing the data collection activity in a situation where one district sends its students to a high school in another district. Furthermore, MASSDE will evaluate whether MASSDE should provide additional guidelines to districts regarding the choice of a data collection method in order to improve ease of use, to increase the overall response rate, and to increase the participation of all exiter subgroups in the data collection activity. The targets listed below were developed using the FFY 2006 baseline data of 93%, which is the percentage of students with disabilities who have been competitively employed, enrolled in postsecondary education, or both competitively employed and enrolled in postsecondary education within one year of leaving high school. FFY Measurable and Rigorous Target 2007 (2007-2008) 93% 2008 (2008-2009) 93% 2009 (2009-2010) 94% 2010 (2010-2011) 95% 132 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 14 Revised February 1, 2010 Improvement Activities/Timelines/Resources: Please note that many of the activities presented below impact across multiple indicator areas. For these activities, a full description of the activity is available in Appendix A. Timelines (FFY) 2005 - 2007 Improvement Activity Project FOCUS Academy (Additional Indicators Impacted: 1, 2, 3, 4, 5, 8, 13) See Appendix A for a complete description. 2005 - 2010 Secondary School Reading Grant (Additional Indicators Impacted: 1, 2, 3 5) Resources MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston, Education Development Center), LEA staff time MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Comprehensive System of Personnel Development Training Project (CSPD) (Additional Indicators Impacted: 3, 5, 11, 13) MASSDE staff time, CSPD trainer time, CSPD district staff time See Appendix A for a complete description. 2005 - 2010 National Association of State Directors of Special Education (NASDSE) Satellite Series (Additional Indicators Impacted: 2, 3, 5, 6, 13) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Special Education Summer Institutes (Additional Indicators Impacted: 1, 2, 3, 4, 5, 6, 8, 11, 13) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2005 - 2010 Special Education Website (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Community/Residential Education Project – (Additional Indicators Impacted: 5, 13) See Appendix A for a complete description. 133 MASSDE staff time, DDS staff time, LEA staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 14 Timelines (FFY) 2006 - 2010 Improvement Activity Data Analysis Revised February 1, 2010 Resources MASSDE staff time MASSDE will analyze data trends at the student, district and state level. Data will be drawn from sources such as the Post-School Outcomes Survey, Student Information Management System (SIMS) and the Chapter 74 Vocational Technical Education Postsecondary and Postgraduate data collection. The resulting analyses will be presented to stakeholders and used to inform technical assistance and professional development activities. 2006 - 2010 Survey Protocol Evaluation and Data Collection Technical Assistance MASSDE staff time, LEA staff time MASSDE will evaluate the Indicator 14 survey protocol annually and revise it as necessary as well as provide technical assistance, including guidance documents and teleconferences, to LEAs to help district personnel become familiar with the Post-Secondary Outcomes Survey and to establish a plan to complete the postsecondary outcomes data collection activity and reporting. 2006 - 2010 Inclusive Concurrent Enrollment Partnership Program for Students with Disabilities (Additional Indicators Impacted: 5, 13) MASSDE staff time, LEA staff time, technical assistance providers See Appendix A for a complete description. 2008 - 2010 Educational Proficiency Plans (EPP) – (Additional Indicators Impacted: 1, 2 ,3, 13) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2007 - 2010 Massachusetts FOCUS Academy (Additional Indicators Impacted: 1, 2, 3, 4, 5, 8, 13) See Appendix A for a complete description. 2008 - 2010 Secondary Transition - Transition Works: Innovative Strategies for Transitioning Youth with Disabilities from School to Work – (Additional Indicators Impacted: 1, 2, 13) See Appendix A for a complete description. 134 MASSDE staff time, grant partners (Federation for Children with Special Needs, Center for Applied Special Technologies, Institute for Community Inclusion at UMass-Boston), LEA staff time MASSDE staff time, MRC staff time, grant partners (Federation for Children with Special Needs, Institute for Community Inclusion at UMass-Boston), LEA staff time Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 14 Timelines (FFY) 2008 - 2010 Improvement Activity Graduation and Dropout Prevention and Recovery Commission (Additional Indicators Impacted: 1, 2) Revised February 1, 2010 Resources MASSDE staff time, LEA staff time See Appendix A for a complete description. 2008 - 2010 Dropout Prevention and Recovery Work Group (Additional Indicators Impacted: 1, 2, 4) MASSDE staff time, LEA staff time See Appendix A for a complete description. 2008 - 2010 Dropout Prevention, Intervention, and Recovery Website (Additional Indicators Impacted: 1, 2) MASSDE staff time See Appendix A for a complete description. 2007 - 2008 Massachusetts Online Resource Library (Additional Indicators Impacted: 1, 2, 3, 4, 5, 6, 8, 13) MASSDE staff time See Appendix A for a complete description. 2007 - 2008 SPecial EDition Online Newsletter (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2008 - 2010 Work-Based Learning Plans for Students with Disabilities, (Additional Indicators Impacted: 2, 13) See Appendix A for a complete description. 135 MASSDE staff time, LEA staff time, Workforce Development staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 14 Submitted February 1, 2010 Indicator 14 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 93% FFY 2008 marked the last year of a four-year cohort cycle in Massachusetts to collect and report postsecondary survey data regarding students with IEPs who graduated the previous year. While OMB approved new Part B SPP/APR Indicator 14 definitions of post-secondary education and competitive employment on February 25, 2009, they are not in effect until FFY 2009 and therefore states are not required to report on revised Indicator 14 until the FFY 2009 APR, to be submitted in February, 2011. MASSDE is voluntarily submitting this report for FFY 2008 in order to conclude the cohort cycle and ensure data consistency with the previous cohort years. The following report for FFY 2008 is consistent with the current indicator and measurement language and MASSDE’s definitions. As instructed by OSEP, required changes to the indicator and measurement will be reflected in the FFY 2009 APR for Indicator 14. Actual Target Data for FFY 2008 (2008-2009): Number of Students with Disabilities in the cohort who responded to the survey Number of Respondents who have been competitively employed Number of Respondents who have been enrolled in postsecondary education Number of Respondents who have been competitively employed and enrolled in postsecondary education % of Respondents who have been competitively employed and/or enrolled in postsecondary education 2342 591 513 1062 92.5% The FFY 2008 “Post-Secondary Outcomes Survey” and “CVTE Graduate One-Year Follow-Up Survey” cohort data collection process yielded responses from 2,342 students who exited high school within the 2008-2009 school year. Of the respondents, 92.5% have been competitively employed, enrolled in postsecondary education, or both competitively employed and enrolled in postsecondary education, within one year of leaving high school. Further analysis of these data demonstrate that 16.5% (513) have been enrolled in postsecondary education within one year of leaving high school; 19% (591) have been competitively employed within one year of leaving high school; and 40.8% (1062) of respondents have been competitively employed and enrolled in postsecondary education within one year of leaving high school. This is illustrated in the chart below. 136 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 14 Post-School Outcomes of FFY 2008 Cohort Respondents 5.7% Competitively Employed Enrolled in Postsecondary Education 19.0% 40.8% Submitted February 1, 2010 Competitively Employed and Enrolled in Eostsecondary Education 16.5% Not Competitively Employed nor Enrolled in Postsecondary Education Definitions MASSDE defines exiters as students with IEPs who graduated from high school with a diploma or a certificate of attainment, aged out of special education, or dropped out of high school. MASSDE has adopted the following competitive employment definition stated under the Rehabilitation Act: Competitive employment means work- (i) In the competitive labor market that is performed on a full-time or part-time basis in an integrated setting; and (ii) For which an individual is compensated at or above the minimum wage, but not less than the customary wage and level of benefits paid by the employer for the same or similar work performed by individuals who are not disabled. (Authority: Sections 7(11) and 12(c) of the Act; 29 U.S.C. 705(11) and 709(c).) MASSDE recognizes full-time military service and supported employment positions as competitive employment. MASSDE defines postsecondary school enrollment as full-time or part-time enrollment in the following types of programs: a technical school, a vocational school, a two-year college or university, or a four-year college or university. MASSDE allows the definition of full-time and part-time enrollment to be dictated by postsecondary school program descriptions. Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 (2008-2009): Explanation of Progress or Slippage There were 5,486 students with disabilities who exited Massachusetts high schools during the 2007-2008 school year, the fourth year of the cohort cycle. School districts participating in the FFY 2008 cohort contacted 4,246 exiters (77.4% of the total number of exiting students) to request that they complete either the “Post-Secondary Outcomes Survey” or the “CVTE Graduate One-Year Follow-Up Survey.” MASSDE received survey responses from 2,342 exiters. This response rate of 55.2% is an increase of 5.3% over the FFY 2007 response rate. This is an overall response rate of 42.7% of all exiting students during that school year. 137 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 14 Submitted February 1, 2010 (Please note that as of the date of this report, five school districts have not submitted data from the “CVTE Graduate One-Year Follow-Up Survey” for 104 students surveyed. Therefore, data from another 104 surveys of students with disabilities may be added to the results for Indicator 14. MASSDE is continuing to work with these districts to compile and submit full data sets.) Survey respondents are representative of the total population of students with disabilities who exited high school in FFY 2008. MASSDE compared the demographics of the respondents reported by districts to the Student Information Management System (SIMS) database. The respondents reported by districts are an appropriate representation of students with disabilities who exited high school within FFY 2008 with regard to various demographic factors such as race/ethnicity, gender, disability, level of need, and program placement. In FFY 2008, there was slippage (- 0.8 percentage points to 92.5%) over last year’s target rate of 93.3%. MASSDE does not consider this to be a significant change since it is only 0.5 percentage points below the FFY 2008 measurable and rigorous target, and because of unique national and statewide economic circumstances this year. The specific information provided by the respondents presents notable changes in the post secondary status of exiters. FFY 2008 data show a: 3% increase in the number of respondents who have been enrolled in post secondary education, 10.4% decrease in competitive employment, and 9.6% decrease in respondents reporting both competitive employment and enrollment in postsecondary education. MASSDE believes that this slippage and these figures are related to the downturn in the economy and the resulting lack of available employment because data also show: an increase of 12.1% between FFY 2007 and FFY 2008 in the number of respondents who were unemployed but searching for employment, and of respondents who were neither competitively employed nor enrolled in post-secondary education, 53.2% were searching for employment. This is a significant increase – 23.7% – over the number of respondents who were prepared and able to work but could not secure employment in FFY 2007. MASSDE recognizes that it is a continued challenge for districts to contact exiters who have dropped out because of the high rate of mobility within this population; districts often have outdated student contact information. The FFY 2008 cohort districts attempted to contact 261 students who dropped out. Of these students, 53 responded to the school districts’ outreach. While this is an increase of 20.3% over the FFY 2007 response rate for dropouts, it represents only 4.3% of the total dropouts in this cohort. Although this does not affect the overall representativeness of the survey results, it is clear that students with disabilities who drop out of school are not well represented in the survey results. MASSDE continues to revise data collection protocols and provide technical assistance to school districts to help them improve their work toward increasing the validity of data for Indicator 14. Indicator 14 Revisions for FFY 2009 Prompted by the revised Indicator 14 definitions to be included in the FFY 2009 APR and revised SPP, in FFY 2008 MASSDE piloted new questions in the “Post-Secondary Outcomes Survey.” MASSDE will incorporate the results of this pilot into future data collection for Indicator 14, using the following definitions identified in the revised Indicator 14 measurement and language. (As noted above, these changes become effective in FFY 2009, and will be reported in the FFY 2009 APR.) 1. Enrolled in higher education means youth have been enrolled on a full- or part-time basis in a community college, college/university, or other institution that meets the definition of “Institution of Higher Education” in the Higher Education Act (HEA), for at least one complete term, at any time in the year since leaving high school. The HEA defines this as enrollment in: (a) an educational program to earn a degree or other recognized credential; OR (b) a training program that lasts at least one academic year to prepare for gainful employment in a recognized occupation. 138 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 14 Submitted February 1, 2010 2. Competitively employed means that youth have worked for pay at or above the minimum wage in a setting with others who are nondisabled for a period of 20 hours per week for at least 90 days at any time in the year since leaving high school. This includes military employment. 3. Enrolled in other postsecondary education or training program means youth have been enrolled on a full- or part-time basis for at least one complete term at any time in the year since leaving high school in an education or training program (e.g., Job Corps, adult education, workforce development program). 4. Some other employment means youth have worked for pay or been self-employed for a period of at least 90 days at any time in the year since leaving high school. This includes working in a family business (e.g., farm, store, fishing, ranching, catering services, etc.). The pilot survey yielded the following results in the FFY 2008 cohort: Of the 2,342 respondents who make up the number of FFY 2008 respondents who have been competitively employed and/or enrolled in postsecondary education within a year of exiting school (92.9%), only 77% (1,610) of them would be counted under the new definitions. 41.6% (866) of the FFY 2008 respondents would be counted in a different category of post-school outcome using the new definitions. MASSDE anticipates that there will be a significant change in the Indicator 14 rate using these new definitions in FFY2009 because individual student responses to the pilot survey provided conflicting information regarding student involvement in post-secondary education and employment, and districts reported their discomfort in asking several of the survey questions, particularly questions about student earning capacity. Based on this data, MASSDE will revise the FFY 2008 survey protocol, provide additional technical assistance to cohort districts and consider the use of informational flyers provided directly to students and families for FFY 2009. Please see Appendix C for the FFY 2008 ”Post-Secondary Outcomes Survey,” which includes the piloted questions. Improvement Activities In FFY 2008 MASSDE engaged in several activities to improve post-school outcomes. The following had a direct affect on Indicator 14. MASSDE strives to increase student participation in the Indicator 14 survey process. For this reason, MASSDE conducts an annual Survey Protocol Evaluation to determine usability for students and districts completing the data collection activity. Data validity is a priority during protocol evaluation. Analysis of individual student responses and survey assessment by cohort districts inform MASSDE’s annual protocol evaluation. Additionally, MASSDE provides Data Collection Technical Assistance to districts through conference calls and individual optional support and scripts for survey interviewers, and guidance on the overall survey process, the selection of survey personnel, and steps for contacting students. The Special Education Planning and Policy Development Office (SEPP) is working to ensure that students with IEPs and their educators engaged in these improvement activities. SEPP works with the following Inter- and intra-agency offices to improve post-school outcomes for students with IEPs: Student Support, Career, and Education Services unit (SSCE); the District and School Accountability and Assistance Office (DSAA); the Massachusetts Rehabilitation Commission (MRC); and the Massachusetts Department of Developmental Services (MDDS). Following is a list of some of the FFY 2008 activities: . The Graduation and Dropout Prevention and Recovery Commission (SSCE) was charged with examining current statewide policies and making recommendations on how to retain at-risk students. The Commission’s focus was on all students, and included an examination of issues related to students with disabilities. The Commission’s final report, Making the Connection, was released in October 2009 and is available at http://www.mass.gov/Eeoe/doc/Dropout_Commission_Report_10_21_2009.pdf. 139 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 14 Submitted February 1, 2010 The Dropout Prevention and Recovery Work Group’s (SSCE) focus is to support district team action planning and to facilitate the sharing of promising practices in order to prevent student dropout thereby increasing the graduation rate, which results in improved post-school outcomes. The Dropout Prevention, Intervention, and Recovery Website (SSCE) includes an extensive collection of graduation and dropout prevention related news and trainings, articles/reports, and websites for students, parents, and educators. Educational Proficiency Plans (EPPs) (EPP) (SSCE) - The purpose of the EPP is to increase the support students need to stay in school to meet graduation standards and will have the requisite skills needed for post-secondary success. Worked-Based Learning Plans (WBLP) for Students with Disabilities (SSCE) - Through work-based learning experiences, students have an opportunity to learn about various career areas and try different work styles, find out what type of work they enjoy, find out how they learn best in a workplace setting, and find out what natural supports are available. By providing students with disabilities the opportunity to explore a variety of career areas and discover what type of work they enjoy in the context of their academic environment, the WBLP promotes students staying in school. Massachusetts FOCUS Academy (MFA) (SEPP) provides online, graduate level coursework to middle and high school educators across the state. The course offerings titled Promoting PostSecondary Education and Youth Development and Self-Determination have a significant effect on supporting improved post-school outcomes for students with disabilities. The courses help educators gain a better understanding of how disability affects student learning and provide educators with improved skills in the areas of curriculum design, instruction, and technology. These skills translate into improved student outcomes, which will lead to higher graduation rates. The Inclusive Concurrent Enrollment Partnership Programs for Students with Disabilities (ICE) (SEPP) continues to provide funding to establish and sustain partnerships between Massachusetts public high schools and public institutions of higher education to support students with severe disabilities, ages 18-22, who have not been able to earn a competency determination and do not have typical high school prerequisites, to enroll in post-secondary credit and noncredit classes with their non-disabled peers. During FFY 2008, ICE technical assistance emphasized development of additional course enrollment, campus social involvement, and employment options for participating students through access to community-based transportation. The current focus of technical assistance for the ICE partnership program is increased emphasis on program sustainability and community-based integrated employment opportunities for participating students that relate directly to course selection and career goals. MASSDE provided professional development through the National Association of State Directors of Special Education (NASDSE) Satellite Series (SEPP). The 2008 series provided two telecasts that affect Indicator 14 titled, “News You Can Use: Resources and Supports for Students with Autism and their Families,” and “Partners in Progress: Youth/Young Adult Leaders for Systems Change.” Participants included school personnel from districts across Massachusetts, as well as staff from other units within MASSDE. The goal of the Community/ Residential Education Project (MDDS) is to facilitate effective transitions from school life to more independent life within the community for students receiving publicly funded special education services who also meet the DMR eligibility criteria for services. This goal is accomplished by supporting less restrictive, more cost effective residential options, special education services and community based supports. Secondary Transition – Transition Works: Innovative Strategies for Transitioning Youth with Disabilities from School to Work (MRC) – The Transition Works: grant, awarded to MRC from the U.S. Department of Education, is intended to help support transitioning youth with disabilities from school to work and post-secondary planning and improve outcomes for students with disabilities. 140 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 14 Submitted February 1, 2010 The following additional activities focus on improving post-school outcomes and contributed to the state’s continued success in meeting its target for Indicator 14: American Recovery and Reinvestment Act: Saving and Creating Jobs and Reforming Education (ARRA) - IDEA Collaboration with Stakeholders Special Education Professional Development Summer Institutes MASSDE has continued to report transition data publicly. Data for Indicator 14 are available at http://profiles.doe.mass.edu/state_report/special_ed.aspx. Additional updates to the special education data on MASSDE’s public website are forthcoming. MASSDE will continue to focus its efforts on improving the effective transition for students with IEPs, and looks forward to reporting on the results of these efforts in the FFY 2009 APR. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008: Improvement activities have been revised in the MA SPP to include updated activities. See the MA SPP for the revised activities and amended activity titles and timelines. In response to the Indicator 14 revisions, MASSDE will collect baseline data, propose new targets, timelines, and activities, and begin reporting against the new definitions for Indicator 14 with the FFY 2009 APR due February, 2011. 141 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 15 Revised February 1, 2010 Monitoring Priority: Effective General Supervision / General Supervision Indicator 15: Identification and Correction of Noncompliance SPP Monitoring Priority: Effective General Supervision Part B / General Supervision Indicator 15: General supervision system (including monitoring, complaints, hearings, etc.) identifies and corrects noncompliance as soon as possible but in no case later than one year from identification. (20 U.S.C. 1416 (a)(3)(B)) Measurement: Percent of noncompliance corrected within one year of identification: a. # of findings of noncompliance b. # of corrections completed as soon as possible but in no case later than one year from identification. Percent = [(b) divided by (a) times 100. Overview of Issue/Description of System or Process: Monitoring by Program Quality Assurance Services: (For further information, see: 1. Coordinated Program Review Procedures: School District Information Package: Special Education: School Year 2005-2006 at http://www.doe.mass.edu/pqa/review/cpr/instrument/sped.doc; and 2. Coordinated Program Review: Mid-Cycle Review: Information Package on Corrective Action Plan Verification Procedures: School Year 2005-2006 at http://www.doe.mass.edu/pqa/review/cpr/midcycle_infopk.doc.) Monitoring is carried out by MASSDE’s Program Quality Assurance Services unit (PQA). PQA is the MASSDE unit charged with monitoring all public school districts and charter schools in the Commonwealth for compliance with laws and regulations in a number of areas. It has a six-year cycle for this monitoring, meaning that it monitors each of those districts and charter schools in multiple areas once during that six-year cycle (the “Coordinated Program Review” or CPR). During every CPR, PQA sends a team to spend from several days to over a week in the district or charter school being reviewed, interviewing its personnel and observing classes. Before the onsite visit, the team surveys parents and scrutinizes selected student records and extensive documentation provided by the district or charter school. The areas monitored in a CPR always include special education and civil rights. With respect to the monitoring of special education, PQA sends a team midway through the six-year cycle to complete an onsite special education “Mid-Cycle Review” (MCR). Again, the review consists of onsite interviews and observations as well as examination of documentation and records. Thus each public school district and charter school in Massachusetts is monitored once every three years for compliance with special education laws and regulations. After the Coordinated Program Review, the CPR team issues a draft and then a final Coordinated Program Review Report rating the district or charter school on multiple compliance standards (“criteria”) in the areas reviewed, including over 606 special education criteria based on federal and state special education law and multiple civil rights criteria. Where a criterion is found to be “Partially Implemented” or “Not Implemented,” the CPR Report includes a finding under that criterion, and the school or district must 6 Though for 2005-06 the last criterion number is 59, there are a 9A and 49A in addition to a 9 and 49, and an 18A and 18B and 25A and 25B instead of an 18 and 25; on the other hand, SE 3 and SE 28 have been reserved. 142 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 15 Revised February 1, 2010 create a corrective action plan (CAP) to address the deficiencies described in the finding. MASSDE staff review the CAP, requiring revisions to be made where the CAP appears inadequate. Once that Corrective Action Plan is in a form acceptable to MASSDE, it issues a Review of Action Plan in which it requires progress reports from the school or district to show that the corrective action described in the Corrective Action Plan has been implemented. As of the beginning of the 2005-06 school year and in response to national guidance on the development of the SPP, corrective action must be completed as soon as possible but in no case later than one year after the provision to the school or district of the final CPR Report. When progress reports are received from the district, MASSDE issues a Review of Progress Report in which it indicates, with the basis for its decision, whether the progress report has adequately shown that the corrective action for a particular criterion has been implemented. If the progress report has not adequately shown the implementation of the corrective action, MASSDE requires a further progress report and indicates what that progress report must show. Three years after the CPR, unless unique circumstances dictate either acceleration of the timetable or postponement, PQA conducts the special education Mid-Cycle Review mentioned above to review again areas that were present on the charter school or district’s previous CAP. PQA publishes a Coordinated Program Review MCR Monitoring Report, and, if the school or district is again found non-compliant, in whole or in part, with any of the areas previously corrected following the CPR, then PQA issues its own Corrective Action Plan, which must be implemented by the school or district without delay. Failure to implement MASSDE’s Corrective Action Plan within the required time may result in the loss of funds to the school or district and/or other enforcement action by MASSDE. During the Mid-Cycle Review, the PQA team also monitors the implementation of any special education requirements that have been newly created or substantially changed since the CPR, as well as reviewing any issues raised by recent complaints about special education. It may also opt to monitor areas other than special education. MASSDE further notes that during OSEP’s verification visit in Massachusetts in July 2003, OSEP found that PQA’s monitoring system, including its six-year cycle of Coordinated Program Reviews and MidCycle Reviews, constitutes “a reasonable approach to the identification and correction of noncompliance…” (Letter of October 29, 2003 to Massachusetts Commissioner of Education David Driscoll from Stephanie Smith Lee, Director, Office of Special Education Programs). Program Quality Assurance Services’ Problem Resolution System (complaint resolution system): For a description of PQA’s Problem Resolution System, please see http://www.doe.mass.edu/pqa/prs/. Baseline Data for FFY 2004 (2004-2005): When MASSDE staff learned, at OSEP’s summer institute on the SPP in August 2005, that one of the SPP’s indicators - Indicator 15 - includes the correction within a year from identification of noncompliance in special education identified through a state’s monitoring system, discussion began immediately among PQA staff as to how to modify PQA’s monitoring system (described above under Overview of Issue/Description of System or Process) so as to be able to fulfill this new requirement and track compliance with it. As this requirement was not included in IDEA 2004 or the proposed regulations implementing it, PQA had not previously considered how to modify its monitoring system in this way. Please see below, in the section entitled Improvement Activities/Timelines/Resources, for PQA’s planning and activities in this area. In the meantime, MASSDE does not have any data, for FFY 2004 (School Year 2004-05) or any other year, on the percentage of special education noncompliance corrected within one year from identification, either related to monitoring priority areas or not so related. PQA. As described above under Overview of Issue/Description of System or Process, PQA’s monitoring involves a thorough review - through Coordinated Program Reviews (CPRs) and Mid-Cycle Reviews (MCRs) - of compliance with dozens of special education compliance standards or criteria, most of which contain multiple parts. MASSDE’s emphasis has been on thorough correction of all of the areas of special education where noncompliance is found, rather than correction within a particular time (though, as described above, if noncompliance 143 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 15 Revised February 1, 2010 found in a CPR is found again at the MCR, PQA issues its own Corrective Action Plan, which must be implemented by the school or district without delay if it is to avoid escalated enforcement action by MASSDE). PQA has never before required the correction of special education noncompliance within one year, nor has it tracked the number of findings of special education noncompliance corrected within one year. Typically, the majority of issues identified at the CPR are corrected before the MCR, but not always and the MCR has allowed MASSDE to ensure that the corrections have been maintained as well as provided an opportunity to review activity for corrective actions that extended for a longer period (as, typically, some physical plant corrective actions often do). To date, instead of a tracking system that is “time-based,” PQA has used its system of progress reporting and its MCR procedures to ensure correction of noncompliance. Appendix D is an Excel table showing the percentage of correction of noncompliance with each special education criterion for the 32 charter schools and districts that received a CPR in 2001-02 and had an MCR in 2004-05 that had been published as of November 3, 2005. It bears repeating that if noncompliance with any criterion found in a CPR is found again at the MCR , PQA issues its own Corrective Action Plan, which must be implemented by the school or district without delay if it is to avoid escalated enforcement action by MASSDE. Indicator 15A and Indicator 15B*: a. # of findings of noncompliance made in the 2001-02 CPR: 560 b. of the 560 findings from the 2001-02 CPR, 380 were no longer present at the 2004-05 MCR; therefore, we consider the findings corrected and sustained: 380 % of noncompliance corrected and sustained: 68% *Note: See Appendix D: Correction of Noncompliance Data for additional detail. Indicator 15C: a. # of agencies in which noncompliance was identified through other mechanisms: 95 b. # of findings of noncompliance made: 206 c. # of corrections completed as soon as possible but in no case later than one year from identification: 206 % of noncompliance identified through other mechanisms (complaints, due process hearings, mediations, etc.) corrected within one year of identification: 100% Discussion of Baseline Data: Indicator 15A and Indicator 15B: See description provided above in the “Baseline Data” section. MASSDE notes that this baseline is not completely responsive to the required measurement of this Indicator, but it is not possible to respond to this Indicator exactly as written at this time. MASSDE notes that although re-identification of noncompliance at the MCR does result in a PQA-initiated CAP, rather than a district or charter schoolinitiated CAP, in the majority of cases it is our perception that the original finding had been corrected, but the correction did not sustain over the three year period. One recurring theme explaining that inability to sustain corrective action is the constant turnover in the field of special education and special education administrators and the constant need to look and re-look at areas of special education compliance. MASSDE anticipates further that the contemplated changes in accountability measures must also be accompanied by a consideration of how certain changes can be systematized such that corrective actions are sustainable over long periods of time and through changes in personnel. 144 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 15 Revised February 1, 2010 Indicator 15C: 100% of noncompliance identified though complaints received during 2004-05 was corrected within one year of identification. Measurable and Rigorous Target FFY 2005 % of noncompliance related to monitoring priority areas and indicators corrected within one year of identification (Indicator 15A) % of noncompliance related to areas not included in Indicator 15A corrected within one year of identification (Indicator 15B) % of noncompliance identified through other mechanisms corrected within one year of identification (Indicator 15C) 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% 100% (2005-2006) 2006 (2006-2007) 2007 (2007-2008) 2008 (2008-2009) 2009 (2009-2010) 2010 (2010-2011) Improvement Activities/Timelines/Resources: Timelines (FFY) 2005 Improvement Activity Study of Reorganization Resources MASSDE staff time MASSDE will study the possibility of reorganizing PQA staff into two parts, each with its own function: one that conducts Coordinated Program Reviews (CPRs) and Mid-Cycle Reviews (MCRs), and one that manages the Problem Resolution System (PRS) (complaint resolution system). 145 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 15 Timelines (FFY) Improvement Activity Revised February 1, 2010 Resources 2005 - 2009 Electronic CAP/Progress Report System Plan, pilot and implement an electronic system of corrective action plans and progress reports MASSDE staff time 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2005 - 2010 Communication About Required One-Year Correction MASSDE staff time MASSDE will inform districts and train PQA staff regarding this requirement. 2005 - 2010 Improvement of Procedures MASSDE will revise and develop monitoring, tracking, and reporting procedures based on data and systems analyses, and input from OSEP and stakeholders 2006 - 2010 Web-based Monitoring System MASSDE staff time, OSEP technical assistance, stakeholders MASSDE staff time, contracted providers MASSDE will plan and implement web-based monitoring system emphasizing selfassessment by districts. 2007 Reorganization MASSDE staff time MASSDE will reorganize PQA public school staff into four CPR/MCR teams and two PRS teams, each team having a supervisor and each function having an assistant PQA director in charge. 2007 Purchase and Use of Additional Software MASSDE staff time MASSDE will purchase and implement software (Crystal Reports) to produce reports on complaints. 2007 Hiring of Staff Trainer MASSDE will hire staff trainer to train monitoring teams. MASSDE staff time 2007 - 2008 Software Upgrade MASSDE staff time MASSDE will plan upgrade from current software used for tracking complaints and complaint resolution. 146 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 15 Submitted February 1, 2010 Indicator 15 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 100% Actual Target Data for FFY 2008 (2008-2009) (based on findings of noncompliance from July 1, 2007 to June 30, 2008): a. MASSDE made 1,191 findings of special education noncompliance through the Problem Resolution System (PRS), Coordinated Program Reviews (CPRs), Mid-cycle Reviews (MCRs), State Performance Plan Compliance Indicators (SPPCI), or the Bureau of Special Education Appeals (dispute resolution system) (BSEA) between July 1, 2007 and June 30, 2008. b. MASSDE uses the date on which it verifies in writing to the LEAs submission of data or documentation for evidence of correction of noncompliance as the date on which noncompliance is deemed corrected. For the FFY 2008 reporting period, 1,018 findings of noncompliance were corrected within one year of the finding. Percent of noncompliance corrected within one year of identification: (1018 / 1191) x 100 = 85.5%. All findings of noncompliance made in FFY 2008 have been corrected as of the date of this report, for an overall to-date correction rate of 100%. See Appendix D, the Indicator 15 Worksheet for FFY 2008, for the disaggregation of findings made from July 1, 2007 to June 30, 2008. Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008: Explanation of Progress or Slippage Since the initial reporting period for Indicator 15, MASSDE has made significant progress in increasing the percentage of correction of special education noncompliance within a year of the noncompliance finding. Of the 1,191 findings of special education noncompliance made through the PRS, CPR, or MCR system, the SPPCI, or the BSEA in FFY 2008 (findings made from July 1, 2007 to June 30, 2008), MASSDE verified as corrected 85.5% (1,018) of them within one year, compared to the FFY 2007 total of 62.2%. Notable is that all findings of noncompliance from this reporting period have been corrected to date. Reasons for MASSDE’s progress related to Indicator 15 include the ongoing efforts to provide training and support to PQA staff about the one-year correction requirement, and to improve internal oversight of the complaint management systems and timelines. These efforts, along with the continued review and improvement of MASSDE protocols and procedures related to compliance monitoring, and training opportunities and technical assistance available to LEAs, has supported progress toward full compliance. The effect of these efforts, as described in the improvement activities below, is demonstrated in the target data reported here. 147 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 15 Submitted February 1, 2010 Improvement Activities Massachusetts Part B FFY 2007 SPP/APR Response Table Verification of Correction of Noncompliance In the Massachusetts Part B FFY 2007 SPP/APR Response Table, OSEP required MASSDE to demonstrate the correction of the remaining noncompliance identified in FFY 2004 (nine findings), FFY 2005 (two findings), and FFY 2006 (nine findings) that MASSDE reported in the FFY 2007 APR were not yet corrected. All of these outstanding instances of noncompliance have been corrected to date. MASSDE has verified the correction of the nine findings of noncompliance that remained outstanding from FFY 2004 in the following ways. One finding was corrected through LEA submission of evidence of correction through periodic progress reporting. Monitoring Team staff, consisting of a Monitoring Specialist and Supervisor, reviewed the LEAs submission, and upon determination that the noncompliance was corrected, issued a written verification of correction on May 12, 2009. MASSDE verified another finding of noncompliance through onsite observation by a Monitoring Specialist, and sent the LEA written verification of correction on September 25, 2009. Finally, MASSDE confirmed correction of the remaining seven findings of noncompliance (from a single LEA) through the web-based monitoring system Coordinated Program Review (WBMS CPR) process. The LEA conducted and submitted to MASSDE in the spring of 2009 a self-assessment consisting of student record and document review. The MASSDE Monitoring Specialist then completed a desk review of the self-assessment submission, which was followed up with a review by the Monitoring Team Supervisor. (The Monitoring Teams group in the Program Quality Assurance unit in MASSDE is responsible for conducting compliance and monitoring activities for some state and federal education programs.) MASSDE staff conducted an onsite visit to the LEA in the fall of 2009 and reviewed additional student records, collected parent surveys, observed instructional settings, and interviewed a cross-section of administrative personnel, teaching staff and paraprofessionals. Though this process MASSDE determined that these seven findings of noncompliance had been corrected, and sent written verification of correction to the LEA in a CPR Final report that MASSDE issued on January 27, 2010. For the outstanding instances of noncompliance in FFY 2005 (two) and FFY 2006 (nine), MASSDE verified correction by examining the evidence submitted by the LEAs in their periodic progress reports. Monitoring Team staff, consisting of a Monitoring Specialist and Supervisor, reviewed the submissions, determined that the noncompliance had been corrected, and issued written notices verifying correction on March 5, 2009 and May 1, 2009; and May 6, 2009, May 26, 2009, May 28, 2009, and November 18, 2009, respectively. Massachusetts’ Response to the March 5, 2009 Verification Visit Letter Because OSEP identified MASSDE as being in need of technical assistance for two consecutive years, OSEP advised MASSDE in the Massachusetts Part B FFY 2007 SPP/APR Response Table and in the Verification Visit letter of March 5, 2009, of available technical assistance and required the state to report on (1) the technical assistance sources from which the state received assistance; and (2) the actions that Massachusetts took as a result of that technical assistance, related to Indicator 15. In response to this instruction and MASSDE’s continued priority to address issues related to Indicator 15, MASSDE staff participated in several technical assistance opportunities and consulted multiple sources about general supervision and timely correction of noncompliance. PQA staff has participated in teleconferences with other members of the Northeast Regional Resource Center (NERRC) Local Monitoring and General Supervision Work Group about general supervision, including a webinar entitled Planning and Implementation of Effective Statewide Monitoring and Improvement Systems in October 2009. In addition, PQA initiated project-specific technical assistance with NERRC to research the scope and key elements monitoring systems in states with populations similar to or larger than Massachusetts, which yielded referrals to other sources of technical assistance. MASSDE used this extensive information to 148 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 15 Submitted February 1, 2010 inform its continued refinement of the special education compliance and monitoring system for school districts and charter schools, known as the CPR process. The information provided by NERRC and other agencies reinforced for MASSDE the positive effect of using multiple review and monitoring tools to enhance the monitoring in the CPR process, including LEA self-assessments and desk reviews, to improve existing processes and procedures. The effectiveness of these resources is notable in MASSDE’s significant improvement in the timely correction of noncompliance. OSEP also required MASSDE to submit with this report the following data from monitoring visits conducted during FFY 2007: (1) the date of the onsite monitoring visit; (2) the date of the final report finding noncompliance; (3) the date that MASSDE verified that the noncompliance was corrected and notified the LEA of the correction; and (4) a sample of 10 CAPs with approved activities that address correction of the noncompliant practices based on the statutory and/or regulatory requirements at issue and the root cause(s) of noncompliance. In response to this request, MASSDE has prepared a table documenting dates of onsite visits, final reports, and correction of noncompliance. See Attachment 1. Copies of the requested CAPs are included as Attachment 2. Additional Improvement Activities OSEP provided MASSDE with invaluable technical assistance during its October 2008 visit that has helped MASSDE strengthen the role that school districts have in identifying and correcting noncompliance. As part of the CRP and MCR processes, PQA requires districts to report on the actions they take during corrective action periods to identify and respond to the root causes of identified noncompliance. After implementing corrective action, school districts must continue to monitor their compliance with the relevant requirement and to report results of this internal monitoring to PQA. The reports include dates of actions, names of district staff conducting the monitoring, and information about the records reviewed and the actions undertaken by the district to track and monitor its compliance status. This new system has engaged school districts as more active partners in correcting noncompliance by allowing them to identify root causes of noncompliance and target their efforts at correcting them. Districts have become more engaged in the processes of self-identifying and self-correcting noncompliance because of the targeted support that PQA monitoring staff has been able to provide to school districts as a result of the reorganization of PQA. MASSDE discussed the reorganization priorities in the FFY 2007 MA APR for Indicator 15, and the restructuring plan became effective on July 1, 2008. Under this new structure, PQA’s public school staff members are now organized into four “monitoring teams” and two “PRS teams.” Under the former structure, regional teams were responsible for all aspects of complaint resolution and compliance monitoring. Now CPRs and MCRs are managed by a single monitoring unit and those processes are handled more efficiently and timely. Also, monitoring staff have greater opportunity to provide technical assistance to districts, including helping school districts to use data to identify root causes of noncompliance, and to work with districts to develop corrective action strategies that are more responsive to unique needs and situations. This has strengthened the sense of partnership between MASSDE and school districts and enhanced the quality of compliance activities. These proactive measures result in districts remedying noncompliance outside of the context of a formal review cycle, or in preventing noncompliance from occurring. During FFY 2008, PQA has expanded the implementation of its web-based monitoring system (WBMS), piloted during FFY 2007. The eight pilot districts that conducted self-assessments through WBMS during the pilot year received onsite reviews during 2008-2009 using the new system. These districts are now engaged in the WBMS Corrective Action Planning and Progress Reporting, and were trained on these aspects of the system in May 2009. MASSDE initiated feedback sessions with the pilot districts and monitoring team staff who chaired those reviews to identify aspects of the protocol that presented challenges and make recommendations for system improvements. Those have been incorporated into the WBMS process. 149 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 15 Submitted February 1, 2010 The second cycle of WBMS reviews began in early 2009 when staff from 26 districts participated in MASSDE training on the self-assessment application. Participating districts submitted their selfassessments in the spring of 2009, and upon completion of desk reviews by monitoring team chairpersons, PQA staff began the onsite verification visits in October 2009. MASSDE is laying the foundation for the next monitoring cycle by conducting orientation sessions for staff in schools and districts that are scheduled for onsite reviews during the 2010-2011 (113 staff from 48 districts participated), and also training them in how to navigate the web-based system and how to complete entry data (168 staff from 48 districts participated). The PQA trainer, monitoring team supervisors, PQA’s data coordinator, and the assistant director for monitoring present at the WBMS orientation and training sessions. As this system is rolled out to all schools and districts in Massachusetts and school personnel gain experience in identifying and correcting noncompliance, and preventing it from occurring, MASSDE expects to see a reduction in identified noncompliance and more timely correction of it. Another key area of continued support that PQA has provided to school districts pertains to the electronic corrective action plan/progress reporting system (ECAP). First piloted in FFY 2006 and determined by participating districts to greatly improve their timely correction of noncompliance, this system of electronic exchange of materials has been expanded by PQA. In October 2009, PQA trained staff from 29 school districts participating in the FFY 2009 standard CPR process in the ECAP/progress reporting system. Districts receive supplemental onsite technical assistance from monitoring team chairpersons during the ECAP processes. This new protocol for reporting has increased MASSDE’s ability to verify correction of noncompliance by increasing the efficiency of information-sharing. In addition to providing in-depth training sessions for school district staff on compliance and monitoring protocols and procedures, MASSDE has continued to strengthen its training programs for staff and supervisors regarding the one-year correction requirement and other elements of compliance monitoring. From March 2009 to December 2009, MASSDE held nine training sessions on updated monitoring protocols and procedures for monitoring specialists, supervisors, and other MASSDE and outside agency personnel who partner with PQA in staffing review teams. The state special education advisory group and other state advocacy groups participated in a training presentation in April 2009, September 2009, and January 2010 on updated procedures and the effect of the revised protocols on monitoring activities. Also, MASSDE provides ongoing training opportunities and “refresher courses” to monitoring staff about the ECAP process. The Director of PQA, the assistant directors, and the PQA trainer participate in and/or lead these sessions. This ongoing emphasis on training and information sharing within MASSDE and with school districts has helped districts and MASSDE to identify and correct in a timely manner all special education noncompliance. MASSDE incorporated the learnings from the technical assistance received from external sources and feedback from districts and staff using the new monitoring system and tools to further refine its monitoring system to ensure timely correction of noncompliance. These resources have assisted MASSDE in identifying and tracking LEAs’ noncompliance, and ensuring that it is corrected as soon as possible and no later than one year from identification by MASSDE. The initial effects of these new and refined systems are seen in the improvement noted in this year’s target data of 85.5%. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008: MASSDE has revised measurement language in the State Performance Plan (MA SPP) for Indicator 15 as appropriate. Targets, improvement activities, and timelines remain appropriate for FFY 2008. 150 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 16 Revised February 1, 2010 Indicator 16: Complaint Timelines SPP Monitoring Priority: Effective General Supervision Part B / General Supervision Indicator 16: Percent of signed written complaints with reports issued that were resolved within 60-day timeline or a timeline extended for exceptional circumstances with respect to a particular complaint, or because the parent (or individual or organization) and the public agency agree to extend the time to engage in mediation or other alternative means of dispute resolution, if available in the State. (20 U.S.C. 1416(a)(3)(B)) Measurement: Percent = [(1.1(b) + 1.1(c)) divided by 1.1] times 100. Overview of Issue/Description of System or Process: For a description of the Problem Resolution System (PRS) operated by the Program Quality Assurance Services unit of MASSDE, please see http://www.doe.mass.edu/pqa/prs/. Baseline Data for FFY 2004 (2004-2005): (162 reports within timeline + 16 reports within extended timelines)/258 complaints with reports issued x 100 = 69% Discussion of Baseline Data: The percentage of signed written complaints with reports issued that were resolved within the 60-day timeline or a timeline extended for exceptional circumstances fell to 69% in 2004-05 from 82% (252/308) in 2003-04. Although MASSDE is concerned about the drop, analysis of the data shows that in the majority of cases where the 60-day timeline was exceeded, the complaint was resolved with just a few extra days. 78% of signed written complaints with reports issued were resolved within the timeline or extended timeline or within 1-3 days after it. 83% of signed written complaints with reports issued were resolved within the timeline or extended timeline or within 1-6 days after it. 88% of signed written complaints with reports issued were resolved within the timeline or extended timeline or within 1-10 days after it. As indicated in the second paragraph of the section How Will the Department Address a Concern? in the description of the Problem Resolution System located at http://www.doe.mass.edu/pqa/prs/, PQA gives the district or charter school about which it receives a complaint 15 calendar days to investigate the complaint and provide PQA with an investigation report. In some cases, the district or charter school delays or resists carrying out this investigation and submitting the report. (Oftentimes, the same district or charter school delays or resists carrying out its responsibilities with respect to more than one complaint.) Where the school or district fails to investigate and submit its report, PQA staff makes multiple attempts to obtain compliance. Eventually, MASSDE staff, often including a MASSDE lawyer, meets with the superintendent and special education administrator to explain to them the sanctions that MASSDE will impose unless the LEA carries out its responsibilities immediately. No matter how scrupulous PQA staff members are in adhering to timelines, almost every case of such unresponsiveness by schools and districts results in noncompliance with timeline requirements. MASSDE’s plan for ensuring that it complies with timeline requirements in 2005-06 and beyond is described under Improvement Activities/Timelines/Resources below. 151 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 16 Revised February 1, 2010 FFY Measurable and Rigorous Target 2005 (2005-2006) 100% 2006 (2006-2007) 100% 2007 (2007-2008) 100% 2008 (2008-2009) 100% 2009 (2009-2010) 100% 2010 (2010-2011) 100% Improvement Activities/Timelines/Resources: MASSDE provides the following plan in the MA SPP including strategies, proposed evidence of change, targets and timelines for ensuring full compliance with the required timeline, as soon as possible. Please see the chart located below for improvement activities, timelines, and resources. Proposed evidence of change MASSDE proposes to request monthly reports for the first quarter and then quarterly reports thereafter from Remedy’s Action Request System showing the percentage of compliance with timelines for the current year’s complaints in order to have a more frequent review and revision of any identified causes of delay. Targets The target for 2005-06 and every year hereafter will be 100% compliance with the timeline requirements of 34 CFR § 300.661. Timelines (FFY) 2005 Improvement Activity Software Modification Resources MASSDE staff time MASSDE will modify Remedy’s Action Request System software, the software PQA uses to track the resolution of complaints. 2005 Study of Reorganization MASSDE staff time MASSDE will study the possibility of reorganizing PQA staff into two parts, each with its own function: one that conducts Coordinated Program Reviews (CPRs) and Mid-Cycle Reviews (MCRs), and one that manages the Problem Resolution System (PRS) (complaint resolution system). 152 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 16 Timelines (FFY) 2005 - 2010 Improvement Activity Internal Monitoring Revised February 1, 2010 Resources MASSDE staff time MASSDE will review and revise internal monitoring procedures to ensure the timely complaint resolution. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) MASSDE staff time See Appendix A for a complete description. 2006 - 2010 Analysis of Data MASSDE staff time MASSDE will prepare statistical reports on PRS, analyze any reasons for noncompliance or barriers to timely compliance, and implement any needed modifications to PRS (including Remedy’s Action Request System). 2006 - 2010 Web-based Monitoring System MASSDE staff time, contracted providers MASSDE will plan and implement web-based monitoring system. 2006 - 2010 Guidance on Extensions MASSDE staff time MASSDE will provide guidance to PQA complaint investigators on acceptable reasons for extensions and proper duration of extensions. 2007 Reorganization MASSDE staff time MASSDE will reorganize PQA public school staff into four CPR/MCR teams and two PRS teams, each team having a supervisor and each function having an assistant PQA director in charge. 2007 Purchase and Use of Additional Software MASSDE staff time MASSDE will purchase and implement software (Crystal Reports) to produce reports on complaints. 2007 - 2008 Software Upgrade MASSDE staff time MASSDE will plan upgrade from current software used for tracking complaints and complaint resolution. 2008 Consultation among Complaint Investigators MASSDE will institute regular meetings of complaint investigation staff to discuss issues and will relocate all complaint investigators together. 153 MASSDE staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 16 Submitted February 1, 2010 Indicator 16 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 100% Actual Target Data for FFY 2008 (2008-2009): [(176 + 4) / 190] x 100 = 94% 1.1 – Complaint with reports issued: 190 1.1(b) – Reports within timeline: 176 1.1(c) – Reports within extended timelines: 4 Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 (2008-2009): Explanation of Progress or Slippage In FFY 2008, MASSDE demonstrated progress toward meeting its measurable and rigorous target by increasing the percentage of signed written special education complaints with reports issued that were resolved within 60 days, or within a timeline extended for exceptional circumstances, to 94%. This is an increase by 2.5 percentage points over FFY 2007 (91.5%), and almost 4 percentage points over FFY 2006 (91.1%). Notable is the progress MASSDE has made in reducing the number of complaint timelines extended for exceptional circumstances, and in increasing the number of complaint reports issued that were resolved within the extended timeline. In FFY 2007, the number of signed written complaints with reports issued whose timelines were extended was 38 (16%), and it was four in FFY 2008 (2%). In addition, MASSDE increased the percentage of signed written complaints with reports issued that were resolved within an appropriately extended timeline to 100% in FFY 2008, from 97.4% in FFY 2007. Improvement Activities Massachusetts Part B FFY 2007 SPP/APR Response Table Technical Assistance Sources and Actions Taken by MASSDE as a Result Because OSEP identified MASSDE as being in need of technical assistance for two consecutive years, OSEP advised MASSDE in the Massachusetts Part B FFY 2007 SPP/APR Response Table of available technical assistance and required the state to report on (1) the technical assistance sources from which the state received assistance, and (2) the actions that Massachusetts took as a result of that technical assistance. In response to this instruction, MASSDE staff has continued to examine specific areas of challenge in meeting the required timelines for all written complaints. Program Quality Assurance PQA) staff has reviewed the SPP/APR Calendar’s “Technical Assistance for Part B, Indicator 16 Investigative Questions” and closely examined its data and resources from other states. Based on its finding that MASSDE consistently receives 2.5 to 3 times the mean of written state complaints according to the Part B: Rates Per 10,000 of Special Education Students Enrolled national data posted by CADRE for 2003-2004, 20042005, 2005-2006, and 2006-2007, MASSDE recognized that its current practice regarding the management of timeline extensions required revision, particularly with regard to the support provided to investigators managing complex issues that could potentially delay decisions, and in tracking complaints and milestones during the 60-day timeline. As a result of this examination and needs assessment, PQA has implemented several changes to its supervision and communication systems. Supervisors and an assistant director meet weekly to review 154 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 16 Submitted February 1, 2010 data and complaint timelines, and meet regularly with complaint investigators (PRS specialists) to review current complaints and rationale for extension to ensure that timelines are being met, or the reasons for extension are related to exceptional circumstances. They also ensure that any extensions granted are for conservative periods. Specifically with regard to the extension of timelines for complaint resolution, MASSDE has: directed staff to limit extensions to no more than 30-45 calendar days beyond the original 60 days, recommending that extensions be kept to 30 days or less whenever possible; instituted a policy that if complaint investigators obtain the material they need to investigate the complaint early in the extension period, they should resolve the complaint as early as possible; informed staff that complaint timelines may be extended only for extenuating circumstances; and required that extensions be approved by the assistant director of PQA in charge of PRS and by the complaint investigator’s supervisor. MASSDE has also improved intra-agency communication about issues affecting complaints. The PQA assistant director coordinates communication between PRS specialists and other MASSDE offices (e.g., the legal office, and the career and vocational education office) when the involvement of other program staff is needed because of the nature of the complaint. This increased communication within PQA and with other agency staff helps to ensure that timelines are met and extensions are not sought for inappropriate purposes. The effect of these communication and oversight strategies is seen in the progress that MASSDE made this year in increasing the number of complaint reports issued within appropriate timelines, and reducing the number of complaints that received extensions to 4 for FFY 2008. Massachusetts’ Response to the March 5, 2009 Verification Visit Letter Sample of State Complaints That Have Been Extended In response to its findings during its October 2008 verification visit to MASSDE, OSEP required by letter dated March 5, 2009 that MASSDE submit with the FFY 2008 APR additional documentation regarding extension of complaints beyond the 60-day timeline for complaint resolutions. By way of background, during its October 2008 verification visit to MASSDE, OSEP noted the number of special education complaints for the 2007-2008 school year with extended timelines. Through its review of a sample of six of those extensions, OSEP determined that two were properly extended, and four were not. Of those four that were not properly extended, in one case MASSDE’s letter of extension was issued one day after the 60-day timeline had expired; one letter of extension failed to specify the length of the extension; and two letters of extension referred to reasons of exceptional circumstances even though the extensions were given to allow LEAs to gather additional information. Also, even when the district provided additional information immediately following the 60-day timeline, MASSDE did not issue its decision until the end of the extension period. OSEP required MASSDE to produce for the FFY 2008 APR a sample of ten extended complaints, including the letter of complaint, the letter extending the complaint, and the final written decision or disposition if the complaint was closed without a written decision. As requested by OSEP, MASSDE is submitting additional documentation. (See Attachment 3.7) Please note that although OSEP requested that MASSDE provide a sample of ten complaints that have been extended, including the letter of complaint, the letter extending the complaint, and the final written decision or disposition, MASSDE is submitting four. MASSDE issued only four extensions during FFY 2008. Of the four complaints, #09-0035 was not in conformity with the permissible reasons for granting an extension. Following is a summary of each complaint: Complaint # 08-0963. MASSDE received this complaint on July 8, 2008, soon after it began implementing its reorganization of PQA. The 60-day timeline required resolution by September 6, 2008. On July 17, MASSDE issued a Request for Local Report to the LEA, and the LEA’s 7 Personally identifiable information from the complaints and related documentation have been redacted in accordance with the Family Educational Rights and Privacy Act (FERPA), 20 U.S.C. § 1232g and 34 CFR Part 99, for this publicly available report. 155 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 16 Submitted February 1, 2010 response was due August 8. MASSDE learned that the data needed from the LEA’s related services providers were unavailable at the time of the information request because of staff unavailability during the summer months; this is a permissible reason for granting an extension. MASSDE identified the need for an extension and sent the complainant written confirmation of the need for extension by letter dated September 3. MASSDE stated that the extension period was not to exceed September 1 and that MASSDE would issue its findings by October 10, which was 34 days beyond the 60-day date. MASSDE’s findings were reported by letter dated October 23, which is 13 days beyond the original extension period. The reason for the delay was that the complainant had filed a rebuttal to the district’s response. This is a permissible reason for granting an extension beyond the initial timeline. Complaint # 09-0067. MASSDE received this complaint on August 29, 2008, and the 60-day timeline required resolution by October 28, 2008. On September 2, MASSDE issued a Request for Local Report to the LEA, and the response to the request was due September 16. This complaint involved a claim for compensatory services during a disciplinary period that involved a criminal matter and a court order that was issued in the prior year. MASSDE could have made a determination within the initial timeline that the agency lacked sufficient information to render a decision; however, MASSDE extended the complaint timeline in order to work with the parent and school district to obtain necessary additional information from the court about the order in the underlying criminal matter, and to determine the effect of that order on the student’s access to education. Although MASSDE’s stated reason for granting the extension was to “follow-up with our Department’s legal office,” that characterization is inaccurate. Rather, MASSDE, with the consent of the complainant and the school district, was continuing to investigate the matter in order to make a substantive determination. After receiving and reviewing all necessary legal records (including a clarified court order) and information provided by the parties, MASSDE ordered the district to provide compensatory services in its December 17 letter of finding. Complaint #09-0388. MASSDE received this complaint on April 17, 2009, and the 60-day timeline required resolution by June 16, 2009. MASSDE issued a Request for Local Report to the LEA on May 8, and the response was due May 25. Because the LEA did not share with the complainant a copy of the school district’s Local Report, as required by MASSDE, MASSDE shared it with the complainant and granted an extension to allow the complainant time to file a rebuttal to the LEA’s response. MASSDE issued a letter of extension on June 16, and extended the period for resolution to July 17 (31 days beyond the 60-day timeline). Complaint # 09-0035. MASSDE received this complaint on August 12, 2008, and the 60-day timeline required resolution by October 11, 2008. MASSDE issued a Request for Local Report to the LEA on September 5, and the LEA’s response was due September 19. MASSDE granted an extension because the LEA did not respond to the request for Local Report on time, and recognizes that this is not a permissible reason for granting an extension. The extension letter identified November 14, 2008 as the date upon which a decision would be made. The complainant in this case filed additional documentation as a rebuttal in response to the LEA’s response. This information was received within the extension period and MASSDE issued its decision within the identified extension period. Revised Procedures for Granting Extensions in Exceptional Circumstances In its verification visit letter, OSEP required MASSDE to include with its FFY 2008 APR its revised procedures ensuring that an extension of the 60-day timeline for complaint resolutions is granted only if the requirements in 34 CFR § 300.152(b)(1) are satisfied, i.e., exceptional circumstances exist with respect to the particular complaint, or the parties agree to extend the time to engage in mediation or alternative dispute resolution. MASSDE uses the following criteria in considering whether to grant extensions for exceptional circumstances: The complaint is initiated during start of summer months and school district staff and/or documentation/data needed to address PQA investigation are not available. 156 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 16 Submitted February 1, 2010 The complainant provides a rebuttal to the LEA’s submission, necessitating either additional follow-up by PQA, and/or additional response by the LEA, and/or additional time for MASSDE to review and render a determination. Documentation provided by one or both parties necessitates that PQA conduct an onsite visit. In this case, PQA subsequently shares onsite observations and interview results with both parties. The parties then may provide rebuttal or additional information for PQA’s consideration. The parties request extension. This occurs primarily when the parties are negotiating a local/private agreement to resolve the issue. In this case PQA does not investigate or direct the LEA to address the issue unless the parties do not reach agreement. The timeline is extended to allow PQA time to conduct its investigation. When a complaint investigator believes that an extension beyond the 60-day timeline may be warranted, he or she initiates the following procedures: The complaint investigator consults with the supervisor and determines there is a need for an extension based on an exceptional circumstance and determines the length of the extension. The assistant director reviews the request for extension and either approves or disapproves it. If the extension is approved, the assistant director ensures that the length of the extension is reasonable, and is for as short a duration as possible under the specific circumstances. Extensions may be granted for 30 days or less, and the maximum period for an extension period should not exceed 45 days. The complaint investigator records in the Remedy Action Request System (“Remedy”) data tracking application the date he or she issues the extension letter, the date that the complaint has been extended to, and the exceptional circumstance(s) that necessitated the extension. To track all complaint timelines, including extensions, the supervisor and assistant director regularly review Remedy data, including the extension timeline information, using Crystal Reports software, and follow-up with the complaint investigator as needed to ensure that appropriate timelines are maintained. Close attention to these criteria and procedures for granting extensions has significantly reduced the number of extensions to the 60-day complaint timeline granted by MASSDE. In FFY 2008, only 4 complaints (2%) were extended. The changes to procedure and oversight have allowed MASSDE to improve its performance in meeting complaint timelines. In addition to the activities noted above, MASSDE continued to focus on previously identified improvement activities in FFY 2008. With regard to improvement of software and data systems, MASSDE is upgrading the Remedy System data tracking application to allow for automatic electronic reminders to PQA supervisors and the assistant director when an extension has been granted. This notice will increase MASSDE’s ability to oversee and track the complaints to ensure that no extensions are issued without prior review and approval, as noted in the above-referenced procedures on extension. In addition, the complaint investigator is now required to enter into Remedy the date on which he or she receives materials from the parties that were submitted in accordance with the allowed extension period. Tracking information in this manner helps to ensure that MASSDE’s final determination on the complaint is made as soon as possible after an extension has been granted. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008: The Massachusetts Part B State Performance Plan (MA SPP) and Annual Performance Report (APR) have been amended to reflect the changed requirements for aligning the language of Indicator 16 with federal regulations. The targets, improvement activities, timelines, and resources remain appropriate for FFY 2008. 157 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 17 Revised February 1, 2010 Indicator 17: Due Process Timelines SPP Monitoring Priority: Effective General Supervision Part B / General Supervision Indicator 17: Percent of adjudicated due process hearing requests that were adjudicated within the 45day timeline or a timeline that is properly extended by the hearing officer at the request of either party or in the case of an expedited hearing, within the required timelines. (20 U.S.C. 1416(a)(3)(B)) Measurement: Percent = [(3.2(a) + 3.2(b)) divided by 3.2] times 100. Overview of Issue/Description of System or Process: With the full implementation of revised internal procedures and Rule changes, both geared toward accomplishing full compliance with timelines, the data reflects significant improvement in meeting the timelines for hearings. Internal administrative changes included tightening up on postponements; limiting closing arguments, i.e., period for submission and length; rotation of hearing officer assignments so that decision writing is more evenly divided; and monitoring and managing caseloads so that a given hearing officer, ideally, is not writing more than one decision at a time. Baseline Data for FFY 2004 (2004-2005): # of Hearings (fully adjudicated) 12 Decisions issued within 45-day timeline or a timeline that is properly extended by the hearing officer at the request of either party. 11* % of fully adjudicated due process hearing requests that were fully adjudicated within the 45day timeline or a timeline that is properly extended by the hearing officer at the request of either party. 91.6% *Note: The one decision that was outside the timeline was three days past the timeline. Discussion of Baseline Data: The data reveal that of the 2004-2005 hearing requests that were fully adjudicated during 2004-2005, almost 92% resulted in full adjudication (i.e., decision) within the 45-day timeline or a timeline properly extended by the hearing officer at the request of either party. Note further that the one decision that was not timely issued was only 3 days outside of the prescribed timelines. This represents a significant improvement from 2003-2004 data, which reflected that 67% of the hearings were fully adjudicated within the timelines as defined above. 158 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 17 Revised February 1, 2010 FFY Measurable and Rigorous Target 2005 (2005-2006) 100% 2006 (2006-2007) 100% 2007 (2007-2008) 100% 2008 (2008-2009) 100% 2009 (2009-2010) 100% 2010 (2010-2011) 100% Improvement Activities/Timelines/Resources: Timelines (FFY) 2005 Improvement Activity Fill Staffing Vacancies Resources BSEA staff time Fill existing BSEA staffing vacancies (the director of BSEA left in March 2005 and the Coordinator of Mediation left soon after); the hiring of a new director will allow for additional supervisory and managerial resources to be dedicated to ensuring that hearing officers comply with federally mandated timelines for issuing decisions. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) BSEA staff time See Appendix A for a complete description. 2005 - 2010 Revise Internal Procedures BSEA staff time The BSEA will revise internal procedures and implement these revisions, including an increase in supervision/monitoring to ensure that Hearing Officers who are assigned multiple cases that have similar decision deadlines will have such cases reassigned to other hearing officers who are more available to conduct the hearing and write the decision in a timely manner. 159 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 17 Submitted February 1, 2010 Indicator 17 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 100% Actual Target Data for FFY 2008 (2008-2009): [(20 + 4) / 24] x 100 = 100% 3.2 – Hearings fully adjudicated: 24 3.2(a) – Decisions within timeline (including expedited): 4 3.2(b) – Decisions within extended timeline: 20 # of Hearings (fully adjudicated) 24 Decisions issued within 45-day timeline or a timeline that is properly extended by the hearing officer at the request of either party. 24 % of fully adjudicated due process hearing requests that were fully adjudicated within the 45-day timeline or a timeline that is properly extended by the hearing officer at the request of either party or in the case of an expedited hearing, within the required timelines. 100% Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 (2008-2009): Explanation of Progress or Slippage During FFY 2008, 24 hearings were fully adjudicated by the Bureau of Special Education Appeals (BSEA). Of those, four hearing decisions were issued during the 45-day timeline, and 20 were issued within a timeline that was properly extended by the hearing officer at the request of either party, or within the required timelines for an expedited hearing. Since MASSDE established the baseline and target date in FFY 2004, the data for Indicator 17 has shown improvement. In FFY 2004, the baseline year, the percentage of fully adjudicated decisions within appropriate timelines was 91.6%; 88.8% in FFY 2005; 96.2% FFY 2006; and 94.4% in FFY 2007. During the FFY 2008 reporting period, Massachusetts met its measurable and rigorous target of 100%. 160 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 17 Submitted February 1, 2010 Improvement Activities Massachusetts’ improvement in this area during this reporting period is due to the BSEA’s continued efforts to revise internal procedures to better manage hearing timelines. This year, the BSEA worked extensively with professional associations (e.g., through the Northeast Regional Resource Center (NERRC)) to exchange best practice resources with other state education agencies, and to access training opportunities for hearing officers. As a result of these interactions, and additional research about issues that affect timelines (including managing hearings involving pro se parties), the BSEA has continued to increase supervision and monitoring of hearing officers’ caseloads. Oversight and equalization of case loads help to ensure that multiple cases with overlapping procedural timeframes and decision deadlines are not assigned to a single hearing officer, thereby allowing hearing officers to conduct hearings and issue decisions in a timely manner. In addition, as reported in the October 1, 2009 letter from MASSDE to OSEP, the BSEA has drafted and implemented the use of a Guide for Pro Se Litigants and an accompanying Pro Se Reference Manual to assist with the management of hearing timelines and processes. The results of the ways that these publications affect the timely adjudication of due process hearing requests and related indicators will be reported in the FFY 2009 APR. Massachusetts’ Response to the March 5, 2009 Verification Visit Letter With the FFY 2008 APR, MASSDE is required to submit documentation demonstrating procedures to ensure that LEAs convene a resolution session within 15 days of receipt of the parent’s due process complaint, or within seven days of receipt of the parent’s due process complaint on a disciplinary matter, and that timely resolution sessions have occurred consistent with these procedures unless the parent agrees in writing to waive the resolution meeting or the parties agree to engage in mediation. Information on monitoring activities related to resolution sessions is discussed fully in the APR for Indicator 18. OSEP also requested that MASSDE submit documentation demonstrating that if the resolution process is unsuccessful in resolving the parent’s due process complaint the 45-day due process hearing timeline commences at the expiration of the 30-day resolution period under 34 CFR § 300.510(a), or within the adjusted time period described in 34 CFR § 300.510(c). The BSEA has incorporated into its hearing rules a rule that specifically addresses advancement of the start of the hearing timeline when the resolution process is unsuccessful. Rule III.B (see Attachment 4), states: 161 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 17 Submitted February 1, 2010 A hearing may be held earlier than the assigned date when the parties jointly request advancement and notify the Hearing Officer in writing that the resolution session either has been waived or has been completed without resolution before the expiration of the thirty (30) day time line for the resolution session. In addition, the BSEA sends to each parent initiating a due process hearing request an Advancement/Postponement Request Form that allows the parent to request a change in hearing timelines to a date earlier than the initially assigned hearing date. This form is included in the informational materials sent to parents upon the filing of a due process hearing request in order to facilitate the process for advancing timelines, and help to ensure that hearings are convened in a timely manner upon the expiration of the resolution period or during adjusted time periods. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): The Massachusetts Part B State Performance Plan (MA SPP) and Annual Performance Report (APR) have been amended to reflect the changed requirements for aligning the language of Indicator 17 with federal regulations. The targets, improvement activities, timelines, and resources remain appropriate for FFY 2008. 162 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 18 Revised February 1, 2010 Indicator 18: Hearing Requests Resolved by Resolution Sessions SPP Monitoring Priority: Effective General Supervision Part B / General Supervision Indicator 18: Percent of hearing requests that went to resolution sessions that were resolved through resolution session settlement agreements. (20 U.S.C. 1416(a)(3(B)) Measurement : Percent = (3.1(a) divided by 3.1) times 100. Overview of Issue/Description of System or Process: The BSEA has devised and implemented the use of a form to be filed with the BSEA by the moving party (parent) in the event a case is settled through the resolution process prior to the hearing date. Said form constitutes a withdrawal of the hearing request and closure of the case. Baseline Data for FFY 2005 (2005-2006): 48% (212/442) Discussion of Baseline Data: The 48% baseline data figure (212/442) is calculated based on: (1) 212: represents 50% of all cases (424) involving parental requests for hearing which were not resolved through mediation or substantive hearing officer decision on the merits. Only thirteen (of the 212 cases reported in Table 7) were cases in which parents filed a written form with the BSEA, per BSEA procedure, withdrawing a hearing request and citing settlement at resolution session as basis for the withdrawal. We believe that the number 424 is likely highly inflated (and hence not deemed reliable) as it includes situations in which private settlements may have resulted outside the resolution session process; cases which were withdrawn without settlements having occurred; cases in which a settlement conference was conducted by the BSEA resulting in withdrawal of the hearing request; cases in which a pre-hearing conference resulted in a settlement and/or withdrawal of the hearing; and cases in which a dispositive ruling was issued by a hearing officer; and we, therefore, reduced it by half. While we admit this is arbitrary, we believe it is closer to reality than to suggest either that all of the 424 cases were settled as a result of a resolution session or that only 13 were settled as a result of a resolution session. As you will see in our improvement activities, we will be focusing on how we may be able to obtain more accurate data in the future. (2) 442: the total number of hearing requests, minus the number of hearings requested by LEAs (resolution session not required), minus the number of mediations related to due process (notion being that parties may opt for mediation in lieu of resolution session). This number similarly is not deemed reliable at this time for the following reasons: a) there may be cases in which both a resolution session and a mediation were held; b) there are likely cases in which both parties waived the resolution session and did not opt for mediation; and c) there are likely cases in which the LEA failed to timely convene a resolution meeting within the 15 days and therefore it was constructively waived. None of these situations is accounted for in the above-noted number. The Massachusetts Steering Committee, mindful of the quality of the data in this Indicator recommended setting very modest targets. 163 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 18 Revised February 1, 2010 FFY Measurable and Rigorous Target 2005 (2005-2006) 48% (our baseline) 2006 (2006-2007) 48% 2007 (2007-2008) 48% 2008 (2008-2009) 49% 2009 (2009-2010) 50% 2010 (2010-2011) 50% Improvement Activities/Timelines/Resources: Timelines (FFY) 2005 - 2010 Improvement Activity Collaboration with Stakeholders (Impacts all Indicators) Resources BSEA staff time See Appendix A for a complete description. 2006 - 2010 Review Procedures BSEA staff time The BSEA will review procedures for closing hearing requests and determine points at which data might be gathered that is more reliable and complete. 2006 - 2010 Implement New Data Collection Procedures BSEA staff time The BSEA will refine data procedures to more effectively gather data for this indicator. 2006 - 2007 Summer Institute on Resolution Sessions The BSEA will off a Summer Professional Development Institute related to effective Resolution Sessions. 164 BSEA staff time, contracted trainer Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 18 Submitted February 1, 2010 Indicator 18 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 49% Actual Target Data for FFY 2008 (2008-2009): (20 / 47) x 100 = 42.5% 3.1 – Resolution meetings: 47 3.1(a) – Written settlement agreements: 20 Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008: Explanation of Progress or Slippage In prior years the Bureau of Special Education Appeals (BSEA) has reported difficulties with its data collection method(s) for Indicator 18, which resulted in a lack of reliability for baseline data and an underreporting of information on resolution sessions and settlement agreements reached as a result of those sessions. Notable is the baseline data in FFY 2005 and actual data for FFY 2007, representing a rate of less than 4% of hearing requests that went to resolution session were resolved through resolution session agreements. For FFY 2008, the BSEA significantly revised its data collection procedures and resources and is pleased to report increased validity and reliability of the data for Indicator 18. The rate of 42.5% is a significant improvement toward meeting the measurable and rigorous target of 49%. Improvement Activities Massachusetts’ Response to the March 5, 2009 Verification Visit Letter OSEP advised MASSDE in the Massachusetts Part B FFY 2007 SPP/APR Response Table and in the Verification Visit letter of March 5, 2009, of available technical assistance and required the state to report on (1) the technical assistance sources from which the state received assistance; and (2) the actions that Massachusetts took as a result of that technical assistance, related to Indicator 18. In response to this instruction and MASSDE’s continued efforts to improve the reliability of data, during FFY 2008 the BSEA engaged in a series of technical assistance efforts, including accessing available resources such as survey information of other states’ methods of data collection, to inform its review and revision of its process for collecting data on resolution session and results. Recognizing the lack of reliability and likely under-reporting that resulted from LEAs reporting to the BSEA directly on resolution sessions, data collection is now incorporated in the hearing officers’ management of due process complaint timelines. Specifically, the hearing officer initiates a conference call with the parties nineteen (19) days after the initial hearing request, and asks the parties for information about the status of the resolution meeting and any agreement reached by the parties. This direct communication, the documentation of which is filed with the BSEA Assistant Director, has allowed for more accurate and timely reporting of sessions and outcomes in FFY 2008, thereby increasing the validity and reliability of the data reported, and resulting in significant progress toward meeting annual measurable and rigorous targets. MASSDE has implemented changes to its procedures that help to ensure that LEAs convene a resolution session within 15 days of receipt of the parent’s due process complaint, or within seven days of receipt of the parent’s due process complaint on a disciplinary matter, and that timely resolution sessions have occurred consistent with these procedures unless the parent agrees in writing to waive the resolution meeting or the parties agree to engage in mediation. Through the Coordinated Program Review (CPR) 165 Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 18 Submitted February 1, 2010 and Mid-Cycle Reviews (MCR) processes, Program Quality Assurance (PQA) reviews LEAs’ compliance with standards and criteria regarding timely resolution sessions. Specifically, monitoring teams examine student records, copies of agreements to waive resolution sessions, and copies of resolution agreements to assess LEAs’ compliance with the federal requirements for timely convening of or waiver of resolution sessions, and resolution of disputes as a result of resolutions sessions, as described in 300 CFR § 300.510. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008: MASSDE has amended the timelines in the improvement activities section of the Massachusetts State Performance Plan (MA SPP) for Indicator 18 to reflect continued activities toward ensuring valid and reliable data collection procedures. See the MA SPP for revisions. 166 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 19 Revised February 1, 2010 Indicator 19: Mediation Agreements SPP Monitoring Priority: Effective General Supervision Part B / General Supervision Indicator 19: Percent of mediations held that resulted in mediation agreements. (20 U.S.C. 1416(a)(3)(B)) Measurement: Percent = [(2.1(a)(i) + 2.1(b)(i)) divided by 2.1] times 100. Overview of Issue/Description of System or Process: Mediation is a voluntary and confidential process. Each mediator will conduct mediation slightly differently, but mediations usually follow this structure: The mediator will give an overview of the process in a joint session with the parties. In this session the mediator asks each participant to present the issues and explain the situation from his or her point of view. From there the mediator may move into separate sessions with each party. These sessions might be used to clarify the issues and/or generate options for resolution. These separate sessions might go back and forth a few times but what happens in the end is that the parties are brought back together. What usually unfolds during this process is an agreement and it is drafted at the mediation. Baseline Data for FFY 2004 (2004-2005): # of Mediations 660 # of Mediation Agreements 567 % of Mediations Held that Resulted in Mediation Agreements 85.9% Discussion of Baseline Data: The data reveal that of the 660 mediations held during 2004-05, almost 86% resulted in a mediation agreement. This is a continuation of the consistently high level of mediation agreements reached in Massachusetts over the past two years. In 2002-03, 79% of mediations resulted in mediation agreements, as did 74% of the mediations in 2003-04. The Massachusetts Steering Committee unanimously recommended that our initial target setting be modest and with this Indicator in particular we believe a maintenance target is more appropriate than an increase. Massachusetts has a very high level of mediation agreements reached, and it may be the highest level in the nation. While it is important to continue to track mediation agreements, we believe it is inappropriate to set a target higher than the current level we have reached in Massachusetts, as mediation is a voluntary activity and we do not want to suggest in writing or in target setting that we are seeking to compel parties in mediation to reach agreement. Therefore the targets set for this first six-year period are essentially maintenance targets. 167 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 19 Revised February 1, 2010 FFY Measurable and Rigorous Target 2005 (2005-2006) 85.9% 2006 (2006-2007) 86% 2007 (2007-2008) 86% 2008 (2008-2009) 75% - 86% 2009 (2009-2010) 75% - 86% 2010 (2010-2011) 75% - 86% Improvement Activities/Timelines/Resources: Timelines (FFY) 2005 Improvement Activity Fill Staffing Vacancies Resources BSEA staff time Fill existing BSEA staffing vacancies (the director of BSEA left in March 2005 and the Coordinator of Mediation left soon after); the hiring of a new director will allow for additional supervisory and managerial resources to be dedicated to ensuring that hearing officers comply with federally mandated timelines for issuing decisions. 2005 - 2010 Collaboration with Stakeholders (Impacts All Indicators) BSEA staff time See Appendix A for a complete description. 2005 - 2010 Training and Technical Assistance in Special Education Mediations The BSEA will receive training in special education mediations on an on-going basis from national and regional technical assistance providers. 168 BSEA staff time, national technical assistance providers Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 19 Submitted February 1, 2010 Indicator 19 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 75% - 86% Actual Target Data for FYY 2008: [(43 + 672) / 846] x 100 = 84.5% 2.1 – Mediations held: 846 2.1(a)(i) – Mediation agreements related to due process complaints: 43 2.1(b)(i) – Mediation agreements not related to due process: 672 Although OSEP no longer requires states to submit Table 7, MASSDE is submitting with this report the Report of Dispute Resolution Under Part B of the Individuals with Disabilities Education Act, 2008-2009, to document the data reported for Indicator 19. Please see Appendix E. Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FYY 2008 (2008-2009): Explanation of Progress or Slippage The MASSDE mediation program is managed by the Bureau of Special Education Appeals, Mediation Office (BSEA-Mediation), and is nationally recognized as providing highly effective mediation services. The MA SPP identified our target setting for this indicator to be a maintenance target. Although BSEAMediation recognizes that tracking mediation agreements was important, it is not appropriate to suggest that we seek to “compel” parties in mediation to reach agreement in order to meet identified targets. While the 84.5% reported for FFY 2008 represents a slight increase from the FFY 2007 percentage of 83.9%, and is slightly lower than our FFY 2004 baseline year of 85.9%, this percentage meets MASSDE’s essential goal of maintaining a high level of mediation success. Of note is the decrease in the number of mediations held in FFY 2008 (846) from the number of mediations held in FYY 2007 (906). In FFY 2008, MASSDE met its revised measurable and rigorous target. The BSEA will continue to work toward meeting the target percentage range for this indicator. Improvement Activities In FFY 2008, BSEA-Mediation continued to focus on training and technical assistance in special education mediations to improve its mediation program. For example, mediators participated in training offered by the Association of Conflict Resolution (ACR), the U.S. Department of Education Office for Civil Rights (OCR), and the Massachusetts Department of Public Health (MASSDPH) on issues related to alternative dispute resolution, Section 504 of the Rehabilitation Act, and state school health laws. Each of these efforts informed mediators’ knowledge of substantive areas at issue in disputes. Also, BSEAMediation assisted in developing and implementing resources available to pro se parties engaged in dispute resolution, including mediation. (See the FFY 2008 APR for Indicator 17 for an overview of the Guide for Pro Se Litigants and Pro Se Reference Manual.) Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): MASSDE is submitting a revised State Performance Plan (MA SPP) for Indicator 19 that redefines measurable and rigorous targets in a range, beginning with FFY 2008. The consensus among mediation practitioners, and affirmed by OSEP, is that 75-85% is a reasonable rate of mediations that result in agreements, and is consistent with national mediation success rate data. MASSDE identifies 86% as the upper range for the target, consistent with the previously established targets for FFY 2006 through FFY 2010. See the MA SPP for the revised measurable and rigorous targets. Other improvement activities, timelines, and resources remain appropriate for FFY 2008. 169 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 20 Revised February 1, 2010 Indicator 20: State Reported Data SPP Monitoring Priority: Effective General Supervision Part B / General Supervision Indicator 20: State reported data (618 and Massachusetts State Performance Plan and Annual Performance Report) are timely and accurate. (20 U.S.C. 1416(a)(3)(B)) Measurement: State reported data, including 618 data, State Performance Plan, and Annual Performance Reports, are: a. Submitted on or before due dates (February 1 for child count, including race and ethnicity; placement; November 1 for exiting, discipline, personnel and dispute resolution; and February 1 for Annual Performance Reports and assessment); and b. Accurate, including covering the correct year and following the correct measurement. States are required to use the “Indicator 20 Scoring Rubric” for reporting data for this indicator. Overview of Issue/Description of System or Process: There are two reporting periods per year for the 618 data. Table 1 (Child Count), Table 3 (Educational Environments) and Table 6 (Assessment) data are due on February 1. Table 2 (Personnel), Table 4 (Exiting), and Table 5 (Discipline) data are due on November 1. MASSDE reports its 618 and SPP/APR data from more than one data source. All student-level databases used to report the 618 data also utilize the same state assigned student identifier (SASID) used in our Student Information Management System (SIMS) database for consistency in reporting. Table 1 (Child Count) and Table 3 (Educational Environments) report student information from the October 1 collection of our SIMS database. Until this year, MASSDE collected student-level data in SIMS four times a year, October 1, December 1, March 1 and at the end of the school year. With additional flexibility provided by the IDEA Reauthorization, MASSDE has removed the December 1 collection, previously used to collect student level data for special education students only. MASSDE uses information collected through the Massachusetts Comprehensive Assessment System (MCAS) to provide student information for Table 6 (Assessment). This information is not collected in our SIMS database but is collected in a separate database specific to MCAS. In the MCAS database, the data is collected at the student-level and identifies each student according to SASID. Currently collected through our District and School Staff Report (DSSR) are the Table 2 (Personnel) data. These data are collected on an aggregate level for each school and district. Through the ongoing development of our teacher database we hope to continue providing timely and accurate data for Table 2 and plan on scheduling the data collection for this database to meet the needs of OSEP. MASSDE continues to use the end of year SIMS submission to establish initial data for Table 4 (Exit data). However, in order to submit accurate numbers for the dropout category in Table 4, MASSDE uses the data submitted through SIMS in the following October 1 submission to identify any returned dropouts, summer graduates and certificates of attainment. Students who return to school after being coded as a dropout during the previous end of year submission will not be counted in the dropout count. Table 5 (Discipline) data are collected through MASSDE’s School Safety & Discipline Report (SSDR). This is a student-level collection that is open for submissions all year from July to July. The system accepts late submissions until October of the following academic year. 170 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 20 Revised February 1, 2010 Baseline Data for FFY 2004 (2004-2005): In order to align with OSEP’s assessment method for this Indicator, MASSDE is implementing the OSEPrecommended scoring rubric to display its baseline data performance on this indicator (see Appendix F). According to the rubric, the baseline data shows MASSDE to have performed at 52.9% on the timely and accurate submission of its state reported data. Indicator #20 Calculation A. APR Grand Total = 63 B. 618 Grand Total = 0 C. APR Grand Total (A) + 618 Grand Total (B) = 63 D. Subtotal (C divided by 119)* = 0.529 52.9% E. Indicator Score (Subtotal (D) x 100) = Discussion of Baseline Data: Due to the timing of our previous data collection schedules and the time needed for cleaning and checking of the data, delays have occurred in most of the OSEP collections. We believe our compliance with Table 1 and Table 3 will dramatically increase with our move from the December 1 to the October 1 collection. We also are hopeful the developing teacher database will help us provide timely and accurate data for Table 2. We plan to time the data collection for this database to meet the needs of OSEP’s data collection. Our intention is to meet the Table 1, Table 2 and Table 3 deadlines in 2006. We will continue to work on our compliance for Table 4 and Table 5. Our system requires us to collect the October data after collecting end of year data in the previous year in order to complete these data. Currently, our October data is ready for analysis in January or February after thorough cleaning and checks of the data. For this reason, the Table 4, exiting data has been submitted after the November 1 deadline. We anticipate submitting the 2004-05 Table 4, Exit data by March 1, 2006 and will work with the data to meet the compliance deadline by 2010. The Table 5, Discipline data is on a similar cycle where we close the data submission window in October of the following academic year. This allows districts the time to submit accurate and complete data but makes it difficult for us to submit the data by the November 1 deadline. We anticipate submitting the 2004-05 Table 5, Discipline data by December 1, 2005 and will work with the data to meet the compliance deadline by 2010. The Annual Performance Report has been submitted by the deadline each year with as accurate data as we have available at the time of reporting. For example, we have submitted our discipline data in the previous APRs but know there has been room for improvement in the reporting of this data. We are working to improve the reporting of the data by districts each year through adjustments made to our collection tool. We currently do not compute a graduation rate in Massachusetts and therefore could not provide percent of graduates in the previous APRs. Instead, we have provided the percent of students receiving a competency determination by passing the statewide MCAS test in Math and English/Language Arts and completing all required academic coursework. As we determine a graduation rate calculation and begin implementing it among our districts, we will be able to more accurately report graduation data. 171 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 Indicator 20 FFY Revised February 1, 2010 Measurable and Rigorous Target 2005 (2005-2006) 100% 2006 (2006-2007) 100% 2007 (2007-2008) 100% 2008 (2008-2009) 100% 2009 (2009-2010) 100% 2010 (2010-2011) 100% Improvement Activities/Timelines/Resources: Timelines (FFY) 2005 - 2010 Improvement Activity Collaboration with Stakeholders (Impacts All Indicators) Resources MASSDE staff time See Appendix A for a complete description. 2005 – 2010 Student Information Management System (SIMS) MASSDE staff time MASSDE will continue to implement studentlevel data collection procedures through SIMS. MASSDE will review and revise components of SIMS on an on-going basis in order to ensure that data collected are valid, reliable, and timely. 2006 - 2010 Education Personnel Information Management System MASSDE will design, pilot and implement a statewide educator database. The database will collect data at the individual-level and include data on position, certification/ specialization and subject areas of instruction. This data will be used for future reporting of the 618 personnel data (Table 2). 172 MASSDE staff time Massachusetts Part B Annual Performance Report for FFY 2008 Indicator 20 Submitted February 1, 2010 Indicator 20 – Annual Performance Report for FFY 2008 APR FFY Measurable and Rigorous Target 2008 (2008-2009) 100% Actual Target Data for FFY 2008 (2008-2009): a. 100% submitted on or before due-dates; and b. 100% of data submitted accurately Indicator #20 Calculation A. APR Grand Total 43 B. 618 Grand Total 47 C. APR Grand Total (A) + 618 Grand Total (B) = 90 Total N/A in APR 0 Total N/A in 618 -4 Base 90 D. Subtotal (C divided by Base*) = 1.0 E. Indicator Score (Subtotal D x 100) = 100.0 The target data for FFY 2008 were based on MASSDE’s ability to produce its required data submissions for FFY 2008 (618 data: Tables 1-7, and the APR submission) in a manner consistent with OSEP’s data submission requirements. The percent compliance indicates the percentage of data submissions that were successfully submitted for FFY 2008. For further explanation on how this calculation was derived, please refer to the scoring rubric located in Appendix F. Discussion of Improvement Activities Completed and Explanation of Progress or Slippage that occurred for FFY 2008 (2008-2009): Explanation of Progress or Slippage MASSDE has improved its performance on Indicator 20 over the FFY 2007 score of 98.8% by meeting its measurable and rigorous target of 100% in FFY 2008. Using the scoring rubrics, data for all seven 618 data tables are considered timely and complete, and passed the edit checks. Improvement Activities FFY 2008 was the second year in which MASSDE collected individual-level personnel data using Massachusetts Education Personnel Information Management System (EPIMS). With this resource, MASSDE instituted more rigorous data validations, and refined definitions for reporting categories, as it continued to train and support LEAs efforts to ensure the accuracy and quality of the data submitted. Massachusetts has been approved for EDEN-only status for all 618 data submissions. For all 618 data submissions, Massachusetts has used the EDEN submission system for timely reporting. MASSDE will continue its efforts to provide timely and accurate data to OSEP through our future EDEN submissions, and Table 7 submissions. To meet compliance requirements for the FFY 2010 APR submission, MASSDE will continue to work with personnel to maintain the high quality of data accuracy and meeting of timelines that it has shown in the past. Revisions, with Justification, to Proposed Targets / Improvement Activities / Timelines / Resources for FFY 2008 (2008-2009): MASSDE determined that use of the Indicator 20 scoring rubric that was distributed in October 2009 by OSEP did not require any change to the baseline data as reported in the SPP. Proposed targets, improvement activities, timelines and resources remain relevant for FFY 2008. 173 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A Appendices Appendix A: Description of Selected Cross-Cutting Improvement Activities Many of the MASSDE improvement activities are cross-cutting; they have an impact on multiple indicator areas. The MA SPP Improvement Activity charts for each indicator list the activities that relate to that particular indicator. Below is a more complete description of the cross-cutting activities. Contents of Appendix A: ARRA Title II-D Technology Competitive Grants Central Massachusetts Communities of Care Positive Behavioral Interventions (PBIS) Grant Collaboration between MASSDE Curriculum and Instruction Math Office and Special Education Planning and Policy Development Office (SEPP) Collaboration with Federation for Children with Special Needs Collaboration with Stakeholders Community/Residential Education Project Comprehensive System of Personnel Development Training Project (CSPD) Curriculum and Instruction Summit District and School Assistance Centers (DSAC) Dropout Prevention and Recovery Workgroup Dropout Prevention, Intervention, and Recovery Website Educational Proficiency Plans (EPP) Emergent Literacy Grant Graduation and Dropout Prevention and Recovery Commission Inclusive Concurrent Enrollment Partnership Programs for Students with Disabilities Massachusetts FOCUS Academy Massachusetts Online Resource Library National Association of State Directors of Special Education (NASDSE) Satellite Series Project FOCUS Academy Revision of “Is Special Education the Right Service?” (ISERS) Revision of “Ten Step Guide for Comprehensive Educational Assessment of Students with Visual Impairments” Secondary School Reading Grant Secondary Transition - TransitionWorks: Innovative Strategies for Transitioning Youth with Disabilities from School to Work Sign Language Video Resource Library SPecial EDition Online Newsletter Special Education Leadership Academies and Seminars Special Education Professional Development Summer Institutes Special Education Program Improvement Grants – Fund Code 274 Special Education Program Improvement Grants – Fund Code 249 Special Education Website Trauma Sensitive Schools Initiative Work-Based Learning Plans for Students with Disabilities 174 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A ARRA Title II-D Technology Competitive Grants – MASSDE Student Support Services Unit Indicators Impacted: 1, 2 The purpose of this two-year federal grant program is to improve student achievement through the effective use of technology in elementary and secondary schools. This program will support proposals that create robust, technology-infused environments that sustain the following four priority areas. 1. Projects that work collaboratively with MASSDE to create, implement, and evaluate online courses/modules for underserved high school students in alternative education, credit recovery, or credit acceleration programs. Grant recipients may adapt an online course/module or partner with an organization to design and develop the online courses/modules that align with the Massachusetts Curriculum Frameworks or the Massachusetts High School Program of Studies (MassCore). Products created must be in a format that can be shared with MASSDE, and successful models will be disseminated and used by other districts. 2. Projects that create effective technology-rich environments that support existing tiered-instruction in English language arts and mathematics. The tiered-instruction may include all three levels: core instruction, supplemental instruction, and intensive intervention on any one level. 3. Projects in which the grant recipients will work collaboratively with MASSDE’s partners (e.g., WGBH Teachers' Domain, Verizon Thinkfinity) or other research-based successful models, to: a. design, develop, and implement online professional development; b. mentor participating teachers who are teaching in technology-rich classrooms; c. support participating teachers to reflect and refine their teaching; and d. select promising practices that integrate technology into curriculum and instruction. 4. Projects that use appropriate technology effectively to implement formative, benchmark, and summative (MEPA) assessments, particularly in schools that have high number of English language learners (ELL) students. Central Massachusetts Communities of Care Positive Behavioral Interventions (PBIS) Grant Indicators Impacted: 2, 4, 5 The purpose of this federal grant program is to support the partnership of select school districts in Worcester County with the Central Massachusetts Communities of Care Project (CMCC) for the purpose of developing and implementing PBIS, a tiered system for improving school climate by supporting positive behaviors throughout the school. Schools participating in the grant program will receive PBIS training and associated technical assistance and other resources from the CMCC. CMCC is a provider of care management services for youth with serious emotional disturbance and has two community-based family centers in Worcester County. The priorities of the grant program are to: Increase the capacity of school districts in Worcester County to foster positive school climates, support positive behaviors throughout participating schools, and to reduce disruptive behaviors; and Increase participating schools' ability to identify students, grades 4-8, in need of mental health services, and to respond to the need for intensive support via both internal capacity and communitybased specialty providers of coordinated wraparound services. The goal of the school district-CMCC partnership is to identify at-risk students who are in need of mental health services and to reduce and/or prevent court involvement among students with emotional impairments. Participating districts receive professional development as well as onsite assistance in the development and implementation of the principles of PBIS. 175 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A Collaboration between MASSDE Curriculum and Instruction Math Office and Special Education Planning and Policy Development Office (SEPP) Indicators Impacted: 3, 5 With input and guidance from the urban superintendents, the Massachusetts Urban Math Liaisons network (math directors who provide guidance and support around mathematics in Massachusetts public schools) identified the need to better support students with disabilities in Mathematics as a critical priority in the urban districts. In response to this need, the Math Specialist Support meetings will be dedicated to developing a district level collaboration between special educators and math specialist. The learning objectives for this collaboration include: 1. Creating sense-making opportunities regarding the necessity of – and resources for – promoting the belief that students with disabilities can learn rigorous mathematics and deserve a chance to learn high quality and higher order mathematics; 2. Developing an understanding of what contributes to the reasons students with disabilities have difficulties learning mathematics by exploring research findings and listening to experts on the subject; 3. Articulating necessary practices and strategies to support students with mathematics difficulties, and identifying strategic customization of instructional practices; and 4. Identifying district and school structures and supports for students with disabilities learning mathematics, including professional development, coaching, curriculum needs, policy, and time for collaboration. Collaboration with Federation for Children with Special Needs Indicators Impacted: 3, 5, 8, 13 MASSDE has a longstanding relationship with the Federation for Children with Special Needs (FCSN), the Parent Training and Information Center federally funded to provide free information, support, technical assistance and workshops to Massachusetts’ families who have children with disabilities. FCSN provides training, and technical assistance to families throughout Massachusetts on behalf of MASSDE. Training topics include: Transition from Early Intervention to Special Education Parent’s Rights IEPs The Massachusetts Comprehensive Assessment System (MCAS) Transition 101 Understanding My Child’s Learning Style The FCSN has partnered with MASSDE in the writing and implementation of the State Personnel Development Grant. Through this collaboration, FCSN has provided 3-credit graduate level courses to Massachusetts educators on working with parents, worked on self-guided modules for parents and families on the Successful Transition for Middle and High School Students, is designing alternate version of these modules for special populations such as Spanish speakers, and has provided the opportunity for parent/district collaboration through the A.P.P.L.E. model. Additionally, the FCSN has participated in the state stakeholder input opportunities, in the development of MASSDE technical assistance documents, and has included MASSDE as presenters in the annual Visions of Community conference. 176 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A Collaboration with Stakeholders Indicators Impacted: 1-20 Special Education Advisory Council (SAC) – The SAC is a group of parents and professionals charged by federal special education law and the state to provide policy guidance to MASSDE on issues affecting special education and related services for students with disabilities within the Commonwealth. SAC’s responsibilities include: Advising MASSDE on unmet needs within the state in the education of students with disabilities; Commenting publicly on proposed rules and regulations involving special education; Advising MASSDE on the development of evaluations and corrective action plans; and Assisting in the coordination of services to students with disabilities. State Special Education Steering Committee – Stakeholders from across disciplines, including parent, educators, administrators, advocates, agency representatives, meet annually as members of the Steering Committee to: Review baseline and current data (618 data and monitoring data); Identify areas in need of attention; and Plan for improvement activities. Community/Residential Education Project – Massachusetts Department of Developmental Services (MDDS) Indicators Impacted: 5, 13, 14 The Community/ Residential Education Project was developed through an interagency agreement between MASSDE and MDDS. The goal of the project is to facilitate effective transitions from school life to more independent life within the community for students receiving publicly funded special education services who also meet the MDDS eligibility criteria for services. This goal is accomplished by supporting less restrictive, more cost effective residential options, special education services, and community based supports. The project provides greater flexibility in service delivery based on individual support needs. Supports are provided to participants and their families that are designed to increase the family’s capacity to care for their child in the home and/or increase the participants’ and families’ capacity for effective interactions within the home and with the community. Students participating in this project may return home from residential education placements or utilize the project to obtain a diverse array of supports in their home communities as an alternative to an initial residential special education school placement. Comprehensive System of Personnel Development (CSPD) Training Project Indicators Impacted: 3, 5, 11, 13, 14 The CSPD Training Project was developed as a response to requirements of the Individuals with Disabilities Education (IDEA) 97. The Act required states to develop a multifaceted approach to personnel development under regulations for CSPD. To fulfill this obligation, the MASSDE’s Special Education Planning and Policy Development Office (SEPP) instituted a series of training activities to supplement ongoing personnel preparation activities provided within school districts and other agencies. The CSPD Training Project consists of three components: 1. Training Modules: SEPP is providing training units to assist school districts and other agencies in providing high quality professional development on special education related topics. The units consist of annotated PowerPoint Presentations and, in some cases, supplemental handouts. Topics presently available include: a. The Massachusetts IEP Process b. A Principal's Role and Special Education in Massachusetts c. Is Special Education the Right Service? d. Transition From Adolescence Into Adulthood in Massachusetts e. The Massachusetts Transition Planning Chart and Effective Transition Planning f. Specific Learning Disabilities: Eligibility Determination under IDEA 2004 177 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A 2. CSPD Trainers: SEPP has contracted with a limited number of trainers who receive ongoing training on the CSPD Training Modules. CSPD Trainers are made available as much as possible to groups of 50+ individuals in public schools, and approved special education schools. Requests for training for groups larger than 50 people serving multiple districts and/or agencies are given priority. 3. CSPD Districts: The 40 largest districts are invited to send their district's professional development provider to training sessions on the modules. It is an opportunity for participants to impact MASSDE work (including the development of new modules) and network with colleagues. Curriculum and Instruction Summit Indicators Impacted: 1, 2, 3, 8 MASSDE holds annual Curriculum, Instruction, and Assessment Summits, the purposes of which are to: share MASSDE resources for strengthening curriculum, instruction and assessment; identify needs for future development of curriculum resources and technical assistance; and build capacity of the department, districts and schools through regional partnerships. Topics from the FFY 2008 Summits include: Starting Out Right: Preventing and Closing the Achievement Gap Curriculum Alignment Online Courses and Resources for Standards-Based Teaching and Learning Narrowing Achievement Gaps in Reading and Writing Addressing the Achievement Gap: Parents as Teachers and Partners Effective Math Instruction for English Language Learners The Integration of Science and Literacy The Role of the Arts in Raising Academic Achievement Tools for Differentiated Curriculum and Instruction Tiered Instructional Models – Overview (Session I) to Application (Session II) Implementing a Balanced Assessment System Supporting Student Achievement in Science and Technology/Engineering Math Learning Communities in Practice District and School Assistance Centers (DSAC) – MASSDE Center for School & District Accountability Indicators Impacted: 2, 3, 5, 13 During FFY 2010 MASSDE opened six regionally based DSACs to help identified districts and their schools strategically access and use professional development and targeted assistance to improve instruction and raise achievement for all students. DSACs use a regional approach that leverages the knowledge, skills, and expertise of local educators to address shared needs through an emphasis on expanding district and school capacity for sustained improvement. Focused professional development offerings will be directed at building essential knowledge and skills of educational leaders and teachers in major content areas and for key student groups. The professional development offerings designed to help educators improve the outcomes for students with disabilities include graduate level courses on Universal Design for Learning, Creating Positive Learning Environments, Youth Development and Self-Determination and Transition Planning. Additionally, Math Specialists will focus on helping general and special educators develop the necessary skills to help improve the math skills of students with disabilities. Dropout Prevention and Recovery Workgroup – MASSDE Urban & Commissioner’s Districts Unit and Secondary Support Services Unit Indicators Impacted: 1, 2, 4, 14 This workgroup was created in summer 2008 and is supported by both the Urban and Commissioner’s Districts unit and the Secondary Support Services unit of MASSDE. The workgroup is comprised of 18 urban districts whose combined number of student dropouts represents almost half of the total number of students in the Commonwealth who drop out of school. The group’s focus is to facilitate sharing of promising practices in their districts, and to support district team action planning activities through face-to-face meetings and webinars. 178 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A Dropout Prevention, Intervention, and Recovery Website – MASSDE Student Support and Secondary School Services Unit Indicators Impacted: 1, 2, 14 Launched in July 2009, this website describes information and resources including an extensive collection of dropout reduction related articles/reports, other websites, dropout data overview information, and descriptions of state activities. New promising practices will be added as they are developed and evaluated. Educational Proficiency Plans (EPP) – MASSDE Student Support and Secondary School Services Unit Indicators Impacted: 1, 2, 3, 13, 14 School districts must develop an EPP for any student in the class of 2010 who does not score at 240 or above on the grade 10 English Language Arts (ELA) and Mathematics Massachusetts Comprehensive Assessment System (MCAS) tests. The EPP identifies the student's strengths and weaknesses, based on MCAS and other assessment results; coursework; grades; and teacher, student, and counselor input; and includes the courses in those subject areas the student is required to take in grades 11 and 12. The EPP requirement is intended to increase the likelihood that students graduating from high school have the requisite skills needed for success in college and a career. The EPP is not intended to promote test preparation or remedial courses for the junior and senior years of high school. Students are encouraged to and supported in taking challenging courses that will better prepare them for postsecondary opportunities. For students with disabilities, MASSDE recommends that the current IEP is reviewed prior to developing the student’s EPP to assist in identifying their strengths and weaknesses in the learning environment. Emergent Literacy Grant Indicators Impacted: 3, 5, 6 The Center for Applied Special Technology (CAST) is providing training to educators and parents in the use of research-based, universally-designed technology for developing literacy skills in early learners, especially those with cognitive disabilities, in an inclusive environment. Seventeen school districts that are involved in the Massachusetts Comprehensive System of Personnel Development are currently participating in the "Universally-Designed Technology for Literacy" project. During the three years of the project (2004-2006), it is expected that district capacity for supporting all learners in emergent literacy will be increased through the "trainer-the-trainer" professional development strategies used. For more information, see http://madoe.cast.org/. Graduation and Dropout Prevention and Recovery Commission – MASSDE Student Support and Secondary School Services Unit Indicators Impacted: 1, 2, 14 In August 2008 the Massachusetts State Legislature passed An Act to Improve Dropout Prevention and Reporting of Graduation Rates, which established a Commission to make recommendations in 10 topic areas. The Commission included representatives from a variety of youth-serving state agencies, the state legislature, and community organizations. The Commission’s work was shaped by testimony at three public hearings. The Massachusetts Executive Office of Education (MEOE) released the final Commission report Making the Connection, in October 2009. It includes findings and recommendations in four main areas: 1) new statewide expectations; 2) early identification; 3) effective prevention, interventions, and recovery; and 4) responsive reforms and budget priorities. Inclusive Concurrent Enrollment Partnership Programs for Students with Disabilities Indicators Impacted: 5, 13, 14 This state-funded pilot grant program is designed to build and expand partnerships between high schools in public school districts and partnering state public institutions of higher education to offer inclusive concurrent enrollment opportunities for students with significant disabilities, ages 18-22, in credit or non-credit courses that include non-disabled students. These partnerships will result in improved systems that better serve students with disabilities and support their college and work success. 179 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A The partnership programs are designed to: 1) promote and enhance academic, social, functional, and employment skills and outcomes; 2) provide opportunities for students with severe disabilities to participate with their non-disabled peers in inclusive credit or non-credit courses; and 3) promote participation in the student life of the college community. As part of the improvement and expansion of these programs, partnerships continue to develop their programs to include individualized community-based integrated employment opportunities that align with participating student career goals and course selection. Massachusetts FOCUS Academy (MFA) Indicators Impacted: 1, 2, 3, 4, 5, 8, 13, 14 MFA is a federally funded five-year grant (SPDG) that builds upon the previous successes of Project FOCUS and Project FOCUS Academy (PFA). The grant program provides online professional development opportunities and leadership institutes to educators, families, and other stakeholders on a variety of topics related to instructing students with disabilities, with a particular focus on middle and high schools. Course offerings include Universal Design for Learning, Positive Behavioral Supports, Family Engagement, and PostSecondary Transition. New courses for FFY2009 include: Differentiated Instruction, Collaborative Teaching Model, and Generalist Transition Courses I and II. The MFA programmatic offerings are research-based, and target areas that impact student outcomes. Massachusetts Online Resource Library Indicators Impacted: 1, 2, 3, 4, 5, 6, 8, 13, 14 Designed to provide evidence based practices in professional development, MASSDE/SEPP is developing an online Resource Library to highlight OSEP Funded Technical Assistance and Dissemination Resources and other online resources. The library will include information on the IRIS Center, Access Center: Improving Outcomes for Students K-8, Center for Positive Behavioral Interventions and Supports (PBIS), National Center on Response to Intervention, the NASDSE Satellite Series. Topics will include, but are not limited to: Co-Teaching Model Differentiated Instruction Transition Planning Positive Behavioral Interventions and Supports Response to Intervention Accommodations Role of the paraprofessional Supervising the paraprofessional National Association of State Directors of Special Education (NASDSE) Satellite Series Indicators Impacted: 2, 3, 5, 6, 13, 14 NASDSE, with support from the Pennsylvania Department of Education and the Pennsylvania Training and Technical Assistance Network (PaTTAN), provides the NASDSE Satellite Series. These telecasts bring nationally recognized experts to the state using technology, providing an affordable means of quality personnel development for a variety of stakeholders. Experts provide important information on high-interest topics to an audience that includes state directors of special education, state agency staff, local administrators, teachers, related service providers, higher education faculty, families and other stakeholders. The number of entities participating increased from 43 in 2008-2009 to 100 in 2009-2010. Topics of telecasts, made available in three ways (satellite signal, computer media stream, recorded video) have included: News You Can Use: Resources and Supports for Students with Autism and their Families; Partners in Progress: Youth/Young Adult Leaders for Systems Change; From Computers to Classrooms: Tackling Bullying in Today’s Schools; Understanding the Big Picture: Federal Policy and its Impact on the Classroom; Seclusion and Restraint: The Impact of Federal and State Policy on the Classroom; and Healthy, Physically Fit and Ready for Action: Addressing the Physical Education and Activity Needs of Individuals with Disabilities 180 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A Project FOCUS Academy Indicators Impacted: 1, 2, 3, 4, 5, 8, 13, 14 In the fall of 2004, MASSDE was awarded a three-year U.S. Department of Education (USDOE) funded State Improvement Grant (SIG) - Project FOCUS Academy (PFA). Project FOCUS Academy was designed to develop professional development programs to help students with disabilities build sound career goals and learn skills to ensure successful post-secondary outcomes. As part of the SIG, MASSDE works with educators from selected high schools. The design of the project requires study groups from high schools to participate in face-to-face and distance-learning professional development opportunities in the areas of: Transition/Post-Secondary Outcomes; School-wide Positive Behavioral Interventions and Supports; Universal Design for Learning; and Family Participation. The distance-learning model is provided through MASSDE's Massachusetts Online Network for Education (MassONE). Three courses in each content area are offered over a two year period. Building on this coursework, participants from the nine participating high schools are involved in Implementation Year activities in FFY 2007 ranging from using new techniques in classrooms to teaching other high school staff about each of the three content areas. Revision of “Is Special Education the Right Service?” (ISERS) Indicators Impacted: 3, 5, 6, 10 The ISERS document offers guidance for practitioners and parents on how to: Identify students with disabilities; Be knowledgeable of updated regulations and characteristics of disabilities; Define appropriate services and interventions; and Ensure a responsive general education environment for all students. The first stage of the revision began in March, 2009 with the reconvening of the Disability Workgroups composed of experts in each of the areas of disability to review the current document for accuracy and relevance in light of new research and current practices. The revision process will continue in FFY 2009. Revision of “Ten Step Guide for Comprehensive Educational Assessment of Students with Visual Impairments” Indicators Impacted: 3, 5, 6, 11, 13 The “Ten Step Guide” 1) recommends types of assessments that will be useful in making a determination of eligibility for a student with a visual impairment for the initial eligibility determination or three-year reevaluation; 2) helps to ensure a common understanding of the purpose and complexity of conducting the specialized educational assessment of students with visual impairments; and 3) provides resources to help educators meet the unique needs of students with visual impairments and to prepare them for further education, employment, and independent living. Members of the Vision Impairment Disability Workgroup, working with other experts in the fields of diagnosis, treatment, education and training of students with visual impairments, have collaborated to revise the “Ten Step Guide” to reflect updated regulatory information and include best practices. The revision includes a new section describing the “hidden” characteristics of a vision loss that affect academic and social factors. Understanding these characteristics will enable non-vision specialists to facilitate meaningful inclusion and participation of students with visual impairments throughout the school day. The Workgroup also recommended a name change for the next edition of the document to, “Guidelines for the Specialized Assessment of Students with Visual Impairments.” The revised document will include updated information, and will be re-formatted for use as a web-based resource. 181 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A Secondary School Reading Grant Indicators Impacted: 1, 2, 3, 5, 14 The Secondary School Reading grant program selects middle schools, high schools and vocational schools to receive four years of funding to develop and implement a school wide approach to improving reading achievement. Generally, each school receives between $8,000 and $10,000 per year. The first year of the grant is focused on self-assessment and program planning. The remaining three years are for action planning and implementation. The program has been in place for six years and has provided funding for more than 100 schools in four cohorts. For the first four years, all schools were eligible to compete for the grant. In the past two years, eligibility has been limited to schools that are considered high-need based on poor MCAS performance or unusually large special education populations. School wide approaches must include: involvement of and training for all professional and paraprofessional staff; reading across content areas; multiple targeted intervention programs for struggling readers; adequate time for reading instruction; assessment that drives instruction; a variety of flexible grouping patterns; and leadership structures that provide ongoing support and guidance. Funded districts must have an identified district coordinator and develop a cross-sectional Reading Leadership Team in each participating school. Members of the leadership teams attend MASSDE-sponsored professional development events about three times per year to discuss current research on adolescent literacy and share their efforts to improve adolescent literacy achievement. Members of each school’s Leadership Team, which consists of a cross-section of staff, including representatives from all content areas and special programs, attends these meetings. Secondary Transition - TransitionWorks: Innovative Strategies for Transitioning Youth with Disabilities from School to Work – Massachusetts Rehabilitation Commission (MRC) 5 Year Federal Grant Indicators Impacted: – 1, 2, 13,14 TransitionWorks: Innovative Strategies for Transitioning Youth with Disabilities from School to Work is a fiveyear grant from the U.S. Department of Education awarded to MRC to support transitioning youth with disabilities from school to work. The program focuses on aligning existing services and developing innovative practices in Boston, Springfield and Worcester. As part of this initiative vocational rehabilitation counselors are partnering with local school districts to support youth with disabilities in their transitions from school to work, post-secondary education, and independent living. MASSDE, the Federation for Children with Special Needs, Urban Pride, Commonwealth Corporation, and the Institute for Community Inclusion are partnering with MRC to implement the grant activities. Sign Language Video Resource Library Indicators Impacted: 3, 5 The purpose of this library project is to develop mathematics and science/technology vocabulary reference tools that educational interpreters and teachers of students who are deaf or hard-of-hearing may incorporate into their instruction. Available technical assistance will include written guides and DVDs. The design of the tool will be user-friendly and promote ready access for end users. In addition, under this project, MASSDE continues to provide a cost-free institute for educational interpreters to improve participants’ sign vocabulary in mathematics and science/technology content areas for grades 7-12. 182 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A SPecial EDition Online Newsletter Indicators Impacted: 1-20 The purpose of this newsletter is to provide school districts with on-going technical assistance and to prompt dialogue within, among, and between districts and MASSDE. Each issue of SPecial EDition will be organized around a State Performance Plan (SPP) indicator, and will spotlight particular strategies and best practices districts can use to meet and exceed indicator targets. The newsletter will also incorporate information from National Technical Assistance and Dissemination Centers (NTADC) and other resources to support strategy implementation. Special Education Leadership Academies and Seminars Indicators Impacted: 3, 5, 8, 11 As part of the Special Education Summer Institute, MASSDE annually provides two Special Education Leadership Academies. The academies provide opportunities for school district special education administrators to develop new leadership skills and to improve current skills. Academy I is open to administrators who have 1-5 years of experience, and Academy II is for administrators with more than 5 years of experience. Both Academies provide professional development to administrators on the following areas: Effective Leadership in the areas of state and federal laws and regulations; Fiscal Administration; Data Collection and Analysis; Staff Recruitment and Retention; Instructional Program Design and Improvement; and Access to the general curriculum based on the Massachusetts Curriculum Frameworks. MASSDE sponsored ongoing leadership seminars for former participants of the Leadership Academies where participants reconnect and network with their Academy colleagues and share effective practices, policies, strategies, or products with one another. Special Education Professional Development Summer Institutes Indicators Impacted: 1, 2, 3, 4, 5, 6, 8, 11, 13, 14 The Special Education Summer Institutes are statewide professional development opportunities provided free of change to special education professionals. Sponsored by MASSDE in partnership with school districts, educational collaboratives, institutions of higher education, and professional associations, the institutes are designed to support approved private special education schools, educational collaboratives, and local school districts’ efforts to increase the quality of programs and services provided to students with disabilities and increase the number of highly qualified educators working in the field of special education. Additionally, SEPP collaborates with the MASSDE office of Curriculum and Instruction to provide professional development institutes in specific curriculum content areas. Current and future topics in Special Education Institutes include: Access to Print: A Framework for All Learners Assessing English Language Learners (ELL) with Disabilities Effective Evaluation of Special Education Programs Language and Expository Discourse Managing Behavior in an Inclusive Classroom Mathematics and/or Science and Technology: American Sign Language (ASL) and Other Signed Systems Occupational Therapy Services in Educational Settings Strategies for Students with Sensory Integration Dysfunction in an Inclusive Classroom Sustaining Braille Proficiency of Licensed Teachers of Students with Visual Impairments Topics in Teaching Literacy to Students who are Deaf of Hard-of-hearing Special Education Professional Development Seminar for Educators of Students who are Deaf or Hard of Hearing 183 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A Special Education Program Improvement Grants – Fund Code 274 Indicators Impacted: 3, 4, 5, 11 The purpose of this grant program is to fund professional development activities to improve the skills and capacity of educators to meet the diverse needs of students with disabilities. Fund Code 274 is available to all public school districts and educational collaboratives (during FFY 2005 – FFY 2007). For FFY 2006 and FFY 2007, the priorities for Fund Code 274 are: Priority 1 - Enhancing Induction and Mentoring Programs (required) Priority 2a - Serving Students with Autism Spectrum Disorders in Inclusive Settings Priority 2b - Curriculum Development, Instruction, and Classroom Assessment Priority 2c - Meeting the Behavioral and Social Needs of a Diverse Student Population Priority 3 - Recruitment and/or Additional Professional Development Needs as Identified by the District or Educational Collaborative (10% max could be used for this priority) Almost every school district in the state will utilize Fund Code 274 funds, and participate in regional professional development conferences designed to support the priorities of the grant. Special Education Program Improvement Grants – Fund Code 249 Indicators Impacted: 3, 4, 5, 13 The purpose of this grant program is to fund professional development activities that will help to improve the skills and capacity of educators to meet the diverse needs of students with disabilities. Its priorities are to enhance program-based induction, mentoring, and retention programs and to advance the skills of educators through professional development activities. Fund Code 249 is available to all approved private special education schools. Priorities for FFY 2006 and FFY 2007 are: Induction/Mentoring; and Curriculum Development, Instruction, and Classroom Assessment. FFY 2008 priorities are: Educator Quality and Effectiveness: Induction, Mentoring, and Retention; Supporting Schools and Students: Curriculum Development, Instructional Practices, and Classroom Assessment; and College and Career Readiness: Secondary Transition Planning. All funded programs must be effective, sustained, and intensive in order to have a positive and lasting positive influence on classroom instruction and outcomes for students with disabilities. Special Education Website Indicators Impacted: 1-20 The Special Education section of MASSDE’s website provides a variety of tools, news items, and resources to districts, parents, and other stakeholders: http://www.doe.mass.edu/sped/. Some of the most visited sections of the website are: Headlines: http://www.doe.mass.edu/sped/ Contact Us – Opportunity for external customers to request information/ask questions: specialeducation@doe.mass.edu Grants: http://www.doe.mass.edu/sped/grants.html Training: http://www.doe.mass.edu/sped/training.html Forms and Notices: http://www.doe.mass.edu/sped/iep/ Special Education Program Plan: http://www.doe.mass.edu/sped/programplan/ Special Education Data: http://profiles.doe.mass.edu/state_report/special_ed.aspx 184 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix A Trauma Sensitive Schools Initiative – MASSDE Student Support Services Unit Indicators Impacted: 1, 2, 4 This MASSDE initiative focuses on the needs of students who have experienced or witnessed trauma by assisting with reducing the barriers that may affect academic performance, classroom behavior, and relationships that result from trauma. MASSDE is working to bring “trauma sensitive” practices to schools across the state through annual trainings and technical assistance that incorporate best practices and strategies for creating a safe supportive school environment where all students can learn and where students are held to high expectations. Work-Based Learning Plans (WBLP) for Students with Disabilities – MASSDE Student Support, Career & Education Services Indicators Impacted: 2, 13, 14 The Massachusetts WBLP is a diagnostic, goal-setting and assessment tool designed to drive student learning and productivity on the job. It was developed by the MASSDE through an interagency collaboration of employers, educators, and workforce development professionals. Through work-based learning experiences, students have an opportunity to learn about various career areas and try different work styles, find out what type of work they enjoy, find out how they learn best in a workplace setting, and find out what natural supports are available. Students learn and practice basic foundation skills and begin to develop lifelong career skills. Beginning in March 2009, SEPP collaborated with the MASSDE Connecting Activities Office to develop a one page guidance document called Using the Massachusetts Work-Based Learning Plan In Transition Planning Activities for Students with Disabilities and to enhance the WBLP Scoring Rubric. The document is intended to: encourage the inclusion of students with disabilities in WBLP programs; be used as an option for individual student transition planning; and support educators, employers, Connecting Activities field staff, Workforce Investment Boards, One Stop Career Centers and Local School-to-Career Partnerships in the implementation of quality work-based learning for students with disabilities. The WBLP scoring rubric is a student performance evaluation guide that facilitates employer assessment of participating students’ WBLP Foundation Skills. Through this collaboration, MASSDE also created the Work Experience and Transition Activities resource webpage. This resource lists resources, including websites, articles, and program materials, to assist in planning the work experiences and developing WBLPs for students with disabilities. 185 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix B Appendix B: Massachusetts Parent Survey for Indicator #8 This is a survey for parents of students receiving special education services. Your responses will help guide efforts to improve services and results for children and families. (Note: If you have more than one child currently receiving special education services, you may choose to submit one or more surveys, based upon your experiences as related to your children.) For each statement below, please select one of the following response choices: very strongly disagree (VSD), strongly disagree (SD), disagree (D), agree (A), strongly agree (SA), very strongly agree (VSA). You may skip any item that you feel does not apply to you or your child. Schools' Efforts to Partner with Parents 1. I am considered an equal partner with teachers and other professionals in planning my child's program. 2. I was offered special assistance (such as child care) so that I could participate in the Individualized Educational Program (IEP) meeting. 3. At the IEP meeting, we discussed how my child would participate in statewide assessments. 4. My child’s teachers give me enough time and opportunities to discuss my child’s needs and progress. 5. All of my concerns and recommendations were documented on the IEP. 6. Teachers and administrators at my child’s school invite me to share my knowledge and experience with school personnel. 7. I was given information about organizations that offer support for parents of students with disabilities. 8. I have been asked for my opinion about how well special education services are meeting my child's needs. 9. 10. 12. Teachers treat me as a team member. VSA VSD A SA VSA I feel I can disagree with my child’s special education program or services without negative consequences for me or my child. Teachers and administrators: 15. Agree SA IEP meetings are scheduled at a time and place that are convenient for me. Teachers are available to speak with me. 14. A My child's evaluation report is written in terms I understand. 11. 13. Disagree VSD SD D - seek out parent input. - show sensitivity to the needs of students with disabilities and their families. 16. - encourage me to participate in the decision-making process. 17. - respect my cultural heritage. 186 SD D Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix B The school: VSD SD D 18. - has a person on staff who is available to answer parents' questions. 19. - communicates regularly with me regarding my child's progress on IEP goals. 20. - gives me choices with regard to services that address my child's needs. 21. - offers parents training about special education issues. 22. - offers parents a variety of ways to communicate with teachers. 23. - gives parents the help they may need to play an active role in their child's education. 24. - provides information on agencies that can assist my child in the transition from school. 25. - explains what options parents have if they disagree with a decision of the school. Demographic Information 26. Number of years child has received special education services Less than 1 year 1-3 years 4-7 years More than 7 years 29. Child’s school level Elementary School Middle School High School 30. Child’s Primary Disability (check one) 27. Child’s race/ethnicity White Black or African-American Hispanic or Latino Asian or Pacific Islander American Indian or Alaskan Native Multi-racial 28. Language spoken in the home English Spanish Portuguese Chinese Creole/Haitian Vietnamese Other _________________ Autism Communication Impairment Deaf-Blind Impairment Developmental Delay Emotional Impairment Health Impairment Hearing Impairment Intellectual Impairment Multiple Disabilities Neurological Impairment Physical Impairment Specific Learning Disability Vision Impairment Thank you for participating. 187 A SA VSA Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix C Appendix C: MA Post-School Outcomes Survey for Indicator #14 School District: Student Name: SASID: Gender: Date of Exit from School (mm/yyyy): - Male - Female Question 1: What is your educational status since leaving high school? - CURRENTLY ATTENDING college, community college, or a technical school - NOT CURRENTLY ATTENDING, but have attended college, community college, or a technical school at some time since leaving high school - HAVE NOT ATTENDED college, community college, or a technical school at any time since leaving high school (Skip Questions 2 and 3. Go to Question 4.) Question 2: If you have attended college, community college, or a technical school at any time since leaving high school, check your enrollment status. - Full-time student enrolled in a degree program - Part-time student enrolled in a degree program - Not enrolled in a degree program, but taking college-level courses Question 3: If you have attended college, community college, or a technical school at any time since leaving high school, check the type of program. - 4-year college or university - 2- year college or university - Technical or vocational school - Other. Please describe: Question 4: What is your current employment status? - Employed – in the competitive job market, including self-employment - Full-Time Military Service - Supported Employment – job placement with ongoing support from a job coach or agency - Unemployed - not employed but looking for employment - Not in the Labor Force - not employed and not looking for employment Question 5: If you are NOT CURRENTLY employed, have you been employed at any time since leaving high school? - Yes - No Question 6: If you have been employed at any time since leaving high school, check whether you were working full-time or part-time in your most recent job. - Full-time – 35 or more hours per week, including summer employment - Part-time – less than 35 hours per week, including summer employment - Not employed since leaving high school Thank you for participating in this survey. If you have any questions, please call ______. If you are returning this survey by mail, send it to: _______. 188 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix D Appendix D: MA Post-School Outcomes Survey for Indicator #14 – FFY 2008 School District: Student Name: SASID: Gender: Date of Exit from School (mm/yyyy): - Male Method of Response: - Female - Email - Mail - Telephone - Other - Non-Responder Question 1: What is your educational status since leaving high school? - CURRENTLY enrolled or attending classes - NOT CURRENTLY enrolled or attending, but have enrolled or attended classes - HAVE NOT enrolled or attended classes Question 2: If you have enrolled or attended classes at any time since leaving high school, what type of program did you attend? - 4-year college or university - 2-year college or university - Technical or vocational school - GED program - Adult education in the community - Job Corp, Work Force Development program, etc. - Other Describe:_______________________ - Not applicable - Have not enrolled or attended classes Question 3: If you have enrolled or attended classes at any time since leaving high school, what was your enrollment status? - Full-time student enrolled in a degree program - Part-time student enrolled in a degree program - Not enrolled in a degree program, but taking classes - Not applicable - Have not enrolled or attended classes Question 4: If you have enrolled or attended classes at any time since leaving high school, how long does the program require to finish? - Less than 1 academic year - 1 academic year or more - Not applicable - Have not enrolled or attended classes Question 5: If you have enrolled or attended classes at any time since leaving high school, have you completed one class or more? - Yes - No - Not applicable - Have not enrolled or attended classes 189 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix D Question 6: What is your employment status since leaving high school? (This includes current and previous employment.) - Employed – in the competitive job market - Full-Time Military Service - Self-employed – including working for a family business - Supported Employment – job placement with ongoing support from a job coach or agency - Unemployed – not employed but looking for employment - Not in the Labor Force – not employed and not looking for employment Question 7: If you have been employed at any time since leaving high school, what is the longest amount of time you worked at the same job? - Less than 3 months - 3 months or more - Not applicable - Not employed since leaving high school Question 8: If you have been employed at any time since leaving high school, how many hours did you work in a typical week? (This includes summer employment.) - 20 hours or more per week - Less than 20 hours per week - Not applicable - Not employed since leaving high school Question 9*: If you have been employed at any time since leaving high school, what is the highest wage you were paid per hour? (This includes tips if you earn them.) - Less than $8.00 per hour - $8.00 per hour - More than $8.00 per hour - Not applicable - Not employed since leaving high school *Massachusetts’ minimum wage is $8.00/ hour as of January 1, 2008. Thank you for participating in this survey. If you have any questions, please call: If you are returning this survey by mail, please send it to: 190 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix E Appendix E: Correction of Noncompliance Data for FFY 2004 SE Criteria # SE Criteria Topic 2001-02 CPR findings of noncompliance Findings of noncompliance identified at the CPR and no longer present at the 2004-05 MCR Percent of Noncompliance Corrected and Sustained 1 2 3 4 5 Assessment selection Req/opt. Assmt. SLD Assessment Reports Participation State/local assessments Determination of Transition Age of Majority Team composition Eligibility deter. Timelines End of school year evals Independent Evals Frequency Re-evals Progress Rpts. Annual meeting Child find Screening Services at 3 IEP dev/content Placement deter. Extended Eval LRE SD/SY req. IEP implem/avail Confidentiality of student records Notice to parent Parent consent Parent partic. Team notice IEP or nsn to parents Communication in home lang. Parents rights Educational Surrogate parents PAC Involvement in the gen curric. Continuum of placement/services Specialized mater. Assit. Tech 11 16 15 4 5 8 9 3 45% 50% 60% 75% 4 4 100% 11 6 55% 9 18 21 7 16 14 78% 89% 67% 4 4 100% 7 12 23 9 3 0 3 21 16 6 12 5 11 6 10 9 8 3 0 0 7 8 6 9 1 8 86% 83% 39% 89% 100% N/A 0% 33% 50% 100% 75% 20% 73% 5 4 80% 17 14 6 9 11 11 8 5 8 7 65% 57% 83% 89% 64% 13 7 54% 2 2 100% 1 0 0% 19 11 58% 3 3 100% 12 8 67% 2 2 100% 6 7 8 9 10 11 12 13 14 15 16 17 18A 18B 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 191 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix E 36 37 38 39 40 41 42 43 44 45 46 47 48 49 49A 50 51 52 53 54 55 56 57 58 TOTALS IEP implem, acct, finan respon Out of district policies/procedures ESIS Private school at private expen. Grouping req. Age span Programs for 3 & 4 year olds Behavioral interventions. Record suspensions Suspen upto and greater than 10 Suspen greater than 10 Disci[pline not yet sped FAPE Related services Transportation Responsibilityprincipal/spe d dir Teacher cert. Related service providers credentials Paraprofessionals Professional devel SPED Facilities Program evaluation Child count Entitlement grant 8 8 100% 8 8 100% 2 2 100% 2 1 50% 8 9 6 6 75% 67% 5 4 80% 12 9 7 6 58% 67% 6 6 100% 9 3 7 12 2 8 3 5 6 2 89% 100% 71% 50% 100% 20 13 65% 3 3 100% 2 2 100% 11 23 14 23 7 0 11 16 9 14 7 0 100% 70% 64% 61% 100% N/A 560 380 68% 192 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix F Appendix F: Indicator #15 Worksheet for FFY 2008 Indicator/Indicator Clusters 1. Percent of youth with IEPs graduating from high school with a regular diploma. 2. Percent of youth with IEPs dropping out of high school. 14. Percent of youth who had IEPs, are no longer in secondary school and who have been competitively employed, enrolled in some type of postsecondary school, or both, within one year of leaving high school. 3. Participation and performance of children with disabilities on statewide assessments. 7. Percent of preschool children with IEPs who demonstrated improved outcomes. 4A. Percent of districts identified as having a significant discrepancy in the rates of suspensions and expulsions of children with disabilities for greater than 10 days in a school year. 5. Percent of children with IEPs aged 6 through 21 -educational placements. 6. Percent of preschool children aged 3 through 5 – early childhood placement. General Supervision System Components # of LEAs Issued Findings in FFY 2007 (7/1/07 to 6/30/08) (a) # of Findings of noncompliance identified in FFY 2007 (7/1/07 to 6/30/08) (b) # of Findings of noncompliance from (a) which were corrected*** no later than one year from identification Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other 23 23 18 Dispute Resolution: Complaints, Hearings 0 0 0 Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other 77 234 192 Dispute Resolution: Complaints, Hearings 0 0 0 Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other 36 60 51 Dispute Resolution: Complaints, Hearings 3 3 3 Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other 53 106 84 Dispute Resolution: Complaints, Hearings 0 0 0 193 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix F Indicator/Indicator Clusters 8. Percent of parents with a child receiving special education services who report that schools facilitated parent involvement as a means of improving services and results for children with disabilities. 9. Percent of districts with disproportionate representation of racial and ethnic groups in special education that is the result of inappropriate identification. 10. Percent of districts with disproportionate representation of racial and ethnic groups in specific disability categories that is the result of inappropriate identification. 11. Percent of children who were evaluated within 60 days of receiving parental consent for initial evaluation or, if the State establishes a timeframe within which the evaluation must be conducted, within that timeframe. 12. Percent of children referred by Part C prior to age 3, who are found eligible for Part B, and who have an IEP developed and implemented by their third birthdays. 13. Percent of youth aged 16 and above with IEP that includes coordinated, measurable, annual IEP goals and transition services that will reasonably enable student to meet the postsecondary goals. (a) # of Findings of noncompliance identified in FFY 2007 (7/1/07 to 6/30/08) (b) # of Findings of noncompliance from (a) which were corrected*** no later than one year from identification 82 242 196 3 4 4 45 75 60 Dispute Resolution: Complaints, Hearings 0 0 0 Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other 45 48 36 Dispute Resolution: Complaints, Hearings 7 7 7 135 137 137 0 0 0 41 41 35 1 1 1 General Supervision System Components Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other Dispute Resolution: Complaints, Hearings Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other Dispute Resolution: Complaints, Hearings Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other Dispute Resolution: Complaints, Hearings 194 # of LEAs Issued Findings in FFY 2007 (7/1/07 to 6/30/08) Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix F Indicator/Indicator Clusters Other areas of noncompliance: Faculty, Staff, and Administration Other areas of noncompliance: Recordkeeping Other areas of noncompliance: Among Bureau of Special Education Appeals findings, appropriateness of IEP or of placement; among complaint findings, multiple areas, the bulk of which (89) involved non-implementation or partial implementation of IEP General Supervision System Components # of LEAs Issued Findings in FFY 2007 (7/1/07 to 6/30/08) (a) # of Findings of noncompliance identified in FFY 2007 (7/1/07 to 6/30/08) (b) # of Findings of noncompliance from (a) which were corrected*** no later than one year from identification Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other 38 51 40 Dispute Resolution: Complaints, Hearings 2 2 2 Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other 4 6 5 Dispute Resolution: Complaints, Hearings 5 6 6 Monitoring Activities: Self-Assessment/ Local APR, Data Review, Desk Audit, Onsite Visits, or Other 0 0 0 Dispute Resolution: Complaints, Hearings 83 145 145 1191 1018 (b) / (a) X 100 = 85.5% Sum the numbers down Column a and Column b Percent of noncompliance corrected within one year of identification = (column (b) sum divided by column (a) sum) times 100. 195 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix G Appendix G: Attachment 1 – Report of Dispute Resolution for FFY 2004 Report of Dispute Resolution Under Part B of the Individuals with Disabilities Education Act Complaints, Mediations, Resolution Sessions, and Due Process Hearings SECTION A: Signed, written complaints 412 (1) Signed, written complaints total 258 (1.1) Complaints with reports issued (a) Reports with findings 206 (b) Reports within timeline 162 (c) Reports within extended timelines 16 (1.2) Complaints withdrawn or dismissed 71 (1.3) Complaints pending 83 (a) Complaint pending a due process hearing 52 SECTION B: Mediation requests 660 (2) Mediation requests total (2.1) Mediations (a) Mediations related to due process 58 (i) Mediation agreements 48 602 (b) Mediations not related to due process 519 (i) Mediation agreements 0 (2.2) Mediations not held (including pending) SECTION C: Hearing requests 768 (3) Hearing requests total (3.1) Resolution sessions NA* NA* (a) Settlement agreements 12 (3.2) Hearings (fully adjudicated) (a) Decisions within timeline 1 (b) Decisions within extended timeline 10 738 (3.3) Resolved without a hearing SECTION D: Expedited hearing requests (related to disciplinary decision) 69 (4) Expedited hearing requests total (4.1) Resolution sessions NA NA (a) Settlement agreements 1 (4.2) Expedited hearings (fully adjudicated) 0 (a) Change of placement ordered *NA=Reporting period does not cover 7/1/05, effective date of IDEA 2004, which initiated requirement of resolution session. 196 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix H Appendix H: Table 7 – Report of Dispute Resolution for FFY 2008 Report of Dispute Resolution Under Part B of the Individuals with Disabilities Education Act FFY 2008 (2008-2009) SECTION A: Written, Signed Complaints (1) Total number of written, signed complaints filed (1.1) Complaints with reports issued (a) Reports with findings of noncompliance (b) Reports within timeline (c) Reports within extended timelines (1.2) Complaints pending (a) Complaints pending a due process hearing (1.3) Complaints withdrawn or dismissed 271 190 119 176 4 23 15 58 SECTION B: Mediation Requests (2) Total number of mediation requests received (2.1) Mediations held (a) Mediations held related to due process complaints (i) Mediation agreements related to due process complaints (b) Mediations held not related to due process complaints (i) Mediation agreements not related to due processnot complaints (2.2) Mediations held (including pending) SECTION C: Due Process Complaints (3) Total number of due process complaints filed (3.1) Resolution meetings (a) Written settlement agreements (3.2) Hearings fully adjudicated (a) Decisions within timeline (include expedited) (b) Decisions within extended timeline (3.3) Resolved without a hearing (4) 846 846 47 43 799 672 0 609 47 20 24 4 20 470 SECTION D: Expedited Due Process Complaints (Related to Disciplinary Decision) 40 Total number of expedited due process complaints filed 1 (4.1) Resolution meetings 1 (a) Written settlement agreements 2 (4.2) Expedited hearings fully adjudicated 0 (a) Change of placement ordered 197 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix I Appendix I: Indicator #20 Scoring Rubric for FFY 2004 APR Data APR Indicator 1 Valid and Reliable Data 2 3A 3B 3C 4A 5 7 8 9 10 11 12 13 14 15 16 17 18 19 APR Score Calculation Correct Calculation 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 Followed Instructions 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 Total 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 Subtotal Timely Submission Points - If the FFY 2006 APR was submitted on-time, place the number 5 in the cell on the right. Grand Total (Sum of subtotal and Timely Submission Points) = 198 2 2 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 3 58 5 63 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix I Table Table 1– Child Count Due Date: 2/1/07 Table 2Personnel Timely 618 State-Reported Data Responded to Passed Data Note Complete Edit Requests Data Check Total 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 Due Date: 11/1/07 Table 3– Ed. Environments Due Date: 2/1/07 Table 4– Exiting Due Date: 11/1/07 Table 5Discipline Due Date: 11/1/07 Table 6- State Assessment Due Date: 2/1/08 Subtotal 618 Score Calculation Grand Total (Subtotal x 2) = 199 0 0 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix I Indicator #20 Calculation A. APR Grand Total = 63 B. 618 Grand Total = 0 C. APR Grand Total (A) + 618 Grand Total (B) = D. Subtotal (C divided by 119)* = 63 0.529 E. Indicator Score (Subtotal (D) x 100) = 52.9% * Note: Any cells mark with a N/A will decrease the denominator by 1 for APR and 2 for 618 data. Definitions Timely – All data for the APR are submitted on or before February 1, 2008. Data for tables for 618 are submitted on or before each tables’ due date. NO extensions. Valid and Reliable Data - Data provided are from the correct time period, are consistent with 618 (when appropriate) and the measurement, and are consistent with previous indicator data (unless explained). Correct Calculation - Result produced follows the required calculation in the instructions for the indicator. Instructions Followed - APR provides information required in the instructions for the indicator. For example, when required, explanation provided, raw data and/or definitions given, or response provided to previous OSEP APR analysis. Complete Data – No missing sections. No placeholder data. Data submitted from all districts or agencies. For example, when the instructions for an indicator require data broken down into subparts, data for all subparts are provided. Passed Edit Check - Tables submitted to Westat do not have missing cells or internal inconsistencies. (See https://www.ideadata.org/TAMaterial.asp regarding Westat edit checks.) Responded to Data Note Requested - Provided written explanation to Westat in response to data note requests. 200 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix J Appendix J: Indicator #20 Scoring Rubric for FFY 2008 SPP/APR Data - Indicator 20 APR Indicator Valid and Reliable Correct Calculation 1 1 1 2 1 1 3A 1 1 2 3B 1 1 2 3C 1 1 2 4A 1 1 2 5 1 1 2 7 1 1 2 8 1 1 2 9 1 1 2 10 1 1 2 11 1 1 2 12 1 1 2 13 1 1 2 14 1 1 2 15 1 1 2 16 1 1 2 17 1 1 2 18 1 1 2 19 1 1 2 Subtotal APR Score Calculation Timely Submission Points - If the FFY 2007 APR was submitted on-time, place the number 5 in the cell on the right. Grand Total - (Sum of subtotal and Timely Submission Points) = 201 Total 38 5 43.00 Massachusetts Part B State Performance Plan for FFY 2005 – 2010 and Annual Performance Report for FFY 2008 Appendix J 618 Data - Indicator 20 Table Table 1 - Child Count Due Date: 2/1/09 Table 2 Personnel Due Date: 11/1/09 Table 3 - Ed. Environments Due Date: 2/1/09 Table 4 - Exiting Due Date: 11/1/09 Table 5 Discipline Due Date: 11/1/09 Table 6 - State Assessment Due Date: 2/1/10 Table 7 - Dispute Resolution Due Date: 11/1/09 Timely Complete Data Passed Edit Check Responded to Data Note Requests Total 1 1 1 1 4 1 1 1 N/A 3 1 1 1 1 4 1 1 1 N/A 3 1 1 1 N/A 3 1 1 1 N/A 3 1 1 1 N/A 3 Subtotal 23 Grand Total (Subtotal X 2.0476) = 618 Score Calculation 47 Indicator #20 Calculation A. APR Grand Total 43 B. 618 Grand Total 47 C. APR Grand Total (A) + 618 Grand Total (B) = Total N/A in APR 90 0 Total N/A in 618 -4 Base 90 D. Subtotal (C divided by Base*) = 1.0 E. Indicator Score (Subtotal D x 100) = 100.0 202