PA PBS Network Evaluation Plan Data Collection Schedule_FY2010-11 SCHOOL/DISTRICT DATA Tool/Measure Purpose When Who Completes Where Found PBIS Leadership Team Self-Assessment (Blueprint) Identify status, need and change over time at State, District or School Level Baseline & Annually Completed by appropriate political unit and sent to PA PBS Management Team Self-Assessment Survey (SAS) Identify status, needs and change over time Annually (begin at start-up) Completed by building level staff in PBS surveys www.pbis.org On-line library -> Tools -> PBIS Leadership Team SelfAssessment and Planning Tool www.pbssurveys.org School Safety Survey (SSS) Identify safety status, needs and change over time Plan to guide implementation status and technical assistance need at the universal level Baseline & Annually Completed by all building level staff on PBS Surveys website Start-up, and at least 3x per year thereafter Team members complete one MAP with data from TIC, BoQ, PoI, SAS, etc. Revisit plan as needed. Recommended for all schools to complete by April. Internal Coach and Team Members. Ext. Coach submits final BoQ to TAC who confirms then enters on PBS Surveys Website www.pbssurveys.org Elements Report: This report shows the percent implemented for each BoQ element in a bar chart and accompanying data table. The BAT is to be completed by the team(s) involved with Tiers 2 and 3 behavior support, and reflects the consensus (or majority) of team members. www.papbs.org Benchmark for Advanced Tiers Action Plan Multi-tiered Action Plan (MAP) Benchmarks of Quality (BoQ) Benchmarks for Advanced Tiers (BAT) Implementation status and change over time allows school teams to self-assess the implementation status of Tiers 2 (secondary, targeted) and 3 (tertiary, intensive) behavior support systems within their school. Annually Reports to use Individual Item Scores: this report shows the current status (in place, partially in place, and not in place) and improvement priority (high, medium, and low) percents for each item within each system. www.pbssurveys.org www.papbs.org PA PBS Network Evaluation Plan Data Collection Schedule_FY2010-11 Tool/Measure Purpose School-wide Evaluation Tool (SET) (optional) When Assess and evaluate the critical features of schoolwide effective behavior support Can be done Annually in the Fall Who Completes Where Found Reports to use an external expert can evaluate the status of critical PBS features both before and after implementation www.pbssurveys.org The SET summary score report is used (a) to determine annual goals for SW{BS (b) to evaluate on-going efforts (c) design and revise procedures as needed, (d) to compare annual accomplishments PA PBS NETWORK STATEWIDE EVALUATION DATA Total Students Staff Attendance Rate LRE-%GenEd <21% LRE-%GenEd 21-60% Referrals to SpecEd Students Eligible for SpecEd Number of Students Expelled 2010 AYP Status Level PSSA %Prof/AdvReading PSSA %Prof/Adv-Math Used to identify changes over time with implementation Research findings will ensure sustainability, political support, funding, visibility, school acknowledgement and policy at the state level Annually TBD School/District Point of Contact (POC) submitted to Regional Coordinator www.papbs.org PA PBS Network Evaluation Plan Data Collection Schedule_FY2010-11 STUDENT DATA MEASURES/OUTCOMES Tool/Measure Purpose When Who Completes Discipline data by Ethnicity Identify Disproportional Discipline data based on ethnicity Annually (team-monthly) Enter in SWIS or other data system Discipline data by Individual Education Plan (IEP) Disproportional Discipline data based on IEP Annually (team-monthly) Enter in SWIS or other data system Office Discipline Referrals (ODRs) Data-based Decision Making across all Three Tiers Quarterly data shared with all staff (team-monthly) In School Suspensions (ISS) Data-based Decision Making across all Three Tiers Annually (team-monthly) Enter in SWIS or other data system Out of School Suspenstions (OSS) Data-based Decision Making across all Three Tiers Annually (team-monthly) Enter in SWIS or other data system Enter in SWIS or other data system Where Found Reports to use www.swis.org; or School district and building level data base www.swis.org ; or School district and building level data base www.swis.org ; or School district and building level data base www.swis.org; or School district and building level data base www.swis.org; or School district and building level database “Big Five Reports”: Avg Referrals per Day per Month Referrals by Problem Behavior Referrals by Location Referrals by Time Referrals by Student PA PBS Network Evaluation Plan Data Collection Schedule_FY2010-11 YEAR 1 SWPBS EVALUATION PLAN DATA COLLECTION SCHEDULE Sept Oct Nov Dec Jan Feb Mar Apr May June July Aug Tool/Measure District Blueprint Self-Assessment X x Self-Assessment Survey (SAS) X Team Implementation Checklist (TIC) X X X Mult-tiered Action Plan (MAP) X X x X Benchmarks of Quality (BoQ) X x School Safety Survey (SSS) Discipline Data by Ethnicity X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X In-school Suspensions (ISS) X X X X X X X X X X X X Out-of-school Suspensions (OSS) X X X X X X X X X X X X X X X X X X X X X X X X Discipline Data by Individual Education Plan (IEP) Office Discipline Referrals (ODRs): Big 5 Reports Academic Data (e.g. PSSA, Curriculum Based Measures, and individual student academic data for Tier 2/Tier 3 interventions) PA PBS Network Statewide Evaluation Data (Research done by IUP) Key X Month Due for Tool/Measure, or Month to Review Data Period to work on Tool/Measure TBD PA PBS Network Evaluation Plan Data Collection Schedule_FY2010-11 YEAR 2 SWPBS EVALUATION PLAN DATA COLLECTION SCHEDULE Sept Oct Nov Dec Jan Feb Mar Apr May June July Aug Tool/Measure Self-Assessment Survey (SAS) X Team Implementation Checklist (TIC) X X X Mult-tiered Action Plan (MAP) X X x X Benchmarks of Quality (BoQ) X School Safety Survey (SSS) x Discipline Data by Ethnicity X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X In-school Suspensions (ISS) X X X X X X X X X X X X Out-of-school Suspensions (OSS) X X X X X X X X X X X X X X X X X X X X X X X X Discipline Data by Individual Education Plan (IEP) Office Discipline Referrals (ODRs): Big 5 Reports Academic Data (e.g. PSSA, Curriculum Based Measures, and individual student academic data for Tier 2/Tier 3 interventions) PA PBS Network Statewide Evaluation Data (Research done by IUP) TBD PA PBS Network Evaluation Plan Data Collection Schedule_FY2010-11 YEAR 3 SWPBS EVALUATION PLAN DATA COLLECTION SCHEDULE Sept Oct Nov Dec Jan Feb Mar Apr May June July Aug Tool/Measure Self-Assessment Survey (SAS) X Mult-tiered Action Plan (MAP) X x X X Benchmarks of Quality (BoQ) (Schools must receive 70% or more on TIC to drop its use and only use the BoQ) X Benchmarks for Advanced Tiers (BAT) X x School Safety Survey (SSS) Discipline Data by Ethnicity X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X X In-school Suspensions (ISS) X X X X X X X X X X X X Out-of-school Suspensions (OSS) X X X X X X X X X X X X X X X X X X X X X X X X Discipline Data by Individual Education Plan (IEP) Office Discipline Referrals (ODRs): Big 5 Reports Academic Data (e.g. PSSA, Curriculum Based Measures, and individual student academic data for Tier 2/Tier 3 interventions) PA PBS Network Statewide Evaluation Data (Research done by IUP) TBD