Wendy Zdeb MASSP Associate Director wendyz@michiganprincipals.org During today’s session we will: ◦ Review basic fundaments of the Explore, Plan and ACT and MME assessments. ◦ Look at the connection between District and School Improvement Goals. ◦ Identify how Explore and Plan results can help to focus SIP and Student Growth Goals. ◦ Discuss ways to include all school stakeholders in the SIP process. Take responsibility for your own learning – stay with us Support the learning of your colleagues – make sure they stay with us If you need to take a call or have a side conversation, please step into the hall If you have a question, ask. All kids can learn? All kids are learning at their highest possible level? All educators can learn? All educators are learning at their highest possible level? Data can target instructional needs? Educators target instructional needs using data? We will need the help of colleagues to meet the needs of all kids? Michigan Merit Exam ACT – College Readiness ◦ English (18), Reading (21), Science (24), Math (22) Work Keys – Career ◦ Applied Math, Reading for Info, Locating Information Michigan Items – Alignment ◦ Social Studies, Science, Math, Writing Conflicting Viewpoints 17% Research Summaries 45% Data Representation 38% Hand out green sheets Humanities 25% Prose Fiction 25% Social Studies 25% Natural Science 25% Humanities – architecture, art, dance, ethics, film, language, literary criticism, music, philosophy, radio, television, and theater. Social Studies -anthropology, archaeology, biography, business, economics, education, geography, history, political science, psychology, and sociology Natural Sciences - anatomy, astronomy, biology, botany, chemistry, ecology, geology, medicine, meteorology, microbiology, natural history, physiology, physics, technology, and zoology. Prose Fiction - short stories or excerpts from short stories or novels. Trigonometry 7% Pre-Algebra 23% Plane Geometry 23% Elementary Algebra 17% Coordinate Geometry 15% Intermediate Algebra 15% Hand out purple sheet Rhetorical Skills- Style 16% Rhetorical SkillsOrganization 15% Rhetorical SkillsStrategy 16% Usage and MechanicsPunctuation 13% Usage and MechanicsGrammar and Usage 16% Usage and MechanicsSentence Structure 24% EXPLORE PLAN ACT 1 6 11 16 21 26 31 36 ACT College-Readiness Benchmarks ACT Readiness Benchmarks for Credit-Earning College Courses College EXPLORE (8th/9th) Credit-Earning College Readiness Course Benchmarks 8th 9th PLAN (10th) College Readiness Benchmarks ACT (11th/12th) College Readiness Benchmarks English Comp. English 13 14 English 15 English 18 Algebra Math 17 18 Math 19 Math 22 Social Science Reading 15 16 Reading 17 Reading 21 Biology Science 20 20 Science 21 Science 24 75 % chance “C” or better Are these students “on track”? 50% chance of “B” or better Alignment with Common Core … not a moving target! Important for everyone to be on the same page. ◦ Belief in a Pre K-12 system ◦ Knowledge of Common Core and College Readiness ◦ Shared vocabulary and expectations Building on each other’s goals, sharing information and developing commonalities All graduates of the Rochester Community Schools will be College Ready, Career Ready and Life Ready in English Language Arts. All graduates of the Rochester Community Schools will be College Ready, Career Ready and Life Ready in Mathematics. All graduates of the Rochester Community Schools will be College Ready, Career Ready and Life Ready in Science. Our School Improvement Goals: All students will meet the college readiness benchmark in Reading. All students will meet the college readiness benchmark in Math. All students will meet the college readiness benchmark in Science. District Initiative: Pyramid of Intervention training for Staff. District Interventions for students: Mandatory Summer programs, Universal Screening. Building Interventions for students: Academic Center, Blended Service Model, Math Lab, Reading Lab, Study Island, R&R, Homework Lunch, Academic Draft. Scholars of Highest Distinction GPA 3.9 - 4.0 4 AP Courses ACT Score of 32 or higher Scholars of Distinction GPA 3.8 3 AP Courses ACT Score of 28 or higher Scholars of Achievement GPA 3.5 2 AP Courses ACT Score of 26 or higher 7th Explore (1-25) 8th Explore (1-25) 9th Plan (1-32) 10th Plan (1-32) 11th ACT/MME (1-36) Allows for one year’s measurement of growth and time for inventions. - We conduct these on Feb.10th (late start) The 1-25 score measured by the Explore are all standards covered in Elementary and Middle School. Our District is shifting curriculum alignment to the ACT College Readiness Standards (rather than the MEAP). Elementary and MS have been in-serviced on the Standards and the State is moving to the National Core Standards which are ACT based. The ACT Math standards were broken down by GLCEs and HSCEs (Bill Aten). On the next slide, the yellow highlighted standards are actually GLCEs which are found in the Math portion of the ACT. Data Points First: Spring 2009 11th grade results What percent of students with each ACT scale score met standards on the MME? Math ACT Mathematics with MME Mathematics 99 99 100 100 100 100 100 100 100 100 100 100 100 98 99 100 93 90 84 80 Percent Proficient on the MME 73 70 60 52 50 40 30 To read the graph: 52% of the 1248 students with ACT Math scores of 18 were proficient on the MME Math assessment. 25 20 9 0 0 0 0 0 0 0 0 0 0 1 1 (1) 4 (4) 6 (3) 8 (6) 9 (4) 10 (10) 11 (35) 12 (90) 13 (289) 14 (883) 15 (1651) 10 ACT Scale Score (Number of Students) 41% of the items on MME Math come from the ACT. 36 (67) 35 (135) 34 (222) 33 (84) 32 (214) 31 (97) 30 (263) 29 (371) 28 (573) 27 (530) 26 (507) 25 (547) 24 (637) 23 (670) 22 (680) 21 (783) 20 (387) 19 (773) 18 (1248) 17 (897) 16 (1740) 0 What percent of students with each ACT scale score met standards on the MME? ACT Reading with MME Reading Reading 99 100 100 100 100100 100 100 100100 100 100 100100 98 99 100 94 88 90 77 Percent Proficient on the MME 80 70 63 60 50 41 40 To read the graph: 41% of the 638 students with ACT Reading scores of 16 were proficient on the MME Reading assessment. 30 24 20 9 10 0 0 0 0 0 0 0 0 0 0 1 1 (1) 2 (1) 4 (2) 5 (6) 6 (20) 7 (4) 8 (37) 9 (65) 10 (148) 11 (388) 12 (718) 5 ACT Scale Score (Number of Students) 85% of the items on MME Reading come from the ACT. 36 (53) 35 (156) 34 (211) 33 (244) 32 (258) 31 (324) 30 (306) 29 (358) 28 (353) 27 (361) 26 (451) 25 (444) 24 (469) 23 (1011) 22 (559) 21 (585) 20 (1182) 19 (626) 18 (641) 17 (1182) 16 (638) 15 (1080) 14 (658) 13 (950) 0 But students take the ACT & MME at the same time… 2007-08 10th grade PLAN with 2008-09 11th grade MME 35 What percent of students with each PLAN scale score met standards on the MME? Math 2009 MME % Proficient for Each 2008 PLAN Scale Score 99 98 24 (348) 97 23 (692) 93 96 22 (345) 100 21 (339) Math 100 100 100 100 100 100 100 90 90 81 70 61 60 50 38 40 30 21 20 3 3 4 11 (116) 12 (140) 13 (431) 8 (61) 3 9 (89) 5 7 6 (40) 10 10 0 PLAN Scale Score (Number of Students) 32 (14) 31 (68) 30 (108) 29 (431) 28 (287) 27 (285) 26 (317) 20 (375) 19 (721) 18 (723) 17 (1128) 16 (1032) 15 (874) 14 (525) 0 5 (14) Percent Proficient on MME 80 What percent of students with each PLAN scale score met standards on the MME? 2009 MME % Proficient for Each 2008 PLAN Scale Score Reading 99 99 100 100 99 100 24 (338) 25 (330) 26 (279) 27 (245) 28 (153) 30 (70) 95 99 23 (375) 93 96 22 (447) 100 21 (499) Reading 87 90 81 74 68 70 60 54 50 42 40 35 18 19 10 (176) 20 8 (107) 22 28 27 12 (387) 30 11 (295) 32 10 20 (1147) 19 (615) 18 (623) 17 (571) 16 (613) 15 (1189) 14 (539) 13 (469) 7 (51) 0 4 (19) Percent Proficient on MME 80 PLAN Scale Score (Number of Students) 2005-06 8th grade EXPLORE with 2008-09 11th grade MME What percent of students with each EXPLORE scale score met standards on the MME? 2005-06 8th Grade EXPLORE with 2008-09 11th Grade MME Math 98 99 100 99 100 21 (446) 22 (36) 23 (363) 25 (274) 98 100 20 (44) Math 94 90 86 Percent Proficient on 08-09 MME 80 70 70 60 50 46 40 27 30 20 10 14 8 11 10 16 11 8 4 3 0 19 (567) 18 (1035) 17 (1051) 16 (885) 14 (639) 13 (263) 12 (383) 11 (157) 10 (239) 8 (88) 15 (1122) Note: Only score points with 10 or more students are displayed. 7 (52) 6 (48) 5 (37) 4 (19) 3 (13) 0 05-06 8th grade EXPLORE Scale Score (Number of Students) The score where the odds become favorable is highlighted. What percent of students with each EXPLORE scale score met standards on the MME? 2005-06 8th Grade EXPLORE with 2008-09 11th Grade MME Reading 99 99 99 24 (220) 25 (94) 21 (411) 100 23 (324) 98 22 (63) 97 20 (480) 90 95 97 19 (59) 100 18 (456) Reading 91 90 83 69 70 57 60 50 42 40 30 30 25 17 20 16 10 10 17 (990) 16 (442) 15 (851) 14 (1064) 13 (569) 12 (767) 11 (390) 10 (390) 9 (153) 8 (29) 0 7 (10) Percent Proficient on 08-09 MME 80 05-06 8th grade EXPLORE Scale Score (Number of Students) Elementary and Middle Schools have celebrated incredibly high success rates on the MEAP… ◦ What happens when those “successful” students take the Explore, Plan and ACT? Let’s track on student scores from the MEAP to the MME. ◦ Are the students labeled as “proficient” on the MEAP meeting the ACT College Readiness Standards? ◦ It’s all about the cut score! Based on more than 11,350 Oakland County students who took both tests. What percent of students in each MEAP scale score range met standards on the MME? Percent Proficient on Spring 2010 MME by 8th Grade Fall 06 MEAP Range Mathematics 98 100 100 100 100 100 100 89 90 % Met on 11th Grade MME 80 70 67 60 50 40 37 30 20 14 10 0 0 3 4 6 0 <750 (1) 750-759 760-769 770-779 780-789 790-799 800-809 810-819 820-829 830-839 840-849 850-859 860-869 870-879 (1) (38) (164) (623) (1250) (2184) (2086) (1734) (1405) (854) (467) (211) (149) 8th Grade MEAP Scale Score Range (Count) 880+ (173) What percent of students in each MEAP scale score range met standards on the MME? Percent Proficient on Spring 2010 MME by 8th Grade Fall 06 MEAP Range Reading 100 95 98 99 100 90 90 79 % Met on 11th Grade MME 80 70 64 60 50 45 40 28 30 19 20 10 9 14 11 8 0 <750 (22) 750-759 760-769 770-779 780-789 790-799 800-809 810-819 820-829 830-839 840-849 850-859 870-879 (63) (126) (297) (408) (577) (927) (1442) (1357) (1761) (2143) (1026) (762) 8th Grade MEAP Scale Score Range (Count) 880+ (443) Grade 11 8 7 6 5 4 3 Partially Proficient 1093 809 714 614 516 423 322 Proficient 1116 830 731 629 531 434 336 Advanced 1138 865 776 675 584 470 371 Grade 11 8 7 6 5 4 3 Partially Proficient 1081 796 698 602 501 395 301 Proficient 1108 818 721 619 521 419 324 Advanced 1141 853 760 653 565 478 364 Grade 11 8 5 Partially Proficient 1106 826 526 Proficient 1126 845 553 Advanced 1144 863 567 100% Percent in Category 90% 7.7% 9.7% 4.1% 17.3% 80% 70% 8.7% 10.2% 26.6% 30.9% 60% 27.4% 50% 40% 30% 51.7% 59.1% 46.6% 20% 10% 0% 5 8 Grade 11 Advanced Proficient Partially Proficient Not Proficient Grade 11 9 6 Partially Proficient 1097 899 593 Proficient 1129 928 625 Advanced 1158 960 649 If you know that Explore and Plan can provide an “early warning” to help remediate students and curriculum…what are you going to do about it? Class of 2012 Linkage (Current 11th) 2008-09 EXPLORE AVERAGES (9th Grade) 2009-10 PLAN AVERAGES (10th Grade) RHS 2010-11 ACT AVERAGES (11th Grade) English 16.9 (14) 18.9 (15) 21.6 (18) Math 18.0 (18) 20.6 (19) 22.3 (22) Reading 16.7 (16) 19.1 (17) 21.8 (21) Science 18.5 (20) 20.5 (21) 22.1 (24) Composite 17.6 19.9 22.1 Our teachers and a rigorous curriculum. There is no substitute for quality instruction in the classroom. We are using our data for over all school improvement and to assist individual students. ◦ Revisiting our curriculum/instruction ◦ Targeted ACT prep activities and remediation Interventions Stakeholder Involvement Our results are available for March professional development. Teacher Leaders and SIP Chairs are given data packets to review and prepare for PD in advance. Explain to a neighbor the information on the Item-Response Summary Report What content of items or standards do you believe your data will show as strengths? 1. 2. What content of items or standards will be challenges? 3. What misconceptions will come to light? Types of math, which reading passage, science graphs, elements of grammar Teacher groups conduct item response analysis Create a T-Chart with actual test items Complete the content standard review chart Discuss instructional strategies What strategies can we use in our School Improvement Report? Math Explore Strengths Challenges Plan Strengths Challenges Linking back to the actual items Strengths Fractions unlike denominator Beginning of test Challenges Confused X Y Coordinate End of test Strengths When / where taught? Instructional Strategies Processes Challenges When / where taught? Instructional Strategies Processes When we return to school in August we have 2 PD days. We spend ½ of a day reviewing these charts and planning for the current school year based on our targets. Teachers meet in core course groups to create bell ringer and other activities to address our weaknesses. We regularly revisit these areas and spend time creating remediation assignments. Teachers are provided with data packets which contain lists of their current students divided by: ◦ Above the College Readiness Benchmark ◦ At the College Readiness Benchmark ◦ Below the College Readiness Benchmark Teachers make predictions about their current students. Teachers independently study their scores and adjust their instruction/accommodations accordingly. Teachers collectively look at results and share ideas. Revisit of SIP Goals Gap Statement Collection of support data and artifacts Recommit to the goals and our mission/vision What specific student academic performance (growth) goals are identified for the teacher (at least two)? (As linked to the current school improvement plan) The goals must be instructional, obtainable, measureable, valid (objective based) and constructed with input from the teacher and the administrator. Essential Questions: How much growth in academic achievement typically occurs during high school? Can growth be accelerated so that more students are ready for college and career when they graduate from high school? Figure 1: Achievement Growth between 8th and 12th grades, per content area. Do growth rates differ depending on the degree to which students are on target to becoming college and career ready? Figure 2 (page 3) English: Off Target Students: 9.2, 12.9, 13.0= 3.8 Nearly On Target: 11.6, 14.9, 15.5= 3.9 On Target: 17.4, 19.5, 22.4= 5.0 Average growth was greatest for the group of students who were on target for college and career readiness in 8th grade. Students who were on target in eight grade demonstrated more growth between PLAN and ACT than did either of the other two groups. The group of students who were on target for college and career readiness in 8th grade were the only students who stayed on target in 10th grade and went on to become ready for college-level work by high school graduation. Individual students’ growth goals can be set using the CRB as a yard stick. Student goals can be based on “smart numbers” depended upon entry level student scores. This research demonstrates that it is necessary to intervene with students who are not on target for college and career readiness- not only during high school but before high school, in the upper elementary grades and in middle school. If students are to maximize the benefits of high school, a strong start is essential. Students will test on February 10th. Test results are returned to the students in March. ◦ Counselors review the basic info(pg.2/3) ◦ Content Teachers review their specific sections of the test ◦ Students record their own strength/weakness t-charts ◦ Results are also mailed home (I order an extra set of results from ACT) EXPLORE Individual Student Report Early Indicators of College Readiness EXPLORE and PLAN College Readiness Benchmark Scores The EXPLORE and PLAN College Readiness Benchmark Scores are based on the ACT College Readiness Benchmark Scores. They reflect students’ expected growth from EXPLORE to PLAN to the ACT and assume sustained academic effort throughout high school. ACT Subject Area Test College Readiness Benchmark Score College Course(s) EXPLORE English English Composition 13 Math Algebra 17 Reading Social Sciences 15 Science Biology 20 PR 43 69 65 91 PLAN 15 19 17 21 ACT PR 43 70 65 91 18 22 21 24 PR 37 63 53 80 Students who meet a Benchmark on the ACT have ≈ 50% chance of earning a B or better and ≈ 75% chance of earning a C or better in the corresponding college course or courses. Students who meet a Benchmark on EXPLORE or PLAN are likely to have approximately this same chance of earning such a grade in the corresponding college course(s) by the time they graduate high school. We hold an Explore/Plan parent night (May 11th at 7:00pm) ◦ Principal reviews the EPAS pattern and how the results serve as an “early warning system” ◦ Counselor explains the result sheet and what colleges are looking for ◦ We stress the importance of targeted remediation…not just “ACT prep” When will it take place? Who will be involved? How will they be grouped? What will you share? (1, 2, 3, 4….) How will you follow-up? Keep a spokesman with your plan ◦ Look at the connection between District and School Improvement Goals. ◦ Identify how Explore and Plan results can help to focus SIP and Student Growth Goals. ◦ Discuss ways to include all school stakeholders in the SIP process. ◦ QUESTIONS? Wendy Zdeb MASSP Associate Director wendyz@michiganprincipals.org