Madison Public Schools Testing Reports 2010-2011 Results Presenter: Lee S Nittel Director of Curriculum and Instruction The “Standardized” Test What Tests Were Given In the 2010-2011 Schools Year? •Terra Nova Grade 2 (Language Arts and Math) •NJ ASK Grades 3-8 (Literacy and Math) (Science section in grds 4 & 8) •PSAT Grade 10 (English and Math) •HSPA Grade 11 (Language Arts and Math) •SAT (English and Math) •Advanced Placement Tests •Access for ELLs (Manditory for ESL - Title III) •End of Course Algebra I & II •NJ Biology Competency Test Terra Nova is a Norm-Referenced Test • Norm-Referenced Tests are designed to compare individual students’ achievement to that of a “norm group,” a representative sample of his or her peers. The design is governed by the normal or bell-shaped curve in the sense that all elements of the test are directed towards spreading out the results on the curve (Monetti, 2003; NASBE, 2001; Zucker, 2003; Popham, 1999). The curvegoverned design of norm-referenced tests means that they do not compare the students’ achievement to standards for what they should know and be able to do—they only compare students to other students who are assumed to be in the same norm group. For example, the available norms for the Iowa Test of Basic Skills are: districts of similar sizes, regions of the country, socio-economic status, ethnicity, and type of school (e.g., public, Catholic, private non-Catholic) in addition to a representation of students nationally. Norm-Referenced Tests NJ ASK is a Criterion-Referenced Test Criterion-Referenced Tests are designed to show how students achieve in comparison to standards, usually state standards. (NASBE, 2001; Wilde, 2004; Zucker, 2003). In contrast to normreferenced tests, it is theoretically possible for all students to achieve the highest—or the lowest—score, because there is no attempt to compare students to each other, only to the standards. Results are reported in levels that are typically basic, proficient, and advanced. The test items are not chosen to sort students but to ascertain whether they have mastered the knowledge and skills contained in the standards. New Jersey Assessment of Skills and Knowledge (NJ ASK) The New Jersey Assessment of Skills and Knowledge for grades five through eight (NJ ASK 5-8) was administered for the first time in Spring 2008, and for grades 3 & 4 in Spring 2009 with a new test design. The NJ ASK is designed to give an early indication of the progress students are making in mastering the knowledge and skills described in the Core Curriculum Content Standards. The results are to be used by schools and districts to identify strengths and weaknesses in their educational programs. It is anticipated that this process will lead to improved instruction and better alignment with the Core Curriculum Content Standards. The results may also be used, along with other indicators of student progress, to identify those students who may need instructional support in any of the content areas. This support, which could be in the form of individual or programmatic intervention, would be a means to address any identified knowledge or skill gaps. NJ ASK Scoring • Advanced Proficient = 250-300 • Proficient = 200-249 • Partially Proficient = 199 and Below What do we do with NJ ASK Data? District Factor Groups (DFG) • The District Factor Groups (DFGs) were first developed in 1975 for the purpose of comparing students’ performance on statewide assessments across demographically similar school districts. The DFGs represent an approximate measure of a community’s relative socioeconomic status (SES). The classification system provides a useful tool for examining student achievement and comparing similarly-situated school districts in other analyses. Comparing Apples to Apples • District Factor Groups (DFG) Formula: 1) Percent of adults with no high school diploma 2) Percent of adults with some college education 3) Occupational status 4) Unemployment rate 5) Percent of individuals in poverty 6) Median family income What is Madison’s DFG? • • • • • • • • A B CD DE FG GH I J (Lowest Socioeconomic Determination) (Highest Socioeconomic Determination) 2011 NJ ASK 3 Language Arts Literacy 100.0% 90.0% 83.5% 80.0% 70.0% 78.9% 70.6% 66.1% 60.0% 63.0% 55.8% 50.0% 40.0% 37.0% 30.0% 20.0% 16.6% 21.1% 12.9% 12.8% 10.0% 7.2% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing 2011 NJ ASK 3 Mathematics 100.0% 92.8% 90.9% 90.0% 80.0% 78.9% 70.0% 60.0% 56.4% 54.2% 50.0% 40.0% 36.4% 36.7% 30.0% 20.0% 10.0% 40.5% 38.4% 21.1% 7.3% 9.1% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing 2011 NJ ASK 4 Language Arts Literacy 100.0% 90.0% 85.2% 80.0% 80.0% 70.0% 68.6% 60.0% 66.4% 62.7% 55.5% 50.0% 40.0% 37.3% 30.0% 20.0% 14.8% 20.0% 16.6% 10.0% 13.6% 7.2% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing 2011 NJ ASK 4 Mathematics 100.0% 92.9% 90.7% 90.0% 80.0% 70.0% 60.0% 62.7% 55.3% 50.0% 46.4% 44.3% 47.2% 40.0% 37.6% 32.1% 30.0% 20.0% 10.0% 20.7% 7.1% 9.3% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing 2011 NJ ASK 4 Science 100.0% 98.8% 96.9% 90.0% 90.0% 80.0% 70.0% 67.6% 60.0% 64.9% 50.0% 47.7% 42.3% 40.0% 31.2% 32.0% 30.0% 20.0% 10.0% 1.2% 3.1% 10.0% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing 2011 NJ ASK 5 Language Arts Literacy 100.0% 90.0% 81.5% 80.0% 80.2% 70.0% 63.5% 67.9% 60.0% 60.9% 54.8% 50.0% 40.0% 39.1% 30.0% 20.0% 18.0% 18.6% 19.8% 12.3% 10.0% 6.1% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing 2011 NJ ASK 5 Mathematics 100.0% 90.0% 88.1% 91.9% 80.0% 80.6% 70.0% 60.0% 60.1% 56.8% 50.0% 40.0% 30.0% 28.0% 20.0% 10.0% 39.5% 41.1% 35.1% 19.4% 11.9% 8.1% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing 2011 NJ ASK 6 Language Arts Literacy 100.0% 90.0% 86.9% 82.6% 80.0% 72.1% 70.0% 69.2% 60.0% 66.7% 59.4% 50.0% 40.0% 33.3% 30.0% 20.0% 10.0% 13.1% 17.5% 14.8% 13.4% 7.3% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing 2011 NJ ASK 6 Mathematics 100.0% 90.0% 89.2% 89.8% 80.0% 77.4% 70.0% 60.0% 53.3% 50.0% 47.9% 49.8% 41.9% 40.0% 35.9% 30.0% 20.0% 10.0% 27.6% 22.7% 10.9% 10.2% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing 2011 NJASK 7 Language Arts Literacy 100.0% 93.3% 90.0% 82.3% 80.0% 70.0% 60.0% 63.3% 62.4% 59.6% 50.0% 51.0% 40.0% 36.7% 30.9% 30.0% 22.7% 20.0% 10.0% 17.7% 12.3% 6.7% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing 2011 NJ ASK 7 Mathematics 100.0% 90.0% 89.4% 82.6% 80.0% 70.0% 65.7% 60.0% 50.0% 46.9% 42.5% 43.7% 41.4% 40.0% 38.9% 34.3% 30.0% 24.3% 20.0% 17.4% 10.0% 10.6% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing NJ ASK 8 Language Arts Literacy 100.0% 92.7% 93.8% 90.0% 82.1% 80.0% 70.0% 60.0% 59.7% 63.0% 53.3% 50.0% 40.0% 39.4% 34.1% 30.0% 20.0% 19.1% 17.8% 10.0% 7.2% 6.2% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing NJ ASK 8 Mathematics 100.0% 90.0% 87.2% 86.4% 80.0% 71.5% 70.0% 60.0% 52.8% 50.0% 46.9% 39.5% 41.1% 40.0% 34.4% 30.0% 28.5% 30.4% 20.0% 10.0% 12.8% 13.7% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing Class of 2015 (Current 9th Graders) Percentage Passing Language Arts Literacy (LAL) 100.0% 90.0% 92.5% 92.7% 92.2% 86.8% 82.7% 92.4% 86.8% 93.8% 91.3% 86.5% 85.5% 80.0% 82.4% 70.0% 82.1% 77.8% 80.6% 70.1% 69.5% 60.1% 60.0% 50.0% 40.0% 30.0% 20.0% 10.0% 0.0% Grade 3 Grade 4 Madison Passing Grade 5 Grade 6 DFG Passing Grade 7 State Passing Grade 8 Class of 2015 (Current 9th Graders) LAL Advanced Proficient 45.0% 38.0% 40.0% 35.0% 31.2% 39.4% 34.1% 30.0% 27.7% 17.5% 25.0% 20.0% 13.0% 12.6% 17.6% 19.1% 13.6% 15.0% 12.1% 10.0% 5.0% 6.3% 6.7% 8.2% 7.2% 4.2% 3.4% 0.0% Grade 3 Grade 4 Grade 5 Advanced Proficient Grade 6 DFG AP Grade 7 State AP Grade 8 Class of 2015 (Current 9th Graders) Percentage Passing Mathematics 100.0% 95.7% 90.0% 94.2% 80.0% 86.8% 91.7% 88.0% 93.9% 84.7% 87.2% 85.0% 88.7% 80.7% 86.1% 86.4% 82.2% 76.7% 70.0% 71.5% 71.2% 64.6% 60.0% 50.0% 40.0% 30.0% 20.0% 10.0% 0.0% Grade 3 Grade 4 Madison Passing Grade 5 Grade 6 DFG Passing Grade 7 State Passing Grade 8 Class of 2015 (Current 9th Graders) Mathematics Advanced Proficient 70.0% 58.2% 60.0% 52.8% 50.0% 40.0% 46.9% 57.2% 48.3% 47.6% 47.0% 46.9% 41.4% 41.0% 42.2% 40.3% 39.6% 30.0% 31.1% 30.4% 28.0% 25.5% 24.5% Grade 5 Grade 6 Grade 7 20.0% 10.0% 0.0% Grade 3 Grade 4 Advanced Proficient DFG AP State AP Grade 8 Class of 2016 (Current 8th Graders) Percentage Passing LAL 100.0% 90.0% 94.8% 95.9% 90.7% 92.8% 92.4% 83.4% 82.6% 80.0% 82.9% 92.7% 82.7% 93.3% 82.3% 70.0% 60.0% 66.2% 65.5% 63.3% Grade 5 Grade 6 Grade 7 50.0% 40.0% 30.0% 20.0% 10.0% 0.0% Grade 3 Grade 4 Madison Passing DFG Passing State Passing Class of 2016 (Current 8th Graders) LAL Advanced Proficient 35.0% 30.9% 30.0% 25.6% 25.0% 21.8% 19.2% 20.0% 22.7% 15.0% 15.6% 13.7% 7.1% 14.4% 10.0% 5.0% 12.3% 8.2% 8.7% 8.8% 7.6% 4.6% 0.0% Grade 3 Grade 4 Advanced Proficient Grade 5 DFG AP Grade 6 State AP Grade 7 Class of 2016 (Current 8th Graders) Percentage Passing Mathematics 100.0% 95.4% 90.0% 95.2% 80.0% 87.3% 93.0% 90.7% 93.8% 89.4% 93.9% 90.1% 86.3% 82.6% 84.8% 70.0% 77.6% 72.1% 65.7% 60.0% 50.0% 40.0% 30.0% 20.0% 10.0% 0.0% Grade 3 Grade 4 Madison Passing Grade 5 DFG Passing Grade 6 State Passing Grade 7 Class of 2016 (Current 8th Graders) Mathematics Advanced Proficient 70.0% 60.0% 57.2% 57.9% 57.8% 49.4% 55.9% 50.0% 46.9% 49.3% 40.0% 46.0% 40.4% 30.0% 32.3% 37.2% 38.9% 23.6% 24.3% 32.2% 20.0% 10.0% 0.0% Grade 3 Grade 4 Advanced Proficient Grade 5 DFG AP Grade 6 State AP Grade 7 NJ High School Proficiency Assessment (HSPA) The New Jersey High School Proficiency Assessment (HSPA) was administered for the first time in Spring 2002 to students who had become first-time 11th graders as of September 1st, 2001. The HSPA consists of two content areas: Mathematics and Language Arts Literacy. Satisfactory HSPA performance in Mathematics and Language Arts Literacy is a requirement for a high school diploma. Students who do not perform at required levels are provided additional instruction and subsequent opportunities for retesting. HSPA 11 Mathematics 100.0% 90.0% 88.9% 89.2% 80.0% 74.1% 70.0% 60.0% 50.0% 46.7% 46.5% 50.1% 42.2% 42.7% 40.0% 30.0% 25.9% 24.0% 20.0% 10.0% 11.1% 10.8% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing HSPA 11 Language Arts Literacy 100.0% 98.0% 96.2% 90.0% 87.1% 80.0% 70.0% 68.7% 61.9% 60.0% 52.0% 50.0% 46.0% 40.0% 34.3% 30.0% 20.0% 10.0% 18.4% 12.9% 2.0% 3.8% 0.0% Partially Proficient Proficient DISTRICT Advanced Proficient DFG STATE Passing SAT Score Rank 25th Percentile – 75th Percentile Verbal Math Essay 2005 480-610 495-650 NA 2006 480-620 510-670 480-620 2007 480-640 500-640 480-640 2008 500-630 520-650 490-650 2009 490-630 520-670 520-650 2010 490-620 500-650 490-620 2011 480-620 490-640 490-640 Scholastic Assessment Test (SAT) SAT Average Score Totals 2000 1800 1687 1690 1720 1730 1701 1600 1655 1645 1662 1676 1675 1400 1503 1489 1500 1503 1516 1097 1200 1000 800 1104 980 600 400 200 2005 2006 2007 Madison 2008 DFG State 2009 2010 Advanced Placement Tests 2005-06 2006-07 2007-08 2008-09 2009-10 2010-11 14 subject area tests 20 subject area tests 16 subject area tests 22 subject area tests 20 subject area tests 21 subject area tests 85% scored 82% 3 or scored higher 3 or higher 89% scored 89% scored 84% scored 89% scored 3 or 3 or 3 or 3 or higher higher higher higher 189 AP tests taken 300 AP tests taken 225 AP tests taken 296 AP tests 281 AP tests 371 AP taken taken tests taken Advanced Placement Classes EXAM Art History* Biology Calculus AB Calculus BC* Chemistry English Language English Literature Environmental Science European History French Language German Language Government & Politics US Macroeconomics * Microeconomics* Music Theory Physics B Psychology Spanish Language Statistics US History World History* Total Number 5 0 11 11 1 5 16 9 3 3 2 1 5 1 1 1 21 13 9 2 9 1 125 4 1 11 3 0 3 8 4 14 5 3 0 4 0 0 3 10 12 5 12 22 0 120 3 0 6 1 1 0 1 9 9 4 2 1 3 0 0 3 4 9 3 20 8 0 84 2 0 4 1 0 0 0 1 5 2 0 3 4 0 0 1 2 2 1 6 0 0 32 1 0 1 0 0 0 0 0 5 1 0 0 0 0 0 0 0 2 0 1 0 0 10 *No AP Course offered at MHS. Students studied independently or via online course. Annual Yearly Progress (AYP) Adequate yearly progress (AYP) is calculated primarily on the state assessment results for language arts literacy (LAL) and mathematics. These results are presented for the total school population and disaggregated subgroups as performance indicators (20 indicators). Assessment participation is also used for the total student population and the disaggregated subgroups (20 indicators). In addition to these total 40 primary indicators, a secondary indicator is used for the final AYP calculation. Attendance is used as the secondary indicator for elementary and middle schools; dropout/graduation rate is used for high schools. An Easy Formula? Calculation 1. (20 + 5)/50 = 25/50 = .5 = 50% 2. 2. CI = 1.96 x Square Root (.5 x (1 – .5) / 50 = 1.96 x Square Root (.25 / 50) = 1.96 x Square Root .005 = 1.96 x .0707 = .1386 = 13.86% 3. 50% + 13.86% = 63.86% 4. 63.86% > 86% = AYP Not Met 2011 AYP Status Madison • Torey J Sabatini – YES • Kings Road School – YES • Central Avenue School – NO – (LAL in the Hispanic Subgroup) • Madison Junior School – YES • Madison High School – YES Hitting a moving Target Content Area Grade Span Starting Point 2003 Language Arts Literacy Elementary (Grades 3-5) 68 75 Middle School (Grades 6-8) 58 High School (Grade 11) Mathematics 2011-2013 (Current) 2014 Really? 59 79 100 66 72 86 100 73 79 85 92 100 Elementary (Grades 3-5) 53 62 66 83 100 Middle School (Grades 6-8) 39 49 61 80 100 High School (Grade 11) 55 64 74 86 100 2005-2007 2008-2010 AYP and Subgroups • Schools must meet benchmarks in all subgroups: •All Students •General Education Students •Special Education Students •Limited English Proficient (LEP) •Gender: Female/Male •Ethnicity: White, Black, Asian, Pacific Islander, Hispanic, American Indian, Other •Economic Status: Disadvantaged Based on Free/Reduced Lunch •Migrant Status 30 or More Students Number of Hispanic Students in Each Elementary School •CAS – 41 •KRS – 3 •TJS – 3 The Future • #2 Pencil Companies (Not Happy) • Partnership of Assessment of Readiness for College and Careers (PARCC) • Switch from NJ Core Curriculum Content Standards to Common Core State Standards PARCC PARCC is a 24-state consortium working together to develop next-generation K12 assessments in English and math. PARCC benefits (According to their website): •Students who will know if they are on track to graduate ready for college and careers •Teachers with regular results available to guide learning and instruction •Parents with clear and timely information about the progress of their children •States with valid results that are comparable across the member states •The nation as it is based on college- and career-ready, internationallybenchmarked CCSS Source: http://www.parcconline.org/ Madison Looking Forward •Curriculum Review to ensure compliance regarding the switch from NJ CCCS to CCSS •Assessing technology needs to accommodate future computerized state testing requirements •Be sure we are preparing ALL students for 21st Century Career and College Readiness •Consistent collaboration and communication with all stakeholders of the Madison Learning Community •Data driven instruction to address at-risk students and sub-groups Questions, Comments, Suggestions, Accolades?