PARCC Update June 6, 2014 PARCC Update Today’s Presentation: PARCC Field Test Lessons Learned from the Field Test PARCC Resources 2 Introduction to PARCC The Partnership for Assessment of Readiness for College and Careers: •A consortium of states developing common, high-quality English language arts (ELA) and math tests for grades 3–11 o Computer-based and linked to what students need to know for college and careers •Two summative assessment components: o o Performance-Based Assessment (PBA) End-of-Year Assessment (EOY) 3 PARCC Field Testing: Schools in 14 States & DC • Over 1 million students • Nearly 16,000 schools • 2 grades per school 4 PARCC Field Testing in New York • 230 Schools in 75 Districts agreed to participate in the PARCC Field Test in Spring 2014. • 60% of the field tests were administered online; 40% on paper. • Field tests were administered in ELA and Math in Grades 3-11. 5 Purpose of Field Tests The field tests are designed to generate data to evaluate the quality of the test questions. • Opportunity for a number of important research studies. • Not designed to yield individual student, school, or district results. • No stakes for schools, teachers, or students. 6 Field Testing Windows MARCH APRIL MAY JUNE 24 11 5 6 Field testing the performance-based assessment, which features writing in English Language Arts (ELA) and multistep, real-world problems in math Field testing the endof-year assessment, which features reading comprehension in ELA and conceptual understanding in math 7 Field Test Benefits • Students become familiar with new item types and the test delivery platform • Teachers provide feedback to PARCC on “how it went” • Technology Coordinators evaluate their schools’ technology systems • Administrators evaluate overall readiness • Test Developers measure the reliability of the test questions 8 Test Management System 9 Managing Computer-Based Testing 10 Managing Test Sessions 11 Managing Test Sessions 12 The Test Environment 13 The Test Environment - ELA 14 The Test Environment - Math 15 The Test Environment - Math 16 Reviewing Answers 17 Types of Accessibility Features and Accommodations Features for All Students Accessibility Features* Identified in advance Accommodations** 18 Accessibility Features for All Students Assigned the Computer-Based Test Mode Accessibility Features for All Students Assigned the Computer-Based Test Mode Audio Amplification Blank/Scratch Paper (provided by test administrator) Eliminate Answer Choices Flag Items for Review General Administration Directions Clarified (by test administrator) General Administration Directions Read Aloud and Repeated (by test administrator) Text Highlighter Tool Headphones or Noise Buffers Line Reader Magnification/Enlargement Device Pop-Up Glossary Redirect Student to Test (by test administrator) Writing Tools 19 Feedback on the PARCC Field Test from New York PARCC Field Test Studies 21 Field Test Feedback • PARCC Surveys Test Coordinators Technology Coordinators Test Administrators Students • NYSED Feedback Sessions Gathering feedback from participating districts and schools on the field test and technology readiness • New York feedback is shared with PARCC & Pearson 22 How Will PARCC Use Feedback? • PARCC staff, Working Groups and Pearson are analyzing feedback • PARCC will use feedback in summer planning meetings to identify lessons learned and issues to fix for next year • Feedback will be used to inform decisions on the following: Technology platform alterations Administrative portal set-up Test administration policies and procedures Direct edits to the test administration manuals and supporting documents 23 Field Test Feedback • Overall, across PARCC and in New York, the computer-based field test went smooth with isolated reports of technology challenges. • Almost all schools in New York that started the computer-based field test were able to complete the test. • A majority of students responding to the survey after the PBA field test indicated that they would prefer to take the test online. 24 Districts & Schools are saying… • The test delivery platform worked. There were glitches, but not at every school or for every student. • Time needed to prepare upfront was significant. • More staff need to be present to support test administration. • The field needs clearer documentation, resources, and training. • Students need practice with the math equation editor. 25 Performance-Based Assessment Student Reported Problems - ELA 6.0% The computer stopped working 4.6% 8.0% 31.0% 3.2% The computer worked slowly I had a hard time dragging or moving things on the screen I had a hard time making changes to my answers No problems happened during the test No Response 47.2% 26 Performance-Based Assessment Student Reported Problems - Math 3.6% The computer stopped working 7.7% 4.3% 30.5% The computer worked slowly I had a hard time dragging 13.1% or moving things on the screen I had a hard time making changes to my answers No problems happened during the test No Response 40.9% 27 Advice for Preparing for Computer-Based Testing • Preparation is the key to success. • Computer-based testing requires a significant time commitment from network and technology staff. • Teachers and students need to use the technology and tools all year long to be comfortable and prepared for CBT. 28 Communication is Critical • • • • • • • • • • • Important Notices • Test Administration Policy • Test Sessions Content Filters Firewalls Proxies TestNav District IT Communications Special Alerts Technology Updates New Tools New Processes Important Notices LEA Technology Staff LEA & School Test Administrators NYSED & PARCC School Technology Staff • • • • Firewalls Proctor Caching TestNav District IT Communications 29 What’s Coming from PARCC Diagnostic Assessments • • • • Grades 2-8 Reading, Writing, Math Some computer adaptive subtests Designed to pinpoint students’ learning needs Mid-Year/Interim Assessments • • • • • K-1 Formative Tasks • • • 30 Grades K-1 Reading and math Instructionally embedded performance tasks Grades 3-11 ELA/Literacy and Math Paper-based shifting to computer based Built from released PBA tasks Can be used for assessment at individual, classroom, school levels Speaking & Listening Tools • • • Grades K-12 Performance-based activities Spontaneous oral response to oral prompt; share findings of research in an oral presentation Resources Available Resources http://parcc.pearson.com 32 PARCC Training Management System The PARCC Training Management System is where all the training modules will be located. Go to https://PARCC.pearson.com/TMS to access all training available. 33 PARCC Practice Tests http://practice.parcc.testnav.com/ Spring 2014 Release Fall 2014 Release • Grades 3–11 PerformanceBased Assessment tests for ELA • Grades 3–8 End-of-Year tests for mathematics • Algebra I, Geometry, and Algebra II End-of-Year tests for mathematics • Grades 3–11 End-of-Year tests for ELA • Grades 3–8 PerformanceBased tests for mathematics • Algebra I, Geometry, and Algebra II PerformanceBased tests for mathematics 34 PARCC Resources • • • • • • • PARCC Field Test Information http://www.parcconline.org/field-test PearsonAccess http://parcc.pearson.com Field Test Training Modules http://parcc.tms.pearson.com Test Specifications and Blueprints http://www.parcconline.org/assessment-blueprints-test-specs PARCC Online Sample Items http://practice.parcc.testnav.com PARCC Accessibility Features and Accommodations Manual http://www.parcconline.org/parcc-accessibility-features-andaccommodations-manual Model Content Frameworks www.parcconline.org/parcc-model-content-frameworks 35 Jennifer Sattem PARCC Field Test Lead for NY jsattem@mail.nysed.gov