Introducing the New Iowa Assessments The Iowa Assessments Dates Locations Purposes Introduction May June AEAs Overview of changes in content, ordering, delivery, reporting Content Overviews August September Webinars Details on content coverage, instructional linkages Interpretation Overviews October November AEAs Webinars Details on new reports, interpretations and use Professional Development Scheduled as needed Schools Districts Strategies for using Iowa Assessment data to inform and change instruction 2011 by Iowa Testing Programs Details • All slides posted to Iowa Testing Programs website: https://www.education.uiowa.edu/itp/ • Q&A is underway and will be posted by early June • Catherine-welch@uiowa.edu 2011 by Iowa Testing Programs Overview of New Iowa Assessments New Iowa Assessments • Forms E and F • All new items • All items written and reviewed by Iowa educators • All items field tested on Iowa students • All items align to the Iowa Core and the Common Core State Standards 2011 by Iowa Testing Programs Major Changes from Current Forms • All Levels – Order of tests within the booklet; adjusted number of items – Use of color, page layouts – New configuration of composite scores • Levels 5/6 to 8 – Sources of Information has been eliminated • Levels 9 to 14 – Maps and Diagrams and Reference Materials have been eliminated* – Mathematics (two separately timed parts) has replaced Math Concepts and Estimation and Math Problem Solving and Data Interpretation • Levels 15 to 17/18 – Spelling and Sources of Information* have been eliminated *where appropriate content has been moved to Science or Social Studies 2011 by Iowa Testing Programs Implications for AYP/NCLB Testing (Levels 9 to 14) Forms A and B • Reading Comprehension (25 + 30 mins) • Science (30 mins) • Mathematics Concepts and Estimation (25 + 5 mins) • Mathematics Problem Solving and Data Interpretation (30 mins) Forms E and F • Reading, Part 1 (30 mins) • Reading, Part 2 (30 mins) • Science (35 mins) • Mathematics, Part 1 (30 mins) • Mathematics, Part 2 (30 mins) 2011 by Iowa Testing Programs Implications for AYP/NCLB Testing (Levels 15 – 17/18) Forms A and B • Reading (40 mins) • Science (40 mins) • Mathematics (40 mins) Forms E and F • Reading (40 mins) • Science (40 mins) • Mathematics (40 mins) 2011 by Iowa Testing Programs Level 10 Example Score Reading Written Expression Conventions of Writing Vocabulary Composite Scores ELA Total Mathematics Computation Mathematics Total Core Composite Science Social Studies Complete Composite 2011 by Iowa Testing Programs Level 15 Example Score Reading Written Expression Vocabulary Composite Scores ELA Total Mathematics Computation Mathematics Total Core Composite Science Social Studies Complete Composite 2011 by Iowa Testing Programs Reading Specifications Level 9 10 Content Explicit Meaning Essential Competencies Conceptual Understanding Extended Reasoning Implicit Meaning Author’s Craft Key Ideas Vocabulary Explicit Meaning Implicit Meaning Author’s Craft Key Ideas Vocabulary 2011 by Iowa Testing Programs Written Expression Specifications Level 9 Content Appropriate Expression Essential Competencies Conceptual Understanding Planning and Organization 10 Extended Reasoning Sentence Structure Usage and Grammar Appropriate Expression Planning and Organization Sentence Structure Usage and Grammar 2011 by Iowa Testing Programs Mathematics Specifications Level 9 10 Content Essential Competencies Conceptual Understanding Extended Reasoning Algebraic Patterns and Connections Data, Probability and Statistics Geometry Measurement Number Sense and Operations Algebraic Patterns and Connections Data, Probability and Statistics Geometry Measurement Numbers Sense and Operations 2011 by Iowa Testing Programs Science Specifications Level 12 13 14 Content Essential Competencies Conceptual Understanding Extended Reasoning Earth Science Life Science Physical Science Earth Science Life Science Physical Science Earth Science Life Science Physical Science 2011 by Iowa Testing Programs Social Studies Specifications Level 9 10 11 Content Essential Competencies Conceptual Understanding Extended Reasoning Civics/Government Economics Geography History Civics/Government Economics Geography History Civics/Government Economics Geography History 2011 by Iowa Testing Programs Skills Tests Level Test Essential Competencies All Spelling All Capitalization All Punctuation All Vocabulary All Computation 2011 by Iowa Testing Programs Conceptual Understanding Extended Reasoning Test Design and Development 2011 by Iowa Testing Programs Iowa Assessments – Forms E/F • Standards-based instructional decisions • Individual progress and growth for individuals • Reporting group progress and growth • Providing relative comparisons • Providing empirical evidence that supports comparisons with NAEP, state results and international benchmarking measures • Providing information that measures a continuum of achievement and tracks student progress from kindergarten to grade 12. • Measuring achievement in core academic areas important for success in college including reading, language arts, mathematics and science. 2011 by Iowa Testing Programs Test Development Sources of Evidence • • • • • • • • Common Core State Standards Leading state standards International standards Assessment data Curriculum surveys NAEP frameworks and specifications Scholarly research in curriculum and assessment Feedback from educators, researchers, professional organizations, parents, students 2011 by Iowa Testing Programs Introduction to Reports Reports to Support Uses of The Iowa Assessments • • • • • Standards-based Interpretations Accountability Growth College Readiness Relative Comparisons 2011 by Iowa Testing Programs Standards-Based Interpretations • Determine which standards have been mastered by the student, classroom or school • Determine which standards need additional focus • Compare progress among students 2011 by Iowa Testing Programs Accountability 2011 by Iowa Testing Programs Measure Growth • Determine expected growth for all students • Set goals for a student based on any starting place • Measure student growth using vertically articulated standards 2011 by Iowa Testing Programs College Readiness • Predict college readiness indicators • Help students plan the appropriate coursework • Identify students that are not “on track” 2011 by Iowa Testing Programs Relative Comparisons • Determine student strengths with respect to the school, district, state and nation • Use relative comparisons to evaluate programs, set expectations and determine interventions 2011 by Iowa Testing Programs Reports – Standard Service • • • • • • • List of student scores Summary reports Student labels Profile Narrative Report Mathematics Performance Summary Reading Performance Summary Student data on CD 2011 by Iowa Testing Programs 2011 by Iowa Testing Programs 2011 by Iowa Testing Programs 2011 by Iowa Testing Programs 2011 by Iowa Testing Programs Reports – Optional • • • • • • Group Diagnostic Report Group Item Response Record Group Item Analysis Individual/Group Performance Profile Individual/Group Longitudinal Report Individual/Group Common Core Standards Domain Report • Group Narrative Summary 2011 by Iowa Testing Programs 2011 by Iowa Testing Programs Scoring and Reporting • Standard Service • List of Student Scores • Summary Reports 2011 by Iowa Testing Programs 2011 by Iowa Testing Programs 2011 by Iowa Testing Programs 2011 by Iowa Testing Programs 2011 by Iowa Testing Programs Implications for AYP Reporting New Iowa Assessments Implications for Determination of Proficiency • Background – Due to historical trend data available prior to NCLB, the state’s workbook application requested continued flexibility of administration dates (fall, midyear or spring) – The National Percentile Rank (NPR) metric allowed for a fixed cutscore while allowing for flexibility in administration dates 2011 by Iowa Testing Programs New Iowa Assessments Implications for Determination of Proficiency • Assumptions for new forms – Schools will continue to administer their Iowa Assessments to meet their scheduling requirements and to retain their historical trend data (fall, midyear or spring) – New forms will be linked to previous forms and the equivalent of the 41st NPR from the 2000 norms will be identified on the Form E scale – The expectations for proficiency remain the same from Forms A/B to Forms E/F – Interpretation information will be made available to schools to transition to new forms 2011 by Iowa Testing Programs Standard Score Scale 41 NPR = 259 Standard Score = 21 Raw Score 2011 by Iowa Testing Programs Current Proficiency Ranges – High School Reading Example Testing Period Fall Score Not Proficient Proficient 1-20 21-44 165-258 259-369 NPR 1-40 41-99 Raw Score 1-21 22-44 170-261 262-369 NPR 1-40 41-99 Raw Score 1-22 23-44 170-262 263-374 1-40 41-99 Raw Score Standard Score Midyear Standard Score Spring Standard Score NPR 2011 by Iowa Testing Programs Proposed Link to Proficiency Ranges – High School Reading Example Testing Period Fall Score Raw Score Standard Score Midyear Proficiency – New 21-44 New assessments will be linked to current assessments 259-369 NPR 41-99 Raw Score 22-44 Standard Score Spring Proficiency -Current 262-369 NPR 41-99 Raw Score 23-44 Standard Score NPR 263-374 41-99 2011 by Iowa Testing Programs Standard score scale will be established using linking relationship SS metric will be used for reporting AYP Reading Example Fall Midyear Spring 41st NPR 41st NPR 41st NPR Form A Form E 259 SS 257 SS Form A Form E 262 SS 259 SS Form A Form E 263 SS 260 SS 2011 by Iowa Testing Programs Summary • Proficiency cutscores be reported in Standard Score metric • Proficiency cutscores be available in August • Cutscores will be provided for: – Grades 3-12 – Mathematics, Reading, Science – Fall, Midyear, Spring 2011 by Iowa Testing Programs Test Administration and Delivery Test Administration and Delivery •Registering/Ordering Materials •Receiving Materials •Administering Assessments •Returning Materials •Scoring and Reporting Registering and Ordering Materials • Continue to use Online Tools to register and order materials • Continue to use current process for Student Demographic Files (“barcodes”) 2011 by Iowa Testing Programs Online Tools Closed from June 8 through August 15 for updates Receiving Testing Materials • Test Booklets, Directions for Administration and Answer Documents – Pearson will continue to pack and ship • Interpretive materials – Available as pdfs at Online Tools 2011 by Iowa Testing Programs Administration Configurations for Iowa Assessments Year Form Paper/Pencil Online Constructed Response (optional) 2011-2012 E Pilot Pilot 2012-2013 F Pilot 2013-2014 E 2014-2015 F 2011 by Iowa Testing Programs Accommodations • Determined by IEP or 504 Plan • Should be consistent with state policy as defined in the annual Department of Education letter on NCLB requirements 2011 by Iowa Testing Programs Calculator Use • Calculators may be used on the Mathematics test (Parts 1 and 2) – Use of calculators should be guided by district alignment of assessment with instruction – No separate calculator norms • Calculators may not be used on the Computation test 2011 by Iowa Testing Programs Test Security • Assurance statement for school administrators from the Iowa Department of Education • Applies to test preparation and test administration practices • Maintaining test security is a requirement for NCLB compliance and Title I funds 2011 by Iowa Testing Programs 2011 by Iowa Testing Programs Returning Testing Materials • Test Booklets and Answer Documents – Return materials to Pearson – Answer Documents must have barcodes to be processed • Order for Scoring Services (OSS) – Complete in ITP Online Tools 2011 by Iowa Testing Programs Scoring and Reporting • CD-ROM – Shipped from Riverside to address provided on OSS – New record layout • Printed Reports – Shipped from Pearson to address provided on OSS 2011 by Iowa Testing Programs