Introducing the New Iowa Assessments

advertisement
Introducing the New Iowa
Assessments
The Iowa Assessments
Dates
Locations
Purposes
Introduction
May
June
AEAs
Overview of changes in content,
ordering, delivery, reporting
Content
Overviews
August
September
Webinars
Details on content coverage,
instructional linkages
Interpretation
Overviews
October
November
AEAs
Webinars
Details on new reports,
interpretations and use
Professional
Development
Scheduled as
needed
Schools
Districts
Strategies for using Iowa
Assessment data to inform and
change instruction
2011 by Iowa Testing Programs
Details
• All slides posted to Iowa Testing Programs
website:
https://www.education.uiowa.edu/itp/
• Q&A is underway and will be posted by early
June
• Catherine-welch@uiowa.edu
2011 by Iowa Testing Programs
Overview of New Iowa
Assessments
New Iowa Assessments
• Forms E and F
• All new items
• All items written and reviewed by Iowa
educators
• All items field tested on Iowa students
• All items align to the Iowa Core and the
Common Core State Standards
2011 by Iowa Testing Programs
Major Changes from Current Forms
• All Levels
– Order of tests within the booklet; adjusted number of items
– Use of color, page layouts
– New configuration of composite scores
• Levels 5/6 to 8
– Sources of Information has been eliminated
• Levels 9 to 14
– Maps and Diagrams and Reference Materials have been eliminated*
– Mathematics (two separately timed parts) has replaced Math Concepts and
Estimation and Math Problem Solving and Data Interpretation
• Levels 15 to 17/18
– Spelling and Sources of Information* have been eliminated
*where appropriate content has been moved to Science or Social Studies
2011 by Iowa Testing Programs
Implications for AYP/NCLB Testing
(Levels 9 to 14)
Forms A and B
• Reading Comprehension (25
+ 30 mins)
• Science (30 mins)
• Mathematics Concepts and
Estimation (25 + 5 mins)
• Mathematics Problem
Solving and Data
Interpretation (30 mins)
Forms E and F
• Reading, Part 1 (30 mins)
• Reading, Part 2 (30 mins)
• Science (35 mins)
• Mathematics, Part 1 (30
mins)
• Mathematics, Part 2 (30
mins)
2011 by Iowa Testing Programs
Implications for AYP/NCLB Testing
(Levels 15 – 17/18)
Forms A and B
• Reading (40 mins)
• Science (40 mins)
• Mathematics (40 mins)
Forms E and F
• Reading (40 mins)
• Science (40 mins)
• Mathematics (40 mins)
2011 by Iowa Testing Programs
Level 10 Example
Score
Reading

Written Expression

Conventions of Writing

Vocabulary

Composite Scores
ELA Total
Mathematics

Computation

Mathematics Total
Core Composite
Science

Social Studies

Complete Composite
2011 by Iowa Testing Programs
Level 15 Example
Score
Reading

Written Expression

Vocabulary

Composite Scores
ELA Total
Mathematics

Computation

Mathematics Total
Core Composite
Science

Social Studies

Complete Composite
2011 by Iowa Testing Programs
Reading Specifications
Level
9
10
Content
Explicit Meaning
Essential
Competencies
Conceptual
Understanding


Extended
Reasoning
Implicit Meaning


Author’s Craft


Key Ideas


Vocabulary


Explicit Meaning


Implicit Meaning


Author’s Craft


Key Ideas


Vocabulary

2011 by Iowa Testing Programs

Written Expression Specifications
Level
9
Content
Appropriate Expression
Essential
Competencies
Conceptual
Understanding



Planning and Organization
10
Extended
Reasoning
Sentence Structure

Usage and Grammar

Appropriate Expression




Planning and Organization
Sentence Structure

Usage and Grammar

2011 by Iowa Testing Programs

Mathematics Specifications
Level
9
10
Content
Essential
Competencies
Conceptual
Understanding
Extended
Reasoning
Algebraic Patterns and
Connections


Data, Probability and Statistics


Geometry



Measurement



Number Sense and Operations



Algebraic Patterns and
Connections


Data, Probability and Statistics









Geometry
Measurement
Numbers Sense and Operations

2011 by Iowa Testing Programs
Science Specifications
Level
12
13
14
Content
Essential
Competencies
Conceptual
Understanding
Extended
Reasoning
Earth Science



Life Science



Physical Science



Earth Science



Life Science



Physical Science



Earth Science



Life Science



Physical Science



2011 by Iowa Testing Programs
Social Studies Specifications
Level
9
10
11
Content
Essential
Competencies
Conceptual
Understanding
Extended
Reasoning
Civics/Government



Economics



Geography



History



Civics/Government



Economics


Geography



History



Civics/Government



Economics



Geography






History
2011 by Iowa Testing Programs
Skills Tests
Level
Test
Essential
Competencies
All
Spelling

All
Capitalization

All
Punctuation

All
Vocabulary

All
Computation

2011 by Iowa Testing Programs
Conceptual
Understanding
Extended
Reasoning
Test Design and Development
2011 by Iowa Testing Programs
Iowa Assessments – Forms E/F
• Standards-based instructional decisions
• Individual progress and growth for individuals
• Reporting group progress and growth
• Providing relative comparisons
• Providing empirical evidence that supports comparisons with NAEP,
state results and international benchmarking measures
• Providing information that measures a continuum of achievement and
tracks student progress from kindergarten to grade 12.
• Measuring achievement in core academic areas important for success
in college including reading, language arts, mathematics and science.
2011 by Iowa Testing Programs
Test Development
Sources of Evidence
•
•
•
•
•
•
•
•
Common Core State Standards
Leading state standards
International standards
Assessment data
Curriculum surveys
NAEP frameworks and specifications
Scholarly research in curriculum and assessment
Feedback from educators, researchers, professional organizations,
parents, students
2011 by Iowa Testing Programs
Introduction to Reports
Reports to Support Uses of
The Iowa Assessments
•
•
•
•
•
Standards-based Interpretations
Accountability
Growth
College Readiness
Relative Comparisons
2011 by Iowa Testing Programs
Standards-Based Interpretations
• Determine which standards have been
mastered by the student, classroom or school
• Determine which standards
need additional
focus
• Compare progress
among students
2011 by Iowa Testing Programs
Accountability
2011 by Iowa Testing Programs
Measure Growth
• Determine expected growth
for all students
• Set goals for a student based
on any starting place
• Measure student growth
using vertically articulated
standards
2011 by Iowa Testing Programs
College Readiness
• Predict college readiness indicators
• Help students plan the appropriate
coursework
• Identify students
that are not
“on track”
2011 by Iowa Testing Programs
Relative Comparisons
• Determine student strengths with respect
to the school, district, state
and nation
• Use relative comparisons
to evaluate programs,
set expectations and determine interventions
2011 by Iowa Testing Programs
Reports – Standard Service
•
•
•
•
•
•
•
List of student scores
Summary reports
Student labels
Profile Narrative Report
Mathematics Performance Summary
Reading Performance Summary
Student data on CD
2011 by Iowa Testing Programs
2011 by Iowa Testing Programs
2011 by Iowa Testing Programs
2011 by Iowa Testing Programs
2011 by Iowa Testing Programs
Reports – Optional
•
•
•
•
•
•
Group Diagnostic Report
Group Item Response Record
Group Item Analysis
Individual/Group Performance Profile
Individual/Group Longitudinal Report
Individual/Group Common Core Standards
Domain Report
• Group Narrative Summary
2011 by Iowa Testing Programs
2011 by Iowa Testing Programs
Scoring and Reporting
• Standard Service
• List of Student Scores
• Summary Reports
2011 by Iowa Testing Programs
2011 by Iowa Testing Programs
2011 by Iowa Testing Programs
2011 by Iowa Testing Programs
2011 by Iowa Testing Programs
Implications for AYP Reporting
New Iowa Assessments
Implications for Determination of Proficiency
• Background
– Due to historical trend data available prior to
NCLB, the state’s workbook application requested
continued flexibility of administration dates (fall,
midyear or spring)
– The National Percentile Rank (NPR) metric
allowed for a fixed cutscore while allowing for
flexibility in administration dates
2011 by Iowa Testing Programs
New Iowa Assessments
Implications for Determination of Proficiency
• Assumptions for new forms
– Schools will continue to administer their Iowa
Assessments to meet their scheduling requirements
and to retain their historical trend data (fall, midyear
or spring)
– New forms will be linked to previous forms and the
equivalent of the 41st NPR from the 2000 norms will
be identified on the Form E scale
– The expectations for proficiency remain the same
from Forms A/B to Forms E/F
– Interpretation information will be made available to
schools to transition to new forms
2011 by Iowa Testing Programs
Standard Score Scale
41 NPR =
259 Standard Score =
21 Raw Score
2011 by Iowa Testing Programs
Current Proficiency Ranges –
High School Reading Example
Testing Period
Fall
Score
Not Proficient
Proficient
1-20
21-44
165-258
259-369
NPR
1-40
41-99
Raw Score
1-21
22-44
170-261
262-369
NPR
1-40
41-99
Raw Score
1-22
23-44
170-262
263-374
1-40
41-99
Raw Score
Standard Score
Midyear
Standard Score
Spring
Standard Score
NPR
2011 by Iowa Testing Programs
Proposed Link to Proficiency Ranges –
High School Reading Example
Testing
Period
Fall
Score
Raw Score
Standard Score
Midyear
Proficiency –
New
21-44
New assessments
will be linked to
current
assessments
259-369
NPR
41-99
Raw Score
22-44
Standard Score
Spring
Proficiency -Current
262-369
NPR
41-99
Raw Score
23-44
Standard Score
NPR
263-374
41-99
2011 by Iowa Testing Programs
Standard score
scale will be
established using
linking
relationship
SS metric will be
used for reporting
AYP
Reading Example
Fall
Midyear
Spring
41st NPR
41st NPR
41st NPR
Form A
Form E
259 SS
257 SS
Form A
Form E
262 SS
259 SS
Form A
Form E
263 SS
260 SS
2011 by Iowa Testing Programs
Summary
• Proficiency cutscores be reported in Standard
Score metric
• Proficiency cutscores be available in August
• Cutscores will be provided for:
– Grades 3-12
– Mathematics, Reading, Science
– Fall, Midyear, Spring
2011 by Iowa Testing Programs
Test Administration and Delivery
Test Administration and Delivery
•Registering/Ordering Materials
•Receiving Materials
•Administering Assessments
•Returning Materials
•Scoring and Reporting
Registering and Ordering Materials
• Continue to use Online Tools to register
and order materials
• Continue to use current process for
Student Demographic Files
(“barcodes”)
2011 by Iowa Testing Programs
Online Tools
Closed from June 8 through August 15 for updates
Receiving Testing Materials
• Test Booklets, Directions for Administration
and Answer Documents
– Pearson will continue to pack and ship
• Interpretive materials
– Available as pdfs at Online Tools
2011 by Iowa Testing Programs
Administration Configurations for
Iowa Assessments
Year
Form
Paper/Pencil
Online
Constructed
Response
(optional)
2011-2012
E

Pilot
Pilot
2012-2013
F

Pilot

2013-2014
E



2014-2015
F



2011 by Iowa Testing Programs
Accommodations
• Determined by IEP or 504 Plan
• Should be consistent with state policy as
defined in the annual Department of
Education letter on NCLB requirements
2011 by Iowa Testing Programs
Calculator Use
• Calculators may be used on the Mathematics
test (Parts 1 and 2)
– Use of calculators should be guided by district
alignment of assessment with instruction
– No separate calculator norms
• Calculators may not be used on the
Computation test
2011 by Iowa Testing Programs
Test Security
• Assurance statement for school
administrators from the Iowa Department
of Education
• Applies to test preparation and test
administration practices
• Maintaining test security is a requirement
for NCLB compliance and Title I funds
2011 by Iowa Testing Programs
2011 by Iowa Testing Programs
Returning Testing Materials
• Test Booklets and Answer Documents
– Return materials to Pearson
– Answer Documents must have barcodes to be
processed
• Order for Scoring Services (OSS)
– Complete in ITP Online Tools
2011 by Iowa Testing Programs
Scoring and Reporting
• CD-ROM
– Shipped from Riverside to address provided on OSS
– New record layout
• Printed Reports
– Shipped from Pearson to address provided on OSS
2011 by Iowa Testing Programs
Download