Interim Assessments
1
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Interim Comprehensive Assessments
(ICAs)
•Include the same item types and formats, including performance tasks, as the summative
assessments
•Use the same blueprints as the summative assessments and assess the same standards.
•Yield results on the same vertical scale yield overall scale scores, overall performance level
designations, and claim-level information
•Fixed forms and will become adaptive when item counts are adequate
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
2
Interim Assessment Blocks (IABs)
• Focus on smaller sets of targets
•Provide more detailed information for instructional purposes.
•Currently available only as fixed forms
•Yield overall more specific information for each block/target set.
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
3
Assessment Viewing Application
The Assessment Viewing Application (AVA)
◦ Provides access to the interim assessments and items for professional development .
◦ AVA is available to users with a TIDE account
Available this fall in the AVA app on the WCAP portal
http://wa.portal.airast.org/test-administrators/
OSPI content specialists are developing guidance for proper use of the information gained through viewing
the items in the interims, and plan to have that available in the fall of 2015.
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
4
Current Interim Assessments
•
•
•
•
•
Fully accessible
Available for both ELA and Mathematics
Fixed form online tests, to become adaptive as item
bank allows
Current set of IABs available – next few slides
Blocks with an asterisk are not available for the 2015-16 school
year.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
5
English Language Arts IABs
Grade 3-5
Read Literary Texts
Read Informational Texts
Edit/Revise
Brief Writes
Listen/Interpret
Research
Narrative Performance Task * Gr4-5 only in 2015-16
Informational Performance Task * N/A in 15-16
Opinion Performance Task * Gr3 only in 2015-16
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
6
English Language Arts IABs
Grade 6-8
Read Literary Texts
Read Informational Texts
Edit/Revise
Brief Writes
Listen/Interpret
Research
Narrative Performance Task*
Explanatory Performance Task*
Argument Performance Task
High School
Read Literary Texts
Read Informational Texts
Edit/Revise
Brief Writes
Listen/Interpret
Research
Explanatory Performance Task*
Argument Performance Task
* Not available in 2015-16
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
7
Math Interim Assessment Blocks for
2015–16
Grade 3
Grade 4
Grade 5
Fractions
Measurement/Data
Operations/
Algebraic Thinking
Performance Task
Fractions
Numbers Base 10
Operations/
Algebraic Thinking
Performance Task
Fractions
Expressions/Equations
Measurement/Data Geometry
Numbers Base 10
Ratio/Proportions
Performance Task
Grade 6
Performance Task
Grade 7
Grade 8
Grade 11
Expressions/Equations
Number Systems
Ratio/Proportions
Performance Task
Expressions/Equations
Functions
Geometry
Performance Task
Linear Functions
Quadratic Functions
Geometry
Performance Task
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
8
Interim Assessments: Scoring Training
(THSS)
Scoring
◦ Interim assessments will have various item types, most of which will be
machine scored
◦ Hand scoring will be a local (school/classroom) responsibility
◦ Rubrics and training are provided online as part of the THSS system and also
under the THSS Materials tab in TIDE
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
9
Scoring Materials
Found in the Teacher Hand Scoring System (THSS) is available within the WA Portal.
Each item has an Exemplar tab and Training Guide tab to use with training.
◦ Calibration – most important aspect!
◦ Exemplars include a “Prep Set” to walk teachers through scored, student responses and a “Check Set”
to test consistency in scoring each item.
◦ Training Guide includes: Background information for the teacher (i.e. the passage/stimuli students read,
the item, rubric, informational notes for teacher understanding).
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
10
Training Guide - ELA
◦
◦
◦
◦
◦
◦
Cover page: Instructions by claim
Stimulus (passage or prompts) or sources
Item stem
Rubric(s)
Condition code document
Claim and target chart
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
11
9/29/2015
Exemplars - ELA
◦ Prep Set
◦ ~10 student response papers
◦ Ordered 2, 1, 0
◦ Includes metadata, item stem, student response,
and scoring comments Check Set
◦ ~10 student response papers
◦ Randomly ordered
◦ Include metadata, item stem, and student
response
◦ Key to Check Set Scores
◦ Included scores and scoring comments
Training Guide - Mathematics
◦
◦
◦
◦
◦
◦
◦
Cover page
Stimulus for Performance Task
Metadata table
Item stem
Dependent item stem (if applicable)
Rubric and exemplar response
Condition code document
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
13
Exemplars - Mathematics
◦ Prep Set
◦ ~5-10 student response papers
◦ Ordered full credit, partial credit, no credit
◦ Includes metadata, item stem, student response(s) to dependent item(s) (if
applicable), student response, and scoring comments
◦ Check Set
◦ ~5-10 student response papers
◦ Randomly ordered
◦ Includes metadata, item stem, student response(s) to dependent item(s) (if
applicable), student response
◦ Key to Check Set Scores
◦ Included scores and scoring comments
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
14
IAB Reporting
•Individual student scores are available for each block.
•Reporting for each block is based on three classifications related to the overall
scale score cut point between levels 2 and 3: “Below Standard,” “At/Near
Standard,” and “Above Standard.”
•Each IAB can be administered unlimited times to a classroom.
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
15
ICA Reporting
•ICA reporting is the same as for the summative assessment:
• Overall scale score achievement level per content area/subject.
• Claim score reporting is based on the overall scale score for levels 1-4 with
the cut point between levels 2 and 3.
• ICAs can be administered unlimited times to a classroom.
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
16
Interim Assessments
Interim Assessment Blocks (IABs) for ELA
◦ The non-PT ELA blocks have 5-9 questions.
◦ Each ELA block contains a different amount of hand scored items:
◦ Listening, Research and Edit/Revise blocks are all machine scored
◦ Brief Write blocks are all hand scored
◦ Reading Lit and Reading Info blocks have1-2 hand scored items per block
◦ All PT blocks have three questions and a full write.
◦ Two Research items and the Full Write are hand scored.
◦ One Research item is machine scored.
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
17
What will hand scoring look like within
an ELA block?
Reading Literary Text (1-2 items 2pt rubric)
Reading Informational Text (1-2 items 2pt rubric)
Brief Writes (all items, 2pt rubric)
Performance Tasks
◦ 1 Full Write (10 pt rubric)
◦ 4 pts for Organization
◦ 4 pts for Elaboration
◦ 2 pts for Conventions
◦ 2 Research questions (2 pt rubrics)
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
18
Interim Assessment Blocks: ELA
ELA Block
# of items
Reading Lit
13-15
Reading Info
14-16
Brief Write
6 brief writing tasks
Response type
Mostly machine
scored, a few hand
scored
Mostly machine
scored, a few hand
scored
Estimated Time*
45 min -1 hour
45 min -1 hour
All hand scored
45 min -1 hour
Edit/Revise
13-16
All machine scored
30 min
Listening
14-16
All machine scored
30 min
Research
17-18
All machine scored
30 min
Mostly hand-scored
1-2 hours, including 30
minutes for the
classroom activity.
All Performance Tasks
3 items and 1 full
write
*Estimated time is based on 1-2 minutes to answer a MC question and up to 5 to answer a constructed
9/29/2015
response. Plus time to read stimulus/sources.
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
19
IABs 2015–16: Math, Grades 3–5
Math Blocks
# of items
Response type
Estimated Time*
Grade 3
Fractions
Measurement & Data
Operations & Alg. Thinking
Grade 4
Fractions
Numbers Base 10
Operations & Alg. Thinking
13–16
All machine scored
30–45 min
Mostly hand scored
1 ½ hour, including 30
minutes for the
classroom activity.
Grade 5
Fractions
Measurement & Data
Numbers Base 10
Grades 3, 4, & 5
Performance Task
6
*Estimated times for the non-PT blocks are based on 1–2
minutes to answer a Claim 1 question and 2–6 minutes to
answer a Claim 2, 3, or 4 question.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
20
IABs 2015–16: Math, Grades 6–8
Math Blocks
# of items
Response type
Estimated Time*
Grade 6
Expressions & Equations
Geometry
Ratios & Proportional Relations
Grade 7
Expressions & Equations
Number System
Ratios & Proportional Relations
13–16
All machine scored
30–45 min
Mostly hand scored
1 ½ hour, including 30
minutes for the
classroom activity.
Grade 8
Expressions & Equations
Functions
Geometry
Grades 6, 7, & 8
Performance Task
6
*Estimated times for non-PT blocks are based on 1–2 minutes to answer a Claim 1 question and 2–6 minutes
to answer a Claim 2, 3, or 4 question.
9/29/2015
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
21
IABs 2015–16: Math, High School
Math Blocks
# of items
Response type
Estimated Time*
Algebra & Functions
Linear Functions
Quadratics
Geometry
Right Triangle Ratios
High School
Performance Task
13–16
All machine scored
30 min–45 min
13–16
All machine scored
30 min–45 min
Mostly hand scored
2 hours, including 30
minutes for the
classroom activity.
6
*Estimated times for the non-PT blocks are based on 1–2
minutes to answer a Claim 1 question and 2–6
minutes to answer a Claim 2, 3, or 4 question.
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
9/29/2015
22