Test Coordinator
Meeting
December 18, 2014
RESEARCH AND
EVALUATION
Agenda
• Welcome/Introductions
• Technology Update
• Smarter Balanced Interim Assessments
• ICA-Interim Comprehensive Assessment
• IAB-Interim Assessment Blocks
• Washington Comprehensive Assessment Program – WCAP
• Questions???
• Closing Remarks
Time: 4 to 6 p.m.
Location: CAB Auditorium
RESEARCH AND
EVALUATION
Welcome and Introductions
Research and Evaluation
Curriculum and Instruction
• Pat Cummings
Director of Research & Evaluation
• Roy Tatlonghari
Instructional Facilitator
• Linda Medford
Coordinator Student Assessment
• Nicolle Wambold
Instructional Facilitator
• Lindsay Franklin
Assessment Specialist
Technology
Special Guest
Thea Turnley-Student System Specialist
RESEARCH AND
EVALUATION
• Glenn Desseau
Manger Technology
• Field Technicians
Technology Update
Software deployments are occurring between 6 a.m. – 9 a.m.,
depending on site schedules.
Remember:
• Connect all new COWs to power and data every night.
• Connect all laptops in new COWs to power and data every night.
• Contact HELP at 253.571.4357 or HELP@Tacoma.k12.wa.us for
assistance.
Technology Update
Number of Schools with SBAC Software Deployed
26
Elementary Schools
22
Middle Schools
3
High Schools
1
Total Number of Managed Cart Laptops
Laptops with Software
Success Rate
Elementary Schools
Middle Schools
High Schools
1,708
700
41%
Percentage of district
machines with SBAC software
25%
Total number to date
3000
SBAC Interim -Comprehensive and Blocks
Interim Assessments Timeline
 Interim Assessments will be available Jan 6 (more information to come after the
Test Administration Manual is completed and the secure browser is installed)
 Jan 6 – Comprehensive Interim
 Jan 27 – Interim Assessment Blocks
 Initial release will include fixed forms; adaptive forms will be available as the
item pool allows
 There are two types of Interim Assessments:
 Comprehensive
 Blocks
Comprehensive (ICA) are
almost identical to the endof-year Smarter Balanced
assessments.
They take as long to
administer (total of 7 to 8
hours), and report scores as
composite scale scores,
achievement levels and
‘claims”
Interim
Assessments
Blocks (IAB) are short
tests organized by
“claims”
Examples or current
thinking on test design:
Interim
Comprehensive
Assessment (ICA)
Interim
Assessment
Blocks (IAB)
ELA
Math (Grades 3-5)
Math (Grades 6-7)
Math (Grade 8)
Math High School
Interim Comprehensive Assessments (ICAs)
• Interim Comprehensive Assessments (ICAs) use the same blueprints
as the summative assessments and assess the same standards. They
will be provided as fixed forms and will become adaptive when item
counts are adequate.
• The ICAs include the same item types and formats, including
performance tasks, as the summative assessments, and yield results
on the same vertical scale. The ICAs yield overall scale scores,
overall performance level designations, and claim-level information.
Interim
Comprehensive
Assessment (ICA)
ICA Reporting
• ICA reporting is the same as for the summative assessment:
 Overall scale score with error band endpoints and achievement
level per content area/subject.
 Claim score reporting is based on three classifications related
to the overall scale score cut point between levels 2 and 3.
Interim
Comprehensive
Assessment (ICA)
Interim Assessment Blocks (IABs)
• Interim Assessment Blocks (IABs) focus on smaller sets of
targets and therefore provide more detailed information for
instructional purposes.
• The blocks are available either as fixed forms or with the use of
a computer adaptive algorithm. The IABs yield overall
information for each block.
Interim
Assessment
Blocks (IAB)
IAB Reporting
• Individual student scores are available for each block.
• Reporting for each block is based on three classifications related to
the overall scale score cut point between levels 2 and 3:
1. Below Standard
2. At/Near Standard
3. Above Standard
Interim
Assessment
Blocks (IAB)
IABs for ELA Grades 3 – 5
IABs for ELA Grade 3 – 5
1
Read Literary Texts
2
Read Informational Texts
3
Edit/Revise
4
Brief Writes
5
Listen/Interpret
6
Research
7
Narrative Performance Task* Gr 4 and 5 only in 2014-2015
8
Opinion Performance Task* N/A in 2014-2015
9
Informational Performance Task* Gr 3 only in 2014-2015
* This is a full Performance Task as students experience in the summative assessment
IABs for Mathematics Grade 3
IABs for Mathematics Grade 3
1
Operations and Algebraic Thinking
2
Numbers and Operations in Base 10 Not available in 2014-2015
3
Fractions
4
Measurement and Data
5
Mathematics Performance Task*
* This is a full Performance Task as students experience in the summative assessment
IABs for Mathematics Grade 4
IABs for Mathematics Grade 4
1
Operations and Algebraic Thinking
2
Numbers and Operations in Base 10
3
Fractions
4
Geometry- Not available in 2014-2015
4
Measurement and Data
5
Mathematics Performance Task*
* This is a full Performance Task as students experience in the summative assessment
IABs for Mathematics Grade 5
IABs for Mathematics Grade 5
1
Operations and Algebraic Thinking
2
Numbers and Operations in Base 10
3
Fractions
4
Geometry
5
Measurement and Data - Not available in 2014-2015
6
Mathematics Performance Task* - Not available in 2014-2015
* This is a full Performance Task as students experience in the summative assessment
IABs for ELA Grades 6-8
IABs for ELA Grades 6-8
1
Read Literary Texts
2
Read Informational Texts
3
Edit/Revise
4
Brief Writes
5
Listen/Interpret
6
Research
7
Narrative Performance Task* Not available in 2014-2015
8
Opinion Performance Task* Not available in 2014-2015
9
Informational Performance Task*
* This is a full Performance Task as students experience in the summative assessment
IABs for Mathematics Grades 6-8
1
2
3
4
5
6
1
2
3
4
5
IABs for Mathematics Grades 6-7
Ratios and Proportional Relationships
Number System
Expressions and Equations
Geometry - Not available at Gr 7 in 2014-2015
Statistics and Probability - Not available in 2014-2015
Mathematics Performance Task*
IABs for Mathematics Grade 8
Expressions and Equations – I (and Proportionality) - Available with #2 as a
single Expressions & Equations Block in 2014-2015
Expressions and Equations - II
Functions
Geometry
Mathematics Performance Task*
* This is a full Performance Task as students experience in the summative assessment
IABs for ELA High School
IABs for ELA High School
1
Read Literary Texts
2
Read Informational Texts
3
Edit/Revise
4
Brief Writes
5
Listen/Interpret
6
Research
7
Explanatory Performance Task* Not available in 2014-2015
8
Argument Performance Task*
* This is a full Performance Task as students experience in the summative assessment
IABs for Mathematics High School
IABs for Mathematics High School
1
2
3
4
5
6
7
8
9
10
11
12
13
Algebra and Functions
Linear Functions
Quadratics
Exponentials – Not available in 2014-2015
Polynomials – Not available in 2014-2015
Radicals – Not available in 2014-2015
Rationals – Not available in 2014-2015
Trigonometric – Not available in 2014-2015
Geometry
Transformations – Not available in 2014-2015
Right Triangle Ratios
Three-Dimensional Geometry – Not available in 2014-2015
Proofs – Not available in 2014-2015
Circles – Not available in 2014-2015
Applications – Not available in 2014-2015
IABs for Mathematics High School
IABs for Mathematics High School
Other
14
Interpreting Categorical and Quantitative Data – Not available in 2014-2015
15
Probability – Not available in 2014-2015
16
Making Inferences and Justifying Conclusions – Not available in 2014-2015
17
Mathematics Performance Task*
* This is a full Performance Task as students experience in the summative assessment
Preparing for New Test Scores
 Smarter Balanced assessments measure the full range of the Common Core State Standards.
They are designed to let teachers and parents know whether students are on track to be
college- and career-ready by the time they graduate.
 Because the new standards set higher expectations for students--and the new tests are
designed to assess student performance against these higher expectations--our definition of
grade level performance is higher than it used to be.
 As a result, it’s likely that fewer students will meet grade level standards, especially for the
first few years. Results should improve as students have additional years of instruction aligned
to the new standards and become better equipped to meet the challenges they present.
 This does not mean that our students are “doing worse” than they did last year. Rather, the
scores represent a “new baseline” that provides a more accurate indicator for educators,
students, and parents as they work to meet the rigorous demands of college and career
readiness.
Option #1 for SBAC Interim Assessments TBD
Comprehensive (ICA)
 Available first week January
 Almost identical to the end-of-year Smarter Balanced assessments
except is fix and not adaptive
 Total of 7 to 8 hours (most likely longer)
 Teacher have to score items (how many and what training is need
not yet available)
 Report scores as composite scale scores, achievement levels and
‘claims’
 Teacher training materials regarding this option not yet available
Option #2 for SBAC Interim Assessments TBD
Blocks (IAB)
 Available last week of January
 Short tests organized by “claims” (not all claims are available…
information it trickling out)
 Test are 1 to 2 hours for each subject (ELA/Math)
 Teacher have to score items (which items and what training is need
not yet available)
 Report scores as met standard only
 Assessment map (what specific items are tested) is not available
 Whether the Block will include a performance activity is not available
 Teacher training materials regarding this option not yet available
Option #3 for SBAC Interim Assessments TBD
Practice Test (Kent Model... must do all three options)
 Option is available now.
 Includes a classroom teaching activity (for each grade and subject.. 30 to 60 minutes) & a
performance task (computer based- 60 minutes) that is connected to the activity.
 Is followed with the complete online practice test that teaches all the tools (approximately
one hour).
Comments:









Do not get scores back
Worked very well last year in other districts
Can do anytime
Can be controlled and monitor from district (we send schedule and copies of performance
tasks)
Provides exposure to both tools (online) and performance activities
Training is activities are easier to manage and can be consolidated
Less stressful for teachers and students
The Portal has yet to link the practice test so we do not know if students will log in as guest
or through their student account
After the WCAP Portal test is available we will review and determine if more scripted
teacher training materials are necessary to supplement the activity… this will be in a model
similar to Emily Bannon’s Digital Library tutorial.
Washington Comprehensive Assessment Program – WCAP Portal
Located on the Web:
http://wa.portal.airast.org/
Student and Families
Coming Soon
Test Administrators
Test Coordinators
Technology Coordinators
WCAP - Test Administrators
General Information – Teacher Fact Sheet
• User Guides and Manuals
• Online Reporting System – ORS User Guide – coming soon
• Guidelines on
Assessments
Tools,
Supports,
Accommodations
for
State
• Test Information Distribution Engine – TIDE – coming soon
• Smarter Balanced Usability, Accessibility, and Accommodations
Guidelines – coming soon
• Smarter Balanced Accessibility and Accommodations Implementation
Guide – coming soon
• Smarter Balanced Test Administration Manual TAM – coming soon
WCAP - Test Administrators (Continued)
Assessment Resources
• Grades 3-5
• Grades 6-8
• High School
 Classroom Activities for ELA and Math
 Smarter Balanced Usability,
Guidelines – coming soon
Accessibility,
and
Accommodations
 Smarter Balanced Accessibility and Accommodations Implementation
Guide – coming soon
WCAP - Test Administrators (Continued)
Modules
 Test Information Distribution Engine (TIDE) Training Module – coming soon
 ORS Training Module – coming soon
 Smarter Balanced Performance Task Training Module
 Smarter Balanced Accessibility and Accommodations Training Module
– coming soon
 Embedded Universal Tools and Online Features Module – coming soon
 Test Administrator Online System Interface Module [PPTX]
 Student Testing Interface Training Module – coming soon
WCAP – Test Coordinators
General Information – Smarter Balanced Field Test Report
• User Guides and Manuals
• Online Reporting System – ORS User Guide – coming soon
• Guidelines on Tools, Supports, Accommodations for State
Assessments
• Test Information Distribution Engine – TIDE – coming soon
• Smarter Balanced Usability, Accessibility, and Accommodations
Guidelines – coming soon
• Smarter Balanced Accessibility
Implementation Guide – coming soon
and
Accommodations
• Smarter Balanced Test Administration Manual TAM – coming soon
WCAP – Test Coordinators (Continued)
Assessment Resources
• Grades 3-5 – Grades 6-8 – High School
• Classroom Activities for ELA and Math
• Smarter Balanced Usability, Accessibility, and Accommodations
Guidelines – coming soon
• Smarter
Balanced
Accessibility
Implementation Guide – coming soon
and
Accommodations
• Achievement Level Descriptors (ALD) Glossary of Terms [PDF]
• Smarter Balanced Adaptive Software[PDF]
• Smarter Balanced Infographics Chart
WCAP – Test Coordinators (Continued)
Modules
 Test Information Distribution Engine (TIDE) Training Module – coming soon
 ORS Training Module – coming soon
 Smarter Balanced Performance Task Training Module
 Smarter Balanced Accessibility and Accommodations Training Module –
coming soon
 Embedded Universal Tools and Online Features Module – coming soon
 Test Administrator Online System Interface Module [PPTX]
 Student Testing Interface Training Module – coming soon
WCAP – Technology Coordinators
General Information
• What is a CAT? [PPTX]
• Smarter Balanced Performance Task Training
Module [PPTX]
WCAP – Technology Coordinators (Continued)
Technical Information
• Online System Requirements Guidelines [DOCX]
• Braille Requirements Documents for Online Systems – coming soon
• System Support Sunset Document – coming soon
• Technical Specifications for the Online System [DOCX]
• Technology Requirements for the Online Systems Training Module[PPTX]
• What is a CAT? [PPTX]
• Smarter Balanced Performance Task Training Module [PPTX]
• Secure Browser Installation Guide[DOCX]
• Smarter Balanced Accessibility and Accommodations Training Module – coming
soon
• Embedded Universal Tools and Online Features Module – coming soon
• Student Testing Interface Training Module – coming soon
Test Information Distribution Engine - TIDE
TIDE Tasks
•
•
•
•
Upload/edit staff records and roles
Load accommodations and test settings
Managing student rosters (only your enrolled students)
Additional Materials Orders – coming soon
CEDARS tasks NOT TIDE TASKS
•
•
•
Adding/deleting students
Editing student demographics or biographic info
Flagging exempted students (home/private/F1 if enrolled)
TIDE (Continued)
TIDE (Continued)
What OSPI will do?
 Load initial staff records to TIDE
 DAC=DC; Designees=DA
 Emails will arrive as TIDE
goes live 12/19 (unless
TIDE is delayed by testing)
 Load unique student records to
TIDE
 Provide list in WAMS of shared
and/or dual primary SSIDs for
review
TIDE (Continued)
What to do right now?
 Prep local security settings for emails
• Separate email coming from OSPI
 Alert teachers that emails will be generated
• 3 day expiration on temp password
• Can use ‘forgot password’ without security questions
after temp password expires
 Upload staff records with roles
Digital Library – Training Video
Information on SBAC Field Test
• Plan for training well in advance of testing.
• Evaluate how well the training is going with teachers and
administrators, and revise or regroup as needed.
• Test equipment early and check all laptops that will be used for
testing at least a few weeks before online test administration.
• Be sure computers are completely shut off and restarted once a
week and also restarted the morning of testing before the test
session.
• Make sure there are enough headphones for test sessions.
• Trouble-shoot any technical issues with the practice and training
tests.
• The teacher/proctor needs to be very active and watch students
testing.
Students’ Advice for Teachers Preparing Students for the SBAC
• Be calm know that your class is going to do well.
• Have them do a couple practice sessions so they know what to do when they actually take the
test.
• They always need to walk around the room or classroom so they can see if the student needs
help because sometimes a student is raising their hand and the teacher does not see.
• Do not get your kids worried about the test. Tell them it is just like any other test. Remember
to tell them to relax and just do their best. Also, tell them to check their work multiple
times so they can check each question and make sure they got it correct.
• Make sure students know that there is a spell check and dictionary available when they are
working on the essay.
• Encourage the student to go slow, take their time, and read every question closely.
• I would tell them to take time to prepare the class for the test because I feel like I did not
have enough time to learn and review all the things that were in the test.
• Advice I would give to my teacher who is preparing this next year is kind of nothing. The
teachers did a great job!
“In general, I thought the Smarter Balanced Assessment was” by Grade Level
100.0%
90.0%
80.0%
70.0%
60.0%
50.0%
40.0%
30.0%
20.0%
10.0%
0.0%
Very hard
Kind of hard
In between easy and hard
Kind of easy
Very easy
Grade 3 (128)
2.3%
11.7%
60.9%
19.5%
5.5%
Grade 4 (73)
6.8%
21.9%
60.3%
11.0%
Grade 5 (208)
5.3%
25.5%
54.3%
11.5%
3.4%
Grade 6 (151)
6.0%
19.9%
51.7%
18.5%
4.0%
Grade 7 (82)
3.7%
14.6%
57.3%
22.0%
2.4%
Grade 8 (66)
10.6%
22.7%
51.5%
13.6%
1.5%
Grade 11 (37)
21.6%
10.8%
43.2%
10.8%
13.5%
Modal response was “in between easy and hard.” Grade 8 and 11 students
reported more hard and very hard responses than younger grade levels.
“Please tell us how you felt about each of the online tools”
(Percent that used and found each tool helpful in green)
Spell Check
54.6
Writing Tools
46.7
Highlighter
46.2
Calculator
44.6
Zoom
44.1
English Dictionary
41.1
Mark for Review
36.8
English Glossary
35.4
Digital Notepad
33.7
Math Tools
31.7
Strike-through
28.8
0.0
10.0
20.0
30.0
40.0
Used it and helpful
Used it but not helpful
Tried it but confusing
Strikethrough
28.8
16.0
5.5
Math
Tools
31.7
11.0
3.4
Digital
Notepad
33.7
17.3
5.2
English
Glossary
35.4
14.7
3.2
Didn’t use - didn’t need
31.2
28.5
37.2
31.1
33.9
Didn't use - didn’t know how
3.9
3.0
1.6
1.6
3.2
Didn’t see it on test
14.7
22.5
4.9
13.9
6.9
50.0
Mark for
English
Review Dictionary
36.8
41.1
14.0
14.9
5.2
4.1
60.0
70.0
80.0
90.0
100.0
44.1
15.1
3.7
44.6
10.6
3.2
46.2
14.1
2.9
Writing
Tools
46.7
11.0
4.6
26.9
30.8
16.3
29.1
21.8
14.8
1.1
1.6
1.3
0.7
3.7
3.1
11.9
4.7
24.0
7.1
12.2
15.5
Zoom
Calculator Highlighter
Spell
Check
54.6
7.9
4.1
The spell check, writing tools, highlighter, calculator, zoom, and English dictionary
were used by at least 40% of students taking the field test. The other tools were used to
a lesser extent.
Questions
??????????????
RESEARCH AND
EVALUATION
Pat Cummings, Director
pcummin@tacoma.k12.wa.us
253-571-1280
Linda Medford, Coordinator Student Assessment
lmedfor@tacoma.k12.wa.us
253-571-1193
Lindsay Franklin, Assessment Specialist
lfrankl@tacoma.k12.wa.us
253-571-1190
RESEARCH AND
EVALUATION