Smarter Balanced
in Washington
Preparing for the Transition
Webinar #4
March 20, 2014
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Division of Assessment and Student Information
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Organization of Webinars Series

Future webinars are scheduled for 3:30-4:30 PM on:
April 9 May 13 June 10
July 15
August 13

PowerPoints and answers to questions raised during the
webinars are posted on OSPI’s Smarter Balanced webpage http://www.k12.wa.us/smarter/default.aspx; audio
recording of webinars are included.

We will minimize repeating previously provided
information, so please check the webpage.
03/20/2014 Slide 1
Summative Field Tests
Getting Ready for the Tests
03/20/2014
Field Testing Countdown to Test
Administration!
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION




Whoa!!! The delay of one week caught everyone by
surprise.
OSPI had no input on the issue, but is deeply sorry
for the disruption and the late notice.
Thanks to everyone who recognized the delay was
no one’s preference and would have been avoided if
it were not necessary.
The first field test window opens Tuesday, March 25.
03/20/2014 Slide 3
Scheduled Downtimes Remain the Same
Administration
Downtime
Practice Test/Training Test
Saturday – Sunday, May
17 and 18
Field Test
Thursday, April 10 –
Sunday, April 13, 2014
Thursday, May 8 –
Sunday, May 11, 2014
Field Testing Windows and Scheduled
Downtimes

There are four test administration blocks:
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION





March 25 – April 4
April 7 – April 25
April 28 – May 16
May 19 – June 6 (not for grades 9-10)
Those who got bumped from week one can test any time
before June 6

EdWeek and Seattle Times mentioned an additional week of June 9 – that
was a mistake on the part of the Smarter Balanced spokesperson
03/20/2014 Slide 5
Field Testing Updates and the
Countdown to Test Administration!
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Students are permitted and encouraged to use their
own ear buds or headsets, but districts and schools
should also plan on having some available. USB
headphones are recommended as they are typically
plug-and-play devices. Districts and schools are
responsible for ensuring that each participating
student has a headset.
03/20/2014 Slide 6
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Field Testing Updates

Continue accessing resources and materials for the Field
Test scheduling, administration, and communication.

Ensure your district and school coordinators and teacher
administrators are carefully reviewing the training
modules posted on the Field Test Portal.
03/20/2014 Slide 7
Training and Resources

Field Test Portal Recent Additions
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION



Classroom Activity and Performance Task Administration
Guidelines: How to identify the performance task topic for
each school and grade, download the classroom activity, and
administer the classroom activity and performance task.
Keyboard Command Chart for Students: This document
explains the keyboard commands that students can use to
navigate between test features and tools.
Test Security Incident Log: This document provides
instructions and a template of the incident log that Test
Administrators, School Test Coordinators, and District Test
Coordinators will use to report any Test Security Incidents that
occur during testing.
03/20/2014 Slide 8
Training and Resources

OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Field Test Portal Recent Additions, continued
Scribing Protocol for Smarter Balanced Assessments: This
document is designed to assist staff, test administrators,
educators, and scribes in ensuring scribing is standardized
and contributes to valid measures of students' college and
career readiness.


Embedded Designated Support Glossaries: Further
information on the glossary supports that are available.
Communications Toolkit: The communications toolkit for the
Field Test includes 12 documents that support communications
efforts surrounding the launch of the Field Test. Materials
include Field Test FAQs, talking points, parent/guardian
notification letter template, and other helpful resources.
03/20/2014 Slide 9
Training and Resources

Field Test Portal Recent Additions, continued
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION


ORS User Guide: The Online Reporting System (ORS) enables
authorized users to view test progress information for students
participating in the Spring 2014 Smarter Balanced Field Test.
Field Test Portal Recent Updates



Test Administrator User Guide: (Updated March 16)
Guidelines: Frequently Asked Questions for the Usability,
Accessibility, and Accommodations Guidelines (Updated March
16)
Technical Specifications Manual for Online Testing (Updated
March 17)
03/20/2014 Slide 10
Pre-ID’ing and Data Topic Updates

TEST TICKETS!!!
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Test tickets are available in WAMS Profile Downloads under
‘8. Smarter Balanced Field Test’

2 tickets per student: ELA and MATH



For HS testing single subjects – discard extra tickets
Sorted by school name, grade, group name (if applied), student
last/first/middle
Additional Test Ticket Resources:


MS Access DB/Form posted to:
http://www.k12.wa.us/SMARTER/Tests.aspx
Excel Student list posted in WAMS Profile Downloads currently
03/20/2014 Slide 11
Pre-ID’ing and Data Topic Updates
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

Student Data TIDE tasks prior to testing:
1) Block 1 test sites must identify remaining students
(“stragglers”) and enter them into TIDE prior to testing
2) Correcting Demographics in TIDE


Demographic data in TIDE is used in item analysis
Make corresponding updates in Local SIS’s and CEDARS
3) Uploading supports/accommodations

TIDE User Guide, pages 30–35 and Test Administration Manual,
section 7.0
03/20/2014 Slide 12
Pre-ID’ing and Data Topic Updates
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

New and Moved Student Files Schedule:
Test Window Window Dates


New and Moved
File Extracted
New and Moved
uploaded to TIDE
Window 1
March 25 to April 4
3/10/2014
3/11/2014
Window 2
April 7 to April 25
3/27/2014
3/28/2014
Window 3
April 28 to May 16
4/17/2014
4/18/2014
Window 4
May 19 to June 6
5/15/2014
5/16/2014
Will reflect students from most recent CEDARS submission
Students enrolled between most recent CEDARS submission and
the start of testing must be added by a District Administrator
03/20/2014 Slide 13
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Pre-ID’ing and Data Topic Updates

New and Moved Student Files (continued)

EXAMPLES
School is testing both ELA and Math during window 2 and most recent
CEDARS submission before window 2 new and moved extract was on
March 21:
A.

Window 2 extract will include all students enrolled between February 10 (initial
statewide student upload) and March 21
School is testing ELA in window 2 (same CEDARS date as above) and
Math in window 3; most recent CEDARS prior to window 3 extract was
April 7:
B.

Window 2 new and moved includes same students as above. Window 3 new and
moved includes students enrolled between February 10 and April 7 with
duplicates of window 2 new and moved records removed.
03/20/2014 Slide 14
Why Field Test?
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Dry Run
Field Tests
Item Data


Operational
Tests
Although this is a field test, we must have valid responses
to shape our future tests.
Accurate item data will determine difficulty, bias and
sensitivity, whether items are kept, and ultimately the cut
scores (or what score is needed to meet standard).
03/20/2014 Slide 15
Security
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION



Test Administrators must ensure that all conditions of
test security are maintained.
Report all security incidents witnessed or suspected.
Only students who are testing can observe assessment
items.


Students who are not being tested or unauthorized staff must
not be in the room where a test is being administered.
Based on the item type (i.e., performance tasks), trained TAs
may also have limited exposure to assessment items in the
course of properly administering the assessment;

however, even TAs may not actively review or analyze any
assessment items.
03/20/2014 Slide 16
Security
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

TAs and SCs or other individuals who have witnessed,
been informed of, or suspect the possibility of a test
security incident that could potentially affect the integrity
of the tests or the data should follow the steps outlined
in Appendix B of the Test Administration Manual and the
TIDE User Guide located at: http://sbac.portal.airast.org/wpcontent/uploads/2014/01/Smarter_TIDE_UserGuide_Spri
ng2014.pdf
03/20/2014 Slide 17
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Security

The Test Security Incident Log (on the Smarter Balanced
Portal http://sbac.portal.airast.org/field-test/resources/) is
the document of record for all test security incidents.

TAs must download the template and log incidents
immediately and submit via email (or alternate agreedupon process) to their SCs and DCs.

Instructions on how to complete the Log, including a
listing of the column headers and descriptions, are located
within the EXLS file, under tab ‘Instructions’.
03/20/2014 Slide 18
Security
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION

At the close of the testing window, ensure that all test
security incidents were reported in accordance with the
guidelines in Appendix B in the TAM and the TIDE User
Guide.
03/20/2014 Slide 19
Operational Summative
Assessments
03/20/2014
Administration Window
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION


The 2015 summative operational assessment
windows/dates are still being discussed…
The complexities include:

Per Smarter Balanced Consortium:



High schools need to test on Smarter Balanced w/in final 7 weeks of
school
Grades 3-8 test in final 12 weeks of school
In Washington:


Grade 3 results must be returned in time for principals to meet with
parents before the end of the year
High school exit exams need to be scheduled as well (ELA for 10th
and EOC in math and biology) - these will be paper/pencil
03/20/2014 Slide 21
Interim Assessments
We are all life long learners… patiently learning
a little each month about interim assessments
03/20/2014
Interim Assessments
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION


No updates have been provided to states on interim
assessments.
A letter will soon be sent to districts with schools who
are in Priority, Focus or Emerging status:


Smarter Balanced interims will replace Reading Benchmark and
Math Benchmark assessments (RBAs and MBAs)
OSPI is still discussing appropriate interims for grades 1-2
(WaKIDS can be used in kindergarten)
03/20/2014 Slide 23
Digital Library
Educator resources for
formative assessment practices
to improve instruction
03/20/2014
A Balanced Assessment System
Summative
assessments
Benchmarked to college
and career readiness
Common
Core State
Standards
specify
K-12
expectations
for college
and career
readiness
Teachers and
schools have
information and
tools they need
to improve
teaching and
learning
Educator resources for
formative assessment
practices
to improve instruction
Digital Library Basics, 2-26-14
All students
leave
high school
college
and career
ready
Interim assessments
Flexible, open, used
for actionable
feedback
Slide 25
✔
Balanced Assessment
✔
Summative
Assessments for
Accountability
✔
•Coverage of full breadth/depth of Common Core
•Computer Adaptive Testing (CAT)
• Precise assessment of all students
• More engaging assessment experience
•Performance Tasks – real world problems
Interim
Assessments to
Signal Improvement
Formative Tools and
Resources for
Improved
Instruction
•Optional for district, school or classroom use
•Fully aligned with Common Core – same item pool
•Focus on set of standards or mirror summative test
•Teachers can review and score responses
•Digital library gives access to high-quality resources
•Tools/materials for classroom-based assessments
•Professional social networking (Web-based PLCs)
•Useful for in-service and pre-service development
Smarter Balanced Digital Library:
Formative Assessment Practices and
Professional Learning – educator involvement
National Advisory
Panel (NAP)
State Leadership
Team (SLT)
State Network of
Educators (SNE)
• 11-20 experts
• Began December 2012
• Provides policies and
criteria for resources
• 10-14 WA members
• Provides support and
training for State
Network of Educators
• Promote statewide
communications
• 85 WA Members (1,500+
nationally)
• Representation from
LEAs, AEAs, content
leaders, ELL, IHE
• Serve Summer 2013 –
Late Fall 2014
• Submit and review
resources
Digital Library Basics, 2-26-14
•
Digital Library Basics
One Stop:
• Accessed through a single sign-on with user permission levels
• Educators have access to all of the instructional and professional learning
resources for each grade band (Grades K-2, 3-5, 6-8, 9-12)
• There will be resources that educators can share or use with students and families,
but students and families will not be able to access materials directly.
– It WILL NOT be a “bank” of formative assessment items alone. All resources will
have the formative assessment process embedded within them.
•
•
All submitted materials will be vetted through a Quality Criteria Review Process
by SNEs across the nation.
• Each resource will be reviewed and rated by at least 3 SNEs
• If they do not meet the quality criteria, resources will not be included in the library
Functionality
• The applications uses state-of-the art tagging and search features so that
educators will be able to:
 Quickly find resources by CCSS, formative assessment process attributes, etc.
 View and download resources
 Rate resources
 Use social networking features to collaborate with other educators across
the Consortium by posting questions and sharing their knowledge.
Digital Library Basics, 2-26-14
Resources in the Digital Library
Assessment
Literacy Modules
Exemplar
Instructional Modules
• Commissioned professional development modules
• Resources for students and families
• Frame formative assessment within a balanced assessment system
• Articulate the formative assessment process
• Highlight formative assessment practices and tools
• Commissioned professional development modules
• Instructional materials for educators
• Instructional materials for students
• Demonstrate/support effective implementation of the formative process
• Focus on key content and practice from the Common Core State
Standards for Mathematics and English Language Arts
• High-quality vetted instructional resources and tools for educators
• High-quality vetted resources and tools for students and families
Education Resources
* Resources include the following file types: Video, HTML5,
Audio, PPT, Excel, Word, and PDF.
• Reflect and support the formative process
• Reflect and support the Common Core State Standards for Mathematics
and English Language Arts
• Create Professional Learning Communities
Digital Library Basics, 2-26-14
Resources in the Digital Library
Assessment
Literacy Modules
Exemplar
Instructional Modules
Education Resources
* Resources include the following file types: Video, HTML5,
Audio, PPT, Excel, Word, and PDF.
•
Not an assessment bank
•
Not an item bank
•
Not a learning management
system where educators can
register for training or receive
credit by completing specific
online courses
•
Not a library for general public
(will require registration and
login)
•
Not a site where any resource
can automatically be posted; all
resources must be vetted
through the Quality Criteria
Digital Library Basics, 2-26-14
Grounded in this Definition of
Formative Assessment Process
•
Formative Assessment is a deliberate process
used by teachers and students during
instruction that provides actionable feedback
that is used to adjust ongoing teaching and
learning strategies to improve students’
attainment of curricular learning targets/goals.
~ Compiled by the Digital Library National Advisory Panel
Digital Library Basics, 2-26-14
All Resources are Grounded in the Four
Attributes of the Formative Assessment Process
and Reviewed using Quality Criteria
Clarify
Intended
Learning
Elicit
Evidence
Act on
Evidence
Interpret
Evidence
Digital Library Basics, 2-26-14
Quality Criteria for Professional Learning
Resources
The resource…
1) Reflects research and/or the principles of effective professional
learning
2) Incorporates formative assessment practices
3) Supports learner differences and personalized learning
4) Demonstrates utility, engagement, and user-friendliness
5) Integrates technology and media effectively
Digital Library Basics, 2-26-14
Quality Criteria for Instructional Resources
The resource…
1) Aligns with the intent of the Common Core State Standards
2) Incorporates formative assessment practices
3) Contains accurate, complete, high-quality curriculum and
instruction
4) Supports learner differences and personalized learning
5) Demonstrates utility, engagement, and user-friendliness
6) Integrates technology and media effectively
Digital Library Basics, 2-26-14
SNE Resource Recommendation Options
•
•
•
•
Recommend with distinction
Recommend
Recommend with revisions
Do not recommend
Digital Library Basics, 2-26-14
Do not
recommend
Resource Posting Work Flow
Step 1:
Resource
Submitted
Step 2:
Gatekeeping
Criteria
Applied
Step 3:
Quality
Criteria
Applied
Step 4:
Decision
Posted
Cover
Profile
SNE
1
SNE
1
Sent to SLT
SNE
2
Returned to Submitter
SNE
3
Digital Library Basics, 2-26-14
Smarter Balanced – Who and When?


OSPI staff involved in workgroups 2010-2014
WA teachers involved 2011-2014
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION







Pilot in spring 2013
Practice Tests widely available in May 2013
Comprehensive summative field test in 2013-14
Digital Library - State Networks of Educators began vetting
resources to populate the library in Fall 2013


Item and stimulus writing and review
Alignment Study
Achievement Level Descriptors
“Soft Launch” of the Digital Library in late Spring 2014
All components of Smarter Balanced operational in 2014-15



Full Digital Library in fall 2014
Interim assessments available late fall 2014
Summative assessments administered in spring 2015
03/20/2014 Slide 37
Resources For You!


For the latest news and developments on
Smarter Balanced in Washington:
http://www.k12.wa.us/smarter/default.aspx
Materials for administration, as well as
communication templates for parents and
community: http://sbac.portal.airast.org/fieldtest/resources/

For questions about Smarter Balanced or the
assessment system transitions, contact:
Assessment@k12.wa.us 360-725-6348
OFFICE OF SUPERINTENDENT OF PUBLIC INSTRUCTION
Happy Field Testing!!!!!
03/20/2014 Slide 39
Thank you!
2007 WASL: Preparing Students to Live, Learn and Work in the 21st Century
8.30.2007 | Slide 40