1
Update
from the Office of
RACE TO THE TOP
ASSESSMENTS
Florida Association of Science Supervisors
October 24, 2012
Sally Sanders
Science Content Specialist
Race to the Top Goals
2



Double the percentage of incoming high school
freshmen who ultimately graduate from high school,
go on to college, and achieve at least a year’s worth
of college credit;
Cut the achievement gap in half in 2015;
Increase the percentage of students scoring at or
above proficient on NAEP by 2015, to or beyond the
performance levels of the highest-performing states.
Florida’s RTTT Application
3
Three projects assigned specifically to the Office of
RTTT Assessments:
 Florida Interim Assessment Item Bank and Test
Platform
 District-developed Assessments for Hard-toMeasure Content Areas
 Contract for FL participation in international
benchmarking studies (TIMSS, PIRLS, PISA)
District Developed Assessments
4
Content
Awarded Districts
Physical and Health
Education: K-8
Miami-Dade County
Physical and Health
Education: 9-12
Hillsborough County
Performing Arts: K-12
Polk County
Visual Arts: K-12
Miami-Dade County
Career and Technical
Education
World Languages
Hillsborough County
Duval County
Status Update:
Hard to Measure Content Areas
5




Competitive Award for seven projects issued in
August 2011
Main deliverable in Year 1 (2011-12): Item
Specifications
Main deliverable in Year 2 (2012-13): Item
Development
Main deliverable in Year 3 (2013-14): Field Testing
Timeline – District-Developed Student
Assessments Project
6
2011-12
2013-14
2012-13
Fall
Spring
Summer
Fall
Spring
Summer
Fall
Spring
Monitoring,
Communication
and Risk
Management
plans
completed
Item
development
plan
Item review
plan
Item writer
training
materials
Item
specifications for
PE/ Health,
Visual Arts,
Performing Arts,
CTE, World
Languages
Batch 1 items
for review
Batch 2 items
for review
Year 1 items
uploaded to test
platform for pilot
testing
Item
Development
Face-toFace Project
Meeting
Item
development
Begin test
design
specifications
Batch 3
items for
review
Batch 4
items for
review
Review of
items for bias
and content
Year 2
items
uploaded to
test platform
for pilot
testing
Test design
specifications
complete
Preparation
for FieldTesting.
Batch 5
items for
review
State-wide
field test
Train
performance
scorers
Analyze data
Data review
for bias and
content
Compile final
item pool
Status Update:
TIMSS, PIRLS, PISA
7

TIMMS (Trends in International Mathematics and
Science Study)
 Test
given in Spring 2011 in Grades 4 and 8
 Results available in Spring 2013

PIRLS (Progress in International Reading Literacy Study)
 Test
given in Spring 2011 in Grade 4
 Results available in Spring 2013

PISA (Program for International Student Assessment)
 Test
will be given in Fall 2012 to 15-year-old students
 Results available in Spring 2014
Item Bank and Test Platform
8

Statewide technology-based system

Bank of standards-based items/tasks


Test builder tool to construct valid and reliable
assessments


In development
Diagnostic, interim, summative
Computer or paper-based functionality
Item Bank and Test Platform
9

Online tutorials for

use of the item bank

item writing

item reviewing

assessment development
Timeline - Interim Assessment Item Bank
and Test Platform Project
10
Fall
Bid
protest to
ITN
2011-12
Spring
Summer
Intent to
award
published
Contract
awarded to
Pearson
Test item
development
plan &
blueprint of the
content
standards
Plan for Item
review is
approved
Communicati
on plan of PD
modules
Recruitment
of Florida
Educators for
Item
Reviewers and
Writers
2012-13
Fall
Spring
Item specifications
Y1 batch
Math, ELA,SS, Sci,
3,4 & 5
Spanish
completed
Approved item
All
development plan for
yr2
meetings
All year 1 items in for item
bank
reviewers
Y1 batch 1&2
and review
completed
Meetings for item
have been
reviewers and review conducted
Sustainability plan
Meetings for item
reviewers and review
have been conducted
Phase 1 of item
bank is operational
Develop
communication to
stakeholders
Online system of
tutorials-approved
and available
2013-14
Summer
Y1
submitted
and
approved
Functional
ity test
Phase 2 is
operational
Year 2
batch
1completed
Fall
Spring
Approved
item
development
plan for Y2
Deliver
approved
communicatio
n plan
Y2 batch 2,3
&4
completed
Interim
assessment
for Math
(FAIM)
Item Tryouts
completed
Online training
for educators to
write items
Y2 batch 5
completed
All meetings
for item
reviewers and
review have
been conducted
All items for
Y3 submitted
and approved
Phases 3-6
are operational
Item Bank and
Test Platform
fully functional.
CCSS Connection
11

Common Core State Standards
 http://www.corestandards.org/

Common Core Tools
 http://commoncoretools.me/author/wgmccallum/

The Teaching Channel: Inspired Teaching, Inspiring
Classrooms
 https://www.teachingchannel.org

Education Northwest
 http://educationnorthwest.org/resource/1756

CPALMS
 http://cpalms.org
PARCC Connection
12

Partnership for Assessment of Readiness for College
and Careers http://parcconline.org/
 Sample
Item and Task Prototypes
 Model Content Frameworks

PARCC assessments aligned to the CCSS

Vince Verges, PARCC Project Director
 Serves
as K-12 Lead for PARCC in Florida
Classroom Connection
13

Interim Assessments
 Given
at regular intervals throughout the school year
 Designed to evaluate students’ knowledge and skills
relative to a specific set of academic standards
 Data can be aggregated to inform instruction
IBTP Item Distribution
14
•Tiers 1-4 will be password
accessible to a limited
group of people.
Tier 1
• Differentiated Accountability &
other state level programs
Tier 2
• District level access
• This collection will house the
majority of items.
•Greatest security is
employed for Tier 1 items,
with wider access available
at lower levels.
• School level access
•As items are no longer
used at an upper level,
they will move to become
available at the next level
down.
Tier 3
Tier 4
Tier 5
• Classroom teacher access
• Public access
• Sample items. Collection will grow
over time.
•By end of Year 2, the IBTP
will house approximately
60,000 items.
Item Specifications
15


Purpose: Provide guidance to item writers and
reviewers for the development of high-quality
standards-based (NGSSS and CCSS) assessment
items
Status: Item specifications are in final phase of
development/approval; item writers are using draft
version of specs
Item Types
16







Selected Response
Short Response
Gridded Response
Constructed Response
Extended Response
Essay Response
Performance Tasks
District Involvement
24


Florida educators are involved in writing and reviewing
items for the Interim Assessment Item Bank; writers and
reviewers are compensated
Next slide shows district representation as of October
2012
Column 1: Total item writers/district for all 5 content areas
(Science, Mathematics, ELA, Social Studies, and Spanish)
 Column 2: Total item writers/district for Science
 Column 3: Total item reviewers/district for all 5 content
areas
 Column 4: Total item reviewers/district for Science

Item
Writers
Item
Reviewers
Item
Writers
All Science All Science
Item
Reviewers
All Science
All
Science
Item
Writers
Item
Reviewers
All Science All Science
Alachua
Baker
25
Bay
2
1
8
0
0
2
1
0
4
0
0
1
Gulf
Hamilton
Hardee
0
0
0
0
0
0
0
0
0
0
0
0
Okeechobee 0
Orange
3
Osceola
3
0
0
1
1
2
2
0
0
0
Bradford
Brevard
Broward
Calhoun
Charlotte
Citrus
Clay
Collier
Columbia
Dade
DeSoto
Dixie
Duval
Escambia
Flagler
Franklin
Gadsden
Gilchrist
0
3
54
0
2
4
3
8
0
23
2
0
11
11
1
0
0
0
0
1
7
0
0
1
0
0
0
4
0
0
5
2
0
0
0
0
0
4
16
1
1
1
1
2
0
8
1
0
2
2
0
0
1
0
0
0
2
0
0
0
0
0
0
6
0
0
1
0
0
0
0
0
Hendry
Hernando
Highlands
Hillsborough
Holmes
Indian River
Jackson
Jefferson
Lake
Lee
Leon
Levy
Liberty
Madison
Manatee
Marion
Martin
Monroe
1
4
0
17
0
0
1
0
28
10
5
2
1
0
5
10
1
1
0
0
0
0
0
0
0
0
9
2
0
0
0
0
0
1
0
0
0
1
0
3
0
0
1
0
3
3
1
0
0
0
2
2
0
0
0
0
0
1
0
0
0
0
0
1
1
0
0
0
0
0
0
0
Palm Beach 11
Pasco
7
Pinellas
6
Polk
4
Putnam
0
St. Johns
15
St. Lucie
13
Santa Rosa
1
Sarasota
0
Seminole
6
Sumter
0
Suwannee
0
Taylor
0
Union
0
Volusia
9
Wakulla
4
Walton
0
Washington 0
1
2
1
1
0
6
6
0
0
0
0
0
0
0
2
1
0
0
3
2
1
1
0
4
3
0
0
1
1
0
1
0
8
1
0
0
1
0
0
0
0
2
0
0
0
0
0
0
0
0
2
0
0
0
Glades
1
0
0
0
Nassau
2
0
0
0
Totals
55
93
18
Glades
1
0
0
0
Okaloosa
4
0
1
0
as of 10/4/12
309
How can your district be involved?
26

Functionality Testing
 Phase



I – in progress
Nominate Item Writers
Nominate Item Reviewers
Item Tryouts (field testing)
How can educators be involved?
27




Serve as item writers or reviewers
Test the functionality of the test platform
Send contact information to
Sally.sanders@fldoe.org
 Name
 District
 E-mail address
 Teaching assignment
Office of RTTT Assessments
28
Director: Todd.Clark@fldoe.org
District Developed Assessments for HtM Project Manager:
Antionette.Meeks@fldoe.org
IBTP Project Manager: Michelle.Worrell@fldoe.org
Five Content Specialists:
 English/Language Arts: Julia.Somers-Arthur@fldoe.org
 Mathematics: June.Campbell@fldoe.org
 Science: Sally.Sanders@fldoe.org
 Social Studies: Patty.Ceci@fldoe.org
 Spanish: Annamarie.Tijerino@fldoe.org
Florida’s Common Core State Standards
(CCSS) Implementation Plan
2011-2012
Full Implementation Grade
K
Begin Implementation of
Literacy Standards in ALL
Content Areas for Grades
6-12
Begin Implementation of
Rich and Complex Text and
Informational Text for
Grades K-12
2012-2013
Full Implementation Grades
K-1
Full Implementation of
Literacy Standards in ALL
Content Areas for Grades
6-12
Continue Implementation of
Rich and Complex Text and
Informational Text for
Grades K-12
2013-2014
Full Implementation Grades
K-2
Implementation of a
Blended Curriculum (CCSS
and Supplemental NGSSS
Aligned to FCAT 2.0 and
EOCs) for Grades 3-12
Continue Implementation of
Rich and Complex Text and
Informational Text for
Grades K-12
2014-2015
Full Implementation Grades
K-12
PARCC Assessments Aligned
to CCSS
Florida Statute – Passed as Part of
Senate Bill 736 in Spring 2011
30
Section 1008.22 FS:
(8) LOCAL ASSESSMENTS.—
(a) Measurement of the learning gains of students in all subjects and grade levels other than
subjects and grade levels required for the state student achievement testing program is the
responsibility of the school districts.
(b) Beginning with the 2014-2015 school year, each school district shall administer for each
course offered in the district a student assessment that measures mastery of the content, as
described in the state-adopted course description, at the necessary level of rigor for the course.
Such assessments may include:
1. Statewide assessments.
2. Other standardized assessments, including nationally recognized standardized
assessments.
3. Industry certification examinations.
4. District-developed or district-selected end-of-course assessments.
(c) The Commissioner of Education shall identify methods to assist and support districts in the
development and acquisition of assessments required under this subsection. Methods may include
developing item banks, facilitating the sharing of developed tests among school districts, acquiring
assessments from state and national curriculum-area organizations, and providing technical
assistance in best professional practices of test development based upon state-adopted
curriculum standards, administration, and security.

Section 1008.22, FS
Student assessment program for public schools
31
Thank you
SALLY SANDERS
OFFICE OF RACE TO THE TOP
ASSESSMENTS
SCIENCE SPECIALIST
Sally.sanders@fldoe.org
(850) 245-0760
Fall 2012
Division of Accountability, Research, and Measurement
Florida Department of Education