Proof of Concept
Study
June Atkinson
State Superintendent
Tammy Howard
Director, Accountability Services
NC Department of Public Instruction
July 13, 2015
Purposes
Valid and reliable measures of content
standards.
Growth data for educator effectiveness reports.
Assessments throughout the year that inform
and guide instruction and that predict
performance on future assessments.
A stand-alone summative assessment at the
end of the year that may be connected to the
interim assessments.
2
Research Questions
Determine the feasibility of implementing
the concept across grades 3–8
data analysis to affirm reliability
input/feedback on the integration of the
assessments in instruction
logistical/operational (delivery mode, scoring)
professional development requirements
possibility of different item types
3
Design
Convene teacher groups to recommend test
specifications
Notify districts of schools selected for
participation
Provide professional development to the
selected schools
Administer the three through-grade
assessments and then the modified end-ofgrade
4
Design
Interim 1
Interim 2
Interim 3
End-of-Year
(Covers Interims
1– 4)
 Design could be altered based on outcome of study
 May have overlapping content
 May predict performance throughout the year
5
Timeline
Year
2015–16
Administration
Proof of Concept
(sample population)
Grade Levels
Grade 5: Math
Grade 6: Reading
Release RFP for High
School
2016–17
Field Test
(sample population) Or
Grades 3–8: Math
Grades 4–8: Reading
Purpose
Determine feasibility
of concept
Summer 2016:
Decision-point of how
to proceed
Test items for inclusion
in operational test
forms
Release RFP for
assessment
Pilot High School
2017–18
Pilot Operational Year
(statewide)
Grades 3–8: Math
Grades 4–8: Reading
Full Implementation
High School Operational
6
Review of Current Interim
Assessments
Several school districts currently
administer vendor-developed interim
assessments
Review coverage of content standards,
reliabilities, validity, and compare
performance to EOG performance
School systems will submit interim
assessment data generated from
commercially-developed assessments
7
Selected Districts for Participation in Proof
of Concept: Grade 5 Mathematics
LEA/Charter Schools
Alamance-Burlington Schools
Gaston County Schools
New Hanover County Schools
Brunswick County Schools
Guilford County Schools
Northampton County Schools
Cabarrus Charter Academy
Harnett County Schools
Onslow County Schools
Catawba County Schools
Henderson County Schools
Orange County Schools
Chapel Hill-Carrboro Schools
Hoke County Schools
Piedmont Community Charter School
Charlotte-Mecklenburg Schools
Johnston County Schools
Randolph County Schools
Chatham County Schools
Kannapolis City Schools
Robeson County Schools
Community School of Davidson
Martin County Schools
Vance County Schools
Cumberland County Schools
Millennium Charter Academy
Winston-Salem/Forsyth County Schools
Duplin County Schools
Mooresville City Schools
Yadkin County Schools
Durham Public Schools
Mount Airy City Schools
Yancey County Schools
Edgecombe County Public School
Nash-Rocky Mount Schools
8
Selected Districts for Participation in Proof
of Concept: Grade 6 ELA/Reading
LEA/Charter Schools
Beaufort County Schools
Iredell-Statesville Schools
Brevard Academy
Johnston County Schools
Brunswick County Schools
Madison County Schools
Caldwell County Schools
Paul R Brown Leadership Academy
Camden County Schools
Pitt County Schools
Carteret County Public Schools
Polk County Schools
Charlotte-Mecklenburg Schools
Robeson County Schools
Chatham County Schools
Scotland County Schools
Davidson County Schools
Southern Wake Academy
Duplin County Schools
Summerfield Charter Academy
Granville County Schools
Wake County Schools
Guilford County Schools
Winston-Salem/Forsyth County Schools
Harnett County Schools
Yadkin County Schools
Henderson Collegiate
9
High School
Develop RFP for a college admissions
assessment at grade 11 and grade-level
assessments at grades 9 and 10
Based on RFP outcome, pilot in 2016–
17 and fully implement in 2017–18
Requires setting a proficiency standard
for accountability reports if used as
federal measure
10
Next Steps
Provide sampled school list to districts
Conduct webinar for district and school
level staff
Provide test specifications for each interim
(Superintendents’ Quarterly)
Provide professional development for
teachers of selected schools
11