Assessment Update
Dr. Gayle Potter, Director
Office of Student Assessment
Arkansas Department of
Education
Changes in 2011 - 2012
• Kindergarten students will not be administered a
state required large-scale assessment in the spring.
The Kindergarten screener remains in place.
• The American Diploma Project (ADP) Algebra II
Examination will no longer be administered.
However, please note that Algebra II will be included
in the high school assessments planned for PARCC.
Refer to Commissioner’s Memo LS-12-006 for
specific details.
• Increased numbers of students statewide will be
administered the high-stakes Algebra I online
remediation and retest in order to pass and obtain
graduation credit for Algebra I.
Fall 2010 Administration Combined Population
1st time testers
Number
Percent
Retest 1
Retest 2
Pass
Not Pass
Pass
Not Pass
Pass
Not Pass
Pass
Not Pass
3
100%
0
0%
169
57%
125
43%
0
0%
1
100%
172
58%
126
42%
Mid-Year 2011 Administration Combined Population
1st time testers
Retest 1
Retest 2
Number
Percent
Number
Percent
All Students
All Students
Pass
Not Pass
Pass
Not Pass
Pass
Not Pass
Pass
Not Pass
544
81%
125
19%
366
44%
467
56%
17
29%
42
71%
927
59%
634
41%
Pass
0
0%
Not Pass
1
100%
Pass
15
79%
Not Pass
4
21%
Began
Tutorial
1
Fall 2010 On-line Remediation and Retest
Began
Completed
Completed Practice
Practice
Tutorial
Test
Test
Tested
1
1
1
1
Began
Tutorial
36
Spring 2011 On-line Remediation and Retest
Began
Completed
Completed Practice
Practice
Tutorial
Test
Test
Tested
35
35
20
19
Number
Percent
note: 43 students were eligible for online remediation and testing
Changes in 2011 - 2012
• A single form of the Augmented Benchmark and
End-of-Course exams will be designated for
students who are provided the readaloud accommodation. Refer to Commissioner’s
Memo LS-12-023 for specific details.
• Embedded field test items are being removed
from the Braille version of all tests in order to
shorten testing length for blind students.
Erasure Analysis Policy
• In June, U.S. Department of Education Secretary Arne
Duncan sent a letter to chief state school officers urging
states to “make assessment security a high priority by
reviewing and, if necessary, strengthening efforts to
protect assessment and accountability data, ensure the
quality of those data, and enforce test security.”
• ADE continuously reviews security guidelines and test
administration procedures in consultation with the
Technical Advisory Committee, the Planning Advisory
Committee, and the testing contractors.
• One result is that ADE is currently developing an erasure
analysis policy that will help to further ensure the
integrity of test administration across the state.
Arkansas Assessment Overview 2011-2012
Norm-Referenced and
National Tests
Grade
Tested
Criterion-Referenced Tests
K
English Language Development Assessment
Kindergarten Screening:
Qualls Early Learning Inventory
(QELI)
English Language Development Assessment
Norm-Referenced Test:
ITBS Complete Battery
Reading, Language, and
Mathematics
2
English Language Development Assessment
Norm-Referenced Test:
ITBS Complete Battery
Reading, Language, and
Mathematics
3
Augmented Benchmark Exam:
Literacy and Math
Alternate Portfolios for IEP
English Language Development Assessment
Augmented Benchmark Exam:
ITBS Survey BatteryReading, Language, and
Mathematics
4
Augmented Benchmark Exam:
Literacy and Math
Alternate Portfolios for IEP
English Language Development Assessment
5
Augmented Benchmark Exam:
Literacy, Math, and Science
Alternate Portfolios for IEP
English Language Development Assessment
1
NAEP
Long-Term
Trends
Augmented Benchmark Exam:
ITBS Survey BatteryReading, Language, and
Mathematics
Augmented Benchmark Exam:
ITBS Survey BatteryReading, Language, and
Mathematics;
ITBS Complete BatteryScience
Arkansas Assessment Overview 2011-2012
Norm-Referenced and
National Tests
Grade
Tested
Criterion-Referenced Tests
6
Augmented Benchmark Exam:
Literacy and Math
Alternate Portfolios for IEP
English Language Development Assessment
Augmented Benchmark Exam:
ITBS Survey BatteryReading, Language, and
Mathematics
7
Augmented Benchmark Exam:
Literacy, Math, and Science
Alternate Portfolios for IEP
English Language Development Assessment
Augmented Benchmark Exam:
ITBS Survey BatteryReading, Language, and
Mathematics;
ITBS Complete BatteryScience
8
Augmented Benchmark Exam:
Literacy and Math
Alternate Portfolios for IEP
English Language Development Assessment
Augmented Benchmark Exam:
ITBS Survey BatteryReading, Language, and
Mathematics
ACT EXPLORE
9
End-of Course Algebra I
Grade 9 Math Portfolio for IEP
English Language Development Assessment
ITED Complete Battery
Vocabulary, Reading,
Language, and Mathematics
10
End-of-Course Geometry
End-of-Course Biology
Grade 10 Science Portfolio for IEP
English Language Development Assessment
ACT PLAN/
PSAT
11
Grade 11 Literacy
Grade 11 Literacy Portfolio for IEP
English Language Development Assessment
ACT**
SAT**
**AP (Advanced Placement)
12
English Language Development Assessment
NAEP
Long-Term
Trends
Long-Term
Trends
ACT**
SAT**
**AP (Advanced Placement)
The Partnership for Assessment of
Readiness for College and Careers
Partnership for Assessment of Readiness
for College and Careers (PARCC)
Governing Board States
9
Participating States
PARCC Assessment Development and
Design
• PARCC will develop an assessment system comprised of four
components. Each component will be computer-delivered and
will leverage technology to incorporate innovations.
– Two summative assessment components designed to
o Make “college- and career-readiness” and “on-track” determinations
o Measure the full range of standards and full performance continuum
o Provide data for accountability uses, including measures of growth
– Two formative assessment components designed to
o Generate timely information for informing instruction, interventions,
and professional development during the school year
o In ELA/literacy, an additional third formative component will assess
students’ speaking and listening skills
10
PARCC Assessment Development and
Design
• Summative Assessment Components:
– Performance-Based Assessment (PBA) administered as close to the end of the
school year as possible. The ELA/literacy PBA will focus on writing effectively
when analyzing text. The mathematics PBA will focus on applying skills,
concepts, and understandings to solve multi-step problems requiring abstract
reasoning, precision, perseverance, and strategic use of tools
– End-of-Year Assessment (EOY) administered after approx. 90% of the school
year. The ELA/literacy EOY will focus on reading comprehension. The math
EOY will be comprised of innovative, machine-scorable items
• Formative Assessment Components:
– Early Assessment designed to be an indicator of student knowledge and skills
so that instruction, supports and professional development can be tailored to
meet student needs
– Mid-Year Assessment comprised of performance-based items and tasks, with
an emphasis on hard-to-measure standards. After study, individual states may
consider including as a summative component
11
PARCC Assessment Development and
Design
The PARCC assessments will allow us to make important claims
about students’ knowledge and skills.
• In English Language Arts/Literacy, whether students:
– Can Read and Comprehend Complex Literary and Informational Text
– Can Write Effectively When Analyzing Text
– Have attained overall proficiency in ELA/literacy
• In Mathematics, whether students:
– Have mastered knowledge and skills in highlighted domains (e.g.
domain of highest importance for a particular grade level – number/
fractions in grade 4; proportional reasoning and ratios in grade 6)
– Have attained overall proficiency in mathematics
12
PARCC Assessment Development and
Design
Flexible
Early Assessment
• Early indicator of
student knowledge
and skills to inform
instruction, supports,
and PD
Summative
assessment for
accountability
13
Mid-Year Assessment
• Performance-based
• Emphasis on hard to
measure standards
• Potentially
summative
Formative
assessment
Performance-Based
Assessment (PBA)
• Extended tasks
• Applications of concepts
and skills
ELA/Literacy
• Speaking
• Listening
End-of-Year
Assessment
• Innovative, computerbased items
Building a Pathway to College and Career
Readiness for All Students
K-2 formative
assessment
being
developed,
aligned to the
PARCC system
K-2
Timely student achievement
data showing students,
parents and educators
whether ALL students are ontrack to college and career
readiness
3-8
College
readiness score
to identify who
is ready for
college-level
coursework
High
School
ONGOING STUDENT SUPPORTS/INTERVENTIONS
14
Targeted
interventions &
supports:
•12th-grade bridge
courses
• PD for educators
SUCCESS IN
FIRST-YEAR,
CREDIT-BEARING,
POSTSECONDARY
COURSEWORK
Supporting Educators in the Classroom
INSTRUCTIONAL TOOLS TO
SUPPORT IMPLEMENTATION
PROFESSIONAL DEVELOPMENT
MODULES
K-12 Educator
TIMELY STUDENT ACHIEVEMENT
DATA
15
EDUCATOR-LED TRAINING TO SUPPORT
“PEER-TO-PEER” TRAINING
Key Challenges for PARCC
Technical Challenges
• Developing an
interoperable
technology platform
• Transitioning to a
computer-based
assessment system
• Developing and
implementing
automated scoring
systems and processes
• Identifying effective,
innovative item types
16
Implementation
Challenges
• Estimating costs over
time, including longterm budgetary
planning
• Transitioning to the
new assessments at the
classroom level
• Ensuring long-term
sustainability
Policy Challenges
• Student supports
and interventions
• Accountability
• High school course
requirements
•
College admissions/
placement
•
Perceptions about
what these
assessments can do
PARCC Highlights:
The Work is Underway
• Governing Board meetings where major decisions have
been made around assessment design, procurement
schedule, committee structure and by-laws
• Consortium-wide and in-state meetings, including first
Transition & Implementation Institute, attended by 200
state and district leaders from 22 states
• Release of final by-laws, draft content frameworks and
launch of PARCC website (www.parcconline.org)
• Direct engagement with over 1,000 educators, K-12 and
postsecondary leaders and state and local officials
Fall 2011 PARCC Procurements
• Technology Needs Assessment (Joint SBAC/PARCC)
• Technology Architecture Services, Interoperability
Standards Development Services, and Systems
Implementation Services
• Operational Item Development
• Text Complexity Tool
• Educator Leader Cadres
18
PARCC Content Frameworks
• The PARCC Consortium is working to finalize content
frameworks for English language arts and mathematics
in Grades 3-8 and high school.
• These content frameworks are currently planned to be
released in late October.
• Additionally, Achieve has secured funding to create
content frameworks for English language arts and
mathematics in Grades K-2 that will connect seamlessly
with the Grades 3-8 content frameworks.
• Development for the Grades K-2 content frameworks is
set to begin soon.
PARCC Content Frameworks
• The PARCC Consortium is working to finalize
content frameworks for English language arts and
mathematics in Grades 3-8 and high school.
• These content frameworks are currently planned
to be released in late October.
• Additionally, Achieve has secured funding to
create content frameworks for English language
arts and mathematics in Grades K-2 that will
connect seamlessly with the Grades 3-8 content
frameworks.
• Development for the Grades K-2 content
frameworks is set to begin soon.