NCLB Implications for
Assessment and Accountability
for Students with Disabilities
Martha L. Thurlow
OSEP Strand
Highlights of IDEA Part D Research
National Center on Educational Outcomes (NCEO)
Overview of Session
NCEO’s History and Focus
No Child Left Behind Act (and
IDEA)
Selected Research Findings
and Implications
National Center on Educational Outcomes (NCEO)
NCEO’s Background
Funded since 1990 – from outcomes to
assessments and accountability
(especially with IDEA 97)
Three areas of focus:
 Research
 Technical Assistance and Dissemination
 Collaboration and Other Leadership
National Center on Educational Outcomes (NCEO)
Many targeted topics:
Accommodations
Out-of-Level Testing
Accountability
Participation
Alternate Assessment
Reporting
Assessment
Standards
Graduation Requirements
The importance of these topics was reinforced by
IDEA 97, and more recently by No Child Left Behind
National Center on Educational Outcomes (NCEO)
No Child Left Behind, the 2001
reauthorization of the Elementary and
Secondary Education Act, includes
students with disabilities as one of
several subgroups in its accountability
requirements
National Center on Educational Outcomes (NCEO)
Stated purpose of NCLB:
“…to ensure that all children have a
fair, equal, and significant opportunity
to obtain a high-quality education and
reach, at a minimum, proficiency on
challenging State academic achievement
standards and state academic
assessments”
National Center on Educational Outcomes (NCEO)
Key Elements of NCLB
 State standards for what a child should know
and be able to do in reading and math now,
and in science by 2005-06
 Tests of every student’s progress toward the
reading and math standards in grades 3-8 plus
once in high school beginning in 2005-06, and
toward science standards in elementary,
middle, and high school beginning in 2007-08
National Center on Educational Outcomes (NCEO)
Key Elements of NCLB
 Criteria of adequate yearly progress (AYP) for
each state, district, and school – for all
students and for subgroups
 School and district performance publicly
reported in district and state report cards
 Consequences for districts or schools that
continually fail to make AYP
National Center on Educational Outcomes (NCEO)
NCLB builds on IDEA concepts of best practice
in the large-scale assessment of students with
disabilities
Assessment Participation
Accommodations
Alternate Assessment
Reporting
and adds concepts consistent with IDEA, such as:
Accountability
Universal Design
National Center on Educational Outcomes (NCEO)
NCEO has research, technical assistance
activities, and other leadership activities in
all of these areas.
http://education.umn.edu/NCEO
Today – highlight work on just a few
topics: state participation and
accommodation policies, public reporting
practices, universal design
National Center on Educational Outcomes (NCEO)
NCEO
Analyses of Written State
Policies (2002)
Study Procedures
[Collected policies through Sept 2001]
1. Requested newest policy from all 50 states
2. Completed grids for all states and all
accommodations (with notations)
3. Sent data to state for verification
4. Made changes only with written
documentation
National Center on Educational Outcomes (NCEO)
Participation Policies
Additional Testing Options*
Available
Out-of-Level Test
Available, Not
Aggregated
Not
Allowed
9
12
8
Partial Participation
21
0
4
Multiple Alternates
9
0
0
National Center on Educational Outcomes (NCEO)
Participation Policies
Participation Policy Variables
Non-Pursuit of Standard
Diploma
Parent/Guardian Involvement
Curricular Validity
IEP Team Decides
0
10
20
30
Number of States
National Center on Educational Outcomes (NCEO)
40
50
Assessment Accommodation
Policies
Decision-Making Criteria Used Without Restrictions
Student Needs &
Characteristics
Other Variables
Maintains Validity
Used for Instruction
IEP Team
Determined
0
10
20
30
40
Number of States
National Center on Educational Outcomes (NCEO)
50
Assessment Accommodation
Policies
Decision-Making Criteria Prohibited
Percent Time
Receiving Services
Category of
Disability
0
10
20
30
40
Number of States
National Center on Educational Outcomes (NCEO)
50
“Accommodation”
Terminology
Distinctions between “okay” and “not okay”
accommodations are usually evident in
terms used in policies
States with different terms
37
States with single term
13
National Center on Educational Outcomes (NCEO)
Terms Used to Indicate “Not Okay”
Testing Changes
Modification*
17 states
Non-Standard
7 states
Not Allowed
5 states
Not Permitted
3 states
Not Aggregatable
2 states
Non Valid/Impact Score
1 state each
*One state uses this term for “okay”test change
National Center on Educational Outcomes (NCEO)
Eligible Groups
Besides IEP, 504, and ELLs
All for All
Students
Some for All
Students
Colorado
Minnesota
Kansas
Washington
Oregon
All for Some
Students
New York
“All” Under Special Circumstances
Rhode Island
Kentucky Maryland
Wyoming
Maine
Mississippi
Massachusetts North Dakota
National Center on Educational Outcomes (NCEO)
Presentation
60% of
states
A better look at the
accommodation
policies of states
Equipment
Response
Scheduling/
Timing
National Center on Educational Outcomes (NCEO)
Setting
Accommodations Most Often Allowed
(With & Without Restrictions)
Presentation Accommodations
Number of States Allowing:
Without
With
Large Print
46
3
Braille
35
14
5
41
37
8
Read/Re-read/Clarify Directions* 29
10
Read Aloud*
Sign Language Interpretation
*One state prohibits use
National Center on Educational Outcomes (NCEO)
Accommodations Most Often Allowed
(With & Without Restrictions)
“Equipment” Accommodations
Number of States Allowing:
Without
With
Magnification
40
0
Amplification
34
0
Light/Acoustics
32
0
Calculator*
14
23
Templates/Graph Paper
32
0
*One state prohibits use
National Center on Educational Outcomes (NCEO)
Accommodations Most Often Allowed
(With & Without Restrictions)
Response Accommodations
Number of States Allowing:
Without
With
Proctor/Scribe
31
17
Write in Test Booklet
37
2
Computer or Machine*
30
9
Communication Device
27
8
*One state prohibits use
National Center on Educational Outcomes (NCEO)
Prohibited
Accommodations
Top Five
Spell Checker/Assistance
# of States
11
*Others include:
Read Aloud
Re-read, Clarify
Directions
Extended Time
3
Audio/Video Cassette
2
Abacus
Over Multiple Days
2
Computer
Others*
1
Calculator
Student’s Home
National Center on Educational Outcomes (NCEO)
Generalizations
Participation Policies
• More options are available in states
that just the usual three (same way as
other students take test, with
accommodations, alternate)
• Policies have become more specific
over time
National Center on Educational Outcomes (NCEO)
Generalizations
Accommodation Policies
• Few states completely prohibit
accommodations
• Policies are really complex, with
clarifications about type of test,
specific skills assessed, and certain
student characteristics
National Center on Educational Outcomes (NCEO)
NCEO
Analyses of Public Education
Reports (2003)
Study Procedures
[Collected reports through May 2002]
1. Searched Web sites of all 50 states
2. Summarized findings and sent to states to
verify
3. States sent additional public reports
4. Changes made only if reports were
available to the public
National Center on Educational Outcomes (NCEO)
Previous Findings:
1998 Study
1998 Study
WA
ND
MT
VT
MN
ME
WI
SD
OR
ID
WY
MI
IL
NV
UT
CO
NY
KS
IN
PA
OH
WV
MO
KY
CA
SC
MS
TX
LA
RI
MA
DE
NC
AR
NM
CT
NJ
VA
TN
OK
AZ
NH
IA
NE
MD
AL
GA
FL
AK
HI
States Reporting
Disaggregated Data for
Students with Disabilities
General
Assessments
No disaggregated data
Participation data only
Performance data only
Performance and Participation
11 states reported disaggregated participation data
13 states reported disaggregated performance data
National Center on Educational Outcomes (NCEO)
Previous Findings:
2000 Study
2000 Study
WA
ND
MT
VT
MN
ME
WI
SD
OR
ID
WY
MI
IL
NV
UT
CO
NY
KS
IN
PA
OH
WV
MO
KY
CA
SC
MS
TX
LA
RI
MA
DE
NC
AR
NM
CT
NJ
VA
TN
OK
AZ
NH
IA
NE
MD
AL
GA
FL
States Reporting Disaggregated Data for
Students with Disabilities
AK
HI
No disaggregated data
Performance data only for some tests
General
Assessments
Performance and Participation data for some tests
Performance data only for all tests
Performance and Participation data for all tests
14 states reported disaggregated participation data
17 states reported disaggregated performance data
National Center on Educational Outcomes (NCEO)
New Findings:
NH
WA
MT
OR
ND
MN
SD
ID
WI
WY
NE
NV
UT
CO
CA
KS
OK
AZ
VT
NM
TX
IA
MI
AR
LA
KY
TN
MS AL
ME
MA
NY
IL IN OH
MO
2002 Study
WV
SC
PA
VA
NC
DE
MD
GA
FL
AK
RI
CT
NJ
General
Assessments
HI
No disaggregated data (n=6)
Performance data only for some tests (n=2)
Performance and Participation data for some tests (n=10)
Performance data only for all tests (n=4)
Performance and Participation data for all tests (n=28)
National Center on Educational Outcomes (NCEO)
New Findings:
WA
MT
OR
ND
MN
SD
ID
UT
CO
CA
AZZ NM
KS
OK
TX
AK
HI
IA
MI
NY
IL IN OH
MO
AR
LA
2002 Study
NH
ME
WI
WY
NE
NV
VT
MS
KY
TN
AL
WV
SC
PA
VA
NC
CT
NJ
DE
MD
MA
RI
GA
FL
Alternate
Assessments
No disaggregated data (n=25)
Participation data only (n=10)
Performance data only (n=2)
Participation and Performance data (n=13)
National Center on Educational Outcomes (NCEO)
Universally Designed Assessments:
 are designed from the beginning
to be accessible and valid for
the widest range of students
 provide optimal standard
assessment conditions
National Center on Educational Outcomes (NCEO)
Elements of UD Assessments
 Inclusive assessment population
 Precisely defined constructs
 Accessible, non-biased items
 Amenable to accommodations
National Center on Educational Outcomes (NCEO)
Elements of UD Assessments
 Simple, clear, and intuitive
instructions and procedures
 Maximum readability and
comprehensibility
 Maximum legibility
National Center on Educational Outcomes (NCEO)
More things to look for:
 Results from ongoing survey of state
directors of special education
 Searchable bibliography of research on
effects of accommodations
 Universal design research
 In-depth study of alternate
assessments
National Center on Educational Outcomes (NCEO)
More things to look for:
 Principles of inclusive assessments and
accountability systems
 Self study guide to inclusive
assessments and accountability systems
Visit the NCEO Web site for
these and more . . . .
National Center on Educational Outcomes (NCEO)
Join Many Others! education.umn.edu/nceo
Hits on NCEO Web Site
450,000
388,517
400,000
360,437
355,426
Number of Hits
350,000
292,670
272,333
300,000
230,861
250,000
200,000
150,000
92,573
100,000
50,000
57,814
8,000
8765
0
Q1
Q2
Q3
2000-2001
Q4
Q1
Q2
Q3
2001-2002
Q4
National Center on Educational Outcomes (NCEO)
Q1
Q2
2002-2003