National Assessment of Educational
Progress (NAEP) Overview
and Tools Workshop
NAEP:
The Nation’s Report Card
• NAEP is the Nation’s only monitor of what
students know and can do in various subject
areas
• NAEP is a survey designed to produce national
and state level results
• NAEP produces results for populations, not
individuals
NAEP Components
MAIN
LONG -TERM
National
Public and Nonpublic
(Grades 4, 8, and 12)
State
Public
(Grades 4 and 8)
National
Public and Nonpublic
(9-, 13-, and 17-year olds)
TUDA
(Grades 4 and 8)
3
NAEP Assessments
• Main NAEP
–
–
–
–
–
Grades 4, 8 and 12
Began in 1969
Follow NAGB Frameworks, content change about every 10 years
Every two years for mathematics and reading
State and TUDA in odd years, national in even years
• Long Term Trend
–
–
–
–
–
–
Ages 9, 13 and 17
Began in 1970s
National assessment only
Every four years
Mathematics and Reading only, content mostly unchanged
Last given in 2008
• Special assessments
– High School Transcript Study
– National Indian Education Survey
NAEP Organization
U.S. Department of Education
Institute of Education Sciences (IES)
National Assessment
Governing Board (NAGB)
National Center for Education
Statistics (NCES)
Assessment Division
NAEP Program
Contractors
NAEP Contractors
8.Quality
Assurance
HumRRO
7.Disseminat
ion &
Outreach
Hager Sharp
6. Web
Operations
and
Maintenance
GMRI
1. Alliance
Coordination
ETS
NCES
Assessment
Division
5.Sampling &
Data
Collection,
Training and
Support
Westat
2. Design,
Analysis &
Reporting
ETS
3. Item
Development
AIR
ETS
4. Material
Preparation,
Distribution
& Scoring
Pearson
6
NAEP Frameworks
• Each NAEP assessment is built around an
organizing framework, which is the blueprint
that guides the development of the
assessment instrument and determines the
content to be assessed.
• The High Schools That Work program develops
its assessments from the NAEP frameworks.
NAEP Frameworks
• Frameworks have been developed for:
– Reading
- Economics
– Mathematics
- Civics
– Science
- Foreign Language
– U.S. History
- Writing
– Geography
- Arts
Participation
• The Elementary and Secondary Education Act
(ESEA – formerly NCLB) requires
states/districts who receive Title I funding to
participate in the biennial NAEP assessment in
reading and mathematics at grades 4 and 8.
• Georgia law and State Board of Education
rules require participation in all NAEP
assessments.
School Sampling
• School samples are randomly selected from groups of schools
that have been stratified by variables such as:
– Region
– Extent of urbanization
– Minority enrollment
– Median household income
– Results of state achievement assessments
– Unique to the state/district
Student Sampling
• Student samples are randomly selected from each school
– All students are included
– New students also have opportunity to be included
– IEP guidelines may be disregarded
Contextual Background Variables
• In addition to assessing subject area knowledge and
abilities, NAEP collects information from students,
teachers, and principals about contextual or
background variables that are related to student
achievement:
– student questionnaires, which examine background
characteristics and subject area instructional experience;
– teacher questionnaires, which gather data on teacher
training and classroom instruction;
– school questionnaires, which gather information about
school characteristics and policies; and
– SD/ELL questionnaires, which provide information about
students within the sample who have disabilities or are
limited-English-proficient.
Analysis and Reporting
Average scale scores and achievement levels
reported for reading, mathematics, and science
– Scale Scores
• Subgroup comparisons (e.g., SD, ELL)
• State and regional comparisons
• Reading and Mathematics scale score range is 0-500
• Science scale score range is 0-300
– Achievement Levels
• Indicate the students within the total population, or
in a particular subgroup, that meet or exceed
expectations of what they should know and be able
to do
• Advanced, Proficient, Basic
Results
• State and national results only (No student,
classroom, school, county, or RESA results)
• Trial Urban District Assessment (TUDA) in Atlanta
Public Schools will report district level results
• State results are usually reported within six
months of the assessment cycle.
Future Assessments
15
Resources
•
•
•
•
•
•
•
•
•
General information
Assessment results
Item maps
Frameworks
Data analysis tool
Released questions
Scoring detail
State profiles
http://www.nces.ed.gov/nationsreportcard
16
Resources
17
20
21
Important Information
• NAEP website:
http://nces.ed.gov/nationsreportcard
• NAEP Data Tool:
http://nces.ed.gov/nationsreportcard/naepda
ta/
• NAEP Questions Tool:
http://nces.ed.gov/nationsreportcard/itmrls
Workshops
• NAEP Questions Tool workshops are available to
systems and schools
• The workshops provide participants with hands-on
training with an interactive-internet based item
bank and data analysis tool
• For more information or to schedule a workshop,
contact Bobbie Bable at the GADOE
Contact Information
Bobbie Bable
NAEP State Coordinator
bbable@doe.k12.ga.us
404-657-6168