NPC Conference Dec 13 - University of California, Irvine

advertisement
Optimal Preschool
Policies for LowIncome Children
Greg J. Duncan
School of Education
University of California, Irvine
Outline
What skills and behaviors should
preschools be promoting?
Concrete achievement skills, mostly
How good are we at doing that?
So-so, and impacts are smaller now than 40
years ago
Outline (con’t)
What policy levers are available?
Funding + regulating quality and curriculum
What’s the bottom line on them?
Center-based care helps; quality regulation
doesn’t seem to work; and we’re promoting
the wrong curricula in Head Start
Are there successful models out there?
Yes, but only scaled up in one city
What skills and behaviors
matter most for success
in school?
Skills and Behaviors
Problem
Behaviors
Achievement
Engagement
Description:
Concrete math
and reading skills
Ability to control
impulses and
focus on tasks
i) Ability to get
along with
others
ii) Sound mental
health
Example test
areas or
question
wording:
Knowing letters
and numbers;
beginning word
sounds, word
problems
Can’t sit still;
can’t concentrate;
score from a
computer test of
impulse control
i) Cheats or tells
lies, bullies, is
disobedient at
school
ii) Is sad, moody
Duncan and Magnuson, 2011
Skill and behavior gaps between high- and low-income
kindergarteners and fifth graders (SAT scale)
+106
+53
-27
-30
School
engagement
-100
Math (or
~reading)
achievement
Anti-social
behavior
Mental
health
problems
Kindergarten gap
5th grade gap
Source: Early Childhood Longitudinal Study – Kindergarten cohort.
Skill and behavior gaps between high- and low-income
kindergarteners and fifth graders (SAT scale)
+106
+121
+53 +59
-27
-30
-42
School
engagement
-100
Math or
reading
achievement
Anti-social
behavior
Mental
health
problems
Kindergarten gap
5th grade gap
Source: Early Childhood Longitudinal Study – Kindergarten cohort.
-31
Which school-entry academic skills
and behaviors best predict later
school achievement?
Regress later achievement on:
• School-entry math and reading
• School-entry engagement, etc.
Controls for:
• Child IQ, temperament
• Maternal and family measures
Duncan et al. (2007)
Predictive importance for later school
achievement (standardized coefficients)
School-entry:
Grades 1 to 8
achievement:
Reading
.17*
Math
.34*
Engagement/attention
.10*
Anti-social (- expected)
.01 ns
Mental health (- expected)
.01 ns
Duncan et al (2007)’s meta-analysis of six longitudinal data sets, five of
which control for prior IQ
Bottom line for ECE and
school readiness:
Marshmallows be damned!
Concentrate first and foremost on
early math and literacy skills
How well do ECE programs
promote cognitive skills?
• Evidence from strong evaluation
studies published between
1960-2007
• End of treatment effect sizes
(vs. longer-run studies)
Average cognitive impact at end of treatment
2.00
Average effect size in sd units
Perry
1.50
Abecedarian
1.00
0.50
0.00
1955
-0.50
1965
1975
1985
1995
2005
2015
Average cognitive impact at end of treatment
2.00
Head Start
Non Head Start
Average effect size in sd units
Perry
1.50
Y
Abecedarian
1.00
National Head
Start
0.50
0.00
1955
-0.50
1960
1965
1970
1975
1980
1985
1990
1995
2000
2005
2010
2015
Average cognitive impact at end of treatment
2.00
Head Start
Non Head Start
Average effect size in sd units
Perry
1.50
Y
Abecedarian
Boston
pre-K
1.00
National Head
Start
0.50
0.00
1955
-0.50
1960
1965
1970
1975
1980
1985
1990
1995
2000
2005
2010
2015
Why are impacts of programs
from the 60s, 70s and 80s
larger than now?
Counterfactual conditions now are
much more enriching:
• Maternal schooling much higher
• Fewer siblings
• More center-based care
What About Long-Run ECE
Effects?
• Short-term impacts on test scores fade
over time
– Meta-analysis: Decline by .025 standard
deviations each year, or entirely after 8-9 years
• Yet, consistent impacts on adult educational
attainment, earnings and crime across
diverse ECE programs
– Example: Deming (2009) fixed-effect Head Start
study using an index of adult outcomes shows
effect size .23 sd
The Mechanism Puzzle
• We don’t know why there are long-run
effects on human capital when short-run
achievement impacts fade
• BUT evidence suggests that there is not one
explanation for all evaluation study findings
– It’s not only because of “character” or behavior
• Good News, though: Equifinality--a variety
of ECE programs with differing approaches
have positive impacts on adult human
capital through differing pathways
Policy levers
• Funding streams for programs
• Curriculum requirements
• Process quality regulation (QRIS)
ECE Funding & Enrollment
• Two largest funding streams for ECE: Head Start
($8.5 billion) and State Prekindergarten ($5.1
billion)
• In year before Kindergarten about 75% of
children experience ECE in a mix of full- and partday programs
•90% of top income quintile
•65-69% of bottom three income quintiles
• Lower enrollment among Hispanics, Immigrants,
and rural populations
Cost of Expanding ECE Access
• Focus on funding bottom three income
quintiles
~ 1.2 million of these children are not in ECE
(or private ECE)
• Per child cost of program (mix of part and full
day programs): ~$7,500
• New Cost: $9.36 billion (a little more than the
current cost of Head Start)
What is minimal ECE short-run effect
size needed to recoup $7,500?
• Increase of 1% percentile rank in Kindergarten
achievement predicts .5% increase in adult earnings
(Chetty et al., 2011)
• Our estimate of present value of lifetime earnings
(PVLE) at age 5:
– Lower estimate ~$382,392
– Higher estimate ~$681,544
• Break Even if ECE program impacts are :
– Lower PVLE estimate: 4 percentile points (.10-.15 ES)
– Higher PVLE estimate: 2 percentile points (.03-.08 ES)
How to generate large
cognitive impacts?
• Curriculum requirements?
• Process quality regulation (QRIS)?
Types of Curricula
• “Whole-child”
• Content-specific (e.g., math or
literacy)
• “Locally-developed”
Whole-child curricula
• Head Start mandates “whole child”
curricula
• Creative Curriculum is most popular
• HighScope (Perry Preschool) is 2nd
most popular
• No strong evidence on effectiveness
Process Regulation Policy Lever
• All but one state have Quality Rating and
Improvement Systems (QRIS)
• Star-type ratings for quality based on structural
characteristics and classoom observations
(ECERS, CLASS)
• Most run by state family services and not
education departments
• No RCT evidence; value-added evidence
suggests no substantial impacts for stars, ECRS
or CLASS
New RCT Evidence on:
• Which curricula best promote
school readiness?
• Do gains in QRIS-type process
quality match gains in child
outcomes?
The Preschool Curriculum
Evaluation Research (PCER)
Initiative Study
• provided random-assignment evaluations of
14 early childhood education curricula
• 12 grantees; all used common measures of
child outcomes, classroom processes, and
implementation quality
• 2,911 children
Curricula comparisons in PCER
Literacy
Math
I
II
III
Whole-child (Creative
Curriculum and HighScope)
IV
Locallydeveloped
Note: Comparison IV only involves the Creative Curriculum
I. Literacy vs. HighScope and Creative Curriculum
U North Florida n=250
FL Early Literacy and Learning Model
Creative
Florida State n=200
Florida State n=200
Berkeley n=290
FL Literacy Express
FL DLM Early Childhood Express
NJ Ready Set Leap
HighScope
HighScope
HighScope
VA Language Focused
HighScope
University of Virginia
n=200
II. Literacy vs. Locally Developed
UT Houston n=200
TX Doors to Discovery
UT Houston n=200
TX Let’s Begin with the Letter People
Vanderbilt n=210
TN Bright Beginnings
Locally
Developed
Locally
Developed
Locally
Developed
III. Math vs. HighScope and Creative Curriculum
Berkeley and SUNY Buffalo
n=320
CA, Pre-K Math
NY
Creative or
HighScope
IV. Creative Curriculum vs. Locally Developed
UNC Charlotte n=310
Vanderbilt
n=210
NC, Creative Curriculum
GA
TN Creative Curriculum
Locally
Developed
Locally
Developed
Do preschool curricula affect:
• Classroom quality?
• Child school readiness?
Do preschool curricula affect:
• Classroom quality?
• Child school readiness?
Experimental curricula comparisons predicting classroom
observational measures at the end of preschool
ECERS
total
score
TBRS
Math
TBRS
Literacy
Arnett
total
score
I. Literacy v. HighScope and
Creative Curriculum
II. Literacy v. Locally developed
III. Math v. HighScope and
Creative Curriculum
IV. Creative Curriculum v.
Locally developed
Each cell estimate
is from a separate
regression
Experimental curricula comparisons predicting classroom
observational measures at the end of preschool
I. Literacy v. HighScope and
Creative Curriculum
II. Literacy v. Locally developed
III. Math v. HighScope and
Creative Curriculum
IV. Creative Curriculum v.
Locally developed
ECERS
total
score
TBRS
Math
TBRS
Literacy
Arnett
total
score
.25+
-.14
.07
.18
(.15)
(.16)
(.16)
(.16)
.51*
.46
.83*
.38
(.23)
(.32)
(.37)
(.25)
.15
1.16*
.34
.63
(.32)
(.52)
(.31)
(.52)
.61*
.51*
.71**
.99*
(.23)
(.23)
(.17)
(.36)
Do preschool curricula affect:
• Classroom quality?
• Child school readiness?
Experimental curricula comparisons predicting school
readiness skills at the end of preschool
Social
skills
Literacy
Math
Academic
composite composite composite composite
I. Literacy v. HighScope
and Creative Curriculum
II. Literacy v. Locally
developed
III. Math v. HighScope
and Creative Curriculum
IV. Creative Curriculum
v. Locally developed
Experimental curricula comparisons predicting school
readiness skills at the end of preschool
Social
skills
Literacy
Math
Academic
composite composite composite composite
I. Literacy v. HighScope
and Creative Curriculum
.15**
(.05)
-.01
(.05)
.06
(.05)
-.13
(.10)
II. Literacy v. Locally
developed
.15
(.09)
.14+
(.07)
.15+
(.08)
-.18
(.19)
III. Math v. HighScope
and Creative Curriculum
.05
(.10)
.35**
(.11)
.25*
(.11)
.14
(.17)
IV. Creative Curriculum
v. Locally developed
.02
(.08)
.02
(.08)
.02
(.08)
-.03
(.23)
Can’t we do even better than
this?
• What if you built the
curriculum around proven
approaches?
Boston pre-K as a model?
• Curriculum combined proven math &
literacy and behavioral curricula
• Develop “non-cognitive” skills as a
by-product of boosting academic skills
• Strong professional development,
including coaching
• Big impacts, but $12K per child
Boston pre-K
Weiland & Yoshikawa, 2013 Child Development
0.7
.62***
0.6
Effect size
0.5
.59***
.50***
.44***
0.4
0.3
0.2
0.1
0
PPVT-III
W-J LW (early
(vocabulary)
reading)
W-J AP
(numeracy)
REMA Short
(numeracy,
geometry)
39
Positive “Spillover” Effects on All Three
Dimensions of Executive Function Skills
0.7
0.6
0.5
0.4
0.3
.24***
.24***
.21***
.28***
0.2
.11
0.1
0
Backward DS Forward Digit
(working
Span (working
memory)
memory)
Pencil Tap
(inhibitory
control)
DCCS
(inhibitory
control)
TOQ Attention
(att. shifting)
40
What does Boston pre-K look
like?
6-minute video from
restoringopportunity.com
https://www.youtube.com/watch?v=URZkGPwcsn0
Summary
• Focus most on building achievement skills
• Typical ECE programs generate fairly small
impacts, although still may have
Benefits > Costs
• QRIS quality systems aren’t promising
• Mandated “whole-child” curricula aren’t
either
• Experiment with full-monty curricular
approaches
Greg J. Duncan
gduncan@uci.edu
School of Education
University of California, Irvine
Download