Prevention and Cost-Effectiveness in the Chicago Child-Parent Centers

advertisement
Prevention and Cost-Effectiveness in
the Chicago Child-Parent Centers
Arthur J Reynolds1, Judy A Temple2, Dylan L
Robertson1, Emily A Mann1, Suh-Ruu Ou1
1. University of Wisconsin-Madison
2. Northern Illinois University
Society for Research in Child Development
April 26, 2003
Some Facts about the Evaluation
Literature
Cost effectiveness rarely applied to child
development programs
Effect sizes as economic “returns”
Extensive longitudinal studies of social
programs are ideal for testing cost
effectiveness
Most Frequently Cited Early Childhood Intervention Programs
Program
Type
Age at Last
Follow-Up
Number of
Citations
High/Scope Perry Preschool Program
Model
27
15
Carolina Abecedarian Project
Model
21
14
Houston Parent-Child Development Center
Model
11
14
Yale Child Welfare Research Program
Model
14
10
Large Scale
20
9
Milwaukee Project
Model
14
8
Syracuse Family Development Program
Model
15
8
Early Training Project
Model
20
6
Consortium for Longitudinal Studies
Model
27
6
Philadelphia Project
Model
18
6
Infant and Health Development Program
Model
8
6
Educational Testing Service Head Start Study
Large Scale
8
5
New Haven Follow-Through Study
Large Scale
9
5
Elmira Prenatal/Early Infancy Project
Model
17
5
Harlem Training Project
Model
12
4
University of Rochester Nurse Home Visiting Program
Model
4
4
Gordon Parent Education Program
Model
10
3
New York State Experimental Prekindergarten
Large Scale
8
3
PSID Head Start Longitudinal Study
Large Scale
25
3
Chicago Child-Parent Centers
Figure. Alternative Paths Leading to Social Competence
Early Childhood
Ages 3-9
Exogenous
Conditions
Gender
Socio-Environmental
Risk
Neighborhood
Attributes
Ages 5-12
Motivation
Self-efficacy
Perceived competence
Persistence in learning
MA
CA
Program
Participation
Timing
Duration
Intensity
SA
Developed Abilities
Cognitive development
Literacy skills
Pre-reading/numeracy skills
Social Adjustment
Classroom adjustment
Peer relations
Self-regulating skills
MA
Social Competence
Behaviors
CA
SA
FS
FS
MA= Motivational Advantage
CA = Cognitive Advantage
SA = Social Adjustment
FS = Family Support
SS = School Support
Adolescence
Ages 12-
SS
Family Support
Parent-child interactions
Home support for learning
Participation in school
Parenting skills
School Support
Quality of school environment
Classroom environment
School-level performance
SS
School Achievement
and Performance
Retention in Grade
Receiving Special
Education Services
Delinquency and Crime
Child Maltreatment
Participation in Social
Services
Educational Attainment
Child-Parent Centers
Child-Parent Center
Preschool/Kindergarten
(Wing or Building)
Principal
Head Teacher
Outreach
Services
Parent
Component
School-Community
Representative
Resource Mobilization
Home Visitation
Parent Conferences
Parent Resource Teacher
Parent Room Activities
Classroom Volunteering
School Activities
Home Support
Age 3
Elementary School
Grades 1 to 3
Curriculum Parent-Resources Teacher
Curriculum
Component
Language Focus
Small Class Sizes
Inservice Training
Health
Services
Health Screening
Nursing Services
Free + ReducedPrice meals
To
Parent
Component
Parent Room Activities
Classroom
Volunteering
School Activities
Home Support
Curriculum
Component
School-Wide
Services
Reduced Class Size
Health Services
Teacher Aides
School-Community
Instructional Materials
Representative
Individualized instruction Free + ReducedInservices
Price meals
Resource Mobilization
Age 9
Johnson Child-Parent Center
Chicago Longitudinal Study
989 complete cohort of children graduating
from Child-Parent Centers in kindergarten;
they participated from 2 to 6 years. Centers
are located in the highest poverty areas of
Chicago.
550 children enrolled in an alternative early
childhood program in kindergarten in five
randomly selected schools and other schools
serving low-income families. They matched
on eligibility for Title I programs and
socioeconomic status.
Characteristics of Program and
Comparison Groups
CPC Intervention
Comparison
Sample
Complete Cohort
Random sample of K sites
Recovery, age 22
869 of 989 (88%)
465 of 550 (85%)
Key attributes
Reside in highest poverty
areas
Over 80% of children enroll
Mean no. of family risks 3.6
Parent ed > than in c-group
Reside in high poverty areas
Had school-based enrichment
1 or 2 years
60% full day
69 % 1 year
56% 2-3 years
15% in Head Start
100% full day
30% 1 year
0% 2-3 years
Intervention level
Preschool
Kindergarten
School age
Mean no. of family risk 3.6
Area poverty > than in p-group
Characteristics of Preschool Group and Comparison Group (March, 2001)
CPC
Preschool
Group
(N=858)
NoPreschool
Group
(N=456)
Percent girls
53.0
47.0
.03*
Percent Black
94.2
92.8
.32
Percent parents not completed high school at child age 8
40.6
46.2
.08
Percent single parent at age 8
57.3
58.8
.63
Percent parent were teen (<19) at child’s birth
17.7
18.2
.83
Percent parent not employed at age 8
59.7
52.8
.04*
Percent ever reported receiving free lunch at age 8
73.7
69.3
.09
Percent child/neglect report by age 3
1.2
2.6
.05*
Percent income level is 60% + poverty for school area
77.0
71.7
.03*
Percent missing data from parent education or free lunch
report
15.0
18.9
.08
Family risk index (0-6)
3.1
3.0
.45
Characteristics
P-value
Equivalence of Program and Comparison Groups
School Readiness Skills
ITBS National Percentile Score
90
80
66
70
60
51
47
51
39
50
40
28
30
20
10
0
Age 5 Composite
Word Analysis
Comparison Group
Preschool Group
Math
Adjusted Group Differences for Measures of Child
Well Being in the Chicago Longitudinal Study
50
Juvenile
Arrest by
Age 18
Grade
Retention by
Age 15
Special
Education by
Age 18
Child
Maltreatment
by Age 17
Percentage of Sample
38.4
40
30
25.1
23
16.9
20
24.6
14.4
14.2
6.9
10
0
Comparison Group
Preschool Group
Percent of Overall Sample
Special Education Placement by Age 18
40
35
30
25
24.6
21.3
14.4
20
15
10
20.7
15.4
13.5
5
0
Comparison
Preschool
Preschool
School-Age
Extended
Rates of High School Completion by Groups
80
Percentage of Sample
70
60
50
40
30
20
10
0
January
2000
September March 2001 September
2000
2001
CPC preschool
January
2002
May 2002
January
2003
Non-CPC preschool
Note. Adjusted for gender, race, family risk index, follow-on participation, and CPC sites.
High School Completion Categories by Group
60
51.7
52.3
53.6
52.3
48.3
50
44
Percentage of Sample
51.7
44.5
44.4
43.9
Graduation
40
51.7
44
30
20
9.7
10
3.8
0
4.2
11.2
GED
5.7
14.2
11.8
10.3
5.6
14.1
10.3
2.9
Sep. 2000
(N=1,286)
March 2001
(N=1,314)
Preschool Group
Sep. 2001
(N=1,315)
Comparison Group
Jan. 2002
(N=1,338)
May 2002
(N=1,334)
Preschool Group
Jan. 2003
(N=1,336)
Comparison Group
Benefit-Cost Analysis
Benefit Categories
School Remedial Services


Reduced Costs of Special Education Services
Reduced Expenditures for Extra Schooling for
Retained Students
Child Welfare System


Reduced Treatment and Administrative Costs
Cost savings to Victims
Juvenile Court and Treatment Costs



Reduced Administrative Costs
Reduced Costs of Juvenile Treatment
Savings to Crime Victims
Benefit Categories (cont.)
Adult Courts and Treatments

Reduced Administrative Costs

Reduced Costs of Treatment

Savings to Crime Victims
Life Time Earnings Capacity (Projected from
HS Completion)

Increased Earnings Through Age 65

Increased Tax Revenues to Governments
Program Costs Per Participant vs.
Selected Yearly Costs (1998)
Preschool ($6,692) vs. Special
education, $7,791
School-age ($2,981) vs. Juvenile
institution, $32,237
Extended ($10,000) vs. Child welfare
services, $9,492
Major Categories of Costs in the Chicago ChildParent Centers: Preschool and School-Age
Components (1998 dollars)
Budget Category
Preschool Program
School-Age Program
Instructional staff (%)
$7,864,225 (43.4%)
$7,849,856 (73.5%)
Family and schoolcommunity staff/parent
program
1,744,945 (9.6%)
25,634 (0.2%)
Administration
2,288,153 (12.6%)
1,481,416 (13.9%)
Parent program
participation
1,421,695 (7.9%)
897,300 (8.4%)
Total cost in 1998 dollars
18,100,194
10,674,231
Number of children in 25
centers/schools
4,114
6,757
Present value of weighted
average cost per child
6,692
2,981
Procedures and Examples
1. Estimate the program effect
(Example: .70 fewer years in special ed)
2. Convert to 1998 dollars
(Example: $7,791 (i.e., adjust for inflation))
3. Estimate benefit at the time of program entry (age 3)
using an annual discount rate of 3% (Example:
$5,971)
This is the Present Value of Benefits in 1998 dollars.
The Program Economic Benefit Per Participant is
.7 (5,971) = $4,180.
Summary of CBA Findings Per Participant
CPC
component
Cost
Societal
Benefit
Public
Benefit
Preschool
$6,692
$47,759
$25,771
School-Age
$2,981
$4,944
$4,219
Extended
$4,057
$24,772
$14,594
Note. Present value in 1998 dollars discounted at 3%
Benefits of CPC Preschool by Category
100%
90%
15%
Tax revenues
28%
80%
13%
Tax revenues
Crime saving-victims
70%
60%
50%
16%
Crime savingstreatment
Crime savingvictims
10% Education savings
29%
40%
30%
25%
45%
Participants
Crime
savingstreatment
20%
19%
10%
Education
savings
0%
Society
Public
Estimated Benefits and Costs: Preschool
Child care
$1,657
$770
Sources of Savings or Costs
Abuse and neglect
$6,127
Crime victims
Justice system
College tuition
$7,130
-$557
$7,243
Taxes on earnings
$20,517
Lifetime earnings
$692
Grade retention
Special education
-$6,692
-$10,000
$4,180
Program
-$5,000
$0
$5,000
$10,000
$15,000
$20,000
Present Value in Thousands (1998 $ discounted at 3 %)
$25,000
Estimated Benefits and Costs: School-Age
Sources of Savings or Costs
Child care
$0
Abuse and neglect
$204
$431
Crime victims
Justice system
$0
College tuition
-$20
Taxes on earnings
$259
$732
Lifetime earnings
Grade retention
$472
Special education
-$2,981
-$6,000
-$4,000
$2,866
Program
-$2,000
$0
$2,000
$4,000
Present Value in Thousands (1998 $ discounted at 3 %)
$6,000
Estimated Benefits and Costs: Extended
$1,646
Child care
Sources of Savings or Costs
Abuse and neglect
$480
$3,737
Crime victims
$3,025
Justice system
College tuition
-$234
Taxes on earnings
$3,040
$8,610
Lifetime earnings
$467
Grade retention
$4,001
Special education
-$4,057
-$10,000
-$5,000
Program
$0
$5,000
$10,000
Present Value in Thousands (1998 $ discounted at 3 %)
$15,000
Government and Participants Savings
Sources of Societal Savings for the CPC Preschool Program
13%
Program Participants
46%
Government Savings
Crime Victims
41%
Benefit to Cost Ratios for 3
Measures of Participation
Present Value of Benefits Per Dollar Invested ($)
10.00
9.00
8.00
7.14
6.11
7.00
6.00
5.00
3.85
3.60
4.00
3.00
1.66
2.00
1.42
1.00
0.00
Preschool
School-Age
Extended
Total Benefit
Public Benefit
Sensitivity of Estimated Total and General Public
Benefits and Cost of the Preschool program
1998 Present Value Dollars Per Child
105000
Total Benefits
90000
General Public
75000
Preschool Cost
60000
45000
30000
15000
0
0
1
2
3
4
Discount Rate
5
6
7
Sensitivity of Estimated Total and General Public
Benefits and Cost of the Extended Program
1998 Present Value Dollars Per Child
60000
Total Benefits
50000
General Public
Extended Cost
40000
30000
20000
10000
0
0
1
2
3
4
Discount Rate
5
6
7
Benefit-Cost Ratios for Total Benefit of 4 Programs
Present Value of Benefits per Dollar Invested ($)
10
8.74
9
7.14
8
7
5.06
6
3.78
5
4
3
2
1
0
High/Scope Perry
Preschool Program
CPC Preschool Program Elmira PEIP (High Risk)
Abecedarian
Notes: 1) High/Scope Perry Preschool cost benefit amounts are in 1992 dollars; discounted at 3%.
Benefits include averted intangible crime victim costs. 2) Chicago Child Parent Center
(CPC) cost benefit amounts are in 1998 dollars; discounted at 3%. 3) Elmira PEIP cost
benefit amounts are in 1996 dollars; discounted at 4%.
LISREL mediation model for high school completion, coefficients
are standardized and adjusted for measurement errors
Early Childhood
Variables
Ages 5-9
Middle Childhood
Ages 9-12
Grade Retention
by Age 15
-.39
Covariates
Gender
Socio-Environmental
Risk
Black
-.29
-.20
ITBS Word analysis in
Kindergarten
Adolescence
Age 12-
.16
-.15
Attended Magnet Schools ,
Ages 10-14
.11
.16
-.24
.15
.21
.33
.32
Preschool
Participation
-.23
.12
Classroom adjustment,
Age 9
.13
High School
Completion
by Age 20
(Sep, 2000)
.13
.11
.28
Parents’ Participation
in school, Ages 8-12
-.12
Number of school moves
-.14
School Commitment,
ages 10 or 15
.10
R2 = .34
-.08
-.11
-.14
Abuse/neglect repot,
Ages 4-12
RMSEA= 0.055
AGFI= 0.95
LISREL Mediation Model for Any Arrest Petition by Age 18,
Coefficients are Standardized and Adjusted for Measurement Errors
Early Childhood
Variables
Ages 5-9
Middle Childhood
Ages 9-12
Grade Retention
by Age 15
-.38
Covariates
Gender
Socio-Environmental
Risk
Race/Ethnicity
-.20
ITBS Word Analysis in
Kindergarten
-.26
.15
Attended Magnet Schools,
Ages 10-14
.11
.16
Adolescence
Age 12-
-.26
.24
-.19
Any Arrest
petition by
age 18
.33
.30
Number of School Moves,
Ages 10-14
-.15
-.23
Preschool
Participation
Classroom Adjustment,
Age 9
.12
Parents’ Participation in
School, Ages 8-12
-.13
Abuse/neglect
Report, Ages 4-12
.12
.10
.28
School Commitment,
Ages 10 or 15
-.10
-.13
-.09
R2 = .35
RMSEA= 0.052
AGFI= 0.95
Percentage of Total Indirect Effect of Preschool
Accounted for by Mediators
60
48.1
Percentage
50
40
31.1
27.9
30
23.2
21.3
18.7
20
10
0
Cognitive Advantage
Family Support
High School Completion
School Support
Juvenile Arrest
Implications of Chicago Study
Early childhood programs are among the most
effective preventive interventions. Evidence of
benefit-cost analysis suggests the long-term payoff
of such approaches.
Length of program participation can matter as much
as timing. Services should better reflect this
principle.
Implement intensive parent programs through
staffed parent-resource rooms and emphasis on
personal development and school participation.
Implications of Chicago Study (cont.)
Focus enrichment on school readiness, especially
language and literacy skills through relatively
structured, activity-based approaches.
Focus school-age programs on school organization
and instructional resources through such elements
as reduced class sizes and child-teacher ratios, and
instructional coordination.
Study the strengths and limitations of universal
access to early care and education programs.
Quality and effectiveness will depend on success in
A. Coordinating services
B. Recruiting and keeping well-trained staff
C. Tailoring services to the needs of families.
For more information about the
Chicago Longitudinal Study, contact:
Arthur J. Reynolds
Waisman Center
University of Wisconsin-Madison
1500 Highland Avenue
Madison, WI 53705
Telephone: 608-263-1847
Fax: 608-262-3821
E-mail: areynolds@waisman.wisc.edu
Web Site: www.waisman.wisc.edu/cls/
Download