Evaluation report of 2010-11 Proposition 10 funding

advertisement
First 5 Kern
Annual Report
Fiscal Year 2010-2011
Presented By
JIANJUN “JJ” WANG, Ph.D.
Focuses of the Annual Report

1. Meet state requirements to justify the return on
state investment


Results-Based Accountability: Identify what works for
whom in which context.
2. Facilitate program improvement

“Define success as turning the curve away from the
baseline or beating the baseline” (Friedman, 2005, p. 58) –
It is particularly important when decrease of the state
revenue seems inevitable (as tobacco consumptions
dwindle down).
What Works: Fact Finding, Outcome
Assessment, and Trend Evaluation


Descriptive Data to Count Service Outputs

# of Children Born with Low Birth Weight

# of Mothers Involved in Breastfeeding

# of Families with Insurance Coverage
Assessment of Service Outcomes
“Not everything that counts can be counted, and not
everything that can be counted counts.”
-- Albert Einstein

Analysis of Variable Relations
State-Recommended Evaluation
Framework

Three levels of data will be collected, evaluated
and reported on in order to provide answers to
different categories of questions. These levels
include:

Descriptive data;

Outcome data; and

Data produced through applied social research
methods. (First 5 California, 2005, p. 5)
Structure of the Report

Chapter 1: First 5 Kern Overview

Chapter 2: Impact of First 5 Kern-Funded
Programs

Chapter 3: Effectiveness of Service Integration

Chapter 4: Turning the Curve

Chapter 5: Conclusions and Future Directions
Fact Finding: Descriptive Results on
Service Counts

Sormano and Neville-Morgan (2009) pointed out, “Data
is more compelling when aggregated” (p. 18).

In the Health and Wellness area, the number of funded
programs increased from eight in the last year to 11 this
year.

Five new programs have been added to the Parent
Education and Support Services area, making a total of 18
funded programs this year.

Approximately $1 million were added to expand services in
Early Childcare and Education.
Programs Highlighted in the State Report

Programs covered in the local report to the
state:

Community Action Partnership of Kern 2-1-1 program

Bakersfield Adult School Health Literacy Program

Delano School Readiness Initiative

Indian Wells Valley Family Resource Center

Children’s Health Initiative

Successful Application Stipend

GBLA’s Domestic Violence Reduction Project.
Fact Finding: Health and Wellness
Figure 5: Relation Between Low Birth Weight and Family Income
Blue: Regular Weight, Red: Low Birth Weight
Fact Finding: Health and Wellness
Figure 6: Lack of Regular Dental Checking in Single Parent Families
See a dentist/hygienist less than a year: Yes (red), No (blue)
Outcome Assessment: Health and Wellness
Figure 11: Parental Respect
Blue: Pre-test, Red: Post-test
Outcome Assessment: Health and Wellness
Figure 12: Peer Respect
Blue: Pre-test, Red: Post-test
Outcome Assessment: Health and Wellness
Figure 13: Attention Span
Blue: Pre-test, Red: Post-test
Fact Finding:
Parent Education and Support Services
Figure 19: Trend of Resolving Immigration Barriers
__________
* Recall is defined as a post-test administration.
Fact Finding:
Parent Education and Support Services
Figure 20: Trend of Expanding Insurance Coverage
Outcome Assessment:
Parent Education and Support Services
Figures 21 & 22: Change of Parent Beliefs on Child Fearing
Arvin
Shafter
Outcome Assessment:
Parent Education and Support Services
Figure 25: Improvement of Substance Abuse Condition Through
Parent Education
Fact Finding: Balance Service Coverage in
Kern County (Figures 27 & 28)
Results of ASQ-3 36th Month Assessment
Focus Area 2
Outcome Assessment:
Early Childcare and Education (Table 10 reference)
ASQ Domains
Focus Area 2
Focus Area 3
Gross Motor
93
90
Fine Motor
78
78
Communication
74
71
Problem Solving
90
83
Personal Social
85
73
Outcome Assessment:
Early Childcare and Education
Figure 30: Early Education Programs Do a Good Job
Outcome Assessment:
Early Childcare and Education
Figure 33: Invariant Language Combinations across Ages 4 and 5
Outcome Assessment:
Early Childcare and Education (Figure 35)
Outcome Assessment:
Early Childcare and Education (Table 12)
Program Site
df
t
p
Effect Size
Arvin
31
11.07
.0001
4.20
BCSD
101
7.48
.0001
1.49
Delano
29
8.50
.0001
3.16
Greenfield
13
8.69
.0001
4.82
Lamont
74
4.05
.0001
0.94
Lost Hills
21
6.83
.0001
2.98
Mojave
5
10.01
.0002
8.95
McFarland
22
7.72
.0001
3.29
Shafter1
15
5.68
.0001
2.93
Shafter2
13
6.39
.0001
3.54
Taft
37
18.50
.0001
6.08
Fact Finding:
Outreach Activities Across Programs (Table 14)
Outreach Activities
Number of Programs
Establish an MOU with partners
13
Develop brochure
35
Develop/disseminate annual reports
9
Develop poster
10
Make press release
13
Participate in collaborative meetings
39
Participate in community gatherings
24
Participate in health fair
25
Publish educational book
7
Publish newsletter
14
Seek funding opportunities with partner agencies
34
Sustain partnerships for more than one year
38
Fact Finding:
Integration of Services Across Programs
Figure 38: Referrals to Enhance Service Accessibility in the Local
Context
Service for clients referred from other agencies: Blue – No, Red – Yes.
Fact Finding:
Integration of Services Across Programs
Figure 40: Proportion of Coordinated Services Across Different Funding
Levels
Services coordinated by the county, state, or nation: Blue – Yes, Red – No
Outcome Assessment:
Integration of Services Across Programs
Figure 45: Translation Services Across Different Funding Levels
Translation services offered: Blue – Yes, Red – No
Outcome Assessment:
Integration of Services Across Programs
Figure 51: Effectiveness of Integration Services
Outcome Assessment:
Integration of Services Across Programs
Figure 53: Increase of Program Visibility Through Local Partnerships
Trend Evaluation: Effect of “Turning the
Curve” Since 2009 (Table 17)
*Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation: Effect of “Turning the
Curve” Since 2009 (Table 18)
*Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation: Effect of “Turning the
Curve” Since 2009 (Table 19)
*Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation: Effect of “Turning the
Curve” Since 2009 (Table 20)
Program Site
Year
Percent
Buttonwillow
2009-10
3
2010-11
53
IWV
2009-10
27
McFarland
2010-11
2009-10
89
43
2010-11
76
*Blue color for FY 2009-10, and red color for FY2010-11.
Pattern*
Trend Evaluation: Effect of “Turning the
Curve” Since 2009 (Table 21)
Program Site
Buttonwillow
2009-10
Percent
50
2010-11
82
Henrietta
Weill
2009-10
61
2010-11
73
IWV
2009-10
83
2010-11
90
2009-10
73
2010-11
86
Neighborhood
Place
2009-10
71
2010-11
79
SENP
2009-10
44
2010-11
62
2009-10
64
2010-11
75
MVIP
Wind in the
Willows
Year
Pattern**
*Percent of “yes” response in the blue and red bars, respectively.
**Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation: Effect of “Turning the
Curve” Since 2009 (Table 22)
Program Site
Year
Percent
2009-10
33
2010-11
42
2009-10
46
2010-11
82
Homeless
Center
2009-10
47
2010-11
55
Greenfield
2009-10
41
2010-11
50
2009-10
49
2010-11
59
2009-10
29
2010-11
64
2009-10
48
2010-11
58
Arvin
Delano
MVIP
Shafter
Taft
Pattern*
*Blue color for FY 2009-10, and red color for FY2010-11.
Trend Evaluation:
Effect of “Turning the Curve” Since 2009

Additional results are available in the annual
report, including:

More nursery school attendance for children after
age 3;

Fewer children were exposed to cigarette smoke;

More children received all shots recommended by
doctors;

More children being read to twice or more times
per week.
Conclusions

Based on the results from fact-finding, outcome
assessment, and trend evaluation, First 5 Kern,
through its funded partners, has:

Extended the current longitudinal data gathering
beyond the annual monitoring of First 5 Kern
performance;

Incorporated more explanatory and outcome variables
to justify the Results-Based Accountability (RBA) on
each Result Indicator (see the next slide);

Strengthened its leadership role in the area of service
integration.
Additional Information from
Program-Specific Instruments

Program-Specific Instruments include:
1. Anger Management Assessment
2. Be Choosey Be Healthy
3. Child Assessment Summer Bridge
4. Comprehensive Need Assessment
5. Eyberg Child Assessment
6. Incredible Years Parenting Scale
7. Richardson’s Student Behavior Assessment
8. School Readiness Articulation Survey
9. Substance Abuse Assessment
Introduction to New Recommendations
Statement from Kris Perry, Executive Director,
First 5 California
Regarding First 5 California Project Legacy
Due to declining revenues, First 5 California can no longer fund programs at
their current levels. We anticipated this situation and are prepared to address it
in a fair and equitable manner.
Our aim is to fulfill the objectives of our strategic plan, be responsible stewards
of tax dollars and help ensure all children enter school ready to achieve their
greatest potential. To accomplish this, we created First 5 California Project
Legacy to serve as a “Roadmap to the Future” by establishing two to three
Signature Programs and innovative Pilot Projects for children 0 to 5 and their
families.
Introduction to New Recommendations

Three Signature Programs identified by the
State Commission:

a child program

a parent program

a teacher program
Source: http://www.ccfc.ca.gov/Help/program_development.asp
New Recommendations
1. Identify/develop “signature programs” through a
balanced consideration between the existing
partners with exemplary track records and new
partners with strong potential to deliver
groundbreaking services;
2. Collect timely feedback from service providers
to enhance performance tracking;
3. Invite input from service providers on additional
evidences that should have been gathered to
represent their outcome-based contributions.
Download