First 5 Kern Annual Report Fiscal Year 2010-2011 Presented By JIANJUN “JJ” WANG, Ph.D. Focuses of the Annual Report 1. Meet state requirements to justify the return on state investment Results-Based Accountability: Identify what works for whom in which context. 2. Facilitate program improvement “Define success as turning the curve away from the baseline or beating the baseline” (Friedman, 2005, p. 58) – It is particularly important when decrease of the state revenue seems inevitable (as tobacco consumptions dwindle down). What Works: Fact Finding, Outcome Assessment, and Trend Evaluation Descriptive Data to Count Service Outputs # of Children Born with Low Birth Weight # of Mothers Involved in Breastfeeding # of Families with Insurance Coverage Assessment of Service Outcomes “Not everything that counts can be counted, and not everything that can be counted counts.” -- Albert Einstein Analysis of Variable Relations State-Recommended Evaluation Framework Three levels of data will be collected, evaluated and reported on in order to provide answers to different categories of questions. These levels include: Descriptive data; Outcome data; and Data produced through applied social research methods. (First 5 California, 2005, p. 5) Structure of the Report Chapter 1: First 5 Kern Overview Chapter 2: Impact of First 5 Kern-Funded Programs Chapter 3: Effectiveness of Service Integration Chapter 4: Turning the Curve Chapter 5: Conclusions and Future Directions Fact Finding: Descriptive Results on Service Counts Sormano and Neville-Morgan (2009) pointed out, “Data is more compelling when aggregated” (p. 18). In the Health and Wellness area, the number of funded programs increased from eight in the last year to 11 this year. Five new programs have been added to the Parent Education and Support Services area, making a total of 18 funded programs this year. Approximately $1 million were added to expand services in Early Childcare and Education. Programs Highlighted in the State Report Programs covered in the local report to the state: Community Action Partnership of Kern 2-1-1 program Bakersfield Adult School Health Literacy Program Delano School Readiness Initiative Indian Wells Valley Family Resource Center Children’s Health Initiative Successful Application Stipend GBLA’s Domestic Violence Reduction Project. Fact Finding: Health and Wellness Figure 5: Relation Between Low Birth Weight and Family Income Blue: Regular Weight, Red: Low Birth Weight Fact Finding: Health and Wellness Figure 6: Lack of Regular Dental Checking in Single Parent Families See a dentist/hygienist less than a year: Yes (red), No (blue) Outcome Assessment: Health and Wellness Figure 11: Parental Respect Blue: Pre-test, Red: Post-test Outcome Assessment: Health and Wellness Figure 12: Peer Respect Blue: Pre-test, Red: Post-test Outcome Assessment: Health and Wellness Figure 13: Attention Span Blue: Pre-test, Red: Post-test Fact Finding: Parent Education and Support Services Figure 19: Trend of Resolving Immigration Barriers __________ * Recall is defined as a post-test administration. Fact Finding: Parent Education and Support Services Figure 20: Trend of Expanding Insurance Coverage Outcome Assessment: Parent Education and Support Services Figures 21 & 22: Change of Parent Beliefs on Child Fearing Arvin Shafter Outcome Assessment: Parent Education and Support Services Figure 25: Improvement of Substance Abuse Condition Through Parent Education Fact Finding: Balance Service Coverage in Kern County (Figures 27 & 28) Results of ASQ-3 36th Month Assessment Focus Area 2 Outcome Assessment: Early Childcare and Education (Table 10 reference) ASQ Domains Focus Area 2 Focus Area 3 Gross Motor 93 90 Fine Motor 78 78 Communication 74 71 Problem Solving 90 83 Personal Social 85 73 Outcome Assessment: Early Childcare and Education Figure 30: Early Education Programs Do a Good Job Outcome Assessment: Early Childcare and Education Figure 33: Invariant Language Combinations across Ages 4 and 5 Outcome Assessment: Early Childcare and Education (Figure 35) Outcome Assessment: Early Childcare and Education (Table 12) Program Site df t p Effect Size Arvin 31 11.07 .0001 4.20 BCSD 101 7.48 .0001 1.49 Delano 29 8.50 .0001 3.16 Greenfield 13 8.69 .0001 4.82 Lamont 74 4.05 .0001 0.94 Lost Hills 21 6.83 .0001 2.98 Mojave 5 10.01 .0002 8.95 McFarland 22 7.72 .0001 3.29 Shafter1 15 5.68 .0001 2.93 Shafter2 13 6.39 .0001 3.54 Taft 37 18.50 .0001 6.08 Fact Finding: Outreach Activities Across Programs (Table 14) Outreach Activities Number of Programs Establish an MOU with partners 13 Develop brochure 35 Develop/disseminate annual reports 9 Develop poster 10 Make press release 13 Participate in collaborative meetings 39 Participate in community gatherings 24 Participate in health fair 25 Publish educational book 7 Publish newsletter 14 Seek funding opportunities with partner agencies 34 Sustain partnerships for more than one year 38 Fact Finding: Integration of Services Across Programs Figure 38: Referrals to Enhance Service Accessibility in the Local Context Service for clients referred from other agencies: Blue – No, Red – Yes. Fact Finding: Integration of Services Across Programs Figure 40: Proportion of Coordinated Services Across Different Funding Levels Services coordinated by the county, state, or nation: Blue – Yes, Red – No Outcome Assessment: Integration of Services Across Programs Figure 45: Translation Services Across Different Funding Levels Translation services offered: Blue – Yes, Red – No Outcome Assessment: Integration of Services Across Programs Figure 51: Effectiveness of Integration Services Outcome Assessment: Integration of Services Across Programs Figure 53: Increase of Program Visibility Through Local Partnerships Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 17) *Blue color for FY 2009-10, and red color for FY2010-11. Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 18) *Blue color for FY 2009-10, and red color for FY2010-11. Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 19) *Blue color for FY 2009-10, and red color for FY2010-11. Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 20) Program Site Year Percent Buttonwillow 2009-10 3 2010-11 53 IWV 2009-10 27 McFarland 2010-11 2009-10 89 43 2010-11 76 *Blue color for FY 2009-10, and red color for FY2010-11. Pattern* Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 21) Program Site Buttonwillow 2009-10 Percent 50 2010-11 82 Henrietta Weill 2009-10 61 2010-11 73 IWV 2009-10 83 2010-11 90 2009-10 73 2010-11 86 Neighborhood Place 2009-10 71 2010-11 79 SENP 2009-10 44 2010-11 62 2009-10 64 2010-11 75 MVIP Wind in the Willows Year Pattern** *Percent of “yes” response in the blue and red bars, respectively. **Blue color for FY 2009-10, and red color for FY2010-11. Trend Evaluation: Effect of “Turning the Curve” Since 2009 (Table 22) Program Site Year Percent 2009-10 33 2010-11 42 2009-10 46 2010-11 82 Homeless Center 2009-10 47 2010-11 55 Greenfield 2009-10 41 2010-11 50 2009-10 49 2010-11 59 2009-10 29 2010-11 64 2009-10 48 2010-11 58 Arvin Delano MVIP Shafter Taft Pattern* *Blue color for FY 2009-10, and red color for FY2010-11. Trend Evaluation: Effect of “Turning the Curve” Since 2009 Additional results are available in the annual report, including: More nursery school attendance for children after age 3; Fewer children were exposed to cigarette smoke; More children received all shots recommended by doctors; More children being read to twice or more times per week. Conclusions Based on the results from fact-finding, outcome assessment, and trend evaluation, First 5 Kern, through its funded partners, has: Extended the current longitudinal data gathering beyond the annual monitoring of First 5 Kern performance; Incorporated more explanatory and outcome variables to justify the Results-Based Accountability (RBA) on each Result Indicator (see the next slide); Strengthened its leadership role in the area of service integration. Additional Information from Program-Specific Instruments Program-Specific Instruments include: 1. Anger Management Assessment 2. Be Choosey Be Healthy 3. Child Assessment Summer Bridge 4. Comprehensive Need Assessment 5. Eyberg Child Assessment 6. Incredible Years Parenting Scale 7. Richardson’s Student Behavior Assessment 8. School Readiness Articulation Survey 9. Substance Abuse Assessment Introduction to New Recommendations Statement from Kris Perry, Executive Director, First 5 California Regarding First 5 California Project Legacy Due to declining revenues, First 5 California can no longer fund programs at their current levels. We anticipated this situation and are prepared to address it in a fair and equitable manner. Our aim is to fulfill the objectives of our strategic plan, be responsible stewards of tax dollars and help ensure all children enter school ready to achieve their greatest potential. To accomplish this, we created First 5 California Project Legacy to serve as a “Roadmap to the Future” by establishing two to three Signature Programs and innovative Pilot Projects for children 0 to 5 and their families. Introduction to New Recommendations Three Signature Programs identified by the State Commission: a child program a parent program a teacher program Source: http://www.ccfc.ca.gov/Help/program_development.asp New Recommendations 1. Identify/develop “signature programs” through a balanced consideration between the existing partners with exemplary track records and new partners with strong potential to deliver groundbreaking services; 2. Collect timely feedback from service providers to enhance performance tracking; 3. Invite input from service providers on additional evidences that should have been gathered to represent their outcome-based contributions.