Evaluation Summaries - ChildFund International

advertisement
ChildFund International Evaluation Summaries
Over the past three months, Program Assessment & Learning has reviewed about 175 ChildFund
documents, and identified 20 that we believe should be publically shared to meet new standards in
the US non-profit sector. These 20 documents meet a set of criteria we developed, based on Charity
Navigator published information:






The document is an evaluation of some sort;
There is an identifiable evaluation methodology;
The evaluation reports on results;
The report is in readable English;
The publication date is no earlier than 2009;
Recommendations or changes are proposed to strengthen projects based on the evaluation
findings.
The following pages contain the brief summaries of the 20 identified evaluation documents. The
actual documents can be made available on request.
Evaluation Summaries
1. Moran, Mary. (2010). Stepping Stones: Successful Transitions between Home, Preschool, and Primary
School: Evaluation of the Pilot Program, 2009-2010. ChildFund International.
 Stepping Stones: Successful Transitions Between Home, Preschool, and Primary School Pilot Project.
 2009 – 2010; Mumbwa Region, Zambia.
 This pilot project’s main goal was to ease the transition of young children from homes to Early Childhood
Development (ECD) Centers or primary schools. Using a Stepping Stones program model, the project
trained ECD teachers and primary school teachers in developmentally appropriate practices around
transition; helped parents support children in making successful transitions; aided adults to create
opportunities for children to practice the skills that encourage successful transitions both prior to the
actual move and in the early period after transitioning to a new environment; and created linkages
between home, ECD, and primary school environments.
 Life Stage: 1 and 2
 Methodology: Qualitative evaluation utilizing classroom observation and interviews from a subset of
randomly chosen parents and children stratified to represent all classes involved and to represent equal
numbers of boys and girls and parents of boys and girls.
 Constituent Voice: Highlights the experiences of participating preschool and 1st grade teachers.
 Recommendations include training more teachers directly (as opposed to through other teachers) and
increasing parental involvement in school-related project components.
_______________________________________________________________
2. Barry, S. Eliot, P., and Toure, C.T. (2011). Lessons Learned from the USAID/Senegal Community Health
Program (CHP): Final Evaluation of CHP, as Implemented by ChildFund, 2006-2011. USAID.
 USAID/Senegal Community Health Program
 2006-2011; thirteen regions throughout Senegal
 The goal of the CHP was to provide a basic package of preventive and curative services, that would
respond to the pressing primary health care requirements of rural communities – maternal, newborn and
child healthcare, treatment of diarrhea and acute respiratory infections, malaria prevention and
treatment, HIV/AIDS and TB prevention, family planning, nutrition and other community health needs.
CHP activities focused on training Community Health Workers, skilled birth attendants, and outreach
workers. Overall, the evaluation team found that the CHP has made significant headway in strengthening
access to primary health care services in previously underserved rural communities in regions and
1



districts across the country.
Life Stage: 1, 2, and 3
Methodology: Qualitative methodology utilizing focus group discussions and key informant interviews
with stakeholders, individuals, and groups at all levels of the health system.
Recommendations include: (a) systematizing the process by which patients are referred to health posts;
and (b) establishing a national-level working group to address the long-term sustainability of the
program.
______________________________________________________________
3. ATLAS: Active Teaching and Learning Approaches in Schools: Report on the Pilot Conducted in Zambia
2008-2009. (n.d.). International Reading Association and ChildFund International.
 Active Teaching and Learning Approaches in Schools (ATLAS) Pilot Program
 2008-2009; Mumbwa District, Zambia
 The overall purpose of the ATLAS program was to enhance the quality of education in schools in the
Mumbwa District. The pilot program addressed the quality of teaching and learning through the effective
use of active, participatory, child-centered teaching and learning methodologies. In order to support
behavior change at the classroom level, the project focused primarily on providing participating teachers
with the opportunity to enter and engage in teacher dialogue, to participate in teacher training sessions,
and to receive classroom coaching.
 Life Stage: 2
 Methodology: Mixed-method. Quantitative methods included pre-and-post-test participant assessments;
qualitative methods included interviews, direct observation, and survey questionnaires.
 The evaluators proposed a series of changes to be integrated into the ATLAS program model. Two of
these proposed changes – teaching educators techniques to improve student engagement in classroom
activities and teaching educators techniques for teaching large classes – have been integrated into the
ATLAS curriculum.
_______________________________________________________________
4. Adefrsew, Azeb. (2013). Post-evaluation Report of Education Project in Ethiopia and Zambia. ChildFund
Australia.
 Creating a Child-friendly and Supportive School Environment (Buee District, Ethiopia, 2008-2010);
Promoting Child Participation in Education (Mumbwa District, Zambia, 2008-2010).
 This report focuses on two child-friendly schools projects. The first project, Creating a Child-friendly and
Supportive School Environment, aimed to contribute to the country’s education program in terms of
quality improvement, and the project largely focused on child-centered learning pedagogies. The second
project, Promoting Child Participation in Education, aimed to promote child participation in school
governance, and it focused on child rights and participation in school governance.
 Life Stage: 2
 Methodology: qualitative evaluation. Methods included: desk review focus group discussions;
participatory learning and action; key informant interviews; and questionnaires. Evaluation sites and
children participating in FGDs were selected through a simple random sampling technique; other FGD
and KII respondents were selected using purposive sampling.
 This report highlights the voice of child participants, community stakeholders, and participating teachers.
 The report provides a number of recommendations, such as incorporating a strong community
sensitization component into future interventions in order to better help surrounding communities
overcome harmful child and gender norms.
_______________________________________________________________
5. Mapping Community-based Child Protection Mechanisms (CBCPMs)– Uganda. (2013). Child Protection in
Crisis Network for Research, Learning, and Action.
 Mapping Community-based Child Protection Mechanisms
 2013; Aruba and Nebbi Districts, Uganda.
 The goal of the research was to take a bottom-up approach in examining existing CBCPMs in Arua and
Nebbi districts in Uganda. By understanding how communities currently define, prevent, and respond to
2



child protection violations and how local systems connect (or do not connect) to formal protection
systems, these mechanisms can then be supported and enhanced, rather than ignored or undermined.
Life Stage: 1, 2, and 3
Methodology: This research utilized a community mapping approach. The tools and methods used in data
collection were based on the work of the Inter-agency Initiative on Child Protection Systems and
Community-Based Child Protection Mechanisms in Sierra Leone.
This research highlights the voice of community-level stakeholders, including: children and youth,
community leaders, local NGOs, and government officials.
_____________________________________________________________________
6. Kashaija, L.M., and Walakira, E.J. (2013). Linking Communities, Strengthening Responses Project in Lira and
Dokolo Districts: Evaluation Report. ChildFund Uganda.
 Linking Communities, Strengthening Responses
 2011-2012, Lira and Dokolo Districts, Uganda
 This project’s goal was to promote evidence-based child protection programming through research as
well as a pilot project designed to address child sexual violence. Project activities included: mapping
child protection structures; training community members, children’s club members, and youth groups;
holding community sensitization sessions; and utilizing radio to raise awareness on child sexual
violence prevention, response, referral, and documentation.
 Life Stage: 2
 Qualitative evaluation using purposive sampling. Methods included: key informant interviews, focus
group discussions, and desk review.
 The report highlights the voice of local-level stakeholders, including community members, program
participants, and local government officials.
 Recommendations include: clearly defining the role of local-level actors in project initiatives to avoid
overlap and ambiguity; exploring an expanded use of mobile technology in child protection processes;
and continuing to focus on children’s clubs as a means to impact child protection mechanisms.
_____________________________________________________________________
7. Dziewanski, Darius. (2011). Development, from a Child’s Perspective: Integrating Child-centered
Participatory Action Research into Education Programs in Liberia. ChildFund International.
 Participatory Research and Learning Project (PARLER),
 2010-2011; Gbarpalou County, Liberia
 The PARLER project sought to identify obstacles to school enrolment and retention among 5-8 year olds
as well as bring to light risks to the healthy development of children. The project trained youth
facilitators to work with children 5-8 year old in order to identify obstacles to educational enrolment and
retention and to map general risk factors to child protection. Other project activities included: teacher
trainings, parent sensitization and education dialogues, and life skills trainings.
 Life Stage: 2
 Methodology: Mixed-method impact evaluation comparing participating and non-participating
communities: by matching participating and non-participating communities with each other according to
a number of characteristics.
 Evaluation recommendations include: expanding sensitization sessions for parents of participating
children in areas related to health and nutrition; and enhancing the quality and quantity of activities
designed to strengthen teacher capacity.
____________________________________________________________________
8. Report on Findings from India Midline: Assessing the Status of Core Program Indicators in India. (2013)
ChildFund International.
 Jhabua, Udaipur Jhadol, and Daltonganj Project Areas, India.
 The purpose of this assessment was to measure a list of organization-wide core program outcome
indicators. ChildFund organizes its work with infants, children, and youth in three life stages: Healthy and
Secure Infants and Young Children (0-5 years old); Educated and Confident Children (6-14 years old);
3



and Skilled and Involved Youth (15-24 years old). For children 0-5 years of age, ChildFund India focuses
on maternal, neonatal and child health, nutrition, and early childhood development. For children 6-14
years of age, ChildFund focuses on confidence and basic education. For youth 15-24 years of age,
ChildFund focuses youth leadership, social engagement, and livelihood opportunities.
Life Stage: 1, 2, and 3
LQAS Household Surveys targeting mothers of children under 5, children ages 6-14, and youth ages 1524, accompanied by a qualitative document review.
Report concludes that in areas where ChildFund’s efforts align with those of the Government of India,
statically significant results on core program indicators are achieved; in areas targeting soft skills, the
evaluators found no such changes.
____________________________________________________________________
9. Villeronte, M. (2012). Midline Report Philippines: Bicol Area
 Bicol Bright Futures Project Area, Philippines
 The purpose of this assessment was to measure a list of organization-wide core program outcome
indicators. ChildFund organizes its work with infants, children, and youth in three life stages: Healthy and
Secure Infants and Young Children (0-5 years old); Educated and Confident Children (6-14 years old);
and Skilled and Involved Youth (15-24 years old). For children 0-5 years of age, ChildFund focuses on
maternal, neonatal and child health, nutrition, and early childhood development. For children 6-14 years
of age, ChildFund focuses on confidence and basic education. For youth 15-24 years of age, ChildFund
focuses youth leadership, social engagement, and livelihood opportunities.
 Life Stage: 1, 2, and 3
 LQAS Household Surveys targeting mothers of children under 5, children ages 6-14, and youth ages 1524; qualitative document review; focus group discussions; and key informant interviews.
 The report provides a number of recommendations on how to improve data collection processes for
future midline assessments.
_____________________________________________________________________
10. Sorenson, Amy. (2013). Midline Report on Core Nine Indicators – Sierra Norte De Puebla Project Area.
ChildFund International.
 Sierra Norte De Puebla Project Area, Mexico.
 The purpose of this assessment was to measure a list of organization-wide core program outcome
indicators. ChildFund organizes its work with infants, children, and youth in three life stages: Healthy and
Secure Infants and Young Children (0-5 years old); Educated and Confident Children (6-14 years old);
and Skilled and Involved Youth (15-24 years old). For children 0-5 years of age, ChildFund focuses on
maternal, neonatal and child health, nutrition, and early childhood development. For children 6-14 years
of age, ChildFund focuses on confidence and basic education. For youth 15-24 years of age, ChildFund
focuses youth leadership, social engagement, and livelihood opportunities.
 Life Stage: 1, 2, and 3
 Methodology: LQAS Household Surveys targeting mothers of children under 5, children ages 6-14, and
youth ages 15-24; qualitative document review.
 The report recommends that ChildFund Mexico increase its targeting and engagement of children in the
first and third life stage and increase programming focused on empowerment of young mothers.
_____________________________________________________________________
11. Samaranayake, Mallika R. (2012). Household Survey and Qualitative Assessment for Core Outcomes of
the ChildFund International Midline Evaluation - Sri Lanka Nuwara Eliya ASP First Cycle Programme.
ChildFund International.
 Nuwara Eliya Program Area, Sri Lanka
 The purpose of this assessment was to measure a list of organization-wide core program outcome
indicators. ChildFund organizes its work with infants, children, and youth in three life stages: Healthy and
Secure Infants and Young Children (0-5 years old); Educated and Confident Children (6-14 years old);
and Skilled and Involved Youth (15-24 years old). For children 0-5 years of age, ChildFund focuses on
maternal, neonatal and child health, nutrition, and early childhood development. For children 6-14 years
4




of age, ChildFund focuses on confidence and basic education. For youth 15-24 years of age, ChildFund
focuses youth leadership, social engagement, and livelihood opportunities.
Life Stage: 1, 2, and 3
Methodology: LQAS Household Surveys targeting mothers of children under 5, children ages 6-14, and
youth ages 15-24; qualitative document review, focus group discussions, and key informant interviews.
The report highlights the voice of mothers of infants and young children, children, and youth living in
communities where ChildFund implements programming.
The report provides a number of programmatic recommendations to increase program effectiveness for
each life stage.
____________________________________________________________________
12. Bogale, T., Amsal, Y., and Berhanu, G. (2012). Midline Assessment of ChildFund Core Outcomes at SodoBuee and Silti-Aynagie Program Areas. ChildFund International.
 Sodo-Buee and Silti-Aynagie Program Areas, Ethiopia.
 The purpose of this assessment was to measure a list of organization-wide core program outcome
indicators. ChildFund organizes its work with infants, children, and youth in three life stages: Healthy and
Secure Infants and Young Children (0-5 years old); Educated and Confident Children (6-14 years old);
and Skilled and Involved Youth (15-24 years old). For children 0-5 years of age, ChildFund focuses on
maternal, neonatal and child health, nutrition, and early childhood development. For children 6-14 years
of age, ChildFund focuses on confidence and basic education. For youth 15-24 years of age, ChildFund
focuses youth leadership, social engagement, and livelihood opportunities.
 Life Stage: 1, 2, and 3
 Methodology: LQAS Household Surveys of mothers of children under 5, children ages 6-14, and youth
ages 15-24; qualitative document review; focus group discussions; and key informant interviews.
 The report highlights the voice of local implementing partners, mothers of infants and young children,
children, and youth living in communities where ChildFund implements programming.
 The report recommends that, among other things, ChildFund Ethiopia’s future interventions should place
greater emphasis on technical trainings and capacity assessments of community stakeholders and local
staff.
_____________________________________________________________________
13. End off Project Evaluation: Strengthening the House of Nanny Project – Kendu Bay “Tego Od Dayo.” (2013).
ChildFund International.
 Strengthening the House of Nanny
 2010 – 2013; Rachuonyo North District, Kenya.
 This was a 3-year project implemented in partnership with four youth groups. The project primarily
worked to provide grandmothers of Orphaned and Vulnerable Children with economic empowerment
opportunities. It also worked extensively with youth through village savings and loan scheme trainings
and management opportunities, project management training, and sensitization sessions on Orphans and
Vulnerable Children.
 Methodology: Mixed-method: Quantitative household questionnaires comprising mainly of close-ended
questions, utilizing LQAS sampling; qualitative methods included interviews, focus group discussions,
and case studies. The assessment also included a participatory research element.
 This report highlights the voice of youth as well as orphaned and vulnerable children and their
caregivers.
 The report recommends that the project expand its use of community sensitization and incomegenerating activities in the future.
_____________________________________________________________________
14. Enhancing Community-based Care and Support Systems for Children and Youth Living with HIV/AIDS:
Findings from Final Evaluation – Kenya, Uganda, and Zambia. (2009). Australian Partnerships with African
Communities.
 Enhancing Community-based Care and Support Systems for Children and Youth Living with HIV/AIDS
Program
5






2004-2009; Kenya, Uganda, and Zambia
This program aimed to meet the psychosocial needs of HIV affected orphans and other vulnerable
children and youth are adequately met within their own communities by July 2009 in three target
districts in Kenya, three target districts in Uganda and two target districts in Zambia. The program
worked extensively with youth and local community-based organizations in areas relating to
psychosocial support, school-based support, economic strengthening, social mobilization, and policy
engagement.
Life Stage: 3
Qualitative evaluation methodology. Data collection methods included desk review, semi-structured
questionnaires, and interviews based of purposeful sampling.
This report highlights the voice of local partners, children, and youth.
The report outlines future opportunities for replication and capacity development.
____________________________________________________________________
15. Enhancing Community-based Care and Support Systems for Children and Youth Living with HIV/AIDS:
Final Evaluation Survey Report (2009). Australian Partnerships with African Communities.
 Enhancing Community-based Care and Support Systems for Children and Youth Living with HIV/AIDS
Program
 2004-2009; Kenya, Uganda, and Zambia
 This program aimed to meet the psychosocial needs of HIV affected orphans and other vulnerable
children and youth are adequately met within their own communities by July 2009 in three target
districts in Kenya, three target districts in Uganda and two target districts in Zambia. The program
worked extensively with youth and local community-based organizations in areas relating to
psychosocial support, school-based support, economic strengthening, social mobilization, and policy
engagement.
 Life Stage: 3
 Methodology: Household survey and questionnaires using random sampling of a pre-defined HIVaffected target population.
 The report recommends that ChildFund/AusAID should consider documenting the key success factors
that underpin the positive changes in child/youth wellbeing reported here, and using this to influence
partner government policies in relation to practical measures to support vulnerable children/youth.
___________________________________________________________________
16. Strengthening Community Safety Nets Project: Best Practices Report Documentation Report. (2011).
 Strengthening Community Safety Nets
 2008-2011; 5 sub-cities of Addis Ababa. Ethiopia
 The goal of this project was to promote healthy child development for 50,000 children and assist 8500
primary and secondary caregivers in Addis Ababa and Oromia Region through comprehensive family
centered and child focused care and support services. Project activities focused on: enhancing the access
to family-centered, child-focused care and support services; increasing coordination, collaboration, and
referrals among community actors, NGOs, and government stakeholders; and improving service quality
and coverage through data collection and program monitoring systems.
 Life Stage: 1, 2, and 3
 Methodology: This assessment used a cross-sectional design with qualitative methods: focus group
discussions, key informant interviews, and case studies.
 This report highlights the voice of community-level stakeholders and youth project participants.
_____________________________________________________________________
17. Implementing Standards-based Quality Improvement Processes at the Community Level for Orphans and
Vulnerable Children: The Strengthening Community Safety Nets Project, Ethiopia. (2011). University
Research Co., LLC.
 Strengthening Community Safety Nets
 2008-2011; 5 sub-cities of Addis Ababa. Ethiopia
 The goal of this project was to promote healthy child development for 50,000 children and assist 8500
6
primary and secondary caregivers in Addis Ababa and Oromia Region through comprehensive family
centered and child focused care and support services. Project activities focused on: enhancing the access
to family-centered, child-focused care and support services; increasing coordination, collaboration, and
referrals among community actors, NGOs, and government stakeholders; and improving service quality
and coverage through data collection and program monitoring systems.
 Life Stages: 1, 2, and 3
 Methodology: Standards-based Qualitative Inquiry (QI).
 QI assessments looked at the degree to which services delivered to vulnerable children were meeting
standards;
identified
problems;
and
recommended
changes.
_____________________________________________________________________
18. Torrez, R.L. (2013). Evaluation: Community-based Maternal, Neonatal, and Child Health Innovation in the
Context of the National Health System Decentralization in Francisco Morazan Sur, Honduras.
 Community-based Maternal, Neonatal, and Child Health Innovation in the Context of the National Health
System Decentralization in Francisco Morazan Sur, Honduras
 2009 - 2013; Francisco Morazan Sur, Honduras
 The goal of this Child Survival Project was to decrease maternal, neonatal, infant and under-five child
mortality in the project area to levels established by the Government of Honduras (GOH). Project
activities focused on strengthening facility-based maternal and child health services, improving quality
and demand; systemizing a model of maternal, neonatal, and child health and nutrition (MNCHN)
services, improving equity and quality; and promoting improved CB MNCHN services, standards and
norms within the national decentralization strategy.
 Life Stage: 1
 Methodology: Mixed-methods approach using both quantitative and qualitative techniques. Methods
included: review of secondary data, key informant interviews, group interviews, observations and a
participatory analysis workshop.
 The report recommends that ChildFund Honduras assist the Ministry of Health and other project
partners in the design and initial implementation of a sustainability plan.
_____________________________________________________________________
19. Nutrition Support Project for Children Aged 0-5 Years and Expectant Mothers In Kenya, Horn of Africa.
(2013). Viconsult Associates.
 2011 – 2012; Kenya
 This project aimed to ensure that the children’s right to survival, development and protection were
fulfilled during the humanitarian crisis occasioned by the last drought experienced in the Horn of Africa
region between the years 2010 and 2012. Project activities focused on the provision of micro-nutrients to
expectant mothers, infants and young children, and water, sanitation, and hygiene-related activities.
 Life Stage: 1, 2, and 3
 Methodology: Qualitative evaluation using purposive, non-probability sampling. Data collection methods
included: key informant interviews, focus group discussions, progress reports, documents, literature
review and observation.
 The report recommends that future projects providing participating communities with a structured way
of utilizing the existing informal early warning systems at the community level and providing training on
alternative livelihood activities.
________________________________________________________________________
20. Petrova, V., and Lee, B. (2013). Contributing to Early Childhood Development in Ecuador: ChildFund in the
Landscape of National Early Childhood Development.
 ChildFund Ecuador Early Childhood Development Program
 c. 1990 – Present; Carchi Program Area, Ecuador.
 This program focuses on empowering caregivers to provide quality early childhood development
stimulation for infants and young children and helping community stakeholders to enhance or establish
local child protection structures.
 Life Stage: 1
 Methodology: Qualitative Process Tracing
7


This report highlights the voice of participating mothers and community-level stakeholders.
Recommended changes to programming include gender training and tailoring parenting workshops to
men in Ecuador.
8
In Addition:
Listed below are good evaluations that did not fit the final selection criteria, primarily due to being outdated:





Bernard Van Leer ‘The Future Will be Better’ – Honduras, 2004
Samburu Summative Evaluation – Kenya, 2005
ECCI Multicountry Initiative – 2008
PROTECT Project: Final Evaluation – Gambia, 2013 (the Methodology was missing for this one; the
document stated it was attached as an annex, but the annex was missing from the document we have on
file).
ChildFund Keystone Report (I am unfamiliar with the content of this report and was unsure if you want
to post this to the website – if you do, I would be happy to summarize it).
Listed below are documents that fit the initial criteria (with the exception of a handful in Spanish and French),
but are not flagged for use because the quality was poorer than the ones that are summarized:
















ChildFund Zambia FPIP II Evaluation
ChildFund Ethiopia Final Evaluation_Emergency Response, 2012
ChildFund Ethiopia_Youth Livelihood Security Project, 2012
ChildFund Ethiopia Midterm_Child Protection and GBV Project, 2011
ChildFund Indonesia REACH Informal Interviews, 2013
ChildFund Sri Lanka_ Listening to the Voices of Children, 2013
ChildFund Guatemala, Honduras, and Mexico ECD Program Evaluations (in Spanish). c.2004
Senegal GbV Research Report Series (4; 2013): Etude Sur…, Etude Talibes…, Impact VgB…, Rapport
VGB (The reports are all in French, but I recall Cat speaking well of their quality).
Angola_Olonjuli Report(s), 2011 (short – probably not great candidates)
Honduras Child Development Program Evaluation, n.d.
ChildFund Keystone Final Report, 2013
Dominica_Strengthening Programs in Support of ECD, 2002
SCSN CCF Canada Evaluation Report, c.2011
ChidFund Kenya_Weaving the Safety Net Midterm, 2008
Honduras Cost Study and Operations Research Reports, 2013 (in Spanish).
ChildFund India_ IDP Final Evaluation Report
Baselines:
 ChildFund Kenya_Assuring the Essentials
 Kismu Baseline Survey Report
 Uganda Child Protection Research Brief
9
Download