Terms of Reference Independent evaluation of CARE’s response to the 2011-2012 Sahel humanitarian crisis Draft 11 December 2012 Background The Sahel region of West Africa has experienced a severe food and nutrition crisis for the third time in seven years. Irregular rains, limited crops, high food prices and a drop in migrant worker’s remittances due to the conflicts in Libya, Nigeria and Mali have put people’s resilience to the test. The failed rains of the last year left many farmers and pastoralists without their main income and source of food: crops have withered, livestock died of thirst and hunger. As a consequence, many people had to revert to measures such as eating the seeds spared for planting, selling emaciated livestock for low prices, using saved assets to buy food that has become more expensive or taking their children out of school to help earning an income. In August 2012, the UN estimated that some 18.7million people were in need of humanitarian assistance in nine countries, with more than one million children at risk of starvation and another three million are facing malnutrition in the Sahel1. As food sources run out women turn to gathering and selling firewood as an alternative income and walking long distances alone puts them at risk of violent attacks. The conflict in Mali has displaced more than 440,000 people and created a severe humanitarian crisis in the northern regions of the country. For security reasons humanitarian organizations such as CARE had to suspend operations in the north of the country, leaving thousands of people without assistance. Almost 70,000 Malians fled to neighboring Niger, putting more stress on already vulnerable households and host communities. Even in years which are not overshadowed by drought, the countries of the Sahel have some of the highest rates of food insecurity and malnutrition. One child in five dies before it reaches the age of five years and 30 percent of these deaths are due to the lack of food and water.² Countries like Niger, Chad and Mali are some of the poorest in this world, ranking lowest in the Human Development Index published yearly by the United Nations.³ CARE’s response CARE has been running emergency operations in Chad, Mali, and Niger, reaching over 752,000 affected people2 with humanitarian assistance supported by long-term strategies that are aimed to strengthen their livelihood in the longer term. Chad In Chad, where more than 3.6 million people are affected, CARE has distributed food such as grains, beans and oil to more than 212,000 people. This includes almost 29,000 children under age 5 who received special nutritional supplements – such as a peanut butter-based paste or a blend of corn and soy – to compensate for the loss of vitamins, proteins and other important micronutrients. More than 7,000 nursing mothers have also received special supplementary food to ensure adequate nutrition for themselves and their children. CARE has also provided crisis-affected people in Chad with access to safe drinking water and adequate sanitation. We have repaired broken water pumps and distributed jerry cans for the collection and purification of water. We have provided 2,000 families seeds and tools so they are better equipped for the planting season and the upcoming harvest. As a further aid to mothers, CARE has begun cash transfers enabling them to buy what they need at local markets – an efficient system that also supports the local economy. Parallel to our emergency response, 1 UN OCHA, Special Humanitarian Bulletin, Sahel Crisis, August 13, 2012. The nine countries are Niger, Mali, Chad, Burkina Faso, Mauritania, Gambia, Senegal, Nigeria and Cameroon 2 CARE International Sahel Crisis Overview. September 2012 we are rolling out programs that accelerate families’ recovery from the food crisis and support their livelihoods in the long term. Mali In Mali, where 4.6 million people are in need of assistance, CARE is providing emergency food supplies to 250,000 women and men. In the southern regions of the country, CARE’s distributions of seeds for the next harvest are under way. At the same time, we are seeking access to the northern areas where conflict has forced hundreds of thousands of people to flee their homes. CARE is assisting displaced families arriving in Mopti, central Mali, with food and essential household and hygiene items, as many of them have had to leave all their possessions behind. Plans for ongoing assistance include the provision of psychological and medical assistance to survivors of gender-based violence. Due to the conflict, CARE and other humanitarian organizations have had to suspend operations in the north of the country. If and when a political agreement allows displaced people to return home, CARE is prepared to provide support to the most vulnerable returnees, such as assisting with transportation, providing food and relief items and continued financial support as they seek to resume their livelihoods. Niger In Niger, where 6.4 million people are affected, CARE works in 14 departments of five regions. We support temporary paid work, enabling families to buy food in the local markets and completing needed community projects. As immediate assistance to families in need, we provided cash support, and we are now distributing food such as grains, oil, beans and nutritional supplements in the most affected areas. In certain regions, we continue to provide cash support targeted at families with nutritional needs. We have provided families with agricultural tools and higher-yield seeds ahead of the planting season, and we support pastoralist populations by providing animal fodder and by buying some of their excess livestock and distributing the meat. CARE has also supported community better recover from the food crisis as well as develops further resilience through voucher for assets reconstitution, food and fodder security stocks, community based malnutrition prevention and management and support to early warning structures at community and communal levels. Simultaneously, CARE is assisting refugees have who fled the conflict in Mali, and workers from Niger who have had to return from conflict-ridden Libya and Nigeria. Our efforts targeting refugees include food and basic relief items, latrines and showers, hygiene promotion, and the rehabilitation of wells and water pumps. Purpose CARE’s accountability framework and learning policy for humanitarian action commits CARE to undertaking an independent, external evaluation of major Type 2 humanitarian response in order to be able to account for our interventions to key stakeholders (in particular beneficiaries), to ensure we solicit external independent feedback and validation on our performance and to ensure learning at all levels of the organization. CARE’s response to the crisis in the Sahel region in Niger, Mali and Chad represents a significant humanitarian response with national, regional and organisation complexities. The three countries teams have completed After Action Reviews of the 2012 emergency interventions and formulated important recommendations for potential interventions for 2013 as well as recommendations for CARE’s emergency responses generally. The After Action Reviews are internal reflections on how CARE met its commitments against the Humanitarian Accountability Framework and our own review of lessons learned. The After Action Reviews, as internal reflection processes, don’t however provide an independent evaluation of CARE’s performance in terms of the effectiveness of our humanitarian response relative to our stated strategies, which is a complementary element of CARE’s learning and evaluation policy. Further, the After Action Reviews focus at a national level, and CARE would like to use the opportunity of a regional evaluation to be able to identify the high level, strategic lessons and recommendations which apply at a regional and global level in addition to the national level learning. As such, in keeping with CARE’s learning and evaluation policy, in order to ensure accountability and learning from this crisis, it is proposed to conduct an external evaluation of the response. The evaluation will provide important insights into the effectiveness of CARE’s response to the crisis in the Sahel, including generating recommendations for how CARE’s work in the region can best respond to similar crises in the future and how we can most effectively contribute to improving resilience of chronically food insecure communities. Given CARE’s strong focus on women’s empowerment and gender equality programming, the evaluation will have this as a particular focus. CARE Mali, Niger and Chad in collaboration with the relevant CMPs, CEG and its operational and strategic partners are well positioned to propose innovative approaches for an efficient and sustainable enhancement of the resilience capacity of CARE’s impact groups. This assumes however that lessons learnt are documented through evaluations and the AARs such that evidence from the interventions by CARE and others are fully analyzed and taken into account. The evaluation should review, validate and expand upon the conclusions of the After Action Reviews. The evaluation will precede a regional reflections workshop where senior decision makers will come together to extrapolate key strategic implications for CARE’s future work in response to similar crises, including ways we can support effective resilience programming in the region. This reflections workshop will reference and advance key learning from the reflections process conducted in the Horn of Africa in response to food crisis in that region. The purpose of this evaluation is to assess, analyze and document: 1. The quality and effectiveness of CARE’s emergency response in Chad, Mali, Niger during the 2011-2012 humanitarian crisis using relevant international programming standards including those outlined in CARE’s Humanitarian Accountability Framework (HAF) (eg Sphere) and relevant OECD/DAC criteria to measure the effectiveness, efficiency, relevance and coverage of CARE’s programs. The evaluation should highlight examples of good practice and critical gaps coupled with recommendations for improving emergency preparedness and response in future at both a country, regional and global (institutional level). The evaluation should reference and validate or provide an alternative viewpoint to the conclusions of the After Action Reviews as appropriate, in keeping with the independent nature of this evaluation. 2. The evaluation should focus in particular on the appropriateness and effectiveness of CARE’s emergency response strategies in meeting CARE’s stated goals of supporting women’s empowerment and gender equity programming, considering the active role of women in responding to food security and mitigating its impact on households and community at large as well as women’s vulnerable situation when the crisis erupts. 3. With reference relevant benchmarks and standards, particularly with regard to Sphere minimum standards assess the appropriateness, effectiveness, efficiency and relevance of CARE’s food security activities as a core sector intervention. If possible, identify where pre-crisis programs contributed to mitigating the impacts of the crisis. Where successful, what were the critical success factors and what recommendations can be made to prevent or mitigate the impacts of similar crisis in the future? 4. Assess the extent to which CARE achieved the stated goals and objectives and targets established in CARE’s own emergency response strategies and project documents including both fundraising and programming goals, and where possible compare CARE’s performance to evaluations available for other agencies. 5. The effectiveness and coherence of the coordination between key stakeholders, including internally (CARE Country Offices, WARMU, CARE Canada, CEG, CMPs), sub regional coordination between the 3 country offices, host governments, donors, UN agencies, NGOs and affected community members themselves and the implications of this for the effectiveness of the response. 6. Evaluate the extent to which CARE utilized lessons-learned relevant to drought cycle management, disaster risk reduction programming to mount a relevant and appropriate response and how likely this is to increase the resilience of vulnerable populations. 7. Identify any opportunities missed or threats to CARE’s programming and make recommendations for possible future regional programming across the sub region where CARE could contribute positively to strengthened resilience and food security in Niger, Chad and Mali. Specific Issues for Consideration The evaluation should ensure the dynamics of conflict in the region are considered, in particular in terms of whether CARE’s programs incorporated conflict sensitive approaches. Issues related to any specific CARE impact groups may be highlighted (eg pastoralists and mobile groups that CARE has long term programming with). Consider the effectiveness of CARE’s programs in responding to the complexities and emergency needs associated with the crisis of internal displacement and the needs of IDPs. Methodology 1. Methodology will be developed by the consultant and based on a combination of: a desk review of relevant literature (including after action reviews, emergency response strategies, evaluations of other agencies), field observations, other appropriate evaluation and survey methods and key informant interviews and/or focus group discussions, with staff in the field, HQs/regional and key external stakeholders (host government officials, UN, NGOs, donor representatives, members of the affected population and host communities). The evaluation team will take all reasonable steps to ensure that the security and dignity of affected populations is not compromised and that disruption to on-going operations is minimized. The methodology proposed will reflect the central focus of the evaluation on gender equality programming and ensure the full participation of women and men involved and affected by CARE’s programs. 2. Confidentiality of information - all documents and data collected from interviews will be treated as confidential and used solely to facilitate analysis. Interviewees will not be quoted in the report without their express written permission. 3. Communication of results – the report will be supplemented whenever possible by presentation of preliminary findings and recommendations at the field visit to both provide immediate feedback to operations managers and give ample opportunities to validate findings. 4. Use of results –the results of this joint evaluation are intended to increase quality of programming and coherence both within CARE Country Offices in the region and at a global level. The findings of the evaluation will be placed in the public domain to promote improved quality through the wider humanitarian community consistent with CARE International’s Evaluation Policy. A management response will be prepared by stakeholders targeted by specific recommendations that will include plans of action wherever appropriate and focal points will be responsible for monitoring follow-up at a country and institutional level as appropriate. 5. Reflections exercise - The consultant will be invited to participate in the regional reflections exercise to be held after the independent evaluation has been conducted. The draft report must be finalized well in advance of the reflections workshop (to be held in March, dates to be confirmed), and the final report may be finalized after the reflections exercise in order to capture any additional feedback. Deliverables 1. An Inception report of no more than 10 pages produced within a week of starting the consultancy following an initial scoping study which consists of selected key informant interviews and review of relevant documents. The Inception Report would typically aim to describe the following: a. The consultants’ understanding of the objectives as per the TOR and a brief description of how they expect the outputs to be used by CARE; b. A summary desk review of key documents (e.g. reviews, evaluations, studies) which directly relate to this research, along with a brief description of how this study might draw on these and a list of other documents which are expected to be particularly critical; c. Methodology including key informants and stakeholder groups to be interviewed, data collection plan, triangulation strategy, approach to data analysis, and how the consultant aims to use perceptions as a validation tool; d. A matrix showing, for each line of questioning, the criteria proposed on which judgment will be based, and the anticipated sources of information; e. Draft outline for the report; f. A proposed timeline; g. Any recommended revisions to the ToR along with a brief justification; h. Specific areas where the consultant(s) expect support (e.g. initial communications with key informants, locating and forwarding documents, logistic support for field visits, etc.). 2. Conduct a debriefing for the Steering Committee on the main findings and recommendations. 3. A draft evaluation report of no more than 30 pages plus annexes, that must include a concise executive summary and summary of recommendations and as many annexes as are available. 4. The evaluation report itself should be approximately 30 pages in length, not including annexes, and include the following elements: Executive Summary (max 3 pages) Summary of recommendations (with recommendations also being embedded at appropriate places within the main body of the report so that their basis and supporting evidence is clear). Recommendations should be phrased so as to promote utilization by specific targeted stakeholders and/or stakeholder groups in CARE. Recommendations should be specific and provide pathways and suggested tools and approaches for achieving them wherever possible. Main body of the report structured to correspond to the objectives outlined above. Planned Timeframe Indicative number of days Date Activity January Consultant orientation, Initial document review, prelim interviews, inception report 4TL + 2TM January February Interviews/research completed, field visits, report drafted, debrief with the Steering Committee and ERWG, debriefing for the Steering Committee 20TL + 16TM March Participate in reflections workshop. Report finalized after feedback considered. 6TL + 2TM 4 + 2TM Deliverables Inception report Key findings and draft report Participation in reflections workshop Final report Management of the Evaluation Process The evaluation process will be guided by a steering committee of up to 8 selected senior staff representing the CARE membership, partners, field staff, and the CI secretariat, who have had substantive involvement with the Sahel humanitarian response. The committee will be co-chaired by the CI Head of Emergency Program Quality and a representative of the Regional Management Unit. The consultant will report to the Steering Committee through the Co-chairs. The specific tasks of the Steering Committee will be to: Provide inputs to help in finalizing the TOR; Provide appropriate support to facilitate the evaluation (data mining, identification of key informants, etc.); Select the consultant; Review and comment on the inception report; Participate in the debrief; Review the draft report prior to finalization; and Review the final report and determine appropriate follow up (including the drafting of a management response to recommendations in the report). Technical support will be provided by CARE’s Head of Emergency Program Quality and Head of Emergency Operations, REC ai and CI’s Emergency Monitoring, Evaluation and Accountability Coordinator Team Composition It is envisaged that the evaluation will be undertaken by a team of 2 consultants – 1 team leader responsible for overall management of the evaluation including reporting, and supported by an additional team member with specific expertise which complements that of the team leader who will support research and field elements of the evaluation. The team members should have significant experience in humanitarian programming. The following set of complementary expertise/backgrounds should be included in the team: 1) a food security 2) a health/nutrition 3) gender 4) resilience 5) monitoring and evaluation expertise. CARE Country Office staff that have not been closely involved in the response may be assigned to assist the team for field visits. The evaluation framework is based on the concepts of independence and transparency. Overall responsibility for drafting and editing of each version of report lies with the Consultant Team Leader. The consultants must speak French and English. The report should be delivered in English. Fees and services A daily fee will be negotiated with the consultants upon selection and before signing of the contract. CARE will provide all expenses related to the evaluation including international flights, in-country travel, accommodation and food. Exact allowance will be detailed in the contract. The consultant is responsible for personal insurance during the evaluation. The consultant will also provide any necessary materials (including laptops) required for the evaluation.