Terms of Reference
2011 Emergency Programme Evaluation - Ethiopia
Introduction:
Concern's (www.concern.net) mission is to help people who are living in extreme poverty achieve
major improvements in their lives, improvements that last and spread without ongoing support from
us. To achieve this mission, Concern engages in long term development work, responds to
emergency situations, and seeks to address the root cause of poverty through our work with
advocacy and development education.
In 2011, Concern responded to the drought and food crisis in Ethiopia with the financial support of
many donors and now seeks an external evaluation to evaluate Concern Worldwide’ response
1. Background
The Famine Early Warning Systems Network (FEWSNET) has reported that the eastern Horn of
Africa experienced two consecutive seasons of significantly below-average rainfall, resulting in one of
the worst droughts in 60 years. As of August 2011, a total of 4.8 million people in Ethiopia were in
need of assistance. In Ethiopia, some food security improvements are expected beginning in October
until December based on the likelihood of declining food prices, enhanced humanitarian response,
and expected recovery of the range resources arising from a forecasted normal short rains
performance.
The Revised Humanitarian Requirements Document was launched by the Government of Ethiopia on
11 July 2011. It calls for an additional USD 398.4 million in humanitarian funding to meet food and
non-food needs in Ethiopia between July and December 2011. Food security is unlikely to improve
significantly over the coming months and will deteriorate further in some areas. The revised
beneficiary caseload represents a 47% increase since April 2011, with the largest regional increases
coming from Oromia – an increase of 1.2 million people, or 178% more beneficiaries than in April.
Concern Worldwide in Ethiopia has been implementing programmes in Ethiopia since 1973 and has
been responding to the current Horn of Africa Drought since March 2011. It should be noted that the
current crisis follows a trend of more frequent peaks of acute malnutrition in what is a chronic food
security crisis.
The main components of the humanitarian response being implemented by Concern Worldwide in
Ethiopia are as follows:
1. Emergency nutrition responses following the Community Management of Acute Malnutrition
(CMAM) approach. In some cases these nutrition projects are supported by small-scale Water
Sanitation and Hygiene Promotion or livelihood support activities.
2. Provision of safe water supplies to drought affected people in four Woredas of Oromia Region.
3. Provision of veterinary drugs and animal feed for reproductive animals (cows, sheep, goats and
camels) in four Woredas of Oromia Region.
The emergency response has been implemented in 15 Woredas of Oromia, Amhara and SNNP
Regions of Ethiopia in areas identified with the Government of Ethiopia to be priority areas for
intervention. The interventions since March 2011 are outlined in the table below:
1
Woreda
Dello Mena
Zone
Bale
Region
Oromia
Meda
Welabu
Bale
Oromia
Hidabo
Abote
Wuchale
North
Shewa
North
Shewa
South
Wollo
South
Gonder
North Wollo
South
Wollo
Wolayita
Amhara
Delanta
Ebinat
Bugna
Dessie Zuria
Diguna
Fango
Kindo
Didaye
Kindo
Koysha
Damot Gale
Damot
Weydie
Dillo
Dhas
Oromia







Emergency Response
Emergency nutrition
Provision of safe water supplies
Water Sanitation and Hygiene Promotion
Emergency nutrition
Provision of safe water supplies
Water Sanitation and Hygiene Promotion
Emergency nutrition
Oromia

Emergency nutrition
Amhara



Emergency nutrition
Livelihood support (provision of seeds)
Emergency nutrition
SNNPR





Emergency nutrition
Water Sanitation and Hygiene Promotion
Emergency nutrition
Water Sanitation and Hygiene Promotion
Emergency nutrition
Wolayita
SNNPR

Emergency nutrition
Wolayita
SNNPR

Emergency nutrition
Wolayita
Wolayita
SNNPR
SNNPR


Emergency nutrition
Emergency nutrition
Borena
Oromia


Borena
Oromia
Provision of safe water supplies
Provision of veterinary drugs and animal feed for
reproductive animals
Water Sanitation and Hygiene Promotion
Provision of safe water supplies
Provision of veterinary drugs and animal feed for
reproductive animals
Water Sanitation and Hygiene Promotion
Amhara
Amhara




The emergency phase of the response is being implemented between 1 March – 31 December 2011
and the recovery phase is planned to be implemented between 1 January 2012 and 30 June 2013.
The main donors of the emergency response are Irish Aid, the United Nations Humanitarian Relief
Fund managed by the Office for the Coordination of Humanitarian Affairs (OCHA), Goal as SubGrants to USAID/OFDA, the Disasters Emergency Committee, the Directorate General for
Humanitarian Aid and Civil Protection (ECHO), Concern Worldwide general donations, including the
Chief Executive Officer Emergency Fund and Jersey Overseas Aid; and through various donations
from IMPACT (Union), the Irish League of Credit Unions (ILCU), Jewish Relief Services and Vegfam
(pending).
2
A map of the emergency programme location is indicated below.
Bugna
Ebinat
Delanta
Dessie Zuria
North Shewa
Hidabo Abote
Wuchale
Wolayita
Diguna Fango
Kindo Didaye
Kindo Koysha
Damot Gale
Damot Weydie
Dello Mena
Meda Welabu
Dillo
Dhas
3
2. Purpose of the Evaluation
To evaluate Concern’s emergency response programme to date with particular emphasis on
appropriateness, timeliness, efficiency and effectiveness of the interventions carried out. This
evaluation will be a technical evaluation to be conducted with specific reference to the operating
environment in and context of Ethiopia and intended to provide supportive and constructive feedback
to the country team. The outcome of the evaluation intends to inform the recovery phase of the
emergency programme planned in early 2012.
3. Specific Objectives
To evaluate the emergency response programme in relation to the specific areas listed below:
1. The process and timeliness:
 Did we choose the right response in the right areas in the right way and in a timely manner?
 Is the project consistent with the policy and strategic direction of the government of Ethiopia?
 Are the activities and the outputs as reflected in the Project Proposal consistent with the
overall goal and objectives?
 What are the recommendations for targeting for the recovery phase of the response?
2. The appropriateness, quality, effectiveness, efficiency, proportionality and impact of the response
 Did the response achieve to the humanitarian needs and what it set out to do?
 Were external standards met? (the Sphere, Red Cross Code of Conduct, national guidelines
and protocols)?
 Were internal standards met with particular reference to adherence to the Programme
Participant Protection Policy (P4), Concern Worldwide Code of Conduct, Humanitarian
Accountability Project (HAP), etc.
 Was the response appropriate and cost effective?
 Was the coverage of the emergency response in proportion to the needs of affected people
(especially women and children, etc.), and to other similar emergency responses?
 Were crosscutting issues such as gender and equality, HIV and AIDS and capacity building
adequately considered in programme response?
 Were the needs assessments, monitoring, evaluation systems and indicators used for this
purpose appropriate?
 To what extent were the objectives/ outcomes of the project as reflected in the project
proposal achieved? Were there any unexpected outcomes? Were the activities sufficient to
achieve the objectives / outputs?
3. The level of connectedness and coherence of the response.
 What are the recommendations for longer term recovery activities?
 What are the recommendations to ensure that the response reduces future vulnerabilities?
4. Identify lessons to be learned to inform the future emergency responses of Concern. The
evaluation should identify examples of best practice in what worked well and areas for
strengthening. The extent to which lessons or recommendations from previous emergencies
(especially in 2008/ 2009) were incorporated into this response.
4. Evaluation Team
The evaluation team will comprise two evaluators as follows:
 Team leader (International)
 One Ethiopian National Evaluator. Separate terms on references on roles and responsibility
will be developed and shared with international and national consultants for clarity.
5. Timeframe of the Evaluation
It is envisaged that the evaluation will take a maximum of 25 working days including report writing.
This is to ensure that all project locations are visited and that there is sufficient time to meet and
interview all key informants. The timeframe is at the discretion of the evaluation team, however the
following breakdown is advised:
 3 days background reading, methodology development and interviews with key informants
external to Ethiopia;
4




10 days field work and travel. The travel may include few woredas which can be selected on
sample basis;
5 days report writing;
1 day feedback sessions in country, at head office in Dublin and in Concern UK;
1 day consolidating feedback from Concern staff and finalising the report.
6. The Scope of Work will include







Review of relevant secondary data – e.g. proposals, donor reports, case studies, visit reports,
end of assignment reports and the recently applied nutrition databases (Woreda and Central
levels).
Meet and/or interview key staff in Concern Worldwide at country level, Concern UK and head
office in Dublin (some of this work can be completed from the evaluators work base).
Use of appropriate tools and interview/focus groups discussions. The process should be
participatory to the extent possible and should involve all stakeholders in the project.
Visit the areas where the emergency responses were implemented, using appropriate tools to
interview programme participants and other key stakeholders, including partners and project
staff; the views of non- beneficiaries should also be included
Debriefing and presentation to key staff on key findings and recommendations prior to
departure from Ethiopia
Produce and solicit feedback on the draft report from relevant Concern staff in Dublin and
Ethiopia (Regional Director, Desk Officer, Country Director, Assistant Country Director
Programmes in charge of emergencies, Emergency Coordinator and Area Coordinators).
Production of the final report from the analysis. The report should include a clear and concise
Executive Summary of no more than 3 pages.
7. Lines of Communication and Reporting


The evaluators will report directly to the Regional Director for the overall evaluation.
The evaluators will report to the Country Director in country and work with the Assistant
Country Director Programmes in charge of emergencies.
8. Output
A report, which should not exceed 20 pages, and following the proposed structure below:
 Executive summary
 Introduction: directly relevant to the report’s analysis and conclusions.
 Methodology.
 Analysis and main findings: supported by referenced data and sources of information.
 Conclusions and recommendations: focussing also on recommendations for the recovery
phase & future emergency responses and details as to how they might be implemented and
guidance on the process by which findings will be shared and discussed with all stakeholders.
 Appendices: the final version of the terms of reference, a list of informants, evaluation team
work schedule and other technical details.
9. Logistics
Concern Ethiopia will make the necessary logistical arrangements (international and in-country travel,,
visas, accommodation, etc.) for the duration of the evaluation.
10: How to apply:
It is envisaged that this evaluation will be completed in February/March. To be considered for this
piece of work, please send a CV, a cover letter outlining how your skills and experience qualifies your
for this position along with a 2 page (maximum) evaluation outline/methodology and budget to
Bríd.Barrett@concern.net by 5pm February 6th, 2012.
5