Terms of Reference for Mid-Term Evaluation of Emergency Appeal

advertisement
Terms of Reference for Mid-Term Evaluation
of Emergency Appeal Operation
Bangladesh: Floods 2014
MDRBD014
1. Summary
1.1. Purpose: This Mid-Term Evaluation will assess the on-going IFRC & Bangladesh Red Crescent Society
(BDRCS) Floods 2014 Emergency Appeal operation and will recommend relevant follow up actions
appropriate to Bangladesh context. The review will focus on two phases:

To review the relief phase of the operation in the area of planning, beneficiary targeting,
coordination, and monitoring according to global standards1;

To review the operational strategy of the early recovery phase and the review of progress against
the revised EA ;
1.2. Commissioner: This Mid-Term Evaluation has been commissioned by the IFRC Asia Pacific Disaster
Management Unit (APDMU)
1.3. Audiences: This main audience of the evaluation will be BDRCS, IFRC Bangladesh delegation, APDMU,
SARD and partner national societies.
1.4. Duration of evaluation: approximately 21 days (with approx. 7 days in the field). After initial desktop
review and discussions at NHQ, visits to areas where both the emergency and the early recovery
activities have been carried out. The field work is to be followed by 7days to allow the evaluator team to
discuss findings and conclusions between field missions and to prepare a draft report before leaving the
country.
1.5. Timeframe: Tentatively starting from 1st week of March, 2015.
1.6. Location of evaluation: Bangladesh (Dhaka and operation areas: Bogra and Sirajganj districts. Relief
phase was implemented in all these four districts but recovery will be commissioned in only two of them.
1.7. Report to: The consultant will directly report to the Program Coordinator.
2. Background
Since mid-August, Bangladesh has seen several rounds of flooding. Heavy rains in the main river basins and upstream
catchments of India, along with continuous rainfall in northwest and north-eastern parts of Bangladesh have caused a
continuously worsening flooding situation in low-lying districts, particularly those clustered around the north-west
(Lalmonirhat, Kurigram, Nilphamari, Rangpur, Gaibandha, Bogra, Serajganj, Jamalpur, Sherpur). This was followed by
heavy rain induced flooding in Sunamganj, Sylhet and Netrokona in the North-east of the country and, later on, in
districts in the centre of the country (Munshiganj, Tangail, Faridpur, Manikganj, Rajbari). Since 19th of September, a
new spell of flooding has hit several districts in the country affecting 400,000 more people and increasing the sufferings
of the people already affected by floods in August. Flash floods triggered by heavy rain and water from upstream hill
areas across the border inundated vast areas in Bogra, Kurigram, Jamalpur, Netrokona, Gaibandha, Lalmonirhat,
Naogaon, Brahmanbaria and Mymensing leaving hundreds of thousands marooned, damaging houses, roads and
embankments. Farmers who had replanted Aman paddy after the water started receding have lost their crops for the
second time as more than 10,000 acres of crops were inundated.
As per government reports, more than half a million families (2.8 million people) are affected, with 57,000
families (275,000 people) displaced. The affected include more than 33,000 families (160,000 people) whose
1
Standards included: SPHERE, HAP, ALNAP, People in Aid
homes have been totally inundated or destroyed. An additional 235,000 houses are reported damaged. The
situation has been described as the worst since the so called ‘mega floods’ of 2007. 2
Districts in the north-west of the country have been most heavily impacted which triggered a Joint Needs
Assessment (JNA)3 covering 9 districts by members of the Humanitarian Coordination Task Team (HCTT) in
which IFRC and BDRCS actively participated. The JNA reported food, sanitation and livelihoods as the most
imminent needs in the early stage across the districts. However, after the receding of flood waters, the the recovery
needs are high. Food stocks of the households were damaged by flood waters and long term food security is a
major issue due to the impact on agriculture crop and loss of livelihoods opportunities. A large number of hand
tube-wells have been contaminated by flood waters creating a risk for water-borne diseases. Many latrines have
been washed away and inadequate sanitation facilities coupled with the lack of proper knowledge of hygiene
practice increases the vulnerability of the affected communities. Repairing of damaged houses is also a major
concern for most of the assessed unions.
In view of the needs, BDRCS has gone for a comprehensive response plan combining relief activities and early
recovery components. An emergency appeal was launched on a preliminary basis for CHF 2,206,628 to support
19,470 flood-affected families (97,350 people) over 12 months, focusing on food and relief item distributions;
health; water and sanitation, and hygiene promotion (WASH); emergency and recovery shelter assistance;
National Society capacity building; and disaster preparedness and risk reduction. The BDRCS, utilising its staff
and volunteers across the affected areas, has been actively engaged in response immediately after onset of disaster
and has continued with the emergency response for 3 months.
On completion of the relief phase, revisions are being made to the original Emergency Appeal Plan of Action
based on the recovery needs of the time and the available funding. The activities under the recovery phase is due
to commence in early January. The mid-term evaluation is intended to have a look at the status of the ongoing
operation and how it fits with the relief phase, review its progress and challenges and identify best practices for
future operations of similar context
3. Evaluation Purpose & Scope
Purpose: This Mid-Term Evaluation will assess the on-going IFRC & BDRCS Floods 2014 Emergency Appeal
operation and to recommend relevant follow up actions appropriate to Bangladesh context. The review will focus
on two phases:
-
Relief phase: To review the area of assessment & planning, beneficiary targeting, coordination, and
monitoring according to global standards to fit it for future operations
-
Early recovery phase: To review the operational strategy of the early recovery phase, to identify
progress and achievements as per indicators, To identify and understand the obstacles, constraints and
challenges and practical recommendations
Scope: The evaluation will look at the appropriateness, relevance, timeliness, efficiency, effectiveness and
accountability of the actions carried out in relief phase and review the operational strategies in terms of targeting,
planning and monitoring mechanism.
2
http://www.lcgbangladesh.org/HCTT/JNA%20materials%20update/2014%20Flood%20Assessment/0809_NW_Flooding_JN
A_FinalFINAL.pdf
3
http://www.lcgbangladesh.org/HCTT/JNA%20materials%20update/2014%20Flood%20Assessment/0809_NW_Flooding_JN
A_FinalFINAL.pdf
Page 2
4. Evaluation Objectives and Key Questions
Specific objectives and key questions to be answered in this Mid-Term Evaluation are listed below.
(Please note that these are guiding questions and the consultant is not limited to those below.)
Relief Phase
1. Appropriateness & relevance:
a.
How was the actions relevant to the findings of JNA 1?
b.
How did the assessment(s) link to planning?
2. Timeliness, efficiency & effectiveness :
a. To what extent have internal systems, structures and mechanisms affected the management and timely and
cost-effectiveness of the service delivery?
b. Was the action done in a timely manner? Was there any delay in delivering assistance? If yes, why? How
could the delivery of programs or assistance have been improved and what lessons are to be learnt for
future operations?
c. Was the IFRC/BDRCS operational structure, internal systems and processes well geared to deliver timely,
efficient and effective disaster response in an equitable manner, proportionate to need? How effectively
were the IFRC global response tools used? How effective were the systems to mobilize resources –
financial, human resources, communications/media, logistics etc.? How adequate is the mobilization of
human resources?
d. What levels of beneficiary consultation were involved during different stages of planning, implementation
and monitoring stages?
e. What was the internal & external coordination in place in each level and did BDRCS & IFRC actively took
part in it? Did BDRCS & IFRC share information and gather feedback with other stakeholders in a timely,
transparent and organized manner?
3. Accountability
a. Were reports submitted and recommendations followed up in a timely manner to management and relevant
stakeholders, including donors?
b. Were the planning and implementation of the relief activities designed and completed according to global
standards?
c. Were beneficiary feedback mechanism in place? If it was in place, how effective it was?
Early Recovery Phase
1. Operational Strategy
a. Does the operational strategy meet the need of the beneficiaries?
Page 3
b. Is the operational strategy relevant and realistic to the situation on the ground and the capacity (including
resources) of BDRCS/ IFRC? What revisions need to be made to the Plan of Action as outlined in the
Emergency Appeal?
c. Was the Operational Strategy done in a collaborative manner, with adequate consultation between BDRCS
& IFRC?
d. How has the funding flow of the emergency appeal influenced the early recovery planning? Was the
funding mechanism timely and appropriate to design an early recovery plan?
2. Cash transfer programming(CTP)
a. Is the CTP designed in line with IFRC global CTP guidelines? How does the flexibility apply to
Bangladesh context and how effective they are?
b. Has the CTP SOP (draft) that is in place been adhered to by BDRCS? Does BDRCS at all levels have
same level of understanding on the SOP & guidelines and does they apply their knowledge to ensure CTP
is done in an accountable and effective manner?
3. Beneficiary Communications (BenComs)
a. What measures have been planned to engage the beneficiaries in the recovery phase? How realistic are
they considering the funding situation and the timeframe?
b. How have the lessons learned in Cyclone Mahasen regarding BenComs and Complaint Response
Mechanism (CRM) been incorporated in the Floods operation?
c. Should there be any differences in BenComs strategy for flood and cyclone prone regions of Bangladesh?
Applicable to both phases
1. Coordination
a. How timely and effective is the coordination system within the IFRC (IFRC Secretariat and NS actors)?
How well is the structure functioning for both relief and recovery? Were the roles, responsibilities and
expectations at each level clear (Geneva, Zone, and country)?
b. How effectively has the IFRC coordinated with external actors, particularly the UN (the cluster system),
the Government, the military and the international and national humanitarian community?
c. How effective was the national coordination structure during the initial phase of the flood?
2. Risk mitigation
a. What are the risks anticipated and are there common understanding between BDRCS, IFRC and other key
stakeholders? Taking a snapshot of the situation in Bangladesh, what are the most serious risks or
challenges facing the operation Are risk mitigation mechanism in place and how do they apply in both
phases?
b. What gaps or bottlenecks still remain? Are there plans in place to address these already or is this an area
that still needs to be addressed? How can they be avoided in the future?
Page 4
5. Evaluation Methodology & Process
An IFRC evaluation management team will oversee the evaluation and to ensure that it upholds the IFRC
Framework for Evaluations. The evaluation management team will consist of an External Consultant, PMER
Delegate and Manager, Humanitarian Response and Preparedness for Response(HR&PFR) of the IFRC
Bangladesh delegation, and Director, Response the BDRCS.
The evaluation will be managed according to the IFRC Framework for Evaluations .
The evaluation team will be composed of four people: One each from CRC and BDRCS and two from IFRC.
CRC: team leader, lead the evaluation team, ensure compliance of ToR., also responsible for drafting the Mid
Term Evaluation (MTE) report and writing the final report.
IFRC APDMU: ………..
IFRC SARD: …………..
IFRC Bangladesh Delegation: two team members (PMER Delegate and Manager HR&PFR) provide technical
input, develop and guide evaluation schedule.
BDRCS: team member, provide local knowledge and also responsible to facilitate field activities.
The specific evaluation methodology will be detailed in close consultation between the MTE Consultant and
the PMER Delegate as well as among the evaluation team, but will draw upon the following primary methods:
1. Desktop review of operation background documents, relevant organizational background and history,
including emergency appeal documents, and any relevant sources of secondary data, such exist surveys
from IFRC participants in the operation. And evaluation / lesson learnt reports from previous operation
2. Field visits/observations
3. Key informant interviews & Focus group discussions
4. Half day feedback session, after field session, to inform findings and gather final feedback from BDRCS,
IFRC & PNS
6. Evaluation Deliverables
The External Consultant will be responsible for the development of evaluation reports with recommendations. The
final output will be an evaluation report.
Draft report – A draft report, identifying key findings, conclusions, recommendations and lessons for the future
operation, will be submitted within a week of the team return from the field.
Final report – The final report will contain a short executive summary (no more than 1,000 words) and a main
body of the report (no more than 10,000 words) covering the background of the intervention evaluated, a
description of the evaluation methods and limitations, findings, conclusions, lessons learned, clear
recommendations. Recommendations should be specific and feasible. The report should also contain appropriate
appendices, including a copy of the ToR, cited resources or bibliography, a list of those interviewed, and any other
relevant materials. The final Mid-Term Evaluation report will be submitted one week after receipt of the
consolidated feedback from IFRC & BDRCS.
A Management response will be generated within two weeks by IFRC and BDRCS upon receive of the Final
report.
Page 5
Timeline:
The MTE is expected to be conducted in the first three weeks of March 2015 , which includes desktop studies,
draft report and in-country travel for interviews with stakeholders and field visits. Exact timeframe will be decided
in due course.
Distribution: The final report will be shared with NS, CD/office, in-country PNSs, SARD, APDMU, AP PMER
and other relevant stakeholders if appropriate. All of the outputs of the consultancy belong to the IFRC and
IFRC has a right to publish those outputs and make them publicly available. This does
not preclude publishing the working paper in other forums, provided that the IFRC is properly acknowledged.
Page 6
ANNEX 1
IFRC evaluation standards
The evaluators should take all reasonable steps to ensure that the evaluation is designed and conducted to respect
and protect the rights and welfare of the people and communities involved and to ensure that the evaluation is
technically accurate and reliable, is conducted in a transparent and impartial manner, and contributes to
organizational learning and accountability. Therefore, the evaluation team should adhere to the evaluation
standards and applicable practices outlined in the IFRC Management Policy for Evaluation.
The IFRC evaluation standards are:
1. Utility: Evaluations must be useful and used.
2. Feasibility: Evaluations must be realistic, diplomatic, and managed in a sensible, cost effective manner.
3. Ethics & Legality: Evaluations must be conducted in an ethical and legal manner, with particular regard
for the welfare of those involved in and affected by the evaluation.
4. Impartiality & Independence; Evaluations should be impartial, providing a comprehensive and unbiased
assessment that takes into account the views of all stakeholders.
5. Transparency: Evaluation activities should reflect an attitude of openness and transparency.
6. Accuracy: Evaluations should be technical accurate, providing sufficient information about the data
collection, analysis, and interpretation methods so that its worth or merit can be determined.
7. Participation: Stakeholders should be consulted and meaningfully involved in the evaluation process
when feasible and appropriate.
8. Collaboration: Collaboration between key operating partners in the evaluation process improves the
legitimacy and utility of the evaluation.
It is also expected that the evaluation will respect the seven Fundamental Principles of the Red Cross and Red
Crescent: 1) humanity, 2) impartiality, 3) neutrality, 4) independence, 5) voluntary service, 6) unity, and 7)
universality.
Further
information
can
be
obtained
about
these
Principles
at:
www.ifrc.org/what/values/principles/index.asp
Qualifications of team member
Selection of the evaluation members will be based on the following qualifications:
1. Demonstrable experience in leading evaluations of humanitarian programs responding to major disasters;
2. Knowledge of strategic and operational management of humanitarian operations and proven ability to
provide strategic recommendations to key stakeholders;
3. Strong analytical skills and ability to clearly synthesize and present findings, draw practical conclusions,
make recommendations and to prepare well-written reports in a timely manner;
Experience in qualitative data collection and data analysis techniques, especially in emergency operations;
Knowledge and experience working with the Red Cross Red Crescent Movement preferred;
Demonstrated capacity to work both independently and as part of a team;
Excellent English writing and presentation skills in English, with relevant writing samples of similar
evaluation reports.
8. Regional knowledge of South Asia (Bangladesh) preferred but not required.
4.
5.
6.
7.
Page 7
Download