GOAL Framework Consultancy for Country Programme WASH Evaluations and Assessment against Global WASH Aims and Priorities Terms of Reference Background on GOAL’s Global WASH Operations Brief information about organization: GOAL is an international humanitarian and development agency dedicated to alleviating the suffering of the poorest of the poor. GOAL is a non-denominational, nongovernmental and non-political organisation. Since its inception in 1977, GOAL has spent in excess of €790 million on humanitarian and development programmes in more than 50 countries. GOAL delivers a wide range of humanitarian and development programmes across 15 countries of operation. Programmes focus on the sectors of WASH, Health, Nutrition, Infrastructure, Livelihoods and Child Empowerment and Protection. GOAL carries out WASH programming in the majority of these countries. Programming focuses on a wide range of emergency and development WASH activities in both urban and rural settings. During 2013 GOAL’s annual budget for WASH globally was approximately USD $10 million, reaching a total 1.2 million beneficiaries. Approximately 240 GOAL and partner WASH staff implement these programmes, covering all elements of water, sanitation and hygiene. Globally GOAL has a Health Strategy and WASH Strategic Framework that guide programming and areas of programme development. Within these documents are the following WASH goal and objectives: WASH Goal: To continue to deliver holistic Water, Sanitation and Hygiene programmes that target vulnerable groups in a timely and efficient manner whilst measuring impact, retaining the capacity to respond to rapid onset emergencies, reducing disaster risk for the chronically vulnerable and building the capacity of a full range of WASH stakeholders to continue to operate and maintain installed facilities and carry out work in the future. WASH Objectives: Ensure that the most vulnerable and/or disaster-affected, in rural, urban and emergency contexts, have increased, equitable access to appropriate and sustainable water and sanitation services and hygiene promotion Strengthening emergency preparedness and contingency planning integrating risk reduction Ensuring local stakeholders, communities and institutions have increased capacity to operate, maintain, develop (and possibly replicate) WASH interventions in order to ensure that WASH interventions are sustainable About the country programmes: GOAL operates in 15 countries globally, these are: Ethiopia, Haiti, Honduras, India, Kenya, Liberia, Malawi, Niger, Philippines, Sierra Leone, South Sudan, Sudan, Syria, Uganda and Zimbabwe. WASH programming in these locations varies greatly and can cover some of the following programming areas: Water Supply: achieved via a variety of water supply options depending on the context, including hand dug wells, boreholes (fitted with handpumps or submersible pumps) and rainwater harvesting. In urban areas GOAL also works with water utilities on extending service delivery and management of services. GOAL always ensures community management systems for operation and maintenance are put in place and that government/utility roles are made clear and linked to other stakeholders. Sanitation: GOAL aims to achieve sanitation coverage via Community Led Total Sanitation (CLTS), although there is acknowledgement that CLTS is not always the most suitable solution and sometimes an alternative low cost subsidy approach is needed. Sanitation Marketing is adopted in many countries, both to sustain and improve upon the results of CLTS, but also to increase sanitation coverage in urban areas. The on-going operation and maintenance (O&M) of on-site sanitation is also taken into consideration, with faecal sludge management (FSM) being pursued in urban areas. During emergency response GOAL is keeping up with the latest developments on emergency sanitation, with the ultimate aim to deliver sanitation as quickly as possible to those in need. Hygiene Promotion: Since 2012 GOAL has actively promoted a Designing Behaviour Change (DBC) framework approach to hygiene promotion, this has resulted in most countries producing several DBC frameworks that detail a variety of new types of activity to achieve hygiene promotion targets. This often can support the use of existing hygiene promotion methodologies such as participatory hygiene and sanitation transformation (PHAST) or community conversations. However, in some cases it might lead to more innovative solutions. GOAL also aims to assess the extent that communities are able to access hygiene hardware; particularly in emergency response this is of utmost importance. Local Government Engagement: With decentralisation taking place and becoming a reality in many of GOALs operational countries the benefits of engaging with local governments on achieving WASH targets have been greatly enhanced. Although it can present challenges GOAL aims to work closely with local governments in planning and coordinating WASH work and also assessing and improving on the quality of work. Market-based solutions: GOAL is increasingly interested in market-based WASH solutions with a focus upon sanitation provision, FSM and O&M of rural water supply as the three main areas. However, this is also a wider interest should solutions be appropriate to specific country objectives. The role of government (local and national) is also taken into account in these approaches, with the aim not to replace government functions but to empower them to see private sector solutions as something they can utilise to deliver on WASH targets for communities. WASH Advocacy: Although still not a significant part of programming, many GOAL countries already take part in informal advocacy relating to key WASH issues. This still needs to be better formalised but exists as something many GOAL WASH teams already achieve. Key areas of WASH programme development: GOAL has been focusing on the following areas of programme development since 2013 and will continue to adjust as seen fit: CLTS and Sanitation Marketing: With the challenges in rural sanitation still significant in many locations the requirement to come up with solutions to close the sanitation gap, GOAL has used Community Led Total Sanitation (CLTS) in many countries to achieve change in this area. But the challenge of ensuring that households are enabled to climb up the sanitation ladder using their own resources via sanitation marketing programming is an on-going challenge. Sustainability of Rural Water Supply: There is still great need to increase water supply coverage, but one of the greatest challenges facing the WASH sector is the sustainability of such infrastructure, GOAL has a particular focus on this and what improvement better collaboration with local government and private sector enterprises can bring about improvements in results. Effective Hygiene Promotion: Through the use of Designing Behaviour Change (DBC) frameworks GOAL has already catalysed some change in operations by introducing this methodology and increasing a focus on behaviour change; the challenge remains to effectively monitor behaviour and identify a small number of effective activities for certain behaviours. Urban WASH: GOAL works in several urban areas globally and has worked on emergency response, recovery and development programming. A broad area of programme development, but with a particular interest in that of faecal sludge management (FSM). Objective of the Evaluation GOAL is seeking a consultancy firm to conduct an evaluation of WASH projects/programmes via a framework agreement that will encompass numerous country programmes over a 36 month period. The specific objective for each country programme will be established in a separate TOR up to 1 month prior to the commencement of that specific evaluation. Evaluations will be conducted in line with the principles set out by the Development Assistance Committee of the OECD with reference to programme relevance, efficiency, effectiveness, impact and sustainability. In addition to the specific country evaluation objectives, an additional objective is to assess the country programme against the above strategic goal and objective for GOAL globally and against GOAL’s 10 Key WASH Principles (below) with an objective measurement to allow cross-country meta-analysis. Scope of Work The scope of work will be more accurately quantified for each country at the time of the evaluation. Each evaluation is likely to be achievable within 21 days. The number of evaluations for each annual year will be a maximum of 6. As mentioned above, there is also the requirement to consider and report on the country programme with reference to GOAL’s 10 Key WASH Principles as follows: Individual programmes will address the ‘three prongs’ of WASH (Water, Sanitation, and Hygiene), either as an integrated program, or in collaboration with other partners, including equal considerations for men and women 2. Community involvement and engagement are essential in all aspects of programming 3. Gender mainstreaming is of considerable importance within the WASH sector and all programmes should be gender sensitive 4. WASH programmes should not only respond to demand, but also create demand 5. Sustainable WASH services should be a primary focus of programming in terms of beneficiaries’ continued use of services and ability to operate and maintain without external assistance. This should include assessment of a programme’s environmental impact 6. Any WASH intervention should be designed and selected so that it is appropriate to the specific circumstances of the people (particularly the most vulnerable) and the location 7. WASH programming should focus on behaviour change and avoid simply improving knowledge 8. Partnership and capacity building of the whole range of stakeholders within a WASH programme is crucial for increasing the strength of a programme and also as a programme output 9. WASH does not operate in isolation from other programme teams. Integration of programming can greatly enhance outputs and thus the well-being of beneficiaries 10. WASH programmes should not only address existing needs of communities, but also be designed to reduce the vulnerability of communities to future hazards 1. The assessment against these principles and other global strategic criteria should be achieved during the course of the overall evaluation and time spent on the assessment should not exceed the 20% of the overall evaluation period. The system developed to assess against these criteria should be applied consistently across all country programmes to enable comparison on progress towards GOALs vision. If the country specific evaluation is only targeting one project within a WASH programme then the assessment of these global objectives and principles can be done against the targeted project if it is not feasible to assess the wider WASH programme. Outputs The consultant/firm will be responsible for compiling a report which addresses all of the questions identified in country specific TOR and also the global assessments outlined in the scope of work above. Typically an evaluation report would include: Executive Summary (including high priority recommendations); Background and introduction; Objectives of the evaluation; Methodology; Results (relevance, efficiency, effectiveness, impact and sustainability) as well as observations regarding programme alignment with the GOAL WASH principles; Discussion, conclusions and lessons learned; Limitations of the evaluation; Recommendations for strengthening the programme/follow on programmes; and Appendices as appropriate. All data collected during the evaluation should be appropriately analysed and electronic copies of data and calculations made available to GOAL in Excel workbooks (and SPSS data and output files if applicable). This date will remain under the ownership of GOAL and will not be available to share without express permission. Methodology The exact methodology for the evaluation will be determined at the time of developing a TOR prior to each country programme evaluation (a minimum of 1 month prior to date of departure). The following evaluation methodologies are foreseen as suitable methods of evaluation: Review of documentation (including survey results) Random sample generated focus group discussions Key informant interviews Interviews with GOAL staff Field visits to implementation location (location sites decided upon randomly) In terms of the review against global strategy components there is sufficient room to apply innovation. The assessment criteria should be objective in order to allow the comparison between countries. This could be achieved by a 1-10 score ranking, the criteria for assigning scores might be gradually expanded and improved upon during the course of the 36 month framework agreement. In order to ensure an understanding of the most up-to-date situation in the country of evaluation it is encouraged to work alongside a local consultancy or research institution during the evaluation period. Available Support GOAL will provide the consultancy with: An induction on the country programme prior to each deployment Ensure all relevant documentation is made available to the consultancy prior to the departure for field based evaluation Provide accommodation and food (or per diem in line with GOAL policies) for the duration of the visit Ensure transport is provided for the purposes of the evaluation and where necessary ensure staff are available for translation purposes Qualification of the Consultancy Significant experience of evaluating WASH programmes in both development and emergency response contexts across a variety of low-income countries Staff capacity to evaluate WASH programming 1 month after receiving the specific WASH evaluation TOR from the GOAL country Network of contacts/affiliates that operate in GOALs country programme sites – enabling the potential to link with a local consultancy/research institution during the evaluation Able to prove up-to-date knowledge with the latest developments in the WASH sector and with evaluation techniques Proven experience of developing high quality, concise reports with relevant recommendations A detailed knowledge of GOAL’s global areas of WASH programme development Submission of Proposals Applicants are requested to submit both technical and financial proposal for this consultancy by 18th May 2015. Technical Proposal The Technical proposal should include although not be limited to the following information: For the purposes of the proposal GOAL is requesting that applicants detail a methodology for a rural WASH programme evaluation matching closely with the general description outlined above on typical GOAL WASH programming A brief discussion of your recent experience in carrying out assignments of similar nature including a sample of a previously produced report. The candidate should also provide any other information that will facilitate evaluation of your competency to execute this assignment. (Maximum 2 pages). Detailed description of the manner in which the consultant understands and will respond to the TOR including time frame, schedule and number of persons involved. Clear description of roles of the proposed members involved in the evaluation. Curriculum vitae of staff able to contribute to this evaluation framework over the 36 month period Literature and data can be made available at the request of the applicant to aid this technical component of the project (see below clarification period) Financial Proposal The financial proposal must contain overall quotation in Euros for all the services to be provided and must itemize the following: An all-inclusive day rate (or a range of rates for different positions) A daily subsistence allowance (DSA) rate used by the organisation – note that in some cases GOAL will choose to pay the GOAL country DSA rate or provide food/accommodation in lieu of a DSA Other relevant costs Total estimated cost for a 21 person-day evaluation process Summary of the total costs for the services proposed i.e. 6 x evaluations per year over 3 years Proposed payment schedule NB. All costs for proposal preparation and of negotiating a contract, including travel cannot be reimbursed as a direct cost of the assignment. Clarification Period Applicants are able to submit questions for clarification on or before 27th April 2015 to hqtenders@goal.ie, with clarifications posted on a website accessible via the GOAL website by 1st May 2015. Proposal Evaluation and Appraisal The technical proposal will be evaluated based on the following criteria Experience and capacity of the proposed team (including qualifications and competencies of the proposed personnel for the assignment) in the carrying out the similar programme evaluations [40 Marks]. A sample methodology for the evaluation of a rural WASH programme that corresponds to the typical GOAL WASH programming outlined above [35 marks] The methodology outlined in responding to the TOR details on assessing GOALs global strategic WASH criteria [25 Marks]. Proposals obtaining more than 70 Technical Marks (against stated criteria) will be considered suitable and qualify for financial assessment. Maximum of 30 Marks will be given to the lowest offer and the other bidders will receive the points inversely proportional to their financial offers. Proposal obtaining the highest Marks (technical points + financial points) will be selected. Submission of Technical and Financial Proposals The proposal should be submitted on or before 18th May 2015 in two copies clearly marked “GOAL WASH Evaluation” as per the Request For Offer (RFO). Offer must be valid for at least 60 days from the deadline of submission as GOAL will seek to select the winning consultant within this period. GOAL is not bound to accept or select the lowest bidder. The consultancy is tentatively expected to commence in June 2015 however, this is subject to change All technical questions for this assignment must be addressed to hqtenders@goal.ie and copied to nboot@goal.ie for their information. Proposals can also be submitted via email as per the RFO but the covering letter must be signed and scanned. Only pdf files will be accepted. MS word or excel files will not be accepted.