Terms of Reference EVERYONE Final Impact Review 2015 1. Background and purpose EVERY ONE has been Save the Children’s priority global campaign for the last five years. The drive behind the campaign is the vision that no child under the age of five will die from preventable causes and public attitudes will not tolerate a return to high levels of child deaths. All Save the Children Members and Country Offices have been part of delivering this campaign through coordinated activities at a local, regional and global level with a strong emphasis placed on coalition and partnership working. The campaign goal is that Millennium Development Goal 4 – a two thirds reduction in child mortality rates by 2015 – is achieved. The Strategic Objective is by 2015 we will have influenced changes in policy and practice that expand coverage of services that dramatically accelerate sustainable and equitable progress towards MDG 4. As Save the Children moves into the last stretch of the EVERYONE campaign the organisation is planning for the final campaign evaluation and the launch of the next global campaign. This evaluation will focus primarily on impact and capturing reflections on the role that Save the Children has played in framing the global and national agendas on child survival, the extent to which we have achieved our objectives and the extent to which public opinion has changed on these issues. The evaluation will build on four evaluative pieces of work which have been undertaken over the course of the last 4 years: A baseline study on public attitudes to child mortality (which will be repeated and completed by February 2016) A mid-term review, conducted in 2012, aimed at establishing progress, reviewing the strategic direction and reviewing the metrics of campaign success. A governance and partnership review conducted in 2015 with the aim of feeding into planning for our next global campaign (internal governance will not be a feature in this evaluation). A series of advocacy impact studies conducted in 2015 in countries where there have been significant changes, along with external evaluations from at least 8 countries during the lifetime of the campaign. 2. Evaluation Objectives and Key Questions The overall purpose of the evaluation is to focus on impact, investment and make recommendations for how Save the Children might adjust and change its strategic approach in the future. Below is an outline of the core objectives and some of the questions we might envisage including in the evaluation, these will be further refined at the inception phase and we encourage consultants to include additional suggestions in proposals. . 1 1. To what extent have the external objectives surrounding MDG 4 and 5 been achieved? a. What have been the trends in combatting child mortality over the last 5 years? b. Which countries are on track to achieving targets and why? 2. What role has Save the Children played in shaping decisions and framing agendas? a. To what extent has Save the Children achieved its internal objectives over the last 5 years? b. How have decision makers and global influencers viewed our approaches and our policies? c. How have we developed and maintained relationships for this purpose? d. How have civil society viewed our approaches and policies? e. How have we worked to strengthen civil society to be part of this process? 3. To what extent has our EVERYONE campaigning and advocacy contributed to changes in behavior, policy and practice at a global and national level? a. What was the intended outcome of our activities and did we utilise inputs (resources, time, people, activities) effectively? b. How did we mobilise the public and work within coalitions and partnerships? c. Have the strategies and tactics we used worked/ did some work better than others and why? d. Have the thematic campaign wedges worked? e. Have our messages fed into key policies, documents and agendas?/ Are we able to make plausible links between legislation, decision making summits and our work? f. In countries where they may not have been specific policy change, what changes have we seen? 4. How has public opinion on the issue of child mortality changed? a. How have we been able to create an enabling environment? b. How has public opinion changed since our mid-campaign baseline was commissioned? 5. Have we maintained and achieved our commitments to the Every Women Every Child strategy? a. How have we done against the commitments we set around training health workers, the Early Newborn Action Plan, Family Planning etc 6. What spillover effects has the campaign had for Save the Children? a. How has it allowed us to increase our brand visibility? b. How has it allowed us to secure resources and how have we used these specifically for the campaign and unrestricted resources? c. How has it changed or maintained our reputation with key stakeholders (either negatively or positive) d. How has it allowed us to build strength in programming work and capacity of advocacy and campaigning across the organisation and its members? e. What additional unforeseen benefits or limitations have there been? 3. Methodology 2 At the inception stage the evaluation team, together with Save the Children’s project lead, will be asked to propose methodological approaches and a framework of enquiry within the time and budget constraints of the contract which will be agreed on and signed off by the campaign strategy group. The evaluation will focus primarily on qualitative methods and approaches including: Desk-based document review of: o o o o o Save the Children’s overarching strategy document for the campaign and global annual strategy and implementation documents. Annual reporting on strategy, internal and external evaluations of key campaigning activities. A review of Save the Children’s global commitments to ending child mortality, as part of the Every Women Every Child Strategy. A review of selected country strategy documents (maximum 10) External literature on child survival and achievements on MDG4, along with a review of our commitments to global strategies. Interviews with internal campaign stakeholders (eg. Project teams, strategy group, country campaigners) Interviews at a global and country level with external stakeholders (eg. NGO allies, media, funders, affected groups and local opinion formers) The evaluation is likely to include an in depth review of up to 10 country strategies or existing country evaluations, including at least 1 country visit (more if budget allows). An online survey validating key findings across the EVERYONE team. Approach to triangulation and confidentiality. Additionally the consultants will be required to work with an agency undertaking a public opinion survey with a view to assessing change against the baseline we commissioned in 2011. 4. Timeline and budget Activity Review and selection of consultant Inception brief, case selection Comments and sign off of inception brief Research phase 1: interviews with Save the Children staff and document review Timeline 18 November 2015 Deliverables 27 November 2015 11 December 2015 Inception brief 11 December – 1 February 2016 Interview questions Research phase 2: interviews with external stakeholders, country visits Presentation of preliminary findings 4 December – 1 February 2016 Preliminary findings 29 February 2016 Presentation 3 First draft report Comments on draft report Final report with recommendations and presentation 11 March 2016 25 March 2016 31 March 2016 Final report Budget- we expect the number of days to be in the region of 60 including 2 week long trips to country programmes 5. Skills and competencies of the consultants Experience conducting summative evaluations of complex social and political change processes. Very strong qualitative analysis skills, particularly interviews and document review. Experience working on, managing or evaluating NGO-led policy advocacy campaigns, with a particular focus on global poverty and social justice issues. Understanding of child survival Excellent analytical, writing, and synthesis skills Ideally, have familiarity with Save the Children and Save the Children’s approach to policy and campaigning or similarly structured global organisations 6. Submitting and Expression of Interest Save the Children invites bids from individuals and teams with the experience and skills described above. If you are interested in this consultancy, please submit a tender comprising of the following: A brief 2 to 3 page expression of interest with a description of the proposed approach, description of deliverables, a proposed budget, and a brief summary of qualifications A CV for each member of the team detailing relevant skills and experience of no more than 4 pages, including contactable referees An example of a relevant previous evaluation 4