External evaluation of Save the Children*s Saving Newborn Lives

advertisement
Terms of Reference
EVERYONE Final Impact Review 2015
1. Background and purpose
EVERY ONE has been Save the Children’s priority global campaign for the last five years. The
drive behind the campaign is the vision that no child under the age of five will die from
preventable causes and public attitudes will not tolerate a return to high levels of child deaths.
All Save the Children Members and Country Offices have been part of delivering this campaign
through coordinated activities at a local, regional and global level with a strong emphasis placed
on coalition and partnership working.
The campaign goal is that Millennium Development Goal 4 – a two thirds reduction in child
mortality rates by 2015 – is achieved.
The Strategic Objective is by 2015 we will have influenced changes in policy and
practice that expand coverage of services that dramatically accelerate sustainable and
equitable progress towards MDG 4.
As Save the Children moves into the last stretch of the EVERYONE campaign the organisation
is planning for the final campaign evaluation and the launch of the next global campaign. This
evaluation will focus primarily on impact and capturing reflections on the role that Save the
Children has played in framing the global and national agendas on child survival, the extent to
which we have achieved our objectives and the extent to which public opinion has changed on
these issues.
The evaluation will build on four evaluative pieces of work which have been undertaken over the
course of the last 4 years:
 A baseline study on public attitudes to child mortality (which will be repeated and
completed by February 2016)
 A mid-term review, conducted in 2012, aimed at establishing progress, reviewing the
strategic direction and reviewing the metrics of campaign success.
 A governance and partnership review conducted in 2015 with the aim of feeding into
planning for our next global campaign (internal governance will not be a feature in this
evaluation).
 A series of advocacy impact studies conducted in 2015 in countries where there have
been significant changes, along with external evaluations from at least 8 countries during
the lifetime of the campaign.
2. Evaluation Objectives and Key Questions
The overall purpose of the evaluation is to focus on impact, investment and make
recommendations for how Save the Children might adjust and change its strategic approach in
the future. Below is an outline of the core objectives and some of the questions we might
envisage including in the evaluation, these will be further refined at the inception phase and we
encourage consultants to include additional suggestions in proposals.
.
1
1. To what extent have the external objectives surrounding MDG 4 and 5 been achieved?
a. What have been the trends in combatting child mortality over the last 5 years?
b. Which countries are on track to achieving targets and why?
2. What role has Save the Children played in shaping decisions and framing agendas?
a. To what extent has Save the Children achieved its internal objectives over the
last 5 years?
b. How have decision makers and global influencers viewed our approaches and
our policies?
c. How have we developed and maintained relationships for this purpose?
d. How have civil society viewed our approaches and policies?
e. How have we worked to strengthen civil society to be part of this process?
3. To what extent has our EVERYONE campaigning and advocacy contributed to changes
in behavior, policy and practice at a global and national level?
a. What was the intended outcome of our activities and did we utilise inputs
(resources, time, people, activities) effectively?
b. How did we mobilise the public and work within coalitions and partnerships?
c. Have the strategies and tactics we used worked/ did some work better than
others and why?
d. Have the thematic campaign wedges worked?
e. Have our messages fed into key policies, documents and agendas?/ Are we able
to make plausible links between legislation, decision making summits and our
work?
f. In countries where they may not have been specific policy change, what changes
have we seen?
4. How has public opinion on the issue of child mortality changed?
a. How have we been able to create an enabling environment?
b. How has public opinion changed since our mid-campaign baseline was
commissioned?
5. Have we maintained and achieved our commitments to the Every Women Every Child
strategy?
a. How have we done against the commitments we set around training health
workers, the Early Newborn Action Plan, Family Planning etc
6. What spillover effects has the campaign had for Save the Children?
a. How has it allowed us to increase our brand visibility?
b. How has it allowed us to secure resources and how have we used these
specifically for the campaign and unrestricted resources?
c. How has it changed or maintained our reputation with key stakeholders (either
negatively or positive)
d. How has it allowed us to build strength in programming work and capacity of
advocacy and campaigning across the organisation and its members?
e. What additional unforeseen benefits or limitations have there been?
3. Methodology
2
At the inception stage the evaluation team, together with Save the Children’s project lead, will
be asked to propose methodological approaches and a framework of enquiry within the time
and budget constraints of the contract which will be agreed on and signed off by the campaign
strategy group.
The evaluation will focus primarily on qualitative methods and approaches including:

Desk-based document review of:
o
o
o
o
o





Save the Children’s overarching strategy document for the campaign and global
annual strategy and implementation documents.
Annual reporting on strategy, internal and external evaluations of key
campaigning activities.
A review of Save the Children’s global commitments to ending child mortality, as
part of the Every Women Every Child Strategy.
A review of selected country strategy documents (maximum 10)
External literature on child survival and achievements on MDG4, along with a
review of our commitments to global strategies.
Interviews with internal campaign stakeholders (eg. Project teams, strategy group,
country campaigners)
Interviews at a global and country level with external stakeholders (eg. NGO allies,
media, funders, affected groups and local opinion formers)
The evaluation is likely to include an in depth review of up to 10 country strategies or
existing country evaluations, including at least 1 country visit (more if budget allows).
An online survey validating key findings across the EVERYONE team.
Approach to triangulation and confidentiality.
Additionally the consultants will be required to work with an agency undertaking a public opinion
survey with a view to assessing change against the baseline we commissioned in 2011.
4. Timeline and budget
Activity
Review and selection of
consultant
Inception brief, case selection
Comments and sign off of
inception brief
Research phase 1: interviews with
Save the Children staff and
document review
Timeline
18 November 2015
Deliverables
27 November 2015
11 December 2015
Inception brief
11 December – 1 February
2016
Interview questions
Research phase 2: interviews with
external stakeholders, country
visits
Presentation of preliminary
findings
4 December – 1 February
2016
Preliminary findings
29 February 2016
Presentation
3
First draft report
Comments on draft report
Final report with
recommendations and
presentation
11 March 2016
25 March 2016
31 March 2016
Final report
Budget- we expect the number of days to be in the region of 60 including 2 week long trips to
country programmes
5. Skills and competencies of the consultants






Experience conducting summative evaluations of complex social and political change
processes.
Very strong qualitative analysis skills, particularly interviews and document review.
Experience working on, managing or evaluating NGO-led policy advocacy campaigns,
with a particular focus on global poverty and social justice issues.
Understanding of child survival
Excellent analytical, writing, and synthesis skills
Ideally, have familiarity with Save the Children and Save the Children’s approach to
policy and campaigning or similarly structured global organisations
6. Submitting and Expression of Interest
Save the Children invites bids from individuals and teams with the experience and skills
described above. If you are interested in this consultancy, please submit a tender
comprising of the following:



A brief 2 to 3 page expression of interest with a description of the proposed
approach, description of deliverables, a proposed budget, and a brief summary of
qualifications
A CV for each member of the team detailing relevant skills and experience of no
more than 4 pages, including contactable referees
An example of a relevant previous evaluation
4
Download