Terms of Reference for IPPF's Innovation Programme Research

advertisement
Terms of Reference for IPPF’s Innovation Programme Research Component
IPPF would like to invite applicants to design and implement the research component of IPPF’s Innovation Programme projects with a
view to publication and public disclosure of results, according to the terms of reference outlined here.
If you are interested, please reply to Dr. Ritu Mahendru, Senior Evaluation Officer for the Innovation Programme at
rmahendru@ippf.org, copying innovation@ippf.org with an expression of interest (EoI) that outlines your approach to meeting these
terms of reference. Details of what to include in the EoI are given in a checklist at the end.
Please submit your EoI by close of business on 04.01.16. Successful applicants will be notified by 12.02.16.
Background
IPPF is a global service provider and a leading advocate of sexual and reproductive health and rights (SRHR) for all. IPPF’s Innovation
Programme (IP) ensures a safe space to implement new and creative projects to enhance learning, increase effectiveness and contribute
to the evidence base of programming in support of IPPF’s strategic priorities and the SRHR sector. The guiding principles of the IP are:

Be creative: It is vital to develop and implement new approaches to meet IPPF's goals and objectives, within the ever changing
landscape of SRHR

Be accountable: We are accountable to our clients, to ensure that our programmes address their needs; and to our donors and
ourselves in working as effectively as possible

Be effective: By subjecting our new ideas to rigorous evaluation and research, we can generate the evidence needed to test
our innovation models
IPPF has identified a programmatic evidence gap in SRH service delivery: how can we better partner with men and boys to increase
their participation in and access to sexual and reproductive health services? Our Member Associations (MAs) have local knowledge and
expertise in providing SRH services to their clients and are therefore best placed to propose innovative ways to address this problem.
Following a competitive selection process, ATBEF (IPPF’s MA in Togo) has been selected to implement their project with the following
aim and objectives:
Aim: To contribute to reducing mother-and-child mortality and gender-based violence (GBV) by involving men and boys in promoting
reproductive health.
Objective 1: to create a favourable environment by building the capacity of political, religious and community leaders to use legal tools
favourable to reproductive health.
Objective 2: to improve men and boys’ access to reproductive health services.
Objective 3: to increase the demand for reproductive health services by improving the involvement of men and boys in promoting their
use.
Objective 4: Establish an effective system of coordination, monitoring/evaluation and research into project interventions.
A more detailed project summary can be found in annex 1.
In order to meet the IP’s Guiding Principles, the IP pairs each project with an independent research partner (individual or institution),
with strong skills and experience in evaluation and operational/implementation research. We are therefore looking to engage a
research partner to design and implement an independent, prospective evaluation of this project, working alongside ATBEF to assess
the realisation and success of their project in accordance with the specifications outlined in this terms of reference. We seek open and
enhanced sharing and publication of any results ensuing from this collaboration.
IPPF will support the successful research partner with up to US$150,000 over the three years.
Aim of the IP
IPPF aims to understand the design, implementation and contextual factors which are the main contributors to the project’s success or
failure, to enable identification of successful innovation projects with potential for scale up and replication.
Objective 1: To design an impact evaluation (IE) to answer the question ‘do men and boys trained
on the importance of their contribution to the promotion of SRHR, use (and promote their
families to use) available SRH services?’
OR
‘Does capacity building community leaders to implement legal tools supportive of SRHR
effectively contribute to the reduction of maternal and child deaths and gender based violence in
their communities?’
This objective aims to empirically and independently measure the extent to which this project achieved its stated outcome through a
theory-based, experimental or quasi-experimental, mixed methods impact evaluation. This study will explore the underlying
determinants of the project’s results, including how and why they are affected by project design, implementation and contextual factors
(for example, sociocultural, political, legal, physical and economic factors). This will require co-development, with ATBEF, of the
project’s theory of change, fully examining assumptions along the entire project causal chain. IPPF proposes that researchers are
actively involved in prospectively designing the project implementation along with ATBEF to enable a robust, prospective impact
evaluation methodology. The proposed study question or questions will be confirmed for evaluability or amended in consultation with
ATBEF as part of finalising the study design. While a full economic analysis is not required, the IE will consider the project’s cost
effectiveness to the full extent that data are available. Results of the IE will inform future project improvements, scale-up or replication
of activities in other contexts.
Objective 2: To contribute to the global body of knowledge on partnering with men and boys in
SRHR by disseminating robust evidence and lessons from this work
This objective aims to contribute to the wider evidence base on partnering with men and boys through dissemination of the findings
from the evaluation to a wide variety of targetted audiences, including but not limited to policymakers, implementers and academics.
Use of creative dissemination activities and channels is encouraged, as well as publication in peer-reviewed journals and open-access
platforms.
Methodology
Current evidence on the impact of partnering with men and boys in the field of SRHR have begun to report promising approaches, but
methodological limitations persist, as exampled in a recent review commissioned by IPPF 1:

few quantitatively rigorous studies exist

many are limited to a short timeframe where impact on behaviour change may not be seen
The successful applicant will be expected to work closely with ATBEF to both design and implement the project. This work will
therefore start with a project inception meeting, attended by the successful applicant, ATBEF and IPPF’s Project Support Team (PST),
to agree roles and responsibilities (to be documented in a collaboration agreement), develop an initial theory of change and create a
joint implementation plan for the duration of the project.
IPPF supports the establishment of a consortium to undertake this research piece.
Timeline and travel
The successful applicant’s time will be spread across a maximum of 38 months. Depending on their location, travel will likely be
necessary to visit field locations and this should be included in the funds available.
Selection process
IPPF will review all applications for adherence to the criteria set out in these terms of reference. A combined internal and external
review panel will then select a shortlist of applications based on the cost-effectiveness of their proposed approach, as well as its
technical / methodological merits in meeting each of the objectives above and the application criteria set out below. Preference will be
given to applicants who clearly address each criterion individually.
Innovative evaluation techniques are also welcome. Preference will be given to those who demonstrate a pragmatic approach,
prioritising designs that will be useful to ATBEF programme managers and decision-makers. Successful applications will therefore likely
propose mixed methods approaches, which can provide ongoing feedback to ATBEF for incremental project improvement / course
correction. Given the gender-responsive nature of this project, the design will have to be explicitly and thoroughly grounded in a
gender-responsive design framework.
Consideration will also be given to the applicant’s demonstrated experience in SRHR and gender awareness. The final selection from this
shortlist will be made jointly by IPPF and ATBEF and will include consideration of logistical working arrangements.
‘Engaging men and boys in sexual and reproductive health: a review of promising approaches and gaps’, commissioned
by the IPPF, 2015.
1
Roles and Responsibilities
Research Partner:
Implement the proposed IP Research Component in collaboration with ATBEF’s IP Project:

Work with ATBEF to design the research approach to meet the objectives specified above, which ATBEF expects will include a
mixed-method impact evaluation and a process evaluation that will focus on implementation questions in annex 2.

Arrange ethics approval for the proposed IP Research Component2.

Register the proposed research on a suitable evaluation registry, for example 3ie’s RIDIE is appropriately qualified for
inclusion.

Maintain close communication with ATBEF to share findings from routine monitoring, evaluation or research activities

Co-own data collected with other parties (IPPF and ATBEF) and ensure that research findings are publically available.

Submit to IPPF semi-annual written reports including a description of results/findings, observations and recommendations of
the research, along with a fiscal report

Author the final write-up of this research preparing various formats suitable for journal publication and other dissemination
activities & audiences, such as a plain-language, accessible main report of not more than 60 pages (not including annexes), a
four-page brief suitable for decision-makers and an infographic.

Prepare a clear dissemination plan, including conferences, media and publication (during and after the study)
ATBEF:
Implement the IP Project in collaboration with the successful research applicant:

Maintain close communication with the successful research applicant to share findings from routine monitoring, evaluation or
research activities

Support the successful research applicant to collect and interpret data, including the sharing of data routinely collected by
ATBEF where needed.
NB: Although ATBEF may be able to support the successful research applicant to collect data, this cannot be confirmed until a
more detailed discussion between ATBEF and the successful applicant. Therefore, for the purposes of this EoI, applicants
should assume that ATBEF cannot support data collection.

Co-own data collected with other parties (IPPF and the successful research applicant)

Co-author the final write-up of this IP Research Component where appropriate

Advise the successful research applicant on the types of dissemination materials needed for local target audiences

Where appropriate, propose local research partner to partner with IPPF Secretariat:

Facilitate communication and contact between the successful research applicant and ATBEF

Facilitate contractual arrangements between IPPF and the successful applicant

Assist in organizing travel logistics for the successful research applicant

Co-own data collected with other parties (ATBEF and the chosen research partner)

Co-author the final write-up of this IP Research Component where appropriate
This may be from national or local ethics committees in countries in which the study will be undertaken, or other
stakeholder institutions with registered ethics approval systems.
2

Co-ordinate a final peer review process in collaboration with the chosen research partner, as appropriate
What to include in the Expression of Interest
The following information must be submitted as part of expression of interest:

The CVs of the Principle Investigator(s) (PI) and other members of the team (maximum of three pages, stating only
qualifications relevant to this study) and a table showing the roles and time being allocated for each member over the 38
months. CVs should explicitly identify the following qualifications:

o
Previous appropriate experimental, quasi-experimental mixed method evaluation experience in India with similar or
larger budgets
o
Demonstrated experience designing gender-responsive evaluation designs
Based on the available information in the TOR, provide an outline and rationale for the research design(s) you will propose for
discussion and finalisation with the team (1200 words):
o
Discuss the proposed evaluation question(s) and whether or not these are evaluable or will need further discussion
and amendment or noting that the questions are not evident at present and will need to be identified and agreed
o
Describe how you will develop a programme theory of change and include, optionally, a one-page example of a theory
of change for a similar programme from previous work or an indicative one based on the project summary and TOR
information provided.
o
Describe proposed evaluation designs methods and data collection techniques, with attention to the robustness of
qualitative components, and how to implement the study components on this budget in the time provided and what
parts will be covered by ATBEF.
o
Describe explicitly how the evaluation will be responsive to age, sex and gendered roles and relations.
o
Describe any innovative aspects of the proposed approach
o
Note any qualifications to the TOR and any identified risks to implementation you identified in the TOR

Provide a summary of how you will develop a research communication plan that will include engagement with key
stakeholders, including project beneficiaries, implementers and decision-makers throughout the study period. The summary
should indicate types of activities and what products will be produced. It should include a dissemination plan for the study
findings. At least 10 per cent of the study budget will go to these activities and products (300 words max)

Provide details of the institutional review board (IRB) from which ethical approval will be sought and the likely time this may
take

Disclose any potential conflicts of interest in your engagement with IPPF’s Innovation Programme

Please provide an proposed budget:
o
Costs of anticipated travel, including visas, vaccinations, airport transfers, per diems and accommodation as these are
expected to be covered by these funds
o
Costs for study implementation, including identification of study components that will be covered by ATBEF
o
Costs for research participants (that meet ethical standards for participation compensation)
o
Costs of the research communication plan, including communication product costs

Please state whether VAT is included in the budget and what your overhead recovery rate is, if applicable

Please state where you saw this terms of reference advertised
Eligibility
IPPF will accept bids or submissions from legally registered organisations that have a demonstrated record of managing similar or
larger grants. At least one PI must be a Togo national, residing in Togo and speaking a local language. They should play a substantive
role throughout the entire study. The addition of an international expert to provide methodological expertise and support in design and
analysis is highly recommended. All team members working on the ground in Togo must be fluent in French.
Consultant study team experience and qualifications
The following are the essential and desirable qualifications that will be assessed from the CVs provided:
Essential:

Experience of designing and implementing qualitative and quantitative research methodologies, with at least one prior
experience being in conducting a rigorous impact evaluation

Demonstrated experience designing experimental or quasi-experimental evaluations that include a mix of methods and are
based on a careful analysis along the entire causal chain of the programme theory of change

Field-based evaluation research in Serbia or a similar appropriate location and context, with demonstrated capacities to
develop survey instruments and train and manage survey teams

Demonstrated capacity to design evaluations that adequately capture and analyse the social and structural determinants of
inequality, including age, sex and gendered roles and relations.

Excellent writing, analytical and communication skills and ability to present complex information in a systematic way

A proven record of delivery of results within the defined time frame

Sensitivity to different cultural and religious contexts

Fluency in written and spoken English and French

Lead PI or co-lead PI will have been lead author on relevant publications in sexual and reproductive health and rights
Desirable:

Experience of implementation research

Other languages, particularly any relevant languages to the project location
Indicative timeline and deliverables
Final selection:
Contracting:
Inception meeting with ATBEF:
Development of detailed IE:
Review of IE by IPPF:
Commencement of IE and ATBEF’s implementation:
12.02.16
Feb / March 2016
March 2016
April 2016
April 2016
May 2016
Submission
Please limit the EoI to 4 pages (8 sides) of A4 (excluding CVs and an annex showing an example theory of change, which is optional).
Incomplete applications will not be considered.
Acceptance of an application is not a guarantee of any awards being made.
Contact details
Dr. Ritu Mahendru, Senior Research and Evaluation Officer for the Innovation Programme
International Planned Parenthood Federation
4 Newhams Row
London SE1 3UZ
United Kingdom
tel
Email:
+44 (0) 20 7939 8225
rmahendru@ippf.org, innovation@ippf.org
Annex 1: Detailed summary of ATBEF’s project
In Togo, as in other countries of West Africa, there are still barriers to accessing sexual and reproductive health (SRH) services despite
the efforts of government, civil society and development agencies. In addition to financial and political barriers, cultural barriers
influence people’s behaviour. These attitudes and practices prevent men and boys from accessing SRH services. As traditional holders of
both power and resources, their lack of involvement in SRH services subsequently leads to poor attendance and uptake of these services
by women and girls. Indicators of this poor service up-take include: low prevalence of contraceptive use (17.1% in 2013); low
attendance at ante- and post-natal services; high maternal and child mortality (401 per 100,000 live births and 123 per 1,000
respectively) and high incidence of gender-based violence.
This initiative proposes targeting men and boys in 5 regional towns and Lomé. The aim is to contribute to reducing mother-and-child
mortality and gender-based violence (GBV) by involving men and boys in promoting sexual and reproductive health. In order to achieve
this, the project will build the capacity of political, religious and community leaders to use existing legal tools favourable to reproductive
health; improve access to reproductive health services by male clients and increase demand for SRH services by men and their families.
These will be achieved through the following activities:

Workshops to improve the gender-awareness of religious and community leaders, as well as encourage them to promote
reproductive health, including vasectomy and other services specific to men.

Training to ATBEF service providers on SRH issues specific to men and boys, including clinical training on the provision of
vasectomies.

Outreach services to provide vasectomies in remote communities.

Promotional campaigns for subsidised SRH services specific to men.

Training for community health workers (CHWs) on involving men and boys in SRH, gender awareness and GBV. To increase
demand for male SRH services, these CHWs will establish ‘husband schools’, youth clubs and men’s committees, the members of
which will act as peer educators and can directly refer men and boys to SRH services.

Championing of SRH services by couples who have successfully engaged in their use.

Radio broadcasts on men’s involvement in SRH and vasectomy services.
The innovation of this project is the promotion of services specific to men, including vasectomy, as well as their involvement in
combating GBV. This is a new area of work in the sub-region (promoting vasectomy) as vasectomy is not widely encouraged in Frenchspeaking Africa. The area of men and boys’ involvement in promoting reproductive health is also in its infancy. If this project is
successful, it can form a model for scaling up in other countries.
Annex 2: Implementation outcomes
Implementation Outcome
Acceptability
Adoption
Appropriateness
Feasibility
Fidelity
Implementation cost
Coverage
Sustainability
Working definition
The perception among stakeholders that an intervention is
agreeable
The intention, initial decision or action to try to employ a
new intervention
The perceived fit or relevance of the intervention in a
particular setting or for a particular target audience (e.g.
provider or consumer) or problem
The extent to which an intervention can be carried out in a
particular setting or organisation
The degree to which an intervention was implemented as it
was designed in an original protocol, plan or policy
The incremental implementation cost of the project
The degree to which the population that is eligible to
benefit from an intervention actually receives it
The extent to which an intervention is maintained or
institutionalised in a given setting
Adapted from (Peters, et al., 2013)
Bibliography
Related terms
Factors related to acceptability e.g. comfort,
relative advantage, credibility
Uptake, utilisation, intention to try
Relevance, perceived fit, compatibility,
perceived usefulness
Practicality, actual fit, trailability
Adherence, delivery as intended, integrity,
quality of programme delivery, dosage of
delivery
Marginal and total cost
Reach, access, service spread, effective
coverage (combining coverage and
fidelity), penetration / integration into the
service setting
Maintenance, continuation, durability,
institutionalisation, incorporation
Peters, D., Tran, N. & Adam, T., 2013. Implementation Research in Health: A practical guide, Geneva: World Health Organisation.
Download