Terms of Reference for IPPF’s Innovation Programme Research Component IPPF would like to invite applicants to design and implement the research component of IPPF’s Innovation Programme projects with a view to publication and public disclosure of results, according to the terms of reference outlined here. If you are interested, please reply to Dr. Ritu Mahendru, Senior Evaluation Officer for the Innovation Programme at rmahendru@ippf.org, copying innovation@ippf.org with an expression of interest (EoI) that outlines your approach to meeting these terms of reference. Details of what to include in the EoI are given in a checklist at the end. Please submit your EoI by close of business on 04.01.16. Successful applicants will be notified by 12.02.16. Background IPPF is a global service provider and a leading advocate of sexual and reproductive health and rights (SRHR) for all. IPPF’s Innovation Programme (IP) ensures a safe space to implement new and creative projects to enhance learning, increase effectiveness and contribute to the evidence base of programming in support of IPPF’s strategic priorities and the SRHR sector. The guiding principles of the IP are: Be creative: It is vital to develop and implement new approaches to meet IPPF's goals and objectives, within the ever changing landscape of SRHR Be accountable: We are accountable to our clients, to ensure that our programmes address their needs; and to our donors and ourselves in working as effectively as possible Be effective: By subjecting our new ideas to rigorous evaluation and research, we can generate the evidence needed to test our innovation models IPPF has identified a programmatic evidence gap in SRH service delivery: how can we better partner with men and boys to increase their participation in and access to sexual and reproductive health services? Our Member Associations (MAs) have local knowledge and expertise in providing SRH services to their clients and are therefore best placed to propose innovative ways to address this problem. Following a competitive selection process, ATBEF (IPPF’s MA in Togo) has been selected to implement their project with the following aim and objectives: Aim: To contribute to reducing mother-and-child mortality and gender-based violence (GBV) by involving men and boys in promoting reproductive health. Objective 1: to create a favourable environment by building the capacity of political, religious and community leaders to use legal tools favourable to reproductive health. Objective 2: to improve men and boys’ access to reproductive health services. Objective 3: to increase the demand for reproductive health services by improving the involvement of men and boys in promoting their use. Objective 4: Establish an effective system of coordination, monitoring/evaluation and research into project interventions. A more detailed project summary can be found in annex 1. In order to meet the IP’s Guiding Principles, the IP pairs each project with an independent research partner (individual or institution), with strong skills and experience in evaluation and operational/implementation research. We are therefore looking to engage a research partner to design and implement an independent, prospective evaluation of this project, working alongside ATBEF to assess the realisation and success of their project in accordance with the specifications outlined in this terms of reference. We seek open and enhanced sharing and publication of any results ensuing from this collaboration. IPPF will support the successful research partner with up to US$150,000 over the three years. Aim of the IP IPPF aims to understand the design, implementation and contextual factors which are the main contributors to the project’s success or failure, to enable identification of successful innovation projects with potential for scale up and replication. Objective 1: To design an impact evaluation (IE) to answer the question ‘do men and boys trained on the importance of their contribution to the promotion of SRHR, use (and promote their families to use) available SRH services?’ OR ‘Does capacity building community leaders to implement legal tools supportive of SRHR effectively contribute to the reduction of maternal and child deaths and gender based violence in their communities?’ This objective aims to empirically and independently measure the extent to which this project achieved its stated outcome through a theory-based, experimental or quasi-experimental, mixed methods impact evaluation. This study will explore the underlying determinants of the project’s results, including how and why they are affected by project design, implementation and contextual factors (for example, sociocultural, political, legal, physical and economic factors). This will require co-development, with ATBEF, of the project’s theory of change, fully examining assumptions along the entire project causal chain. IPPF proposes that researchers are actively involved in prospectively designing the project implementation along with ATBEF to enable a robust, prospective impact evaluation methodology. The proposed study question or questions will be confirmed for evaluability or amended in consultation with ATBEF as part of finalising the study design. While a full economic analysis is not required, the IE will consider the project’s cost effectiveness to the full extent that data are available. Results of the IE will inform future project improvements, scale-up or replication of activities in other contexts. Objective 2: To contribute to the global body of knowledge on partnering with men and boys in SRHR by disseminating robust evidence and lessons from this work This objective aims to contribute to the wider evidence base on partnering with men and boys through dissemination of the findings from the evaluation to a wide variety of targetted audiences, including but not limited to policymakers, implementers and academics. Use of creative dissemination activities and channels is encouraged, as well as publication in peer-reviewed journals and open-access platforms. Methodology Current evidence on the impact of partnering with men and boys in the field of SRHR have begun to report promising approaches, but methodological limitations persist, as exampled in a recent review commissioned by IPPF 1: few quantitatively rigorous studies exist many are limited to a short timeframe where impact on behaviour change may not be seen The successful applicant will be expected to work closely with ATBEF to both design and implement the project. This work will therefore start with a project inception meeting, attended by the successful applicant, ATBEF and IPPF’s Project Support Team (PST), to agree roles and responsibilities (to be documented in a collaboration agreement), develop an initial theory of change and create a joint implementation plan for the duration of the project. IPPF supports the establishment of a consortium to undertake this research piece. Timeline and travel The successful applicant’s time will be spread across a maximum of 38 months. Depending on their location, travel will likely be necessary to visit field locations and this should be included in the funds available. Selection process IPPF will review all applications for adherence to the criteria set out in these terms of reference. A combined internal and external review panel will then select a shortlist of applications based on the cost-effectiveness of their proposed approach, as well as its technical / methodological merits in meeting each of the objectives above and the application criteria set out below. Preference will be given to applicants who clearly address each criterion individually. Innovative evaluation techniques are also welcome. Preference will be given to those who demonstrate a pragmatic approach, prioritising designs that will be useful to ATBEF programme managers and decision-makers. Successful applications will therefore likely propose mixed methods approaches, which can provide ongoing feedback to ATBEF for incremental project improvement / course correction. Given the gender-responsive nature of this project, the design will have to be explicitly and thoroughly grounded in a gender-responsive design framework. Consideration will also be given to the applicant’s demonstrated experience in SRHR and gender awareness. The final selection from this shortlist will be made jointly by IPPF and ATBEF and will include consideration of logistical working arrangements. ‘Engaging men and boys in sexual and reproductive health: a review of promising approaches and gaps’, commissioned by the IPPF, 2015. 1 Roles and Responsibilities Research Partner: Implement the proposed IP Research Component in collaboration with ATBEF’s IP Project: Work with ATBEF to design the research approach to meet the objectives specified above, which ATBEF expects will include a mixed-method impact evaluation and a process evaluation that will focus on implementation questions in annex 2. Arrange ethics approval for the proposed IP Research Component2. Register the proposed research on a suitable evaluation registry, for example 3ie’s RIDIE is appropriately qualified for inclusion. Maintain close communication with ATBEF to share findings from routine monitoring, evaluation or research activities Co-own data collected with other parties (IPPF and ATBEF) and ensure that research findings are publically available. Submit to IPPF semi-annual written reports including a description of results/findings, observations and recommendations of the research, along with a fiscal report Author the final write-up of this research preparing various formats suitable for journal publication and other dissemination activities & audiences, such as a plain-language, accessible main report of not more than 60 pages (not including annexes), a four-page brief suitable for decision-makers and an infographic. Prepare a clear dissemination plan, including conferences, media and publication (during and after the study) ATBEF: Implement the IP Project in collaboration with the successful research applicant: Maintain close communication with the successful research applicant to share findings from routine monitoring, evaluation or research activities Support the successful research applicant to collect and interpret data, including the sharing of data routinely collected by ATBEF where needed. NB: Although ATBEF may be able to support the successful research applicant to collect data, this cannot be confirmed until a more detailed discussion between ATBEF and the successful applicant. Therefore, for the purposes of this EoI, applicants should assume that ATBEF cannot support data collection. Co-own data collected with other parties (IPPF and the successful research applicant) Co-author the final write-up of this IP Research Component where appropriate Advise the successful research applicant on the types of dissemination materials needed for local target audiences Where appropriate, propose local research partner to partner with IPPF Secretariat: Facilitate communication and contact between the successful research applicant and ATBEF Facilitate contractual arrangements between IPPF and the successful applicant Assist in organizing travel logistics for the successful research applicant Co-own data collected with other parties (ATBEF and the chosen research partner) Co-author the final write-up of this IP Research Component where appropriate This may be from national or local ethics committees in countries in which the study will be undertaken, or other stakeholder institutions with registered ethics approval systems. 2 Co-ordinate a final peer review process in collaboration with the chosen research partner, as appropriate What to include in the Expression of Interest The following information must be submitted as part of expression of interest: The CVs of the Principle Investigator(s) (PI) and other members of the team (maximum of three pages, stating only qualifications relevant to this study) and a table showing the roles and time being allocated for each member over the 38 months. CVs should explicitly identify the following qualifications: o Previous appropriate experimental, quasi-experimental mixed method evaluation experience in India with similar or larger budgets o Demonstrated experience designing gender-responsive evaluation designs Based on the available information in the TOR, provide an outline and rationale for the research design(s) you will propose for discussion and finalisation with the team (1200 words): o Discuss the proposed evaluation question(s) and whether or not these are evaluable or will need further discussion and amendment or noting that the questions are not evident at present and will need to be identified and agreed o Describe how you will develop a programme theory of change and include, optionally, a one-page example of a theory of change for a similar programme from previous work or an indicative one based on the project summary and TOR information provided. o Describe proposed evaluation designs methods and data collection techniques, with attention to the robustness of qualitative components, and how to implement the study components on this budget in the time provided and what parts will be covered by ATBEF. o Describe explicitly how the evaluation will be responsive to age, sex and gendered roles and relations. o Describe any innovative aspects of the proposed approach o Note any qualifications to the TOR and any identified risks to implementation you identified in the TOR Provide a summary of how you will develop a research communication plan that will include engagement with key stakeholders, including project beneficiaries, implementers and decision-makers throughout the study period. The summary should indicate types of activities and what products will be produced. It should include a dissemination plan for the study findings. At least 10 per cent of the study budget will go to these activities and products (300 words max) Provide details of the institutional review board (IRB) from which ethical approval will be sought and the likely time this may take Disclose any potential conflicts of interest in your engagement with IPPF’s Innovation Programme Please provide an proposed budget: o Costs of anticipated travel, including visas, vaccinations, airport transfers, per diems and accommodation as these are expected to be covered by these funds o Costs for study implementation, including identification of study components that will be covered by ATBEF o Costs for research participants (that meet ethical standards for participation compensation) o Costs of the research communication plan, including communication product costs Please state whether VAT is included in the budget and what your overhead recovery rate is, if applicable Please state where you saw this terms of reference advertised Eligibility IPPF will accept bids or submissions from legally registered organisations that have a demonstrated record of managing similar or larger grants. At least one PI must be a Togo national, residing in Togo and speaking a local language. They should play a substantive role throughout the entire study. The addition of an international expert to provide methodological expertise and support in design and analysis is highly recommended. All team members working on the ground in Togo must be fluent in French. Consultant study team experience and qualifications The following are the essential and desirable qualifications that will be assessed from the CVs provided: Essential: Experience of designing and implementing qualitative and quantitative research methodologies, with at least one prior experience being in conducting a rigorous impact evaluation Demonstrated experience designing experimental or quasi-experimental evaluations that include a mix of methods and are based on a careful analysis along the entire causal chain of the programme theory of change Field-based evaluation research in Serbia or a similar appropriate location and context, with demonstrated capacities to develop survey instruments and train and manage survey teams Demonstrated capacity to design evaluations that adequately capture and analyse the social and structural determinants of inequality, including age, sex and gendered roles and relations. Excellent writing, analytical and communication skills and ability to present complex information in a systematic way A proven record of delivery of results within the defined time frame Sensitivity to different cultural and religious contexts Fluency in written and spoken English and French Lead PI or co-lead PI will have been lead author on relevant publications in sexual and reproductive health and rights Desirable: Experience of implementation research Other languages, particularly any relevant languages to the project location Indicative timeline and deliverables Final selection: Contracting: Inception meeting with ATBEF: Development of detailed IE: Review of IE by IPPF: Commencement of IE and ATBEF’s implementation: 12.02.16 Feb / March 2016 March 2016 April 2016 April 2016 May 2016 Submission Please limit the EoI to 4 pages (8 sides) of A4 (excluding CVs and an annex showing an example theory of change, which is optional). Incomplete applications will not be considered. Acceptance of an application is not a guarantee of any awards being made. Contact details Dr. Ritu Mahendru, Senior Research and Evaluation Officer for the Innovation Programme International Planned Parenthood Federation 4 Newhams Row London SE1 3UZ United Kingdom tel Email: +44 (0) 20 7939 8225 rmahendru@ippf.org, innovation@ippf.org Annex 1: Detailed summary of ATBEF’s project In Togo, as in other countries of West Africa, there are still barriers to accessing sexual and reproductive health (SRH) services despite the efforts of government, civil society and development agencies. In addition to financial and political barriers, cultural barriers influence people’s behaviour. These attitudes and practices prevent men and boys from accessing SRH services. As traditional holders of both power and resources, their lack of involvement in SRH services subsequently leads to poor attendance and uptake of these services by women and girls. Indicators of this poor service up-take include: low prevalence of contraceptive use (17.1% in 2013); low attendance at ante- and post-natal services; high maternal and child mortality (401 per 100,000 live births and 123 per 1,000 respectively) and high incidence of gender-based violence. This initiative proposes targeting men and boys in 5 regional towns and Lomé. The aim is to contribute to reducing mother-and-child mortality and gender-based violence (GBV) by involving men and boys in promoting sexual and reproductive health. In order to achieve this, the project will build the capacity of political, religious and community leaders to use existing legal tools favourable to reproductive health; improve access to reproductive health services by male clients and increase demand for SRH services by men and their families. These will be achieved through the following activities: Workshops to improve the gender-awareness of religious and community leaders, as well as encourage them to promote reproductive health, including vasectomy and other services specific to men. Training to ATBEF service providers on SRH issues specific to men and boys, including clinical training on the provision of vasectomies. Outreach services to provide vasectomies in remote communities. Promotional campaigns for subsidised SRH services specific to men. Training for community health workers (CHWs) on involving men and boys in SRH, gender awareness and GBV. To increase demand for male SRH services, these CHWs will establish ‘husband schools’, youth clubs and men’s committees, the members of which will act as peer educators and can directly refer men and boys to SRH services. Championing of SRH services by couples who have successfully engaged in their use. Radio broadcasts on men’s involvement in SRH and vasectomy services. The innovation of this project is the promotion of services specific to men, including vasectomy, as well as their involvement in combating GBV. This is a new area of work in the sub-region (promoting vasectomy) as vasectomy is not widely encouraged in Frenchspeaking Africa. The area of men and boys’ involvement in promoting reproductive health is also in its infancy. If this project is successful, it can form a model for scaling up in other countries. Annex 2: Implementation outcomes Implementation Outcome Acceptability Adoption Appropriateness Feasibility Fidelity Implementation cost Coverage Sustainability Working definition The perception among stakeholders that an intervention is agreeable The intention, initial decision or action to try to employ a new intervention The perceived fit or relevance of the intervention in a particular setting or for a particular target audience (e.g. provider or consumer) or problem The extent to which an intervention can be carried out in a particular setting or organisation The degree to which an intervention was implemented as it was designed in an original protocol, plan or policy The incremental implementation cost of the project The degree to which the population that is eligible to benefit from an intervention actually receives it The extent to which an intervention is maintained or institutionalised in a given setting Adapted from (Peters, et al., 2013) Bibliography Related terms Factors related to acceptability e.g. comfort, relative advantage, credibility Uptake, utilisation, intention to try Relevance, perceived fit, compatibility, perceived usefulness Practicality, actual fit, trailability Adherence, delivery as intended, integrity, quality of programme delivery, dosage of delivery Marginal and total cost Reach, access, service spread, effective coverage (combining coverage and fidelity), penetration / integration into the service setting Maintenance, continuation, durability, institutionalisation, incorporation Peters, D., Tran, N. & Adam, T., 2013. Implementation Research in Health: A practical guide, Geneva: World Health Organisation.