Title: Estimating maternal and newborn lives saved using Lives

advertisement
Business Case and Intervention Summary
ARIES PROJECT 203326
Intervention Summary
Title: Estimating maternal and newborn lives saved using Lives Saved Tool (LiST)
What support will the UK provide?
The UK will provide upto £267,393 for the development, implementation and dissemination of a model
to estimate the number of maternal and newborn lives saved through DFID support.
Why is UK support required?
In December 2010, the Department for International Development published Choices for women:
Planned pregnancies, safe births and healthy newborns. The UK’s Framework for Results for
improving reproductive, maternal and newborn health in the developing world (RMNH FfR).
This framework committed £4.4 billion for women’s and children’s health to:

save the lives of at least 50,000 women during pregnancy and childbirth and 250,000
newborn babies by 2015;

ensure at least 2m safe deliveries;

provide access to modern methods of family planning for 10m additional women; and

prevent more than 5m unintended pregnancies by 2015.
This included a commitment to monitor progress and publish results on an annual basis. UK support is
required to procure the services of an independent Provider to design and implement a model to
measure maternal and newborn lives saved as part of the UK Government’s commitment to
transparency and value for money.
What are the expected results?
Expected results are:

a computerized model to generate lives saved estimates

a detailed methodological note to guide the collation of input data for the model

annual estimates of maternal and newborn lives saved for all countries where DFID has a bilateral
programme – both country level and aggregate results

final cumulative estimates of maternal and newborn lives saved through DFID support during the f
FfR period
Business Case
Strategic Case
A. Context and need for a DFID intervention
Context
The UK government is committed to reduce poverty in poorer countries, in particular through
achieving the Millennium Development Goals (MDGs), including MDG 4 (Reduce child mortality) and
MDG 5 (Improve maternal health).
While progress is being made towards attainment of the MDGs, the rate of progress is insufficient to
attain the MDG targets, with particular challenges in reaching the poorest and most disadvantaged as
described below:
MDG 4: Reduce child mortality
Globally, nearly 19 000 children under five years die every day, amounting to 6.9 million deaths a
year. Although mortality rates for under-fives dropped by 41% between 1990 and 2011, these rates
are still insufficient to achieve MDG 4 by 2015, with only 6 out of 10 regions on track. A large share
of child mortality (40%) is attributable to deaths in the neonatal period with approximately 3 million
newborns dying in the first month of life1.
MDG 5: Improve maternal health
Worldwide, 287 000 women die each year from complications arising during pregnancy and
childbirth, representing a 47% decrease globally between 1990 and 2010. Over 99% of maternal
deaths occurring in developing countries2. For every woman who dies during pregnancy or childbirth
an additional 20 or 30 suffer complications such as such as severe anaemia, incontinence, damage
to the reproductive organs or nervous system, chronic pain, and infertility3.
1
Level and trends in child mortality. Report 2012. Estimates developed by the UN Inter-Agency Group for Child
Mortality Estimation.
2 WHO, UNICEF, UNFPA, World Bank (2012). Trends in Maternal Mortality: 1990 to 2010. Geneva: World Health
Organization.
3 C Murray and A Lopez, eds. Health Dimensions of Sex and Reproduction, Vol. 3, Global Burden of Disease and Injury
Series. Boston: Harvard University Press, 2008.
To support attainment of the MDGs, in 2010 DFID published a Framework for Results for improving
reproductive, maternal and newborn health in the developing world (FfR) setting out how the UK will
support action to:

save the lives of at least 50,000 women during pregnancy and childbirth and 250,000
newborn babies by 2015;

ensure at least 2m safe deliveries, particularly for the poorest 40% by 2015;

provide access to modern methods of family planning for 10m additional women, including 1m
young women aged 15 – 19 by 2015; and

prevent more than 5m unintended pregnancies by 2015.
The Government is committed to making British aid more effective by improving transparency and
value for money4. This includes monitoring and reporting progress made in delivering results
commitments.
In 2011 DFID published a Results Framework outlining four levels of indicators that capture each
main stage through which inputs are transformed into developing country results:5

Level 1 indicators focus on progress against the MDGs, outcomes that cannot be attributed to
DFID alone but result from the collective action of countries and diverse development partners.

Level 2 indicators measure outputs and intermediate outcomes that can be directly linked to DFID
interventions. Level 2 indicators relevant for RMNH include:
a) number of births delivered with the help of a midwife, nurse or doctor through DFID support;
b) number of additional women using a modern method of family planning through DFID
support,
c) number of maternal lives saved through DFID support; and
d) number of newborn lives saved through DFID support.

Level 3 and 4 indicators measure the operational and organisational effectiveness of DFID, to
assess how effectively and efficiently DFID conducts its business.
In June 2012 DFID published its first Annual Report, as the main vehicle for reporting DFID results
and confirmed the commitment of the Government to publish progress against all indicators at all
levels on an annual basis.
In addition to the measurement of results, the RMNH FfR outline 4 additional processes for the
overall monitoring and evaluation of DFID’s contribution towards improving maternal and newborn
4
5
DFID Business Plan 2012 – 15. DFID, May 2012
DFID’s Results Framework. Managing and reporting DFID results. DFID, March 2011.
health:
1. Routine project and programme level evaluation;
2. Mid-term review (2013);
3. Global and partner monitoring and evaluating processes; and
4. Final evaluation (2015-16).
The Level 2 RMNH indicators, reported annually, will feed into and inform the above processes,
providing essential input data for the evaluation of programmes, the mid-term review and final
evaluation of the FfR as a whole.
Need for intervention
DFID has established internal processes to measure and report the number of safe deliveries and
number of additional users of modern methods of family planning through DFID support. Standard
methodology and supporting guidance notes have been developed and disseminated to relevant
cadres within DFID, including results and health advisors with responsibility for DFID programmes.
The first set of results were reported by Country Offices and multilateral programmes accordingly and
published in the 2012 Annual Report.
In contrast, DFID has not yet established methodology to measure maternal and newborn lives
saved. The 2012 Annual Report did not provide results on these indicators, but reported instead that
DFID was working with partners to establish internationally agreed methodology. This Business Case
sets out the rationale and process by which this task will be undertaken.
B. Impact and Outcome that we expect to achieved
Impact:
A global reduction in maternal and child mortality with accelerated progress towards attainment of
MDGs 4 and 5.
Outcome:
Improved effectiveness and value for money of DFID and partner RMNH programmes.
How outcome will lead to impact:
Routine monitoring of maternal and newborn lives saved will tell us the extent to which we have
achieved the results set out in the FfR. Combined with routine programme evaluation, global and
partner monitoring and evaluation, the mid-term review and final evaluation of the FfR this will
generate evidence on effective policy and programme interventions to improve the quality of lives of
women and children.
DFID will establish a Monitoring and Evaluation Reference Group (MERG) to bring cross DFID
coherence on all matters relating to monitoring and evaluation of the FfR. The ERG will review and
make recommendations in response to monitoring and evaluation findings. DFID will act on these
recommendations through a range of channels which include:

working through country programmes, using appropriate funding approaches in each case, to
support countries and communities to achieve our health goals;

working through relevant multilateral institutions that play important strategic coordination,
funding and normative guidance roles for the delivery of malaria and RMNH results;

improving the effectiveness and efficiency of the global response through international
institutions, partnerships and global civil society;

investing in global public goods including tackling resistance, building and sharing evidence
and supporting market efficiencies;

investing in research and working with academic partners to improve the evidence base in
terms of what works best to improve outcomes, and to improve the dissemination of this
knowledge; and

harnessing UK expertise through better partnerships with academics, civil society,
professional bodies and partnerships with other UK government departments to help deliver
this framework.
In addition to the Annual Reports (including lives saved results), findings of the mid-term review and
final evaluation will be disseminated widely as a global public good through mechanisms such as
DFID knowledge hubs and professional networks, posting on DFID internal and external websites,
and peer reviewed publications. Additionally, DFID’s unique position as a Board member of the
Partnership for Reproductive, Maternal and Child Health (PMNCH) and member of the RMNH
Alliance provides opportunity to share information and mobilize partners to take up evidence.
As DFID and partners implement evidence and revise policy and programmes accordingly, the
overall effectiveness and efficiency of the global response to maternal and newborn health will be
strengthened. Through improved efficiency a given level of investment will reach a wider population,
and through improved effectiveness programmes will have a greater impact on lives saved and
illness averted. As a result, there will be a global reduction in maternal and child mortality and
progress towards attainment of MDGs 4 and 5 will be accelerated.
Appraisal Case
A. What are the feasible options that address the need set out in the Strategic case?
Option 1
Internal DFID monitoring
Under this option DFID establishes a standard methodology against which DFID staff report the number
of maternal and newborn lives saved on an annual basis. Results are aggregated centrally.
Option 2
Select , through competitive tender, an external provider to measure lives saved
Under this option a tender is announced and a provider selected to develop and implement a
methodology for modelling lives saved and to measure annual and cumulative results accordingly.
Option 3
Direct contract to John Hopkins University (JHU) to estimate maternal and newborn lives
saved using the Lives Saved Tool (LiST)
Under this option JHU is contracted directly, without competition, to generate annual and cumulative
estimates of maternal and newborn lives saved using LiST
Option 4
The “Do Nothing” counterfactual
Under this option DFID does not measure the number of maternal and newborn lives saved through
DFID support.
B. Assessing the strength of the evidence base for each feasible option
As described above, the measurement of lives saved is part of the overall monitoring and evaluation
process of the FfR. The theory of change (Figure 1) assumes that provision of resources by DFID
together with the time of health and statistical advisors will enable the development/modification of a tool
to generate estimates of maternal and newborn lives saved through DFID support. Results generated
will measure progress over time towards DFID ‘lives saved’ goals. Annual results will be reviewed within
DFID and will inform the mid-term review of the RMNH FfR. DFID will take action in response to results
estimates and mid-term review recommendations in order to strengthen the portfolio of projects and
programmes to improve maternal and newborn health and ensure that goals are attained. Evidence on
the development and implementation of the tool will be widely disseminated through scientific literature
and meetings, enabling partners to conduct similar estimates of the outcomes of their projects and
modify projects and programmes in response. As a result the effectiveness of DFID and partner
activities to improve maternal and newborn health will be increased and progress towards MDGs 4 and
5 will be accelerated.
Figure 1
Theory of Change
INPUT
Monitoring and
evaluation reference
group: knowledge
and expertise
exploited through
quarterly meetings
and additional inputs
as required.
IMPACT
LiST Tool: the LIST tool
is modified to enable
retrospective estimation
of maternal and newborn
lives saved as a result of
DFID support.
Standard Template and
Guidance for reporting
input data: A set of input
data is defined, a
template for annual
reporting of data by
country offices is created
together with supporting
guidance.
Annual results
estimates: Estimates of
maternal and newborn
lives saved are generate
annually for DFID
supported countries and
aggregated for all DFID
support. Results are
reviewed by DFID and
inform midterm review
and final evaluation of
FfR. DFID RMNH
portfolio modified as
necessary in light of
findings.
Dissemination of
modified LiST and
evidence as a global
public good: Evidence
on development and use
of tool is disseminated
widely, enabling partners
to improve the monitoring
and evaluation of their
RMNH programmes and
take any necessary
action to improve
performance
A global reduction in maternal and child
mortality with accelerated progress
towards attainment of MDGs 4 & 5.
DFID staff time:
Policy, research and
country office staff
collaborate with JHU
to modify LiST.
Country office health
and results advisors
provide annual input
data for LiST
analysis.
OUTCOME
Improved effectiveness and value for money of DFID and
partner RMNH programmes.
DFID financial
resources: enable
JHU staff to
undertake project
including travel for
workshops to modify
LiST and to discuss
annual results with
DFID.
OUTPUT
In the table below the quality of evidence for each option is rated as either Strong, Medium or Limited
Option
Evidence rating
Rationale
1
Limited
Results cannot be tracked annually. Results not
statistically robust.
2
Limited
Delay in generation of first set of results. Significantly
greater time requirement from DFID staff compared to
other options.
3
Strong
Results can be generated within 1-2 months. Results
robust and credible with global community.
4
Limited
Since DFID has committed to publishing results annually
there are clear negative implications of not publishing.
Option 1 Internal DFID monitoring
DFID could develop a standard methodology against which DFID staff would report the number of
maternal and newborn lives saved on an annual basis. The obvious method to measure lives saved
would be to measure changes in maternal and newborn mortality rates within countries over time and to
combine these with population estimates to calculate a change in absolute numbers of deaths. Finally a
fixed attribution rate could be applied to determine the number of lives saved through DFID support.
However, national mortality rates are not monitored on an annual basis, are measured differently
between countries (eg DHS or MICS) and are subject to wide margins of error. Therefore, estimation of
results using this method would not be reliable and would not allow for annual progress to be tracked.
The DFID Maternal and Newborn Senior Research Fellows have advised against this approach.
Therefore this option is rated as LIMITED.
Option 2 Select, through competitive tender, an external provider to measure lives saved
An alternative approach to measure lives saved is to model estimates using a defined set of input data.
A computerized tool could be developed to generate estimates from the input data. Input data could be
gathered from national and/or global data sources.
Open competition would generate a range of proposals that could be assessed for their strengths and
weaknesses as well as cost, which would allow DFID to select the most robust and cost-effective
methodology.
However significant DFID input would be required under this option. Firstly, the procurement process
itself, including the review of alternative methodologies and understanding of proposed computerized
models, would consume a significant amount of time of procurement and technical staff within Policy and
Research Divisions. Secondly, to ensure ownership by DFID staff at country level, it would be necessary
to closely involve DFID country health and results advisors for the development and field testing of the
tool and methodology. DFID staff would also need to provide input data on an annual basis for the
model, and would need to be involved in the quality assurance of results generated.
Additionally, given the complexity of this task and the need to develop a computerized model to generate
the lives saved estimates this option would require a substantial amount of time before the first set of
results could be finalized. It is unlikely that results would be available in time for inclusion in the next
DFID annual report.
Therefore this option is rated as LIMITED.
Option 3
Direct contract to John Hopkins University (JHU) to estimate maternal and newborn lives
saved using the Lives Saved Tool (LiST)
LiST is a computer-based tool which allows users to set-up and run multiple scenarios to estimate the
impact of different packages of RMNH interventions and coverage levels for their countries, states or
districts. These scenarios provide a structured format for users to combine the best scientific information
about effectiveness of interventions for maternal, neonatal and child health with country specific
information about cause of death and current coverage of interventions to inform their planning and
decision-making as well as to help prioritize investments and evaluate existing programs. This tool
utilizes publically available information on demography, family planning, HIV (incidence as well as
prevention and treatment) and coverage of maternal and child health interventions to estimate the
number of lives saved by changes in these characteristics. The effect sizes and general model have
been developed by the Child Health Epidemiology Reference Group (CHERG) and are updated
regularly to reflect the most recent knowledge available. LiST is built into the freely available Spectrum
Policy Modelling Software (futuresinsitute.org).
LiST was devised by the John Hopkins Bloomberg School of Public Health. JHU remains the centre of
expertise in the use of LiST, including its potential application.
LiST is widely used in the RMNH community to estimate the impact of RMNH programmes. Generally,
LiST is used to estimate the potential impact of programmes at the planning stage, in order to guide the
most cost effective intervention or combination of interventions.
DFID internal consultation, in particular drawing on the expertise of the Maternal and Newborn Senior
Research Fellows, concluded that LiST would be an appropriate tool to measure maternal and newborn
lives saved. Although LiST has not, as yet, been used retrospectively to estimate lives saved from
programme activities, a collaboration between DFID and JHU to develop this methodology, and refine
LiST as necessary, could provide a global public good for implementation by other partners.
Under this Option a series of workshops, led by JHU, will be held with DFID staff to define input data,
revise and test the LiST model. Guidance will be prepared for DFID health and results advisors, outlining
the input data required and data sources. On an annual basis DFID staff will be asked to complete a
standard template to submit all required country level input data a (eg skilled birth attendant coverage,
contraceptive prevalence rate etc). This template will be sent directly to JHU. JHU will provide support to
DFID staff as required, to ensure that data submitted is accurate and complete. JHU will run the LiST
analysis and then share preliminary results with DFID staff for review and agreement before
presentation to the MERG.
Consultation with JHU has confirmed that this is a feasible option. Since the LiST model has already
been devised and is widely implemented the modification of the tool to generate lives saved estimates
can be done relatively quickly (2-3 months) and hence results estimates will be available soon thereby
meeting DFID’s commitment to publish results annually. However, as above, significant input from DFID
is required, including field testing, provision of input data and quality assurance of results.
Therefore this option is rated as STRONG.
Option 4
The “Do Nothing” counterfactual
Under this option DFID does not monitor, nor report, the number of maternal and newborn lives saved
through DFID support. This option would result in a failure of the Government to deliver on its
commitment for transparency and value for money through results reporting.
Therefore this option is rated as LIMITED.
What is the likely impact (positive and negative) on climate change and environment for each
feasible option?
Categorise as A, high potential risk / opportunity; B, medium / manageable potential risk / opportunity; C,
low / no risk / opportunity; or D, core contribution to a multilateral organisation.
Option
Climate change and environment risks Climate
change
and
environment
and impacts, Category (A, B, C, D)
opportunities, Category (A, B, C, D)
1
C
C
2
B
C
3
C
C
4
C
C
This programme has varying climate and environment risks depending on the option selected. The
second option – development of a new computerised tool – has a higher risk because it would entail
significant air travel and field testing in countries, thus travel-related emissions would be expected to be
significant. Option 1 has a low risk because in the first case there would be limited travel required as the
majority of the work would be done by country advisers already in-country, although some international
travel to support country advisers would be likely. Option 3 is considered low risk because the number of
meetings requiring air travel between the USA and the UK and from the USA to selected country offices
is limited. It is important that the project maximises the use of email, teleconferencing and videoconferencing to keep travel to the absolute minimum required.
None of the options offer any opportunities because of the focus of this programme is to model
estimated maternal and newborn lives saved and not to look at causes.
C. What are the costs and benefits of each feasible option?
Costs of each feasible option
Costs can be considered in 3 categories: contractor salary and benefits; contractor travel and per diem;
and DFID travel and subsistence.
A. Contractor salary and benefits
This includes the salary and associated benefits of staff employed by the contractor to undertake the
work. In Table 1 below, it is assumed that each contractor will allocate a Principle Investigator, Research
Associate and Administrative Assistant for the project. It is assumed that the annual salary and fringe
benefits are the same for each type of worker, regardless of the provider.
The ‘length of effort’ (LOE) to develop the tool and run annual models is estimated for both Option 3
(LiST anlaysis) and Option 2 (analysis using newly developed tool). LOE is greatest in 2012/13 since the
tool will be developed and tested during this time. Option 2 is estimated to require double the LOE in
2012/13 when compared to Option 3 since the former requires development of a new model and
computerized tool, whereas the latter only requires modification of an existing tool.
LOE in 2013/14 and 2014/15 are less than Year 1 and are the same for both options. LOE in these
years allows for data input, analysis and generation of results. In 2015/16 the LOE increases slightly
since an additional cumulative analysis will be undertaken and contractor staff may also contribute to the
final evaluation of the RMNH FfR and associated dissemination meetings.
There will be no contractor costs with Options 1 and 4.
Table 1 Contractor Salary and Benefits, Options 2 and 3
Salary plus
Staff description
LOE
fringe,
2012-2016*
2012/13
2013/14
2014/15
2015/16
Option 2
Principle Investigator
50%
15%
15%
20%
£75,865
Research Associate
80%
25%
25%
30%
£75,925
10%
5%
5%
5%
£8,812
Administrative Coordinator
Indirect costs @36% of
57,817
salaries and benefits
Option 2 Total
£218,419
Option 3
*Principle Investigator
25%
15%
15%
20%
£57,490
Research Associate
40%
25%
25%
30%
£57,525
5%
5%
5%
5%
£7,112
Administrative Coordinator
Indirect costs @36% of
salaries and benefits
Option 3 Total
£43,966
£166,093
* Annual salaries plus benefits in 2012/13 are estimated as follows:
Principle Investigator: £73,500; Research Associate: £46,000; Administrative Co-ordinator: £34,000
A 3% annual rate of inflation is applied for salary plus benefit in subsequent years.
B. Contractor travel and per diem costs
The contractor will be expected to travel on several occasions throughout the duration of the project. In
2012/13 (year 1) the contractor will organize tool development workshops to develop and field test the
model with DFID staff. For Option 3, it is estimated that three workshops will be conducted – one in
London, one in Asia and one in Africa. Option 2 is estimated to require six tool development workshops
since it is likely that the new tool will need greater testing and modification than Option 3.
It is also anticipated that the contractor will make annual trips to London to meet with DFID Policy, FCPD
and Research Staff in Years 1, 2 and 3 of the project. The purpose of these trips is to share and discuss
preliminary annual results for clarification and agreement. In the final year of the project it is anticipated
that the contractor will make 2 trips to London, one of which will be to discuss and agree final year and
aggregate results, and the second trip will be to participate in a possible dissemination event of the
RMNH FfR final evaluation.
Tables 2 and 3 describe the contractor travel and per diem costs for Options 2 and 3.
Table 2
Contractor travel and per diem, Option 2
Option 2
2012/13
2013/14
2014/15
Total all
years
2015/16
Cost
Number
of days
No
staff
Number
of trips
total
Number
of trips
Total
Number
of trips
Total
Number
of trips
Total
Journey cost
100
n/a
2
3
600
1
210
1
221
2
463
1,494
Daily per diem
Africa
300
6
2
3
10,800
1
3,780
1
3,969
2
8,335
26,884
1,250
n/a
2
2
5,000
0
0
0
5,000
170
7
2
2
4,760
0
0
0
4,760
1,100
n/a
2
2
4,400
0
0
0
4,400
170
7
2
2
4,760
0
0
0
4,760
London
Airfare
Daily per diem
Asia
Airfare
Daily per diem
Total Direct
30,320
3,990
4,190
8,798
47,297
Indirect costs
@36%
10,915
1,436
1,508
3,167
17,024
Total costs
41,235
5,426
5,698
11,965
64,325
*A rate of inflation of 5% per annum is applied to airfare and per diem costs
** It is assumed that the contractor is a European Institution and therefore travel costs to London have
been estimated at £100 per trip. This may or may not be the case.
Table 3
Contractor travel and per diem, Option 3
Option 3
2012/13
2013/14
Cost
Numbe
r of
days
No
staff
Number
of trips
total
Numbe
r of
trips
Airfare
Daily per
diem
Africa
550
n/a
2
2
2,200
300
6
2
2
Airfare
Daily per
diem
Asia
1,250
n/a
2
170
7
Airfare
Daily per
diem
1,100
170
2014/15
2015/16
Total
all
years
Total
Numbe
r of
trips
Total
Numbe
r of
trips
Total
1
1,155
1
1,213
2
1,273
8,215
7,200
1
3,780
1
3,969
2
4,167
26,884
1
2,500
0
0
0
2,500
2
1
2,380
0
0
0
2,380
n/a
2
1
2,200
0
0
0
2,200
7
2
1
2,380
0
0
0
2,380
London
Total Direct
Indirect costs
@36%
Total
18,860
4,935
5,182
5,441
44,558
6,790
1,777
1,865
1,959
16,041
26,650
6,712
7,400
60,599
0
7,047
0
*A rate of inflation of 5% per annum is applied to airfare and per diem costs
Option 1 (internal DFID monitoring) and Option 4 (‘do nothing’ counterfactual) incur no travel and per
diem costs.
C
DFID travel and subsistence costs
As outlined in Section B above, DFID country office and policy division staff will participate in the
workshops for the development and field testing of the computerized model. Workshops will be
organised in Africa for African based staff, in Asia for Asian based staff and in London for UK based staff
plus a small number of country office staff. Option 2 is estimated to require twice the number of
workshops when compared to Option 3 since the former requires development of a new model and
computerized tool, whereas the latter only requires modification of an existing tool.
Since the development of the model is not a routine activity and is not a responsibility of Country Offices,
DFID travel and subsistence costs for these workshops are included in this Business Case.
Table 4 Cost per workshop for DFID staff participation
Average
airfare
Visa
cost
Accommodation
per day
Subsisten
ce per
day
Number
of days
Cost
per
person
Number of
travelling
participants
Total per
workshop
London
1,000
0
150
60
5
2,050
2
4,100
Africa
1,000
80
100
50
5
1,750
10
18,300
Asia
1,000
80
100
50
5
1,750
10
18,300
Table 5 Total cost for DFID staff participation in workshops, Options 2 and 3
Option 2
Workshop location
London
Africa
Asia
Total
Number of
workshops
2
2
2
6
Option 3
Total cost
8,200
36,600
36,600
81,400
Number of
workshops
1
1
1
6
Total cost
4,100
18,300
18,300
40,700
Options 1 and 4 will not incur DFID staff travel and subsistence costs.
Table 6 Summary of costs
Contractor salary and
Contractor travel
DFID staff travel and
benefits
and per diem
subsistence
Option 1
£0
£0
£0
£0
Option 2
£218,419
£64,325
£81,400
£364,114
Option 3
£166,093
£60,599
£40,700
£267,392
Option 4
£0
£0
£0
£0
Total
Benefits of each feasible option
The purpose of the project is to generate annual and final cumulative estimates of maternal and
newborn lives saved. As described under Section B above, Options 1 and 3 could generate results
beginning in 2012/13. Therefore the total number of result estimates for these Options will be 5 (annual
results for 4 years plus a final cumulative set of results). Under Option 2 the first set of results will be
available in 2013/14 and therefore the total number of results estimates will be 4 (annual results for 3
years plus a final cumulative set of results). Under Option 4, no results will be generated.
Summary of costs and benefits of each feasible option
The costs and benefits of each feasible option are described in Table 7, below. Option 3 (contract to
JHU) offers the lowest cost per result estimate.
Table 7
Option
Option 1
Option 2
Option 3
Option 4
Summary of costs and benefits of each feasible option
Number of result
estimates
5
4
5
0
Cost
Cost per result estimate
0
£364,114
£267,392
0
£0
£91,029
£53,478
n/a. No results estimated
D. What measures can be used to assess Value for Money for the intervention?
Measures that will be used to assess value for money of the intervention include:

Cost per annual results estimate generated

Number (%) of annual estimates produced on time

Average number of days taken by each health and/or results advisor to gather and submit input
data plus time taken for review and finalization of result estimates
E. Summary Value for Money Statement for the preferred option
Options 1 and 4 are not considered appropriate since these options will not generate robust estimates of
lives saved that would stand up to public scrutiny.
The preferred option is Option 3, contract to JHU to estimate maternal and newborn lives saved using
LiST. This option will generate results beginning in 2012/13, and offers the lowest cost per result when
compared to competitive tender. Additionally, since LiST is a widely accepted and utilized tool, results
estimated using LiST are likely to be credible to the global community.
Commercial Case
Indirect procurement
A. Why is the proposed funding mechanism/form of arrangement the right one for this
intervention, with this development partner?
The work will be funded through an Accountability Grant to JHU. The Accountability Grant will specify
the purpose to which DFID funds will be used, the schedule of disbursement and reporting
requirements. The Grant will also provide for DFID to modify or terminate its financial support if any
changes occur which, in the opinion of DFID, impair significantly the development value of the work
or if JHU does not deliver the expected outputs.
JHU has the technical competence to perform the work and is recognized globally for its expertise in
designing and implementing LiST. JHU has run a previous training workshop for DFID staff on the
use of LiST, hence has a proven record of accountability to DFID, and has demonstrated the
competence of JHU staff to provide training and to support DFID advisors.
B. Value for money through procurement
JHU’s technical and commercial capabilities have been assessed to ensure that it can offer
sustainable quality which represents value for money throughout the life of the project. By hosting a
short series of workshops (in DFID offices) economies of scale will be achieved in revision of the
LiST model. Demands on DFID staff time will be minimized by the creation of a template and
guidance for the submission of data for the LiST analysis. JHU will conduct the actual analysis and
will engage with DFID staff through telephone and/or VC for any required follow up.
Since DFID aims to engage with a partner with demonstrable competence to generate lives saved
estimates, at a lower cost than through competitive tender, direct engagement with JHU rather than
open competition is justified.
Financial Case
A. What are the costs, how are they profiled and how will you ensure accurate forecasting?
As shown in Table 12 below, the estimated budget for the project is £267,393. The main cost drivers
are contractor salary and benefits; contractor travel and per diem costs; contractor indirect costs; and
DFID staff travel and subsistence costs.
A. Contractor salary and benefits
Contractor staff assigned to the project include a Principle Investigator, Research Associate and
Administrative Coordinator.
The salary and benefit costs of contractor staff are presented in Table 8 below. As described
previously, the LOEs for the Principle Investigator and Research Associate are highest in 2012/13
and lowest in 2013/14 and 2014/15. The annual salary of each staff member in 2012/13 is taken as
the baseline and an inflationary rate of 3% is applied thereafter.
Table 8
Contractor salary and benefits, by year
Baseline
annual
salary +
benefits
Principle
Investigator
Research Associate
Administrative
Assistant
Total salary plus
benefits
2012/13
2013/14
2014/15
2015/16
Total
LOE
Cost
LOE
Cost
LOE
Cost
LOE
Cost
73,500
46,000
25%
40%
18,375
18,400
15%
25%
11,356
11,845
15%
25%
11,696
12,200
20%
30%
16,063
15,080
57,490
57,525
34,000
5%
1,700
5%
1,751
5%
1,804
5%
1,858
7,112
38,475
24,952
25,700
33,000 122,127
B Contractor travel and per diem costs
In 2012/13 two staff members will travel to London, Africa and Asia in order to conduct workshops for
development of the LiST tool and to meet with DFID staff to present and discuss the first set of
results. In 2013/14 and 2014/15 two staff members will make one trip to London for the presentation
and discussion of results, and in 2015/16 two staff members will make two trips to London for the
presentation of results and possible participation in a dissemination workshop for the FfR evaluation.
Estimated travel and per diem costs are presented in Table 9.
Table 9
Contractor travel and per diem costs, by year
Travel
2012/13 2013/14 2014/15 2015/16
Total
Airfares
8,000
1,155
1,213
2,547
12,915
Per Diem
15,560
3,780
3,969
8,335
31,644
Total travel costs
23,560
4,935
5,182
10,882
44,559
C Contractor indirect costs
JHU policy stipulates an indirect cost of 36% for agreements with non-research external
organisations where the bulk of JHU work is conducted ‘on campus’. This rate is applied to JHU
direct costs in Table 10 below.
Table 10
Contractor indirect costs, by year
2012/13
2013/14
2014/15
2015/16
Total
Total salary, benefits and travel costs
62,035
29,887
30,882
43,882
166,686
Indirect cost
22,333
10,759
11,118
15,798
60,007
D
DFID staff travel and subsistence costs
In 2012/13 DFID staff will participate in workshops to develop the LiST Tool. There will be three
workshops with approximately 12 participants each. For the London workshop the majority of
participants will be UK based while two will be from overseas. For the African and Asia workshops
two participants will be locally based while the other 10 will travel from other countries in the Region.
Estimated costs include flights, visas and subsistence.
There will be no DFID staff travel after the first year of the project.
Table 11 DFID staff travel and subsistence costs, by year
2012/13
2013/14 2014/15 2015/16 Total
Travel
22,000
0
0
0
22,000
Subsistence
17,100
0
0
0
17,100
Visa
1,600
Total DFID costs
40,700
1,600
0
0
0
40,700
Summary of costs
Table 12 Summary of costs
2012/13
2013/14
2014/15
2015/16
Total
Contractor salary and benefits
38,475
24,952
25,700
33,000
122,127
Contractor travel and per diem
23,560
4,935
5,182
10,882
44,559
Contractor Indirect
22,333
10,759
11,118
15,798
60,007
40,700
0
0
0
40,700
125,068
40,646
42,000
59,680
267,393
DFID staff travel and
subsistence
Total
Forecasts of spend
JHU will provide annual budget reports and forecasts of spend to the DFID Programme Officer. If
there is any need to adjust the yearly budget, within the total envelope above, this will be discussed
and approved by DFID in advance of any adjustment.
B. How will it be funded: capital/programme/admin?
Programme budget – sitting with the Group Management Unit (Aries 203368)
C. How will funds be paid out?
Funds will be disbursed to JHU quarterly in arrears upon receipt of a detailed statement of
expenditure and consistent with Blue Book requirements.
D. What is the assessment of financial risk and fraud?
JHU has in place reasonable policies and procedures and systems for managing its finances and
procurement. It has a well-established finance and administrative office and extensive experience in
managing project budgets. All costs will be incurred directly by JHU hence there is minimal risk of
financial mismanagement or fraud.
E. How will expenditure be monitored, reported, and accounted for?
JHU will maintain records of the disbursement of grant money and will report activities completed and
expenditure on a quarterly basis. JHU will submit Annual Audited Accounts for each financial year of
the Accountability Grant.
DFID will:

Review annual work plans and budgets to monitor efficiency and identify cost savings

Track progress and budget execution through quarterly narrative and financial reports
Financial tracking and payments will be maintained in ARIES in accordance with Blue Book
requirements.
Management Case
A. What are the Management Arrangements for implementing the intervention?
A Project Officer will be assigned within the ARHT for the day to day administration of the project
including financial tracking, compliance and other administrative functions. An A2 health advisor will
provide the lead technical role, with support from the A1 Maternal and Newborn Health Advisor and the
Maternal and Newborn Senior Research Fellows.
Within JHU the project will be managed by a Principle Investigator, a member of the senior faculty of
JHU, supported by an administration officer.
B. What are the risks and how these will be managed?
The main risks and strategies to mitigate these risks are presented in Table 13 below.
Table 13
Risks and mitigation strategies
Risk
Failure to determine input data and
to modify LiST to generate lives
saved estimates
Probability
Low
Impact
High
DFID country offices do not provide
input data to JHU for the generation
of annual estimates
Low
High
JHU does not generate results as
scheduled. Insufficient information is
available for annual reports
Low
Moderate
Results generated are not credible
with the global community
Low
Low
Risk Mitigation Strategy
A series of workshops will be held with
DFID staff to develop and refine the LiST
tool. The DFID Maternal and Newborn
Senior Research Fellows will peer review
the model and methodology during
development and prior to implementation.
DFID staff will be involved in the
development of the tool and awareness will
be raised through health advisor and
statistical advisor cadre meetings. Standard
methodology will be developed, including a
table for input data and guidance will be
prepared on how to complete the table.
JHU will provide ongoing support to country
offices to ensure that input data is complete
and accurate.
The contractual arrangement with JHU will
stipulate that funds will only be disbursed if
JHU provides results in accordance with
the planned schedule. The technical lead
will maintain regular contact with JHU to
ensure that JHU is on track to deliver
results.
JHU will be encouraged to disseminate the
revised LiST tool and to publish scientific
literature on the development and
implementation of the tool. The mid- term
review of the FfR will provide opportunity
for independent external review of the
approach taken with recommendations
made to DFID as necessary
C. What conditions apply (for financial aid only)?
n/a
D. How will progress and results be monitored, measured and evaluated?
Progress and results will be monitored and evaluated within the context of the overarching monitoring
and evaluation framework of the RMNH FfR. The FfR monitoring framework tracks progress against all
RMNH Level 2 indicators and includes both a mid-term review and final evaluation. The measurement
of lives saved will provide input data to inform both the mid-term review and final evaluation.
Success will be measured by the generation of country level and aggregate estimates of maternal and
newborn lives saved on an annual basis.
A logical framework has been developed with indicators and targets against which progress will be
monitored by DFID. The logical framework will form the foundation of annual output-to-purpose reviews
of the project to examine progress against outputs and outcomes. A project completion report will be
conducted by DFID as a final assessment of project performance.
Lograme
Quest No of logframe for this intervention: 3689191
Download