Doc id
Working Draft - Last Modified 02/04/2012 09:24:35
FP Summit
Monitoring and Accountability
Printed 1/6/2012 3:08:26 PM
Background for the RHSC RMA Working Group June 2012
| 0
Doc id
Objectives
Monitoring and Accountability
1.
Define Purpose of the Work Stream
Working Draft - Last Modified 02/04/2012 09:24:35
2. Introduce the Monitoring & Accountability Technical and
Advisory Groups
3.
Outline Vision for Success
4.
Describe Basic Objectives for Achieving the Vision
Monitoring
–
Accountability
–
Links and Contributions to EWEC and MDG Platforms
Printed 1/6/2012 3:08:26 PM
5.
–
Summary: Conceptual Framework
| 1
Doc id
Purpose of the work stream
Working Draft - Last Modified 02/04/2012 09:24:35
To develop an approach linked with MDG5b and the
EWEC Accountability Framework, to track performance
towards Family Planning Summit goals and objectives,
and to ensure:
1. Rigor on family planning tracking with an eye on
program innovation, coverage, and scale.
Printed 1/6/2012 3:08:26 PM
2. Country ownership; alignment with country-specific
policies and reporting processes
3. Stewardship and accountability at global and
country levels; emphasis on voluntary FP, rights,
equity and choice.
4. Broad-based participation of non-state actors and
civil society.
| 2
Doc id
Introduction to monitoring & accountability team
Technical Working Group
▪ Bill & Melinda Gates Foundation
▪ Demographic and Health Surveys (DHS)
▪ Department for International Development (DFID)
▪ Futures Institute
Working Draft - Last Modified 02/04/2012 09:24:35
▪ Guttmacher Institute
▪ United Nations Population Fund (UNFPA)
▪ United States Agency for International Development (USAID)
▪ University of North Carolina, MEASURE Evaluation Project
▪ World Health Organization (WHO)
▪ McKinsey & Co
Complemented by a larger Advisory Group
Printed 1/6/2012 3:08:26 PM
▪ Advance Family Planning
▪ AFIDEP
▪ Buffet Foundation
▪ Childrens Investment Foundation
▪ Health Metrics Network
▪ International Planned Parenthood Federation (UK)
▪ Population Council
▪ RHSC
▪ Packard (fellow)
| 3
Doc id
Vision for success has 5 elements
Monitoring
Working Draft - Last Modified 02/04/2012 09:24:35
1 Increased frequency, comparability and quality of a core set of consensus FP indicators,
including resource tracking
▪ Agreed, common set of indicators to reflect both supply & demand side factors such as access,
sensitive to discrimination and coercion
▪ Sourced from surveys and routine health information systems
▪ Emphasis on innovative approaches to improving data quality and availability
▪ Support to increase the frequency and availability of results
2 Country ownership; build capacity and minimize redundant, parallel reporting systems
Accountability
4 Global metrics working group/data warehouse to drive stewardship and accountability through
published results and communication strategies
▪ Build on successful scorecard platforms (eg ALMA malaria scorecard) by incorporating spatial
elements of data presentation and dynamic interactive user environment
5 Strong links between every step of this process and wider MDG5b and EWEC
monitoring and accountability frameworks
May 7, 2012
© 2012 Bill & Melinda Gates Foundation
| 4
Printed 1/6/2012 3:08:26 PM
General
3 Data use for performance management and compliance; feedback loops
▪ FP Effort Index or its equivalent
▪ Published updates on progress against objectives including quality of care and equity
▪ Dashboard review process by country committees
▪ Watchdog function for ensuring voluntary family planning and choice
▪ Role for civil society in holding governments, donors and providers to account
Doc id
Basic objectives to achieve vision; work stream remit
… the monitoring and accountability team has
objectives to deliver in time for the Summit
1 Increased frequency, comparability and quality
of a core set of consensus FP indicators
▪ Draft core set of indicators to collect in all
countries
▪ Dashboards of these indicators for regular
review by
– In-country committees
– Global monitoring platform
– FPS governance mechanism
– EWEC / MDG monitoring platforms
▪ Description of work needed to improve
frequency, comparability and quality of core
indicators; track resource flows effectively
Track FP resource flows effectively, building on
extant models, focus on simplicity
Monitoring
2 Country ownership; minimize redundant,
parallel reporting systems
Accountability
General
▪ Draft description of process needed to align
with country policy, programs, data
systems
▪ Draft process at country level to use reported
data for FP program improvement ;
emphasis on actionable measurement and
watchdog function
4 Global metrics platform/data warehouse to
drive stewardship & accountability through
published results; communication strategies
▪ Description of tools and process at global
level to drive accountability through results
(e.g., internet enabled GIS system, public
scorecard system, etc)
5 Strong links between every step of our process
and wider RMNCH / MDG monitoring and
accountability framework
▪ Framework and workplan for linking FP
monitoring to the country and global EWEC /
MDG monitoring and accountability systems
Printed 1/6/2012 3:08:26 PM
3 Data use for performance management and
compliance; feedback loops; oversight of family
planning volunteerism and choice
Working Draft - Last Modified 02/04/2012 09:24:35
For each element of what good monitoring and
accountability looks like…
| 5
Doc id
Summary: Improved monitoring and accountability will be delivered
through a framework linked to EWEC and MDG monitoring and
Feedback loops
accountability mechanisms
FP Summit activities
Detail on next page
UN Secretary General
Progress monitoring and accountability
across MDGs (including 5b)
▪
Family Planning Summit Accountability
and Monitoring
▪ Global level (Monitoring WG and governance body)
▪ Country level (Focus on in-country committees)
Funding / resource
flows for FP
FP data from
combination of
sources
Donors, countries
and users fund FP
Countries act to
improve FP
▪
▪
Track progress in
reaching the 120m
additional women
Publish country
progress
Define core set of
indicators to
populate FP
performance
dashboards
Improve quality,
frequency and
comparability of
data from multiple
sources used to
support FP indicators
1 UN Secretary General, iERG, WHO Secretariat, plus PMNCH and others
May 7, 2012
© 2012 Bill & Melinda Gates Foundation
| 6
Printed 1/6/2012 3:08:26 PM
▪ Partner countries
▪ Donors
▪ Implementing Partners
Collect and report on indicators based on specific
commitment, pledge, etc.
▪
Define indicators
to be tracked
Civil Society
▪ Holds governments,
donors and providers
to account for
commitments and
rights based
approach; advocacy
Every Woman Every Child1
Progress monitoring and accountability across
RMNCH (indicator #4 = met need for
contraception)
Working Draft - Last Modified 02/04/2012 09:24:35
Country level
feedback loop
Data drives
accountability and
program
improvement
Doc id
Summary: The detail of the accountability and monitoring platform shows
Feedback loops
how it will drive improvements at both global and country level
FP Summit activities
Detail of how the Summit will drive accountability and program improvements at global and country level
RMNCH / MDG monitoring
Country level Accountability and Monitoring
Platform
(In-country committees)
Donors,
countries and
users fund FP
Countries act to
improve FP
In country committees collect and review data on
progress and program performance regularly
 Oversee data reporting process
 Review country progress through regular review of
dashboard1 of indicators
 Ensure voluntary family planning and choice
Printed 1/6/2012 3:08:26 PM
- Partner countries
- Donors
- Implementers
Collect data on FP performance and
funding flows
Working Draft - Last Modified 02/04/2012 09:24:35
Global Accountability and Monitoring
(Monitoring Working Group and governance
structure)
Monitoring Working Group works to improve data and
drives progress towards reaching 120m women and
accountability
▪ Define agreed set of FP indicators to track
▪ Support work to improve frequency and quality of these
indicators
▪ Review dashboard1 of indicators, including progress
towards 120 million women on a regular basis
▪ Use insights from this review to drive progress
▪ Publish indicators online using GIS or scorecards to
improve accountability
Country committees drive program improvements by
countries through feedback loop
▪ Data used to drive improvements in FP programs through
defined processes (e.g., “red flag” mechanism)
▪ Data used to drive progress towards 120m women in each
country
Civil society drive improvements through feedback loop
▪ Civil society actively engaged in driving governments to
improve FP access, choice and accountability
1 In-country and global dashboards will focus on different indicators – those most relevant to their roles
May 7, 2012
© 2012 Bill & Melinda Gates Foundation
| 7
Doc id
Indicators: Progress to date
•
•
Developed conceptual framework and long list of indicators (enabling
environment and commitments, supply and demand interventions and
measurable change, contraceptive practice, impacts)
Improving quality and frequency of the data – population and facility
surveys, routine service data/HMIS, client exit interviews
Working Draft - Last Modified 02/04/2012 09:24:35
Printed 1/6/2012 3:08:26 PM
• Indicators include:
- Enabling environment: policy, goal and plan, financing
- Supply interventions: procurement and forecasting; supply chain and
stockouts; coverage; availability of choice of methods; access to post
partum and PAC FP;
- Demand: financing for tailored demand interventions; knowledge and
attitudes; intention to use;
- Contraceptive practice: MCPR (numbers of users) and unmet need for
spacing and limiting, disaggregated by age, wealth, residence; method mix;
informed choice; informed consent; new acceptors, renewers and method
switchers; discontinuation rates
- Outcomes: TFR; ABR; unintended pregnancies and abortions averted;
maternal, infant and neonatal deaths averted
Key questions:
How to monitor non discrimination and informed consent?
Integration indicators?
How to build in equity measurements?
| 8