1
PERFORMANCE SUB-COMMITTEE
REPORT
2
PERFORMANCE SUB-COMMITTEE REPORT
Agenda
I. Why Progress Tracking?
II. Proposed approach
III. Decision Points
IV. Backup
3
BACKUP
Why focus on Progress Tracking?
Explanation
Actively monitor the
Harmonized Work
Plan 2008
• RBM partnership needs to report progress on the HWP 08 activities
(~ USD 33M budget) – ROI for the donors
• HWP 2008 has 6 priorities, > 100 activities, covering 12
mechanisms, that extend from end of 07 until end of 08
• > 50% of these activities involve collaboration between mechanisms:
mutual progress updates are important
• RBM partnership has defined high level targets for 2008
Report on RBM 2008
targets
Create links between
RBM activities and
impact on global
malaria control
targets
• Contribution from activities of HWP 2008 needs to be qualitatively
assessed and reported in order to improve future plans and
activities
• While RBM fills the vital resource gaps in the global malaria control,
majority of the impact/ outcomes fall outside of RBM partnership’s
control
• To gauge the appropriateness of its workplan budgets, however, the
partnership needs to measure the overall progress made by
countries through annual Landscape Report updates
4
BACKUP
At RBM, Progress Tracking Needs To Occur at Three Levels
Item Tracked
Level 1
Level 2
Level 3
Level of aggregation
HWP ‘08
Activities
• Progress reporting based on completion of activities
HWP ‘08
Targets
• Progress tracking against RBM HWP 2008 targets
RBM 2010
Targets
in the yearly Harmonized Work Plan (HWP) 2008
• Progress report on global targets by aggregating
country level data tracked by the partnership
5
At RBM, Progress Tracking Needs To Occur at Three Levels
Item Tracked
Level 1
Level 2
Level 3
Is RBM directly
accountable?
Why?
HWP 2008 Activities
• Activities have been defined by
RBM mechanisms
HWP 2008 Targets
• Targets involve implementation
and decisions beyond the RBM
mechanisms. E.g., 12-20
countries to deploy MIS
RBM 2010 Targets
• Targets involve implementation
and decisions beyond the RBM
mechanisms (e.g., in-country
and global actors)
• Achievement of outcomes take
long periods and need significant
in-country effort
6
Agenda
I.
Why Progress Tracking?
II.
Proposed approach
III. Decision Points
IV. Backup
7
Summary of Progress Tracking for Three levels
Level 1
Item
Tracked,
Example
Involvement
Output
Level 3
Activities defined in the HWP 2008
2008 Targets set by RBM partnership
RBM 2010 Targets
1.4.1 Provide consultant support to 45
malaria endemic sub-Saharan African
countries to complete needs
assessment and gap analysis including
partner and intervention mapping.
2008 targets for Priority 1:
By 2010, particularly in the lowest two
economic quintiles
 HWG Contracting out, Sep07 –Mar 08,
USD4.5M
• Support deployment of partnership
coordinators in 10 countries
•
• RBM Sec managed monitoring process
• Performance Sub comm. (PSC) and
RBM Sec. managed
• Performance Sub comm and RBM
Sec. managed
• Management dashboard with exception
handling capability updated
• Compiled based on interviews and
qualitative assessments on progress
• Compiled based on data from
countries and global malaria scene
• Monitored every 3 months
• Compiled every 6 months
• Compiled once a year
• Led by: RBM Sec
• Led by: PSC, RBM Sec.
• Led by: PSC, RBM Sec.
• WGs, SRNs and the board to input
into the process
• Chairs and co-chairs of WGs, SRNs
to participate in the process
• Countries, donors and other
constituencies of the partnership
• 3-monthly progress report by priority
and mechanism
• 6-monthly progress report by priority,
target and mechanism
• Yearly Malaria Landscape Report
• Exception reporting, “red flags”
• Exception reporting
• Report for EC
• Report for EC, Board
• Activities maintained in a shared file
Process
Level 2
• 45 technically sound, operationally
feasible ,country and partner owned
SUFI business plans
8
• 80% of people at risk from malaria
are protected
80% of malaria patients are
diagnosed and treated with effective
anti-malarial medicines …
• Other?
EXAMPLE
Measuring Progress at Level 1
Sample of output – Management Dashboard
What will be tracked: All priorities and All Mechanisms
Q1 2008 – Progress update on HWP 08
Total # of Activities = 140
Activities
100%
100%
100%
80%
80%
80%
60%
Planned
activities
20%
20%
Unplanned
activities
Budgets
Process for tracking
Q4 07
End of
Q1,Q2,
Q3, Q4 08
Q1
Planned
Q4 08
Q1 Budget
overspend
• Set up progress
tracking tool/system
• Set up progress tracking
tool/ system
• Consolidate yearly
progress
• Set up HWP activities
in progress tracking
system
• Launch monitoring process
end of every quarter
Exceptions
• Launch progress
tracking process with
WGs and SRNs and
set up expected
dates for monitoring
• Generate progress and
exception reports by priority
and mechanism
• Compile lessons learnt in
activity implementation,
goal setting and
monitoring process
• Report to the
Performance sub
committee and to the
Board on HWP progress
Action items
• Report to the EC and
launch activities needed to
make progress in HWP
9
0%
Ongoing
60%
40%
Untracked
Yet to
start
20%
Complete
0%
Ratios (>1 shows an exception)
USD
Million
Total ’08
Planned
Q1
Actual
Tracked
40%
40%
0%
60%
% of total Budget used
52 %
Budgets actual vs. planned
1.13 %
Budget needed vs. remaining for
uncommenced activities
1.13 %
% of total budget used vs. % of
Ongoing activities completed
10 % / 52 %
33
17
15
USD 2 M
•
XWG having unresolved resourcing issues
•
XARN unable to create awareness around X events
•
RBM Sec to convene a special EC call to resolve issues
•
..
EXAMPLE
Measuring Progress at Level 2
Sample of output (Based on Qualitative comments)
What will be tracked: 2008 Targets
Targets for 2008
1
• 45 technically sound, operationally feasible ,country
and partner owned SUFI business plans
• Support deployment of partnership coordinators in
10 countries
2
• >60% of countries applying for funding in Round8
(GFATM) to be successful
• 45 Countries mobilize adequate funds for SUFI
3
• At least 95% of countries currently getting funding
should continue to keep it
• At least 80% of countries with existing Global Fund
assistance should perform at "A" or “B1” ranking
4
• 12-20 countries to deploy MIS
• Publish Malaria Landscape report and update 107
country profiles
Process for tracking
5
End ‘07
• Agree on targets at
RBM Board 2007
meeting
• PSC and RBM Sec
set up process for
target 08
measurement
Jun ‘08
Nov ‘08
• An affordable facility for Malaria in place
• 45 countries have access to affordable medicines
for malaria through the private sector
• Launch mid-year Level2 • Launch end of year Level2
measurement process
measurement process
• Schedule interviews with • Schedule interviews with all
all chairs
chairs
6
• Compile report to the EC • Compile report to the partnership
and partnership on
board on findings (Discuss
findings
during 08 board meeting)
• Launch actions
10
• Track progress and report to the EC and the
partnership Board
• Partnership achieves > 80% implementation rate of
planned activities of the HWP
Progress to date
EXAMPLE
Measuring Progress at Level 3
What will be tracked: RBM 2010 Targets
Process for tracking
INPUT
• Total resources committed
End ‘07
• Volume of ITN inflows
Q1 08
Q4 08
• Measurement of Global Fund disbursement (and rating)
• General government expenditure on health as a percentage of total
government expenditure
• Per capita government expenditure on health at international dollar rates
OUTCOME
• Density of physicians and nurses per 1000 people
• People served as a % of people in need for ACT, ITN, IRS, IPT
• % of U5 children with malaria fever receiving appropriate treatment within 24
hours
• PSC agrees with
MERG and RBM
Sec. on the
parameters to
measure
• Launch measurement
process with donors,
countries and other
partnership
constituencies
• List of measurement
parameters agreed
and compiled
• Set up guidelines and
processes
• Compile data
• Analyze and prepare landscape
report
• Publish landscape report
Sample of output
• % of households with at least one ITN
• % of U5 children sleeping under ITN
• % of pregnant women sleeping under ITN
• % of pregnant women on IPT according to national policy
• % of households in malarious areas protected by IRS
• % of U5 children with uncomplicated malaria correctly managed at health
facilities
• % of health facilities with no stock-outs if nationally recommended anti-malarial
drugs continuously for 1 week during last 3 months
• % of malaria epidemics detected within 2 weeks of onset and properly controlled
IMPACT
• All-cause under 5 Mortality rate
• Anaemia prevalence in children under 5 years of age
• Parasite prevalence rates in community surveys
• Laboratory confirmed malaria cases seen in health facilities
• Laboratory confirmed malaria deaths seen in health facilities
• Malaria-attributed deaths in sentinel demographic surveillance sites
11
See RBM Malaria Landscape Report
Agenda
I.
Why Progress Tracking?
II.
Proposed approach
III. Decision Points
IV. Backup
12
DECISION POINTS
•
Review the content of the performance measures and the means by which
evaluative data will be captured
•
Discuss and Adopt progress reporting framework for the 2008 Harmonized
Work Plan
•
Discuss and systematize annual evaluation process and recommendations
for Performance Sub-Committee
•
Provide guidance on alignment of progress reporting framework with the
ongoing development of the Global Malaria Business Plan (between now and
May 2008)
•
Reaffirm its commitment to a results-oriented Partnership, and its own
collective responsibilities emerging from its position as the governing body of
the Partnership
13
Agenda
I.
Why Progress Tracking?
II.
Proposed approach
III. Decision Points
IV. Backup
14
BACKUP
Why focus on Progress Tracking?
Explanation
Actively monitor the
Harmonized Work
Plan 2008
• RBM partnership needs to report progress on the HWP 08 activities
(~ USD 33M budget) – ROI for the donors
• HWP 2008 has 6 priorities, > 100 activities, covering 12
mechanisms, that extend from end of 07 until end of 08
• > 50% of these activities involve collaboration between mechanisms:
mutual progress updates are important
• RBM partnership has defined high level targets for 2008
Report on RBM 2008
targets
Create links between
RBM activities and
impact on global
malaria control
targets
• Contribution from activities of HWP 2008 needs to be qualitatively
assessed and reported in order to improve future plans and
activities
• While RBM fills the vital resource gaps in the global malaria control,
majority of the impact/ outcomes fall outside of RBM partnership’s
control
• To gauge the appropriateness of its workplan budgets, however, the
partnership needs to measure the overall progress made by
countries through annual Landscape Report updates
15
BACKUP
At RBM, Progress Tracking Needs To Occur at Three Levels
Item Tracked
Level 1
Level 2
Level 3
Level of aggregation
HWP ‘08
Activities
• Progress reporting based on completion of activities
HWP ‘08
Targets
• Progress tracking against RBM HWP 2008 targets
RBM 2010
Targets
in the yearly Harmonized Work Plan (HWP) 2008
• Progress report on global targets by aggregating
country level data tracked by the partnership
16