Introduction to Monitoring & Evaluation

advertisement
Monitoring & Evaluation:
Overview
Sam Muhula
CHAK-M&E Officer
ACHA-P workshop
• Do you ever wonder how -%age of ART clients
in 6 month cohort undergoing repeat CD4
testing rose from 52% to 73% is come about?
OR
• Prevalence of low birth weight in a country is
20%,
• Results from M&E efforts
What is M&E
• Process by which data is collected, analyzed in
order to provide information to policy makers
and others for use in program planning and
project management
Monitoring
Evaluation
• What do you do?
• Measures how well the program
activities have met expected
objectives?
• How much does implementation • Extent to which changes in
vary from site to site?
outcome can be attributed to the
program
• Did the program benefit the
intended people?
• Focuses more on quality of
program
• ongoing continuous process
• carried out at intervals
• collection of data at multiple
points thr’out program cycle
• data collected at intervals
• determine if activities need
adjustments to improve desired
outcomes
• control group needed- change in
outcome attributed to program
Graphic illustration of program monitoring over time
1800
1600
Cumm-ever on ART
Cumm-ever on ART
1400
No of PLWAs
1200
1000
800
600
400
200
0
Time
Graphic illustration of program impact
1800
1600
Cumm-ever on ART
Current on ART
1400
No of PLWAs
1200
1000
800
600
400
• Intention is to reduce the gap
200
0
Time
Attrition=
Low
retention
& High
drop out
Use of information
• Find out causes of attrition in our program
– Lost To Follow Up- Community component
– Death- find out major cause of death
– Transferred out- why
– Stopped ART- self or physician?
M & E functions
Yes
Illustrates progress towards
achievements
Highlights successes &
shortcomings
 management of useful
information
Provide information needed
for planning & decision making
Provides evidence of effects of
interventions
Set up feedback systems
neutral
No
× Used to “police” others and
there work
× determines failure
× identifies those to punish
× data manipulation to create
false outcomes
× data only reported upwards ,
and not used locally
M & E plans
M&E plan includes;
• Anticipated relationship between activities,
outputs and outcomes
• List of data sources
• Cost estimates for M&E activities
• Responsible parties
• Monitoring schedule
• Indictor definitions
• Dissemination and utilization plan of
information gained
M&E plan matrix
Objective Performa
nce
Indicators
Indicator Definition
The indicator describes the
facilitated exchange and
To facilitate
learning visits among the
No. of
south south-south partners and
facilitated
south
CHAs for learning practical
visits
exchange &
lessons from the
conducted
learning
experiences that exist
Data Resp Freque Target
Sour onsib ncy of Values
ce
le reports
party
Monthly
/quarterl
y/biannually
/annuall
y
Indicators
• Variable that measures an aspect of a program
• Measures the value of change in meaningful
units
• Focuses in a single aspect of a program
– Narrowly defined to capture the aspect as
precisely as possible
• Can be quantitative or qualitative
– Quantitative-numeric (Nos. or &ages)
– Qualitative-descriptive (can be used to
supplement the Nos. & %ages)
Indicators (cont)
• Qualitative indicators adds richness of
information about the context in which the
program has been operating
– Examples; availability of updated CHAs directory,
updated ACHAP website
Challenges with M&E
• Advance proper planning
– M&E and programs do not communicate
– Issues with budget
– Not able to meet targets
– Not able to evaluate program
• Different funders=different and ever changing
monitoring &reporting requirements
• Inadequate understanding of what M&E is all
about
• Poor reporting culture
Some online resources;
• Measure evaluation training website
– http://www.cpc.unc.edu/measure/training
• Global health e-learning website
– http://www.globalhealthlearning.org.
Download