Monitoring & Evaluation: Overview Sam Muhula CHAK-M&E Officer ACHA-P workshop • Do you ever wonder how -%age of ART clients in 6 month cohort undergoing repeat CD4 testing rose from 52% to 73% is come about? OR • Prevalence of low birth weight in a country is 20%, • Results from M&E efforts What is M&E • Process by which data is collected, analyzed in order to provide information to policy makers and others for use in program planning and project management Monitoring Evaluation • What do you do? • Measures how well the program activities have met expected objectives? • How much does implementation • Extent to which changes in vary from site to site? outcome can be attributed to the program • Did the program benefit the intended people? • Focuses more on quality of program • ongoing continuous process • carried out at intervals • collection of data at multiple points thr’out program cycle • data collected at intervals • determine if activities need adjustments to improve desired outcomes • control group needed- change in outcome attributed to program Graphic illustration of program monitoring over time 1800 1600 Cumm-ever on ART Cumm-ever on ART 1400 No of PLWAs 1200 1000 800 600 400 200 0 Time Graphic illustration of program impact 1800 1600 Cumm-ever on ART Current on ART 1400 No of PLWAs 1200 1000 800 600 400 • Intention is to reduce the gap 200 0 Time Attrition= Low retention & High drop out Use of information • Find out causes of attrition in our program – Lost To Follow Up- Community component – Death- find out major cause of death – Transferred out- why – Stopped ART- self or physician? M & E functions Yes Illustrates progress towards achievements Highlights successes & shortcomings management of useful information Provide information needed for planning & decision making Provides evidence of effects of interventions Set up feedback systems neutral No × Used to “police” others and there work × determines failure × identifies those to punish × data manipulation to create false outcomes × data only reported upwards , and not used locally M & E plans M&E plan includes; • Anticipated relationship between activities, outputs and outcomes • List of data sources • Cost estimates for M&E activities • Responsible parties • Monitoring schedule • Indictor definitions • Dissemination and utilization plan of information gained M&E plan matrix Objective Performa nce Indicators Indicator Definition The indicator describes the facilitated exchange and To facilitate learning visits among the No. of south south-south partners and facilitated south CHAs for learning practical visits exchange & lessons from the conducted learning experiences that exist Data Resp Freque Target Sour onsib ncy of Values ce le reports party Monthly /quarterl y/biannually /annuall y Indicators • Variable that measures an aspect of a program • Measures the value of change in meaningful units • Focuses in a single aspect of a program – Narrowly defined to capture the aspect as precisely as possible • Can be quantitative or qualitative – Quantitative-numeric (Nos. or &ages) – Qualitative-descriptive (can be used to supplement the Nos. & %ages) Indicators (cont) • Qualitative indicators adds richness of information about the context in which the program has been operating – Examples; availability of updated CHAs directory, updated ACHAP website Challenges with M&E • Advance proper planning – M&E and programs do not communicate – Issues with budget – Not able to meet targets – Not able to evaluate program • Different funders=different and ever changing monitoring &reporting requirements • Inadequate understanding of what M&E is all about • Poor reporting culture Some online resources; • Measure evaluation training website – http://www.cpc.unc.edu/measure/training • Global health e-learning website – http://www.globalhealthlearning.org.