M&E establishes clear links for past, present and future initiatives and development results Helps to extract relevant information from past and on-going activities Provides evidence for fine-tuning or reorientation of a project/programme Determines if work is going in the right direction 04/11/2013 Monitoring is the on-going process by which stakeholders obtain regular feedback on the progress being made towards achieving their goals and objectives / targets and outcomes 04/11/2013 Clarifies program objectives Links activities and their resources to objectives Translates objectives into performance indicators and set targets Routinely collects data for these indicators, compares actual results with targets Reports progress to managers and alerts them to problems 04/11/2013 Evaluation is the use of social science methods to collect, analyze, interpret and communicate data about the effectiveness of a policy, program or project Evaluation is a rigorous and independent assessment of either completed or ongoing activities to determine the extent to which they are achieving stated objectives and contributing to Decision-making. 04/11/2013 Monitoring is focused on tracking evidence of movement towards the achievement of specific, predetermined targets Evaluation takes a broader view of an intervention, considering not only progress toward stated goals, but the logic of the initiative, as well as its consequences Both are needed to be able to better manage policies, programs, and projects 04/11/2013 Define the project work. Develop success indicators and their measures Collect the evaluation data. Analyze and interpret the data. Use the evaluation results 04/11/2013 The purpose of the review is to enable the health sector to undertake a stock taking exercise so that it can assess its performance in key technical programmes in relation to set objectives and targets over the years within the 5YPOW. Lessons learnt should enable it to take corrective actions to improve performance in the following year. 04/11/2013 1.To assess the progress made on the implementation of recommendations of the previous reviews 2.To review the technical performance of priority programmes in the past year 3. To identify challenges and enabling factors for implementation 4. To identify best practices (innovations that influence attainment of results). 5. To agree on modalities for scaling up. 04/11/2013 FINANCING THE HEALTH SECTOR SERVICE DELIVERY, PRIORITY HEALTH INTERVENTIONS AND INSTITUTIONAL CARE ORGANIZATION AND MANAGEMENT OF HEALTH SERVICES planning and budgeting; financial management; procurement INVESTMENTS Capital Investment Human resource dev., health information 04/11/2013 An indicator is a specific measure, that when tracked systematically over time indicates progress (or not) toward a specific target • Indicators asks the question: – How will we know success when we see it? Indicator Development should be “CREAM” C R E A M - Clear Relevant Economic Adequate Monitorable 04/11/2013 Makes explicit the intended objectives of government action – (“Know where you are going before you get moving”) • Outcomes are what produce benefits • Clearly setting outcomes is key to designing and building results-based M&E system • Important! Budget to outputs, management to outcomes! 04/11/2013 Routine medical and other records - part of the broader health information management system; Mortality records and reports from health facilities. Vital systems registration and community registration Data from organizations providing community‐based services Procurement systems (forecasting quantification, storage and distribution systems) Financial disbursements 04/11/2013 Mapping available services in health facilities and other health settings; Health facility surveys; Population‐based surveys; Surveillance data (e.g. behavioural and biological surveys) 04/11/2013 Data collection, storage and management including data recording tools, data reporting forms, databases, Electronic systems for data‐sharing and analysis. 04/11/2013 Possible sources of Baseline data Written records (paper & electronic) Individuals involved with the intervention The general public Trained observers Mechanical measurements and tests Geographic information systems Sources are who or what provide data NOT the method of collecting data 04/11/2013 Performance reviews – This is the first step of the review process Specifically, each department conducts a selfreview by collecting, collating, analyzing and reporting on its performance using data generated routinely within the health delivery system. 04/11/2013 Assessment of capacity within the health sector for planning, monitoring and evaluation, and support to NGOs (including private sector) in light of existing and future needs Review of current arrangements for leading and guiding the financing approach and for external aid coordination, and recommendations for enhancing communications and working arrangements Assessment of status of health sector/agencies working relationship 04/11/2013 1. Decide how to obtain the data you need from each source 2. Prepare data collection instruments 3. Develop procedures for use of the data collection instruments 04/11/2013 Desk top study to review all relevant policy documents underpinning POW Field visits to Regions, Districts, and Tertiary institutions Reconciliation of releases and payments from the Accounts Division Briefing meetings with relevant stakeholders 04/11/2013 Gives information on the status of projects, programs, and policies Provides important information over time on trends and directions Helps confirm or challenge theory of change Provides clues to problems 04/10/2013 Data quality issues should include • Timeliness • Periodicity • Consistency • Confidentiality, data security and data accessibility – 04/11/2013 Purpose of the data auditing process for the Monitoring of the National Response activities is: To ensure increased credibility and validity of primary data provided by implementing agencies. To ensure that accurate data reporting is done 04/11/2013 Data quality assessments (Local quality controls and checks) should be carried out periodically and regularly to identify weaknesses in data collection and reporting systems, and to constantly improve data quality and accuracy. 04/11/2013 Outcome and impact indicators can be derived from : Population based or household surveys DHS, MICS, and AIS Behavioural survey KAP Facility Based surveys Community based surveys Client satisfaction surveys Cost effective and cost benefit studies An analytical approach known as ‘triangulation’ integrates multiple data sources to improve the understanding of a public‐health problem. It is used to guide programmatic decision‐making to address such problems. 04/11/2013 The Health responses can be strengthened through different types of research Clinical/Epidemiologic; Socio-Cultural/Behavioural; Health systems. 04/11/2013 EXAMPLES: Factors that influence adherence to medical regimens, Factors that influence uptake of diagnosis, testing and decisions. 04/11/2013 INFORMATION DISSEMINATION A dissemination process should be structured and encouraged for information to be shared at all levels with project managers, data collectors and beneficiaries (PLWHA, community leaders) and the general public Dissemination platforms may include the documentation centres established at national and provincial levels. 04/11/2013 Communication spaces available to disseminate the data to the general public include the radio, television and print media and SMS messages. Regular production of newsletters and the development of an effective web based information system with chat rooms , blogs. etc 04/11/2013