A3 Mainstreaming Monitoring & Evaluation

advertisement

M&E establishes clear links for past, present
and future initiatives and development results

Helps to extract relevant information from
past and on-going activities

Provides evidence for fine-tuning or reorientation of a project/programme

Determines if work is going in the right
direction
04/11/2013
Monitoring is the on-going process
by which stakeholders obtain
regular feedback on the progress
being made towards achieving
their goals and objectives /
targets and outcomes
04/11/2013

Clarifies program objectives

Links activities and their resources to objectives

Translates objectives into performance indicators
and set targets

Routinely collects data for these indicators,
compares actual results with targets

Reports progress to managers and alerts them
to problems
04/11/2013
Evaluation is the use of social science methods
to collect, analyze, interpret and communicate
data about the effectiveness of a policy, program
or project
Evaluation is a rigorous and independent
assessment of either completed or ongoing
activities to determine the extent to which they
are achieving stated objectives and contributing
to Decision-making.
04/11/2013
Monitoring is focused on tracking evidence of
movement towards the achievement of specific,
predetermined targets
Evaluation takes a broader view of an
intervention, considering not only progress
toward stated goals, but the logic of the
initiative, as well as its consequences
Both are needed to be able to better manage
policies, programs, and projects
04/11/2013

Define the project work.
Develop success indicators and their
measures

Collect the evaluation data.

Analyze and interpret the data.


Use the evaluation results
04/11/2013
The purpose of the review is to enable the
health sector to undertake a stock taking
exercise so that it can assess its
performance in key technical programmes
in relation to set objectives and targets over
the years within the 5YPOW.
 Lessons learnt should enable it to take
corrective actions to improve performance
in the following year.

04/11/2013





1.To assess the progress made on the
implementation of recommendations of the previous
reviews
2.To review the technical performance of priority
programmes in the past year
3. To identify challenges and enabling factors for
implementation
4. To identify best practices (innovations that
influence attainment of results).
5. To agree on modalities for scaling up.
04/11/2013

FINANCING THE HEALTH SECTOR

SERVICE DELIVERY, PRIORITY HEALTH
INTERVENTIONS AND INSTITUTIONAL CARE

ORGANIZATION AND MANAGEMENT OF
HEALTH SERVICES
planning and budgeting; financial management;
procurement

INVESTMENTS
Capital Investment Human resource dev., health
information
04/11/2013
An indicator is a specific measure, that when tracked
systematically over time indicates progress (or not)
toward a specific target
• Indicators asks the question:
– How will we know success when we see it?
Indicator Development should be
“CREAM”
C
R
E
A
M
-
Clear
Relevant
Economic
Adequate
Monitorable
04/11/2013
Makes explicit the intended objectives of
government action
– (“Know where you are going before you get
moving”)
• Outcomes are what produce benefits
• Clearly setting outcomes is key to designing
and building results-based M&E system
• Important! Budget to outputs, management
to outcomes!
04/11/2013






Routine medical and other records - part of the
broader health information management system;
Mortality records and reports from health
facilities.
Vital systems registration and community
registration
Data from organizations providing
community‐based services
Procurement systems (forecasting
quantification, storage and distribution systems)
Financial disbursements
04/11/2013

Mapping available services in health facilities and
other health settings;

Health facility surveys;

Population‐based surveys;

Surveillance data (e.g. behavioural and biological
surveys)
04/11/2013
Data collection,
 storage and management including
data recording tools,
 data reporting forms,
 databases,
 Electronic systems for data‐sharing
and analysis.

04/11/2013
Possible sources of Baseline data

Written records (paper & electronic)

Individuals involved with the intervention

The general public

Trained observers

Mechanical measurements and tests

Geographic information systems
Sources are who or what provide data NOT
the method of collecting data
04/11/2013
Performance reviews –


This is the first step of the review process
Specifically, each department conducts a selfreview by collecting, collating, analyzing and
reporting on its performance using data generated
routinely within the health delivery system.
04/11/2013

Assessment of capacity within the health sector for
planning, monitoring and evaluation, and support to
NGOs (including private sector) in light of existing and
future needs

Review of current arrangements for leading and
guiding the financing approach and for external aid
coordination, and recommendations for enhancing
communications and working arrangements

Assessment of status of health sector/agencies
working relationship
04/11/2013
1.
Decide how to obtain the data you
need from each source
2. Prepare data collection instruments
3. Develop procedures for use of the
data collection instruments
04/11/2013

Desk top study to review all relevant policy
documents underpinning POW

Field visits to Regions, Districts, and Tertiary
institutions

Reconciliation of releases and payments from the
Accounts Division
Briefing meetings with relevant stakeholders
04/11/2013
 Gives
information on the status of
projects, programs, and policies
 Provides important information
over time on trends and directions
 Helps confirm or challenge theory
of change
 Provides clues to problems
04/10/2013

Data quality issues should include
• Timeliness
• Periodicity
• Consistency
• Confidentiality, data security and data
accessibility –
04/11/2013
Purpose of the data auditing process for the
Monitoring of the National Response activities is:


To ensure increased credibility and validity
of primary data provided by implementing
agencies.
To ensure that accurate data reporting is
done
04/11/2013

Data quality assessments (Local quality
controls and checks) should be carried out
periodically and regularly to identify
weaknesses in data collection and reporting
systems, and to constantly improve data
quality and accuracy.
04/11/2013
Outcome and impact indicators can be derived from :

Population based or household surveys DHS, MICS,
and AIS

Behavioural survey KAP

Facility Based surveys

Community based surveys
Client satisfaction surveys
Cost effective and cost benefit studies
An analytical approach known as ‘triangulation’ integrates
multiple data sources to improve the understanding of a
public‐health problem. It is used to guide programmatic
decision‐making to address such problems.



04/11/2013
The Health responses can be strengthened
through different types of research
 Clinical/Epidemiologic;
 Socio-Cultural/Behavioural;
 Health
systems.
04/11/2013
EXAMPLES:


Factors that influence adherence to
medical regimens,
Factors that influence uptake of
diagnosis, testing and decisions.
04/11/2013
INFORMATION DISSEMINATION


A dissemination process should be structured
and encouraged for information to be shared at
all levels with project managers, data collectors
and beneficiaries (PLWHA, community leaders)
and the general public
Dissemination platforms may include the
documentation centres established at national
and provincial levels.
04/11/2013


Communication spaces available to disseminate
the data to the general public include the radio,
television and print media and SMS messages.
Regular production of newsletters and the
development of an effective web based
information system with chat rooms , blogs. etc
04/11/2013
Download