Overview of M&E System
•Results Framework and KPIs
•Program Monitoring
•Program Evaluation
•Support Activities
•Operations and Management
Mirrors the M&E Sub-manual
Outline
Why M&E?
• To know if we were able to achieve our objective:
Communities in target municipalities are
empowered to achieve improved access to
services and to participate in more inclusive
local planning, budgeting, implementation and
disaster risk reduction and management.
Monitoring vs. Evaluation
Monitoring
Evaluation
a continuing function that uses
systematic collection of data on
specified indicators to provide
management and the main
stakeholders of an on-going
development intervention with
indications of the extent of
progress and achievement of
objectives and progress in the
use of allocated funds.
Is a periodic, systematic
analysis of project or program
performance in terms of
achievement of higher
objectives, and to process the
lessons learned for improving
design during implementation
or applying the lessons to other
projects or programs.
“when, where, how much”
“why, how”
Program Development Objective:
 “Communities in the target municipalities
empowered to achieve improved access to
basic services and to participate in more
inclusive local planning, budgeting,
implementation and disaster risk reduction
and management”
Results Framework and KPIs
Program Development Objective
• 6 (End-of-Program) Outcome Indicators
•22 (Intermediate) Outcome Indicators
 6 indicators for Component 1: Barangay Grants
 10 indicators for Component 2: Capacity Building
and Implementation Support
 6 indicators for Component 3: Program
Management and M&E
Results Framework and KPIs
PROGRAM MONITORING
• Community Monitoring
• Operations Monitoring
• Results Monitoring
• Grievance Monitoring
• Geo-tagging
Types of Monitoring
Data Gathering, Processing
and Reporting
1) NPMO will randomly quality
check the approved data
1) NPMO will feed data
2) Process and publish them into
and manage
reports or maps.
information in the
3) Send feedback to regional level.
server.
1)
2)
3)
Thorough quality checking
Approval and consolidation
Send feedback to SRPMT.
1)
2)
3)
Check submitted data for clearance
Send feedback to municipal level
Post process data
1)
2)
Encoding to office desktop
Submit data to KC NCDDP server.
1)
Geo-tagging activities, gathering of forms, GRS, etc.
• Opportunity
 Data Sharing
 Avoids duplications
 Venue to clarify guidelines and directives
 Monitoring of higher level results
• Challenge
 Development of indicators, systems and tools
 Multiple stakeholders
 New approach for DSWD
 High expectations
Convergence
• Comes in the form of…
 Documents and record reviews
 Site visits
 Key informant interviews
 Focus group discussions
• Purpose…
 Assess the actual forms and procedures used
 Review data collection and handling
 Check the sufficiency and timeliness of data
 Check other concerns which affect data validity, accuracy and
integrity
Data Quality Assessment
Types of
Evaluation
Examples
Internal
Municipal Talakayan
External
Impact Evaluation by MCC and MCA-P
Thematic Studies by WB and ADB
Third party
Consultation mechanisms conducted
by others such as the CSOs,
Academes, future CDD investors, etc.
Types of Evaluation
SUPPORT ACTIVITIES
Program Information Management System
and Capability building
•
•
•
•
•
•
•
•
Desktop Application
Web Application
Business Intelligence
Geo-database/GIS
Android Applications
Interactive Website
Web Forum
LGU Dashboard
PIMS
• Staff Capacity Building
 Trainings
 TA and Coaching
• LGU and Community trainings on
M&E
Capacity Building
OPERATIONS &
MANAGEMENT
•
•
•
•
•
NPMO
RPMO
SRPMT
ACT
LGU counterpart staff
Roles in M&E
Role of ACTs in Program M&E
Area
Monitoring
Direct
Indirect
Filling-out of forms
Facilitate volunteers to fill-out
forms
Data gathering, review,
encoding and submission
Facilitate Community
Monitoring
Geo-tagging
Evaluation
Conduct of SET (as member of
MSIT)
Coordination and monitoring
of SET conduct
Grievance intake
Grievance resolution
Talakayan Implementation
Support to conduct of special
studies
PIMS
Support Activities
Maintenance of M&E
equipment and database
Training of volunteers
Training of LGUs
Community Monitoring
Forms and
Geo-tagging
CM and AR
SET
GRS
Operational
Results
Geo-tagging
KPI
Talakayan
External IE
and Studies
Third Party
•
•
•
•
•
•
If you do not measure results, you cannot tell success from failure.
If you cannot see success, you cannot reward it.
If you cannot reward success, you are probably rewarding failure.
If you cannot see success, you cannot learn from it.
If you cannot recognize failure, you cannot correct it.
If you can demonstrate results, you can win public support.
Adapted from Osborne & Gaebler, 1992
The Power of Measuring
Results