DEVELOPMENT OF A MONITORING AND
EVALUATION SYSYEM TO SUPPORT
POVERTY REDUCTION AND GROWTH
IN VIETNAM
Contents





The importance of M&E in Vietnam & M&E
initiatives
The National ODA monitoring system &
monitoting tools to support
Proposed project rating system
Capacity building for M&E
Linking on ground activities and national
system
Vietnam MPI
M&E is important in Vietnam

Decree on ODA management has an M&E chapter



Hanoi Core Statement



Localisation of Paris Declaration
Specific commitments on harmonising M&E
Pilot National M&E System


3
Functions and procedures for M&E
PMU, line agencies and national agencies
Efforts to developed the M&E system made from 1998
Expect to institutionalise harmonised system during 2006
Vietnam MPI
4 M&E initiatives in Vietnam




Hanoi Core Statement
National monitoring & reporting system
Measuring progress of national objectives

5 year socio-economic development plan 2006-2010

Comprehensive Poverty Reduction & Growth Strategy
Partnership evaluations


Experience with Government of Japan
Using evaluation results for investment formulation
Vietnam MPI
Hanoi Core Statement

Commitments from Government & donors:






Harmonisation Action Plan
Annual work plan including:




Alignment to Government policy & systems
Harmonisation and simplification
Management for development results
Mutual accountability
Use of common results frameworks
Aligned reporting and monitoring formats
13 verifiable indicators reported annually
Baseline survey completed for all indicators
Vietnam MPI
Effectiveness and efficiency of national M&E system
National ODA monitoring system - history
First national portfolio monitoring report using aligned format
Institutionalise aligned format
Refine IT tools, guidelines & definitions to support aligned format
Commence using aligned format
Refine format and align GoV and donor systems
Detailed review of pilot monitoring system
National data flows begin from monitoring system
Refine institutional arrangements for monitoring practice
Pilot use of monitoring system: 6 Ministries & 7 Provinces
Extensive training of monitoring practitioners
Format revised, definitions agreed, IT tools developed to support use
Draft format developed and trialed with 6 loan projects
GoV and 5 Banks form partnership for reporting formats
Q1
Q2
Q3
2004
Q4
Q1
Q2
Q3
2005
Q4
Q1
Q2
Q3
2006
Q4
Vietnam MPI
National ODA monitoring system









Partnership with 5 Banks (80% ODA)
Harmonised format to reduce transaction costs
IT tools developed to support use
Trialled for 4 quarters (>20 projects)
Refined to align GoV and donor needs
Will be legalised in 2006
Reduces transaction costs for managers
Data consistency for increased analysis
Data consistency enables benchmarking
Vietnam MPI
National ODA monitoring system - logic
•ODA-MIS
•Aligned Monitoring Tool (AMT)
•National benchmarking indicators – process
•Sectoral benchmarking indicators - progress
•Portfolio Monitoring Tool (PMT)
•Portfolio and contract review tools
•National M&E Manual and Website
•National M&E Resource Centre
National
Agencies
Feedback &
Benchmarking
Quarterly
Portfolio
Analysis
Line
Agency
Donor
Quarterly
Portfolio
Analysis
Line
Agency
•Aligned Monitoring Tool (AMT)
•Portfolio Monitoring Tool (PMT)
•Sectoral benchmarking indicators - progress
•Portfolio and contract review tools
•National M&E Manual and Website
Line
Agency
Donor
Feedback &
Benchmarking
Quarterly
Progress
PMU
PMU
Quarterly
Progress
PMU
PMU
Quarterly
Progress
PMU
PMU
Quarterly
Progress
PMU
PMU
•Aligned Monitoring framework
•Definitions and procedures to support framework
•Aligned Monitoring Tool (AMT)
•Methods and tools in Manual progress monitoring
•National M&E Manual and Website
Vietnam MPI
Effectiveness and efficiency of national M&E system
National ODA monitoring system - future
Monitoring supports management for development results
Institutionalised feedback & benchmarking
Profession of M&E practitioners in Vietnam
National data flows from monitoring system
Demand for monitoring data to support management
Tools support use of institutionalised format
GoV and donors agree common set of outcome indicators
GoV and Donor data needs aligned in institutionalised format
2006
2008
2010
Vietnam MPI
AMT – Aligned Monitoring Tool









Compiles monitoring data from
PMU quarterly
Compares actual and plan
Tracks disbursement
Tracks procurement
Tracks activity outputs
Tracks safeguards
Enables variance from plan
analysis
Supports project management
Automatic rating system
Vietnam MPI
Monitor 3 types of change

Disbursement
Variance between actual and planned rate of
disbursement

Process
Variance between actual and planned time taken to
complete required processes for bidding, contract
implementation, resettlement and environmental
management

Performance
Variance between actual and planned
implementation of activities and achievement of
outputs
Vietnam MPI
PMT - Extracts data from the AMT
 Disbursement sheets
(disbursement rate)
ODA Stakeholders
Portfolio Monitoring Tool
 Procurement, resettlement and
environmental issues sheets
(process monitoring)
Portfolio analysis, sectoral
analysis and benchmarking
 Activity sheet (performance
monitoring)
Aligned Monitoring Reports
PMU 1
PMU 2
PMU 3
PMU 4
Vietnam MPI
ODA-MIS – acts as M&E archive




New, user friendly version
Data on all ODA projects
Data on all phases of
project cycle
Allows benchmarking by:





Sector
Line agency
Donor
Centrally located in FERD
Other line agencies will be
able to access online
Vietnam MPI
Health Rating – the Project
Project Indicators
 Disbursement
 Bidding Efficiency
 Activity Efficiency
 Contract Payments
 Resettlement Efficiency
 Resettlement Achievement
Rate
 Environmental Management
Efficiency
 Performance Indicators
Vietnam MPI
Project Rating System

Project Rating - Frequency Distribution - All Projects in Portfolio
7

6

No. of Projects
5
Disbursement
4
Procurement
Safeguards
3
Physical Progress

2
1

0
Unsatisfactory
Partly
Unsatisfactory
Partly Satisfactory
Satisfactory
Highly Satisfactory
Continuous process
Compare projects
Identify poor performing
projects
Target efforts to improve
them
Identify good performance
and learn lessons
Rating Scale
Vietnam MPI
Rating System – Guiding Principles
Project Rating - All Projects In Portfolio

35
Indicators that can be compared
within and between portfolios
30
Rating
25
Physical Progress
20
Benchmarking indicators
Safeguards
Procurement
15
Disbursement
10
5

0
Project 1
Project 2
Project 3
Project 4
Project 5
Max Possibile Score
Collect data once
Use data from the AMT
Project Name
Overall Project Rating - Frequency Distribution - By Sector

7
6
Avoid complex indicators
5
No. of Projects
Simple and believable
Health
4
Transport
Rural Development
3
Education
2
1
0
Unsatisfactory
Partly
Unsatisfactory
Partly Satisfactory
Satisfactory
Highly Satisfactory

Quality Assurance
Cross-checking data to make sure
its reliable
Rating Scale
Vietnam MPI
Capacity building for M&E



Creat a champion network for M&E since 2005
Select champions for M&E from ministries and provinces
Two types of champions:






Management level
Practitional level
Conduct Training of trainers
Regular meetings
Use champions to expand the M&E system at ministries
and provinces
Resources:



M&E manual
M&E website
Resource centre
Vietnam MPI
Linking on ground activities and national
system – an example
Vietnam MPI
Thank you for your attention
Mrs. Nguyen Linh Chi
linhchi.vamesp@vnn.vn