Guidelines on the Monitoring & Evaluation of Implementing the PPA

advertisement
Republic of the Philippines
Department of Health
NATIONAL NUTRITION COUNCIL
Nutrition Bldg., 2332 Chino Roces Avenue
Extension, Taguig City
PPAN-IG No. 010
Revised March 2006
GUIDELINES ON THE MONITORING AND EVALUATION OF
IMPLEMENTATION OF THE PHILIPPINE PLAN OF ACTION FOR
NUTRITION AT PROVINCIAL, CITY AND MUNICIPAL LEVELS
I.
INTRODUCTION
The Philippine Plan of Action for Nutrition (PPAN) is the systematic integration of efforts of
government and private agencies and institutions to address the country’s malnutrition problem.
PPAN is formulated by the National Nutrition Council (NNC) and is part of the Philippine
Development Plan under the Human Development Chapter. PPAN intends to address and prevent
malnutrition through direct nutrition interventions and development measures.
The core and support programs of PPAN are implemented by member, cooperating and partner
agencies of NNC. At sub-national levels, PPAN is operationalized by various nutrition committees
composed of representatives from government and private sectors involved in the program, with local
chief executives at various levels serving as chairpersons.
Nutrition planning has been an institutionalized activity of the local nutrition committees. This is a
result of the continuing capability-building process made possible through technical, financial and
material support from NNC central and regional offices.
PPAN monitoring and evaluation has also been an institutionalized activity of the local nutrition
committees. It is a management tool to: (a) assess progress of plan implementation; (b) identify
strengths and weaknesses in implementing the local nutrition program; (c) institute appropriate
corrective measures; and (d) facilitate achievement of the plan's objectives.
This guideline on the monitoring and evaluation of local level plan implementation (MELLPI) was
formulated in 1979 to guide M&E by field implementers. While the activity stopped in 1986 because
of certain political adjustments, the activity resumed in 1991 after some adjustments.
This guideline is intended for use of PPAN implementors in conducting the MELLPI at the national,
regional, provincial, city and municipal levels.
II.
OBJECTIVES
The monitoring and evaluation of local level plan implementation aims to:
1.
Assess the efficiency of local level plan implementation, as indicated by the outreach of
activities undertaken relative to the local nutrition action plan, funds expended as well as the
management and support given by local executives and other implementing agencies.
2.
Measure changes in weight status of preschool and school children during the evaluation year
and the immediate past two years.
3.
Determine the extent to which nutrition is integrated into local development plans and
programs.
4.
Advocate for the continuing support for local nutrition programs.
III.
MECHANICS
1.
Organization of the Interagency Evaluation Team at the national, regional, provincial, city
and municipal levels
National Level
a.
The interagency National Evaluation Team (NET) is organized to evaluate the
municipalities, cities or provinces which are Consistent Regional Outstanding Winner in
Nutrition (CROWN) awardees.
b. Each team shall include 1 representative each from: National Nutrition Council (NNC)
Secretariat, NNC member agency –central office, and/or one (1) representative from the
private sector involved in nutrition duly recognized by NNC.
Regional/Provicial/City/Municipal Level
a Similar to NET, the Regional/Provincial/City/Municipal Evaluation Team (R/P/C/MET) is
organized to evaluate provinces, cities, municipalities and barangays with Nutrition Action
Plan/s (NAP/s).
b. The team will be composed of 2-3 members of the Regional/Provincial/City/Municipal
Nutrition Committee or their duly designated representatives. For relatively large
regions/provinces/cities/municipalities, two or more teams may be organized.
c. If possible, membership to the evaluation team must be rotated to ensure that all members
of Nutrition Committee are given the opportunity to assess the implementation of local
nutrition action plans.
d. A R/P/CET chairperson will be elected from among its members to ensure that the
monitoring and evaluation activities are carried out as planned.
e. The regional Nutrition Program Coordinator or P/C/M Nutrition Action Officer shall
coordinate the activities ensuring that provinces, cities and barangays with nutrition action
plans are covered in the monitoring and evaluation activity.
An orientation of the evaluation team shall be organized by the NNC-Secretariat/NPC/NAO
before the monitoring and evaluation visits start. The orientation shall cover a review of the
MELLPI guidelines and updates/adjustments made on the same. A protocol for the team on
how to conduct the visit shall be developed by the NNC and discussed with the Teams prior to
the visits.
2.
Schedule and Frequency of Monitoring and Evaluation
a.
Each region, province, city and municipality should conduct an annual evaluation
anytime between January to March.
b.
More frequent monitoring, e.g. quarterly, is encouraged particularly in nutritionally
depressed municipalities. The R/PET may divide into 2 teams of 3 members each to
monitor a cluster of areas (provinces/cities or municipalities and barangays) to make
quarterly monitoring more feasible.
3.
Areas to be Visited
a.
The R/P/CET should visit all provinces/cities/municipalities/barangays with nutrition
action plans in the region/province/city/municipality at least once within the year. The
R/P/CET will decide on the number of municipalities and/or barangays with nutrition
action plans to be visited within the province or city/municipality using the guide
below.
Number of municipalities/barangays Minimum number of
in the province/city/municipality
municipalities/barangays to be visited
10 or less
11-20
21-30
31 or more
2
3
4
5
2
To identify the specific municipality/barangay to be visited per P/C/M, the R/P/CET
should utilize a systematic sampling procedure with random start.
The procedure below is suggested:
a-1
Get the sampling interval using the formula:
Total no. of municipalities in the province
Sampling Interval = -----------------------------------------------------(for province)
No. of municipalities to be visited
Total no. of barangays in the
city/municipality
Sampling Interval = -----------------------------------------------------(for city/municipal)
No. of bgys./municipalities to be visited
For example:
1.
Province A has a total of fifteen (15) municipalities.
2.
The R/PET in Reg. A should visit at least three (3) municipalities in
Province A.
Thus: Sampling interval
a-2
=
15 =
3
5
Thus, if the sampling interval is 5, and the random start falls on the 2nd
municipality, the municipalities to be visited by the team will be the 2nd and 7th
municipality appearing on the list. The number one (1) or top performing
municipality/barangay in the province/city/municipality is automatically one of
the sample areas to be visited by the team. The same procedure should be used
in selecting the barangays to be visited in a city or municipality.
The following sampling techniques may also be used by the evaluation team in
identifying municipalities/barangays to be visited:
2-1.
According to prevalence of undernutrition.
Arrange the
municipalities/barangays according to prevalence of children with
weights below normal. The team may choose one area from each
cluster, e.g. high, middle and low prevalence.
2-2.
Computed Average Rank (CAR). Using the CAR of different areas
from Form A4 of the current P/C/MPAN, choose 1
municipality/barangay from each cluster. The number of clusters shall
depend on the number of municipalities/barangays to be visited by the
team.
2-3.
Fish bowl. Write the name of all municipalities or barangays in pieces
of paper and put in a bowl or box. From the bowl, pick the number of
desired number of sample municipalities or barangay.
2-4.
Geographic location. Group the municipalities/barangays according to
district or geographic location. Pick the required number of sample
municipalities/barangays from each group.
2-5.
Mixed. Combination of technique nos. 1 and 3, 1 and 4, 3 and 4 may be
used.
3
a-3.
Municipalities which are nominated for three (3) consecutive years by the PNC
as the Outstanding Municipality in the Province and have submitted plans for
the current year should also be visited by the RET.
a.4
CROWN awardees will be monitored by the NET for a period of three (3)
years, assuming the minimum score required for each year was met. An area
which failed to meet the minimum score shall again vie for the outstanding
city/province or outstanding municipality in the region.
a-5.
The R/P/CET is required to validate nutritional status data through actual
visitation of targeted barangays and validation weighing of sample
preschoolers equivalent to 10% of the total preschool population or a
maximum of 50.
a-6
The NET will also conduct validation weighing of 10% of the total PS and
compare the weight data collected by the PET with OPT records taken at least
six (6) months prior to the NET’s visit.
Only areas with nutrition action plans can vie for the award as outstanding
municipality in a province or region, outstanding city and outstanding province in the
region.
b.
The
R/P/C/MET
should
also
endeavor
to
visit
provinces/
cities/municipalities/barangays without nutrition action plans for monitoring purposes.
The evaluation teams may prioritize areas to be visited using the suggested criteria
below:
a)
b)
c)
d)
e)
no nutrition program is the area
non-functional nutrition committee
continued absence of a nutrition action plan (number of years without a
nutrition action plan may be used as an indicator)
high prevalence of Below Normal (low) and Below Normal (very low)
preschoolers
newly trained and deployed Nutrition Action Officer
The RET will monitor the CROWN awardees to help the area win the succeeding
awards or maintain its status. Provinces, cities and municipalities which are recipients
of the Nutrition Honor Award shall likewise be monitored by the RET at least annually
and by NET, whenever possible.
4
Monitoring Tools
Activity
a.
Form No.
User
Data gathering at
- Provincial/City level
- Municipal Level
- Barangay Level
1-P/C
1-M
1-B1
1-B2
RET and NET
RET, PET and NET
RET, PET and NET
RET, PET and NET
- Provincial/City/Municipal
2-P/C/M
RET, PET and NET
c.
Feedback to Areas Visited
before leaving the area
3
PET, RET and NET
d.
Ranking of Areas Evaluated
b.
Summary of Evaluation Results/
Final Evaluation Results
4
- Provinces and Cities
4-P/C
RET
- Municipalities
4-M
PET
The sources of data for filling out the MELLPI forms are provincial/city/municipal nutrition
action plans, PPAN quarterly reports, provincial/city/municipal evaluation wall charts,
minutes of meetings, attendance sheets of meetings, masterlist of clients for various programs,
progress reports, Provincial/City/Municipal Annual Investment Plan or Annual Budget
Report, correspondences and other records. Interview with the local chief executives,
members of the nutrition committees as well as other functionaries especially at the barangay
level shall be conducted by the Team to provide qualitative data that will complement and
supplement the information attained from the scoresheets and reference documents.
Instructions for filling up the MELLPI forms are in Attachment 1.
5.
Submission of Results
a.
Filled up scoresheets (Form 1-P/C, 1-B1, 1-B2, 2-P/C/M, and 4-P/C) used by the
R/PET in the regional/provincial evaluation should be submitted to the NNC-Regional
Office for validation before its submission to NNC-CO. This should be submitted
with the signatures of the chairperson and members of the R/PET in ink.
The NNC-RO or RET shall first validate the correctness and accuracy of the R/PET
following R/PET results before endorsement by the RET Chairperson to NNC-CO.
a1.
Filled up scoresheets (Form 1-P/C, 1-M, 1-B1, 1-B2, 2-P/C/M, 4-P/C, and 4-M)
submitted and signed by the chairperson and members of the RET in ink.
a2
Summary of candidates for Green Banner Award:
Outstanding Municipality in the Province
Outstanding Municipality in the Region
Outstanding Province/City in the Region
6.
b.
The N/R/PET shall provide written and/or oral feedback to nutrition committees
evaluated using Form 3 within 2 weeks after the visit. An oral feedback may be done
by the team immediately after the monitoring visit to present the initial results of the
visit.
c.
For potential CROWN awardees, the RET should attach a brief description of the
area’s outstanding and/or unique/innovative program/s including other
accomplishments related to nutrition, and awards received and action pictures.
Provisions for the Giving of Awards
a. For the municipality/city/province to qualify for an award, the following minimum final
score, must be satisfied.
Level
Award
Average rating
Provincial
Outstanding Municipality
in the Province
85
Regional
Outstanding Municipality
in the Region
88
Outstanding Province/City
in the Region
90
National
Consistent Regional Outstanding
Winner In Nutrition (CROWN)
Maintenance
- 1st year
5
90
- 2nd year
Nutrition Honor Award
b.
95
98
Provinces, cities and municipalities adjudged as outstanding in the following
categories will receive a Green Banner Award:
Outstanding Municipality in the Province
Outstanding Municipality in the Region
Outstanding Province in the Region
Outstanding City in the Region
7.
c.
Provinces, cities and municipalities adjudged as outstanding in the region for three (3)
consecutive years in the region can be nominated by the RET to receive the award
called Consistent Regional Outstanding Winner in Nutrition (CROWN). The
outstanding municipality in the region should come from among the first ranking
municipality in the provinces.
d.
The PET/RET/NET then submits the results and nominations for award to the RNC,
NNC and Technical Committee, respectively. The Regional and Provincial Nutrition
Committees may reserve the right not to declare an awardee in any category.
e.
Recipients of the CROWN award will be monitored by the NET for a period of three
(3) years. Should these areas meet the standards set by the NNC for maintenance
award, these areas shall be declared winner(s) of the Nutrition Honor Award. If these
fail to qualify after the third year, then these areas will have to again vie for
outstanding province, city or municipality in the region.
Declaration of winners
The list of winning areas can be disclosed only after the NET results/recommendations are
confirmed by the interagency NNC Technical Committee.
The NNC Secretariat will present the results of the evaluation to the NNC Technical
Committee for approval. Once the NNC Technical Committee has made its decision, such
will be considered final and irrevocable.
8.
Recognition of Provinces/Cities/Municipalities
In recognition of areas which have efficiently implemented the program, the NNC may award
the following, depending on resources available:
1.
The Green Banner award to the first ranking municipality in a province, and first
ranking province/city/municipality in the region and certificates of recognition to the
second and third ranking municipalities/cities/provinces.
2.
Cash award and/or plaque to the municipality/city/province adjudged as the Consistent
Regional Outstanding Winner in Nutrition (CROWN).
3.
Certificate of Recognition to the municipality/city/province which has maintained the
CROWN award.
4.
Cash award and/or plaque to the municipality/city/province which have been selected
for the Nutrition Honor Award.
6
Download