Republic of the Philippines Department of Health NATIONAL NUTRITION COUNCIL Nutrition Bldg., 2332 Chino Roces Avenue Extension, Taguig City PPAN-IG No. 010 Revised March 2006 GUIDELINES ON THE MONITORING AND EVALUATION OF IMPLEMENTATION OF THE PHILIPPINE PLAN OF ACTION FOR NUTRITION AT PROVINCIAL, CITY AND MUNICIPAL LEVELS I. INTRODUCTION The Philippine Plan of Action for Nutrition (PPAN) is the systematic integration of efforts of government and private agencies and institutions to address the country’s malnutrition problem. PPAN is formulated by the National Nutrition Council (NNC) and is part of the Philippine Development Plan under the Human Development Chapter. PPAN intends to address and prevent malnutrition through direct nutrition interventions and development measures. The core and support programs of PPAN are implemented by member, cooperating and partner agencies of NNC. At sub-national levels, PPAN is operationalized by various nutrition committees composed of representatives from government and private sectors involved in the program, with local chief executives at various levels serving as chairpersons. Nutrition planning has been an institutionalized activity of the local nutrition committees. This is a result of the continuing capability-building process made possible through technical, financial and material support from NNC central and regional offices. PPAN monitoring and evaluation has also been an institutionalized activity of the local nutrition committees. It is a management tool to: (a) assess progress of plan implementation; (b) identify strengths and weaknesses in implementing the local nutrition program; (c) institute appropriate corrective measures; and (d) facilitate achievement of the plan's objectives. This guideline on the monitoring and evaluation of local level plan implementation (MELLPI) was formulated in 1979 to guide M&E by field implementers. While the activity stopped in 1986 because of certain political adjustments, the activity resumed in 1991 after some adjustments. This guideline is intended for use of PPAN implementors in conducting the MELLPI at the national, regional, provincial, city and municipal levels. II. OBJECTIVES The monitoring and evaluation of local level plan implementation aims to: 1. Assess the efficiency of local level plan implementation, as indicated by the outreach of activities undertaken relative to the local nutrition action plan, funds expended as well as the management and support given by local executives and other implementing agencies. 2. Measure changes in weight status of preschool and school children during the evaluation year and the immediate past two years. 3. Determine the extent to which nutrition is integrated into local development plans and programs. 4. Advocate for the continuing support for local nutrition programs. III. MECHANICS 1. Organization of the Interagency Evaluation Team at the national, regional, provincial, city and municipal levels National Level a. The interagency National Evaluation Team (NET) is organized to evaluate the municipalities, cities or provinces which are Consistent Regional Outstanding Winner in Nutrition (CROWN) awardees. b. Each team shall include 1 representative each from: National Nutrition Council (NNC) Secretariat, NNC member agency –central office, and/or one (1) representative from the private sector involved in nutrition duly recognized by NNC. Regional/Provicial/City/Municipal Level a Similar to NET, the Regional/Provincial/City/Municipal Evaluation Team (R/P/C/MET) is organized to evaluate provinces, cities, municipalities and barangays with Nutrition Action Plan/s (NAP/s). b. The team will be composed of 2-3 members of the Regional/Provincial/City/Municipal Nutrition Committee or their duly designated representatives. For relatively large regions/provinces/cities/municipalities, two or more teams may be organized. c. If possible, membership to the evaluation team must be rotated to ensure that all members of Nutrition Committee are given the opportunity to assess the implementation of local nutrition action plans. d. A R/P/CET chairperson will be elected from among its members to ensure that the monitoring and evaluation activities are carried out as planned. e. The regional Nutrition Program Coordinator or P/C/M Nutrition Action Officer shall coordinate the activities ensuring that provinces, cities and barangays with nutrition action plans are covered in the monitoring and evaluation activity. An orientation of the evaluation team shall be organized by the NNC-Secretariat/NPC/NAO before the monitoring and evaluation visits start. The orientation shall cover a review of the MELLPI guidelines and updates/adjustments made on the same. A protocol for the team on how to conduct the visit shall be developed by the NNC and discussed with the Teams prior to the visits. 2. Schedule and Frequency of Monitoring and Evaluation a. Each region, province, city and municipality should conduct an annual evaluation anytime between January to March. b. More frequent monitoring, e.g. quarterly, is encouraged particularly in nutritionally depressed municipalities. The R/PET may divide into 2 teams of 3 members each to monitor a cluster of areas (provinces/cities or municipalities and barangays) to make quarterly monitoring more feasible. 3. Areas to be Visited a. The R/P/CET should visit all provinces/cities/municipalities/barangays with nutrition action plans in the region/province/city/municipality at least once within the year. The R/P/CET will decide on the number of municipalities and/or barangays with nutrition action plans to be visited within the province or city/municipality using the guide below. Number of municipalities/barangays Minimum number of in the province/city/municipality municipalities/barangays to be visited 10 or less 11-20 21-30 31 or more 2 3 4 5 2 To identify the specific municipality/barangay to be visited per P/C/M, the R/P/CET should utilize a systematic sampling procedure with random start. The procedure below is suggested: a-1 Get the sampling interval using the formula: Total no. of municipalities in the province Sampling Interval = -----------------------------------------------------(for province) No. of municipalities to be visited Total no. of barangays in the city/municipality Sampling Interval = -----------------------------------------------------(for city/municipal) No. of bgys./municipalities to be visited For example: 1. Province A has a total of fifteen (15) municipalities. 2. The R/PET in Reg. A should visit at least three (3) municipalities in Province A. Thus: Sampling interval a-2 = 15 = 3 5 Thus, if the sampling interval is 5, and the random start falls on the 2nd municipality, the municipalities to be visited by the team will be the 2nd and 7th municipality appearing on the list. The number one (1) or top performing municipality/barangay in the province/city/municipality is automatically one of the sample areas to be visited by the team. The same procedure should be used in selecting the barangays to be visited in a city or municipality. The following sampling techniques may also be used by the evaluation team in identifying municipalities/barangays to be visited: 2-1. According to prevalence of undernutrition. Arrange the municipalities/barangays according to prevalence of children with weights below normal. The team may choose one area from each cluster, e.g. high, middle and low prevalence. 2-2. Computed Average Rank (CAR). Using the CAR of different areas from Form A4 of the current P/C/MPAN, choose 1 municipality/barangay from each cluster. The number of clusters shall depend on the number of municipalities/barangays to be visited by the team. 2-3. Fish bowl. Write the name of all municipalities or barangays in pieces of paper and put in a bowl or box. From the bowl, pick the number of desired number of sample municipalities or barangay. 2-4. Geographic location. Group the municipalities/barangays according to district or geographic location. Pick the required number of sample municipalities/barangays from each group. 2-5. Mixed. Combination of technique nos. 1 and 3, 1 and 4, 3 and 4 may be used. 3 a-3. Municipalities which are nominated for three (3) consecutive years by the PNC as the Outstanding Municipality in the Province and have submitted plans for the current year should also be visited by the RET. a.4 CROWN awardees will be monitored by the NET for a period of three (3) years, assuming the minimum score required for each year was met. An area which failed to meet the minimum score shall again vie for the outstanding city/province or outstanding municipality in the region. a-5. The R/P/CET is required to validate nutritional status data through actual visitation of targeted barangays and validation weighing of sample preschoolers equivalent to 10% of the total preschool population or a maximum of 50. a-6 The NET will also conduct validation weighing of 10% of the total PS and compare the weight data collected by the PET with OPT records taken at least six (6) months prior to the NET’s visit. Only areas with nutrition action plans can vie for the award as outstanding municipality in a province or region, outstanding city and outstanding province in the region. b. The R/P/C/MET should also endeavor to visit provinces/ cities/municipalities/barangays without nutrition action plans for monitoring purposes. The evaluation teams may prioritize areas to be visited using the suggested criteria below: a) b) c) d) e) no nutrition program is the area non-functional nutrition committee continued absence of a nutrition action plan (number of years without a nutrition action plan may be used as an indicator) high prevalence of Below Normal (low) and Below Normal (very low) preschoolers newly trained and deployed Nutrition Action Officer The RET will monitor the CROWN awardees to help the area win the succeeding awards or maintain its status. Provinces, cities and municipalities which are recipients of the Nutrition Honor Award shall likewise be monitored by the RET at least annually and by NET, whenever possible. 4 Monitoring Tools Activity a. Form No. User Data gathering at - Provincial/City level - Municipal Level - Barangay Level 1-P/C 1-M 1-B1 1-B2 RET and NET RET, PET and NET RET, PET and NET RET, PET and NET - Provincial/City/Municipal 2-P/C/M RET, PET and NET c. Feedback to Areas Visited before leaving the area 3 PET, RET and NET d. Ranking of Areas Evaluated b. Summary of Evaluation Results/ Final Evaluation Results 4 - Provinces and Cities 4-P/C RET - Municipalities 4-M PET The sources of data for filling out the MELLPI forms are provincial/city/municipal nutrition action plans, PPAN quarterly reports, provincial/city/municipal evaluation wall charts, minutes of meetings, attendance sheets of meetings, masterlist of clients for various programs, progress reports, Provincial/City/Municipal Annual Investment Plan or Annual Budget Report, correspondences and other records. Interview with the local chief executives, members of the nutrition committees as well as other functionaries especially at the barangay level shall be conducted by the Team to provide qualitative data that will complement and supplement the information attained from the scoresheets and reference documents. Instructions for filling up the MELLPI forms are in Attachment 1. 5. Submission of Results a. Filled up scoresheets (Form 1-P/C, 1-B1, 1-B2, 2-P/C/M, and 4-P/C) used by the R/PET in the regional/provincial evaluation should be submitted to the NNC-Regional Office for validation before its submission to NNC-CO. This should be submitted with the signatures of the chairperson and members of the R/PET in ink. The NNC-RO or RET shall first validate the correctness and accuracy of the R/PET following R/PET results before endorsement by the RET Chairperson to NNC-CO. a1. Filled up scoresheets (Form 1-P/C, 1-M, 1-B1, 1-B2, 2-P/C/M, 4-P/C, and 4-M) submitted and signed by the chairperson and members of the RET in ink. a2 Summary of candidates for Green Banner Award: Outstanding Municipality in the Province Outstanding Municipality in the Region Outstanding Province/City in the Region 6. b. The N/R/PET shall provide written and/or oral feedback to nutrition committees evaluated using Form 3 within 2 weeks after the visit. An oral feedback may be done by the team immediately after the monitoring visit to present the initial results of the visit. c. For potential CROWN awardees, the RET should attach a brief description of the area’s outstanding and/or unique/innovative program/s including other accomplishments related to nutrition, and awards received and action pictures. Provisions for the Giving of Awards a. For the municipality/city/province to qualify for an award, the following minimum final score, must be satisfied. Level Award Average rating Provincial Outstanding Municipality in the Province 85 Regional Outstanding Municipality in the Region 88 Outstanding Province/City in the Region 90 National Consistent Regional Outstanding Winner In Nutrition (CROWN) Maintenance - 1st year 5 90 - 2nd year Nutrition Honor Award b. 95 98 Provinces, cities and municipalities adjudged as outstanding in the following categories will receive a Green Banner Award: Outstanding Municipality in the Province Outstanding Municipality in the Region Outstanding Province in the Region Outstanding City in the Region 7. c. Provinces, cities and municipalities adjudged as outstanding in the region for three (3) consecutive years in the region can be nominated by the RET to receive the award called Consistent Regional Outstanding Winner in Nutrition (CROWN). The outstanding municipality in the region should come from among the first ranking municipality in the provinces. d. The PET/RET/NET then submits the results and nominations for award to the RNC, NNC and Technical Committee, respectively. The Regional and Provincial Nutrition Committees may reserve the right not to declare an awardee in any category. e. Recipients of the CROWN award will be monitored by the NET for a period of three (3) years. Should these areas meet the standards set by the NNC for maintenance award, these areas shall be declared winner(s) of the Nutrition Honor Award. If these fail to qualify after the third year, then these areas will have to again vie for outstanding province, city or municipality in the region. Declaration of winners The list of winning areas can be disclosed only after the NET results/recommendations are confirmed by the interagency NNC Technical Committee. The NNC Secretariat will present the results of the evaluation to the NNC Technical Committee for approval. Once the NNC Technical Committee has made its decision, such will be considered final and irrevocable. 8. Recognition of Provinces/Cities/Municipalities In recognition of areas which have efficiently implemented the program, the NNC may award the following, depending on resources available: 1. The Green Banner award to the first ranking municipality in a province, and first ranking province/city/municipality in the region and certificates of recognition to the second and third ranking municipalities/cities/provinces. 2. Cash award and/or plaque to the municipality/city/province adjudged as the Consistent Regional Outstanding Winner in Nutrition (CROWN). 3. Certificate of Recognition to the municipality/city/province which has maintained the CROWN award. 4. Cash award and/or plaque to the municipality/city/province which have been selected for the Nutrition Honor Award. 6