Type of Review: Annual Review Project Title: MADHYA PRADESH HEALTH SECTOR REFORM PROGRAMME (MPHSRP) Date started: 2007 Date review undertaken: May - June 2014 Instructions to help complete this template: Before commencing the annual review you should have to hand: the Business Case or earlier project documentation. the Log frame the detailed guidance (How to Note)- Reviewing and Scoring Projects the most recent annual review (where appropriate) and other related monitoring reports key data from ARIES, including the risk rating the separate project scoring calculation sheet (pending access to ARIES) You should assess and rate the individual outputs using the following rating scale and description. ARIES and the separate project scoring calculation sheet will calculate the overall output score taking account of the weightings and individual outputs scores: Description Outputs substantially exceeded expectation Outputs moderately exceeded expectation Outputs met expectation Outputs moderately did not meet expectation Outputs substantially did not meet expectation Scale A++ A+ A B C Introduction and Context What support is the UK providing? DFID will provide £120m (over 2007 - 2015) to Govt of Madhya Pradesh (GoMP, India) to increase provision and use of quality health services, especially by the poorest people. MPHSRP will help the GoMP to achieve accelerated reduction in maternal mortality, infant mortality and child malnutrition. What are the expected results? What will change as a result of our support? DFID support for MPHSRP aims to help Govt of MP achieve the following results by 2015: Decrease in Maternal Mortality Ratio from 335 (in 2005) to 230 per 100,000 live births. Decrease in Infant Mortality Ratio from 76 (in 2006) to 47 per 1000 births. Decrease in the proportion of undernourished children from 58% (in 2005) to 45%. Increase in deliveries conducted by nurses and doctors from 47% in 2008 to 85%. Increase in full immunisation coverage from 36% (2008) to 58%. Increase in % of children o Breastfed within an hour of birth from 43% (2008) to 65%; o Exclusively breast fed till 6 months from 31% (2008) to 50%; What are the planned Outputs attributable to UK support? There 5 priority outputs that are attributable to UK support: 1. Quality public and private health, sanitation and nutrition services available in underserved districts 2. Improved Human Resource Management in Health Sector 3. Financial management and procurement systems improved 4. Increased Demand for Nutrition, Health and Sanitation Services 5. Monitoring and Evaluation Systems Strengthened How will we determine whether the expected results have been achieved? Baseline for key indicators is available and monitoring systems are in place to provide regular information on progress against expected results. The technical and financial performance of the programme is assessed on a six-monthly and annual basis, to monitor progress against the log frame and to agree the plans for subsequent tranches of funding. Additionally, independent measurements of maternal child health and nutrition service coverage (utilization and quality) is undertaken through regular surveys, evaluation studies and National Government led health review missions. 1 What is the context in which UK support is provided? What need are we trying to address? Madhya Pradesh (MP) is one of the poorest states in India, with over 54% of its population living below the poverty line. Despite progress in recent years, MP is currently off track on MDG 1, 4 and 5 (nutrition, maternal and child mortality). MP has the highest infant mortality rate of all states in India, although it has declined from 76 to 56 infant deaths per 1000 live births over 2006 to 2012. A high maternal mortality ratio of 335 per 100,000 births in 2006 has now declined to 230 per 100,000 births in 2012: however it is much higher than the national average of 178 per 100,000 births. An estimated 160,000 mothers and children die every year because of easily preventable and treatable medical complications. More than half (58%) the children in MP are undernourished. Important contributors to under nutrition include access and availability of food, poor infant and child feeding and caring practices, poor sanitation and repeated diarrhoea. Indicators 2006 Progress Maternal Mortality Ratio 335 per 100,000 births 230 (SRS 2010 -12) Infant Mortality Rate 76 per 1000 live births 56 (SRS 2012) Contraceptive Prevalence Rate 53% 59.3% (AHS 2012) Under-weight children (0-5 year) 58% 52% (NIN 2011) Deliveries taking place in health facilities 47% 79.7% (AHS 2012) Children aged 12-23 months fully immunized 36% 59.7% (AHS 2012) Children fully breast fed till 6 months of age 31% 39.7% (AHS 2012) The performance of the public health delivery system faces several constraints: per capita expenditure of public health is low (at $8, against a global standard of $34 for a minimum package of essential healthcare); high ‘out of pocket’ expenditures (on diagnostics and medicines); staff vacancies and infrastructure gaps; lack of drugs and other essential supplies at local levels; weak monitoring systems; poor accountability of health personnel, low motivation and management capacity. What will we do to tackle this problem? DFID’s financial and technical assistance will help GoMP in delivery of maternal, child health and nutrition services in the poorest, remote, rural and underserved areas. DFID funds will help in improved functioning of primary hospitals, child feeding centres, monitoring and supervision, community mobilisation, staff training and health communications. Technical assistance will help Government of Madhya Pradesh (GoMP) in better health planning and human resource management; improved monitoring and procurement systems. Areas of support for health and nutrition services include the following: Improved Quality of hospital services for maternal, neonatal and child health; Scaling up quality and coverage of monthly integrated village based health and nutrition days and strengthening community demand for health and nutrition and sanitation services; Promoting behaviour change communications with special focus on the first 1000 days of life and nutrition behaviours like breast feeding and complementary feeding; Setting up and functioning of state Nutrition Mission and delivery of district nutrition plans; Strengthen drug procurement and distribution systems for availability of essential medicines at 50 district hospitals and 1400 sub-district hospitals; Support in developing a health human resource database and rational deployment of 12,000 doctors and nurses in remote areas; and Capacity development at all levels, supportive supervision, IT enabled MIS, strengthening financial management and procurement systems. Who will be implementing the support we provide? The programme is implemented by the Department of Public Health and Family Welfare (DPHFW), Department of Women and Child Development (DWCD) and the Departments of Panchayati Raj and Rural Development, Govt of Madhya Pradesh. The Technical and Management Support Agency, placed in MP manages the technical cooperation. 2 Section A: Detailed Output Scoring Output 1: Quality public health and nutrition services available in underserved districts. Output 1 score and performance description: A Progress against expected results: Indicator Milestone 2013 -14 Status May 2014 Score Functional quality Achieved across 16 TAST A+ - Quality assurance assurance systems for districts, 5 high priority committee functional in 16 CEmONC and BEmONC districts and state quality focus districts. assurance committee functional to track Model Maternity Wings across 51 districts Over Achieved. QI inputs to 94 high load delivery A+ - QI inputs to 60 high load points. delivery points and bimonthly actions taken report. Achieved A - Functional facility based performance monitoring using QA MIS Improved Quality of Achieved A - Quality monitoring and Village Health and micro-planning of VHND in Nutrition Days (VHND) in 16 focus districts by TAST, focus districts. NGOs, VHSCs and MGCAs. Number of staff trainings supported by DFID TAST on Health, Nutrition and management issues - Progress against planned - Suposhan - VHND - SBA and Hospital quality - Programme Management (PMUs) Number of children and pregnant women reached with nutrition services Source – ICDS MIS Nutrition mission implemented in the state - 78 Lakhs Overachieved; 1340 VHNDs covered and supply gaps addressed Achieved. 12000 health and nutrition staff directly trained by DFID TA on health and nutrition. TA team monitored quality of cascade training for 51000 frontline providers 74 lakhs - District plans being implemented and monitored in 16 districts. Achieved: including Design, delivery and appraisal of Suposhan Abhiyan. A - 350 AWC assessments and supervision every quarter starting Oct 2013, for improved quality of nutrition services. - 50 Model AWCs set up in 16 focus districts Achieved A Partly achieved. Protocols, budgets and site selection completed: GoI approval awaited. B - Direct VHND support to 1000 villages A+ A B* *Drop in coverage numbers is observed 2013 -14, because more stringent criteria are being applied for reporting coverage numbers; only those who availed supplementary nutrition for 21 days or more per month will be reported. Highlights of progress Health MPHSRP TA helped institutionalize state and district quality monitoring using GoI’s maternal new born health (MNH) tool kit across 51 districts including setting up and 3 certification of Model Maternity Wings at District Hospitals. The quality improvement strategy in MP has gained momentum due to intensive demonstration by DFID TA in 94 hospitals. Specific actions supported by TA include: gap assessment, on site correction, trainings, supportive supervision, feedback to blocks and districts for HR, supplies, equipment and funding gaps. DFID FA is also being used for hospital cleanliness and mobility support for supportive supervision to complement the TA inputs on quality improvement.The budget allocation for quality improvements in NRHM plans (PIP) increased from INR 1.8m in 2013-14 to 225.8m in 2014-15. TA supported the development of Model Maternity Wings (MMW) in 48 district hospitals. Out of the 46 maternity wings assessed against benchmarks, nine district hospitals are now certified as Model Maternity Wings. Periodic rounds of quality assessments conducted in 94 high load delivery points and gaps shared with district quality assurance committees; significant improvement in physical layout of labor rooms, display of protocols, and logistics and supplies; all these aspects were appreciated by a recent GoI review mission. The TA also helped in providing hands-on trainings to staff on operating the radiant warmer for newborns, and infection prevention practices. During the field visit to district Chattarpur and Tikamgarh, there was ample evidence of QI inputs provided by TAST, for instance: o Repair of radiant warmers. New radiant warmers and delivery tables o Renovations, mike/intercom, curtains o Labour room Trey arrangements, o Organized ANC area with the OPDs. o Additional toilets, tap connections o Protocols in the Labour room for life saving obstetric procedures o BCC materials in the waiting areas, wards Three health facilities are being developed as Centre of excellence in Sehore district where there is a 45% point improvement in proper disposal of needles, 60% point improvement in waste segregation practices, 40% point reduction in mothers leaving hospital before 48 hrs of delivery. Functional Taps improved from 63 to 89% and functional toilets from 53 to 94%; average OPD waiting time reduced from 20 minutes to 3 minutes. Both TA and FA provided under MPHSRP has helped operationalize two Skills labs (five more in the pipeline): two training batches completed using Mannequins to practice hands on skills. The participants are assessed on objectively structured clinical examination (OSCE) for skill retention. Under the national RMNCH+A strategy, DFID TA provided leadership to conduct gap assessment across the 17 High priority districts on quality parameters and used the findings to develop the plans and budgets for addressing the quality gaps. Currently monthly block monitoring visits are ongoing. A good analysis of gaps was presented to our review team in district Chattarpur, where all 13 gaps identified at district hospital during Feb14 were closed in May14, which is a good achievement. 4 Nutrition MPHSRP aims to reduce undernutrition among children under two and deliver the 10 evidence based interventions recommended by Lancet nutrition series. The following strategies are being prioritised under MPHSRP: a. Strengthen the quality, coverage and functionality of services provided by village based feeding centers (AWCs) under ICDS for improved feeding (IYCF) and hygiene. This includes training and supervision for frontline ICDS staff. b. Improve coverage and uptake of community based integrated health and nutrition services through monthly Village health nutrition days and health volunteers (ASHA) to deliver immunisation, micronutrients (Iron and Vitamin A and Zinc) and management of childhood infections (Diaarrhea and Pnuemonia). c. Improved coverage and uptake of Water, Sanitation and Hygiene programme. d. Mobilising Village self help groups through participatory learning and action cycles for demand generation and utilisation of health and nutrition and sanitation services. MPHSRP TA is supporting the roll out of an ambitious Suposhan strategy for management of moderate and severe malnourished children and includes AWC based supervised feeding followed by home based care and improved counselling of mothers for child feeding practices. TA designed the training modules/guidelines including a matrix of 20 nutritionhealth education sessions; flash cards and job aids and implementation of first phase of Sneh Shivirs (special VHNDs) reaching 3200 AWCs and helped train more than 2000 ICDS officials, 3,200 AWWs and 1,500 village volunteers. DFID TA also completed a rapid appraisal of the first phase of Suposhan(findings provided in output 5) and is now supporting the design of Suposhan evaluation. It was observed during field visit that nearly 1200 severely underweight children were identified and treated (supervised feeding, micronutrients) in 120 Sneh Shivirs in Chatarpur and Tikamgarh. TAST helped in planning, training, monitoring of Sneh Shivirs as well as rapid appraisal. The project milestone for setting up 50 Model AWCs could not be achieved because of delays in the approval of ICDS Mission budgets. Nearly 1000 Model AWCs are now planned under ICDS Mission. Protocols including budget estimates are ready and 453 Model AWC sites identified. Setting up model AWCs will complement DFID FA use for AWC construction. DFID TA designed the Chief Minister’s Community Leadership Development (CLD) course to increase availability of trained personnel for community social welfare schemes. The proposal and syllabus was approved by cabinet and an expert committee (Tata Institute of Social Sciences) and MP Bhoj University will manage the study centers and certifications. GoMP has allocated INR 106 crores; approval awaited from the Finance commission. The course will benefit nearly 10,000 village volunteers every year, starting July 2014. DFID TA helps to strengthen VHNDs through micro-planning, training, monitoring and addressing skills and supply gaps. Manuals were prepared for Supervisors and Frontline Workers (ASHAs, ANMs and AWWs), with specific attention to nutrition counselling and micronutrients (Zinc and Iron). The functionality assessment of 1340 VHND sites suggests that 80 percent were held at AWCs in presence of all three workers (ANM, ASHA and AWW) indicating good convergence. Gaps were observed in terms of privacy for ANC (50%), hand-washing facility (35%), focus on adolescent girls (41%) and identification of 5 high risk cases (42%). The skills on Blood pressure measurement and anaemia detection were weak. District specific actions taken to strengthen VHND are: o In districts Jhabua, Alirajpur and Dindori, 882 ANMs were trained to enhance skills on measuring of Blood Pressure, Haemoglobin for pregnant women. o In Dindori, ANC table and curtain were not available and Pachayats were supported to utilize untied fund to buy ANC table, curtain and hub cutter. o In Tikamgarh, adolescent girls were not present at VHND sites. Anganwadi workers motivated to call adolescent girls and provide with deworming and iron tablets. Anganwadi Center quality improvement process was undertaken in 16 districts through regular monitoring and supportive supervision. The functionality of about 900 AWCs across the 16 districts was assessed on 20 key indicators and the assessment tool is now being incorporated in the ICDS monitoring policy to strengthen supervision. Using the data analysed from the AWC assessments the following actions are being taken: o Quality visits by Supervisory staff o Timings for opening AWCs, SNP supply and coverage o Identify children with growth faltering with emphasis on Counseling on feeding. o Cleanliness of AWCs, Hand washing practices o Increase Home contact o Improve quality of Food (Hot cooked meal) DFID TA is also supporting training reforms through Training Needs Assessment (TNA); assessments of Mid-level Training Center (MLTC) and Anganwadi Training Center (AWTC): revision of modules and curriculum digitization of training content. Rapid Appraisals of two MLTCs (Jabalpur and Indore) and three AWTC revealed near absence of nutrition related resource materials, weak training skills of trainers, dilapidated infrastructure and equipment. MPTAST has designed and conducted the Training needs assessment (TNA) for 415 districts and block staff and 2485 sector supervisors. Performance across the levels were graded and following categories of staffs have evolved: o To be developed as State / District Resource Persons pool o Staffs requiring specific core areas of training identified (GMP, ECCE etc.) o Staff requiring basic training on all the thematic areas Based on the findings of training center assessments and TNA, a range of training reforms are planned under the ICDS Mission to be supported during 2014 -15 through both DFID TA and FA. Recommendations Health Quality implementation of RMNCH+A strategy in all 17 High priority districts; conduct 34 BMVs every month for supportive supervision and quality improvements at delivery points and community centers (GAK and VHNDs). Scale up Skill labs to 5 divisions Support development of Model Maternity Wing across all 51 District hospitals as per MNH toolkit Nutrition Set up 50 model AWCs in 16 focus districts Quality improvement of AWCs and institutionalise QI process under ICDS Mission Implementation and evaluation support for Suposhan Training reforms and strengthen MLTCs and AWTCs (Use of TA and FA) a. Develop quality teaching/training aids (charts, case studies, job aids, audio visuals) b. Strengthen trainer competency and develop modular format for trainings c. Help improve attendance and batch saturation (e.g. credit system, training calendar) d. Systematic evaluation of trainer and trainee feed back e. Develop system for field practical during trainings Impact Weighting (%): 25 Revised since last Annual Review? No Risk: Medium Revised since last Annual Review? No Output 2: Improved quality of Human Resource Management in Health Sector Output 2 score and performance description: A 6 Progress against expected results: Indicator Milestone 2013 -14 Better HR database - Quarterly analysis of doctors’ informs rational database with evidence of deployment of use of data and rational human resources deployment. - Comprehensive HR database designed. Status May 2014 Achieved Score A Partly achieved. Software B designed and data updation for nurses is 60% complete. HR Policy and - HR cell undertakes regular Achieved. HR Cell A Strategy developed HR analysis, and supports undertakes quarterly analysis along with recruitment and training and shares the report with departmental GoMP. One of the major planning. capacity achievement during the augmentation reporting period has been rational deployment and recruitment of more than 12000 staff Highlights of progress; The doctors’ database covering 4800 doctors is now supplemented by a “Work Performance Module” to monitor the performance of Doctors ie. OPDs, IPDs, minor and major surgeries, caesareans etc. This has improved the attendance of Doctors and is also used for ACRs (Annual Confidential ratings). All transfers, promotions and decision for fresh recruitment of Doctors and further counselling for deployment are informed by gap analysis using the HRMIS tool. As a result of using the HRMIS, the following improvements in HR availability are seen; 190 MBBS Doctors appointed at PHCs where earlier no doctors appointed 164 MBBS additional doctors appointed in 17 focus Districts To improve the functionality of level 31 delivery points and enable emergency obstetric care; o 42 new Anaesthetists appointed where there was no Anaesthetist posted o 71 new Paediatricians appointed at sick new born care units and 21 paediatricians deployed at L3 block hospitals for improving newborn care o 72 new Obstetricians deployed at L-3 facilities o 57 (Anaesthetists, Obs & Gynae and Paediatrician) specialists redeployed at District Hospital and 40 Doctors redeployed at subdistrict L-3 Hospitals. There is slow progress in compilation of comprehensive HR database. The existing software for the doctor’s database is being expanded to make it comprehensive including all Nurses, paramedical staff: likely to be completed by end July 2014. As per current priority of GoMP, the database of the Nurses is being updated with 60% completion till now. Recruitment Support: Recruitment support was provided to DoPHFW and NRHM to recruit more than 12000 positions (doctors, specialists, nurses, counsellors, programme management staff). TA support included; developing the rule books, processing applications and counselling for postings. Nursing Reforms DFID TA organized a State level workshop in Apr 2014 to help improved planning, deployment monitoring and supportive supervision of nursing cadre. A draft manual proposing restructuring and nursing reforms is awaiting approval and operationalization. The proposed reforms include: - Identify staffing norms for Nurses - Introduction of new positions like Nurse Practitioner and midwifery, Block PHN, Chief Superintendent, Deputy Director and Joint Director Positions. - Re-structuring for better planning, monitoring, and supportive supervision of nurses - Career progression and growth - Plans for filling the HR gaps of nurses in difficult and hard to reach areas - Safety and security issues - Continuous Education of Nurses - Registration of Nurses – both in the public and private 1 Level 3 delivery points are considered functional only if all 3 specialists are available ie. Obstetrics, Paediatrics and anaesthetist. 7 Recommendations a. HRMIS to be completed and operationalized to cover doctors and nurses. b. Consolidate the result due to regular HR analysis and its institutionalization c. Transition the roles of HR data analysis to the existing govt staff by Oct 2014 d. Help operationalize nursing reforms especially in the areas of staffing norms, career progression and setting up of a nursing directorate. Impact Weighting (%): 20% Revised since last Annual Review? No Risk: High Revised since last Annual Review? No Output 3: Financial and procurement systems effectiveness improved Output 3 score and performance description: 8 A Progress against expected results: Indicator FRA & ASP Risk Ratings Audit analysis and compliance enhanced Procurement and Drug Management System strengthened Milestone 2013 -14 - Financial management action plan for NRHM implemented. - FRA undertaken along with fund flow audit & procurement review and action plan agreed - TAST provides FA spend tracking every quarter. - Audit tracking of DH&FW and DWCD (5 districts every quarter) - Compliance with audit findings for DH&FW, NRHM and ABM enhanced. - Local purchase module in SDMIS. - Cabinet approval of Procurement Corporation, budgets allocated, Legal options for operationalizing corporation available. - Drug stock out study completed and shows reduced stock outs. Status May 2014 All achieved Score A Achieved. In addition to audit tracking and compliance, TA helped in improved FM practices Achieved. A A Overachieved. Corporation registered, MD appointed, recruitments ongoing. Achieved - TSUs scaled up across all divisions. Achieved Highlights of progress; The Fiduciary risk rating for both DoPH&FW and DWCD have reduced from substantial in 2010 to moderate in 2013. FRA findings 2013 for DoHFW There are 4 benchmarks of low risk, 7 benchmarks of moderate risk and 4 benchmarks of substantial risk. The overall risk rating is Moderate. The key areas with substantial risk are o Accounting policies and Account code classifications are published and applied. o In year reporting of actual expenditure. o Criticisms and recommendations made by the auditors are followed up. o Effective action taken to identify and eliminate corruption. FRA findings 2013 for DWCD There are 6 benchmarks of low risk, 6 benchmarks of moderate risk and 3 benchmarks of substantial risk. The overall risk rating is Moderate. The key areas with substantial risk are o In year reporting of actual expenditure. o Appropriate use of competitive tendering rules and decision-making is recorded and auditable. o Effective action taken to identify and eliminate Corruption. TA support provided to mitigate the risk identified in the FRA – Health: o Draft Finance Manuals prepared for NRHM Finance Division. o Audit analysis of Concurrent Auditors and Statutory Auditors is shared quarterly with GoMP to identify areas for improvement in PFM. o Risk analysis and reporting format issued to the Concurrent Auditors for compliance. o Framework for Village Health Sanitation Nutrition Committee audit o Standard Bid documents being used to improve transparency in procurement process. All procurement is being undertaken through online tendering system supported by TAST. DWCD: o Supported State and district ABM unit in the appointment of statutory auditors with welldefined terms of reference, guidelines and formats for financial statements. o Preparation of Finance and Procurement Manual for ICDS Mission. 9 o Capacity Building on Financial systems pertaining to procurement Audit analysis of Atal Bal Mission; o Statutory Audit finding analysis of 30 districts and State ABM unit was done during the year 2013-14 and four reports were submitted. o Based on ABM Audit Finding Analysis, Key issues and intervention by MPTAST are described in the following table: Key Issue Intervention Result areas Audit analysis in 2013 for 2011- Guidelines on the appointment Audit analysis done in March 12 found 66% of the sample of auditors and formats for 2014 for 5 sample districts districts had not prepared preparation of financial found that all 5 districts have Balance Sheet and Income and statements for District ABM prepared Balance Sheet and Expenditure account. units Income Expenditure account Auditors report on Financial Guidelines on the appointment Financial statements are now Statements of District ABM of auditors and formats for being prepared as per the Society lack uniformity. The preparation of financial format leading to uniformity and level of assurance provided by statements for District ABM comparability of the financial the audit reports vary in the units information across Districts. nature, scope and type of audit procedures performed. District ABM Societies in which Support provided to Finance Audited Financial Statements of the auditors have reported audit adviser, ABM for tracking the District ABM Unit are being findings were not being tracked audit findings and identifying scrutinized on a regular basis at State ABM Society key issues. TAST led audit and non-compliances and analysis was used as a deviations are being background document for communicated to the respective review. Districts. Analysis of Concurrent Audit and Statutory Audit reports of NRHM (5 districts per quarter). o Audit finding analysis of 21 districts was done during the year 2013-14 and four reports were submitted to NRHM, highlighting the problem areas and changes observed. o Audit finding analysis was done for 5 districts statutory audit reports and 16 districts concurrent audit reports. 5 districts out of these were repeat districts which were used to analyse the change in the financial management system. o Based on Audit Finding Analysis, Key issues and intervention by MPTAST are described in the following table: Key Issue Intervention Result areas Compliance with Tax Deduction Guidelines on Tax Deduction at Guidelines issued and at Source under Income Tax Source under Income Tax Act compliance observed in audit and Vat needs to be improved for state and district units finding analysis System of tracking compliances NRHM staff tracking the Concurrent audit report with the audit findings reported compliances of each report. A compliance and audit findings by the Statutory Auditor needs CA is fully dedicated to being tracked by NRHM to be put in place. handling this work in NRHM Finance Division Finance Division Bank reconciliation statements Guideline for reversal of Time Guideline for reversal of time are not prepared mainly due to Barred cheques prepared by barred cheques is under review huge number of time barred MPTAST. Engaged in by State Health Society, M.P. cheques which are to be continuous dialogue with NRHM Staff appointment in process reconciled and also due to Finance Division for filling up of and was delayed due to code of vacant staff position vacancies. conduct during the year Advance adjustment is not Guideline for preparing ageing Under review by State Health being done timely and properly, schedule of advances prepared Society, M.P. advance reconciliation and by MPTAST and shared with ageing of advances is also not State Health Society, M.P. being done Concurrent Audit reports State Health Society, M.P. Concurrent audit reports are submission delayed by 3 appointed the Concurrent now submitted within one months auditors for 2013-14 at the state month to the State Health level for all the Districts. Society Concurrent audit reports are not Format for risk analysis and Risk reporting started by many uniform in the content and reporting by Concurrent auditors concurrent auditors from Q3 format of reporting prepared by MPTAST report onwards although 10 Instructions issued to the reporting needs to be improved concurrent auditors. further. Procurement and Drug Management Systems Cabinet approval for Procurement Corporation obtained and incorporated under Companies Act, 1956. First Board of Director meeting held in March 2014. Recruitments are ongoing. SDMIS is being used for e-monitoring for drug availability, stock outs, expiry, and supply and payment position. This year two additional features have been added; Local purchase modules and Equipment MIS to help inventorize equipment and faster repairs. Further, expansion of SDMIS till PHC level is being undertaken through DFID TA support. TAST working with Center for Development of Advanced Computing (A scientific society of DoIT, Ministry of Communication & Information Technology, GoI) for customizing “e-aushadhi” systems for expansion till PHC level and Drug Distribution Counter. The drug availability study done as part of evaluation of ‘Free dugs for All’ scheme showed; o The average drug count in district stores increased from 95 in 2012 to 220 in 2013. o Incomplete supplies reduced from an average 57.6% to 36.6% over 2012 to 2013. o Access to free medicines has improved for both OPD and IPD patients through Drug Distribution counters. The OPD and IPD footfall increased by average of 37 per cent in OPD and 13.7% in IPD across all levels. o Procurement order value for the centrally rate contracted items increased from INR 64 crores 2011 to INR 128 crores in 2013-14 showing a 99% increase. o The budget utilized for the state rate contracted drugs has changed from 28% in 2011-12 to 59% in 2012-13: a reduction in local purchase by 31% in one year. o The overall medicine availability has increased 3 times whereas the budget utilization for procurement of centrally rate contracted drugs by the districts has doubled. Recommendations Support GoMP in operationalization of the Drug Procurement Corporation Ensure smooth transition of functions of the procurement cell and biomedical engineers to the Drug Procurement Corporation. Achieving one cycle of drug procurement via the corporation by March 2014. Commission a third party diagnostic report on existing procurement systems. Customizing “e-aushadhi” systems for expansion till PHC level and Drug Distribution Counter Undertake Warehouse Management Training for ensuring good storage and QA of drugs Strengthening Quality Assurance of drugs i.e. regular sampling, testing etc. Statutory and Concurrent Audit Analysis at NRHM Capacity building of finance and account personnel through NIFM Close tracking of FA fund spend and progress on ICDS infrastructure Impact Weighting (%): 20% Revised since last Annual Review? No Risk: Medium Revised since last Annual Review? No 11 Output 4: Increased demand for Nutrition, Health and Sanitation services Output 4 score and performance description: A Progress against expected results: Indicator Milestone 2013 -14 Strengthened capacity of community groups to monitor community based health, nutrition and wash services and counselling. Status April Score 2014 A - High level committee for CBA-PLA Achieved constituted A - SRLM and GoMP approved the CBA- Achieved PLA plan (Sanjhi Sehat) and budgets A - CBA-PLA (Sanjhi Sehat) model Achieved; covered 3650 initiated in 3 of the 8 districts and covered 3000 SHGs members spread SHGs in 499 villages across 500 villages BCC campaign for - 2 districts implement stronger IPC. Achieved awareness on maternal - 360 media campaign started. health, IYCF and - Innovative BCC strategies Achieved sanitation practices implemented across districts A Highlights of progress: State Rural Livelihood Mission (SRLM) approved Sanjhi-Sehat (Participatory Learning and Action PLA) in eight districts of Madhya Pradesh. Sanjhi Sehat is designed to demonstrate the impact of woman’s group mobilisation on health, nutrition and WASH outcomes and influence GoMP to scale up this strategy under the rural livelihood Mission and the new ICDS Mission as a community based innovation. Sanjhi Sehat will cover 1,034 villages by capacitating approximately 7,500 SHGs across eight districts in MP to inform potential scale up across 51 districts through SRLM. To date the programme has started implementing only in the three districts managed by MPTAST namely Chattarpur, Tikamgarh & Sagar covering 3643 SHGs in 499 villages. The remaining five districts Barwani, Shivpuri, Raisen, Dindori and Panna to be supported by SRLM using DFID FA funds is yet to roll-out. The main challenge was in getting agreement from SRLM on a mechanism for hiring and contracting staff to deliver Sanji Sehat in its focus districts. After lengthy negotiation this has been finally resolved albeit belatedly in June 2014 and is expected to get underway in August 2014. Other achievements include Formation of a State Level Monitoring Committee chaired by the Chief Executive Officer (CEO) of SRLM and two meetings convened with SRLM, Health, WCD and PR&RD. o Partnerships with NGOs to implement Sanjhi Sehat in three of the eight districts. o Induction and orientation of NGO and SRLM staff; adaptation of the 20 PLA cycle modules; development of a communication package for Sanjhi Sehat o Implementation started in district Chattarpur, Tikamgarh and Sagar to cover 3643 SHGs, first 3 PLA cycles in 499 villages. Training of 73 PLA facilitators completed to roll-out the first three PLA cycles. Expert agency hired to provide training, monitoring and onsite mentoring support. Other initiatives by DFID TA to promote community mobilisation; o Training of Village health nutrition and sanitation committee (VHSNC) o Establish and support the community action website to help track the functioning of ASHAs (training, incentive payments), VHSNC and Gram Arogya Kendra. o Strengthening of Gram Aarogya Kendra BCC activities; o Khirki Mehendi Wali, (KMW) a long format radio programme was developed by BBC Media Action on maternal child health nutrition issues with women empowerment theme. 37 episodes were aired in 9 All India Radio and 11 Community radio stations across MP. Following the broadcast, listeners clubs are being created in 207 Kasturba Gandhi Balika Vidyalayas and 322 girls’ hostels in partnership with Dept of Education. Orientation of 1100 wardens was done to enable facilitated discussions. The Dept of Women Empowerment is keen to introduce KMW through Tejaswini program with 12000 12 SHGs in six districts. o ‘Jeet Jaruri Hai’ based on the Snakes and Ladders Game was developed on exclusive breastfeeding and complementary feeding to aid Frontline workers for counselling. The tool is recommended for inclusion in the annual Plan for ICDS Mission, and is also being included in NRHM Toolkit for all 49000 Gram Arogya Kendras. o Pet puja campaign on nutrition; focussed on cultural beliefs, barriers and misconceptions related to child Feeding, complementing the Suposhan Campaign covered two districts with an estimated audience reach of more than half a million. o Swasthya Sargam: Compilation of songs on various health issues promoting hand washing, complete ANC and breastfeeding was developed by DFID TA; around 10,000 CDs of Swasthya Sargam are now available at all the Health Facilities. o A set of audio jingles on the maternal and child health issues, and non-communicable diseases were developed for radio broadcast. It is proposed that these jingles would be broadcast through all the 14 primary channels of All India Radio and FM channels which has an estimated 93% reach. o Training for district functionaries of govt IEC Bureau and ANM Training center trainers on 360 degree Communication was organised covering 46 districts. Following the training, the IPC Tool on Birth Spacing ‘Fayde ka Mantar’ was distributed to all the 60,000 ASHAs and ANMs with guidelines on their training and use. Recommendations: Complete 8 of the 22PLA modules of Sanjhi Sehat in the five SRLM districts by March 2015. Complete at least 10 out of the 22 PLA modules with WASH integration, in the three TAST supported districts by March 2015. Set-up trouble shooting mechanism to resolve operational challenges vis a vis Sanji Sehat especially in SRLM districts were MPTAST is not operational Mobile Kunji implementation (Training of frontline workers and back end technology) in the 17 high priority districts. Mobile Kunji is a multimedia job aid to ensure delivery of standardized, messages about maternal, neonatal and child health. Impact Weighting (%): 15% Revised since last Annual Review? No Risk: Medium Revised since last Annual Review? No Output 5: GoMP has a state M and E system that enables quality planning. Output 5 Score and performance description: B Progress against expected results: Indicator Milestone 2013 -14 Status April 2014 Timely Health MIS Achieved - NRHM data effectively used for reports which are tracking district progress. regularly analysed to - Training of district and Block staff assess district/facility on improving data quality. performance - Block monitoring visits by district mentors for RMNCH+A strategy. - Quarterly score cards analysed and shared with GOI. Strong MIS system for Achieved - ICDS data effectively used for tracking nutrition tracking district progress. performance Partly achieved - District analysis/grading reports and KPIs tracked Evaluation studies, Over achieved: 4 - At least 2 Reviews/independent reviews and evaluations/assess assessment/evaluation studies of independent ment done specific initiatives for health and 13 Score A A B A A B A+ assessments of Health and Nutrition initiatives nutrition. Highlights of progress GoMP is making steady progress in setting up robust monitoring systems to enable quality planning. There is strong emphasis on e –monitoring and use of data for decision making. At present 12 Monitoring softwares are being used for key programmatic processes. MPHSRP TA is directly supporting the six out of the 12 softwares (HMIS, MCTS, HRMIS, SDMIS, EqMIS and ASHA) for data updation and analysis. Using the software the performance of districts is reviewed by senior govt officials during weekly meetings convened by the PS (Health). TAST is providing inputs for improving data collection, reporting and compilation: however much more efforts are needed for better analysis and use of information and informing decision making. For instance there is limited progress on capturing short term intermediate results of TA inputs, for instance impacts of trainings, QI inputs, hospital functionality, drug availability at peripheral health centers, Analysis and use of AHS data: TAST helped analyse periodic AHS data for concurrent monitoring and trend analysis. Key trends shared with GoMP officials include: Maternal Health data reflects low 100 IFA consumption and Full ANC (Hb, BP measurement). Low coverage means that pregnant woman will remain anaemic, will have high risk of deaths due to Heamrrahge and Eclampsia and low birth weight babies. Child feeding practices and Immunization coverage was low in many districts. High FP use but so is high fertility, which means that majority use sterilisation and more uptake of spacing methods needed. Based on this Prerna scheme was launched to promote spacing counselling through ASHA. High Institutional delivery, but lower rates of early breast feeding. This is an example of missed opportunity for providing child feeding counselling and FP services. All the above data analysis has led to high priority to quality ANC, RMNCH counsellers, supplies and diagnostics (Hb kits, BP and Urine testing) at Gram Arogya Kendras. Strengthen NRHM HMIS Earlier facility based reporting was not in place. With support from DFID TA, the reporting on the facility based HMIS has improved eg. Only 35% of health facilities were reporting in June 2013, this increased to 100% for all facilities except Sub health centers (98 percent reporting). TAST is supporting analysis of facility based data to track facility specific performance. To ensure data completeness and its quality, DFID TA supported the NRHM Divisional level workshops with 600 staff to clean the data, address discrepancies, data validation, and score cards. Score card in 17 HPDs under RMNCH+A – using HMIS data Under RMNCH+A block monitoring visits have been conducted in 32 out of 53 blocks across the 17 HPDs. Quarterly RMNCH+A progress Score Card prepared for last three quarters based on composite scores of 16 RMNCH+A indicators and discussed during the State Resource Unit meeting. Facility and community level gap assessment was completed, data analysed and the major findings are incorporated in the district PIP. Revised ICDS MIS DFID TA was provided to scale-up the IT-enabled MIS for ICDS across the State with a dedicated URL created for MIS- mpwcdmis.gov.in. This ensured monthly reporting from AWCs on infrastructure, human resources and the services. About 3,400 ICDS functionaries were trained for implementation of new MIS. A feedback mechanism was started with video conferencing and monthly meetings which focused primarily on completion and submission of MPR and major data gaps. Registers were designed keeping in view the revised on-line reporting format and the numbers of registers were reduced. A Validation Module is now added to the online reporting systems, to improve the data quality. The divisional, district and block ICDS officials are each validating 18 MPRs per month and the state officers validate two MPRs per month: nearly 10,000 MPR are being validated every month across the state. Using the new ICDS MIS, a Take Home Ration (THR) stock report is being developed monthly to get accurate forecast for THR requirement per AWC as per the number of beneficiaries. This has helped rationalize the demand and supply of THR and curtailing 14 excess supply/wastage in almost all districts. Assessments, Evaluations and reviews conducted in 2013 -14; Four large scale assessments and evaluations were conducted through MPHSRP TA during 2013 -14; o Evaluation of free drug for All scheme o Evaluation of Hot cooked meal pilot o Rapid assessment of Suposhan Shivirs o Assessment of Model Maternity wings o Gram Arogya Kendra assessment study. All these evaluations were done at the request of GoMP and findings are informing the annual plans with corrective actions. Using the evidence generated from all the above, DFID TA documented several papers and case studies (co authored by TA consultants and Govt officials) for wider sharing and publications; o State drug MIS (SDMIS) model for IT Department E-Governance best practice paper o Free Drug for All scheme for PM’s Award o Case Study for Mid-term Appraisal of 12th Five-Year Plan on Gram Arogya Kendra and ‘Free Drug for All’ Scheme o Three abstracts selected for South Asian Nutrition conference and Transform nutrition conference. o Five abstracts submitted to World congress on Public Health A rapid appraisal of SuPoSHaN campaign was undertaken to inform the strategies for the next phase and the findings were; o Supplies and infrastructure available in about 70% centres o Visual aids not available in most centres - IEC material development in-process o Poshan Sahyogini appointed and working; but health team seen in only 30% coordination needs strengthening o Weighing children is a challenge - further training and supervision support is needed o MIS – data transfer to sector needs to be streamlined o Home visits - carried-out post shivir but guidance needed on making them focused Study to assess the MCH services in 48 District hospitals as per the 39 points checklist (MNH toolkit) with an aim for certification as Model Maternity Wing. Results; o 40% had labour room arranged as per MNH toolkit, 71% had drugs and instrument trays as per protocols, 54% had labour room protocols displayed, o 92% had functional radiant warmers and only 40% had adequate no. of beds. o HR: 69% had SBA trained ANM/staff nurse posted at Labour rooms and 35% had female security staff posted for the maternity. o Knowledge and skills assessment: 75% had skills on new born resuscitation, 71% had knowledge about AMTSL and 73% correctly filled partograph for all deliveries. o Service delivery: 85 % had uninterrupted electric and water supply, 88% had facility for zero dose in PNC ward and 98% had provision for PPIUCD services. From March to May 2014 after rigorous follow-ups and corrections, 9 DH resolved all the gaps and are certified as Model Maternity wing. More certifications are ongoing. Recommendations: Preparations of analytical reports with data from E-Health soft wares, Block monitoring visits and surveys and help improve decision making for RMNCH+A.. Support ICDS for better analysis and use of data eg. Dashboard for key indicators (eg. Nutritional status, SNP coverage), district grading reports. Evaluations to be designed and conducted during 2014 -15: NIN nutrition survey (using DFID FA) to assess the mid-term impacts of Atal Bal Mission on stunting and wasting and nutrition specific and sensitive indicators Process Evaluation of QA work Evaluation of Suposhan Abhiyan CBA/PLA evaluation – baseline completion and qualitative assessments Impact Weighting (%): 20% Revised since last Annual Review? No Risk: Medium 15 Revised since last Annual Review? No Section B: Results and Value for Money 1. Progress and results 1.1. Has the log frame been updated since last review? Yes. We have revised the 2015 impact target for Infant mortality rate from 51 to 47 per 1000 because of the faster trajectory of decline noted in 2011 and 2012. Output indicators were also revised to align with changing govt strategies for instance the new RMNCH+A strategy, change in CMAM approach, model AWC strategy in ICDS Mission. 1.2 Overall Output Score and Description: Score: Output Output 1 Output 2 Output 3 Output 4 Output 5 Overall score Impact weight 25% 20% 20% 15% 20% Score A A A A B A 1.3 Direct feedback from beneficiaries : Beneficiary Feed back Pregnant women We receive all the medicines from hospital free of cost. Meals were Ms. Guddi also provided on time and hospital is cleaner. I came though Janani Kaluya, Panna Express and also hospital assured to arrange JE after discharge. I am very happy with this hospital and my child is also healthy. Lactating Mother Larkui Here children are learning lot of things that they did not know. village, Sehore, during We like all the things that are told here on feeding and caring for Suposhan, Sneh Shivir. the child. Lactating Mother at Tilkan Earlier we were not aware of the benefits of the recipe and also Village Rewa didn’t know how to improve the quality of the same. But now we During Sneh Shivir. can prepare at home and serve to our children MPW, Jamuna prasad MPTAST has been monitoring VHND session and they provided SHC- Baraithi, feedback on the VHND and directly supported in organizing VHND. District- chhatarpur Guidelines on preparation of due list, micro plan, essential materials, essential services to be provided to beneficiaries on VHNDs. Now we are able to organize the VHND in better manner covering all the target women and children. ANM of SHC (Level 1) Binnaeki, Patan Block, District Jabalpur. This is SHC having L1 facility; I am able to conduct delivery. Because of facility available at SHC pregnancy cases come from nearby villages like Panagar, Sukha. People said this is the proper place to avail treatment easily and on time. Now i know how to maintain and keep the instrument sterilized and place it in right way and at right place after receiving guidance from MPTAST. o Summary of overall progress MPHSRP has made good progress against the project milestones and is on track to achieve all the outcome and impacts. As per available estimates2, DFID support to MPHSRP has directly enabled: More than 190,000 women give birth in a health facility attended by skilled staff, Over 42000 additional people to use modern family planning methods. Provision of nutrition services to nearly 535,000 (half a million) children and pregnant women. Overall sector level progress; GoMP has shown substantial progress in access to facility and community services over last 7 years: Functional delivery points have increased from 335 to 1400 since 2007: which has led to 79% institutional deliveries, up from 43% in 2007. There is also a massive improvement in OPD (7.9m to 2 Using FCPD guidance for calculation methodology 16 31.6m per year) and IPD (0.4m to 3.7m per year) use over 2008 to 2013. 53 sick new born units and 312 nutrition rehabilitation centres set up: highest in the country. GoMP has established village level health units with Anganwadi centers, named as Gram Arogya Kendra. These units are functional in 49000 villages with 16 essential drugs and 5 diagnostics along with ANC table/curtains and adult weighing scales. Labelling AWCs as Gram Arogaya Kendra and providing additional resources has strengthened the availability of basic services/supplies at AWCs, promoted convergent action between Health & DWCD and institutionalize VHNDs. More than 4800 nurses, 4000 Auxiliary midwives and 2300 doctors recruited since 2009. Since 2009, DWCD has deployed more than 750 additional ICDS block officials/supervisors and additional 16000 Anganwadi workers to support nutrition services resulting in increased coverage of under 6 children from 52% in 2008 to 82% in 2013. However there still remains a non-uniform geographic distribution of doctors and nurses, infrastructure, logistics and variable quality of services as evidenced by various gap analysis studies. MPHSRP attributed progress in MP MPHSRP has provided substantial assistance under five areas: Quality improvement of health and nutrition services, HR management, monitoring systems, procurement, and improving demand and community mobilisation. Mobilised delivery of the flagship Govt of India’s RMNCH+A strategy as the state lead partner. The District Monitors were deployed; gap assessment informed annual plans (PIP) and block supportive supervision started. Quality improvements of health services at both facility and community levels; across 94 high load delivery points, 1340 village health nutrition days and helping GoMP to certify Model Maternity wings. DFID FA is supplementing the quality improvement efforts funding hospital cleanliness and mobility for better supportive supervision. MPHSRP TA and FA enabled two fully functional Skills labs and five more in the pipeline to improve clinical skills of nurses for maternal neonatal care. Supporting the ambitious Suposhan campaign for prevention of malnutrition and supervised feeding for malnourished children reaching 3200 AWCs; also completed a rapid appraisal of the first phase and is now supporting the design of Suposhan evaluation. Designed the Chief Minister’s Community Leadership Development (CLD) course which is now cabinet approved, affiliated with Bhoj University to benefit nearly 10,000 village volunteers every year, starting July 2014. State Rural Livelihood Mission (SRLM) approved Sanjhi-Sehat (Participatory Learning and Action PLA) in eight districts to improve Health nutrition and WASH outcomes to capacitate 7,500 SHGs: implementation ongoing in 3 districts reaching 3600 SHGs. All recruitments, postings, transfers and promotion of Doctors are informed by HRMIS designed and managed by DFID TA. During 2013 -14, TA supported the recruitment of more than 12000 clinical staff, counsellors, and mission management staff. Helped GoMP set up an independent procurement corporation to streamline procurement of drugs and equipment to achieve best value for money. The corporation is approved by the cabinet, budgets allocated, registered under companies act and staff recruitment is ongoing. In the meantime MPHSRP TA has helped operationalise the local purchase modules in SDMIS; equipment MIS; expanding essential drug lists from 247 to 426: absorbing drug budget increase of more than 136% from 123 crores to 291 crores. DFIDTA is directly supporting six of the 12 e - monitoring softwares (HMIS, MCTS, HRMIS, SDMIS, EqMIS and ASHA) for data updation, analysis and its use for improvement in services. DFID TA has supported a number of evaluations and independent assessments and lessons are being widely shared at national, regional and international forums. o Key challenges During 2013 -14, there were two successive elections (National and State) and due to code of conduct, several key processes and approvals were delayed. (Sanjhi sehat) Delayed start-up of Sanjhi Sehat community mobilisation initiative and short time available for completing all the PLA cycles. Though the Sanjhi Sehat proposal was passed by SRLM in October 2013, recruitment of staff and implementation in 5 SRLM led districts has not yet taken off. Although significant progress is seen in setting up monitoring systems with data flow and data management, more efforts are needed for analysis and use of data for decision making. There is also a need to monitor short term results of various activities like training, supervision, and drug supply systems. 17 Sustainability of roles played by embedded consultants across Health and ICDS department will be a challenge. Currently there are about 40 consultants working on key operational roles, of which about 17 positions are already agreed to be funded by NRHM. Delays in setting up of a Comprehensive HRMIS because of negotiations with govt on SRS designs and appropriate softwares. Operationalising the newly set up procurement Corporation will take atleast one year to ensure adequate staffing and handhold atleast one procurement cycle. Use of E-Aushadhi (SDMIS till primary health centre) needs to be customised to MP systems. High attrition rate of district level MPTAST on account of the launch of large long-term projects funded by BMGF in UP and Bihar. Hiring replacements for one-year tenure up to March 2015 will remain a challenge. Strengthening management and monitoring capacity for DWCD at the state, district and block levels to effectively implement the new ICDS Mission and World Bank funded ISSNIP is a key challenge. Efforts to strengthen Programme Management units at the state and district level will enable the department to address systemic issues and procedural delays. More targeted strategies to reach the most vulnerable and migrant population’s needs to be defined within the overall health and nutrition sector interventions. 1.4 Annual Outcome Assessment MPHSRP is well on track to achieve most of the outcomes and impact targets as evident from the available data: however the updated nutritional status data is not available after 2011. The annual reduction of infant mortality during 2007 to 2012 is 5.3% compared to 2% annual reduction during 1990 to 2007. Similarly MMR has declined from 335 in 2004- 06 to 230 in 2010 - 12 with annual reductions of 5.2% as compared to 3.1% annual reductions during 1990 to 2006. Based on faster trajectory of reductions of Infant and maternal mortality we will revise the 2015 targets to 47 and 200 respectively. The project has also achieved the 2015 targets for immunisation and early breast feeding. Indicators Baseline Target 2015 Milestone (2013-14) Progress Maternal Mortality Ratio 335 per 100,000 births 230 250 230 (SRS 2010 -12) Infant Mortality Rate 76 per 1000 live births 47 50 56 (SRS 2012) Contraceptive Prevalence Rate (any modern method) 53% 60 58% (for 12-13) 59.3% (AHS 2012) Under-weight children (0-5 year) 58% 45 50% (for 12-13) 52% (NIN 2011) Deliveries taking place in health facilities 47% 85 75% 79.7% (AHS 2012) Women who received 3 ANCs 34% 80 70% (for 12-13) 70.7% (AHS 2012) Children aged 12-23 months fully immunized 36% 58 54% 59.7% (AHS 2012) Children breast fed within an hour 43% 65 55% (for 12-13) 65% (AHS 2012) Children fully breast fed till 6 months of age 31% 50 40% (for 12-13) 39.7% (AHS 2012) 2. Costs and timescale 2.1 Is the project on-track against financial forecasts: Y/N Yes. The total project cost for MPHSRP is £120m (FA; £103m and TA; £17m). As of June 2014, £93m FA and £12.62m TA has been spent and the overall forecast is likely to be met. During 2013 -14, the FA spend was £14m and TA spend was £3.75m. • DFID has so far disbursed £93 million to MPHSRP FA over 2007 -2013: Of which £ 30 m was 18 earmarked for DWCD (Nutrition). • During 2007 -12 and there was no separate budget line for DFID funds and DFID funds of £65m were routed through the State Treasury as part of sector budgets with commitment from GoMP of 10% annual increase in overall govt budgets. • In the second phase of the project (2012 -2015), additional safeguard was added as a separate budget line within DHFW and DWCD with detailed plans to ensure additionality of resources. During 2012 -13 and 2013-14, about 42% of this additional money have been spent. The reasons for slow spending was delays in approvals of plans and activities: designing of Infrastructure plans, layouts and spending guidelines. We expect that pace of spending will improve during 2014 -15 as all preparatory activities are completed. • The TA pipeline spend is projected to be high and overall TA spend is expected to cross the £17m allocated budgets. The agreement to vire £5m from FA to TA is agreed with GoMP and discussions with Govt of India, DEA are ongoing. 2.2 Key cost drivers: Key cost drivers of the project come from two separate mechanisms: Financial and Technical Aid. Both departments (DoPHFW and DWCD) have a separate budget line earmarked for DFID funds to ensure additionality. The detailed FA plans for both the departments are finalised. Additional funds for DWCD is being used to a) Strengthen and upgrade Mid-level training centre (for supervisors) and Anganwadi training centres (for Anganwadi workers) b) undertake concurrent monitoring/NIN survey, c) implementation of innovative pilots d) Anganwadi centre construction. The additional funds for DoPHFW will be used for hospital cleanliness, mobility support for supervision, capacity building, setting up skill labs, and strengthening nursing training institutions. Cost drivers under TA are the remuneration and travel/logistics costs of expert professionals and institutions. TA funds are used for improved planning, quality improvements, capacity building, monitoring, analytic studies, evaluations, and piloting innovations. The TA support team includes: 15 member core team across technical thematic areas: 45 member district teams across 16 underserved districts: 50 consultants placed within GoMP to support planning, quality issues, monitoring, procurement and HR functions. 2.3 Is the project on-track against original timescale: Y/N Yes. The project is on-track against the original timescale. 3. Evidence and Evaluation 3.1 Assess any changes in evidence and implications for the project There are no major changes in evidence underpinning the theory of change. Lancet series on nutrition was released in 2013 which endorses10 evidence based nutrition intervention with high impact on child health and nutrition. All the 10 Lancet endorsed interventions are already part of the Madhya Pradesh’s Atal Bal Nutrition Mission strategy and implementation guidelines supported under MPHSRP. During 2013 -14, Govt of India launched its RMNCH+A strategy compiling all the latest evidence. MPHSRP has aligned its operational actions to focus on the 17 High priority districts harmonising with other development partners and provide district mentoring support. What is the latest evidence telling us? Globally, gaps are maximum around institutional care but MP has done the difficult part better, eg. : o Institutional Delivery : 79% o Facility Based New Born Care and SNCUs : 90% coverage at District level o Facility management of malnutrition (NRCs) : 96% coverage at Block level. o Free referral transport and level 1 MCH centers in remote areas. However evidence shows that coverage of community interventions is poor in MP eg. : o Full ANC coverage : 13.3% (only 17% women consuming 100 IFA tablets) o Exclusive Breast Feeding : 39% o Full Immunization : 59% o Oral Rehydration therapy or increased fluid in diarrhea : 45% o Spacing Methods; only 0.5% use of IUCD Ensuring Quality amidst Quantity…… ie. MP has demonstrated numeric coverage results, but need to focus more on quality of services: o 68% receive 3 ANC & 78% institutional delivery but Maternal and neonatal mortality high. o 1400 delivery points operationalized: however low complication management and LSCS rate (3.8% in public sector). o Sick new born units (SNCUs): 60,000 Admissions per year with 12% mortality; Birth Asphyxia 19 and Sepsis are major newborn killers…. need to improve quality in labor rooms. o Missed opportunity: 79% institutional deliveries, but only 65% early breast feeding. High unmet need for spacing and limiting FP methods, but Postpartum FP coverage is low. In summary, coverage of facility based institutional care is better than community based care in MP: therefore significant realignment of strategies is needed. Way Ahead and implications for the programme: o Close monitoring of High Priority Districts through score card and regular block monitoring for quality of delivery points. o Renewed focus on community based interventions (Child feeding, home based newborn care, Diarrhea and childhood pneumonia, antenatal care) o Promotion of spacing methods at both institutions and community o Addressing HR gaps on priority and task shifting. o Strengthening supportive supervision and use of protocols for improving quality. o Use data for tracking progress and initiating action (HRMIS, Drug MIS, MCTS, SNCU data) 3.2 Where an evaluation is planned what progress has been made? Section A, output 5 describes the progress on evaluations and independent assessments. Four assessments and evaluations were conducted through MPHSRP TA during 2013 -14; o Evaluation of free drug for All scheme o Evaluation of Hot cooked meal pilot o Rapid assessment of Suposhan Shivirs o Assessment of Model Maternity wings o Gram Arogya Kendra assessment study. MPHSRP also hosted an ICAI nutrition review during Feb 2014 and draft report is available. Evaluations to be designed and conducted during 2014 -15: National Institute of Nutrition (NIN) nutrition survey to assess the mid term impacts of Atal Bal Mission on stunting and wasting and nutrition specific and sensitive indicators Process Evaluation of QA work Evaluation of Suposhan Abhiyan CBA/PLA evaluation; baseline completion and qualitative assessments An endline evaluation of MPHSRP is also planned during 2015 -16. 20 4. Risk 4.1 Output Risk Rating: Low/Medium/High The programme is judged to be of medium risk with the potential of high return. 4.2 Assessment of the risk level The key risk factors are assessed as given in the table: S.no 1. 2. Risk Factors Fiduciary risks substantial Weak planning and implementation capacity 3. Non-availability of critical medical staff in remote areas 4. Change to GoI policies. 5. Staff resistance to change Current risk profile Fiduciary risks reduced to moderate. Significant improvements: TA is helping in planning and implementation quality, especially at the district level. The district teams are strengthening district level implementation; capacity building, supervision, and monitoring. TA is also strengthening the human resources and procurement systems in the state. The staff inadequacies continue to be of concern. However, large scale recruitments and rationalisation in staff deployment has improved the situation at district, and sub-district level. Govt has taken steps for incentivising doctors and nurses, flexible recruitment. Low risk: GoI strongly committed to reduce maternal and child mortality and under nutrition: contributes about 30% of health resources. Medium risk: High degree of political and bureaucratic commitment to health and nutrition. Incentives in place to attract talent and reward performance. 4.3 Risk of funds not being used as intended DFID funds form part of the budget for DPHFW and DWCD. GoMP accounts for the financial aid through standard GoMP procedures, including approved budgets put up in the Assembly, annual audits conducted by the Comptroller and Auditor General (CAG), whose reports are also presented to the legislative assembly. From April 2012 onwards there is earmarked scheme code for DFID funding for DOPHFW and DWCD and this has substantially reduced the risk of funds not being used as intended. The funds are being used through societies under the Health and through treasury route in DWCD. The society accounting in NRHM is in accordance with its Financial Management Manual which is provided by Government of India. This ensures that prudential norms of double entry book keeping with standard books of accounts are followed. The accounting in DWCD is done as per the Treasury rules as per the accounting procedures prescribed by the CAG. Quarterly Concurrent and Annual external audits of the State Health Society and District Health Societies is carried out by CAG empanelled Chartered Accountants who are appointed as prescribed by GOI. Audit of DWCD is conducted by audit parties from CAG on a routine basis and treasury system does a pre audit before passing the bills. CAG conducts periodic transaction audit and performance audit of DoHFW and DWCD which GoMP makes available to DFID. FRA of DoHFW done in July 2013 has given the overall risk rating as Moderate. FRA also identifies 4 (four) benchmarks which have substantial risk which also have a positive trajectory of change. FRA of DWCD done in July 2013 has given the overall risk rating as Moderate. FRA also identifies 2(two) benchmarks which have substantial risk which also have a positive trajectory of change. The overall risk rating is moderate with positive trajectory of change. 4.4 Climate and Environment Risk One of the key climate and environment risks under health sector relates to biomedical waste management procedures. Infection management and environment protection guidelines (IMEP) have been defined by Govt of India and state govt has agreed to implement these guidelines in all hospitals. However IMEP guidelines are not consistently followed by all facilities and the staff needs to be better trained and supervised. DFID TA has supported training on infection prevention and biomedical waste management practices. 5. Value for Money Performance on Value for Money (VfM) measures Achieving VfM is described in terms of the 'three Es': Effectiveness, Efficiency, and Economy. Effectiveness measures: 21 MPHSRP continues to demonstrate value for money on effectiveness parameters like rate of reduction in infant mortality, and rates of increase of health service coverage. As mentioned in section1.5, the trajectory of decline of Infant and maternal mortality has doubled since 2007. There is also an accelerated increase in coverage of critical lifesaving interventions like Institutional deliveries, immunisation and early breast feeding rates. The annual increase in number of institutional deliveries during 2008 to 2012 is 8.25 % points per year as compared to only 2.7% points per year during 1998 to 2007. While it is mainly because of the govt cash incentive scheme, TA has supported improved maternity/labour room care. The annual increase in full immunisation during 2008 to 2012 is 6% points as compared to 1% point reduction per year during 2005 to 2008. TA helped in strengthening micro planning, mother and child tracking systems and VHNDs contributing to improved immunisation. Efficiency measures: Technical and Allocative efficiency was measured in terms of: Increased budget allocations and utilisation patterns; increased availability and performance of health human resources; better procurement practices and drug distribution systems. Efficiency measures under MPHSRP are: The GoMP budget of DoPHFW has grown at an average of 22% to INR 3113.72 crores in 201314. The growth in DWCD budget has been on an average 42% to INR 3688.26 crore in 2013-14. The off budget receipts for the DoPHFW has increased by 40% from INR 1077.58 crores in 2008-09 to INR 1508.03 crores in 2013-14. In DoPHFW, the average year on year growth of expenditure is around 23% during the period 2008-09 to 2011-12 with the average utilisation percentage around 98% of the budget estimate. In DWCD, the average year on year growth of expenditure is 54% during the period 2008-09 to 2011-12 with the average utilisation around 98% of the budget estimate. Substantial increase in drug budget (136%) from 123 crores in 2011 to 291 crores in 2014 with expansion of essential drug lists from 247 to 446 drugs. Average total drug count in CMHO stores increased from 95 in 2012 to 251 in 2014; 2.2 times increase in the drug budgets from 2011 to 2014 resulted in 2.7 times increase in the average drug count availability. Incomplete supplies reduced from an average 57.6% to 36.6% over 2012 to 2013 Substantial increases in financing and increased numbers of doctors and nurses have led to improved service provision: for instance there is doubling of institutional deliveries and about 460,000 more fully immunised children every year. There is also a massive improvement in OPD (7.9m to 31.6m per year) and IPD (0.4m to 3.7m per year) use over 2008 to 2013. Since 2009, DWCD has deployed more than 750 additional ICDS block officials/supervisors and additional 16000 Anganwadi workers to support nutrition services resulting in increased coverage of under 6 children from 52% in 2008 to 82% in 2013. Economy measures: MPHSRP contributes to overall economy of the health systems by expanding provision of low unit cost primary preventive services (Nutrition, antenatal care, anaemia, immunisation etc). For instance this project is helping strengthen village level services (at AWC, VHND, Subcenters) and train frontline community workers: which aims to cover more clients with less unit cost. (Global evidence proves that unit costs of community level services are much lower than at block or district hospitals). E tendering is leading to transparent competitive processes. This has reduced monopoly and discretion and enhanced accountability in procurement processes. The market credibility of GoMP is steadily improving as evident from increasing tender participation: the vendor participation has increased from 57% in 2011-12 to 69 % in 2013-14. Through rate contract, 56% drugs were procured at a lower cost in 2012 than the year before. All the drugs are generic and low cost. All the rate contracted medicines are generic. The number of generic drugs under the EDL has steadily increased from 240 in 2011-12 to 305 in 2013-14. Proportion of local purchase of drugs has reduced by a third. This has significant cost savings implications because local purchase medicines are at higher rates constituting about 20% of total drug budgets of 290 crores. 5.2 Commercial Improvement and Value for Money Value for money is being ensured under both direct and indirect procurement. 22 Direct Procurement: DFID procured TA under MPHSRP using open competitive bidding through OJEU. From 2010 onwards, MPHSRP TA contract was revised to an output based payment deliverable system where reimbursement was provided only when agreed deliverables were achieved to DFID and Govt satisfaction. Indirect procurement is done through the TA contract with FHI 360 ensuring compliance with rigorous procurement and contracting policies. Procurement guidelines are approved by DFID procurement group. All procurements are undertaken using approved procurement guidelines. Low value sub-contracts are inviting at least 2-3 quotes, preferably from local agencies and price negotiations are held on the quoted rates. As far as possible meetings and trainings are held within the TAST offices or Government premises to minimize expenses. For limited tendering of procurements of more than GBP25k, the procurement process is managed by the Contracts and Grants point person, thereby ensuring segregation of duties. Sub-contracts budgets are negotiated and payments are linked to deliverables in most cases. All deliverables are reviewed by the assigned Technical Monitors before processing payments. Most consultants hired by MP TAST are local nationals where their fee rates are negotiated on their consultancy history of the past three assignments and their qualifications and experience. In the past year there was an incidence of falsified travel receipts submitted by 3 consultants, which was tracked as part of internal finance/administrative review and verification process. FHI 360 investigated the matter and has terminated the consultant contracts and the funds will be returned to DFID. There was also an instance of termination of an NGO contract because of weak accounting practices and poor performance. During the annual Finance and Administrative review conducted for all NGO partners, it was revealed that one of the NGO had weak accounting practices that did not meet standards as well as weak project management/leadership. It was decided to terminate the NGO contract, with a savings of approximately GBP 80,000. 5.3 Role of project partners MPHSRP is implemented in partnership with Health and Woman and Child Departments of Govt of MP and TA support team managed by FHI360. Other technical agencies like Unicef, UNFPA, MI and Ipas are also providing technical support on maternal child health; Family planning and nutrition issues and they all work in close collaboration with DFID TAST and GoMP. Under the GoIs RMNCH+A strategy, strong efforts for donor harmonisation have been undertaken with DFID as the lead state partner. All the development partners share their plans and progress on RMNCH+A in the 17 high priority districts during the state coordination meetings on a regular basis. 5.4 Does the project still represent Value for Money : Y/N Yes. DFID India commissioned an independent evaluation in 2014 to assess the performance of state health sector projects on Value for Money (VfM) measures such as Effectiveness, Efficiency and Economy. The draft report concludes that; notwithstanding the high risk of underestimation, DFID’s investment in MP’s health sector is expected to bring a high return and stands out as a very cost-effective intervention. The cost of a DALY gained works out to £400 which is lower than WHO’s suggested threshold for very cost-effective interventions. 5.5. If not, what action will you take? 6. Conditionality 6.1 Update on specific conditions DFID’s support is based on a shared commitment to three objectives of reducing poverty, respecting human rights and strengthening financial management and accountability. The project aims to improve the health and nutrition status of the people of MP, especially the poorest, and to improve the financial systems and internal performance accountability, as captured in the partnership agreement, the detailed project report and the Log-frame. GoMP continues to show strong commitment to poverty reduction, human rights and financial accountability issues. 7. Conclusions and actions Conclusions: 23 MPHSRP is well on track to achieving all the goal and purpose indicators. The project has already achieved or within striking distance of achieving 2015 targets for 4 (out of 9) indicators in 2012 itself. MPHSRP TA has provided substantial assistance for setting up and implementing quality improvement mechanisms in 94 high load hospitals across 16 districts as well as certifying Model Maternity Wings. GoMP with DFID support is implementing the state nutrition mission targeted at children under 2 years where MPHSRP funds and TA are being used to a) improve quality and functionality of AWC and VHND services b) rapid scale up of Suposhan campaign for preventing malnutrition c) improving monitoring and supportive supervision and d) Behavioural Change Communications. State Rural Livelihood Mission (SRLM) has approved Sanjhi-Sehat in eight districts to improve Health nutrition and WASH and implementation has reached 3600 SHGs. All recruitments, transfers and promotion of Doctors are initiated as informed by the HRMIS designed and managed by DFID TA. During 2013 -14, TA supported the recruitment of more than 12000 clinical staff, counsellors, and mission management staff. MPHSRP TA helped GoMP set up an independent procurement corporation to achieve best value for money and effective distribution systems. The corporation is registered under companies act and staff recruitment is ongoing. DFID TA has supported a number of evaluations and independent assessments and lessons are being widely shared at national, regional and international forums. During the last year of MPHSRP, it is critical to ensure sustainability of project inputs and strategies and achieve a responsible exit. While it is evident that GoMP will be able to compensate for the loss of our budget support through the state and GoI provisions, the project team needs to support GoMP to continue to use the improved management and monitoring systems created by the project; and help Scale-up the community level work on nutrition and sanitation that the project is piloting. Actions: Output 1. Health (NRHM MD and TAST) Quality implementation of RMNCH+A strategy in all 17 High priority districts; conduct 34 BMVs every month for supportive supervision and quality improvements at delivery points and community centers (GAK and VHNDs). Scale up Skill labs to 5 divisions Support development of Model Maternity Wing as per MNH toolkit Nutrition (ICDS Commissioner and TAST) Set up 50 model AWCs in 16 focus districts Quality improvement of AWCs in 16 districts and institutionalise QI process under ICDS Mission Training reforms and strengthen MLTCs and AWTCs Implementation and evaluation support for Suposhan Output 2. (Health Commissioner and TAST) HRMIS to be operationalized to cover doctors and nurses. Consolidate the result due to regular HR analysis and its institutionalization Help operationalize nursing reforms especially in the areas of staffing norms, career progression and setting up of a nursing directorate. Output 3. (Health Commissioner and TAST) Support full operationalization of the Procurement Corporation Transition of procurement cell and Biomedical engineers to the Drug Procurement corporation. Achieving one cycle of drug procurement via the corporation by March 2014. Commission a third party diagnostic report on existing procurement systems. Statutory and Concurrent Audit Analysis at NRHM. Capacity building of finance and account personnel through NIFM Output 4. (NRHM MD, SRLM CEO, ICDS Commissioner and TAST) Complete 8 of the 22PLA modules of Sanjhi Sehat in the five SRLM districts. Complete at least 10 out of the 22 PLA modules with WASH integration, in the three TAST supported districts Set-up trouble shooting mechanism to resolve operational challenges vis a vis Sanji Sehat especially in SRLM districts were MPTAST is not operational Mobile Kunji implementation in the 17 high priority districts. Mobile Kunji is a multimedia job aid to ensure standardized, messages about maternal, neonatal and child health. Output 5. (NRHM MD, ICDS Commissioner and TAST) Preparations of analytical reports with data from E-Health soft wares, Block monitoring visits 24 and surveys and help improve decision making for RMNCH+A.. Support ICDS for better analysis and use of data eg. Dashboard for key indicators (eg. Nutritional status, SNP coverage), district grading reports. Evaluations to be designed and conducted during 2014 -15: NIN nutrition survey (using DFID FA) to assess the mid term impacts of Atal Bal Mission on stunting and wasting and nutrition specific and sensitive indicators Process Evaluation of QA work Evaluation of Suposhan Abhiyan CBA/PLA evaluation – baseline completion and qualitative assessments Responsible exit and sustainability (DFID Task team and PS Health and PS DWCD) Procedural/Administrative Actions o MoU revision with GoI to agree virement of £5m FA to TA. o Extension of FHI contract from March 2015 to Dec 2015. o Include the provision of embedded consultants under NRHM and ICDS Mission budgets. Communicate with GoMP about the withdrawal of consultants by Dec 2014. Sustainability plan o Rapid scale up of Sanjhi Sehat (SHG/PLA Model), evaluation and sharing evidence with GoMP to include under ICDS and NRHM. o Wider stakeholder communication on 3 key technical areas – QI, Skills Lab, Procurement reforms, Sanjhi Sehat model o TA for planning and roll out of new ICDS Mission and ISSNIP. Support recruitments and orientation of district and state PMU staff to sustain TAST functions o Under Health NRHM, PMUs at state and districts to be strengthened (tools, guidelines, MIS systems and QI protocols) to sustain TAST functions o Communicate with MoHFW regarding options for transition of Lead partner role for RMNCH+A. 8. Review Process The Joint Annual review was undertaken during May and June 2014. The review included field visits to two underserved districts and state level presentations and discussions. The review participants included DFID team3, DHFW and DWCD officials of Govt of MP, MoHFW official of GoI and Technical support agency. This Annual review report is informed by independent sources of survey data like Annual health survey, DLHS, NIN survey, SRS as well as Govt MIS. In addition field assessments, gap analysis, thematic reviews and evaluations (eg. RMNCH+A gap analysis, Model maternity wing assessments, Suposhan assessment, Evaluation of the drug scheme) done by TA support team also informed the review. Field visit observations from Chhatarpur and Tikamgarh have informed the review. EDRM: 41552153 Field visit observations and recommendations EDRM: 4552140 State meeting presentations and next steps 3 Health Adviser, Governance adviser, Social development adviser, Program managers, Project Officer and state representative. 25