Evaluation of Rashtriya Sam Vikas Yojna (RSVY) AMS Consulting (P) Limited Aim of the Study To assist the policy makers in drawing useful lessons for designing future programs. Specific Objective • To evaluate the financial & physical progress of the schemes under the program • To study the role of people & people's organizations in planning, implementation and monitoring of the schemes under the program • To assess the status of achievement of the objectives of the program, that is, to assess the extent of benefits accrued to the target groups/areas • To analyze the effectiveness of the administrative & implementing systems for drawing lessons to design future schemes Broad Framework of the Study Planning • Relevance to the needs of the people • Involvement of people’s organizations • Efficiency of implementation Implementation • Quality of works done / services provided • Involvement of people’s organizations • Program achievements / benefits accrued Outcome • Impact of the program • Sustainability of the assets created / works done / new initiatives Sample Selection Sample Selection 11 States 15 Districts 30 Blocks (10% of the blocks in each district, subject to a minimum of 2 blocks) Study States & Districts already identified by the Planning Commission Contd… Sample Selection Sampling of Blocks — Based on the amount of RSVY expenditure (Due care was taken to ensure that the two sample blocks were not contiguous) Sampling of Works — In each block, 10% of the various works from all the major sectors Contd… Data Collection Primary Data — IDIs with State, district & block-level officials IDIs with Line Departments IDIs with PRIs/NGOs FGDs/Interviewing of beneficiaries Secondary Data — District Perspective Plans (DPPs) Monthly Progress Reports (MPRs) Other relevant records Contd… Data Collection Field Observations — In each block, 10% of the various works from all the major sectors for ascertaining physical status and quality Major Findings Key Parameters Planning Implementation Monitoring Maintenance of Assets Impact : Utility Planning — Guidelines PRIs, NGOs and Self Help Groups at every stage of Planning, implementation and monitoring (Para-4.2.4) SWOT analysis & benchmark survey by expert agency (Para-1.2) Identify a few lead sectors (3 to 4) for RSVY interventions (Para-1.2 & 6.4.5) Efforts should be made to concentrate on the poorer pockets within the districts (Para-4.2.11) Contd… Planning — Findings Instead of bottom-up, usual top-down approach followed in most districts Most interventions proposed by Line Departments Little or no community involvement in 10 out 15 districts (In Bastar, Banswara, Palakkad, Dindori and Mon, block-level workshops were organized for identifying the gaps/needs) Contd… Planning — Findings Benchmark survey conducted by 5 out of 15 districts SWOT analysis in 11 out of 15 district Specialist agency/consultant for DPP in only 5 out of 15 districts Inequitable allocation of RSVY funds Contd… Block-wise Status vis-à-vis RSVY Funds Received for Improving Irrigation % RSVY Fund for Improving Irrigation District Sitapur, Uttar Pradesh 18 Behta Kasmanda 16 Reusa Palha 14 Sakran 12 Machhrehta 10 Sidhauli 8 Rampur Mathura 6 4 2 Gondlamau Pisawan 0 0 20 40 60 % Net Irrigated Area 80 100 Contd… Block-wise Status vis-à-vis RSVY Funds Received for Improving Rural Connectivity % RSVY Fund for Rural Connectivity District Sitapur, Uttar Pradesh 20 Behta 18 16 Palha 14 12 Kasmanda 10 8 Rampur Mathura 6 Sidhauli Pisawan Sakran Gondlamau Machhrehta 4 2 Reusa 0 0 10 20 30 40 % Road Connectivity 50 60 70 Contd… Planning — Findings Major deviations observed between the planned and actual expenditure in twothird of the districts, indicating lack of proper planning Out of 15, only 5 districts (Mon, Warangal, Pallakad, Mayurbhanj and Dangs) could actually adhere to their DPPs Contd… Adherence to Original DPPs Warangal Physical Infrastructure 28% 29% Social Infrastructure 39% 41% Addressing Unemployment 8% 7% Improving Agriculture 25% 23% Mon Physical Infrastructure 42% 40% Social Infrastructure 32% 34% Addressing Unemployment 7% 8% Improving Agriculture 19% 19% 0% 10% 20% Proposed in DPP 30% 40% Actual Expenditure 50% Contd… Major Deviations from Original DPPs Sitapur Physical Infrastructure 46% 30% Social Infrastructure 34% 16% Addressing Unemployment 5% 20% Improving Agriculture 15% 34% Bastar Physical Infrastructure 42% 15% Social Infrastructure 21% 11% Addressing Unemployment 13% 37% Improving Agriculture 24% 42% 0% 10% Proposed in DPP 20% 30% Actual Expenditure 40% 50% Contd… Implementation Agency-wise Expenditure of RSVY Funds NGOs 5% Others 3% Blocks 13% Line Depts. 79% Others: U.P. Projects Corporation, U.P. Samaj Kalyan Nirman Nigam, Municipal Corporations, etc. Contd… Agency-wise Expenditure of RSVY Funds District Line Depts. Blocks NGOs Others Warangal 81% 1% 17% 1% Bastar 72% 23% 5% 1% Chamba 71% 27% 1% 1% Dangs 76% 3% 21% 0% Chatra 87% 4% 4% 5% Lohardaga 77% 10% 13% 0% Saraikela 73% 27% 0% 0% Palakkad 88% 3% 2% 7% Dindori 84% 14% 3% 0% 100% 0% 0% 0% Ganjam 83% 12% 5% 0% Mayurbhanj 84% 16% 0% 0% Banswara 28% 61% 11% 0% Chandauli 97% 0% 0% 3% Sitapur 65% 0% 0% 35% 79% 13% 5% 3% Mon Overall Contd… Sector-wise Utilization of RSVY Funds Addressing Unemployment (7%) Physical Infrastructure (29%) Agriculture (40%) Social Infrastructure (24%) Contd… Sector-wise Utilization of RSVY Funds Improving Agriculture Addressing Unemployment Social Infrastructure Physical Infrastructure Banswara 65% 1% 18% 15% Bastar 25% 13% 21% 42% Chamba 27% 8% 27% 38% Chandauli 41% 2% 19% 39% Chatra 58% 5% 6% 30% Dangs 54% 34% 6% 5% Dindori 34% 1% 40% 25% Ganjam 27% 2% 36% 35% Lohardaga 48% 14% 3% 34% Mayurbhanj 12% 2% 42% 44% Mon 19% 7% 31% 42% Palakkad 77% 4% 19% 0% Saraikela 64% 0% 17% 19% Sitapur 15% 5% 35% 45% Warangal 25% 8% 40% 28% 40% 7% 24% 29% District Overall Contd… Physical & Financial Achievement District Physical Progress Financial Progress Banswara 98% 99% Bastar 98% 93% Chamba 83% 96% Chandauli 97% 77% Chatra 97% 94% Dangs 100% 90% Dindori 98% 98% Ganjam 96% 98% 100% 100% 96% 96% Mon 100% 100% Palakkad 100% 99% Saraikela 100% 100% Sitapur 100 % 98% 87% 89% 97 % 95% Lohardaga Mayurbhanj Warangal Overall Contd… Monitoring Contrary to guidelines, little or no community involvement in most of the states; No system of social audit Jharkhand : Nigrani Samitis in the villages Nagaland : Village Level Committees for rural areas (Meetings conducted once every 2 months) Town Level Committees for town areas (Meetings conducted once every 2 months) Monitoring “Strict monitoring schedule should be a part of the implementation process itself‘” (Para-6.6.1) Reportedly periodic review meetings & field visits at State and districts Lack of clearly defined monitoring norms in terms of category of works & designated officials and frequency in most states Convenience Monitoring ! Major Constraints : Limited staff & simultaneous implementation of many schemes Sustainability/Maintenance “In case of the community assets, future maintenance is to be built into the program” (Para-4.2.10) In most states, maintenance of durable assets with Line Department Village panchayat/user group to maintain community-based assets (wells, lift irrigation schemes, community centers, etc.) Major Constraints : Lack of funds resulting in poor maintenance, leading to sub-optimal utilization of assets created Impact of RSVY Interventions Increased agriculture productivity Improved economic status Improved health conditions Improved rural connectivity Improved quality of life Overall Utility of RSVY Interventions RSVY Works : Overall Utility Index (As Perceived by the Targeted Beneficiaries) Overall Utility 5-Point Scale Very Good Good So-So Poor Very Poor = = = = = 4 3 2 1 0 Weighted by Share in Total Expenditure Weighted Average Points Overall Index (Out of 100) Contd…