M&E Issues: RAFIP and REP Kaushik Barua Accra, 12 Dec 2011 1 I. Project management and M&E Three elements of a project: • Given human and financial resources allocated • Given timeframe • Built around specific objectives Two priorities for project management: Accountability: resources are allocated in a project in order to generate the expected set of results Learning and management: management should learn from experience in order to achieve project objectives 2 Setting Up the RAFIP M&E System Planning for Results • Design • Results •Partners Modelling • What do we need to know? • What information we have to gather? •Identification of M&E questions/indicat ors •Who will collect and report the data Data Collection • Surveys (baseline, later completion) • MFIs, Clients, Focus group discussions •Ensuring understanding, buy-in of partners •Ensuring timely and complete reporting Data Analysis • Data entry •Data storage/ management •Data interpretation • Drawing conclusions Reporting • Reports • Workshops • Other interactive media 3 Setting Up the RAFIP M&E System • Planning for Results: • Based on log-frame/ design (outreach, sustainabilityoperational and financial, linkages to agriculture and value chains), MIX indicators • Modeling: • Based on baseline survey (current status, capacity assessment, appropriate indicators), working group with partners • Data Collection: • Reporting frequency, establishing reporting frameworks • Next Steps: Data Analysis (and management), Reporting: • Setting Targets; Which are the key indicators that determine success; How will results feed back into processes, program re-design 4 RAFIP: Key Recommendations • Complete baseline report: Use baseline to assess status of MFIs/ Clients, also as assessment of indicators and capacity • Develop reporting framework: Cover all subcomponents and all important activities; cover definition, unit, frequency of reporting, level of disaggregation, data source, method of data collection, extra comments. M&E Manual has been developed- now operationalising it and examining link to knowledge management • Extra focus: Also cover agricultural portfolio and gender disaggregation 5 The Results Chain Impact Outcomes Outputs “Positive and negative, long-term effects produced by a development intervention, directly or indirectly, intended or unintended” “The likely or achieved short-term and medium-term effects of an intervention’s outputs” “The products, capital goods or services which result from a development intervention” Activities Inputs “Financial, material and human resources used 6 for implementing activities” Source: OECD/ DAC definitions REP: Covering the Results Chain 3rd level 2nd level 1st level Activities Medium-Term Results Immediate Results Reduced Poverty Long-Term Results Higher profits, Higher income income Enterprise sustainability, Increase in Yields employment Training Provisionattended, of water for start-up agriculture kits Building Providing of training, irrigation capacity schemes building Preparation of technical specifications, bidding, supervision, etc Most control and info at this level 7 Inputs Project Human and Financial Resources REP: Monitoring, Analysing and Reporting on Results • Inputs: Mostly tracked by finance • Activities/ Outputs: Tracked regularly, consistentlytraining attended, start-up kits provided etc • Outcomes: Increasing focus in the last 2 years: improving understanding of enterprise sustainability (sustained profits, proxy indicators), employment creation (by examining effects along the supply chain), Sustainability of groups formed/ strengthened (MSE sub-committees) • Impact: Now need focus on long-term outcome/ impact; therefore focus on surveys, evaluation-level reports 8 REP: Key Recommendations • Evaluation client survey (and baseline survey): • Include a comparison group (non-REP clients) to isolate the effects of the project, include questions on HH assets (business and personal), food security, gender (to include an impact element to the evaluation; based on IFAD guidelines and also other Ghana poverty assessment tools) • Develop a data-based report: • Covering enterprise creation, growth, sustainability, job creation • Case studies: Highlighting successes, challenges • Develop the GIS: • Management/ presentation of data/ results, GIS covering the district level; Development should include pilot testing phase, user role definition 9 Thank you 10