FONERWA Project Monitoring and Evaluation Plan The FONERWA monitoring and evaluating system is based on the indicators and means of verification defined in the FONERWA Logframe. FONERWA outcomes and outputs will be monitored across the project portfolio with data collected, compiled and analysed by the M&E Specialists on a regular basis. Project level outcomes and outputs are nested within the FONERWA logical framework, so there is a clear chain of results. Overall responsibility for monitoring and evaluation will rest with the M&E Specialists, although they will be heavily reliant on data collected at project level. The timely provision of results from Monitoring and Evaluation activities will enable the FMT to take corrective or enhancing measures as necessary. The FMT will employ a variety of means for data collection including review of project monitoring reports, field visits to verify reported data and case studies with project beneficiaries. The FONERWA requirements of projects in monitoring and evaluation are specified in the table below. Table 1: Monitoring and evaluation plan M&E Activity FMT Pre-grant award survey Responsible person – project level Project coordinator and team M&E Framework Project Monitoring and Evaluation Officer Confirm Project Baseline Project Monitoring and Evaluation Officer and Project Co-ordinator 1 Inception meeting Project Co-ordinator Set ToRs for project evaluation Project Monitoring and Evaluation Officer Project Co-ordinator Quarterly Progress Reports Minutes of Project Steering Group2 Project Co-ordinator Role of FMT (M&E/finance team) Assess organisational capacity, implementation arrangements and area of coverage. Score project for risk. Guidance to project on setting the Framework Holding orientation workshops as needed Review and validate final framework Guidance to projects on whether a baseline survey is really needed. Guidance on how to conduct survey. Ensure baseline data missing from PD is identified. Review final baseline. Update data management system. KMS to post survey report on website. Support from Programme Manager. Brief project on M&E requirements and provide guidance. Update data management system. Review and agree draft ToRs Review and validate with field visit where necessary. Update FONERWA logframe indicators on data management system. Review Minutes and ensure any corrective action is taken by project. (Programme Manager) Timeframe Within 1 month of FMC approval Within 3 months Conducted within 3 months of project starting Within 2 months of signing Grant Agreement During the inception period i.e.first 3 months Quarterly Six monthly Ideally the external consultant who will conduct the project evaluation should be involved in baseline setting and the ToRs for final evaluation can be drafted during the inception period. However the time period between the two events mean this is likely to prove challenging. 2 For private sector projects this will be the Board of Directors. In Districts this may be the Joint Action Development Forum (JADF.) 1 1 M&E Activity Responsible person – project level Role of FMT (M&E/finance team) FMT Spot-check visit Project Monitoring and Evaluation/Financial Specialist Officer Verification of Quarterly Reporting of achievement and challenges. Update project risk register. Annual review workshop (Lesson Learning Exercise) Project Co-ordinator Mid-term Evaluation – if project is 3+ years duration External consultant Final Evaluation External consultant Participate in workshop, review workshop/review report and disseminate lessons (with KMS). Update data management system. QA consultant selection as needed. Ensure quality of final output. Review the report and update FONERWA logframe indicators on data management system, KMS to post report on website. QA consultant selection as needed. Participate in evaluation team in a sample of projects. Ensure quality of final output. Review the report and update FONERWA logframe indicators on data management system, KMS to post report on website. Timeframe Before Q2 disbursement. Thereafter visit schedule is informed by implementation status, disbursement and project risk rating – triggered by QRs. Annually Mid term point in project cycle. Final quarter of project cycle. The Pre-Grant Award Survey will be carried out by the M&E Specialists, in conjunction with the FMT Project Finance Officer3. The Finance officer will check internal financial control systems, accounting and reporting mechanisms. Using template X the M&E Specialist will: Assess implementation arrangements including partnerships Review composition and recruitment status of project team (including ToRs) Assess organisational capacity including infrastructure Visit the project site to view area of coverage Verify the problem analysis of the PD (available baseline data) Check that the logframe assumptions hold Verify stakeholder consultation has been carried out Award a provisional risk rating, in conjunction with the finance officer. Each project must produce a Monitoring and Evaluation Framework during the project inception period and submit this to the first Quarterly Report. The M&E Framework is a key monitoring tool and an important counterpart to the Project Logframe. The Project Baseline should be established in the Project Document (PD.) The project baseline will need to reviewed and updated during the inception period. Depending on project sector a Baseline Survey or Study may need to be conducted to fill in gaps in baseline data. 3 A combined report will be produced 2 An Inception meeting will be held within the first two months after signing of the grant agreement to: introduce the project team, orientate key stakeholders on the objectives and results framework, provide an update on the project start up activities, agree roles and responsibilities of each institution, provide an overview of reporting, monitoring and evaluation requirements, present the financial reporting procedures and arrangements for audits, plan and schedule Steering Committee meetings. recheck assumptions and risks, and to plan project implementation. If appropriate, this could be combined with the first project Steering Committee meeting. During the Project inception period (the first quarter) the Project Coordinator should review and revise the workplan and budget for year one submitted in the Project Document (PD); including milestones and progress indicators to guide implementation during the first year of the project. The first quarterly Progress Report should also include a more detailed narrative on the institutional roles, responsibilities, coordinating actions and feedback mechanisms of project related partners, as well as annexing the project M&E Framework. Projects will be required to prepare Quarterly Progress Reports to the FMT to ensure continuous monitoring of project activities and to allow for corrective measures in due time. These reports will provide an update on progress on the delivery of outputs, a quarterly expenditure report and a workplan for the next quarter. The reports should also describe progress on implementation as well as lesson learning, a risk update and management and an ongoing assessment of sustainability and acceptance of project interventions by the stakeholders particularly the beneficiaries. The M&E Specialists are responsible for review and approval of these reports using template X. FMT feedback (from M&E and finance teams) will be returned to the project implementer a two-week period. It will be important to encourage early reporting from project implementers of issues affecting delivery. This will require creating a culture of trust between the FMT and recipients. The FMT Finance and M&E staff will conduct joint Spot-Check or Field Visits to each project before Quarter 2 funds are disbursed, in order to verify reported project activities4. During the spot-check visit the Finance Officer will conduct a mini audit of HR, finance and procurement systems and the project team will typically make a presentation on achievement and challenges. Where possible the M&E specialist will conduct a site visit, in order to check that quarterly reporting matches the reality on the ground5. The schedule of spot-checks thereafter will depend on amounts disbursed, activity type financed and rolling risk assessment of projects. Quarterly FMT Monitoring meetings will be held to update the project risk register and schedule spot-checks for the coming quarter, based on quarterly reporting, budget and work plan. Changes in project scope, time delays or budget over/underspend may trigger a spot-check visit. The FMT will employ an early warning system to identify and track Projects at risk (PAR) – see template X. PAR will be identified using a traffic light scoring system through the quarterly project risk analysis meetings, and will generate a red flag on the 4 5 A combined report will be produced For Private sector projects the spot-check must be conducted in partnership with the PS Specialist 3 M&E database. A red flagged project will generate an immediate spot-check visit. Risk may relate to: the delivery of outputs or indicator achievement (>25% off-track) implementation progress (>25% off-track) slow expenditure or “burn rate” (>25% off-track) cost over-run/ unforeseen costs (>25% off-track) inadequate quality of project reporting core project staff turnover total project value (over 500 million RWF) natural calamity in the project region stakeholder complaint received by FMT partnership dissolves or implementing partner leaves FMT professional judgement At the end of each year an Annual Review or lesson learning exercise to assess provisional impact should take place for each project. It will be carried out by the project with support from the M&E Specialists to measure performance against the baseline and targets in the Project Logframe. The M&E Specialists will work closely with the Knowledge Management Specialist and the M&E Advisor to ensure timely and effective communication of the results to all the key stakeholders. The assessment will include a field survey and case studies and will report on: progress made against the indicators and targets, delivery of project outputs, and lessons learned. The assessment report will be incorporated into the end of year quarterly report. The M&E Specialists will encourage members of the Project Steering Group to take part in an Annual field visit to familiarise themselves with the project interventions on the ground and validate the annual assessment. If included in the project budget an external Mid-Term Evaluation will be conducted mid-way through project implementation. The evaluation will review progress against milestones and assess progress made towards the delivery of outputs and achievement of objectives as well as identify corrective actions if needed. It will focus on the effectiveness of delivery, timelines and efficiency of implementation, and risk management. It will present the initial lessons of project design, implementation and management. The findings will be used to enhance implementation during the final half of the project’s term and to share lessons across the FONERWA programme. A Final Evaluation will be conducted before project closure and will focus on the impact and sustainability of project results. The report will summarise the results achieved (objectives, outcomes, outputs), with a key focus to provide lessons learned for other projects, in the interests of replicability or scaling up. The M&E Specialists will also provide guidance to projects to support Participatory Monitoring and Evaluation with beneficiary groups to enable beneficiaries to measure progress of project interventions. This input can be provided to the project Steering Committee. 4 For Private Sector innovation grant projects (which tend to be short in duration), the Annual Review, Mid-Term Review and Final Evaluation will be compressed into a single evaluation exercise at the end of the project. The FONERWA approach to Knowledge Management is captured in the Knowledge Management Framework. Results and lessons learned from the projects will be periodically disseminated within and beyond the project intervention zone using a variety of media (briefing notes, website as well as through existing information sharing networks and forums). Project level data is captured and aggregated towards the fundlevel logframe using the M&E database. Currently an interim Excel template is in use, and an online database on the back-end of the FONERWA website is under development. Every quarter the M&E Specialists will produce a Summary of FONERWA approved projects (project implementation status) to support FMT management of information. A project level Lesson Learning Log has been developed in excel format and should be completed by project implementers on a Quarterly basis. Diagram to summarise FONERWA M&E data flow, sources, outputs and audiences KEY: 5 Diamonds show M&E outputs Green bubbles show M&E audiences Red arrows show data flows Blue boxes show data sources Yellow shows input of data to M&E data base (website backend) FMT professional development The FONERWA Capacity Development Plan identifies a range of capacity-building activities to support the M&E specialists to provide effective oversight to the functions outlined in the M&E Plan. In May an assessment of capacity plan activities to date will be conducted to establish whether planned activities are sufficient and in order to map further/emerging capacity needs. 6