EV ALU ATION PLAN SCHE DULE AND SUMM ARY TEMPLATE PMP Toolkit Excerpt: Annex 18: Part 2 Module 9 This template includes a sample multi-year evaluation plan for a PMP and a table that can be utilized to prepare an evaluation summary. Sample Multi-Year Evaluation Plan for a PMP Evaluation Plan Schedule Evaluation FY13 Q1 FY14 Q2 Q3 Q4 Q1 FY15 Q2 Q3 Q4 Q1 FY16 Q2 Q3 Q4 Q1 FY17 Q2 Q3 Q4 Q1 Q2 Q3 Q4 Health Performance Evaluation Economic Growth Performance Evaluation Education Performance Evaluation Local Governance Impact Evaluation Agriculture Performance Evaluation Key 1. Design and SOW Start 2. Final SOW 3. Awarded by 4. Field Work 5. Final Report Completed Bureau for Policy, Planning and Learning July 2015 EVALUATION PLAN SUMMARY AND SCHEDULE TEMPLATE-1 EV ALU ATION PLAN TEMP LATE Evaluation Plan Summary Evaluation Title/Questions POCs Project/ activity/ program to be Evaluated P/A/P Start/ Increased Jan. use of 2011/ modern Dec. family 2013 End Dates Required (and reason required) or Optional Evaluation Type (performance or impact), and Projected Use Internal or external Estimated Evaluation budget Evaluation Start/ End Dates Performance; to decide whether to exercise option years or recompete External $180,000 Dec. 2012/ Example Family Planning Project evaluation Speedy Analyst 1. To what extent did the MFP project increase capacity of local family planning centers? 2. Did use of modern family planning methods increase in target areas? Required – large project Dec. 2013 planning methods Project Instructions: see notes on the next page. Bureau for Policy, Planning and Learning July 2015 EVALUATION PLAN SUMMARY AND SCHEDULE TEMPLATE -2 EV ALU ATION RESOURCE Notes on Evaluation Plan Summary Fields In all cases, if the information for a particular field is not yet known, enter TBD, but update field as relevant decisions are made. Field Instructions Evaluation Title/Questions Include the planned Evaluation title and any key questions that have been identified thus far. These questions may come from the R/CDCS, a Project Design Document, or other evaluation planning if such planning is already underway. Only include the 1-5 key questions, not detailed sub-questions. POC Enter the point of contact(s) for the evaluation with responsibility for ensuring the evaluation is completed as planned. Ideally this will include one point of contact in the program office and one point of contact in the technical office. Project/ activity/ program to Be Evaluated Evaluations may focus on individual activities, projects, programs (an entire DO, for instance), or even cross-cutting issues. Enter here what is to be evaluated. If multiple projects, activities, or programs are to be included in the evaluation, include the name of each one that will be included. P/A/P Start/ End Dates Include the start and end dates of the projects, activities, and programs that are to be evaluated. If multiple projects, activities, and programs are included in the evaluation, include all start and end dates. Required (and reason required) or Optional Evaluations may be required because a project has been determined to be a large project or because it is a pilot or innovative project. A large project is one that equals or exceeds in dollar value the mean (average) project size for each Development Objective (DO) for the USAID Mission/Office. A pilot or innovative project is one that includes any activity within the project involving untested hypotheses or demonstrating new approaches that are anticipated to be expanded in scale or scope through USG foreign assistance or other funding sources. If an evaluation is required, note here whether it is because of the large project requirement or the innovative intervention requirement. If the evaluation is not required, but a commitment has been made to do the evaluation, than note here that it is an optional evaluation. Evaluation Type (performance or impact), and Projected Use Note here what type of evaluation is planned. There are two types of evaluations. Impact evaluations measure the change in a development outcome that is attributable to a defined intervention. Impact evaluations are based on models of cause and effect and require a credible and rigorously defined counterfactual to control for factors other than the intervention that might account for the observed change. Performance evaluations often incorporate before-after comparisons, but generally lack a rigorously defined counterfactual. Performance evaluations focus on descriptive and normative questions, such as, what a particular project or program has achieved; How it is being implemented; How it is perceived and valued; Whether expected results are occurring; and other questions pertinent to program design, management, and operational decision-making. Internal or external Note here whether the evaluation is external or internal (and the type of internal evaluation). An external evaluation is one in which (at minimum) the lead evaluator is an independent expert outside of USAID, with no fiduciary relationship with the implementing partner. In most cases these will be managed by the Program Office. USAID Mission/Office management may make exceptions under unusual circumstances to management by the Program Office, but the exception should be documented in an addendum to this evaluation plan and included in the PMP. An internal evaluation is one that does not meet the standards of an external evaluation. These are generally of two types. An implementer internal evaluation is led by an individual with a fiduciary relationship to the implementing partner, such as an evaluation led by implementer staff or under a subcontract of the implementer. A USAID internal evaluation is one that is led by USAID staff. Estimated Evaluation budget Enter the estimated budget for the evaluation. Evaluation Start/End Dates Enter the estimated start date for the evaluation (i.e., when the evaluation will be awarded) and the estimated end date of the evaluation. Note that numerous steps must take place prior to the estimated start date, such as development of the Statement of Work. Bureau for Policy, Planning and Learning July 2015 EVALUATION PLAN SUMMARY AND SCHEDULE TEMPLATE -3