Steps in planning results

advertisement
Steps in planning results-oriented assistance instruments
Results-oriented assistance is based on participatory strategic planning. To plan resultsoriented assistance instruments follow these four simple steps:
STEP 1: Begin by clearly defining the problem.
STEP 2: Develop a results-oriented program
description.
STEP 3: Establish a system for monitoring and
evaluating performance and for reporting, using,
and sharing performance information.
STEP 4: Agree upon responsibilities for
performance.
STEP 1: Begin by clearly defining the problem.
Analyze the critical factors and assumptions underlying the plan. Required
analyses include:
environmental analysis (impact upon biodiversity and tropical forestry);
conflict vulnerability analysis (potential for conflict that might affect the plan and
activities); and
gender analysis (how will gender relations affect the achievement of sustainable results,
and how will proposed results affect the relative status of men and women).
Describe your customers' participation in planning, achieving, and measuring and
evaluating results. Since the intended results directly affect the condition of a customer or
the host country, it is imperative that customers participate in defining what are those
changes.
STEP 2: Develop a results-oriented program description.
Align each proposed activity (an action to help achieve a program result or
set of results, or to support the functioning of the Agency or one of its
operating units) with the Agency's Strategic Plans and performance goals.
Begin with a clear understanding of the Agency's goals and Agency Objectives,
Identify the Agency Goal(s) and Strategic Objective(s) a proposed activity will help
achieve.
Agency
Program Goal
1:
Broad-based economic growth and agricultural development
encouraged
Agency
Program Goal
2:
Democracy and good governance strengthened
Agency
Program Goal
3:
Human capacity built through education and training
Agency
Program Goal
4:
World population stabilized and human health protected
Agency
Program Goal
5:
The world's environment protected for long-term sustainability
Agency
Program Goal
6:
Lives saved, suffering associated with natural or man-made disasters
reduced, and conditions for political and/or economic development reestablished.
Identify the Strategic Objective(s) or Intermediate Result(s) (of the Mission or Operating
Unit) a proposed activity will help achieve.
Define the specific, appropriate, and realistic results (changes in the condition of a
customer or changes in the host country condition that affects a customer) to be
achieved.
Describe the different levels of results--at the output level, the outcome level, the subIntermediate Results and Intermediate Results levels, and, if appropriate, results at the
Strategic Objective level.
Describe whether each set of results works in conjunction with one or more other results
and whether any sets of results have a cause-and-effect relationship.
Describe quantitative and qualitative measures to assess whether results have been
achieved.
Explain the basis for determining that the results are within the operating unit's or
Development Partner's manageable interest or span of influence and resources. In most
cases, results at the output level will be within the direct control of a Development Partner
using resources provided. It may take many outputs from several activities over a period
of time to create measurable impact at an IR or SO level.
Describe strategies and processes believed necessary to ensure successful achievement
of results, without over-prescriptive detail that might limit a partner's ability to respond to
changing circumstances during implementation.
Describe operational processes, skills and technologies, and human, capital, information
and other resources that are necessary to achieve the level of results.
Outline the process for assigning responsibility among Strategic Objective Team
members. Identify external and uncontrollable factors that could significantly affect the
achievement of the goal and objectives.
Assess the likelihood and potential impact of key factors, such as political, economic,
demographic, social or environmental that could facilitate or constrain achievement of the
results.
Describe how external factors will be monitored, what attempts will be made to mitigate
potential negative effects and build on potential positive effects, and what types of
adjustments may be necessary.
Discuss the nature and extent of participation of customers, stakeholders, and other
Development Partners needed to ensure achievement of results. Describe customer
needs analysis, appraisals, evaluations, and other methodologies used in formulating
results to be achieved.
Identify customer/stakeholder analysis, evaluations, appraisals, and other sources used.
Describe stakeholder and customer participation in defining results.
State how coordination will be maintained among all actors.
Summarize the plan for monitoring and evaluating performance.
STEP 3: Establish a system for monitoring and evaluating
performance and for reporting, using, and sharing performance
information.
In contrast to the traditional monitoring and evaluation of "inputs and outputs"
or "project outcomes", the emphasis of performance measurement is on results
and on analyzing information to learn, re-plan, and improve performance.
DEFINITIONS: Automated Directive System (ADS)
PERFORMANCE INDICATOR: A particular characteristic or dimension used to
measure intended changes defined by a results framework. Performance indicators are
used to observe progress and to measure actual results compared to expected results.
Performance indicators help answer how or if an Operating Unit or SO Team is
progressing towards its objective, rather than why such progress is or is not being made.
PERFORMANCE TARGETS: Specific, planned level of result to be achieved within
an explicit timeframe.
Establish Performance Indicators (measures).
Identify a performance indicator, expressed as a tangible, measurable objective against
which actual achievement can be compared for each result.
Identify a baseline and then define a performance target (variously referred to as
performance goal, performance standard, performance measure) for each indicator.
Plan to measure performance against targets or goals at various levels of results -output, outcome, sub-IR, IR, and SO.
Link each indicator and corresponding data requirements to the applicable Strategic Plan.
Establish Performance monitoring and evaluation plan for gathering and
analyzing data.
Define the unit of measure for each result. Provide enough detail to ensure that different
people at different times, given the task of collecting data for a given indicator, would
collect identical types of data.
Identify the data source for each performance indicator. Data sources may include
government departments, international organizations, other donors, NGOs, USAID
offices, or activity implementing agencies. Be as specific about the source as possible, so
the same source can be used routinely.
Specify the method or approach to data collection for each indicator.
Gather comparable data periodically to measure progress.
Assign responsibility to a particular office, team or individual for the timely acquisition of
data from data sources.
Plan the analysis of performance data for individual indicators or groups of related
indicators. Identify data analysis techniques and data presentation formats to be used.
Plan any complementary evaluation efforts.
Estimate roughly the costs to the operating unit of collecting, analyzing, and reporting
performance data for a set of performance measures.
Identify the source of funds.
Establish a plan for reporting, using, and sharing performance information.
Plan to use performance information to adapt and improve the performance,
effectiveness, and design of existing development assistance activities. · Revise Agency
or operating unit strategies where necessary.
Plan new Strategic Objectives, Intermediate Results and activities.
Inform decisions whether to alter or abandon Agency program strategies, Strategic
Objectives or activities that are not achieving intended results.
Document findings on the impact of development assistance.
Plan what evaluation efforts, if any, will be needed to complement information from the
performance monitoring system.
Plan, schedule, and assign responsibilities for internal and external reviews, briefings,
and reports.
Clarify what, how and when management decisions will consider performance
information.
Share performance information with partners and customers, in order to mobilize the
knowledge and experience of key stakeholders to identify ways to improve results.
STEP 4: Agree upon responsibilities for performance.
Empowered individuals/teams/offices/organizations meet or exceed performance
goals when they have authority to make decisions and solve problems related to
the results for which they are accountable. NPR Best-in-Class Practice
Plan roles and responsibilities for achieving results
A partnership involves mutual consultation and dialogue on major aspects of the
program. A basic aspect of program planning, which requires careful thought at the
outset, is determining appropriate roles and responsibilities for both the Granting Agency
and Development Partners.
Negotiate accountability for performance
How far up the hierarchy of results a Development Partner is held accountable for
performance depends on a variety of factors: amount of resources, timetable, their span of
influence over other Development Partners and the Host Country Government, and the
gap between where things are and where things ought to be. Allocating responsibility to a
Development Partner for achievement of results at the Intermediate Result or Strategic
Objective level raises important issues about whether such results are within the partner's
manageable interest. Although SO/IR level responsibility might be negotiated in an
individual case (e.g., in a very small Mission or non-presence country), this is not
currently common practice.
The following table shows the different levels of results and the need for a baseline and
performance target for each result, as well as the locus of accountability for performance.
Note that entries in the third column depend upon the dialogue that has occurred between
the Granting Agency and the Development Partner regarding the appropriate level of
responsibility each has for achieving results.
Performance
Measure or
Indicator
Level of Result
Accountability for
performance?
Agency Goal
Baseline
Agency
Performance Target
Agency Objectives
Baseline
Agency
Performance Target
Mission/Operating Unit
Strategic Objective
Mission and/or NationalPerformance Target based Operating Unit - SO
Teams
Intermediate Result(s)
Development Partner(s)and/or
Baseline
Granting Agency, as
Performance Target
appropriate
Outcome(s)
Development Partner(s)and/or
Baseline
Granting Agency, as
Performance Target
appropriate
Output(s)
Baseline
Development Partner(s)
Performance Target
Activities, strategies,
processes
Baseline
Development Partner(s)
Performance Target
Plan for flexible adjustments
Keep in mind that a wide variety of external factors can affect achievement of specific
results and performance targets. For example, changes in political, social, economic, or
other circumstances or types of external events, may occur. These events may render
previous assumptions invalid, or performance as originally intended impossible or
impracticable.
Download