Why Results-Based Budgeting? - the United Nations Office at Nairobi

advertisement
What is RBB at the UN?
The UN Planning and Budgeting Cycle
History of Budgeting in the UN (Timeline)
Why change the Budgeting System?
Why Results-Based Budgeting?
Why budgeting at all?
Why Measure Performance?
Why Results-Based Budgeting?
Advantages and Limitations of RBB
Rules and Regulations concerning budgeting of programmes
What are results in results-based budgeting?
Does results-based budgeting prove that a programme is effective?
Why measure results?
What are the practical benefits of results-based management?
Where do results fit in the logical framework?
Where does the measurement of results fit into other United Nations
evaluation processes?
What is RBB at the UN?
 Results-based budgeting at the U N is
“Working towards achieving results and not only towards delivery of
outputs”
The current definition of results-based budgeting within the UN is as
follows:
Results-based budgeting (RBB) is a budget process in which
(a) Missions formulate budgets around a set of pre-defined objectives and
expected accomplishments, and
(b) Expected accomplishments justify the resource requirements which are
derived from and linked to outputs required to achieve such
accomplishments, and
(c) Actual performance in achieving expected accomplishments is measured
by indicators of achievementi.
Budgeting is about dividing up available resources to do certain things.
Results-based budgeting refers to a budget process that directly connects
resource allocation to specific, measurable results. It is a process in which
budgets are used to drive progress and leverage accountability, rather than
simply to maintain the status quo.ii
Goals of RBB within the UN are:
 To measure performance in order to show whether the activities of the
Organization actually make a difference.
 To establish a top-down, logical framework, using a number of
strictly defined concepts, such as objectives for the biennium,
expected results, performance indicators and outputs.1
 To use the biennial programme budget as a direct link between
expected accomplishments and resource requirements.
 To become a management and planning tool, rather than another
budgeting methodology by mapping the expected results for a
biennium in advance and continuously tracking them.
 To focus on the question of “why performance was below
expectations” and enable managers to detect deficiencies (rather than
be a simple cost-cutting tool).
1
For details on those elements see chapter 2.3 of this reference binder.
Note that RBB does not expose programme managers to disproportionate
responsibility by penalizing them for sub-programmes that have not met
desired results. “Expected accomplishments” are not to be understood as
irrevocable production targets that one would find in commercial
enterprises. They should measure the progress towards objectives and should
be a signal whether the programme is on the right track.
Results-based budgeting is not intended to be yet another exercise that takes
time away from the “real work” of United Nations programmes.
Paying systematic attention to your results provides important information to
help your programme determine whether the activities that are keeping staff
very busy are making a positive difference.
Results measurement is a way to know whether the “real work” is the most
effective work or whether the “real work” would benefit from fine-tuning or
shifting your programme’s resources and activities to maximize
effectiveness.
Results measurement involves everyone in the programme, to the extent that
everyone has a sharp focus on the intended results and contributes towards
that end.
Results measurement also involves everyone in the programme, to the extent
that they provide an opportunity to recognize the progressive steps of
success and to celebrate the positive contributions of United Nations
programmes.
The UN Planning and Budgeting Cycle
The following graph shows the planning hierarchy within
the United Nations. Planning becomes more concrete from
one level down to the next.
History of Budgeting in the UN (Timeline)
The following table provides an overview of the development
of budgeting within the UN:
Year
Methodolo
Focus and Goals
gy
Expenditu 
Measuring inputs
1974 re

Budget Sections were
Budgeting
defined in terms of major
objects of expenditure
1974 Programm 
Input focus was
e
replaced by programme
Budgeting
focus
1987

Refinements in the
definition of programmes,
activities, outputs were
formalized
Resource
Base,
Measurem
ent of

Modifications in the
presentation and
methodology

Increased
Regulation/Docu
ments
Regulations
Governing
Programme
Planning, the
Programme
Aspects of the
Budget, the
Monitoring of
Implementation
and the Methods
of Evaluation
(ST/SGB/PPBME
Rules/1(1987))
Year
Methodolo
Focus and Goals
gy
Growth,
transparency and clarity
Recosting
1992 Approval

Focus on the
of changes
relationship between
in
mandates, programmes,
methodolo
budget sections and the
gy and
structure of the Secretariat
format

Direct responsibility
and accountability of
programme managers

Improvement in
evaluation and
performance reporting

Clearly formulated
objectives “to bring about
observable change”iii
1997 ResultsBased
Budgeting
- The First
Steps

Part of the
organization-wide reformprocess

Elements of RBB
were introduced, however,
in a piece-meal fashion
and with weak impact
1998 Request of 
Further justification
a detailed
of the proposed change
report on
RBB
1998 Medium
Term Plan
2001

Focus on objectives
rather than on detailed
descriptions of activities
and outputs

Better link of
Regulation/Docu
ments
32nd Session of
the Committee on
Programme and
Coordination
33rd Session of
the Committee on
Programme and
Coordination
(A/48/16, para.
235)
A/51/950, para.
45, 46 and 240)
Upon
recommendation
of ACABQ,
General
Assembly
Resolution
52/12B
Year
Methodolo
gy
1998
1999
1999 SG Report
A/54/456
2000 ResultsBasedBudgeting
–
Implemen
-tation of
a full
RBB
cycle
Focus and Goals
programmes and budget
sections

Efforts to formulate
clear objectives, but
budget document still
presented activities and
outputs to be delivered

Introduction of RBB
logical framework
prototype to GA

Focus on an
integrated planning,
management and
measurement cycle
Regulation/Docu
ments
Regulations and
Rules Governing
Programme
Planning, the
Programme
Aspects of the
Budget, the
Monitoring of
Implementation
and the Methods
of Evaluation
(ST/SGB/2000/8)
Why change the Budgeting System?
RBB is not just a new budget methodology, but involves significant changes
in the budget format by placing higher standards on programme design and
planning. By mapping the expected results for a biennium in advance and by
tracking to what extent these have been actually met, this budget format is
also a versatile management tool (see chapter 1.5 for the benefits of using
RBB).
Previous budgeting and evaluation methods did not meet the requirements
for an integrated planning, budgeting and measurement system. The budget
throughout the years (see timeline for details) continued to present activities
and outputs to be delivered, rather than results to be achieved.
The deficiencies of the current methodologies are more specifically:
 They do not allow for adequate means of assessing changes or
achievements relative to objectives. Previous programme
performance reporting was limited to a review of the status and
pattern of output delivery. This was largely a quantitative exercise,
showing the implementation rate in terms of outputs programmed,
implemented, postponed, terminated etc.
 They do not reveal the quality and relevance of the output and to
what extent the output leads to the achievement the objectives of the
medium-term plan. In this respect, the Committee on Programme and
Coordination (CPC) has recommended that the programme and
budget performance reports should detail the achievements relative to
the objectives of the programme framework and the resources of the
programme budget (A/48/16, para. 236).
 They primarily focus on short-term management issues, with
recommendations addressing needs assessment, programme design,
problem solving, quality of outputs, timeliness, requirements of endusers, etc., rather than achievement of results.
 RBB elements were, however, introduced in a piece-meal fashion and
have not been consolidated in one interrelated whole. The link
between results or objectives and resources has remained very weak:
resource requirements are still correlated to outputs and activities.
 Programme objectives, while incorporated in the MTP and reflected
in the programme budget for the biennium, are formulated in a
virtual vacuum since no mechanism is in place to measure to what
extent these objectives have been met.
Without a corresponding change in performance monitoring and evaluation
of results, rather than outputs, the impact of defining objectives has been
practically negligible. Moreover, the shift from input to output budgets has
not resulted in reduced input control relaxation, which could allow
programme managers to determine and adjust the “mix” of resources
required to achieve objectives. The current programme budget still combines
a number of restrictive elements of both input and output budgeting without
according any significant discretionary flexibility to programme managers.
Why Results-Based-Budgeting?
Why budgeting at all?
The UN Rules and Regulations require a programme budget and a
programme performance report, in which the Secretariat is committed to
precise work plans involving delivery of output and where implementation
thereof is monitored and reported.iv
Budgeting fulfils a major role within the organization and is an important
element of the planning, programming, budgeting, monitoring and
evaluation cycle. Budgets combine a managerial and a monitoring and
appraisal function.v
A managerial function:
 By defining the resources likely to be available
 By linking performance to resource availability
 By identifying the constraints under which an organisation operates –
recognising what can and cannot be achieved within given resources
and optimising their use
 By encouraging initiative, how inputs may be effectively managed to
produce the desired outcomes
 By clarifying responsibilities, accountability and ownership of
problems and opportunities.
A monitoring/appraisal function:
 By setting periods for review of the cost-effectiveness of operations
 By enabling continuous monitoring, e.g. by appropriate phasing of the
budget and comparison of budget with actual
 By highlighting areas for change i.e. reduce, consolidate or expand.
Why Measure Performance?
Planning and budgeting for programmes only makes sense if these
programmes are also tracked and their performance is measured. This is also
considered in the UN cycle with the elements “monitoring” and
“evaluation”.vi
There are a few compelling reasons for measuring our programmes:
 To see if programmes really make a difference in the relations
between nations and in the lives of people.
 To improve accountability. Measurement makes clear who is
accountable for which contribution to the accomplishments.
 To help programmes improve services. Measurement provides a
learning loop that feeds information back into programmes (on how
well they are doing). It offers findings that managers can use to adapt,
improve, and become more effective.vii
 To measure progress towards accomplishments on a regular basis,
instead of or in addition to ex-post evaluations. Ongoing measurement
toward specific outcomes allows corrective actions to be taken before
the budget period is over.
Other reasons for measuring results of UN programmes include:
 To clarify and confirm objectives
 To provide feedback into programmes for the future
 To retain or adjust funding.
 To focus attention of Member States on policy issues
 To promote support for the specific programme or project
 To recruit and retain talented staffviii
In sum, establishing a measurement system helps address
 why the organisation is measuring,
 what it needs to measure and
 how it should go about implementing measurement.
The answers to these questions give management and staff a clearer picture
of the purpose of their efforts. That alone frequently leads to more focused
and productive delivery of programmes.ix
Why Results-Based Budgeting?
As mentioned before, previous budgeting systems were lacking in several
regards. They allowed the Organization to track the number of inputs and
outputs, showing us whether quantitative targets have been met and - at best
- whether programmes have been efficient in the use of resources. They did
not show, however, elements to assess the impact of those programmes.
Results-based budgeting was therefore chosen as a planning and budgeting
tool because of the following characteristics:
 To determine the effectiveness and quality – rather than only the
quantity – of our services.
 To provide convincing justification for the UN’s existence and its
activities. RBB helps to formulate such justification by compelling us
to focus on why we are doing the things we do and by providing a tool
to measure the actual results of our work.
 To have a tool that combines strategic planning, budgeting and
performance measurement.
 To improve the clarity and consistency of programme or project
designs and
 To facilitate a common understanding and better communication
between Member States, programme managers and staff in general of
the desired results of programmes of the Organization.
 To keep good records, set targets and meet deadlines.
RBB allows the Organization to attain a unified sense of purpose and
direction.
RBB has also been proposed by the Secretary-General as a means to release
programme managers from overly restrictive input and/or central controls
and to accord them more discretion in determining the right mix of resources
to meet expected accomplishments. In RBB, the increase in accountability of
programme managers (a consequence of holding them responsible for the
contribution to accomplishments) is designed to go hand in hand with an
amplified authority for managing financial and human resources.
Advantages and Limitations of RBB
Advantages
Organizations that have implemented results-oriented budgeting and
measurement systems mention two big advantages they could generate:
increasing service effectiveness and communicating programme value.
Several advantages of RBB have already been mentioned from an external
perspective. Apart from positive external effects, the results-based approach
can generate considerable internal value as well, for example:x
 Guide budget development and resource allocation
Expected accomplishments provide a framework to identify resource
requirements.
 Support annual and long-term planning
It is possible to differentiate between short-term accomplishments and
long-term objectives.
 Identify effective best practices
More transparency will lead to more information about possible
internal benchmarks.
 Provide direction for staff
Staff know how their activities in the programme relate to the overall
objective.
 Identify staff and volunteer training needs
Training needs are derived from expected accomplishments and what
it needs from the staff to achieve them.
Limitations
Results-based budgeting, however, is not a remedy for everything. While
there are some clear benefits to gain, it is important to keep in mind what
you can and cannot expect from RBB. Only then will managers and staff be
clear about how and when to use RBB and when other methodologies might
be required to complement it.
Limitations of RBB are:xi
 Outcome findings will not show whether this is the right outcome to
measure.
 They will not statistically prove that it was the programme that caused
the outcome.
 They will not explain why this level of outcome was achieved.
 They will not, by themselves, tell what to change to improve the
outcome.
 RBB is not a substitute, but has to be seen as an addition to existing
data collection efforts.
 Indicators of achievement and outputs may not be readily available. In
order to make RBB work, you may have to invest resources in
developing meaningful measurements.
Results-based budgeting should also not be mixed up with other
methodologies that track performance. RBB is not:
 Experimental research
 Programme evaluation
 A replacement for tracking inputs, activities and outputs
and…
…is not the answer to all problems!
Rules and Regulations concerning budgeting of programmes
The basic rules concerning budgeting of programmes are laid down in
“Regulations and Rules Governing Programme Planning, the Programme
Aspects of the Budget, the Monitoring of Implementation and the Methods
of Evaluation” (ST/SGB/2000/8).
 Article III describes the rules on the planning, programming and
budgeting process.
 Article V refers to the programme aspects of the budget. Rule 105.2
lays out in more detail the results-based budgeting approach:
“ No activity or output shall be included in the proposed programme
budget unless it is clearly in implementation of the medium-term plan
strategy and likely to help to achieve the plan objectives, or it is in
implementation of legislation passed subsequent to the approval or
revision of the plan.”
What are results in results-based budgeting?
 Results are the programme’s intended benefits for the end-users of
United Nations programmes; namely individuals, populations,
communities, organizations, nations and regions.
 Results address the “so what” question: What difference did this
programme make to individuals, populations, communities,
organizations, nations and/or regions?
 Results are the logical expected accomplishment that occurs during or
after the delivery of programme outputs.
Results involve a change in Knowledge, Skills, Attitude, Behavior,
Condition, Policy etc
Does results-based budgeting prove that a programme is effective?
Results data do not ‘prove’ that a specific programme ‘caused’ an expected
accomplishment. Measurement for results-based budgeting does not usually
control all other possible influences on an expected accomplishment.
Results typically occur because a number of factors contribute to an
expected accomplishment. Results data provide a basis for a ‘plausible’
claim that a specific programme ‘contributed’ to an expected
accomplishment.
Why measure results?
 Results-based management encourages programmes to make midcourse adjustments that are based on how well end-users are benefiting
from the selected outputs.
 Results-based management focuses performance measurement
attention on benefits to end-users, rather than counting levels of
activity.
 Results-based management is a dynamic process, providing feedback
throughout the full programme cycle: planning, programming,
budgeting, monitoring and evaluation.
What are the practical benefits of results-based management?
 Results-based management can be applied many ways. For example:
 To determine effectiveness and continued relevance of activities
 To provide feedback to programmes for future actions
 To focus Member States on policy issues
 To promote support for effective programmes
 To develop and adjust programme budgets
 To recruit and retain talented staff
 To identify and celebrate progress being made
Where do results fit in the logical framework?
Results provide a critical linkage to the broad objectives of programmes and
the implementation process.
Planning
Objectives Results
Outputs
Inputs
Activities
Linkages
are
critical!!!
Performance
Measurement
Implementation
Where does the measurement of results fit into other United Nations
evaluation processes?
 Measurement of results is an extension of the periodic ‘self-evaluation’
that programmes currently conduct.
 The past focus of self-evaluation has been primarily on subprogramme
outputs and activities.
 Results-based budgeting extends the focus to include subprogramme
results.
 These additional data provide more complete management information
for strengthening programme effectiveness and impact.
 Results data may also be useful to the more rigorous and extensive ‘indepth’ evaluations that are selectively undertaken.
i
UN Guide to RBB (Version 1.1), Office of Programme Planning, Budget and Accounts, 23
October 1998, Glossary.
ii Melaville, Atelia I. A Guide to Selecting Results and Indicators. Prepared for the Finance Project,
May 1997, p. 3
iii
UN Guide to RBB (Version 1.1), Office of Programme Planning, Budget and Accounts, 23
October 1998, p. 8
iv Regulations and Rules Governing Programme Planning, the Programme Aspects of the Budget,
the Monitoring of Implementation and the Methods of Evaluation, ST/SGB/2000/8, 19 April 2000,
p.1
v A Guide to Devolved Budgeting, Chartered Institute of Management Accountants, CIMA
Education Group, p. 3
vi
Regulations and Rules Governing Programme Planning, the Programme Aspects of the Budget,
the Monitoring of Implementation and the Methods of Evaluation, ST/SGB/2000/8, 19 April 2000,
p.1
vii Measuring Program Outcomes: A Practical Approach, United Way of America, 1996, p. 4
viii Results-Based Budgeting and Management in a Nutshell, Programme Planning and
Budget Division, United Nations, April 2002, p. 17
ix
Measuring Program Outcomes: A Practical Approach, United Way of America, 1996, p. 4
x
Outcome Measurement: Are You Making a Difference?, Learning Institute for Nonprofit
Organizations, 2000, p. 4
xi
Outcome Measurement: Are You Making a Difference?, Learning Institute for Nonprofit
Organizations, 2000, p. 4 and Measuring Program Outcomes: A Practical Approach,
United Way of America, 1996, p. 21-23
Download