Differences-between-Transparency-Indicator-and

advertisement
Differences between the Transparency Indicator and the Aid Transparency Index
Approach
Transparency Indicator
Aid Transparency Index (ATI)
Who conducts the
assessment?

The OECD-UNDP Joint Support Team of
the Global Partnership for Effective
Development Cooperation (GPEDC).

What is the purpose of this
assessment?

The Transparency Indicator is one of 10
indicators of the Global Partnership
Monitoring Framework. It measures the
implementation of the Common Standard.

What is the coverage of
actors?

39 providers of ODA that endorsed the
Busan Partnership Agreement and that
have produced an implementation
schedule.
The Transparency Indicator assesses both
bilateral and multilateral donors.
However, for bilateral donors, it assesses
the country as a whole.


What indicators are used?
The Transparency Indicator scores donors on a
total of 100 points, using three dimensions
that are equally weighted:
 Timeliness of reporting
 Level of detail of information
 Forward-looking nature of information
The coverage ratio (coverage of information
as a share of Country Programmable Aid (CPA)
or ODA is taken into account for measuring all
three dimensions.

Publish What You Fund – an independent
global campaign for aid transparency, with
inputs from independent reviewers and the
organisations being assessed.
The ATI assesses the state of aid transparency
among the world’s major donors, tracks and
encourages progress and hold donors to
account on their own commitments to
improve the transparency of their aid.
The 2013 ATI assessed 67 providers of
development cooperation. This included
some organisations that are covered by
Busan commitments but are yet to produce a
schedule for implementing the Common
Standard. The ATI selection criteria can be
found in the technical paper (see p.4).
The ATI assesses large or influential bilateral
and multilateral donors. It assesses more
than one agency for some large bilaterals
with multiple ministries responsible for
significant proportions of ODA.
The ATI uses 39 indicators, grouped into
weighted categories, to assess how transparent
donor organisations are about their aid activities.
These categories cover overall commitment to
aid transparency and publication of information
at both organisation and activity level.
The commitment category indicators account for
10% of the overall weight. Publication accounts
for 90% of the overall weight. Within the
publication category, the organisation-level
indicators account for 25% of the overall weight,
while the activity-level indicators account for
65%. Within these categories, the subgroups are
equally weighted. See here for more details.
Comments
The ATI maintains the disaggregation
of agencies as often there is a wide
variation in the amount of information
made available by different agencies
in a single country or donor group.
Moreover, agencies often retain a
large amount of autonomy in deciding
how much information they make
available and have different
publication approaches, particularly
for activity-level information, and
should therefore be held accountable
for this.
Approach
Transparency Indicator
Aid Transparency Index (ATI)
Comments
How is comprehensiveness
taken into account?
Comprehensiveness is assessed by two
aspects:
 Level of detail of information – coverage
of fields in IATI or CRS data
 Coverage ratio – coverage of information
as a share of ODA (Note: The
Transparency Indicator assumes 100%
coverage for ODA reported to the CRS. For
IATI publishers, coverage is calculated as
2012 disbursements published to IATI as a
proportion of 2012 ODA disbursements as
reported to the CRS.
 For forward-looking data – proportion of
CPA for 2012 covered by FSS or IATI data.
(Note: where IATI figures cannot be
compared to CPA, the reporting volume is
calculated as a proportion of ODA.)

As the Transparency Indicator relies
on the disbursements field in IATI for
calculating comprehensiveness,
publishers who do not currently
publish this field (e.g. Australia,
Canada or Denmark) score 0 for
coverage ratio in IATI and therefore
only their CRS data is taken into
account, even if they publish
comprehensive current data to other
IATI fields. Furthermore, this
calculation of comprehensiveness
does not differentiate between IATI
data that is a conversion of CRS data
and IATI data that is published
frequently and on a timely basis. So
publishers such as Finland are able to
score as well as publishers like
Netherlands, Sweden and UK that
publish current and timely data to
IATI.
The ATI addresses the issue of
comprehensiveness in two ways:
o By looking at the level of detail of
information (coverage of fields in IATI).
o Not taking into consideration data from
publishers with very low coverage ratio.
Several donors included in the Index
do not currently report to IATI.
Calculating coverage of information as
a share of ODA for these donors is
resource intensive and therefore not
undertaken for the purposes of the
ATI. Methodologically it would be
difficult to take into account coverage
of information as a share of ODA for
some, while not doing so for others.
Instead, purposive sampling is
undertaken for information not
published to IATI by looking at five
randomly selected activities in the
donor’s largest recipient country.
Approach
Transparency Indicator
Aid Transparency Index (ATI)
Comments
How is timeliness taken
into account?


The ATI only takes current and forwardlooking data into account, defined as
information that has been published within
the previous 12 months and that relates to
that period or is forward looking.
In terms of frequency, for the 2013 ATI, less
than quarterly publication (the minimum
requirement for the IATI standard) was
allocated fewer points than more frequent
publication.
Time lags are not taken into account in the
ATI.
The ‘best of’ CRS and IATI scoring
approach of the Transparency
Indicator means that an organisation
may score highly on timeliness (up to
a third of the total possible score on
the Indicator) even if it only provides
historical data to CRS or reports more
frequently to the CRS and with fewer
time lags compared to publishing
current data to IATI on an annual
basis.
The Index includes 36 fields of the IATI
component of the Common Standard.
It includes all the added-value fields of IATI.
Over 26% of the overall Index score is
allocated to the publication of performance
data and project documents.
The ATI allocates 10% of the overall score
available to organisation-level information.
As the Transparency Indicator uses the
best or maximum score between CRS
and IATI scores to calculate the final
score a donor receives for level of
detail, it is possible for a donor to
score highly on this (up to one third of
the total possible score on the
Transparency Indicator) even if it only
provides historical data to the CRS or
provides more detail in its CRS data
compared to current data to IATI.


How is the level of detail
of information (number of
activities for which
information on a data field
is provided) taken into
account?




The Transparency Indicator accounts for
timeliness by looking at the frequency of
publication, time lags in reporting in IATI
and CRS respectively and the coverage
ratio (therefore taking into account both
current and historical data). A total score
for timeliness is awarded by selecting the
best or the maximum of the two scores
received by a donor.
While the methodology for calculating
time lags in reporting to IATI relies on
financial transaction dates, time lags in
CRS are calculated by date of reporting.
It is worth noting that most CRS reporting
relates to statistical information
pertaining to previous years and is a
minimum of 18 months old.
The Transparency Indicator includes 38
fields of the Common Standard.
It does not include some of the addedvalue fields of IATI such as results and
conditions.
All project documents (e.g. tenders,
contracts, evaluations, MoUs, etc.) are
assessed in a single field, which means that
the overall weight assigned to them is low.
The Transparency Indicator does not take
into account organisation level information
such as annual reports, audits, allocation
and procurement policies, organisation
and country strategies and total
organisation budget.





The ATI only takes current and
forward-looking data into account,
defined as information that has been
published within the previous 12
months and that relates to that period
or is forward looking. This emphasis
on current data is why it is possible for
a donor to perform well on the
Transparency Indicator but not in the
ATI.
Approach
Transparency Indicator
Aid Transparency Index (ATI)
Comments
How is forward-looking
data taken into account?

The 2013 ATI assessed forward-looking
information in the following ways:
 Number of years ahead for which the total
organisation budget is provided (for the next
three years).
 Number of years ahead for which recipient
country/sector budgets are provided (for the
next three years).
 Annual breakdown of activity budgets for the
lifetime of the activity.
The ATI was released in October 2013.
It looks at forward-looking data for
the year in which the Index is
published and two years forward. So
the 2013 ATI assessed forward-looking
data for calendar years 2013, 2014
and 2015.

The Transparency Indicator assesses the
time span of the information (for how
many years ahead is information
provided), the level of detail (county,
sector and activity) and the coverage
ratio.
As with timeliness and level of detail, the
Transparency Indicator uses the best or
maximum score between CRS and IATI
scores to calculate the final score a donor
receives for forward-looking data.
For IATI publishers, scores are calculated based
on the level of detail of information, i.e. the
number of countries/activities for which data is
provided. Purposive sampling is undertaken for
information on activity and recipient country
budgets for non-IATI publishers.
The Transparency Indicator was
released in April 2014. Organisations
can score for one year forwardlooking data if the information relates
to 2013. It uses the best or maximum
score between FSS and IATI scores to
calculate the final score a donor
receives for forward-looking data.
The ATI scores forward-looking
information published to IATI higher
than information published to FSS.
This difference in approach to
measuring forward-looking data is
why it is possible for a donor like
Austria, Belgium or Portugal to
perform well on this on the
Transparency Indicator but not in the
ATI.
What data sources are
used?
Data reported to OECD DAC’s CRS and FSS;
and data published to the IATI Registry.
Data published to the IATI Registry and/or any
other publicly available source to which the
donor publishes information on current activities
and forward flows. This includes donors’ own
websites, other third-party sites to which
information is reported and the FSS (if the
information is disaggregated by agency).
Note 1: For more on the methodology used for the Transparency Indicator, see here: http://effectivecooperation.org/wordpress/wp-content/uploads/2014/04/3.-GlobalPartnership-Transparency-Indicator-Methodological-Note.pdf . For more on the methodology used for the Aid Transparency Index, see here:
http://ati.publishwhatyoufund.org/wp-content/uploads/2013/10/Technical-paper_FINAL.pdf
Note 2: Publish What You Fund participated in the consultations on the Indicator proposals in 2013. The finalisation and the piloting of the methodology was led by the OECDUNDP Joint Support Team.
Download