Evaluation of the Paris Declaration
Phase 2
DAC Evaluation Network
15 June 2009
Niels Dabelstein
Phase II ’Architecture’
Again based on the principles of the Paris
Declaration: a joint evaluation comprising:
•
•
•
•
Country level evaluations assessing results/outcomes
Additional donor/agency HQ studies
Supplementary studies with focus on results
Synthesis report to be presented to 4th HLF
Phase II Evaluation Model
Two complementary foci:
1) Implementation focus (expanded Phase I):
• More diverse set of countries + wider range of
stakeholders
• More attention to capacity building and assess
donor support to analytic & advisory activities
• HQ level studies by donors not included in Phase I
2) Results focus:
• Identify PD influence on development effectiveness
(outcomes & results)
Methodological Issues
Challenges to evaluate the results:
• Brief time span since PD endorsed (March 2005)
• External influences make attribution difficult
• Demanding data requirements
• Complementary methodologies required
To handle these challenges the evaluation should:
•
•
•
•
Have a balanced & sufficient sample of countries
Have sufficient coverage of sectors and themes
Produce information of good quality
Offer possibility of explanation and attribution
Methodological Issues
Therefore methods should include:
•
•
•
•
Synthesis of existing evaluations, research and
indicators
Comparative in-depth case studies chosen to contain a
good cross-section of common themes/sectors
Longitudinal studies: backward looking to track PD-like
(longer established) policies and possibly forward
looking (‘theory-based’ to map plausible directions of
travel)
Targeted comparative studies to ‘supplement’ countrybased evaluations
Overseeing the evaluation
International Reference Group, co-chaired by Sri Lanka
and the Netherlands
• Members of the DAC Network on Development
Evaluation (who actively support)
• Partner countries who conduct country-level
evaluations
• Multilaterals and CSOs
Tasks:
• Endorse overall Evaluation Framework and ToRs for
component & supplementary studies
• Review draft reports for quality, credibility & clarity
Participants in Int. Ref. Group
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Australia
Austria
Belgium
Canada
Denmark
Finland
France
Germany
Global Fund/GAVI
Ireland
Japan
The Netherlands
New Zealand
Norway
Spain
Sweden
Switzerland
United Kingdom
USA
UNDG/UNDP
OECD/DAC
CONCORD
World Bank/IEG
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
Afghanistan
Bangladesh
Benin
Bolivia
Cambodia
Cameroun
Columbia
DRC
Indonesia
Ghana
Kyrgyz Republic
Malawi
Mali
Mozambique
Papua New Guinea
Samoa
Senegal
South Africa
Sri Lanka
Uganda
Viet Nam
Zambia
Reality of Aid
Managing the evaluation
Management Group responsible for:
• Developing the overall evaluation framework and
ToR Core Evaluation Team
• Coordinating and managing the evaluation process
• Guiding the component studies
• Developing and managing supplementary studies
and synthesis of findings and recommendations.
Evaluation Secretariat at Danish Institute for
International Studies
Managing the evaluation
National Reference Groups
Established in-country and with key government,
development partners and NGO stakeholders
• Approve detailed design of country study
• Serve as resource for country evaluation teams
• Review draft evaluation products for quality,
credibility and clarity
BUDGET
Euro
Country Level Studies (18)
USD @ 1,30
1.440.000
1.872.000
Donor HQ Studies (4)
320.000
416.000
Reference Group meetings (4)
350.000
455.000
25.000
32.500
225.000
292.500
1.000.000
1.300.000
Special Studies
550.000
715.000
Dissemination
310.000
403.000
Secretariat DIIS
740.000
962.000
Contingencies
125.000
162.500
5.085.000
6.610.500
Management Group Meetings (8)
Regional workshops (8)
Core team
Total Estimated Cost
Contributions
Euro
Austria
Euro
Norway
*
Australia
100.000
Spain
240.000
Belgium
180.000
Sweden
580.000*
Canada
160.000*
Switzerland
160.000
Denmark
200.000
UK
670.000
Finland
360.000
US
317.000
France
*
AfDB
410.000*
AsDB
Germany
Ireland
80.000
EC
Japan
160.000
IDB
Luxemburg
UN
Netherlands
740.000
New Zealand
45.000
World Bank
TOTAL
Budget
80.000
5.085.000
Outstanding
In kind
4.482.000
603.000
Schedule of Events 2009
•
•
•
•
•
•
•
•
•
•
•
•
•
•
11 – 13 Feb.
1st Meeting of the Reference Group for PD Evaluation Phase 2
Kick-off workshop - 1st draft Approach paper.
15 May
Approach Paper and TOR for Core Team approved.
3 June
Tender process initiated w. three bidders. (one has withdrawn)
5 August
Team Selection
7 September Core Team operational
1 October
Draft Report on Untying of Aid to IRG for comments (by 11
October)
26 – 28 Oct. Asia Pacific Regional Workshop in Cambodia
1 November Final Report on Untying of Aid
3 – 5 Nov.
Latin America Regional Workshop in Colombia
10 – 12 Nov. Anglophone Africa Regional Workshop in Malawi
18 – 20 Nov. Francophone Africa Regional Workshop in Benin
20 November Untying of Aid Report discussed in DAC
30 November 2nd Meeting of the Reference Group for PD Evaluation Phase 2.
1 December Country Level TOR; Work plan for 2010
2 – 3 Dec.
WP-EFF, presentation of progress report and Untying of Aid Study