Implemented by
DMI Associates Consortium
Financed by
the European Union
Monitoring & Evaluation Capacity Building
Needs Assessment
STE Mission REPORT
Project Partner/Beneficiary is the Coordination Bureau of European and Euro-Atlantic
Integration of the Secretariat of the Cabinet of Ministers of Ukraine (SCMU)
Direct local beneficiaries: seven Sub-Committees of the Cooperation Committee/Ministries
chairing PCA (ENP AP) Sub-committees
Inna Bayda, Project Expert
Kyiv, 30 January 2009
EU Support to the Partnership
and Cooperation Agreement
(PCA) implementation – Ukraine
13a Pymonenka Street,
Suite 44, 4th floor
04050, Kyiv, Ukraine
Tel.:
Tel./Fax:
+38044 482 19 38
+38044 482 12 81
E-mail: office@pca.kiev.ua
http://www.pca.kiev.ua
2
Table of contents
List of Acronyms
4
Executive Summary
5
1 Introduction
1.1 Objective of the assignment
1.2 Approach and methodology used
1.3 Target groups interviewed
6
2 Mission Results by Tasks
Error! Bookmark not defined.8
2.1 Quantitative analysis of results obtained through questionnairs
8
2.2 Qualitative analysis of results based on questionnairs and interviews
12
3 Conclusions
20
4 Recommendations/Identified areas for improvement
21
5 Identified areas for further work
5.1 Target groups built around the proposed M&E capacity building plan
5.2. Tentative module-based M&E capacity building plan
22
22
26
ANNEXES
ANNEX I
ANNEX II
ANNEX III
ANNEX IV
ANNEX V
Terms of Reference
CV of the Expert.
Tentative mission plan
List of stakeholders contacted
Documents consulted
3
List of Acronyms
AP
CSP
EC
EU
LFM
M&E
NPI
OO
OVI
PCA
PE
PCM
PP
SCMU
TA
ToR
Action Plan
Country Strategy Paper
European Commission
European Union
Logical Framework Matrix
Monitoring and Evaluation
New Practical Instrument
Overall Objectives
Objectively Verified Indicators
Partnership and Cooperation Agreement
Programme Estimate
Project Cycle Management
Project Purpose
Secretariat of the Cabinet of Ministers of Ukraine
Technical Assistance
Terms of Reference
4
EXECUTIVE SUMMARY
Conclusions
1. The previous and current level of knowledge and experience in M&E (in evaluation in
particular) is generally low among relevant stakeholders. The level of willingness to learn can be
generally assessed as above average.
2. None of the ministries interviewed and MDCSU have a special unit on M&E responsible for
European integration process. Existing units, which have some M&E functions have general
administrative functions and do not correspond to actual needs in M&E related to European
integration process.
3. The level of understanding of M&E tasks, methods and importance varies depending on the
level of administrative power. More understanding has been observed at the execution level.
The higher level officials of administrative hierarchy (heads of departments) pay less attention to
these issues due to busy schedule, which results in the absence of formalization of institutional
framework for M&E functions.
4. M&E functions and responsibilities go far beyond the boundaries of departments of European
integration formally responsible for these activities in line ministries. Active involvement of other
relevant departments providing information to the coordinating one is critical for M&E system’s
proper operation.
5. Clear specific instruction are required for ministries from the Bureau of European and EuroAtlantic Integration of the SCMU of Ukraine on concrete M&E tasks to be incorporated in daily
activities of the relevant specialists aimed at improvement of M&E activities.
Recommendations
 To involve departments of the line ministries which provide required information on the
status of Ukraine-EU Action Plan and further - New Practical Instrument implementation
to the departments of European integration, in M&E capacity building activities.
 To pay particular and urgent attention to capacity of relevant departments of the line
ministries in charge of filling in the structure/formulating tasks of NPI.
 Although evaluation is generally not considered by stakeholders interviewed as a priority
area for project support, it is advisable to build the capacity in this area in a view of
introduction of the New Practical Instrument.
 To discuss with the project beneficiary the issue of gradual official introduction of new
duties into the relevant structures of coordinating and line ministries (interim evaluation
of programmes, for instance) aimed at facilitation and improvements in implementation
and monitoring of the NPI.
 Clear specific instruction are required for line ministries from the Bureau of European
and Euro-Atlantic Integration of the SCMU of Ukraine on concrete M&E tasks to be
incorporated in daily activities of the relevant specialists.
 In order to maximize the impact from M&E capacity building, it is recommended to send
training/seminars materials to participants well in advance for preliminary study,
preparation of questions etc.
 Individual consultation, short-term on-the-job training, counselling etc. have to be
decided with each particular institution. It is recommended to send a letter from the
project asking provide subject, timing and other arrangements for such activities.
 For individual consultations, specific thematic trainings, counselling etc. to consider
distance learning method.
5

To consider further planning and carrying out capacity building programmes in
cooperation with the School for Senior Civil Service Executives of the Main Department
of Civil Service of Ukraine.
6
1 INTRODUCTION
1.1
Objective of the assignment
In accordance with the ToR, developed for the short-term assignment on M&E Capacity Building
Needs Assessment, the objectives of the mission were:
The Overall Objective: improved capacity in the area of monitoring and evaluation of the
Ukrainian civil servants and other representatives of various project beneficiaries and partners
through a proper assessment of their capacity building needs as the first step in forming a
coordinated project response through training, study tours and other capacity building activities.
The Specific Objective: to create a consolidated inventory of the capacity building needs in the
area of Monitoring and Evaluation (M&E) through analysis of individual needs of particular target
groups among Ukrainian civil servants and other representatives of various project beneficiaries
and partners involved in European integration of Ukraine.
The final outcome of the present short-term assignment is the identified areas/priorities for
project training interventions in 2009 formulated in the proposed tentative M&E module-based
capacity building work plan.
The aim is to make the proposed capacity building plan client-oriented taking into consideration
the level of knowledge on M&E among relevant stakeholders, busy schedule of civil servants
and increasing importance of using M&E tools and techniques in a view of introducing New
Practical Instrument replacing Ukraine-EU Action Plan.
1.2
Approach and methodology applied
The two-side approach has been used for this assignment based on the results of
questionnaires and interviews with relevant stakeholders:
(1) what stakeholders think they need to know about M&E, the level of depth of this
knowledge, further use of the knowledge to be obtained in day-to-day work, areas of
particular interest/need and
(2) what stakeholders actually need to know about M&E, further use of the knowledge to be
obtained in day-to-day work, areas of particular interest/need in a view of forthcoming
challenging changes in requirements to Ukraine in the framework of the New Practical
Instrument and future Association Agreement towards EU integration.
Two major components – institutional and personal – have formed the basis of the approach for
the present M&E capacity building needs assessment.
The methodology applied has been based on logical sequence of activities (see Tentative
Mission plan, annex III to this report), starting from studying the relevant documents and
structures of institutions, sending adjusted questionnaires to the relevant stakeholders/target
groups, carrying out interviews with target groups’ representatives with a focus on the Bureau of
European and Euro-Atlantic Integration of the Secretariat of the Cabinet of Ministers of Ukraine
(SCMU) and Secretaries of Sub-committees from the Ministries chairing PCA (ENP AP).
These preparatory and implementation stages have been followed by thorough analysis of the
information received in the form of filled in questionnaires and interviews.
7
Qualitative analysis followed by quantitative analysis of M&E capacity building needs were used
as major methodological tools. The outcomes from the analysis are presented in conclusions
and recommendations and have resulted in tentative module-based M&E capacity building plan.
1.3
Target groups interviewed
Target groups for M&E capacity building needs assessment are represented by the project
beneficiary, line ministries which are in charge of seven PCA (ENP AP) sub-committees and
other relevant state institutions:








Bureau of European and Euro-Atlantic Integration of the SCMU of Ukraine, Project
Beneficiary, which plays the main coordination role in the process of European
integration in general and responsible for coordinating M&E activities in particular;
Ministry of Economy of Ukraine, chairing three PCA (ENP AP) Sub-committees (N 1 –
“Trade and investment”; N 2 – “Economic and social affairs, finance and statistics” and N
3 – “Enterprise policy, competition, regulatory cooperation”);
Ministry of Fuel and Energy of Ukraine, chairing PCA (ENP AP) Sub-committee N 4
“Energy, transport, nuclear safety and environment”;
State Customs Committee of Ukraine, chairing PCA (ENP AP) Sub-committee N 5
“Customs and cross-border cooperation”;
Ministry of Justice of Ukraine, chairing PCA (ENP AP) Sub-committee N 6 “Justice,
freedom and security”;
Ministry of Education and Science, chairing PCA (ENP AP) Sub-committee N 7 “Science
and technologies, research and development, education, culture, public health,
information society and media”;
Ministry of Foreign Affairs – in charge of coordination of New Practical Instrument
development;
Main Department of Civil Service of Ukraine – in charge of capacity building for civil
servants and a number of EU-funded programmes relevant to M&E.
The whole list of stakeholders interviewed is presented in Annex IV of this report.
Target groups/participants for particular module-based capacity building activity will be formed
from the above list of stakeholders around specific priority areas identified through the analysis
presented in the further sections of this report.
8
2 MISSION RESULTS BY TASKS
2.1 Quantitative results obtained through questionnaires
Eight organizations were interviewed in total in the framework of the assignment.
Bureau of European and Euro-Atlantic Integration of the SCMU was represented by two
relevant departments (Department on Monitoring of Ukraine-EU relationships and Department
of Strategic Planning of European Integration).
Departments of European integration in each of the line ministry responsible for sub-committees
of the Cooperation Committee established in the framework of the PCA/ENP AP (Ukrainian
parts of the joint Ukraine-EU bodies) represented the key relevant stakeholders for interviews.
Other relevant stakeholders interviewed were represented by:
 the Ministry of Foreign Affairs, which plays one of the key coordination functions in the
process towards EU integration, and currently is responsible for New Practical Instrument
formulation, which will replace Ukraine-EU Action Plan in few months;
 Centre for adaptation of the civil service to the standards of the European Union
 School for Senior Civil Service Executives of the Main Department of Civil Servants of
Ukraine.
Both structures have a function of advanced trainings for civil servants in the fields related to the
all aspects of EU integration.
Table 1 summarizes the number of questionnaires filled in by each organization. The detailed
list of interviewees with names and positions is presented in annex IV of this report.
Table 1
N
1
Organization
Subcommittee
Bureau of European and Euro-Atlantic Integration of N/a (coordination
the SCMU of Ukraine
function)
2
Ministry of Economy of Ukraine
1,2,3
3
Ministry of Fuel and Energy of Ukraine
4
4
Customs Committee of Ukraine
5
5
Ministry of Justice of Ukraine
6
6
Ministry of Education and science
7
7
Ministry of Foreign Affairs of Ukraine
N/a (coordination
function)
8
Main Civil Service Department of Ukraine, namely:
N/a
Centre for adaptation of the civil service to the
standards of the European Union
School for Senior Civil Service Executives
34
Total number of questionnaires received
Number of
questionnaire
s filled in
12
2
5
2
3
7
1
2:
1
1
9
Institutional aspects have been included in questionnaires in order to determine the role of
M&E functions in day-to-day activities of the relevant stakeholders (which have been the subject
of current needs assessment) and how M&E capacity is built by the institution concerned.
The key results obtained are summarized in the Table 2 below1.
Table 2
Ministry of Economy
of Ukraine
No
Intention
to
establish
/expand
a
separate
M&E unit
No
Ministry of Fuel and
Energy of Ukraine2
Yes
No
3
Planning
Data analysis
Reporting
Project monitoring
Planning
Data analysis
Indicators
development
Reporting
Project monitoring
Customs Committee
of Ukraine
Ministry of Justice of
Ukraine
Yes (?)
No
0
No
No
Yes
No
2
Ministry of Education
and science
Yes
Yes
7 (in total)
Current
Ex-post
Project and
Programme
evaluation
Policies evaluation
Current
Ex-post
Programme
evaluation
Ministry of Foreign
Affairs of Ukraine
Yes
No
5/6
Planning
Indicators
development
Data analysis
Reporting
Project monitoring
Planning
Data analysis
Indicators
development
Reporting
Data analysis
Reporting
Policy monitoring
Centre of adaptation
to EU standards,
Main Civil Service
Department of
Ukraine
Yes
Yes
8
Organization
(Declared)
availability
of a
separate
M&E unit
(Declared)
N of
experts in
charge of
M&E
2
Capacity building activities
undertaken by organization
Monitoring
Evaluation
No
Planning
Data analysis
Indicators
development
Reporting
Project and
Programme
monitoring
Preliminary
Current
Ex-post
Project evaluation
Preliminary
Current
Ex-post
Policies evaluation
Current
Project and
Programme
evaluation
1
Bureau of European and Euro-Atlantic Integration of the SCMU of Ukraine is not included into this summary
because of its coordination M&E function and will be analysed in section 2.2 of this report (qualitative analysis).
2
Data from Information and analytical department of the Ministry; department of European integration
does not have M&E unit and no capacity building activities
10
School for Senior Civil
Service Executives,
as above
Yes
No
3
No
No
It can be stated that out of 8 organizations analyzed, seven ones have a separate unit
responsible for M&E. However, qualitative analysis presented below shows imbalances in
practical performing of M&E functions.
Personal experience and knowledge of M&E has been assessed from retrospective point of
view (past experience), current level of M&E experience and knowledge expressed in the
course of needs assessment and areas of further capacity building in the field concerned.
Table 3 presents retrospective summary of the personal M&E experience and knowledge of the
relevant interviewed stakeholders per organization.
Table 3
Organization
Bureau of European and
Euro-Atlantic Integration
of the SCMU of Ukraine
Ministry of Economy of
Ukraine
Ministry of Fuel and
Energy of Ukraine
Customs Committee of
Ukraine
Ministry of Justice of
Ukraine
Ministry of Education and
science
Ministry of Foreign Affairs
of Ukraine
Main Civil Service
Department of Ukraine
Number of
specialists involved
in previous capacity
building activities
on monitoring/total
N of interviews
Number of
specialists involved
in previous capacity
building activities
on evaluation/total N
of interviews
5/12
2/12
1/2
0/2
0/5
1/5
1/2
1/2
1/3
0/3
2/7
0/7
0/1
0/1
2/2
1/2
Percentage of
the total number
of specialists
interviewed
42% - monitoring
16,7% - evaluation
50% - monitoring
0% - evaluation
0% - monitoring
20% - evaluation
50% - monitoring
50% - monitoring
33% - monitoring
0% - evaluation
29% - monitoring
0% - evaluation
0% - monitoring
0% - evaluation
100% - monitoring
50% - evaluation
The declared average percentage of previous experience in monitoring capacity building
activities is 38%, which is not too high.
However, it is obvious that participation in the past capacity building on evaluation is
considerably lower as compared to the past capacity building experience in monitoring and
constitutes only 17% in average.
11
The current status of average personal M&E experience and knowledge is summarized per
organization as follows3:
The answer “yes” is given if more than 80% of interviewees within each organization indicated the availability of
relevant experience/knowledge; the answer “no” is given if less than 30% indicated the absence of
experience/knowledge; the answer “partial” is given of less than 80% indicated experience/knowledge in monitoring
or evaluation.
3
12
Table 4
Organization
Average experience and
knowledge in monitoring
(as declared)
Average experience and
knowledge in evaluation
(as declared)
Yes
Partial
Yes
Yes
No
No
No
Yes
Partial
No
Partial
Partial
Yes
Yes
Yes
Yes
Bureau of European and EuroAtlantic Integration of the SCMU
of Ukraine
Ministry of Economy of Ukraine
Ministry of Fuel and Energy of
Ukraine
Customs Committee of Ukraine
Ministry of Justice of Ukraine
Ministry of Education and
science
Ministry of Foreign Affairs of
Ukraine
Main Civil Service Department of
Ukraine
It can be concluded that none of the stakeholders have adequate knowledge in evaluation.
Further analysis on the current status of M&E knowledge and experience is provided in section
2.2 of this report.
The previous and current experiences in M&E and capacity building activities in these fields
have formed the basis of the assessment by interviewees of the general areas for further project
support the most useful for current work. It is summarized as follows:
Table 5
The most useful areas for project support4
Organization
Bureau of European and EuroAtlantic Integration of the
SCMU of Ukraine
Ministry of Economy of Ukraine
Ministry of Fuel and Energy of
Ukraine
Customs Committee of Ukraine
Ministry of Justice of Ukraine
Ministry of Education and
science
Ministry of Foreign Affairs of
Ukraine
Main Civil Service Department
Monitoring
Evaluation
Both
+
+
+
+
+
+
+
+
+
+
4
The area is considered as useful if more than 50% of interviewees within each organization indicated it as useful; if
50/50 – both areas are indicated
13
of Ukraine
14
2.2 Qualitative analysis of results based on questionnaires and interviews
Qualitative conclusions of the present analysis to the large extent come out of quantitative
analysis of the stakeholder’s feedback presented above plus analysis of the responses,
comments and opinions expressed during the interviews.
As can be seen from the Table 1, the response of stakeholders in terms of number of
questionnaires filled in by each organization differs. This depends on whether the
questionnaires were filled in mostly by the specialists of departments of European integration or
they were distributed to other departments which provide information to the departments of
European integration.
Usually, departments of European integration play coordination role at the level of the line
ministry while other relevant departments are responsible for actual implementation of particular
articles of Ukraine-EU Action Plan. It has been concluded that as compared with departments
of European integration which have some knowledge on M&E (on monitoring in particular) other
relevant departments have no or very wage idea (as a best scenario) about M&E.
Assuming that these departments will continue working on implementation of tasks in the
framework of New Practical Instrument, which is currently being formulated by the same
departments/people of the line ministries, their involvement in M&E capacity building activities is
critical.
This issue is particularly relevant at the current moment during the NPI formulation process, as
each task of the NPI should be formulated in such a way that allows objective verification,
quantitative and qualitative assessment of the status of achievements, indicator-based
monitoring and criteria-based evaluation in a longer run.
Some line ministries have already understood the importance of the above-mentioned necessity
of involvement of other relevant department in M&E capacity building activities (Ministry of
education and science, Ministry of fuel and energy) and their feedback on project needs
assessment was therefore more pro-active.
Institutional M&E capacity
Table 2 summarizes the current institutional aspects of M&E in line ministries in charge of subcommittees and other relevant stakeholders. Although it looks like the most of the ministries
interviewed formally have separate M&E units, in fact these units/divisions quite often have
nothing to do with M&E as such but control the execution of certain tasks and activities of the
ministry and report to the top management in line with hierarchy structure.
The same concerns the areas of M&E capacity building activities undertaken by institutions
interviewed: in most cases understating of M&E planning, indicators, data analysis reporting etc.
at the execution level of the line ministry is far from proper knowledge of M&E tools and
techniques.
It has been observed that a specialized M&E unit related to EU integration process does not
exist in any ministry. This can be explained by the fixed and approved administrative structure of
each line ministry. This is further exacerbated by the lack of initiative due to the lack of
understanding at the higher level of the line ministry management of importance of M&E which
will be even more prioritized in the framework of NPI implementation.
Introduction of the new administrative unit on M&E can be possible in case of a special order of
the Cabinet of Ministries of Ukraine based on principle agreement from the Bureau of European
and Euro-Atlantic Integration of the SCMU of Ukraine to introduce it. Such institutional change
15
can facilitate the process of Ukraine’s movement towards fulfilment of commitments and tasks in
a view of integration to the EU.
Bureau of European and Euro-Atlantic Integration of the SCMU of Ukraine
The function of monitoring directly concerns two of three departments of the Bureau, namely:
(1) Department of monitoring of Ukraine-EU relationships (17 specialists with direct
responsibilities for monitoring – 6) with major responsibilities for monitoring of UkraineEU agreements, particularly PCA, Ukraine-EU Action Plan; preparation and further
monitoring of NRI implementation; monitoring of agreements between the Council of
Europe and the Ukraine-EU Cooperation Committee etc. and
(2) Department of strategic planning of European integration (13 specialists, with direct
responsibilities for monitoring – 5) with major responsibilities for the monitoring of
Ukraine’s obligations before the Council of Europe; participation in the monitoring of
legislation approximation programmes’ implementation etc.
In addition, the function of monitoring concerns other departments of the SCMU, such as
Department of strategy on economic reforming and strategic planning; Department of regional
policy, department of monitoring and market changes in energy sector of economy, Department
of investment and innovation policy and others.
Capacity building activities in M&E have been previously undertaken in many aspects, like data
analysis, project monitoring, policy monitoring, programme evaluation (preliminary, current and
ex-post). However, the majority of capacity building activities were focused on general aspects
and topics.
It has been concluded that further capacity building in M&E is required to cover both conceptual
and more specific methodological aspects of M&E. This is particularly relevant at the current
stage, as the Bureau formation has been recently completed and young dynamic staff has
joined the team of experienced specialists. Therefore, the project M&E capacity building
programme for 2009 will be a timely and highly needed effort to ensure further enrichment of
M&E knowledge and experience through regular similar programmes. This has been confirmed
by individual self-assessment of M&E capacity building needs. It is important to involve other
relevant departments of the SCMU in these activities.
In particular, such capacity building programmes can be implemented in cooperation with the
School for Senior Civil Service Executives of the Main Civil Service department of Ukraine.
Personal experience and knowledge in M&E
Table 3 above shows generally low participation of the relevant stakeholders in M&E capacity
building activities and extremely low level of evaluation experience in the past.
In order to build upon previous and current experiences and knowledge on M&E while preparing
M&E capacity building programme in the framework of the project, it is worth analyzing the
current status experience/knowledge in M&E and own assessment of the stakeholders of its
level.
The following table summarizes the average assessment of current experience and knowledge
on M&E areas expressed by interviewed stakeholders themselves. It includes availability of
experience in M/E as a whole, areas of expertise and estimation of average level of knowledge
per organization.
16
Table 6
Organization
Bureau of European and
Euro-Atlantic Integration of
the SCMU of Ukraine
Ministry of Economy of
Ukraine
Ministry of Fuel and Energy
of Ukraine
Customs Committee of
Ukraine
Ministry of Justice of Ukraine
Ministry of Education and
science
Ministry of Foreign Affairs of
Ukraine
Main Civil Service
Department of Ukraine
Fields of current experience
in monitoring
Fields of current experience
in evaluation
Monitoring planning
Reporting5
Project monitoring
Indicators development
Data analysis
Monitoring planning
Indicators development
Reporting
Data analysis
Project monitoring
Monitoring planning
Reporting
Project/programme monitoring
Indicators development
Data analysis
N/a
Conducting evaluation
Project/programme evaluation
Policies evaluation
Preliminary/current and ex-post
evaluation
Project monitoring
Indicators development
Data analysis
Reporting
Monitoring planning
Project monitoring
Indicators development
Data analysis
Reporting
Monitoring planning
Data analysis
Reporting
Policies monitoring
Monitoring planning
Project/programme monitoring
Indicators development
Data analysis
Reporting
Conducting evaluation
Project/programme evaluation
Policies evaluation
Current and ex-post evaluation
Conducting evaluation
Project/programme evaluation
Current and ex-post evaluation
N/a
N/a
N/a
Conducting evaluation
Policies evaluation
Preliminary/current and ex-post
evaluation
Project/programme evaluation
Current evaluation
Following the approach to analyze the opinions of interviewees and provide an external views
on actual status of knowledge and experience in M&E, it can be concluded that although quite
positive picture on the current level of knowledge of monitoring areas is presented in Table 5,
the realistic status of this knowledge is less optimistic and in many cases is limited to general
knowledge of basic principles and methods.
5
The most frequently indicated areas by each interviewee within one organization are presented in bold
17
A number of the relevant stakeholders in line ministries expressed their doubts about practical
use of knowledge on M&E and, particularly evaluation knowledge, in their day-to-day activities.
Consequently, they have not indicated the interest in obtaining knowledge on evaluation through
the project support even in its full absence. In spite of this, it is believed that general knowledge
and understanding of evaluation value is critically important, taking into account the forthcoming
changes in M&E requirements in light of NPI introduction.
Based on the previous and current experience and knowledge in M&E of the relevant
stakeholders interviewed, assessment of current and future needs in M&E, they have expressed
their vision of the following areas of the project support to be provided in building their capacity
in monitoring:
Table 7
Organization
Areas of the project
support
(monitoring)
Priorities among proposed
areas
(monitoring)
General knowledge
Methodology and tools
Strategy formulation and
development, including
objectives and indicators
Indicators at different levels
Comparison of the Ukraine with
the EU, new EU member states
and pre-accession EU
Monitoring with applied IT
technologies
Reporting
ROM
SWAP
Methodology and tools
ROM
PIM
MPI
SWAP
General knowledge
Methodology and tools
Indicators at different levels
SWAP
Sector monitoring
General knowledge
Monitoring with applied IT
technologies
ROM
SWAP
Indicators at different levels
Customs Committee of Ukraine
Monitoring methodologies and
tools for further use for ENPI, NPI
and Association agreement
- ROM
Monitoring methodologies and
tools (generally)
Ministry of Justice of Ukraine
Methodology and tools
Strategy formulation and
development, including
objectives and indicators
Planning instruments
Reporting
Monitoring with applied IT
technologies
Methodology and tools
Reporting
Monitoring with applied IT
Bureau of European and EuroAtlantic Integration of the SCMU
of Ukraine
Ministry of Economy of Ukraine
Ministry of Fuel and Energy of
Ukraine
Methodology and tools
ROM
SWAP
PIM
General knowledge
Methodology and tools
SWAP
Sector monitoring
18
Ministry of Education and
science
Ministry of Foreign Affairs of
Ukraine
Main Civil Service Department of
Ukraine
General knowledge
Methodology and tools
Indicators at different levels
Strategy formulation and
development, including
objectives and indicators
General knowledge
Methodology and tools
Indicators at different levels
Comparison of the Ukraine with
the EU, new EU member states
and pre-accession EU
ROM
SWAP
PIM
MPI
All areas except ROM
General knowledge
Methodology and tools
Indicators at different levels
Comparison of the Ukraine with
the EU, new EU member states
and pre-accession EU
PIM
MPI
SWAP
Most of stakeholders tend to obtain general knowledge on monitoring without going deeper into
particular methodologies and tools. However, during the interviews the need to study specific
methodological tools and techniques (ROM, PIM, MPI, and SWAP) was re-ensured. This fact
confirms the conclusion made regarding somewhat inadequate self-assessment of the level of
stakeholders’ knowledge on monitoring and confirms the need to improve and develop it further
for the majority of stakeholders.
Although evaluation has been identified by interviewees as less applicable in their current and
future jobs, during the interviews the importance of evaluation was stressed and explained. As a
result, the following table summarizes the stakeholders’ expectations from the project capacity
building in evaluation:
Table 8
Organization
Areas of the project
support
(evaluation)
Bureau of European and EuroAtlantic Integration of the SCMU
of Ukraine
Ministry of Economy of Ukraine
Ministry of Fuel and Energy of
Ukraine
General knowledge
Methods and tools
Data analysis(qualitative and
quantitative)
Comparison of the Ukraine with
the EU, new EU member states
and pre-accession EU
countries
Impact evaluation
SWAP, SPSP
Interim evaluation
General knowledge
Methods and tools
Data analysis(qualitative and
quantitative)
Impact evaluation
Priority among proposed
areas
(evaluation)
General knowledge
Methods and tools
Impact evaluation
Data analysis(qualitative and
quantitative)
SWAP, SPSP
General knowledge
Interim sector evaluation
SWAP, SPSP
19
Customs Committee of Ukraine
Ministry of Justice of Ukraine
Ministry of Education and
science
Ministry of Foreign Affairs of
Ukraine
Main Civil Service Department of
Ukraine
SWAP, SPSP
Interim sector evaluation
All general issues
Methods and tools
Evaluation reports
SWAP, SPSP
Comparison of the Ukraine with
the EU, new EU member states
and pre-accession EU
countries
All areas
All areas
Methods and tools of evaluation
Evaluation reports
SWAP, SPSP
Comparison of the Ukraine with
the EU, new EU member states
and pre-accession EU
countries
General knowledge
Methods and tools
Indicators at different levels
ROM
SWAP
SWAP, SPSP
Policy impact evaluation
All areas
The following modules relevant to both M&E have been identified as the most needed by in their
current jobs of stakeholders interviewed:
Table 9
Organization
Bureau of European and EuroAtlantic Integration of the SCMU
of Ukraine
Ministry of Economy of Ukraine
Ministry of Fuel and Energy of
Ukraine
Customs Committee of Ukraine
Ministry of Justice of Ukraine
Capacity building modules
the most needed in current
jobs (M&E)6
Priorities among capacity
building modules the most
needed in current jobs
(M&E)
Monitoring system development
PCM
Logical framework approach
and matrix (LFA & LFM)
OVIs
M&E techniques and criteria
Data analysis and monitoring
Monitoring system development
M&E techniques and criteria
Logical framework approach
and matrix (LFA & LFM)
M&E techniques and criteria
Data analysis and monitoring
OVIs
PCM
OVIs
M&E techniques and criteria
Monitoring system development
M&E techniques and criteria
Data analysis and monitoring
Monitoring system development
PCM
Data analysis and monitoring
M&E techniques and criteria
PCM
Data analysis and monitoring
LFA & LFM
PCM
Monitoring system development
M&E techniques and criteria
(general)
Logical framework approach
6
Among areas proposed in the questionnaire, only those the most frequently requested by interviewees have been
listed
20
Ministry of Education and
science
Ministry of Foreign Affairs of
Ukraine
Main Civil Service Department of
Ukraine
Logical framework approach
and matrix (LFA & LFM)
Data analysis and monitoring
PCM
Logical framework approach
and matrix (LFA & LFM)
Data analysis and monitoring
OVIs
Monitoring system development
M&E techniques and criteria
Data analysis and monitoring
Monitoring system development
PCM
Logical framework approach
and matrix (LFA & LFM)
OVIs
M&E techniques and criteria
Data analysis and monitoring
Monitoring system development
Institutional capacity
assessment
and matrix (LFA & LFM)
Development of own internal
monitoring systems
Logical framework approach
and matrix (LFA & LFM)
OVIs
Monitoring system development
Monitoring system development
Monitoring system development
PCM
Logical framework approach
and matrix (LFA & LFM)
OVIs
The following table summarizes the most requested forms of the project support, in which M&E
capacity building programme will be delivered:
Table 10
Organization
Bureau of European and EuroAtlantic Integration of the SCMU
of Ukraine
Ministry of Economy of Ukraine
Ministry of Fuel and Energy of
Ukraine
Customs Committee of Ukraine
Form of support
Conferences
Practical trainings/seminars
Counselling
Individual consultations
Presentations
On-the-job training
Study visits
Presentations
Study visits
Practical trainings/seminars
On-the-job training
Presentations
Study visits
Trainings
Study visits
Comments
Combination of few
topics/aspects in one session
Strengthening of one element
in one session/counseling
Strengthening of one element
in one session/counselling
Involvement of departments
from other relevant institutions
is critical, as activity of subcommittees 2 and 3 gather
information from other
institutions
Too general presentations
should be avoided
More specific topics are needed
Combination of few
topics/aspects in one session
To gain experience from new
EU member states
21
Ministry of Justice of Ukraine
Ministry of Education and
science
Ministry of Foreign Affairs of
Ukraine
Main Civil Service Department of
Ukraine
Trainings
Counselling
Individual consultations
On-the-job training
Presentations
Study visits
Practical trainings/seminars
Presentations
Trainings
On-the-job training
Study visits
Practical trainings/seminars
Presentations
Trainings
On-the-job training
Study visits
Trainings
Short-term thematic seminars
Counselling
On-the-job training
Presentation on M&E can be
made during the sub-committee
N 6 session to be held in April
2009
In addition – questions/answers
on request basis
Joint training sessions with the
project can ensure synergy and
avoid overlapping with other
similar activities
The main expectation from the project M&E capacity building programme aimed at the above
areas/priorities identified for further capacity building activities are:




Improved reporting with more analytical assessment;
Improved formulation of annual plans, objectives, priorities etc.;
Introduced IT technology for easier data collection and analysis;
Improved sector policies formulation
Nobody from the stakeholders interviewed expressed the views on potential implications and
application of knowledge to be obtained through the project in introduction of new tools to
institutional duties. The common opinion on this matter is the needed official request from the
Bureau of European and Euro-Atlantic Integration of the SCMU of Ukraine to introduce these
innovations.
22
CONCLUSIONS
1. The previous and current level of knowledge and experience in M&E (in evaluation in
particular) is generally low among relevant stakeholders. The level of willingness to learn can be
generally assessed as above average.
2. None of the line ministries have a special unit on M&E responsible for European integration
process. Existing units, which have some M&E functions, have general administrative functions
and do not correspond to actual needs in M&E related to European integration process.
3. The level of understanding of M&E tasks, methods and importance varies depending on the
level of administrative power. More understanding has been observed at the execution level.
The higher level officials of administrative hierarchy (heads of departments) pay less attention to
these issues due to busy schedule, which results in the absence of formalization of institutional
framework for M&E functions.
4. M&E functions and responsibilities go far beyond the boundaries of departments of European
integration formally responsible for these activities in line ministries. Active involvement of other
relevant departments providing information to the coordinating one is critical for M&E system’s
proper operation.
5. Clear specific instruction are required for line ministries from the Bureau of European and
Euro-Atlantic Integration of the SCMU of Ukraine on concrete M&E tasks to be incorporated in
daily activities of the relevant specialists aimed at improvement of M&E activities.
23
4 RECOMMENDATIIONS/AREAS FOR IMPROVEMENT
The following recommendations have to be considered by the project at the stage of preparation
and further implementation of the M&E Capacity building programme:









To involve departments of the line ministries which provide required information on the
status of Ukraine-EU Action Plan and further - New Practical Instrument implementation
to the departments of European integration, in M&E capacity building activities.
To pay particular and urgent attention to capacity of relevant departments of the line
ministries in charge of filling in the structure/formulating tasks of New Practical
Instrument.
Although evaluation is generally not considered by stakeholders interviewed as a priority
area for project support, it is advisable to build the capacity in this area in a view of
introduction of the New Practical Instrument.
To discuss with the project beneficiary - Bureau of European and Euro-Atlantic
Integration of the SCMU of Ukraine the issue of gradual official introduction of new
duties into the relevant structures of coordinating and line ministries (interim evaluation
of programmes, for instance) aimed at facilitation and improvements in implementation
and monitoring of the NPI.
Clear specific instruction are required for line ministries from the Bureau of European
and Euro-Atlantic Integration of the SCMU of Ukraine on concrete M&E tasks to be
incorporated in daily activities of the relevant specialists.
In order to facilitate the impact from M&E capacity building, it is recommended to send
training/seminars materials to participants well in advance for preliminary study,
preparation of questions etc.
Individual
consultation,
short-term
on-the-job
training,
counselling
and
questions/answers on request basis have to be decided with each particular institution. It
is recommended to send a letter from the project asking provide subject, timing and
other arrangements for such activities.
For individual consultations, specific thematic trainings, counselling etc. to consider
distance learning method.
To consider further planning and carrying out capacity building programmes in
cooperation with the School for Senior Civil Service Executives of the Main Civil Service
Department of Ukraine.
24
5 IDENTIFIED AREAS FOR FUTURE WORK
5.1 Target groups built around the proposed M&E capacity building plan
Although major target groups for M&E capacity building programme have been mostly defined
before the needs assessment stage, as all of them represent key stakeholders of the project, it
is worth considering forming target groups depending on the topic/priority area identified for
capacity building in M&E.
Therefore, it is suggested to establish the following target groups, keeping in mind the flexibility
and possible adjustment of their composition, answering the current circumstances and time
availability of the participants.
Policy/coordination level target group, comprising:
 Bureau of European and Euro-Atlantic Integration of the SCMU of Ukraine;
 Ministry of Economy of Ukraine;
 Ministry of Justice of Ukraine;
 Ministry of Foreign Affairs of Ukraine.
The purpose of this group establishment is to deliver specific trainings in areas associated with
policy formulation, implementation and monitoring, state-level programmes and strategies.
General target group, comprising:
 Bureau of European and Euro-Atlantic Integration of the SCMU of Ukraine;
 All line ministries chairing sub-committees of PCA (ENP AP).
The aim is deliver general level knowledge on M&E without going into specific details of each
method/tool. This is based on the desire of interviewed stakeholders to move from “general to
specific” to ensure gradual understanding of all aspects related to M&E.
Thematic target groups, comprising
stakeholders interested in particular specific topic/priority area of M&E identified through
capacity building needs assessment. These groups can be formed from the stakeholders with
more advanced knowledge level on M&E.
Institution-level target group
This group is advisable to form for:
 Bureau of European and Euro-Atlantic Integration of the SCMU of Ukraine;
 Ministry of Fuel and Energy (sector is selected as a pilot one for introduction of SWAP)
 Ministry of Education and Science (was the most active during capacity needs
assessment and willing to learn).
It is advisable to organize small-scale seminars combined with practical training sessions, case
studies in each institution, having preliminary agreed topics/issues to be covered. Few topics
can be covered in one event, if agreed with stakeholders.
Individual consultation, short-term on-the-job training, counselling and questions/answers on
request basis have to be decided with each particular institution. It is recommended to send a
letter from the project asking provide subject, timing and other arrangements for such activities.
25
5.2 Tentative module-based M&E capacity building plan
Tentative M&E capacity building plan is based on the above analysis of actual current and
future needs of stakeholders generally identified during the course of the project and specifically
in the framework of the present M&E capacity building needs assessment.
The final plan is a subject for project resources availability and agreements with the relevant
stakeholders.
The following modules are proposed for various target groups formed around priority areas:
Target group
Policy/coordination level
target group
General target group
Priority area/topic
Study visit
Impact evaluation, PIM
MPI
Seminar
Seminar
Monitoring system development,
including internal institution-based
one
M&E techniques and criteria
LFA & LFM
Seminar
PCM
Seminar
Training (presentation
and practical session)
Training (presentation
and practical session)
Seminar
Methodology and tools
Indicators at different levels
SWAP, sector monitoring
Seminar
Seminar
Seminar
ROM
Training (presentation
and practical session)
Practical training/on-thejob training
Data analysis and monitoring
Thematic target groups
Monitoring
Monitoring with applied IT
Thematic target groups
Evaluation
Proposed form
Comparison of the Ukraine with
the EU, new EU member states
and pre-accession EU
Methods and tools
Data analysis (qualitative and
quantitative)
Data analysis(qualitative and
quantitative)
Impact evaluation
SPSP, sector evaluation
Interim evaluation
Seminar
Short-term seminar
Training (presentation
and practical session)
Seminar
Short-term seminar
Capacity building activities at the level of intuition target group, as well as individual
consultation, short-term on-the-job training and counselling (if not included in the above
proposed modules), have to be defined on case-by-case basis upon agreement with particular
stakeholder.
26
Annex I
TERMS OF REFERENCE
STE/09/08
1. STE MISSION BACKGROUND AND OBJECTIVES
Background
As a part of the European Union’s (EU) Tacis Programme to assist the Ukrainian authorities in their
efforts leading to institutional, legal and administrative reforms, a project titled Support to Partnership and
Cooperation Agreement is currently being implemented.
The Project Purpose is:
to support Ukraine in the implementation of the PCA provisions and EU-Ukraine Action Plan, in particular
in terms of operation of joint bodies established within the framework of the PCA, improvement of the
monitoring system of the implementation of the PCA and the EU-Ukraine Action Plan, to be then used
also for the implementation of the new enhanced agreement foreseen to replace the PCA and promoting
partnership relations between the EU and UA in the framework of the ENP as well.
The results to be achieved include:
1) Development of operational, continuous and self-sustainable monitoring system of the PCA and of
the EU-UA AP, its dissemination among the Ukrainian authorities with further possibilities of
application in the course of the “new enhanced agreement” implementation. A relevant training for the
Ukrainian authorities’ staff needs to be included as well.
2) Support to the operation of Ukrainian parts of joint bodies established in the framework of the PCA
(Cooperation Council, Cooperation Committee and Sub-committees) or similar Committees set up in
the new enhanced agreement, in order to support further convergence of the EU and the Ukraine,
Progress in implementing the PCA and the EU - Ukraine AP has been monitored on a continuous basis
by the Government, the European Commission and the Civil Society. The monitoring by the Government
of Ukraine has been implemented under the overall guidance and coordination of the Secretariat of the
Cabinet of Ministers of Ukraine. It has been based on and conducted by the system of seven SubCommittees of the Cooperation Committee following upon the seven priority areas as well as the targets
and monitoring tools laid out for each year. However, the intrinsic shortcomings of the narrowed-down
approach focused exclusively on AP are becoming apparent. The project work during the inception period
reveals there is a growing awareness of the need for a broader scope and mechanism allowing for
assessing the impact of progress made within the AP as a part of a wider effort undertaken with other
donors as well as generated by local initiatives and programmes. Such an Integrated Monitoring System
will allow for placing the AP within a broader context of the overall development of Ukraine. This is the
direction the current project intents to follow, however the integrated nature of the considered improved
monitoring system requires more fundamental and thorough conceptual work in monitoring capacity
building which the project’s original TOR clearly underestimated in its specifications. The necessity of
such conceptual work and related particular needs in the course of its implementation create rationale for
the proposed Short Term Expert assignment described by these Terms of Reference.
Mission Objectives
Capacity building for coordination/monitoring within the framework of the PCA/ENP AP implementation is
recognised as a key area to enable the Government and domestic stakeholders to improve the level of
ownership of the reform processes. Integrated monitoring as a basic management instrument providing
information on progress of the ENP AP and the future Association Agreement in the context of overall
27
development will allow for better management of related processes, better understanding of the need to
properly formulate and apply Objectively Verifiable Indicators (OVIs), easier communications/consensus
building between the Ukrainian authorities, European Union and other Cooperation Partners. To achieve
such a qualitative change, the monitoring capacity building process must be implemented throughout the
relevant and involved parts of the Government at national, regional and local levels as well as across
society and respond to particular capacity building needs of the defined target group at all levels.
The Overall Objective of the mission is improved capacity in the area of monitoring and evaluation of the
Ukrainian civil servants and other representatives of various project beneficiaries and partners through a
proper assessment of their capacity building needs as the first step in forming a coordinated project
response through training, study tours and other capacity building activities.
The Specific Objective of the Mission is to create a consolidated inventory of the capacity building needs
in the area of Monitoring and Evaluation (M&E) through analysis of individual needs of particular target
groups among Ukrainian civil servants and other representatives of various project beneficiaries and
partners involved in European integration of Ukraine.
Results expected:





Target group for capacity building needs assessment analysed and defined.
Meetings for the interviewing procedure scheduled and arranged.
Interviewing process implemented
Consolidated capacity building work plan prepared.
Mission report prepared that will include target group for capacity building needs assessment analysis.
Mission follow-up
The current mission will serve as the initial step towards the follow-up activities listed below:
 Updating and further implementation of the Project Overall Plan of Operations within the framework of
capacity building component taking into consideration external changes in the Project environment
and capacity building needs identified;
 Regular implementation of capacity building interventions at the various relevant level in formats
adapted to the specific target groups and their particular needs;

 Establishing the framework and issues for further capacity building interventions.
2. DUTIES AND ACTIVITIES TO BE UNDERTAKEN
The STE shall work in close cooperation with the Beneficiary/Target Groups, Project Team, and EC
Delegation in Kiev. During the mission STR shall
 Draft and develop within the first 3 days of the assignment a tentative programme/plan of the
mission;
 Analyse and define target groups for capacity building needs assessment;
 Schedule and arrange meetings for the interviewing process;
 Conduct interviews using questionnaire developed by the Project (with review and additional
recommendations, if any);
 Undertake any other actions directly related to the efficient execution of the mission;
 Prepare and deliver draft and final versions of the mission report.
3. DELIVERABLES AND REPORTING
28




Tentative programme of mission developed by the end of the third day of work and agreed
with the Project’s Capacity Building Coordinator by the end of the 5 day of work;
A set of filled in needs assessment questionnaires;
Updated and consolidated Capacity Building work plan for project response until the end of
2009 enclosed as annex to the mission report;
Mission report including target group for capacity building needs assessment analysis (in
English) – draft version is to be delivered within three days from the day of the last interview,
the final version is to be delivered within two weeks from the day of the last interview (formats
will be provided by the project).
4. DURATION AND TIMETABLE OF THE MISSION
The duration of the mission is up to 10 working days and its implementation shall last from 12.12.08 to
12.01.09 as consulted, and agreed with the Project TL in Kiev.
5. DUTY STATION
The mission is to be performed in Kiev, Ukraine.
29
Annex II
Curriculum vitae
1. Family name:
BAYDA
2. First names:
INNA
3. Date of birth:
06 May 1966
4. Nationality:
Ukrainian
5. Civil status:
Married
6. Education:
Institution
[ Date from - Date to ]
Duke University, NC, USA; Terry
Sanford Institute of Public Policy;
08/2002 – 06/2004
Texas A&M University and
Washington, DC
Cochran Fellowship Programme
Training Program in Agricultural
Policy; 07/1998 – 08/1998
CINADCO
Israel
Centre
for
International Co-operation,
International Agricultural Programme
National Technical University of
Ukraine 'Kiev Polytechnic Institute'
(NTUU-KPI); 1983-1989
Degree(s) or Diploma(s) obtained:
Master of Art in International Development Policy
Major: International Development Management
Advanced course on evaluation and monitoring of international
aid.
Certificate on Agricultural Policy Development and
International Co-operation
Certificate on
Agriculture
Resources
Management
for
Sustainable
Diploma in Engineering
7. Language skills: Indicate competence on a scale of 1 to 5 (1 - excellent; 5 - basic)
Language
Russian
Ukrainian
English
French
Reading
1
1
1
3
Speaking
1
1
1
4
Writing
1
1
1
4
8.
Membership of professional bodies: N/a.
9.
Other skills: Windows, Microsoft Office (Word, Excel, Power Point), Internet skills
10. Present position: (1) ECORYS Ukraine/Study and Assessment Ltd, Ukraine – business
development manager; (2) IPP Consultants, France - Asia Director
11. Years within the firm: 11 years as Consultant in technical assistance projects funded by various
international donors; 15 years of experience in evaluation and monitoring of international donor
projects/programmes in various sectors
12. Key qualifications:
 Evaluation/assessments/reviews of the donor funded programs/projects;
 Deep knowledge of procedures, policies, PCM, OVIs for evaluation, and priorities;
30
 Excellent analytical skills (sector reviews and analyses, policy and programs analyses, logical
framework analysis);
Experience in monitoring and evaluation in various regions;
Project planning, management and proposal making;
Excellent reporting skills;
Good knowledge of sector-wide approach and its implementation in various countries;
Experience in working with various international donors and implementing agencies on project
evaluations/reviews/assessments (EU, ADB, CIDA, SIDA, IFC, SWISS Cooperation Centre (SECO,
SDC), IOM, ADA (Austrian Development Agency);
 Experience in liaison, interviewing and communication with local authorities and institutions in 18
countries of the world.





Specific experience in the regions
Country
Indonesia
Russia, Moldova
France, Pakistan, Nepal, Laos,
India, Uzbekistan, Kyrgyzstan,
Kazakhstan, Georgia, Cambodia,
Vietnam, Bangladesh, Indonesia,
Philippines
USA, The Philippines, Indonesia,
Cambodia, Vietnam, China, India,
Uzbekistan
Date from - Date to
2006 - 2007
Asia-Invest Program, Project Manager, IPP
Consultants
December 2007-April 2008
Project evaluation
Aug. 2004 – March 2006
Marketing studies, assessment of the needs and
opportunities, database development, business
development missions for IPP Consultants, France
(governance, education, agriculture, environment)
May-Aug. 2003
The same
13. Other relevant information
Publications: Published paper “Analysis of Technical Assistance impact on agricultural sector of
Ukraine”, Duke University, USA, 2003
Specific EU training:
 Participation in various workshops and trainings organised by the EU Tacis Programme:
 Participation in International Conference “International experience with institutionalization of
monitoring and evaluation system and its relevance for Ukraine” (Kiev, February 2007, WB, SIDA,
Ministry of Labour and Social Policy)
 All workshops in the framework of EU mission on evaluation of TACIS regulations 1999-2004, MayJune 2005;
 Training Seminar on Global Monitoring System, May 2002;
 EC – Ukraine Areas of Cooperation Workshop, EC, Brussels, October 2001;
 Training courses in monitoring and evaluation methodology and techniques, 1998-2002;
 Training course in general management and training techniques, September 1998;
 Workshop on Logical Framework Analysis Techniques, January 1998, Kiev
Address:
04208, Ukraine, Kiev, Poryka St., 17A, Apt.17
tel/fax: +(380-44) 434 91 75
e-mail: ibayda@voliacable.com; innabayda@mail.ru
31
Professional experience
Date from Date to
March 2005
till now
Location
Ukraine
Company
ECORYS Ukraine/
Study and
Assessment Ltd.
Position
Description
Senior expert/Business
Development Manager
November 2008 – Contract with Swedish Cooperative Centre: external evaluation of RDA Donbass
project funded by SIDA, evaluation expert
October 2008 – ROM monitoring mission, Laos, international monitor
July-August 2008 – Contract with SDC, Switzerland: external review of the Organic Agriculture
development project in South Caucasus (Georgia, Armenia, Azerbaijan) – international expert
June – August 2008 – contract with: SCC evaluation of AFLOU and SMS projects funded by SIDA
March-April 2008 – European Initiative for Democracy and Human Rights. External pre-completion
review of the project “Improving access to justice for rural population), Ukraine
March-April 2008 – contract with IOM, Moldova. External evaluation of the project “Coordination of
the Return and Reintegration Assistance for Voluntary Returnees to Moldova. Donor agency: Austrian
Development Agency (International expert)
November – December 2007 – Contract with Swedish Cooperative Centre (funded by SIDA) – external
evaluation of Women Project in Russia (international expert).
September–December 2007 –contract with SWISS Cooperation office, Ukraine on provision of advice
and recommendations on planning platform and project document for Ecolan/Finlan project
May-June 2007 – Contract with SWISS Cooperation Office: External review of the projects Sustainable
Land Use in Ukraine Phase II and Access to rural Financial Services in the Vinnitsa Region of Ukraine.
March 2007 – Needs assessment mission of the Canadian Ministry of Agriculture, local consultant
June 2006, October 2006 – Contract with SWISS Development Cooperation (SDC) Proposals evaluation
(round 1 and 2) – evaluation expert
March-June 2006 – Contract with CIDA, Canada – Evaluation of 2 completed projects and 1 program
funded by CIDA in Ukraine, evaluation expert
May- June 2005 - Contract with Ukrainian Association of Farmers and Private Landowners on
evaluation of RICC project (financed by SIDA, Sweden), evaluation expert
September-December 2005; August –December 2006 – Preparation of the EU-funded agricultural
sector Program (Phase 1 and 2)
April –May 2005 Contract with “Development Researchers Network” (Italy) on evaluation of TACIS
regulations 1999-2004, evaluation expert
November 2006-November 2007 – Asia Invest project, Indonesia, Project Manager
August 2004 till now - Project management, business development missions (Pakistan, Nepal,
Uzbekistan, Kyrgyzstan, Kazakhstan, Georgia, India, Cambodia, The Philippines, Indonesia, China,
Vietnam, Laos); coordination of firm’s activities in the Asia; proposal making for South East Asia and
Central Asia in local governance, educational sector, democracy and human rights, capacity building
and measurement system for performance evaluation building skills
Evaluation expert
(international and
local)
May – Aug.
2003;
Aug.2004 –
till now
Ukraine,
France
IPP Consultants, France
Asia Director
Dec 2001 –
July 2002
Ukraine
Nov 2000 –
Dec 2001
Ukraine
Nov 1998 Nov 2000
Ukraine
Oct. 1997 –
Oct 1998
Ukraine
Sept 1991
Oct 1997
Ukraine
April 1989 Sept 1991
Ukraine
IBM Business
Consulting Services
(since October 2002) /
PWC Consulting
(Belgium)
INTEGRATION
(Germany)
National Technical
University of Athens
Ministry of Agrarian
Policy of Ukraine
State Committee of
Ukraine for Food and
Processing Industry
Project Design
Technological Bureau
Local Expert (long
term),
EU Tacis and
Balkans/Cards
Monitoring Programme
Local Expert (long
term), the EU Tacis
Monitoring project:
Local Expert (long
term), the EU Tacis
monitoring project
Head of Division of the
Main Department of
Foreign Economic
Relations
Chief expert of the
Department of Foreign
Economic Relations
Engineer
Monitoring and assessment of the EC Tacis programmes (Tempus,, Management Training Programme,
Cross Border Cooperation, City Twinning) and projects in F&A sectors, environment, regional
development, democracy, institutional capacity building; project design assessment; monitoring
missions and interviewing; monitoring reports preparation; preparation of sector/country reviews;
communication and liaison with local bodies and EU.
As above
Monitoring of the EC TACIS programs/projects in Food & Agriculture sector, Environment, TEMPUS
program, MTP, capacity building,
Co-operation with the USA, Canada and EU. Preparation of sector analytical assessments, proposals
on future areas of co-operation to the Government of Ukraine. Monitoring and supervision of
International Donors’ TA Projects. Assessments of the sector policy; impact assessment of the
international aid.
Economic cooperation with foreign states; credit and investment programmes; export/Import of food
products; co-ordination of economic links between local and foreign food companies; monitoring and
evaluation of EU-funded projects on behalf of the State Committee.
Design of electric and automatic schemes for sugar industry equipment
33
Annex III
Tentative Mission Plan
Activity
Inception phase
Studying of the ToR and the contract for the assignment and
Studying of the relevant project documents
Getting acquainted with the structure of the project beneficiary
Studying of various activities on M&E capacity building already implemented
by the project
Meetings with the project Team Leader, M&E Capacity Building component
project coordinator and project communication expert aimed at discussing
various aspects of the assignment and approach to its implementation
Preparatory stage
Adding and finalization of the questionnaire on M&E capacity building needs
assessment developed by the project
Approval of the final questionnaire by the project, incorporation of the final
comments from the project
Preparation of the tentative work programme
Sending of final questionnaire on M&E capacity building needs assessment
to the relevant stakeholders contacted (by e-mail) for preliminary studying
and formulation of additional questions, if any, to be discussed during the
forthcoming meetings/interviews
Implementation stage
Meetings and interviews with direct local beneficiaries aimed at identifying
their capacity building needs in M&E
Meeting and interviews with other potential target groups members and
other relevant project stakeholders
Meetings and interviews with the Project Beneficiary
Analytical and reporting stage
Analysis of the information obtained during the meetings and interviews
Analysis of the filled in questionnaires
Preparation of the mission report as per the ToR
Number of
working days
1
1
1
1
4
2
10
Annex IV
List of stakeholders contacted
Stakeholders interviewed
N
1
Name
Lesia Antoniuk
Position
Deputy Head of Department on
Monitoring of Ukraine-EU
relationships, Head of the sector on
monitoring of relationships between
Ukraine and EC
Chief specialist, Department on
Monitoring of Ukraine-EU
relationships
2
Yuri Andrienko
3
Daria Blager
Chief specialist, Department on
Monitoring of Ukraine-EU
relationships
4
Inna Egorova
Head of the sector on cooperation
with the Council of Europe
5
Tatiana
Evtushenko
Chief specialist, Department on
Monitoring of Ukraine-EU
relationships
6
Roman
Grischenko
Chief specialist, Department of
Strategic Planning of European
Integration
7
Anatoliy Kutzevol
Chief specialist, Department on
Monitoring of Ukraine-EU
relationships
8
Viacheslav
Medvedev
Deputy Head, Department of
Strategic Planning of European
Integration
9
Yulia Meleshko
Deputy Head, Department on
Monitoring of Ukraine-EU
relationships
10
Evgeniya
Ovsiannikova
Chief specialist, Department on
Monitoring of Ukraine-EU
relationships
11
Viacheslav
Stetzenko
Deputy Head, Department on
Monitoring of Ukraine-EU
relationships
Organization
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
35
12
Konstantin
Visotskiy
Head of the sector, Department on
Monitoring of Ukraine-EU
relationships
13
Viktoria Tkach
14
Maria
Nesterenko
15
Yulia Berezhna
16
17
Andriy
Velitchenko
Irina Borsch
18
Olena Tanchuk
19
Andriy Shulga
20
Ludmila Shulga
21
Katerina Badrova
22
Olga Kravets
23
Olga Savchenko
24
Olena Bila
25
Oksana Dayko
26
Victoria
Karbisheba
27
Dmitriy Kozoriz
28
Mikola Fomenko
29
Natalia Serediuk
Chief specialist, Department of
coordination with the EC, secretary
of Sub-committee N 1
Chief specialist, Department of
coordination with the EC, secretary
of Sub-committees N 2 and 3
Chief specialist, Department of
European Integration and
international cooperation
Head of Information and Analytical
Department
Chief specialist, Department of
European Integration and
international cooperation
Chief specialist, Department of
European Integration and
international cooperation
Deputy Head of Department of
European Integration and
international cooperation
Deputy Head of Department of
International relations, secretary of
sub-committee N 5
Chief inspector, Department of
International relations
Chief specialist, State Department of
legislation adaptation, secretary of
sub-committee N 6
Deputy Head of Department of
legislation adaptation
Deputy Head of Department of
legislation adaptation
Head of division, Department of
international cooperation and
European integration, secretary of
sub-committee N 7
Chief specialist, Department of
international cooperation and
European integration
Deputy Head of Department of
international cooperation and
European integration
Head of division on monitoring of
high education, Department of high
education
Head of sector, division of
Coordination Bureau on European and
Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers
of Ukraine, SKMU
Ministry of Economy of Ukraine
Ministry of Economy of Ukraine
Ministry of Fuel and Energy of Ukraine
Ministry of Fuel and Energy of Ukraine
Ministry of Fuel and Energy of Ukraine
Ministry of Fuel and Energy of Ukraine
Ministry of Fuel and Energy of Ukraine
State Customs Committee of Ukraine
State Customs Committee of Ukraine
Ministry of Justice of Ukraine
Ministry of Justice of Ukraine
Ministry of Justice of Ukraine
Ministry of Education and Science
Ministry of Education and Science
Ministry of Education and Science
Ministry of Education and Science
Ministry of Education and Science
36
30
Gennadiy Olexuk
31
Oksana
Kovalenko
Andrey
Pravednik
Eduard
Zaharchenko
Vitaliy Kuchinskiy
32
33
34
35
Marina
Farafonova
36
Sergey Bevz
37
Olga Shumilo
monitoring of pedagogical
innovations
Chief specialist, division of
Ministry of Education and Science
monitoring and organization
Chief specialist, division of public
Ministry of Education and Science
and humanitarian education
Deputy Head of Department of
Ministry of Foreign Affair
European legislation
Director of School for Senior Civil
Main Civil Service Department of
Service Executives
Ukraine
Deputy Director, Centre of
Main Civil Service Department of
adaptation of civil servants to EU
Ukraine
standards
Other relevant stakeholders contacted
Head of division on bi-lateral
Ministry of Economy of Ukraine
cooperation between Ukraine-EU
bodies, Department of cooperation
with the EC
Head of Department of European
Ministry of Fuel and Energy of Ukraine
Integration and international
cooperation, secretary of subcommittee N 4
Director
International Centre for Perspective
Research
37
Annex V
Documents consulted
1. Development of operational, continuous and self-sustainable monitoring system
of the EU-Ukraine Action Plan and Agreements (Concept Note, January 2008;
Support to PCA Implementation project, EU Tacis Project)
2. Draft Concept on Monitoring Capacity Building (February 2008, Support to PCA
Implementation project, EU Tacis Project)
3. Assessment of Monitoring System within the Ministry of Fuel and Energy of
Ukraine (June 2008, Support to PCA Implementation project, EU Tacis Project)
4. Statute of Coordination Bureau on European and Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers of Ukraine (www.kmu.gov.ua)
5. Statute of Department on Monitoring of Ukraine – EU relationships of the
Coordination Bureau on European and Euro-Atlantic Integration of the
Secretariat of the Cabinet of Ministers of Ukraine (www.kmu.gov.ua)
6. Structure of the EU-Ukraine “new practical instrument” to prepare and facilitate
the implementation of the Association Agreement (draft, 10.12.2008)
7. Concept for the EU-Ukraine “new joint practical instrument” to prepare and
facilitate the implementation of the Association Agreement
8. Websites visited:
www.icps.kiev.ua;
http://www.me.gov.ua/control/en/publish/article?art_id=46155&cat_id=42412;
http://www.mfa.gov.ua/mfa/en/;
http://mpe.kmu.gov.ua/control/en/index;
http://www.kmu.gov.ua/control/en/publish/article?art_id=87948&cat_id=73007;
http://www.minjust.gov.ua/;
http://www.education.gov.ua/pls/edu/educ.home.eng.
38