Terms of Reference for Evaluation of the “Capacity Strengthening of

advertisement
Terms of Reference for Evaluation of the
“Capacity Strengthening of Local Self-governing Bodies” project (2013-2016)
July 2015
Job title:
Duty station:
Type of contract:
Application deadline:
Expected duration:
Proposed start date:
National Consultant
UNDP Mongolia
Individual Contract
10 August 2015
1 month
15 September 2015
1. BACKGROUND AND CONTEXT
“Capacity Strengthening of Local Self-governing Bodies” (CSLSB) project aims to strengthen capacities of
local hurals (local councils) to fulfil their representational and oversight mandates for improved
accountability of local governments and local service delivery. This is an ongoing project with 4 specific
outputs: i) A National Training Programme for local elected representatives is developed and
institutionalized; ii) Improved downward accountability of elected representatives through promoting
citizen participation in decision making; iii) Increased oversight capacity of local hurals; and iv) Lessons
integrated into legal and policy framework for local self-governance (see Project Document).
Since the CSLSB project was launched in March 2013, the project made a significant progress, especially
with regard to the National Training of elected representatives and increasing hurals’ visibility, openness
and transparency, and experience sharing among them through an integrated portal website. (see Project
Annual Progress Report for 2013, 2014, and Project Progress Report for the 1st half of 2015).
Geographically, the project covers all 21 aimags, 330 soums, and 9 districts of Ulaanbaatar, with selected
activities such as grants being announced on a competitive basis. The project works closely with local
NGOs working in the area of local government, and relevant academic and research institutions. The
CSLSB is being implemented by the Parliament Secretariat and funded by Swiss Agency for Development
and Cooperation (SDC) under its broader support to decentralization and public participation.
2. EVALUATION PURPOSE
The purpose of the evaluation is:
 to assess the extent to which the CSLSB project activities are effective (contributes to achievement of
the project’s stated objectives), sustainable (ability to continue after the project is completed), and
implemented in efficient and timely manner;
 to validate/document stories about concrete results and change from the perspective of target groups
and stakeholders, and
 to provide recommendations for the next phase of the project;
3. INDICATIVE EVALUATION QUESTIONS
In general, the evaluation exercise shall use the standard OECD/DAC Evaluation Criteria for Evaluation of
Development Assistance namely: relevance, effectiveness, efficiency, impact and sustainability. Below is
a list of indicative questions for evaluation of the CSLSB project:
1
Achievement of outcomes (results) – progress so far:
 What are main intended and unintended outcomes of the project? What are the most important
changes?
 What are the specific achievements by Outputs? How do the four outputs link and relate to each
other? To what extent have the project outputs contribute to the project intended outcome?
 What are the main factors (positive and negative) that affect achievement of the outputs? What was
the effect of the change in project implementation modality?
 What are the mechanisms for quality assessment and assurance of project activities, especially of
those activities related to capacity building?
 Does the project create synergy with other local governance/public participation projects and
activities?
 To what extent has gender been mainstreamed both at process and results level?
Sustainability/institutionalization
 To what extent was sustainability considerations taken into account in the design and implementation
of the project activities? Is there evidence that capacity and knowledge generated by the project will
be used beyond the project lifecycle? How effective are strategy/approaches used in
institutionalization of the National Training Programme?
 To what extent the new processes, tools or initiatives are owned by target groups/stakeholders?
Lessons learned and recommendations
 What are the key lessons learned or best practices and key critical risks?
 Is there a need to change/adjust the project implementation strategy in order to achieve the project
objectives while using the remaining resources effectively and efficiently?
4. METHODOLOGY
The evaluation team shall refer to UNDP Evaluation Handbook for the overall evaluation framework.
Proposed tasks of the evaluation team include, but not limited to, the following:






Desk review of all project/s related documents, including project workplans, progress reports,
manuals, publications, and the websites;
Interviews with key stakeholders, including government and non-government organizations (for a
more complete list of stakeholders, please refer to the project reports);
Interviews with representatives of donor organizations and other development partners working in
the country;
Field trips to at least 2 aimags and 2 soums;
Any questionnaire or survey to be conducted must take into account the geographical scope and
duration of this evaluation work.
Submit initial findings of evaluation to key stakeholders for comments before finalizing the evaluation
report;
5. DELIVERABLES
 Evaluation inception report (in English) – to be submitted by the end of the first week of the
assignment, before going into the full fledged data collection. It should detail the evaluators’
understanding of what is being evaluated and why, showing how each evaluation question will be
answered by way of: proposed methods, proposed sources of data and data collection procedures.
2


The inception report should include a proposed schedule of tasks, activities and deliverables,
designating a team member with a lead responsibility for each task or product. The inception report
provides the programme unit and the evaluators with an opportunity to verify that they share the
same understanding about the evaluation and clarify any misunderstanding at the outset.
Draft evaluation report and presentation (in English and Mongolian) – to be submitted by the end of
third week, for review by key stakeholders to ensure that the evaluation meets the required quality
criteria.
Final evaluation report (in English and Mongolian) – to be submitted by the end of fourth week,
incorporating feedback from stakeholders.
6. EVALUATION TEAM COMPOSITION AND REQUIRED COMPETENCIES
The evaluation team will consist of 1 international consultant/team leader and 1 national consultant
who also work as translator.
National Consultant (1 month) – to be recruited locally.
Education background:
 Master’s degree in relevant fields (local governance, public policy, public administration, political
science, sociology, development economics);
 At least 10 years of experience of working in relevant fields;
 Experience and familiarity with research methods, monitoring and evaluation techniques;
 Experience in working with government agencies (central and local), civil society organizations, and
international organizations;
 Strong analytical and reporting writing skills;
 Good interpersonal and cross-cultural communication skills,
 Fluent written and oral English and Mongolian.
7. EVALUATION ETHICS
Evaluations in UNDP will be conducted in accordance with the principles outlined in the UNEG ‘Ethical
Guidelines for Evaluation’, and must follow the procedures to safeguard the rights and confidentiality of
information providers, for example: measures to ensure compliance with legal codes governing areas such
as provisions to collect and report data, particularly permissions needed to interview or obtain
information about children and young people; provisions to store and maintain security of collected
information; and protocols to ensure anonymity and confidentiality.
8. IMPLEMENTATION ARRANGEMENTS
The evaluation team shall report to UNDP Deputy Resident Representative (DRR). The Governance team
shall provide relevant project related documents, and assist in organizing field trips and debriefing
meeting. UNDP will provide office space and meeting room during mission in Ulaanbaatar, if required.
9. APPLICATION AND CRITERIA FOR SELECTION OF BEST OFFER


Expression of interest letter;
CV showing educational background and experience;
o List of publications and/or evaluation reports;
3



o 2 reference letters related to the assignment and contact details of referees;
3 pages short essay in English on current situation of local self-governance in Mongolia and a brief
outline of how the proposed evaluation can be conducted;
Evidence of English language knowledge;
Financial proposal with a clear indication of all inclusive fee (consultancy fee per month, travel/DSA,
stationery, and admin costs etc).
Combined Scoring method will be used in the selection of international consultant, where the technical
proposal (qualifications, experience and essay) will be weighted a max. of 70%, and combined with the
price offer which will be weighted a max of 30%. Below is the breakdown of points of Technical proposal.
Technical proposal: 100 points which equal 70% of the total scoring.
Educational background – 20 points
English skills – 20 points
Experience – 30 points
Essay and proposed methodology – 30 points
10. PAYMENT SCHEDULE
100% of the total fee to be paid upon submission and acceptance of the Final Evaluation Report.
4
Download