TEMPLATE FOR M&E FRAMEWORK

advertisement
Step 6
Step 1
T EMPLATE FOR M&E F RAMEWORK
FOR L EADERSHIP L EARNING
I NITIATIVES
Step 5
Follow-up
Initial contact:
(anchoring)
assure demand
Feedback
Analysis
Event delivery
Baseline
Observation,
Results
Framework
(D RAFT )
Step 4
Step 1
Initial contact
Confirm demand with country team and
client.
Develop initial business case. Link
leadership strategy to expected country
outcomes: what type of leadership
initiatives could be considered to develop
what capacity, using typology of
interventions?1
Identify key players, including for M&E.
Scoping mission
Step 2
1
For typology of interventions, see annex 1.
Development of
Interim period
preparation
Design and Delivery
Scoping mission
Questionnaires
concept note
Step 3
Monitoring and evaluation
Review existing diagnostic work to understand why the enabling environment is weak and what
capacity needs to be developed. Identify drivers of change to start thinking of process indicators.
Review evaluations and experience from previous initiatives.
Map existing initiatives in leadership development and assess their M&E frameworks.
Use typology of interventions to shape very preliminary results framework.
Key questions: Is there a clear understanding of what capacity needs to be developed for whom?
Through what process is country demand expressed?
Tools: Document review, including drivers of change analysis; capacity needs assessment, where
available; map of related activities by other donors and the WBG.
Baseline
Step 2
Identify capacity gaps and priority
intervention strategies and examine the role
of leadership as well as synergies with other
leadership initiatives.
Step 3
2
Ensure a common understanding of the
current capacity at the individual,
organizational, and institutional levels.
Reach agreement with client on context,
issues, expected results, and process for
developing and designing the intervention.
Reformulate identified gaps as preliminary objectives for the initiative. Define objectives related to
the individual, organizational, and/or institutional levels in generic and specific terms.2
Define preliminary objectives for the process, and assess if a shared view of the contribution of the
initiative has emerged.
Identify benchmarks and suggest suitable indicators for measuring change in capacity and the
situation. Use both process and outcome indicators, both generic and specific.
Assess usefulness of and opportunity for a country-focused framework covering several initiatives.
Key questions: Do counterparts seem to have obvious capacity constraints?
What contributed to or detracted from the emergence of a shared view of the purpose and
objectives of the initiative?
Is there a baseline for assessing impact later?
Establish local steering committee to assure
local ownership and engagement.
Tools: Document review; needs assessment and capacity assessment, if not done previously;
interviews; focus groups; facilitated self-assessments.
Identify M&E counterparts.
Development of concept note
Describe context, issues, expected
results, and process. Make a business case
for the initiative, including its link to related
initiatives and possible synergies as well as
lessons learned from similar or related past
initiatives.
Results framework
Outline theory of change between expected outcomes at the individual, organizational, and
institutional levels and the activities delivered.
Identify both outcome and process indicators of change and data collection methods (consider the
trade-off between validity and availability of data).
For each level, identify factors that can either constrain or enable a positive outcome of the
intervention.
For generic indicators, see annex 2.
Key questions: Are objectives clear? Is it clear what desired changes are at individual (knowledge,
attitude, and behavior), organizational (for key organizations), and institutional (enabling
environment) levels? Is there agreement on how these changes can be measured: what indicators
and how to collect information?
Tools: Facilitated workshops and focus groups on objectives and indicators; risk analysis; log
frame; and outcome mapping for outcome indicator.
Step 4
Step 5
Step 6
Interim period preparation
Agree on participant list.
Create draft program and agenda.
Prepare background documentation on
selected issues.
Identify and agree on external resource
persons and facilitators.
Event delivery
The stronger the national event delivery
capacity, the more limited the Bank role.
The greater the ownership by the host
country, the better the results.
Bank staff presence is normally limited and
resource persons primarily consist of nonBank experts.
Follow-up (anchoring)
Disseminate proceedings and guidelines on
process and background papers.
Disseminate lessons learned.
Consider potential of international resource
persons/peers continuing to provide
counsel/advice.
Establish benchmark for capacity of counterparts to carry out necessary preparatory work.
Collect information on process.
Key questions: How does the process of preparation contribute to strengthening capacity? What
could be done differently?
Tools: Self-assessment; face-to-face interviews with key informants
Collecting data
Participate in event to be able to observe and ensure the correct application of M&E tools.
Key questions: What is the evidence of ownership? What is the benchmark for event delivery
capacity? Are objectives clear for participants, and do they agreed? Are other stakeholders involved
in the event?
Tools: Observation, questionnaire, interviews, and possibly web-based survey.
Analysis, feedback
Analyze M&E information. Avoid cherry picking, use triangulation, and look for evidence of
intended and unintended consequences. Structure analysis at three levels: individual,
organizational, and institutional. Review against typology of interventions.
Key questions: What conclusions can be drawn on the short-term outcome of the event?
What evidence is there of enhanced capacity in the counterpart team and of process ownership,
including of the process being anchored in the host country and capacity to ensure follow-up?
Tools: Structured interviews with key informants; web-based self-assessments
Annex 1: Typology of interventions
1. Leadership for Results: New Government
The objectives of this program are to establish a common vision; clarify respective roles,
responsibilities, and accountabilities; build mutual trust and respect; and develop a team
approach to implementing a new government agenda. Approaches and tools might
include how to prioritize among priorities, strategic communications, results-based
management, change management, conflict resolution, ethics, transparency and
accountability, and so on.
Participants will include ministers and senior public servants.
2. Leadership for Results: Communicating and Achieving Results
The objectives of this program are to engage partners and stakeholders to communicate
and implement the government’s agenda effectively. Specific approaches and tools might
include how to make trade-offs among competing interests and priorities, public-private
partnerships, how to identify and address constraints, creative problem solving, strategic
communications, results-based management, project management, rapid results
techniques, and so on.
Participants will include ministers, senior public servants, and private sector and civil
society representatives.
3. Leadership for Results: Decentralized Governance
The objectives of this program are to enhance coordinated and cooperative leadership in a
decentralized environment. Specific approaches and tools might include clarification of
respective roles, responsibilities, accountabilities, effective communication, problem
solving, conflict resolution, and so on.
Participants will include political and/or public sector leaders from each order of
government.
4. Leadership for Results: Transition Phase
The objectives of this program are (a) to enhance public sector readiness to provide
considered, nonpartisan advice on how to implement a new government mandate
following an election and (b) set the foundation for translating the election manifesto and
other public commitments into a medium-term policy agenda. Specific approaches and
tools might include preparation of briefing materials for new ministers, effective
communications strategy, policy preparation, and so on.
Participants will include senior public servants.
Annex 2: Generic Outcomes
The outputs and outcomes from the activities will include capacity results related to the
objectives and the process of planning, implementing, and evaluating the activity.
a.




Individual
New knowledge, skills, and tools
Increased confidence in ability to achieve results
Enhanced collegial trust and respect
Increased effectiveness of existing human and fiscal resources.
b.





Organizational
Increased focus and effectiveness in relation to specific results
Shift from individual agendas to a common vision
Informed and efficient decision-making processes
Improved problem-solving skills, including ability to prioritize actions and
mobilize resources
Horizontal cooperation: increased use of cross-sectoral approaches to problem
solving and decision making
New communication channels
Stronger teams
Exploration of current and emerging leadership challenges and opportunities
Learning and capacity development recognized as key ingredients for
development
Strong foundation for performance.
c.




Institutional/Enabling Environment
Enhanced communication systems
Citizen engagement
Strategic partnerships
Enhanced credibility nationally and internationally.





Download