Facilitator notes: 3.2.4 Collaborative evaluation Objective Participants can identify challenges in and benefits from collaborative evaluation. Participants are aware of existing guidance on collaborative evaluation. Timing 45 minutes Activities 1 Introduction Explain the objectives of the session. [Note the distinction in emphasis between collaborative evaluation and stakeholder involvement. This session focuses on joint and multipartite evaluation where neither party is seeking to strengthen the capacity of the other — rather they have relatively equal power in the process.] 2a Alternative A: Case study presentations by participant “experts” Advantages and disadvantages in collaborative evaluation Objective: Participants can identify challenges in and benefits from collaborative 35” –45” evaluation. Step 1. Preparation (prior to the session) Prior to the training, invite participants with experience in managing or being involved in a joint or multipartite evaluation, specifically with two or more partners of relatively equal power (e.g. two international organisations), to prepare a short case study presentation based on the Outline for case study presentation. Provide volunteers with core content sheets Collaborative evaluation as a reference. Give participants clear limits to prepare a maximum 10-minute presentation, with no more than five overheads or flipcharts. Underline to volunteers that a practice run of their presentations will be necessary to ensure that all the presentations complement each other. Have participant experts run through their presentation with you at least once before the actual session to ensure a good balance between context and analysis, to draw out key issues as covered in the core content sheets wherever relevant, and to practice timing. Allow enough time before the actual session so that presentations can be adjusted and the experts can feel comfortable. Step 2. Case study presentation (15” – 25”) Introduce presenters. One or two presentations are given with time for clarifications and questions afterwards. Step 3. Discussion (20”) Open discussion to all participants on the advantages and disadvantages of collaborative evaluation efforts, encouraging those who did not present to draw from their own experience. Summarise discussions on flipcharts as participants speak. UNICEF M&E Training Resource Module 3.2.4 Collaborative evaluation 1/2 Conclude by showing the overhead "Collaborative evaluation", which shows the progression from single-agency/single-project evaluation to system-wide evaluation. Highlight the rationale for system-wide evaluation in stable and crisis and unstable contexts. 2b 20” Alternative B: Plenary brainstorming Advantages and disadvantages in collaborative evaluation Objective: Participants can identify challenges in and benefits from collaborative evaluation. Step 1. Presentation (5”) Project the overhead "Collaborative evaluation", which shows the progression from singleagency/single-project evaluation to system-wide evaluation. Highlight the rationale for systemwide evaluation in stable and crisis and unstable contexts. (See core content sheet Collaborative evaluation.) Step 2. Plenary brainstorming (15”) Invite participants to brainstorm on all the advantages and disadvantages/challenges in becoming involved in a joint or multipartite evaluation. If they stall, encourage them to pretend they are in charge of the design and management of such an evaluation, donors, national government partners, media, the head of their CO, their organisations headquarters, and primary stakeholders for their office. 3 10” Optional: Plenary brainstorming Where to get help on collaborative evaluation Objective: Participants are aware of existing guidance on collaborative evaluation. This short activity is recommended where participants are from the same organisation. Highlight to participants the recommended readings on collaborative evaluation. Note that these are references that are well established in particular in the donor community. Where participants are from the same organisation, brainstorm quickly on who in the organisation can provide technical guidance and should be informed in the case of a major joint evaluation (i.e. of political or strategic significance), considering country, regional and headquarter offices. Clarify any procedures about which participants are unclear. Materials Flipcharts and markers Overhead projector Handouts Collaborative evaluation Outline for case study presentation Overhead Collaborative evaluation UNICEF M&E Training Resource Module 3.2.4 Collaborative evaluation 2/2