VIETNAM LEADERSHIP AND MANAGEMENT CAPACITY STRENGTHENING PROGRAM Mid-Term Program Evaluation Consultancy SCOPE OF WORK Vietnam Leadership and Management Capacity Strengthening Program, Hanoi School of Public Health 1. Background and Objectives The Vietnam Leadership and Management Capacity Strengthening (VLMCS) Program was established in 2005 to build management and leadership capacity of management level staff working within the public health system with a particular emphasis on the HIV/AIDS programs. VLMCS is a collaborative effort between the Hanoi School of Public Health (HSPH), US Centers for Disease Control and Prevention’s (CDC’s) Sustainable Management Development Program (SMDP), and VAAC. This program is one component of the Project “Enhance Public Health Capacity for HIV Prevention & Care in Vietnam” supported by the US-CDC under the US President's Emergency Plan for AIDS Relief (PEPFAR) aimed at strengthening the training and data management systems and management capacity within the HIV/AIDS prevention and control programs in Vietnam. The main target audience of the VLMCS is staff from within the Provincial AIDS Centers nationwide that serve in leadership and management positions. The VLMCS is intended to help these individuals apply and incorporate the knowledge and skills they have gained into their daily work to improve the quality of HIV/AIDS prevention and control services provided in Vietnam. To date, over 685 participants from 61 out of 63 provinces in the country have been trained in various topics relate to L&M in public health. The purpose of this consultancy is to conduct the 2013 midterm review (MTR) of the VLMCS program activities that have been implemented from between 2009 to date. This will be the first formal review conducted during the current funding period (2011- 2016) and since the last review was conducted in 2009. The purposes of the MTR is to assess the program’s performance during the period specified above, document lessons learned, and inform future program strategy and funding. 2. Tasks and Responsibilities Consultative Sessions and Site Visits: The evaluation will include preliminary consultation meetings with CDC, HSPH staff, and other relevant stakeholders to discuss and then agree on 1 VIETNAM LEADERSHIP AND MANAGEMENT CAPACITY STRENGTHENING PROGRAM the requirements stipulated in the evaluation work plan. This includes review of previous program assessments, the M&E Database, and related program documents. Evaluation work plan: Before actually conducting the data collection in the field, the Local Consultant will prepare an evaluation work plan to operationalize and direct the evaluation. The work plan will describe how the evaluation will be carried out, bringing refinements, specificity and elaboration to the terms of reference. The work plan will act as the agreement between parties for how the evaluation will be conducted. The evaluation work plan will address the following reporting elements: • Expectations of Evaluation • Roles and Responsibilities • Evaluation Methodology • Evaluation Framework (pulling from and/or building upon the existing framework for overarching program evaluation) • Data Collection and Analysis • Reporting • Work Scheduling Developing study tools: The consultant(s) will be responsible for development of MTR tools (taking advantage of/utilizing existing tools when appropriate), protocols and questionnaires and coordinating approval from HSPH and CDC. Data Collection: The evaluator will arrange subsequent site visits for data collection in consultation or collaboration with the other primary team members. Data recording and storage: Data collected during the MTR should be stored electronically and provided to the CDC and HSPH so that they have ownership of and access to it in the future. Data Analysis: Data will be analyzed, reviewed and discussed with HSPH and CDC for preparation of drafting the evaluation report Evaluation Report: The Consultant will prepare an evaluation report in English that describes the evaluation and describes the evaluator’s findings, recommendations and lessons learned. A draft report will be shared with the primary evaluation team members for review and input before the report is finalized and approved. The presentation of results is to be intrinsically responding to the evaluation questions included in the TOR and evaluation plan, as well as follow logical flow based on the data collected. Evaluation results are to bring a focus to the criteria set out in VLMCS’ Cooperative Agreement (2010-2015) highlighting strengths and 2 VIETNAM LEADERSHIP AND MANAGEMENT CAPACITY STRENGTHENING PROGRAM challenges of the program as well as providing recommendations related to current and future activities. Dissemination and development of recommendations: the consultant will assist HSPH and CDC with dissemination of the evaluation report in a stakeholder workshop and revise recommendations from that workshop. 3. Methodology The data collection methods will include mixed methods. The expectation is that the evaluator will utilize to the full extent possible, existing data (from previous recent assessments and/or VLMCS database), and that all new data collection will be based on relevance, feasibility, and cost. The qualitative data are anticipated to be collected via key informant interviews and small group discussions. Quantitative data will largely come from the existing VLMCS database and previous assessments and evaluations conducted. 4. Deliverables and Reports • • • • • Evaluation Work Plan Data collection tools Draft and Final Report Recommendations from a stakeholder meeting Revised M&E Framework, including database modifications and updates 5. Location The consultant(s) will be based in Hanoi, with some travel to project provinces to conduct data collection. 6. Travel There will be some travel to project provinces identified in the evaluation work plan for qualitative data collection. 7. Period of Performance - Daily Rate The chosen candidate(s) will begin work on 9 December 2013 with expected completion after submission of final report by no later than 15 March 2013, with the possibility of extension, depending on need. The proposed number of days for this consultancy will range between 303 VIETNAM LEADERSHIP AND MANAGEMENT CAPACITY STRENGTHENING PROGRAM 40 days and will be finalized within the evaluation work plan developed by the consultant(s) and agreed between the consultants, HSPH and CDC Viet Nam. The Consultant(s) must be approved by HSPH and comply with PEPFAR and CDC rules and regulations. A daily rate will be agreed upon presentation of qualifications, previous rates, cost norms under the CDC-HSPH Cooperative Agreement, and final SOW. 8. Consultant Qualifications 5+ years in Monitoring & Evaluation with research experience in qualitative and quantitative research Ability to work independently and innovatively History of similar work Experience and knowledge of training programs or HIV sector is desirable Vietnamese language skills necessary Fluency in written and spoken English 9. Submission of Application Please submit a resume/CV, cover letter expressing how experience, qualifications and knowledge directly relate to the SOW proposed above, and proposed daily consultancy rate to the following email: nmh2@hsph.edu.vn. Groups or teams submitting applications must submit CVs and resumes for all on the team, but only one cover letter is needed. Only shortlisted applicants will be contacted. Applications are due 29 November 2013 For further information, please contact: Mr. Nguyen Minh Hoang Department of Health System Management Hanoi School of Public Health Address: 138 Giang Vo, Ba Dinh, Hanoi Phone: 04 6 266 2349 - Cell: 0914 341 349 E-mail: nmh2@hsph.edu.vn 4