PHN Curriculum: HIV/AIDS Module Session Outline Session Objectives: At the end of this session, participants will be able to: • Describe the global HIV/AIDS program context; • Identify necessary components of an M&E system for an HIV/AIDS program environment; and • Apply basic M&E concepts to HIV/AIDS program areas Session Overview: 1. 2. 3. 4. Program context (10 slides) - 20 minutes M&E implications of program context (7 slides) - 20 minutes Applying general M&E principles to HIV/AIDS programs (8 slides) - 20 minutes Example of applying general M&E principles: HTC programs (11 slides) - 35 minutes 5. HIV program impact (6 slides) - 15 minutes Total = 110 minutes Method of Session: PowerPoint presentation Discussions Group work and presentation Duration Facilitator presentations and discussion- 110 minutes Group work and presentation- 105 minutes References and Resources*: UNAIDS. 2010. Strategic Guidance for Evaluating HIV Programmes. http://www.unaids.org/en/media/unaids/contentassets/documents/document/2010/12_7_ MERG_Guidance_Evaluating%20HIV_PreventionProgrammes.pdf. USAID. 2011. Evaluation: Learning from Experience: USAID Evaluation Policy. http://www.usaid.gov/evaluation/. Padian, et. al. 2011. Implementation Science for the President’s Emergency Plan for AIDS relief (PEPFAR). J Acquir Immune Defic Syndr 56(3): 199-203. Topp, et al. 2011. Opt-out provider initiated HIV testing and counseling in primary care outpatient clinics in Zambia. Bull World Health Organ 89:328-335A. 1 WHO and partners, 2011. Guide to monitoring and evaluating national HIV testing and counselling (HTC) programmes. http://whqlibdoc.who.int/publications/2011/9789241501347_eng.pdf Useful Web Sites, Databases, and Tools*: • • • • • • • • • • CRIS 3.0: http://www.cris3.org. DQA guidance and tools: http://www.cpc.unc.edu/measure/dqa . SAVVY guidance and tools: http://www.cpc.unc.edu/measure/tools/monitoringevaluation-systems/savvy WHO HIV/AIDS Strategic Information: http://www.who.int/hiv/strategic/me/en/ UNAIDS Monitoring and Evaluation: http://www.unaids.org/en/dataanalysis/tools/monitoringandevaluationguidanceand tools/ Global HIV M&E Information: http://www.globalhivmeinfo.org/Pages/HomePage.aspx UNAIDS Indicator Registry: http://www.indicatorregistry.org PEPFAR next generation indicators reference guide: http://www.pepfar.gov/documents/organization/81097.pdf UNGASS indicators (updated 2010): http://data.unaids.org/pub/manual/2009/jc1676_core_indicators_2009_en.pdf HIV/AIDS Survey Indicators Database. http://www.measuredhs.com . *All Web sites accessed July 21, 2011. 2 CLASS ACTIVITIES Possible Class Activity 1. (Optional 20 minutes – may replace section 2 where the facilitator may fill gaps after group discussions) Objective: Extract M&E implications of the HIV/AIDS program context. At the end of the first section of the class (Context), divide students into small groups. Ask them to complete the following table by identifying at least 5 key points from the lecture and then identifying at least one implication for M&E from that point. Program Context M&E Implications At the end of the group work, each group reports out on their completed table. Record results of feedback on a flip chart and then compare with the M&E implications in the PowerPoint slides for section 2 of the session. Instructor Note: this activity could replace the PowerPoint slides for Section 2 of the session; i.e., section 2 would be done as an interactive exercise with the instructor filling in any gaps that were not identified in the group work. Or it could serve as an introduction to Section 2 with the lecture reinforcing the points made in the group work and filling in gaps. In either case the PowerPoint slides for Section 2 should not be distributed ahead of time and the facilitator will need to react to the points raised rather than following the speaker note script exactly. 3 Possible Class Activity 2: (25 minutes) Objectives: Reinforce general M&E principles around frameworks and indicators from earlier sessions Practice applying these principles to HIV/AIDS program areas. Consider the following example from a national AIDS program in Africa: Program Goal: Prevent the spread of HIV epidemic & minimise its impact on society by 2005 Development Objective 1: Reduction of HIV prevalence Development Objective 2: Improved health & quality of life of people infected & affected by HIV/AIDS Development Objective 3: Strengthened capacity of the National AIDS Council & stakeholders to respond to the HIV/AIDS epidemic at all levels through: a) mitigation of negative socioeconomic impact b) improved research, monitoring & evaluation c) improved management & coordination Logical Framework Matrix Narrative Summary Verifiable Indicators GOAL Prevent the spread of HIV epidemic & minimise its impact on society by 2005 DEVELOPMENT OBJECTIVE 1 Reduction of HIV prevalence Output 1.1 Improved awareness & positive behaviour change attained among priority groups Output 1.2 Improved supply, storage & use of safe blood & blood products Output 1.3 Improved treatment & control of STDs Output 1.4 Prevent mother to child transmission of HIV Output 1.5 Increased access to VCT services October 13, 2004 Means of Verification Assumptions Percentage of young people aged 15 – 24 who are HIV-infected UNGASS 3.1 Target: 20% reduction from 2003 to 2010 Percentage of pregnant women attending ANC who are aged 15 –24 who are HIV-infected Target: 20% reduction from 2000 to 2005 Poverty Index Target: 10% reduction from 2000 to 2005 Life expectancy at birth Target: 5 year increase from 2000 to 2005 Growth in GNP Target: no decrease in GNP due to HIV/AIDS by 2005 PRSP/Ministry of Finance & Planning Poverty Index: will need to discuss with MoFP to see if this is a Realistic target. DHS 2003 ANC Sentinel surveillance The national prevalence rates will be derived from DHS data. The targeted reduction would need to be measured during the year of the next DHS. Percentage of people aged 15 – 49 who are HIVinfected categorised by gender and region Target: 20% reduction from 2003 to 2010 Percentage of HIV-infected infants born to HIVinfected mothers UNGASS 3.2 Target: 20% reduction by 2005 DHS Percentage of young people aged 15 – 24 who both correctly identify ways of preventing the sexual transmission of HIV and who reject major misconceptions about HIV transmission UNGASS 2.7 Target: 90% by 2005 % of sexually active respondents who had sex with a non-spousal, non-regular partner within the previous 12 months (disaggregated by target group) Percentage of young people aged 15 – 24 reporting the use of a condom during sexual intercourse with a non-regular sexual partner UNGASS 2.8 Median age at first sex among 15-24 year age group Increased rate of condom sales by geographical area (relating sales to population size) Percentage of schools with teachers who have been trained in life-skills-based HIV/AIDS education and who taught it during the last academic year UNGASS 2.1 Percentage of large enterprises/companies that have HIV/AID workplace policies and programmes UNGASS 2.2 Percentage of IDUs who have adopted behaviours that reduce transmission of HIV UNGASS 2.6 CBS/Ministry of Finance & Planning /Ministry of Finance & Planning MTC transmission rate calculated per Declaration of Commitment core indicator documentation Sample survey of awareness & behaviour among priority groups BSS/DHS BSS/DHS BSS 2002, 2005 Condom sales figures from PSI, & distribution data from MoH Ministry of Education ANC surveillance will be used to indicate trends in infection rates. Traditional & religious leaders provide support to the dissemination of behaviour change messages Increasing willingness among general population to practice safe sex, particularly among 15-24 year age group UNGASS Workplace indicator could be included under 2.1 World Bank Survey ? 25 4 Divide the participants into groups and ask each group to critique the program goals and the logical framework shown. Possible points the group should discuss are: Are these objectives SMART? Look at one in particular. Compare the Logical Framework Matrix to the basic structure that was presented in the Frameworks Session. Is this filled out correctly? Look at the verifiable indicators for Output 1.1. Would you have put these here? Are they measuring the output? Are the indicators consistent with global standards? Are they feasible to collect? Possible Class Activity 3: (60 minutes) Objectives: Familiarize participants with UNAIDS indicator guidance documents and standard indicators for another HIV program area (other than HTC) Practice developing a framework Practice selecting indicators based on a framework Identify data collection implications of indicator selection At the end of the HTC section, divide participants into groups. Each group should include at least one participant who is familiar with HIV/AIDS programs. Ask each group to select an HIV/AIDS program area and develop a simple M&E framework for that program area covering the basic components of inputs, process, outputs, outcomes, and impacts. [Alternatively, select 1-3 program areas ahead of time and ask groups to choose from those]. Then ask each group to select up to 5 indicators to monitor the different components of the framework they have developed using international standard indicator guidelines, and construct a summary table of the data sources they would need to collect the indicators selected. At the end of the group work, each group presents their framework, indicators and data sources for wider discussion. Class discussion could also include discussion of the feasibility of collecting the indicators selected and establishing the data collection systems in the participants’ countries. Resources: Participants will need copies of the UNAIDS indicator guidance that covers relevant program areas in order to select indicators. Instructor Note: This is an extension of Class Activity 3 and will require a fairly substantial amount of time for group work (minimum 1 hour). Another variant on this theme could be to focus only on the development of the framework (objective 2). 5