Gender-sensitive Monitoring and Evaluation For Training Course on “Gender Equitable development Projects” APMASS & WAP, AIT: Vietnam Karabi Baruah-Ph.D Gender, HIV & Development Specialist 27th June 2012 Danang, Vietnam Session Objectives • Identify critical considerations of a gender-sensitive monitoring and evaluation framework. • Identify the necessary components of a gender-sensitive evaluation. 3 A quick check… True or false? 1.Men and women have different development priorities, needs and constraints and are affected differently by development programs 2. Conventional M&E systems often capture gender differences in access and impact 3. Efficiency/ equity enhanced when gender differences are taken into account. 4. Most people assumed in “gender neutrality” of M&E methods & processes 4 Why a gendered M&E process? 5 ?Do you believe that …. Having a gender-neutral M&E (with no reference to any sex), including the use of gender-neutral language, is the correct way of conducting M&E? Gender-neutral M&E, in most societies ends up reflecting men’s priorities 6 For Monitoring and Evaluation to be Gender-sensitive… • Requires gender issues to be monitored at each stage of the project cycle • Assess differences between women and men in terms of project performance and results • Reflect the needs and experience of women and men Overall a Gender sensitive M&E Improves development outcomes by ensuring target populations are better served by projects 7 Gender Sensitive M&E Measures… Not just the what, when and where, but • Change in the division of labor • Access to and control over resources • Practical and strategic gender needs/interests • Participation (within projects, and in household/community) • Change in decision-making • Changes in gender gap 7 8 Adapt monitoring program to: • Acknowledge differing, ▫ Roles (currently accomplished, division of labor) ▫ Responsibilities (who makes decisions on specific tasks, i.e. water fetching, market access) ▫ Capacities (able to do; based on knowledge, assets, etc.) ▫ Constraints (time, social skills, double burden, etc.) 9 Shift from WID to GAD affects GDD • Women and development approach (WID), focus on women as a homogenous group • Gender and development approach (GAD) focus on gender relation (women in relation to men), gender equality. • Gender Disaggregated Data GDD should reflect this by shifting from women only activities, to activities where women and men are involved, and measuring relational aspects (division of labor, change in intrahousehold decision-making level) Example- A gender sensitive M&E ensures the capture of women’s contribution to agricultural* production Because…. • Women’s Role in staple and secondary crops (underestimated in the first case, undervalued in the second case) • Greater role in subsistence agriculture is explained by lack of access to agricultural service and inputs, less assets (not a simple division of labor) • Women may be involved in low yield complex production systems that ensure stability and resilience, so a yield-based assessment would underestimate women’s contribution. 12 Invisibility of women’s work in survey and other data collection tools Tend to be more true of a quantitative approach Surveys are often based on the assumption that the heads of household are men. Data tend to focus on visible, formal or paid work or task (underestimating unpaid work, the informal sector or homebased work) Often assume static gender roles* Survey design tend to be done by men and it reflects their experience and interests 13 Are women economically active? 14 What in your experience/ perception are the issues & challenges in Gender sensitive M&E? 15 Lack of gender data can lead to incorrect conclusions Lack of knowledge may • lead to overlooking or underestimating gaps in access to and control over resources and benefits • underestimate roles in and contributions of women in unpaid work and also in remunerated work Lack of understanding on work task, phases and specialization • May lead to wrong associations or incomplete findings (income with men, etc) 17 Lack of gender data leads to poor management • Users of resources are misunderstood or misidentified, leading to poor project design, offering wrong solutions and potentially affecting project outcomes • Lead to wrong intervention, and a waste of expertise (as with women and fisheries) • Lack of knowledge of participation barriers undermines participatory approaches • M&E does not provide proper feedback 19 Gendered baseline data 20 Monitoring Gender Sensitive Participation in Project Cycle Project management: Women <—> Men Identification Design Implementation Evaluation Women <—> Men Project target groups * Monitor and evaluate ‘within’ processes at each stage, including evaluation (hence gender M&E) 21 Key issues to consider at different stages in a gender sensitive M/E system… Stage-I: Identification Key issues to consider Are the project’s goals and objectives gender-sensitive: do they adequately reflect women’s and men’s needs? What is the level of input from men and women stakeholders, local women’s NGOs, community based organizations, etc., in setting goals and objectives? Is baseline information, against which results can be measured, being collected through gender analysis and/or social assessment (covering social-cultural, political and economic aspects)? Does the client (country, state, district) have the policy and institutional framework to promote gender equality in development activities? 23 Stage-II: Design Key issues to consider •Do the activities planned reflect the project’s gendersensitive goals and objectives? •Is there a credible implementation plan that links courses of action and intermediate targets to expected final outcomes which benefit both men and women? •Are gender-sensitive target and M&E indicators identified in consultation with female & male stakeholders? •Have the male & female beneficiaries identified performance indicators they would like to monitor? •Does the project design take into account how the information will be used and by whom, and are these needs being assessed in light of budgetary and time constraints? Stage-III: Implementation Key Issues to consider •Are gender-sensitive and sex-disaggregated data being collected to keep track of inputs and outputs, and to measure outcomes? From what sources? •Is the same information as the baseline data being collected for the indicators at one or several times during the life of the project in order to measure and evaluate impact? •Are there specific and adequately detailed references to gender in progress/supervision reports? •Are the data fed back to project personnel and beneficiaries on a timely basis to allow for project adjustments? •Are local women’s organizations, NGOs, research institutes, etc., involved in monitoring the progress of the project’s gender integration? •Do the tools and methods reflect gender outcomes and impacts? •Are there male and female data collectors, and have they received gender Stage-IV: Evaluation Key issues to consider How has integrating the gender perspective changed project implementation and results? How have men and women benefitted from or been harmed by the project? Derive and share lessons that can feed into the overall Rural Development goals and objectives A FRAMEWORK for Monitoring and Evaluation Input People money equipment policies etc. Process Implementation Training Logistics Management etc. Output Results: Activities or Services done Outcome Behaviour Practices Knowledge (target population) Source: Adapted from www.who.int/hiv/strategic/me/en/me_of_aids_overview.ppt Impact Livelihoods Empowerment Health DATA COLLECTION for Monitoring and Evaluation Low Common Gender integration Some Some Input Process Output Low Outcome Household Surveys Programme Monitoring Qualitative methods Source: Adapted from www.who.int/hiv/strategic/me/en/me_of_aids_overview.ppt Impact Sustainable Livelihood Framework Gender analysis Checklist for Assessing gender sensitivity data collection Situations /Issues to Avoid • Sex disaggregated data is available but not used • Information is not collected from the right people • Household surveys are not the appropriate data collection method • Inadequate analysis of gender differences in control of resources within the household Actions to ensure methods adequately address gender issues •Assess the availability of genderresponsive data before considering the need to collect new data. •Include additional questions on gender-specific topics •Use special methods to analyze gender differences in household decision-making and control of resources. •Use special methods to study domestic and public violence •Budget time and resources for follow-up field visits to interpret and further explore statistical findings. “Engendering” the Project Logical Framework Engendering the Logical Framework (LF) • Engendering the logical framework is particularly about identifying and accounting for the gender issues implicit in the planning, monitoring and evaluation of projects, i.e. ensuring it is conscious of social equity issues such as gender relations (FAO) • You can use the following 4 slides as a tool to ensure the LF is engendered Goal checklist Narrative summary Objectively Means of verified indicators verification Do gender What measures Are data for relations affect the can verify verifying the goal project goal? achievement of the sex-disaggregated gender-sensitive and analysed in goal? terms of gender? Important assumptions What are the important external factors necessary for sustaining the gender sensitive goal? What gender analysis tools will be used (e.g., in impact assessment)? Source: FAO/WFP, SEAGA for Emergency and Rehabilitation Programmes: Socio-Economic and Gender Analysis, 2008. Purpose objectives checklist Narrative summary Does the project have gender responsive objective(s)? Objectively verified indicators Means of verification Important assumptions What measures Is data for verifying What are the can verify the project purpose important external achievement of the sex-disaggregated factors necessary gender responsive and analysed in for sustaining the objective(s)? terms of gender? gender-responsive objective(s)? What gender analysis tools will be used (e.g., in Rapid Rural Appraisal)? Source: FAO/WFP, SEAGA for Emergency and Rehabilitation Programmes: Socio-Economic and Gender Analysis, 2008. Outputs checklist Narrative summary Objectively Means of verified verification indicators Is the distribution What measures Is data for of benefits taking can verify project verifying project gender roles and benefits accrue to outputs sexrelations into women and men, disaggregated account? and different types and analysed in of women terms of gender? engaged in or affected by the What gender project? analysis tools will be used (e.g., participatory field evaluations)? Important assumptions What are the important external factors necessary for achieving project benefits (specifically for women)? Source: FAO/WFP, SEAGA for Emergency and Rehabilitation Programmes: Socio-Economic and Gender Analysis, 2008. Activities checklist Narrative summary Objectively Means of verified indicators verification Are gender issues clarified in the implementation of the project, e.g. workplan? Which goods and services are provided by the beneficiaries to the project? Important assumptions Is data for verifying project activities sex-disaggregated and analyzed in terms of gender? What are the important external factors necessary for achieving the activities and especially ensuring Are contributions What gender the continued from women and analysis tools will be involvement of men men accounted for? used (e.g. and women monitoring the participants in the Are external inputs activities)? project? accounting for women’s access to and control over these inputs? Source: FAO/WFP, SEAGA for Emergency and Rehabilitation Programmes: Socio-Economic and Gender Analysis, 2008. Engendering the LF is NOT just about adding gender components • It can be in ensuring GDD for all indicators • It can be about including women or men in activities where they are usually not engaged but where their participation is important, i.e including women in agricultural training, including men in nutrition training, or reducing gaps in participation or benefits. • It can also be about within-project processes, like project staff trained, number of women managers or women enumerators. 36 ??? • How do the issues raised in the presentations relate to your work • Did any ideas emerge on how the issue or concern might be addressed at your work • (eg WAP= annual workplan or IFAD- LF?) • After the next session on GDD you will get a chance to practice engendering a LF