Women’s Empowerment Strategic Impact Inquiry (SII) Metaevaluation Analytic Guide Analyst Instructions 1. Read the Women’s Empowerment SII Research Framework Briefing before starting. It summarizes some key definitions as well as how we are conceptualizing empowerment in the context of this impact research. Critical to your role as analyst is not necessarily that you agree with all of these definitions or conceptualizations but that you understand them and can use them for your analysis. 2. If you have questions about the research framework email them to either Kent (kglenzer@care.org) or Jim (rugh@care.org). Please feel free to call either one of us, too, at either (001) 404-979-9276 (Kent) or (001) 865-908-3133 (Jim). 3. Read through the Metaevaluation Analytic Guide. If you have questions about the guide email them to either Kent or Jim, or give us a call. 4. Once you feel confident that you understand the research framework and the analytic guide, set them both to the side and simply read your assigned evaluation(s) straight through. You are trying to familiarize yourself with the document and its content before analysis starts. 5. If you are reviewing more than one evaluation, you will need to complete a separate analytical guide for each. Print a hard copy of the analytic guide and spread the pages out in front of you so that you can see all the questions at once. Have an electronic copy of the guide open on your computer. Start rereading the evaluation document (either hard copy or on screen) and, as you find data that are pertinent to questions, copy the actual words/sentences/passages to the appropriate table cell in the electronic version of the analytic guide. (If the question requires simply a yes/no answer, or asks you to check certain items, then you should do so.) When you do such copying, please include a page number reference for the copied passage. 6. If there is simply no evidence/data for certain questions, simply write “no data” in the space provided. If at any time you have doubts about where or not data exists, whether or not you should include certain data, please feel free to use Jim/Kent as a sounding board. Send an email pointing us to the particular passage/page number that you are not sure how to interpret, remind us of the specific evaluation you are working on, and we will try to give you some advice. 7. Try to complete the analytic guide all in one sitting: the more you spread the analysis out over multiple days/sessions, the less consistent you will be. 8. Not Required: If you do have the time and inclination, put aside your first analysis for a few days, then rerun the analysis without looking at your first version. When done, compare your first analysis with your second and resolve any discrepancies between the two trials. 9. When done, please email your analysis to both Jim and Kent. Please submit your analysis by May 20. The timing is crucial as we will need to undertake a synthesis of all your work before the global SII synthesis workshop in London in Mid-June. That synthesis will be sent to all of you who participated in this. Short Analytical Guide for SII metaevaluations 1 Women’s Empowerment Strategic Impact Inquiry (SII) Metaevaluation Analytic Guide Project Descriptive Information Country Name of project Dates project operated Date of evaluation Author(s) of evaluation report Project’s donor(s) Short summary description of project (cut and paste if possible) Short description of evaluation purpose and methodology (cut and paste if possible) Extent to which women participated in the evaluation process (cut and paste if possible) Short Analytical Guide for SII metaevaluations 2 Women’s Empowerment Strategic Impact Inquiry (SII) Metaevaluation Analytic Guide Part 1: Project Goals, Objectives, Client Groups, and Key Definitions (for any question below for which there is no data in the evaluation, simply write “not available” 1.1 Do goals/objectives specifically reflect a focus on women’s empowerment or gender inequity? YES/NO (select one) 1.1.a If you answered “yes” to 1.1, please block copy the goals/objectives in the cell to the right 1.2 Does the project disaggregate client groups (“target populations”) by gender? YES/NO (select one) 1.3 Does the project disaggregate the category “women”? YES/NO (select one) 1.3.a If you answered “yes” to 1.3, please describe the nature of this disaggregation in the space to the right (cut and paste if possible; remember to include a page reference) 1.4 How did the project conceptualize “power”? (cut and paste if possible; remember to include a page reference; “Not available” is a possible response) 1.5 How did the project conceptualize “empowerment”? (cut and paste if possible; remember to include a page reference; “Not available” is a possible response) 1.6 How did the project conceptualize “gender”? (cut and paste if possible; remember to include a page reference; “Not available” is a possible response) 1.7 How did the project conceptualize “gender inequity”? (cut and paste if possible; remember to include a page reference; “Not available” is a possible response) 1.8 How did the project conceptualize “gender inequality”? (cut and paste if possible; remember to include a page reference; “Not available” is a possible response) Short Analytical Guide for SII metaevaluations 3 Part 2: Strategies and Interventions (for any question below for which there is no data in the evaluation, simply write “not available” 2.1 What broad strategies, interventions, and/or approaches were deployed by the project in order to have an impact on women’s empowerment and/or gender inequity? (cut and paste if possible; remember to include a page reference; “not available” is a possible response) 2.2 Did the project make use of women’s associations, groups, or organizations? YES/NO (select one) 2.2.a Summarize how the project made use of women’s associations, groups, or organizations in order to advance women’s empowerment or gender equity. (cut and paste if possible; remember to include a page reference; “not available” is a possible response) 2.3 Which, if any, of the 23 sub-dimensions of women’s empowerment do strategies, approaches, and interventions address? (Check all that apply) Sub-Dimension Place an “X” here if addressed Notes (cut and paste if possible; remember to include a page reference) Self image/self esteem A G E N C Y Information/skills Educational attainment Employment Mobility in public space Group membership/ activism Material assets owned Legal/rights awareness Body health/ integrity S T R U C T U R E R E L A T I O N S Marriage/Kinship rules & roles Inclusive & equitable notions of citizenship Transparent information & access to services Enforceability of rights, access to justice Market accessibility (labor/credits/goods) Political representation Share of state budgets Density of civil society representation Consciousness of self / others as inter-dependent Negotiation/ Accommodation habits Alliance/Coalition habits Pursuit / acceptance of accountability New social forms 2.4 Does the project address dimensions of women’s empowerment that are not captured in the 23 dimensions from the global framework? 2.4.a If you answered “yes” to question 2.4, what are these other dimensions? cut and paste if possible; remember to include a page reference Short Analytical Guide for SII metaevaluations YES/NO (select one) 4 Part 3: Impacts (for any question below for which there is no data in the evaluation, simply write “not available” 3.1 Does the evaluation indicate that a gender analysis was done at any time in the life of the YES/NO (select one) project? 3.1.a If you answered “Yes” to 3.1, how was this analysis done? (cut and paste if possible; remember to include a page reference; “not available” is a possible response) 3.2 Does the evaluation indicate that any form of analysis of power relations was done at any time in YES/NO (select one) the life of the project? 3.2.a If you answered “Yes” to 3.2, how was this analysis done? (cut and paste if possible; remember to include a page reference; “not available” is a possible response) 3.3 Are there stated indicators of impact on women’s empowerment or gender inequity? YES/NO (select one) 3.3.a If you answered “Yes” to 3.3: please list the indicators along with any definitions/explanations of them that you find in the evaluation (cut and paste if possible; remember to include a page reference; “not available” is a possible response) 3.3.b What, if any, impact does the evaluation claim that CARE had on women’s empowerment or gender inequity? (cut and paste if possible; remember to include a page reference; “not available” is a possible response) 3.4 Are there tangible outcomes related to empowerment or improving structures or relations of gender inequity? 3.4.a If you answered “Yes” to 3.4: please list these outcomes (cut and paste if possible; remember to include a page reference) 3.5 Were there unintended, negative impacts on women, women’s empowerment, or gender inequity? 3.5.a If you answered “Yes” to 3.5: please describe these unintended, negative impacts (cut and paste if possible; remember to include a page reference Short Analytical Guide for SII metaevaluations Please try to be as specific as possible, up to an including #s of women affected: YES/NO (select one) Please try to be as specific as possible, up to an including #s of women affected, quantitative output/outcome data, etc: YES/NO (select one) 5 Part 4: CI Programming Principles (for any question below for which there is no data in the evaluation, simply write “not available” 4.1 To what extent did the project enact CI Programming Principles in support of women’s empowerment or having a positive influence on structures and relations of gender inequity? (cut and paste if possible; remember to include a page reference; “not available” is a possible response) Promote Empowerment - We stand in solidarity with poor and marginalized people, and support their efforts to take control of their own lives and fulfil their rights, responsibilities and aspirations. We ensure that key participants and organisations representing affected people are partners in the design, implementation, monitoring and evaluation of our programmes Work with Partners -We work with others to maximise the impact of our programs, building alliances and partnerships with those who offer complementary approaches, are able to adopt effective programming approaches on a larger scale, and/or who have responsibility to fulfil rights and reduce poverty through policy change and enforcement Ensure Accountability and Promote Responsibility - We seek ways to be held accountable to poor and marginalized people whose rights are denied. We identify individuals and institutions with an obligation toward poor and marginalized people, and support and encourage their efforts to fulfil their responsibilities Address Discrimination - In our programs and offices we address discrimination and the denial of rights based on sex, race, nationality, ethnicity, class, religion, age, physical ability, caste, opinion or sexual orientation Promote the non-violent resolution of conflicts We promote just and non-violent means for preventing and resolving conflicts at all levels, noting that such conflicts contribute to poverty and the denial of rights Seek Sustainable Results - As we address underlying causes of poverty and rights denial, we develop and use approaches that ensure our programmes result in lasting and fundamental improvements in the lives of the poor and marginalized with whom we work Short Analytical Guide for SII metaevaluations 6 Part 5: Internal GED and External Impacts (for any question below for which there is no data in the evaluation, simply write “not available” 5.1 What, if anything, did the project do to address women’s empowerment and/or gender equity and diversity dynamics inside of CARE itself? (cut and paste if possible; remember to include a page reference; “not available” is a possible response 5.2 Did the evaluation uncover any links or relationships between gender equity and diversity dynamics inside CARE and the project’s impacts on the women it worked with? 5.2.a If you answered “Yes” to 5.2, what were these links? (cut and paste if possible; remember to include a page reference; “not available” is a possible response) Short Analytical Guide for SII metaevaluations YES/NO (select one) 7 Annex I: Definitions1 a. b. c. (Agency question) What evidence is there that CARE’s programs support the expansion of women’s capabilities to identify, pursue, and achieve their basic needs and rights? (Structure question) What evidence is there that CARE’s programs promote a more responsive and equitable enabling environment, as embodied in cultural norms, legal and policy frameworks, economic and market forces, etc? (Relational question) What evidence is there that CARE’s programs promoted greater awareness and practices of interdependence and mutuality of rights and responsibilities between women and the key people and institutions they engage with in pursuit of their needs and rights? Annex II: Women ‘s Empowerment SII Evidence Categories Dimensions of Empowerment and Equity Agency-based Psychological Legal Socio-cultural Political Organizational Productive / Economic Human / body Structural Cultural Legal / Judicial Market/Economic Political Bureaucratic Organizational Relational appreciation flexibility cooperation accountability 1 Sub-Dimensions (13 proposed “core” evidence categories are highlighted) 1. Self-image; self-esteem 2. Legal / rights awareness 3. Information / skills 4. Educational attainment 5. Employment / control of labor 6. Mobility in public space 7. Decision influence in household finance & child-rearing 8. Group membership / activism 9. Material assets owned 10. Body health / integrity 11. Marriage/Kinship rules & roles 12. Inclusive & equitable notions of citizenship 13. Transparent information & access to services 14. Enforceability of rights, access to justice 15. Market accessibility (labor/credits/goods) 16. Political representation 17. Share of state budgets 18. Density of civil society representation 19. 20. 21. 22. 23. Consciousness of self / others as inter-dependent Negotiation/ Accommodation habits Alliance/Coalition habits Pursuit / acceptance of accountability New social forms See full Women’s Empowerment SII Framework for more thorough definitions. Short Analytical Guide for SII metaevaluations 8