Measuring how equitable your service delivery is Kenzo Fry Learning outcomes • Background information on poverty and poverty measures • How wealth quintile calculation works • What is in the toolkit itself and how to use it • Interpreting and using the results Equity • Level the playing field • Serve the marginalised • Reaching the poor • One of the global goals of franchising Poverty • Relative poverty • Absolute poverty When do you need to know about relative and when absolute? Types of poverty measure • Poverty lines - $1.25 per day • Multi-Dimensional Poverty Index • Wealth quintiles (based on wealth index) Selected as the metric for the equity goal Why wealth quintiles? • Relative poverty – relevant to programme decisions anywhere • Data source - DHS • • • • Standardised and high quality Easy to access Regularly updated Includes useful additional variables What is the wealth index? • Figure out the how important different assets and household characteristics are to wealth • Country specific • Uses Principal Components Analysis • Give each person a score based on their assets and household characteristics i Place the population in order of wealth using the wealth index 1 million people Highest wealth index score Lowest wealth index score ii Split into five equal ‘quintiles’ Quintile 1 (200,000 people) iii Quintile 2 (200,000 people) Quintile 3 (200,000 people) Quintile 4 (200,000 people) Quintile 5 (200,000 people) Use a client survey to put clients into quintiles Toolkit • i and ii have been done already for countries with a recent DHS • You just have to do iii • Conduct a client survey • 10 steps using pre-prepared tools • Go to presentationofdata.com Toolkit characteristics • • • • Rigorous Covers complete process User friendly High level expertise not needed Complexity in the back, simplicity in the front What does it do? Guides the user through the 10 steps to a successful client survey, from planning to interpretation of results which answers the question: • Which wealth quintiles do your clients fall into? What is in the toolkit? • Step by Step guide to survey process (written and video tutorials) • Questionnaires • Template workplan • Sampling tool • Data collection team training template • Data entry tool • Data analysis tool Step 1 Define what you want to measure and why • Work with decision makers • How will results be used? • Who do you need to know about? • What do you need to know about them? Step 2 Recruit the survey team • Characteristics of each role Step 3 Plan the survey • Create a workplan Step 4 Sampling • Use the Excel tool provided Series of simple questions • Decide whether to conduct interviews in homes or at facilities • Additional detail on methods, sub-groups, what precision means Step 5 Get relevant permissions • Ethics, government etc Step 6 Train data collection team • Modify training curriculum • Interactive sessions • How select respondents • How to conduct interviews • Supervised practice Step 7 Data collection • Logistics and organisation • Supervision • Observation • Questionnaire checks • Fill in example questionnaire as if you were one of your franchises clients Step 8 Data entry • Modify preprepared tool • Clean, error free data Step 9 Data analysis • Choose from EpiInfo, SPSS, STATA • Use preprepared syntax • Calculate your clients score • Put your client into a wealth quintile Step 10 Interpret results • Understanding quintile graphs • The “bottom two quintiles” metric 40 35 Percentage of clients Percentage of client in the bottom two quintiles = 40% 30 25 20 15 10 5 0 Quintile 1 Quintile 2 Quintile 3 Quintile 4 Quintile 5 40 35 Percentage of clients Percentage of client in the bottom two quintiles = 70% 30 25 20 15 10 5 0 Quintile 1 Quintile 2 Quintile 3 Quintile 4 Quintile 5 40 35 Percentage of clients Percentage of client in the bottom two quintiles = 15% 30 25 20 15 10 5 0 Quintile 1 Quintile 2 Quintile 3 Quintile 4 Quintile 5 40 35 Percetnage of clients Percentage of client in the bottom two quintiles = 50% 30 25 20 15 10 5 0 Quintile 1 Quintile 2 Quintile 3 Quintile 4 Quintile 5 Group discussion Would this information would be useful to your programme? What decisions would you take if your franchise had a low percentage of clients in the bottom two quintiles? What challenges would arise from trying to implement these 10 steps? Quiz • Why are there two surveys involved in the process? • What would it mean if 21% of clients were in the bottom two quintiles? • In what circumstances can you change the wealth index questions? Toolkit version 2 More countries Fewer questions? Same questions everywhere? Even simpler data collection, entry and analysis using an app? Inadequate sample Biased sample How many facilities are there in total 30 or less Include all facilities in sample Yes Include all facilities in sample Mor e than 30 Can you feasibly collect data at all of them? No Select 30 or more of the facilities using the sample selector tool Determine sample size using formula (Minimum sample size =100) Determine sample size using formula (Minimum sample size =200) Determine number of clients to interview at each facility based on number of clients they serve per day