Technology and Global Development 15-502 Instructors: M. Bernardine Dias and Yonina Cooper TA: Aysha Siddique Spring 2009 Lecture 10 Sustainability Outline • • • • • • • • Logistics Videos Monitoring and evaluation II Reading Sustainability Your assignments for next week Media assignment presentations FCEs Logistics • Poster/demo opportunity on February 23rd (4-6p.m.) to present to the visiting trustees • Campaign assignment feedback/questions? • Any other questions/comments? Videos Robot Spy-planes Get New Role as Medical Couriers • How does this use of technology fit with your idea of ICTD? Cell Phones Battle Poverty • How are cell phones battling poverty? • How has the cell phone become a bank? • How do you envision the cell phone aiding the poor? Technology Boosts Income, Reduces Poverty • How does technology boost income? • How does it reduce poverty? • Is the video an accurate assessment of technology's impact on developing communities and poverty? Monitoring & Evaluation II Types and Models • Many types of evaluations – but 2 main categories: – Formative (process evaluation) • – Summative (outcome or impact evaluation) • • Examines what a project has actually accomplished in terms of its goals Popular evaluation methods – Pre-test Post-test model • – Measures the situation before the project starts and repeat the same measures after the project is completed. The differences or changes are attributed to the project Comparison Group model • • Examines the development of the project and may lead to changes in the way the project is structured and carried out Compares project results on two comparable groups at the same period of time, where one group represents beneficiaries of the project and the other represents a group that has not benefited from the project. The difference between the two groups are attributed to the project Key Evaluation Indicators are: Effectiveness, Efficiency, Relevance, Impact, and Sustainability http://www.passia.org/seminars/2002/monitoring.htm Planning a Monitoring System 1. Decide what should be monitored • 2. The careful selection of monitoring indicators organizes and focuses the data collection process Decide how to gather information • 3. Select methods to track indicators and report on progress (observation, interviews, stakeholder meetings, routine reporting, field visits, etc.) Decide who will gather information and when/how often • 4. Project staff at various levels will do most data collection, analysis and reporting. Staff should agree on what the monitoring report should include. Decide on feedback process • 5. Progress reports should be reviewed by project staff and major stakeholders. Feedback should be collected by project managers on a regular basis. Allocate resources for monitoring plan • Needed funds and staff time should be allocated to ensure effective implementation http://www.passia.org/seminars/2002/monitoring.htm Planning an Evaluation 1. What are the purposes of the evaluation? • 2. Identify a manageable number of evaluation purposes and prioritize them. Ask who needs what type of information and for what reason. What evaluation model is the most appropriate for the project? • 3. The evaluation model that a specific project would utilize should be selected during the project design phase. What is the timing of evaluation within the project cycle? • 4. Evaluation timing is determined by the project plan, the identification of significant problems during monitoring, donors’ request, etc. What is the scope and focus of the evaluation? • 5. Identify the geographic area, type of activity and time period that the evaluation should cover to clarify the types of questions to be asked. What methods of gathering data will be used? • 6. Existing data should be identified and assessed. Note that extensive data gathering is time-consuming, expensive, and can result in a lot of unnecessary information. What resources are needed for the evaluation? • Sufficient human, financial and logistic resources should be allocated. http://www.passia.org/seminars/2002/monitoring.htm Analysis and Dissemination • • • • • • Data management is very important and needs to be planned so that effective analysis and dissemination can follow Both quantitative and qualitative data can be useful/required Numerical and statistical methods are often used to analyze quantitative data It is important to find effective ways to combine the quantitative and qualitative data analysis to produce overall results and recommendations Effectively disseminating evaluations (through presentations and reports) is important for many reasons Suggested content for evaluation report: http://www.passia.org/seminars/2002/ME/Chapter6.htm http://www.passia.org/seminars/2002/monitoring.htm Reading Integrating Social Development and Financial Sustainability • • • What are the dilemmas and tradeoffs facing ICT projects at the 'macro level' (state and political parties) and 'micro level' (entrepreneurs and potential consumers)? How did the socially-driven entrepreneurs view the government role in the kiosks? How did the business-driven entrepreneurs view their tele-centers? How does the balance driven entrepreneur balance social development with business viability? How did the consumers generally view the Akshaya project? Sustainability Sustainability in ICTD • Sustainability in simple terms is a measure of the continuation of the project after external support has been concluded. Many development initiatives fail once the implementation phase is over because neither the target group nor responsible organizations have the means, capacity or motivation to provide the resources needed for the activities to continue. There are a number of factors that can be used to ensure that project interventions are likely to become self-sustaining and continue after the termination of external funding, including: • • – – – – – Financial (future expenses, especially recurrent costs) Operational (administrative capacity, technical capacity, institutional motivation, ownership of the project, etc.) Social (community interest, local capacity, political will, etc.) Environmental Technical http://www.passia.org/seminars/2002/monitoring.htm 12 Habits of Highly Effective ICT-Enabled Development Initiatives from bridges.org 1. 2. 3. 4. 5. 6. Start by doing some homework. Look at what has worked and what has not worked, study good practices in the area, and build on what you have learned. Conduct a thorough needs assessment of the community to be served so you can plan to do what is actually required. Make it local: ensure local ownership, get local buy-in, work with a local champion, and be context specific. Engage a local problem-solver with some degree of responsibility, and involve them sufficiently so they can identify and address problems as they arise. Form sound partnerships and collaborations, and be good partners and good collaborators. Set concrete goals and take small achievable steps. Be realistic about outputs and timelines. http://www.bridges.org/12_habits 12 Habits of Highly Effective ICT-Enabled Development Initiatives from bridges.org 7. 8. 9. 10. 11. 12. Found your initiative on technology-neutral concepts so it can be adapted as needed to accommodate technology change over time. Involve groups that are traditionally excluded on the basis of age, gender, race or religion. Identify and understand the external challenges you face, and take practical steps to address them. Monitor and critically evaluate your efforts with effective tools, report back to your clients and supporters, and adapt your approach as needed. Make your initiative sustainable over the long term -- either by bringing in sufficient income to be self-sustaining, or by delivering on a social mission so effectively that it is worthy of continued donor funding. Widely disseminate information on what you are doing and what you have learned so others can avoid your mistakes and build on your efforts. http://www.bridges.org/12_habits Other References • 15502 lecture slides from 2006 and 2007 – jointly prepared by Rahul Tongia, Joe Mertz, Jay Aronson, and Bernardine Dias • Most images are from TechBridgeWorld (www.techbridgeworld.org) What Next? • Economics and Fortune at the “Bottom” or Base of the Pyramid • Assignments: – Due Tuesday • View http://www.ted.com/talks/bill_gates_unplugged.html – Due Thursday • View http://www.ted.com/index.php/talks/paul_collier_shares_4_ways_to_ help_the_bottom_billion.html – Preparation questions on all reading and viewing assignments are available on the course website in the “assignments” section. • Special note: first do the reading/viewing and then look at the questions and come prepared to discuss them in class. Media Assignment