Technology and Global Development 15-502 Instructors: M. Bernardine Dias and Yonina Cooper TA: Aysha Siddique Spring 2009 Lecture 9 Evaluating Impact Outline • • • • • • • • Logistics Videos Some ICTD Examples Reading Monitoring and evaluation I Capacity building assignment Campaign assignment strategy Your assignments for next class Logistics • Questions about the media assignment? • Research assignment follow-up • Any other questions/comments? Videos Microsoft Research Project: Mischief • What novel approach did Microsoft use in its Multipoint project? Social Entrepreneur of the Year in India 2008 • • How was same language subtitling (SLS) used to increase literacy? What was Brij’s contribution? Patrick Awuah ’89 on Leadership in Africa • • Why did Patrick feel that education of leaders is of utmost importance particularly in developing communities? Why should we strive for perfection (even though it is impossible)? Some ICTD Examples aAQUA – Agricultural Portal K. Ramamritham, A. Bahuman, S. Duttagupta, C. Bahuman, and S. Balasundaram, Innovative ICT Tools for Information Provision in Agricultural Extension, ICTD 2006 www.aaqua.org/ Multiple Mice Udai Singh Pawar, Joyojeet Pal and Kentaro Toyama, Multiple Mice for Computers in Education in Developing Countries, ICTD 2006 http://tier.cs.berkeley.edu/docs/ict4d06/multiple_mice-jp.pdf Text-Free User Interfaces Indrani Medhi, Aman Sagar, and Kentaro Toyama, Text-Free User Interfaces for Illiterate and Semi-Literate Users, ICTD 2006 http://research.microsoft.com/enus/um/india/groups/tem/presentations/text-freeui.pdf Tamil Market Madelaine Plauché, Udhyakumar Nallasamy, Joyojeet Pal, Chuck Wooters, and Divya Ramachandran, Speech Recognition for Illiterate Access to Information and Technology, ICTD 2006 http://www.cs.cmu.edu/~dgroup/papers/TamilMarket.pdf Literacy Games Matthew Kam, MILLEE: Mobile and Immersive Learning for Literacy in Emerging Economies, Ph.D. Dissertation, U. C. Berkeley, 2008 http://www.cs.berkeley.edu/~mattkam/millee/portfolio.html CellLife Samir Anand, Development of a Cellphone-Based Monitoring and ManagementSupport System for ART, Masters Thesis, University of Capetown, 2005 http://www.cell-life.org/ PlanetRead Brij Kothari and Joe Takeda, Same Language Subtitling for Literacy: Small Change for Colossal Gains, Chapter 13, Information and Communication Technology in Development: Cases from India, 2000 http://www.planetread.org/ CyberTracker Stephen L. Talbott, CyberTrackers: Bushmen and Information Technology, NetFuture, Technology and Human Responsibility, Issue #154, 2004 http://www.cybertracker.org/ First Mile Solutions Alex (Sandy) Pentland, Richard Fletcher, Amir Hasson, DakNet: Rethinking Connectivity in Developing Nations, Computer, vol. 37, no. 1, pp. 78-83, 2004 http://www.firstmilesolutions.com/ babajob Sean Blagsvedt http://www.babajob.com/ Reading Impact Assessment of ICT for Development Projects • • • What are the difference between monitoring and evaluation? Why are both needed? Why are participatory techniques necessary for evaluations to be effective? What is e-Governance? Why is a ‘rational assessment framework’ important for eGovernance projects? What is the purpose of the assessment? Monitoring & Evaluation I The Need • • • • Project managers, donors, and other stakeholders need to know the extent to which their projects are meeting their objectives and leading to their desired effects. M&E build greater transparency and accountability in terms of use of project resources. Information generated through M&E provide project staff with a clearer basis for decision-making. Future project planning and development is improved when guided by lessons learned from project experience. http://www.passia.org/seminars/2002/monitoring.htm Relationship Between M&E http://www.passia.org/seminars/2002/monitoring.htm Logical Framework Approach http://www.passia.org/seminars/2002/monitoring.htm Methods and Tools http://www.passia.org/seminars/2002/monitoring.htm Methods and Tools http://www.passia.org/seminars/2002/monitoring.htm Methods and Tools http://www.passia.org/seminars/2002/monitoring.htm Methods and Tools http://www.passia.org/seminars/2002/monitoring.htm Methods and Tools http://www.passia.org/seminars/2002/monitoring.htm Methods and Tools http://www.passia.org/seminars/2002/monitoring.htm Selecting M&E Methods • • • • • • • • • What information is needed? Of this information, how much can be collected and analyzed in a lowcost and practical manner? How accurate will the information be? Will the methods get all of the needed information? What additional methods should and could be used if additional information is needed? Will the information appear as credible to decision makers? Are the methods appropriate for the target group? If group members are illiterate, the use of questionnaires might not be appropriate unless completed by the evaluators themselves. Who can administer the methods? Is training required? How can the information be analyzed? http://www.passia.org/seminars/2002/monitoring.htm New Assignment Capacity Building Assignment Campaign Assignment Your Strategy? Other References • World Bank Guide to M&E (http://lnweb90.worldbank.org/oed/oeddoclib.ns f/b57456d58aba40e585256ad400736404/a5efbb5 d776b67d285256b1e0079c9a3/$FILE/MandE_to ols_methods_approaches.pdf) • 15502 lecture slides from 2006 and 2007 – jointly prepared by Rahul Tongia, Joe Mertz, Jay Aronson, and Bernardine Dias • Most images are from TechBridgeWorld (www.techbridgeworld.org) What Next? • More on M&E and Sustainability • Assignments: – Due Thursday • • • • Read http://tier.cs.berkeley.edu/docs/ict4d06/social_development_kerala-rk.pdf View http://www.youtube.com/watch?v=DygAgWi4Tbo View http://www.youtube.com/watch?v=vDyN2yux_NY View http://www.youtube.com/watch?v=7vpqO8Fnq9E&NR=1 • Media assignment – Preparation questions on all reading and viewing assignments are available on the course website in the “assignments” section. • Special note: first do the reading/viewing and then look at the questions and come prepared to discuss them in class.