Impact Measurement: The Tools • • • • • • What is impact? Why measure your impact? Why do your research? Strengthening your impact measurement. Prioritising your impact measurement. Choosing and designing your impact measurement tools. What do you want to measure? What measurement tools do you know of? Impact Measurement: The Tools Sarah McMorrine @tfdatagirl Teach First Innovation Unit 2013 Senior Officer – Data & Impact St Thomas the Apostle College, Peckham 2012- 2013 Assessment Consultant Evelyn Grace Academy, Brixton (Ark Schools) Assistant Principal - Assessment 2010- 2012 London Academy, Edgware 2005-2010 Head of Maths Assistant Head of Maths Teaching Leaders ‘08 What is impact? Impact : What would have happened if you were not there? Outputs 20 day long sessions run. 100 pupils engaged Outcomes 100 pupils certified first aiders Impact Lives saved! Impact Measurement: The Tools Why measure your impact? Playpumps aimed to build 4,000 by 2010 to bring the "benefit of clean drinking water to up to 10 million people". The concept is simple: a merry-go-round is connected to a bore-hole. As children play, the spinning motion pumps underground water into a raised tank. Children would need to "play" non-stop for 27 hours a day. Why do your research? A wind turbine that cost the Welsh government £48,000 to buy has been generating an average of just £5 worth of electricity per month. The turbine was put its Aberystwyth office, rated excellent for sustainability, in 2009. Before it was installed, the turbine makers warned Welsh government contractors it would not be exposed to enough wind where it was positioned. Impact Measurement Strength Longitudinal study Random Controlled Trial (RCT) Quasi-experimental comparison cohort Pre and post programme surveys Impact Measurement Priorities “If your programme doesn’t directly do it, don’t measure it” Sarah McMorrine 2013 Outputs 20 day long sessions run. 100 pupils engaged Outcomes 100 pupils certified first aiders Impact Lives saved! Impact Measurement Tools What do you want to measure? …and what is the best way to measure it?