!

advertisement

!

!

!"#$%&'()*$+*&,-(./*,$/0$

1*22/..#-$.*$."#$34*03#1.$*5$

14#(./,)$($6#..#4$'/5#$5*4$."#$

7*4'-80$3**4$

!"#$%&"#'(!')*$'"$

+!,"-.(!/+0$1223$

4+5(#$!,"&&*$60*$$

6"#"7(#7$0(&+',)&$

."8&"$/",,+#0)&%*$$

9)&,%).()$0(&+',)&$

"#$%&'!('#)*%+,')!,-!

./012134!567!.689/47/:!

"684326;6<7!

+=>!?.'@$>"AB'$#+,')!B?%C>!

In 2012, global health financing totaled $28.1 billion (just shy of the $28.2 billion peak achieved two years earlier).

1 Governments provide the majority of this funding, but each year private philanthropists play an increasingly prominent role. Private contributions through foundations, nongovernmental organizations (NGOs), and corporate giving accounted for nearly 15 percent of global health funding in 2010.

2 Private sector participants can manage their own global health programs or use their donations to fund other organizations performing work in the sector.

3

!

!

!

%&'()*$7(0$-4(7,$.*$9/:/,)$

;**-08$2/00/*,$.*$<-#5#(.$

-/0#(0#0$*5$."#$3**4=$

$

%@'#+!+=>!"#$%&'!('#)*%+,')!

The Mulago Foundation is a private foundation focused on the prospect of creating a better life for the world’s poor. Concentrated in rural settings in developing countries, the Foundation’s work is in four areas that contribute to this overarching goal— livelihood, health, education, and conservation.

4 The Mulago team invests in promising products and services that address these high-priority problems. When it comes to health, the organization is particularly committed to solutions that positively affect the lives of mothers and children.

In identifying new investments, Mulago seeks solutions that can benefit at least one million people. Through its years of experience evaluating opportunities, the team has defined five criteria that indicate whether a solution can achieve this kind of scale.

5

The first is measuring impact. The Foundation is clear that it will only consider investing in organizations that understand the importance of this activity and have figured out how to make it happen. As stated on its website, “We don’t invest in organizations that don’t measure impact—they’re flying blind and we would be too.”

6

The second criterion deals with the cost effectiveness of those impacts. The Foundation believes that if products and services are too expensive for the people in the places where they are to be implemented, then they fundamentally cannot achieve scale. Using estimates of total program costs and an organization’s impact data, Mulago calculates the cost of results realized (e.g., cost per life saved or per child fed) and uses this as a guide for making investment decisions.

The Foundation also plays close attention to the issue of behavior change when assessing a solution’s ability to achieve scale. For any given solution, Mulago looks systematically at the behaviors of the target audience to determine whether the right conditions and motivations exist to create lasting behavior change and generate real impact.

7 This applies not only to the investments individually, but also to the way that the Foundation manages its portfolio and how it advocates for this approach to philanthropic giving, impact investing, or social investments. “We think about Mulago as a behavior change organization,” said Laura Hattendorf, Mulago’s Portfolio Director.

“That’s what we look for. That’s what we fund.” 8 This is especially important in health, she continued, where interventions are often available, but people are lacking information and an incentive to change their actions.

Additionally, Mulago seeks offerings that are easy to replicate. That means that the model behind the product or service must be systematic enough to be distilled into a straight-forward methodology, simple enough that it can be copied, broadly adaptable to a wide range of cultures and settings, and positioned to tap a scalable source of growth funding.

9

"#$%&'!('#)*%+,')-!.,&'.'#B!5>+!.>%$,B+,C!">%B#.>">)+ !!!!!!

6":$;<13 !!!!!!

H $

!

Finally, Mulago screens its investments for a clear path to scale. The Foundation has identified five paths an organization can take to reach one million or more people with a specific intervention: the market, governments, direct implementation via a large institution, indirect implementation via other NGOs, or by seeding the viral spread of behavior change.

10

Before committing any financial support, Mulago must be convinced that an organization is thinking clearly about which of these paths to scale is the best match for its intervention.

With this philosophy, the Mulago Foundation operates much like “a philanthropic venture fund with proven impact as an analog for profit, and cost-per-impact for return on investment.” 11 It primarily targets early-stage organizations and provides unrestricted funding so that its portfolio companies can deploy the money in the way that they believe will provide the greatest leverage.

+=>!C=%$$>)&>-!.,&'.'#B!5>+!.>%$,B+,C!">%B#.>">)+!

One of the few things more important than scalability in the Mulago approach is measurable impact, because if an intervention “can’t demonstrate real impact, it shouldn’t be scaled up.” 12 Leaders of the Foundation admit that they are “unabashedly obsessed with impact.” 13 However, many of the organizations applying to Mulago for investment struggle with how to effectively measure their results. Too often, innovators and entrepreneurs either under- or overinvest in data

!

collection. Those who underinvest in understanding their impact can find themselves

Impact is a change in the state of the work brought about by an intervention. It’s the final result of behaviors (outcomes) that

spending far too much money to achieve too few results. Those who overinvest in gathering information can waste valuable time and resources tracking metrics that produce a flood

are generated by activities (outputs) that

of data but do little more than “clog the works.”

are driven by resources (inputs).

The challenge, as Hattendorf and Kevin Starr,

Mulago’s Managing Director, explained in a blog post, is that, “Measuring impact is kind of like raising kids: It’s often hard [and] it costs more than you think it’s going to.” But, they continued, “You absolutely have to do the best job you can…. It’s the only way to know whether the money we spend is doing any good.”

14

To help organizations meet this challenge, Mulago needed to develop an approach to the measurement of impact that was simple enough for an early-stage, resource-constrained organization to carry out, but rigorous and focused enough to mean something.

15

+=>!B'$#+,')-!*>B,&)!('.!.>%$!,"?%C+!

Based on its experience in the field, the Mulago Foundation developed a simple, but credible framework for measuring impact. The framework begins with a straightforward definition of impact: “Impact is a change in the state of the work brought about by an intervention. It’s the final result of behaviors (outcomes) that are generated by activities (outputs) that are driven by resources (inputs).” 16 There are five steps for how an organization can build evaluation into its operations:

17

"#$%&'!('#)*%+,')-!.,&'.'#B!5>+!.>%$,B+,C!">%B#.>">)+ !!!!!!

6":$;<13 !!!!!!

I $

!

K L!(/0326!137!MD87!E13N26!72E/<0!71!8::1;O9/4D-!7D6!2689!;/44/1<!

No organization can begin to understand its impact until it clearly defines what it has set out to achieve. The Mulago Foundation believes that most mission statements aren’t useful in this regard because they are often focused on the “how” and not the “what.”

The Mulago team asks the groups they work with to reformulate their missions in a phrase of eight words or less that includes a target population (or setting), a verb, and an ultimate outcome that implies something to measure. For example, “Get African oneacre farmers out of poverty” or “Prevent HIV infection in Brazil.”

H L!?/:P!7D6!2/0D7!/<G/:8712!

Next the Mulago team asks for the single best indicator that demonstrates mission accomplished. For instance, the mission to “Get African one-acre farmers out of poverty” could be measured by a change in farm income. “Prevent HIV infection in Brazil” could use a decrease in HIV infection rates as its key metric. Usually it’s possible to identify a single indicator, but the Foundation admits that occasionally a combination of indicators is needed, although these should be kept to an absolute minimum. It is also possible to use a proxy indicator if there is good scientific literature that links that proxy to impact.

Importantly, the Foundation readily acknowledges that this approach is not intended to capture all of the impacts and accomplishments of organizations and their interventions. It is simply intended to answer the question: are they fulfilling their mission?

!

>(..#,-*45$(,-$?.(44$@6(1A$

4*7B$.*$."#$4/)".$*5$1#,.#4C$

7/."$."#$0.(55$*5$($"#('."$

1#,.#4$/,$>(./D(B$E#3('$

$

I L!&67!2689!<3;Q624!

Once the right indicator is chosen, the organization must show a change and have confidence that the change is real.

This means establishing a baseline and then measuring it again at the right intervals to ensure that the impact is sustained. It also requires the organization to choose an appropriate sample in a meaningful way. At this stage, innovators may benefit from having a statistician validate the approach.

J L!"8P6!7D6!:846!F12!8772/Q37/1<!

With impact data in hand, innovators need to make a case that it was their efforts that caused the change. This is often the hardest part of measuring impact because it requires an organization to articulate what would have happened without its involvement. The

Mulago team advises groups to think about what else could have possibly explained the

"#$%&'!('#)*%+,')-!.,&'.'#B!5>+!.>%$,B+,C!">%B#.>">)+ !!!!!!

6":$;<13 !!!!!!

J $

impact. In addition, the Foundation outlines three levels—in ascending order of cost and complexity—for demonstrating attribution:

• #=>>=?@AB$=??>@CD?@EF$$ Crafting an airtight story that the difference in the before-and-after data is unlikely to have been caused by something other than the organization’s intervention. This approach is overused, but can be valid when the change is big, tightly coupled with the intervention, involves few variables (other factors that might have influenced the change), and the organization has a deep knowledge of the setting.

• 6=?GHBI$GEF?>EJK At the outset of a program, identifying settings or populations similar enough to ones the organization is working with to serve as valid comparisons. This works when there aren’t too many other variables, the organization can find good matches, and it can watch the process closely enough to know that significant unforeseen factors didn’t arise during the intervention period. According to Mulago, this approach is rarely perfect, but often good enough.

• &=FIEL@MBI$GEF?>EJJBI$?>@=JK$N&,'KO Still the gold standard when it comes to measurement. RTCs are needed when the stakes are high and there are too many variables to be able to confidently say that an organization’s comparison groups are similar enough to show attribution.

!

R L!C89:39876!Q8<0SF12S7D6SQ3:P!

After real impact is determined, the final step is to figure out how much it actually cost.

Organizations can often generate impact by spending a ton of money, but it won’t give good value for philanthropic dollars spent and it won’t be scalable. The Mulago team asks innovators to stick with the key impact they’ve

Everyone needs to be measuring

already chosen rather than trying to monetize multiple social impacts. The easiest way to calculate bang-for-thebuck is to divide the total donor money spent by the total impact achieved. When dealing with early-stage compa-

impact, but as the investment of resources increases…the rigor of the

nies, Mulago is less concerned about their current cost effectiveness figures (start-ups are expensive!). Instead, they look at whether the projections for steady-state operations make sense.

methodology also has to increase.

Admittedly, implementing this very simple framework takes time and resources. However, the Foundation had seen it work effectively under a variety of circumstances.

As Hattendorf pointed out, the approach is flexible enough to be applied differently as organizations progress in their stage of development. “Everyone needs to be measuring impact,” she said, “but as the investment of resources increases and, presumably, the scale of the implementation expands, the rigor of the methodology also has to increase.

We would never ask an early stage organization to do an RCT but, if something is scaling at the government level, is might be necessary.”

Independent of exactly how the framework is applied, “Everyone benefits from a brighter look at impact: the doers, the funders, the social sector itself, and most importantly, those who are hoping for a brighter day ahead.”

18

!

"#$%&'!('#)*%+,')-!.,&'.'#B!5>+!.>%$,B+,C!">%B#.>">)+ !!!!!!

6":$;<13 !!!!!!

R $

!

!!

!

#),+!$

K ! ^(/<8<:/<0!&91Q89!=6897D!HUKH-!+D6!><G!1F!7D6!&19G6<!%06_`!,<47/7376!F12!=6897D!"672/:4!8<G!>Y89387/1<X!

HUKHX!D77O-AAMMMLD6897D;672/:48<G6Y89387/1<L120AO3Q9/:87/1<4AO19/:ES26O127AF/<8<:/<0S091Q89SD6897DS

HUKHS6<GS019G6<S806!a"8E!HKX!HUKHbL!

H ! ,Q/GL!

I ! *8Y/G!":C1EX!B3<G66O!CD8<GX!8<G!*6Y/!B2/GD82X!^&91Q89!=6897D!(3<G/<0-!=1M!"3:DX!TD626!,7!C1;64!

(21;X!8<G!TD626!,7!&164X!=6897D!?19/:E!8<G!?98<</<0X!%O2/9!HUX!HUUcX!

D77O-AAD68O19L1dF12Ge132<894L120A:1<76<7AHJAfAJUWLF399!a"8E!HKX!HUKIbL!

J ! !^B:898Q96!B1937/1<4!?127F19/1X`!+D6!"39801!(13<G87/1<X!D77O-AAMMML;39801F13<G87/1<L120AMD1SM6SF3<G!

a"8E!HKX!HUKIbL!

R ! ^=1M!T6!(3<GX`!+D6!"39801!(13<G87/1<X!D77O-AAMMML;39801F13<G87/1<L120A_ghD1MSM6SF3<G!a"8E!HKX!

HUKIbL!

f ! ,Q/GL!

W ! ,Q/GL!

V ! %99!g31787/1<4!826!F21;!/<762Y/6M4!:1<G3:76G!QE!7D6!837D124X!3<9644!17D62M/46!:/76GL!

c ! i6Y/<!B7822!8<G!"827/<!(/4D62X!^%!@2/6F!&3/G6!71!=/0DS,;O8:7!?D/98<7D21OEX`!+D6!"39801!(13<G87/1<X!

D77O-AA;39801F13<G87/1<L120A_gh/G684AOMOAQ2/6FS03/G6SD/0DS/;O8:7SOD/98<7D21OE!a"8E!HKX!HUKIbL!

KU ! ^=1M!T6!(3<GX`!1OL!:/7L!

KK ! ,Q/GL!

KH ! ,Q/GL!

KI ! =1;6!O806X!+D6!"39801!(13<G87/1<X!D77O-AAMMML;39801F13<G87/1<L120A!a"8E!HKX!HUKIbL!

KJ ! i6Y/<!B7822!8<G!$8328!=8776<G12FX!^.689!T129G!,;O8:7!"684326;6<7X`!B78<F12G!B1:/89!,<<1Y87/1<!.6Y/6M!

@910X!B6O76;Q62!HJX!HUKIX!D77O-AAMMML44/26Y/6ML120AQ910A6<72EA2689jM129Gj/;O8:7j;684326;6<7!a"8E!

HKX!HUKIbL!

KR ! ,Q/GL!

Kf ! ^=1M!T6!+D/<P!%Q137!,;O8:7X`!+D6!"39801!(13<G87/1<X!D77O-AA;39801F13<G87/1<L120A_gh/G684A2AD1MS

M6S7D/<PS8Q137S/;O8:7!a"8E!HKX!HUKIbL!

KW ! ,Q/GL!

!

KV ! ,Q/GL!

!

!

+D/4!264682:D!M84!43OO1276G!QE!7D6!)87/1<89!,<47/73764!1F!=6897D!028<7!K!.CJ!+TUUVWVKSUKL!

$E<!*6<6<GX!%;E!$1:PM11GX!8<G!B78:6E!":C37:D61<!O26O826G!7D/4!Y/0<6776!M/7D!?21F64412!B76F8<14!Z6</14!84!

7D6!Q84/4!F12!G/4:344/1<!287D62!7D8<!71!/993472876!6/7D62!6FF6:7/Y6!12!/<6FF6:7/Y6!D8<G9/<0!1F!8!;8<806;6<7!

4/7387/1<L!C1OE2/0D7![!HUKI!QE!7D6!@182G!1F!+2347664!1F!7D6!$698<G!B78<F12G!\3</12!#</Y624/7EL!%99!2/0D74!26S

462Y6GL!)1!O827!1F!7D/4!O3Q9/:87/1<!;8E!Q6!26O21G3:6GX!47126G!/<!8!2672/6Y89!4E476;X!346G!/<!8!4O268G4D667X!12!

728<4;/776G!/<!8<E!F12;!12!QE!8<E!;68<4]696:721</:X!;6:D8</:89X!OD171:1OE/<0X!26:12G/<0X!12!17D62M/46]

M/7D137!7D6!O62;/44/1<!1F!7D6!B78<F12G!&28G3876!B:D119!1F!@34/<644L!

Download