Having a pure quantitative approach is very limitating our

advertisement
ACF
Action Contre la Faim
Nutrition Causal Analysis research project
KICK OFF MEETING
discussion paper
9-10th of September 2010
Helen Young, TUFTS University
Jennifer Coates, TUFTS University
Yves Martin Prevel, IRD
Susanne Jaspers, freelance
Kate Ogden, WFP
Hanna Mattinen, ACF
Myriam Aït Aîssa, ACF
Nicolas Guibert, ACF
Sophie Laurence, ACF
Cécile Bizouerne, ACF
Philippe Crahay, ACF
Julien Chalimbaud, ACF
Merci aussi à
Ioana Kornett, Francesca Corna, Anne Dominique Israel d’ACF pour leurs actives
participations.
The objectives of the meeting were:
1. To set clear objectives and adopt a nutrition framework for the ACF/NCA research
project
2. To identify potential methodological options for doing a causal analysis
3. To identify approaches to validate the method
1. Objectives of an NCA and context where it is recommended
Recall of the original main objective of the research: to develop a standardised and replicable
method to identify and rank the key determinants of acute undernutrition
1. What ACF expects from NCA surveys?
We tend to expect a lot from NCA. A clear objective of this research is to clarify what we can
achieve within our capacity and what are our
limits. Recommendations must be based on
solid arguments and therefore solid methodology. ACF implements NCA as a complex
assessment of 2-3 months in a specific local context (typically at a district level).
The first use of NCA by ACF is to define a
intervention and
programmes
medium term strategy
(2-3 years) of
in order to reduce undernutrition (ACF is focusing on
acute undernutrition). An NCA is a key tool for mainstreaming nutrition in all
programmes and making sure that at least, for example, a food security programme does not
increase risks of undernutrition. NCA can be also a powerful tool for advocacy.
2. Focusing on acute undernutrition and/or Stunting?
This can vary according to the local objectives of a NCA and the
context should we consider an NCA?
context.
In which
ACF is keen to consider an NCA in contexts where undernutrition is not well understood
and remains consistently at high levels. However, these context precisions do not
really tell us on which type of undernutrition all NCA should focus on. When looking at
medium term strategy, it seems relevant to focus on stunting 1. On the other side, there are
multiple examples where acute undernutrition remains at high levels during a prolonged
So an NCA can be relevant focusing on
stunting or focusing on acute. However, stunting and acute
undernutrition have different causes. Risk factors and pathways are different.
period and is not well understood.
Z.A. Bhutta and al2 have depicted the different pathways leading to stunting/acute
undernutrition although it does not explore relations between stunting and acute per se:
L.Smith; Marie T.Ruel; Aida Ndiaye “Why is child malnutrition lower in urban than in rural areas? Evidence from 36
developing countries”. 2004.IFPRI discussion paper. http://www.ifpri.org/publication/why-child-malnutrition-lowerurban-rural-areas-0
2
Z.A.Bhutta and al. “What works? Interventions for maternal and child undernutrition and survival”. The Lancet, 2008.
http://www.thelancet.com/journals/lancet/article/PIIS0140-6736%2807%2961693-6/abstract
1
During the meeting we reached the consensus that we cannot only look at acute
linkages between
stunting and acute? The linkages will differ from one context to another3. Does it
imply a different methodology? An important aspect for methodological
considerations is that timeframes are different.
undernutrition without considering stunting. What are the
It would be interesting to test the methodology in a country focusing on chronic and another
one focusing on acute. An opportunity worth to be explored is the recent work by S.Nandy
and J.Miranda on composite indicators (CIAF) of nutritional status4.
2. Undernutrition framework
As portrayed in annexe 1, quite a few adaptations from the original UNICEF framework of
1990 have appeared since. Main frameworks used though are the original UNICEF
framework; the Black Re and al5 adaptation published in the Lancet; the WFP one of 20096
and the ACF one recently published in SCN7. All are showed in annexe 1.
C.G.Victoria. “The association between wasting and stunting: an international perspective”. The Journal of Nutrition
1991.
http://jn.nutrition.org/cgi/content/abstract/122/5/1105
4
See Shailen Nandy and J. Jaime Miranda; overlooking undernutrition?
http://www.ncbi.nlm.nih.gov/pmc/articles/PMC2685640/
3
5
Black RE, Allen LH, Bhutta ZA, Caulfield LE, de Onis M, Ezzati M, Mathers C and Rivera J (2008) Maternal and child
undernutrition: Global and regional exposures and health consequences. The Lancet 371: 243-60. Available at:
www.thelancet.com/journals/lancet/article/PIIS0140-6736(07)61690-0/abstract
6
WFP (2009) Emergency Food Security Assessment handbook. WFP:Rome. Available at:
the main architecture of the framework has survived
even after 20 years. There was a consensus to keep the framework as a concept, to keep it
simple, generic and neutral so that it can be adapted to various situations.
Beside adaptations,
Rather than detailing a framework it seems more relevant to further develop a methodology
to better use it.
Nevertheless, strengths and weaknesses of the different frameworks need to be emphasized
to develop a proper NCA methodology:
1. Crucial to have basic factors more prominent.
From the original framework, two aspects are less emphasized in the more recent
frameworks: people’s
perspective and goals and the basic causes.
- Either we visually represent all the impact of the basic causes on every risk factors. Then
conceptual linkages need to be made between basic causes and undernutrition.
- Or, as L.Smith and L.Haddad8 do recommend, we should have a separate analysis for each
level: underlying
causes are already integrating basic causes.
From all the NCA gathered, often too
little is mentioned about basic causes.
2. Nutrition Cycles and feed back loops
Undernutrition is not only an outcome but also an input: 2 cycles are important : the nutrition
life cycle (intergeneration links as low birth wait is a clear risk factor and is mostly
determined by pregnant women’s nutrition status) and infectious cycle (loop between
nutrition / health and food intake).
They are not pictured in the main frameworks mentioned above. It is an important aspect
when showing a link between poor health and undernutrition especially when looking at
acute, doesn’t tell if health is a cause or a consequence of undernutrition. Careful
methodology and conclusion are necessary.
3. Links with the livelihood framework
www.wfp.org/content/emergency-food-security-assessment-handbook
7
ACF (2010) The threats of climate change on undernutrition: A neglected issue that requires further analysis and urgent
actions, in: SCN, 2010. Newsletter #38 – Climate Change: Food and Nutrition Security Implications. Available at:
http://www.unscn.org/files/Publications/SCN_News/SCN_NEWS_38_03_06_10.pdf
L.Smith and L.Haddad. « Explaining child malnutrition in developing countries”, IFPRI 2002.
http://www.ifpri.org/publication/explaining-child-malnutrition-developing-countries-0
8
ACF and WFP frameworks are putting the livelihood concept in a central position within the
nutritional framework.
The livelihood concept and framework attached is powerful for 2 reasons. It emphasizes the
strategies and choices made at household level, based on available assets. Also, it is a
well known concept, has a better political capital and is widely used by many field workers.
On a weaker side, when we are talking about basic causes, we are not talking about
livelihood assets. It is a wider perspective. Livelihoods concept does not integrate well
public health and child care practices for example.
Livelihood concept is well depicting the process of: availability / strategic choices of
households / outcomes produced impacting available resources. However, a typical choice
of, for example, “should I buy veterinary medicine for my only milking cow or bring my
child to the health centre”, is not well pictured in the livelihood assessments and is critical
for an NCA approach. It is pictured in the livelihood framework (human capital is there) but
not in the livelihoods zone or livelihood groups of the Household Economy Approach.
No consensus has been reached on this point.
- Either we use ACF/WFP frameworks and enlarge/precise the definition of livelihoods in
order to better integrate health / care practices access and use.
- Either we use the Black Re or UNICEF frameworks. See proposed framework in annexe 1
which keeps the livelihood process but is not using the “livelihoods” term.
4. Dynamic aspect
Dynamic aspects are not pictured in the original UNICEF framework nor in
the Black Re one. WFP and ACF frameworks are strongly showing how risk factors are time
bounded.
5. Scale of the framework
A remark regarding the framework: virtually, one framework can be pictured for every
child. A baby boy or girl from the same mother will not necessarily have the same care
practices.
The different levels of analysis are clear in the framework (individual / household /
community) but we are however still
often trying to draw a single framework
for a vast diversity of situations.
Review of the framework, remaining questions…
Annex 1e and 1f are proposing 2 new frameworks depending on how we represent basic
causes. Which one would be the most adapted? Further modifications to add/remove? Do
we mention “housheholds assets” or “livelihoods assets”?
Are the basic causes, and links for other components well pictured or need to be further
detailed?
3. NCA validation protocol
1. Having a pure quantitative approach is restrictive as most multi-variate analysis
have only been able to explain 15 to 25% of variability.
Quantitative assessments have been trying to explain and rank different causes of
undernutrition by testing key indicators one by one with undernutrition levels (weather
chronic or acute). Indicators appearing to be significantly linked with undernutrition were
then gathered in a multi variate analysis in order to explain undernutrition variability (for
ex: 3% percent of undernutrition is explained by poor diet diversity score; 5% by
education…).

most of these multi variate analysis explain only a small part of
variability of undernutrition.
This is leading to few thoughts: Are quantitative analyses inadequate or can multi-variate
analysis be improved?
Does it mean that designing interventions targeted towards main determinants will have a
limited impact?
2. Can quantitative / multi-variate analysis be improved?
These studies are often based on large samples from national databases and are limited by
the number of indicators available. The choice and interpretation of indicators or proxy
indicators is very tricky and often limited.
There is no point identifying a key determinant that is being driven
by something else. This helps drive silos problems.
Another limiting factor is the variability in the sample: comparing different
countries dataset shows more variability in the sample than national surveys / local surveys.
For example the cross country survey by L.Smith and L.Haddad9 have shown much better
results and are confident to explain through only 4 proxy indicators most of the variability of
undernutrition. A limit of this study is the careful interpretation of the 4 proxy indicators
used. Another factor of success of this survey is to have 2 multivariate models: one for basic
causes and another for underlying causes: “A bias results in the fact that impact of basic
causes is already picked up by the variable it determines (underlying causes)”.
9
L.Smith and L.Haddad « explaining child malnutrition in developing countries ». 2002.
http://www.ifpri.org/publication/explaining-child-malnutrition-developing-countries-0
Path analysis methodology could be an appropriate technique to consider as it explores
better the interdependencies of causal factors10.
Including new indicators with geographical variables (GIS) can potentially increase our
understanding.
The Case-Control methodology seems more powerful as it reduces sample size which is a
major constraint. This methodology was used in Colombia11 in 2007 to explain 77% of the
mortality cases due to wasting with only 6 risk factors.
3. If only a small proportion of the prevalence of undernutrition is explained by
determinants, does it mean that designing interventions targeted towards those
main determinants will have a limited impact?
positive
and important impact has been demonstrated of an integrated
approach to reduce undernutrition acting apparently only on few risk factors.
Looking back at the Iringa experience12 and also the Laos GTZ integrated project,
For example, the successful experience of GTZ in Laos, S.Kaufmann showed that 3
interventions where having a direct impact on undernutrition: improve agricultural system;
improve water system and water treatment. Households not having any of the 3
interventions were having chronic undernutrition rates of 73% whereas those having
endorsed all of the 3 interventions were having chronic undernutrition rates of only 25%. It
does not mean that those 3 interventions reduced automatically undernutrition by -50%. As
strongly mentioned in the Iringa experience (and the triple A strategy), a
community
approach is the basis for increasing impact of interventions. Bringing political actors,
community leaders, head of households, mothers around main determinants of
undernutrition, with appropriate information and means for action, is a key success factor.
The how is at least as important as the what.
An interesting perspective is to see how this successful bottom up approach melds with the
current international trend towards large scale specific interventions 13. Maybe a starting
point would be to ask whether there is any information to indicate that this essential
package, and the problems it aims to resolve, is not likely to appropriate in x context for y
reason. Once barriers are removed, or the package is tailored, then perhaps it is more likely
to succeed. So, we would be starting with well-defined hypothesis and
essentially testing to see if we could disprove them, and if yes, then provide some
understanding for why they don’t hold in a certain context.
10
See http://en.wikipedia.org/wiki/Path_analysis_%28statistics%29
Gobernacion de Antioquia « mortalidad por desnutricion en menores de cinco anos en el departamento de Antioquia”.
2007.
12
UNICEF. “Improving Nutrition in Tanzania in the 80s: the Iringa experience” 1992.
http://www.unicef-irc.org/publications/pdf/eps25.pdf
13
Essential Nutrition Action initiative, linkages project. See also ref 11.
11
4. Using a quantitative NCA is not the only way to identify and rank main
determinants of undernutrition.
Ranking/discriminating determinants implies to have criteria for ordering them.
When using a quantitative / multi variate analysis, it implies that the criteria used for
ranking is the statistic explanation of the undernutrition variability. This criteria is
debatable.
First for its reliability: an analysis relies only on existing indicators in the survey. More
important indicators might be missing and not pictured in the analysis. Also when looking
at a homogenous population, some key factors might affect the whole population. A
statistical analysis will not be able to reveal this factor as there is no diversity in the sample.
If the aim of ranking is meant for targeting intervention, then targeting the “statistically most
important determinants” might not be the best way to ensure the highest impact.
Furhtermore, the dynamic aspect is critical: main risk factors are evolving through the
seasons and main determinants should not be identified only looking at a specific time in the
year.
5. Dynamic aspects of an NCA
Causes of undernutrition are changing with time.
The timing of the NCA
assessment is an important aspect in the interpretation of the results. In order to provide a
dynamic aspect to NCA, two approaches are possible: split the NCA in a baseline +
continuous “monitoring” tools or extrapolate dynamic aspects of the main risk factors
identified (one by one).
6. Scale of the framework: “nutrition vulnerability groups”
We focus on trying to identify causes, but adopting a more descriptive approach of the
group and the main causes can help identify nutrition vulnerability groups. Livelihood
groups are not fully satisfactory as they are not uniformed with care practices, nor with
access and use of health care (although it is included in the livelihood framework).One
solution is to look through the hypothesis identified in the initial phase: if they don’t suggest
that causes of undernutrition are different across livelihood/ethnic/urban group then we
don’t need to disaggregate.
7. Linking an NCA with an anthropomethric survey
In order to have a good first understanding of nutrition patterns (prevalence,
heterogeneity…) in an area,
a nutrition survey should be done before an
NCA, except if secondary data is sufficiently detailed. It is not possible to do an NCA with
a nutrition survey (time, sample, methodology and objectives are different).
8. Sequences for an NCA :
Qualitative – Quantitative – Qualitative:
It is clear that a dual qualitative (making hypothesis) and a quantitative approach (testing
the hypothesis) would be relevant for an NCA. As it is an iterative process, a final phase of
qualitative to further interpret the information gathered and refine initial hypothesis should
be valuable.
NCA validation protocol
Linking NCA and nutrition surveys: what type of nutrition survey (rapid or SMART)? What
information is exactly expected from nutrition survey? See example of Sierra Leone with
WFP. What nutrition indicators in the NCA we would be looking at?
Pathways and case control methodologies to be further explored.
How to better underline dynamic aspects of undernutrition in the methodology?
Based on the proposed sequence of the NCA assessment, what parts of the method need to
be standardized and others to be contextualized?
Annexe 1 a: UNICEF Framework 1990
http://www.ceecis.org/iodine/01_global/01_pl/01_01_other_1992_unicef.pdf
Interestingly, the framework included in the above link is not exactly the same as the one
below which was published by UNICEF. In the published one (below) “formal and non
formal institutions” have replaced the “resources and control” box.
Annexe 1b: Black re and Al framework 2008
Black RE, Allen LH, Bhutta ZA, Caulfield LE, de Onis M, Ezzati M, Mathers C and Rivera J (2008) Maternal and child
undernutrition: Global and regional exposures and health consequences. The Lancet 371: 243-60. Available at:
www.thelancet.com/journals/lancet/article/PIIS0140-6736(07)61690-0/abstract
Annexe 1c: WFP Framework 2009
WFP (2009) Emergency Food Security Assessment handbook. WFP:Rome. Available at:
www.wfp.org/content/emergency-food-security-assessment-handbook
Annexe 1d: ACF Framework 2009
ACF (2010) The threats of climate change on undernutrition: A neglected issue that requires further analysis and urgent
actions, in: SCN, 2010. Newsletter #38 – Climate Change: Food and Nutrition Security Implications. Available at:
http://www.unscn.org/files/Publications/SCN_News/SCN_NEWS_38_03_06_10.pdf
Annexe 1e: proposed framework v1
Short Term Consequences:
Mortality, Morbidity, Disability
Long Term Consequences:
Adult size, intelectual ability,
economic productivity, reproductive
performance, metabolic and
cardiovascular disease
Nutrition Status
Immediate
Causes
Dietary Intake
Underlying
Causes
Basic
Causes
Shocks, trends, seasonality
Food Security
Health Status
Maternal, infant and
young child care
practices
Access to quality water,
sanitation and health
services
Households strategies,
traditions and beliefs
Households
assets
Natural, physical,
human, social,
financial and
political
Policies, formal and
informal institutions
Context, Potential resources, services and infrastructures
Annexe 1f: proposed framework v2
Short Term Consequences:
Mortality, Morbidity, Disability
Long Term Consequences:
Adult size, intelectual ability,
economic productivity, reproductive
performance, metabolic and
cardiovascular disease
Nutrition Status
Shocks, trends, seasonality
Underlying
Causes
Dietary Intake
Food Security
Health Status
Maternal, infant and
young child care
practices
Livelihoods strategies,
traditions and beliefs
Livelihoods
assets
Natural, physical,
human, social,
financial and
political
Access to quality water,
sanitation and health
services
Context: Potential resources, services and
infrastructures
Immediate
Causes
Download