What are risk governance deficits?

advertisement
Risk Governance Deficits
A summary of the conclusions of
the IRGC report on Risk Governance
Deficits
Chemin de Balexert 9, CH – 1219 Châtelaine, Geneva, Switzerland | tel +41 (0)22 795 17 30 fax +41 (0)22 795 17 39 | www.irgc.org
international risk governance council
Risk Governance Deficits
January 2010
1 | 31
IRGC’S Risk Governance Framework
Deciding
Understanding
Pre-Assessment
Management
Communication
Characterisation
and Evaluation
international risk governance council
Risk Governance Deficits
Appraisal
Categorising
the
knowledge
about the risk
January 2010
2 | 31
What are risk governance deficits?

Risk governance deficits are deficiencies (when key elements are absent)
or failures (when actions are not taken or prove unsuccessful) in the risk
governance process.

They weaken the overall process. They can (and do) recur.

One way for risk practitioners to improve the governance of risks is to
identify and remedy deficits in the risk governance processes of which they
are a part.
international risk governance council
Risk Governance Deficits
January 2010
3 | 31
IRGC has identified 23 common risk governance deficits
Cluster A: Risk assessment
Cluster B: Risk management
– Detecting early warnings of risk
– Factual knowledge about risks
– Perceptions of risk, including their
determinants and consequences
– Stakeholder involvement
– Evaluating the acceptability of the risk
– Misrepresenting information about risk
– Understanding complex systems
– Recognising fundamental or rapid changes
in systems
– The use of mathematical models
– Assessing potential surprises
international risk governance council
Risk Governance Deficits
– Responding to early warnings
– Designing effective risk management
strategies
– Considering a reasonable range of risk
management options
– Designing efficient and equitable risk
management policies
– Implementing and enforcing risk
management policies
– Anticipating side-effects of risk
management
– Reconciling time horizons
– Balancing transparency and confidentiality
– Organisational capacity
– Dealing with dispersed responsibilities
– Dealing with commons problems and
externalities
– Managing conflicts of interests and
ideology
– Acting in the face of the unexpected
January 2010
4 | 31
B8
Balancing transparency and confidentiality
A1
Early warning systems
A4
Stakeholder involvement
A6
Misrepresenting information about risk
A9
The use of formal models
B10
Dealing with dispersed responsibilities
B1
Responding to early warnings
B5
Implementing and enforcing risk management
decisions
B9
Organisational capacity
B2
Designing effective risk management strategies
B3
Considering a reasonable range of risk
management options
B4
Designing efficient and equitable risk
management policies
B6
Anticipating side effects of risk management
B7
Reconciling time horizons
B10
The Risk Governance Deficits
in the Risk Governance Framework
A1
Early warning systems
A1
Assessing potential surprises
A2
Factual knowledge about risks
A3
Perceptions of risk, including their
determinants and consequences
B9
Organisational capacity
A2
Factual knowledge about risks
A7
Understanding complex systems
A8
Recognising fundamental or rapid changes in
systems
A9
The use of formal models
A6
Misrepresenting information about risk
A3
Perceptions of risk, including their determinants
and consequences
A4
Stakeholder involvement
Dealing with dispersed responsibilities
B3
Considering a reasonable range of risk
management options
B11
Dealing with commons problems and externalities
B4
Designing efficient and equitable risk
management policies
B12
Managing conflicts of interests, beliefs, values
and ideologies
B6
Anticipating side effects of risk management
B7
Reconciling time horizons
B11
Dealing with commons problems and
externalities
B13
A5
Acting in the face of the unexpected
Evaluating the acceptability of the risk
international risk governance council
Primary allocation
Secondary allocation
Risk Governance Deficits
January 2010
5 | 31
IRGC has focused on causes,
risk governance deficits have consequences

Diminution (or even suffocation) of technological innovation and diffusion

Neglect of high-probability, low-impact risks

Missing low-probability, high-impact risks

Secondary impacts due to inadequate consideration of trade-offs

High costs of inefficient regulations

Loss of public trust in public and private institutions as well as NGOs

Unfair or inequitable distribution of risks and / or benefits

A failure to move from business as usual and trigger necessary actions (underreaction)
international risk governance council
Risk Governance Deficits
January 2010
6 | 31
Two clusters of risk governance deficits
Deciding
Understanding
Pre-Assessment
CLUSTER B:
Management
Managing risks
…which may lead to
under-reaction or
over-reaction in risk
management
international risk governance council
Communication
Characterisation
and Evaluation
Risk Governance Deficits
CLUSTER A:
Appraisal
Assessing and
understanding risks
Both under- and
Categorising
over-estimation
can
the
be knowledge
observed in risk
about the risk
assessment…
January 2010
7 | 31
Risk governance deficits, Cluster A – Assessing risks
international risk governance council
Risk Governance Deficits
January 2010
8 | 31
A1 Early warning systems
Missing, ignoring or
exaggerating early
signals of risks
►
Early warning systems may be formal (as in the use of
radar in WW2) or informal (observation of effects of
benzene on Turkish shoemakers)
► When perfect, they prevent serious harm without
causing false alarms
► Early warning systems may:
– Be too insensitive to detect signs of an emerging
risk
– Show False Negatives, causing a risk to evolve
unnoticed
– Indicate False Positives, leading to mistrust and
“Crying Wolf”
The subprime crisis in the United States
The risks of home foreclosures were spread to
investors throughout the world without
transparency about what those risks actually
were, while the few experts expressing concern
were ignored
international risk governance council
Risk Governance Deficits
January 2010
9 | 31
A2 Factual knowledge about risks
The lack of adequate
knowledge about a hazard,
including the probabilities of
various events and the
associated economic, human
health, environmental and
societal consequences
►
Scientific data can be absent, of poor quality or
incomplete
► Factual knowledge is most likely to be lacking
when risks are at their emergent stage
► Even with adequate data, deficits can occur in
the processes of analysis and interpretation
► Further difficulties arise from:
– Whether or not data has been subject to
peer review
– How best to treat uncertainty? (Evidence of
absence of risk or absence of evidence of
risk?)
Radio-frequency electro-magnetic fields
Despite numerous scientific studies, questions
remain as to the health hazards of possible nonthermal effects of radio-frequency EMFs. Results
between studies are often inconsistent and cannot be
replicated.
international risk governance council
Risk Governance Deficits
January 2010
10 | 31
A3 Perception of risk, including their determinants and consequences
The lack of adequate
knowledge about values,
beliefs and interests, and
therefore about how risks are
perceived by stakeholders
►
Risk perceptions vary between people and societal
groups, and can change
► Perceived risks can be very different from estimates
derived from assessments based on scientific
evidence
► Erroneous information about risk perceptions can
mislead decision-makers as much as erroneous
factual information
► Factors influencing risk perception include:
– Personal experience / familiarity with the risk
source
– Distribution and amount of perceived benefits
– Whether or not the risk affects identifiable
people
Risk perceptions of nuclear power
Public perceptions of risk are central to policies
regarding nuclear power. Experts judge risk on the
basis of probability and consequences; most people
base their judgement on criteria that include
“catastrophic potential”.
international risk governance council
Risk Governance Deficits
January 2010
11 | 31
A4 Stakeholder involvement
Failure to adequately identify
and involve relevant
stakeholders in risk assessment
in order to improve information
input and confer legitimacy on
the process
►
Stakeholders can contribute valuable
knowledge to risk assessments
► Excluding relevant stakeholders can
undermine trust in the entire governance
process
► Excessive inclusiveness can, however, slow
down the process or obscure the responsibility
of legitimate decision-makers
► Stakeholders should be able to:
– Contribute useful knowledge or experience
– Add legitimacy to the risk assessment
process
Large infrastructure projects (dams)
The Nagara River Estuary Barrage (Japan) was
delayed for years by legal cases brought by local
stakeholders who were excluded from a topdown planning process. Planning proceeded only
after authorities began a constructive dialogue
with stakeholders.
international risk governance council
Risk Governance Deficits
January 2010
12 | 31
A5 Evaluating the acceptability of risk
A risk’s acceptability is a judgement based on values
and how people balance anticipated risks and benefits
► People and organisations need to define, inter alia,
their risk appetite and level of tolerance for each risk
► Many factors influence the acceptability of risk, such
as:
– Is it incurred voluntarily, or is it imposed?
– Is the risk familiar or unfamiliar?
– Is it controllable by personal action or only through
collective action?
– Does it disproportionately impact on the poor, or
on children?
►
Failure to consider
variables that influence
risk acceptance and risk
appetite
Radioactive waste disposal
Equity considerations (both intra- and intergenerational) are important when assessing risks
relating to the siting of hazardous facilities. Objections
by 3 US states to storing all US LLRW led to the
Federal Low-Level Radioactive Waste Policy Act (1980)
which had the effect of increasing the number of people
at risk from LLRW disposal facilities.
international risk governance council
Risk Governance Deficits
January 2010
13 | 31
A6 Misrepresenting information about risk
►
The provision of biased,
selective or incomplete
information
Many risk management decisions are made under
time and other pressures, and with constrained
resources. Perfect knowledge is rarely available or
possible to communicate
► Each attribute of the risk science – complexity,
uncertainty and ambiguity – can be either over- or
under-stated
► Risk governance can be manipulated by providing
biased, selective or incomplete knowledge, or when
no effort is made to establish its quality and
objectivity
► People tend to over-estimate the validity of evidence
that conforms to their prior beliefs and values
Disposal of the Brent Spar
Greenpeace made an erroneous public claim
that the Brent Spar oil storage buoy contained
some 5000 tonnes of oil and toxic chemicals.
This contributed to consumer boycotts costing
Shell an estimated £60-100 million
international risk governance council
Risk Governance Deficits
January 2010
14 | 31
A7 Understanding complex systems
A lack of appreciation or
understanding of the
potentially multiple
dimensions of a risk and of
how interconnected risk
systems can entail complex
and sometimes
unforeseeable interactions
►
Interactions between components of complex
systems raise numerous difficulties for risk
assessment
► Typically, risk assessments address single issues;
without acknowledging systemic interactions, they
will not be fully informative
► Efforts to reduce risk may lead to unexpected
secondary consequences, in sectors or areas
other than those targeted
► System complexity can both attenuate and amplify
a risk and its consequences
SARS – from civet cats in China, to Toronto
First reported in China in early 2003, SARS infected
8096 people in 27 countries; 774 died. Apart from grave
harm to health, SARS led to severe economic impacts
in Toronto (Canada), on airlines with routes in the
Pacific region (eg Qantas), and up to 90% reductions in
Chinatown restaurant business (in the US).
international risk governance council
Risk Governance Deficits
January 2010
15 | 31
A8 Recognising fundamental or rapid changes in systems
Failure to re-assess in a
timely manner fast and/or
fundamental changes
occurring in risk systems
►
Risk assessment is most straightforward in a
relatively stable environment
► Fundamental changes to political, technological,
environmental or social systems can make obsolete
the assumptions of risk assessments
► These changes may be extremely rapid (e.g. AIDS)
or evolve very slowly and not become apparent until
a “tipping point” is reached (e.g. effects of climate
change)
► These changes are rarely expected
Potato blight and the Irish Famine
The introduction of the “clipper” reduced
journey times from America to Europe,
allowing potatoes carrying blight to survive the
voyage. Between 1845-49 Ireland suffered a
famine which killed over one million people; of
the additional 1 million who emigrated, 20%
died on the ships
international risk governance council
Risk Governance Deficits
January 2010
16 | 31
A9 The use of formal models
An over- or under-reliance on
models and/or a failure to
recognise that models are
simplified approximations of
reality and thus can be fallible
►
►
►
►
►
Deficits can occur from both under-reliance (on
useful models) and over-reliance (on imperfect
models)
Too little may be known about a system to permit
useful modelling
Models may be based on incorrect data or
assumptions
The model itself may behave unpredictably
Models and their results can be manipulated or
used selectively to support strategic or ideological
positions
The subprime crisis in the US
“The essential problem is that our models – both risk models
and econometric models – as complex as they have become,
are still too simple to capture the full array of governing
variables that drive global economic reality. A model, of
necessity, is an abstraction from the full detail of the real
world”.
Alan Greenspan, Financial Times, 16 March 2008
international risk governance council
Risk Governance Deficits
January 2010
17 | 31
A10 Assessing potential surprises
►
Failure to overcome cognitive
barriers to imagining events
outside of accepted paradigms
(“black swans”)
No-one can reliably anticipate the future; there
will always be surprises and unexpected events
► Unknowable risks will be subject to deficits in
their assessment until it is understood that their
existence is NOT predictable, that they cannot
be characterised, measured, prevented or
transferred
► This situation will not be resolved by more
sophisticated tools to model risk
► Instead, what is needed is lateral thinking,
creativity and the capacity to deal with
surprises when they occur
9/11
“We were trapped by our own paradigm… programs to
handle the endless sequence of hijackings and hostage
takings…a “book” was devised and experts
trained…the premise was that the hostage takers
wanted something negotiable; this time, all they wanted
was our lives.”
David T. Jones
international risk governance council
Risk Governance Deficits
January 2010
18 | 31
Risk governance deficits, Cluster B – Managing risks
international risk governance council
Risk Governance Deficits
January 2010
19 | 31
B1 Responding to early warnings
Failure of managers to
respond and take action when
risk assessors have
determined from early signals
that a risk is emerging
►
Signals of a risk may exist, but no action is
taken to prevent or mitigate the risk. This may
be due to:
– Poor communication
– Poor prioritisation
– An “unwillingness to know”
► Conversely, there may be over-reaction to a
warning signal:
– Unnecessary regulation (e.g. US and
Canadian ban on saccharin)
– Apprehension / counterproductive
behaviours (e.g. MMR in the UK)
Hurricane Katrina
Despite being known as “the New Orleans scenario” it took
FEMA five years to model the effect of a hurricane hitting New
Orleans. Funds were insufficient to include an evacuation in
the simulation. In August 2005 weather warnings persuaded
the Governors of Mississippi and Louisiana to declare states
of emergency on Friday 26th, but the mayor of New Orleans
did not order evacuation until Sunday 28th. Katrina hit the
following day.
international risk governance council
Risk Governance Deficits
January 2010
20 | 31
B2 Designing effective risk management strategies
►
Failure to design risk
management strategies
that adequately balance
alternatives
Effective risk management requires:
– A clear objective
– An appropriate risk strategy
– A suitable risk policy, regulation and
implementation plan
► When there are two or more objectives, deficits arise
from a preoccupation with one at the expense of the
other(s)
► Effectiveness includes measuring progress towards
the predetermined objective and revising policies and
regulation to account for new knowledge
The US biofuels policy
Biofuels are part of government strategies to increase
energy security, reduce GHG emissions and boost
agricultural development. US policies emphasise energy
security and boosting farm incomes, but take no account of
scientific evidence that producing corn-based ethanol may
generate more CO2 emissions than come from the
petroleum-based products it replaces.
international risk governance council
Risk Governance Deficits
January 2010
21 | 31
B3 Considering a reasonable range of risk management options
Failure to consider a
reasonable range of risk
management options (and
their negative or positive
consequences) in order to
meet set objectives
►
Risk managers can select favoured or familiar
risk management options for the wrong reasons:
– Not considering trade-offs
– Prior use
– Time constraints
– Resource (including financial) constraints
► Highly uncertain risks pose additional challenges:
– Excessively precautionary approaches can
stifle innovation
– Least-cost options can prevent building
redundancy and resilience into vulnerable
systems
Fisheries management
Measures to reduce the impact of fishing include quotas,
closed seasons and areas, and restrictions on fishing gear,
but the competitive “race to fish” can still lead to excessive
harvests. Rights-based management (e.g. individual
transferable quotas) can protect fishing communities and
fishery stocks, particularly if closely monitored.
international risk governance council
Risk Governance Deficits
January 2010
22 | 31
B4 Designing efficient
and equitable risk management policies
Inappropriate risk
management occurs when
benefits and costs are not
balanced in an efficient and
equitable manner
►
Assessing the efficiency of risk management
options involves tools such as benefit-cost analysis
(when consequences can be quantified), “soft”
benefit-cost analysis (including the use of
judgement to weigh unquantifiable or intangible
benefits and costs), and cost-effectiveness.
► Achieving society-wide efficiency may not result in
an equitable sharing of costs and benefits.
Inequitable decisions can:
– Impose more burdens than benefits on the
most vulnerable or least advantaged members
of society
– Assign costs or restrictions on people or
nations that did not create a risk and do not
deserve to be burdened
The Kyoto Protocol
The Kyoto Protocol takes equity as one of its guiding
principles (e.g. it is industrialised Annex 1 countries that are
subject to emission reduction commitments). It addresses
efficiency through the Joint Implementation and Clean
Development Mechanisms, allowing reductions to be made
where they can be most efficiently achieved.
international risk governance council
Risk Governance Deficits
January 2010
23 | 31
B5 implementing and enforcing risk management decisions
►
Failure to muster the necessary
will and resources to implement
risk management policies and
decisions
Having devised efficient and equitable risk
management policies to meet the assessed
level of risk, the challenge becomes that of
implementing and enforcing them
► Even perfectly conceived policies can achieve
little if they are not implemented and enforced
► Voluntary policies (as in codes of conduct) can
be undermined by free-riders and a lack of
punitive sanctions for non-compliance
► Legally-binding policies can be weakened by a
lack of willingness or capacity to monitor
behaviours and punish transgression
BSE in the UK
The British government used regulations
(including the ruminant feed ban and Specified
Bovine Offal Ban) as part of its management of
the BSE crisis. A “failure to give proper thought to”
the SBO ban was one reason for 48% of
abbatoirs not complying with it 6 years after it
came into force.
international risk governance council
Risk Governance Deficits
January 2010
24 | 31
B6 Anticipating side effects of risk management
Failure to anticipate,
monitor and react to the
outcomes of a risk
management decision in
the case of negative side
effects
►
Changes in one part of a system can impact on and
beyond other components of the system
► Risks managers need to consider both the intended
and unintended consequences of decisions
► The effects of decisions therefore need to be
monitored for both their direct and indirect benefits
and adverse impacts
► Decisions should also be accompanied by
contingency plans for dealing with unintended side
effects
Monitoring the use of clozapine
The anti-psychotic drug clozapine was introduced in Europe in
1973 but reports in Finland in 1975 of patients developing
agranulocytosis (8 died) led to the product’s withdrawal. Later
studies indicated these adverse side effects could be
anticipated by monitoring each patient’s white blood cell count.
With strict requirements for blood monitoring, clozapine was
reintroduced in Europe and approved for use in the US in 1990.
international risk governance council
Risk Governance Deficits
January 2010
25 | 31
B7 Reconciling time horizons
An inability to reconcile
the time frame of the
risk with the time frames
of decision-making and
incentive schemes
►
Business and politics are often dominated by short-term
considerations
► Risks have a variety of timeframes:
– Some emerge only a long period of time (many
chronic diseases)
– Some strike suddenly, often with limited warning
(natural disasters)
– Some start slowly, then escalate rapidly (e.g. AIDS)
– Some are so persistent they breed familiarity (e.g.
alcohol abuse)
► Long-term risks are even ignored in favour of “urgent”
day-to-day needs, or subject to “simple” quick fixes
Asbestos
Asbestos-related health hazards were first reported in
1898. Partially-enforced regulations were first introduced in
Britain in 1931. Licensing regulations and exposure limits
were introduced in 1984 and a full ban on asbestos was
implemented in 1999. It is estimated that asbestos-related
claims will cost British employers and insurers up to £20
billion in the coming decades.
international risk governance council
Risk Governance Deficits
January 2010
26 | 31
B8 Balancing transparency and confidentiality
Failure to balance two of the
necessary requirements of
decision-making: transparency,
which can foster stakeholder
trust, and confidentiality, which
can protect security and
maintain incentives for
innovation
►
Excessive confidentiality can:
– Reduce trust in risk decisions and decisionmakers
– Raise suspicion of the protection of vested
interests
► Excessive transparency can:
– Undermine national security
– Reveal information essential to a
business’s competiveness
– Invade an individual’s rights to privacy
► The modern trend towards greater transparency
and openness makes a decision to invoke
confidentiality more difficult
Enron
Despite increasing emphasis on “corporate governance” in the
US, UK and elsewhere, Enron was able to hide massive amounts
of debt in off-balance sheet overseas entities. This, combined
with mark-to-market accounting, greatly inflated its reported
earnings and share price. Fortune magazine named Enron as
America’s most innovative company for six successive years,
including 2001 – the year Enron collapsed.
international risk governance council
Risk Governance Deficits
January 2010
27 | 31
B9 Organisational capacity
►
Failure to build or maintain
an adequate organisational
capacity to manage risk
IRGC has summarised organisational risk
management capacity as having three dimensions:
– Assets – knowledge, resources, structures and
processes
– Skills – to adapt assets to deal with changing
and dynamic situations
– Capabilities – the overall framework in which the
assets and skills are best exploited, including
external networks
► At the most intangible level, organisations need a
risk culture that recognises the value of risk
management and shows awareness of risk, its
consequences, and the benefits of sound risk
management
Hurricane Katrina
After 9/11 the US Federal Emergency Management Agency
(FEMA) became a part of the new Department of Homeland
Security (DHS). FEMA’s powers and resources were
downgraded and the agency began to suffer budget shortages.
This led to personnel shortages and, prior to Katrina, FEMA had
a 15-20% vacancy rate. It did not have sufficient organisational
capacity to respond effectively.
international risk governance council
Risk Governance Deficits
January 2010
28 | 31
B10 Dealing with dispersed responsibilities
Failure of the multiple
departments or organisations
responsible for a risk’s
management to act cohesively
►
Many risks require a coordinated response from
multiple actors including companies, national
and local governments, and others
► Even within a company or between government
departments, responsibilities are fragmented and
can overlap or be unclear
► International organisations created to handle
trans-boundary issues have the additional
problem of needing to coordinate sovereign
nation states
► Things can, and do, fall between the cracks
Swiss-Italian blackout
On 28 September 2003 a tree flashover in Switzerland
caused a trip of the highly-loaded 380kV Mettlen-Lavorgo line
in Switzerland. A second line then overloaded and tripped.
Rapidly, all of the Italian mainland lost electricity. Costs of the
blackout are estimated at US$139 million. The underlying
problems that led to the incident were largely the result of how
responsibilities for cross-border power transmission were
shared between separate transmission service operators.
international risk governance council
Risk Governance Deficits
January 2010
29 | 31
B11 Dealing with commons problems and externalities
A lack of understanding of the
complex nature of commons
problems and consequently
also of the specific risk
management tools required to
address them
►
Multiple individuals acting in their own selfinterest can ultimately destroy a shared resource
even though each has a long-term interest in
preserving it
► Such resources often fall outside systems of
property rights
► Protecting these resources often requires
individuals to relinquish economic or other
benefits
► When these resources extend globally (e.g.
international fisheries; the atmosphere) their
management requires global action, including
international agreement among governments
Fisheries depletion
The collapse of stocks of cod in the Canadian
Grand Banks, blue-fin tuna in the Mediterranean
and herring in the North Sea all illustrate the
multiple challenges of dealing with the “Tragedy of
the Commons”. Management of the Alaskan
pollock fishery suggests a solution can be found.
international risk governance council
Risk Governance Deficits
January 2010
30 | 31
B12 Managing conflicts of interest, beliefs,
values and ideologies
A conflict may be
negotiable or irreconcilable,
and risk managers must
have the capacity to
distinguish between the two
►
A conflict may be negotiable or irreconcilable
► Conflict may derive from different:
– Interests (which are typically tangible or
economic)
– Beliefs regarding the nature and consequences of
an issue or risk
– Basic values, such as social justice and
ecological sustainability
– Ideologies (often grounded in religion, ethics,
culture, tradition or politics)
► Risk managers need to understand the different
motivations for conflict in order to distinguish those
conflicts that may be resolvable from those that are
irreconcilable
The Canadian asbestos industry
Quebec’s asbestos industry employs under 1,000 workers
yet has “an almost sacred status in the province” which has
“made it politically untouchable”. Canada is the world’s 4th
largest producer and 2nd largest exporter of asbestos, and
has consistently opposed global efforts to regulate
international trade in asbestos.
international risk governance council
Risk Governance Deficits
January 2010
31 | 31
B13 Acting in the face of the unexpected
Insufficient flexibility in the
face of unexpected risk
situations
►
►
►
►
►
For many reasons, risk managers may be unable
to act in the face of the unexpected
Skills and resources suited to prior emergencies
or well-known risks may be insufficient for dealing
with new threats
Managers may delay or fail to change from
routine to crisis management
There may be an absence of authority to
reallocate resources
An emphasis on efficiency makes it difficult to
retain slack resources or build redundancies and
resilience into systems
The Millennium Bug
Dire consequences were predicted from the possible failure of
computers to deal with date-related data between 31 December
1999 and 1 January 2000. Millions were spent checking and
upgrading computer systems, but no problems were reported.
However, work done to prepare for “Y2K” may have added
resilience to systems so as to allow the New York infrastructure
to function after 9/11.
international risk governance council
Risk Governance Deficits
January 2010
32 | 31
Download