Longer version

advertisement
Week 5 : Wednesday 1st November
Lecturer: Jennifer Harper
Topic: Foresight Methodologies and
Processes
1
Outline
Introduction
Clustering of Methods by Task
Categories of Methods
Foresight and Forecasting Methodologies
Methods by Phases
Quantitative
Qualitative
Exploratory vs Normative
Other methods
2
Introduction
Foresight methods and processes draw on futures,
planning and networking approaches.
EU-US approaches differ : EU more fragmented and
diverse as are the methods used
Identify the strengths & weaknesses of the different
approaches and address the concerns
Ensure appropriate use of methods/ Combined use of
methods recommended. Choice and combination of
methods have important implications in terms of process,
results and policy impacts
Ethical concerns: exploratory/creative vs. normative,
top-down
In-built paradox: predicted futures vs invented/created
futures; adaptive change and the self-fulfilling prophesy
3
Clustering of Methods by Task
1. Methods to manage foresight
ROAME (Rationale, Objectives, Activities,
Monitoring and Evaluation)
 Set systems to document the process + outputs
- The structures – steering committee

2. Pre-Foresight Methods





Scoping
Identifying stakeholders – co-nomination
SWOT
Benchmarking
Environmental Scanning
Adapted from Miles 2002
4
Clustering by Task
3. Foresight Generation



Genius forecasting, Expert panels, Brainstorming,
Mindmapping
Relevance trees, cross-impact analysis, delphi,
scenarios, trend extrapolation…
Key technologies
4. Foresight action and renewal

Action Plans, Demonstrators, Panel Embedding,
Publications, Outreach
Adapted from Miles 2002
5
Categories by Criteria
Methods
Quantitative methods (use of
statistics and other data) to
elaborate future trends and impacts
− Trend extrapolation
− Simulation modelling
− Cross impact analysis
− System dynamics
Qualitative methods (drawing on
expert knowledge) to develop long
term strategies
− Delphi method
− Experts panels
− Brainstorming
− Mindmapping
− Scenario analysis workshops
− SWOT analysis
Methods to identify key points of
action to determine planning
strategies
− Critical/ key technologies
− Relevance trees
− Morphological analysis
Source: FOREN Guide
6
Categories of Methods
Quantitative methods provide numerical
representation of future developments, e.g.
forecasts and modelling. They give a great deal
of weight, an ability to examine rates and scales
of changes but they limit the comprehension of
social and political variables and are not always
reliable.
Qualitative methods vary from creative thinking
to more systematic techniques. Used when data
are hard to collect or not available.
Foresight can never be completely
dominated by quantitative methods: the mix
depends on access to relevant expertise and
the nature of the issues.
Source: Foren Guide
7
Categories of Methods
Exploratory methods (“outward bound”) start
from the present and move forward to examine
kinds of alternative future developments it can
lead to. Look at implications of possible
developments that lie outside familiar trends:
What if methods
Normative methods (“inward bound”) start with
the creation of a preliminary view of possible
(preferred) futures, then an analysis of how
these futures may grow out of the present asking what trends and events would take us
there or can be avoided. How methods.
Source: Foren Guide
8
Foresight and forecasting methodologies
Forecasting
3 processes of precedent,
analogy and extrapolation
that gather material by
looking back/backcasting
based on the assumption
of a stable world where
tomorrow will be different
from today just as today
was different from
yesterday, but that the
same things always
change in the same way
at the same rate,
following some
immutable law, or
demographic change.
Foresight
More qualitative methods
based on eliciting expert
knowledge.
Shift from refined
sectoral forecasts “better to sweep wide
and large to glean the
macro-trends than to
forge highly
sophisticated tools for
segments of realities,
which generate
quantitatively precise
forecasts that are
generally wrong because
they skip over
discontinuities”.
9
Foresight and forecasting methodologies
Forecasting main tools:





Traditional methods of
extrapolation.
econometric model
based on mechanics
and transposed to
microeconomics and
then macroeconomics.
Simulation modelling
Cross impact analysis
System dynamics
Foresight Main tools:








Delphi method
Expert panels
Brainstorming
Mindmapping
Scenario analysis
and building
SWOT
Critical technologies
Relevance trees
10
Methods by Phases
1.
2.
3.
4.
5.
Define the problem:specific challenges and needs, e.g. a
longer-term innovation strategy), set the time horizon.
Methods: Panels, SWOT or brain-storming,
Scope -possible focus on specific sectors, bottom-up vs
top-down, extent and structure of consultation
(experts/non-experts), resources, choosing appropriate
methods.
Identify the key variables analyzing the relations between
variables, by placing them in matrix to identify drivers.
Methods: panels/ interviews/desk-based research/
specialized studies/ cross-impact analysis: influence and
dependency graph.
Gathering data on trends and drafting hypotheses.
Methods: trend analysis, simulation modeling, weak
signals.
Exploring possible future through scenario-building
Methods: Exploratory or Normative approaches, panels 11
Scoping for a regional exercise
What are the possible futures of the region in
terms of strengths and weaknesses?
What sectors, technologies and industries
should be promoted to enhance
competitiveness?
What are the likely prospects for regionally
important markets in general?
What are the likely changes affecting the market
important to a specific regionally significant
industry?
What are the likely development trends in
central social issues?
Source: FOR-RIS Report 2004
http://europa.eu.int/comm/research/conferences/2004/foresight/pdf/for-ris_en.pdf#zoom=100
12
Quantitative Methods
Forecasting (time series analysis)
Trend Extrapolation (long-term vs
short-term
Cross Impact Analysis
Simulation Modeling
System Dynamics
13
Time series analysis
Assumption:


inherent laws in economic activity (quantified through past
analysis)
these laws steer the development of economically relevant
variables onto certain ‘predestined’ courses and enable
visualization of future development.
Breakdown of a time series into its components:




trend
typical seasonal but still short-term fluctuations,
business cycle
irregular influences
Short-term vs long-term (UK’s growth rate round 2%
since 1860)
Heavy trends vs seed events (weak signals 9/11)
Source: Hans Georg Graf
14
Types of trends
Linear Trend increases/decreases over time at constant absolute
rates of change.
Exponential Trend increases/decreases at constant percentage
rates of growth
Parabolic trend has the tendency of initially increasing or
decreasing only slightly and then more and more so with time.
Logistic Curves, Growth Curves are usually S-shaped, i.e.,
moving from an initial phase into a dynamic phase in order to
then enter into a new (stationary) equilibrium phase again in the
end.
Life Cycle Curves follow at first a growth curve trend. In a
subsequent period the curve takes a downturn again. forecasts
are based on extrapolations of past trends.
Best fit - based on analysed series of numbers, ‘typical’ trend or
‘trend of the best fit’ is extrapolated into the future by assuming
that the relationships so expressed remain the same and
continue to exist in the same form in the future.
Source: Hans Georg Graf
15
16
Trend Extrapolation
The basis of extrapolation is to locate a trend that is
apparent over time, and project forward data re the
rates of change and the extent of change achieved.
In the shorter-term forecasts this is often a matter of
extending a linear or exponential curve – e.g.
economic growth, power or diffusion of a
technology.
In the longer-term, limits to growth will often be
encountered – there may be a limit to the size of the
population to whom a technology or cultural practice
can diffuse for example, and various other types of
trend curve may be fitted to the data (e.g. S-curve).
Adapted from Hans Georg Graf
17
Concerns with trend analysis
Superficial dichotomy of past as knowable unquestionable facts
and future as arbitrary opinion. Past is open to re-interpretation.
How reliable is trend data? Limited historical data or trends
guessed at.
How to find link between variables? GDP/employment by
rate/volume.
Time sequences: the fertility rate in Fr over past two centuries
offers diametrically opposed trends depending on time sequence
chosen.
Persistence of underlying driving forces? Will counter-trends
come into play, e.g. as resistance grows to a particular cultural
development, or competitors learn to challenge the power behind
a trend?
Adapted from Hans Georg Graf
18
Concerns with trend analysis
At what point will ceilings or turning points be
reached? A key challenge is estimating the ceiling in
diffusion of technologies or practices, e.g. level at
which the population is saturated with this new
product. Infant mortality as indicator of progress in
life expectancy (ceiling).
Is the quantitative trend masking qualitative change?
E.g. new technologies diffuse, but also change, e.g.
computers, cultural practices, diseases: implications
of later adoption of the new product or practice are
liable to be very different from those of the early
adoption. The skills required, the cultural meaning
are all liable to have changed.
Adapted from: Hans Georg Graf
19
Perceptions and misperceptions
Our view of reality depends on:
Our lens/blinkers (partial/blurred vision)
Mindsets, mental constructs, emotion, bias
Our means of observation and knowledge
sources available to us
The means of measurement (GDP)
The weight of the theories we use
The influence of ideologies /schools of thought
Source:Blueprints Report
20
Source: Hans Georg Graf
21
Cross Impact Analysis
An expert-based and quantitative method used in
preparation of scenarios, for establishing the
drivers and likely events.
Experts rate the likelihood of various events
occurring or not occurring.
The matrix of possibilities that arises from this
can be subject to mathematical analysis to
generate a list of scenarios, each with an
aggregate probability of occurrence assigned to
it. The cross-impact method forces attention to
chains of causality: ‘x’ affects ‘y’; ‘y’ affects ‘z’
Source: FOREN Guide
22
Utility of Cross-Impact Analysis
According to William Alexander, Cross-Impact
Analysis assesses the validity and accuracy of
a vision through a systemic approach:
Breaking vision down into specific “themes” &
“events”
Revealing interdependencies among themes and
events
Determining the probabilities of the relative
impact interrelationships may have on each
other
Calculating an overall “matrix index” that
provides a measure of the projected strength
and influences of the event interrelationships
and their likelihood of bringing about the
23
strategic future
Cross Impact Matrix
How does
this 
affect
this
Top executives of highprofile corporations
employ deceptive
practices to rob
shareholders and other
stakeholders.
The forces of economic
globalization make
national borders
permeable to commerce
and enable free trade.
Americans tend to value
decentralized
government.
Permeable borders and
free trade create more
opportunities for
deceptive business
practices.
Decentralized
government weakens
federal regulatory power
and creates a divide and
conquer phenomenon
(corporations can seek
the weakest local
regulatory
environments).

Top executives of highprofile corporations
employ deceptive
practices to rob
shareholders and other
stakeholders.
The forces of economic
globalization make
national borders
permeable to commerce
and enable free trade.
Corporate malfeasance
could make lawmakers
wary and incline them to
impose barriers to
international commerce.
Americans tend to value
decentralized
government.
There may be more
demand for centralized
federal control of
business practices.
American support for
decentralized
government will
promote laissez-faire
trade while accelerating
trends toward
globalization.
Free trade is compatible
with decentralized
government so freetrade advocates will
press for more
decentralization.
http://ghost.rider.edu/cii/presen/matrix.doc
24
Concerns with
Cross Impact Analysis
The definition of events to be included in the study
can be a tiring and tedious process but is a crucial
step in a cross-impact analysis.
Any influences not included in the event set, will be
completely excluded from the study. However, the
inclusion of events that are not pertinent can
complicate the analysis unnecessarily.
Limited use as only suitable for small sets of
variables and very time-consuming for experts.
Limited independent analysis of its utility.
Source: FOREN Guide
25
Simulation Modeling
Modelling : both computer simulations and role-playing.
Computer simulations tend to be complex, representing a
system in terms of a range of variables and their interrelationships.
Large, all purpose vs simple issue-focused models
Equilibrium vs dynamic process-based models
Modelling has been most developed around relatively
easily quantifiable issues, e.g. economic growth,
employment, energy use, and demographics.
In recent years important modelling efforts have been
undertaken in examining climate change and
environmental impacts.
Modelling social, political and cultural change is much
more contentious.
Source: FOREN Guide
26
Concerns with Modeling
Who validates the data and relationships assumed?
dependent experts able to assess the quality of the
modelling effort?
Can key assumptions be debated, even by non-experts?
Is the model over complex?
Can it be made less costly to run, in terms of computer and
labour resources?
Is the model able to cope with structural or qualitative
changes on the horizon? Does it address future
developments within its framework?
Are the results dictated by the assumptions made?
Does the model assume that an equilibrium state is to be
reached? If so, is this remotely realistic ?
Source: FOREN Guide
27
Qualitative Methods
Delphi
Expert panels
Brainstorming
Mindmapping
Scenario analysis and building
SWOT
Critical technologies
Relevance trees
28
Delphi
Delphi technique is a method used to reach
consensus in groups. Its advantage is that it
avoids group situations which are often prone to
control by individuals that have the best group
interaction and persuasion skills.
This method overcomes problems of face-toface confrontation in the group, by keeping the
responses and respondents anonymous.
Delphi method produces a rapid narrowing of
opinions and provides more accurate forecasts
than group discussions.
29
The Delphi Project
The Delphi Method Produces a Consensus-Based Response
Among the first group processes, developed by
RAND researchers in 50s to amalgamate expertise
from a wide range of knowledge areas and divergent
views to achieve eventual consensus.
Delphi process is iterative - in successive rounds, a
group of experts is asked to supply responses to a
list of questions. At the conclusion of every round,
the participants view each other’s answers and may
then change their views in light of what others
believe. The answers are presented anonymously to
eliminate the possibility that undue weight will be
placed on the responses of persons who hold
particularly high status within the group.
http://www.rand.org/publications/MR/MR1626/MR1626.ch2.pdf
30
Chronology of delphi activity
Source: http://www.unido.org/file-storage/download/?file_id=16959
31
The Delphi Process
32
Organising a Delphi
Deciding if it is appropriate method
Defining the objectives (a process that may require use of other
methods like creativity procedures or scenarios or future
workshops)
Setting up of expert panels (virtual?)
Shift to use of On-line delphi, e.g. Euforia and Fistera projects
Formulating the statements
Structuring the fields and defining the topics (mix of desk-based
research and creativity methods, brain-storming)
Setting of criteria: estimated time of realisation (normal time
horizon of delphi 30 years), level of expertise, which country is
leader in this field, which policy measures should be taken? Also
open questions.
In designing the questionnaire, need to consider how to give
feedback to experts in second round and also final presentation of
data to clients.
Constraints: complex logistics, time and resource intensive
Source: FOREN Guide
33
Delphi Results:
Measures and topic clusters
Source: Kuhls, 2001
34
Concerns about Delphi
Dependency on opinion of selected experts
Level of expertise difficult to assess
Poor execution leads to poor results
Results may be manipulated to produce desired
results in the second round
Good for single issues but poor on considering
issues within a holistic context (this is where
cross-impact analysis is important) – less useful
on complex forecasts based on multiple factors
Framing of statements subject to cultural and
social bias
Source: FOREN Guide
35
Brainstorming
Step1 : a period of freethinking for articulation of ideas.
Step 2: collation of ideas and spin-off ideas. Not
normally subject to critique or further analysis
once a sufficient number generated. This
reduces inhibitions to consider “wild” ideas.
Step 3: ideas are grouped and prioritised and taken as
the basis for more analytic discussion.
Widely used technique for expert committees and
consultation management groups. Several computer
systems are now available as alternatives to the
traditional use of whiteboards and flipcharts to
record and display the ideas.
Source: FOREN Guide
36
Mindmapping
• Technique applied to brainstorming and other
group discussion methods – useful for mapping
relationships between a large number of factors
• quick charting of group’s ideas in logical
groupings, even when ideas emerge nonsequentially
• allows efficient brainstorming for ideas, and at
the same time create a skeletal framework for
later categorisation of the information
generated.
• Mindmapping can be used in planning,
identifying customer groups. Mindmapping
works well when issues have many components
and subcomponents. This technique is a nonSource:
FOREN
linear
wayGuide
of outlining information.
37
Scenarios
A scenario is 'the description of a possible future and
the corresponding path to it' (Godet)
Godet presents 5 basic attitudes to the future:
1. the “passive” ostrich (go with the flow)
2. the “reactive” firefighter (damage reduction)
3. the “preactive” insurer(accident prevention)
4. the “proactive” innovative conspirator
(innovators)
5. the “anticipative” actor (blend of 2,3 &4)
Theser scenarios are normative, describing preferred
alternatives.
Shift from trend-based scenarios to scenarios
depicting deep breaks or even breakdown in current
38
trends
Scenarios
Exploratory (outward)
Moving from present to the future
What next? What if?
Normative (inward)
Moving from future back to the present
Where to? How to?
39
Building scenarios
40
Concerns in Scenario Analysis





Superior to many other methods where number of
factors to be considered and the degree of
uncertainty are high
Stimulates strategic thinking, communication and
organisational agility
Difficult to draw up credible and useful scenarios
Users might find it difficult to deal with multiple
images of plausible futures
May be mistaken for forecasts
41
SWOT
Strengths, Weaknesses, Opportunities, Threats
Used in Scenario workshops and Delphi
Focus on the current situation
Prepared by an expert team based on evidence
drawn from interviews, statistical or benchmarking
Assessment can be presented in 2x2 matrix
Strengths
Weaknesses
Opportunities
Threats
Main internal and external factors influencing strategies (or
possible futures)in positive or negative ways.

S: internal positive factors O: external positive factors

W: internal negative factors T: external negative factors
http://www.quickmba.com/strategy/swot/
42
Critical Technologies
What are critical technologies?
Related to national self-sufficiency
generic and pre-competitive
High potential of various product applications.
How to identify list of critical technologies?
Apply criteria to measure importance of certain technologies –
clarity and consistency!!
Interviews, benchmarking, brainstorming, panels,
bibliometrics
Indicate points of policy intervention
Setting the Criteria:
Be clear on what constitutes ‘critical”
capabilities vs needs, technology push vs supply or needs
driven.
Adapted from Foren Guide
43
‘Importance’
Set of criteria used to assess importance & feasibility. Each criteria to
be assigned a mark from the scale 1-5 (1 = low; 5 = extremely high)
Economic
Importance
Social Importance
Environmental
Importance
Importance for GDP
Importance for human
health
Impact on material
effectiveness
Importance for Export
Importance for the
safety of society
Impact on energy
effectiveness
Impact on productivity
Impact/influence on
the quality of life
Environmental-friendly
effect
Market size
Influence on the
creation of job opport.
Potential of replacing
non-renewable energy
by renewable ones
Strategic importance
for CR internationally
Natural and productive
space saving effect
Effect on transport
requirements
44
‘Importance’
Research & technological opportunities
Ability of the R direction to produce new technologies
Probability of ‘breakthrough discoveries’
Probability of creation of new application possibilities related to
the R direction
Possibility of combining the R direction with other R directions
Possibility of applying the results of the R direction in various
applications
Probability of a synergic effect with other research directions
Probability of involvement in international
Importance for meeting untackled needs of the society
45
‘Feasibility’
Application potential
(absorption potential of the
application sector)
Research and technology
potential (production potential
of R&D)
Competitiveness of the application Current state of the art of the
sector (s)
research field
Support in admin/state policy and
regulation
Probability of a positive
development of the research field
Availability of results in the world
market
Level of necessary R &
infrastructure
Demand of the application sector
Financial reqmnts of the research
direction
Probability of financing from various
sources
Level of education in related fields
Current quality of human resources
Czech foresight https://www.unido.org/file-storage/download/?file_id=16961
46
Influence on the creation and
growth potential of SMEs
Relevance Trees and
Morphological Analysis
• Best-known normative forecasting methods
• Used to identify the circumstances, capabilities,
actions and knowledge to achieve future objectives
• Relevance trees sub-divide topic into sub-topics in a
tree-like structure, to map various aspects of a
system, a problem or solutions.
• Morphological Analysis maps all possible solutions
to a problem to determine alternative futures, e.g.
product development or building scenarios.
• These approaches are time-consuming as they
require in-depth analysis and multi-disciplinary
expertise.
Adapted from Miles 2002
47
Horizon Scanning
Horizon scanning is defined as the systematic
examination of potential threats, opportunities and likely
future developments, including (but not restricted to)
those at the margins of current thinking and planning.
Horizon scanning may explore novel and unexpected
issues as well as persistent problems or trends.
UK Chief Scientific Adviser’s Committee, September 2004
[…] excellent horizon-scanning of current science and
technology, looking at opportunities and threats at least
five to ten years ahead, and often considerably beyond
that, is essential to the effective governance and
direction of Government policy, publicly funded research
and many of the activities of the private sector, and to the
interactions between them
UK Science & innovation investment framework 20042014
48
Environmental scanning
Environment refers not just to natural environment –
business, political, technology.
Approaches for identifying important future
developments in the environment of organisations:
Why: trend-spotting: in fashion, tastes, key players
How: issue surveys based on polling experts.
 “genius forecasting” experts write about topics
that they believe will be important for the future.
 systematic analysis of documentary sources, e.g.
press coverage or web searches means to chart
emergence of key themes.
 bibliometrics and patent analysis
Concern: Lock-in to particular sources/methods
http://horizon.unc.edu/projects/seminars/futuresresearch/stages.asp
http://www.tukkk.fi/tutu/vanhat/scanning2003/papers/jkaivooja.pdf
49
Criteria for selecting methods
Organisational context
Nature of issue(s) under consideration
Quantitative/Qualitative data requirements
Time horizon
Methodological competence
Process/Product balance
Suitability for combining with other methods
Suitability for visualising the results
Source: Scapolo (EFA) 2003
50
For discussion
The ethics of forecasting and foresight
depends on the choice and combination of
methods used.
The balance between predicted futures
and created futures is a reflection of sociocultural context and local competencies in
use of futures methods.
51
Topics for Individual assignments
Assignments are to be handed in by end of January.
Topics that can be addressed apart from set questions at
the end of lecture:
Evaluation or impact assessment of a major foresight
activity
Effective engagement /outreach to policy-makers and
society
Emerging themes in foresight like ethical issues,
systemic and/or adaptive foresight, Higher Education or
university foresight, regional foresight,
Emerging tools: disruption scenarios, success scenarios,
on-line approaches and horizon scanning.
52
References
FOREN GUIDE http://forera.jrc.es/documents/eur20128en.pdf
Hans Georg Graf
http://www.unido.org/file-storage/download/?file_id=16949
http://forera.jrc.es/fta/intro.html
http://www.efmn.info
http://cordis.europa.eu/foresight/home.htm
http://www.eranet-forsociety.net/ForSociety
http://www.costa22.org/
http://forlearn.jrc.es/index.htm
http://www.unido.org/doc/12296
http://www.futurreg.net/
53
Download