Presentation - The Teamcore Research Group

advertisement
Modeling Crowds:
Psycho-history Reinvented
(or: crowd modeling and contagion)
Gal A. Kaminka
The MAVERICK Group
Computer Science Department
and Brain Research Center
Bar Ilan University, Israel
September 2012
Gal Kaminka galk@cs.biu.ac.il
Psycho-history
(in Isaac Asimov's Foundation Series)
“The branch of mathematics which deals with the reactions
of human conglomerates to fixed social and economic
stimuli.”
– Gaal Dornick, “Foundation” by Isaac Asimov
September 2012
Gal Kaminka galk@cs.biu.ac.il
Making decisions (that affect crowds)


Making decisions involves weighing uncertain outcomes
To reduce uncertainty: want predictions, and more
Types of Queries:

“What if” (predictions)

Analyze (determine actionable factors influencing the outcomes)

Plan (propose action plans to affect outcomes)
• State of the art: surveys, fact-finding missions, experts, …
• Limited automation

Social simulation: Automation
September 2012
Gal Kaminka galk@cs.biu.ac.il
Social Simulation Approaches
Collectives/Macro
Individuals/Micro
(e.g., global dynamics)
(e.g., multi-agent based simulation)
September 2012
Gal Kaminka galk@cs.biu.ac.il
Social Simulation Approaches
Collectives/Macro
Individuals/Micro
(e.g., global dynamics)
(e.g., multi-agent based simulation)
Qualitatively model rallies:
• Predict violence
• Determine actionable factors
Pedestrians, evacuations:
• Contagion
• Culture effects
[Fridman and Kaminka, SBP 2011, AMPLE
2011, QR 2011, TIST 2012]
[Fridman et al. AAAI 2007, AAMAS
2012, AAMAS 2011, CSR 2011,
CMOT 2010, ICCM 09, … ]
September 2012
Gal Kaminka galk@cs.biu.ac.il
Need Pedestrian, Evacuation Sims

Training simulations
–
–

“Urban noise” to fill virtual streets
Train to spot, track suspects within crowd
Urban planning, architecture

September 2012
Safety decision-support systems
Gal Kaminka galk@cs.biu.ac.il
The Goal:
Individual Agent with Social Capabilities
 Endow each agent with capability for social reasoning
 Creates crowd phenomenon when used by many
 Able to account for different crowd behaviors

Task independent
 Factors influencing action selection of agent

Goal-oriented selection (most agent literature)

Contagion (we do this via social comparison)

Culture

Emotions (e.g., Tsai, Tambe, Marsella et al.)
September 2012
Gal Kaminka galk@cs.biu.ac.il
Social Comparison Theory (SCT)
(Festinger 1954)

SCT: Theory in social psychology, actively researched



Originally given as a set of axioms (Festinger 1954)
Still active research topic in psychology
Key: If lacking objective means to evaluate their progress:



People compare their behavior with those that are similar
They take actions to reduce differences with others
Tendency to reduce difference increases with similarity
Hypothesis:
Social comparison is the underlying mechanism of contagion
8
Gal Kaminka galk@cs.biu.ac.il
SCT (Comparing agent Ame, agent set O,
Similarity limits Smin, Smax)
Lines 1-4: Select agents not too dissimilar or too similar
Line 5: Select a representative agent Ac to compare against
Line 6: Determine differences with Ac
Line 7: Determine power of attraction to Ac
Line 8: Select an action to minimize differences
9
Gal Kaminka galk@cs.biu.ac.il
Experiments: Comparison to Human Behavior
Qualitative comparison:
 Movies of human pedestrians in Paris, Vancouver
 Movies of simulated pedestrians


10
Different variants of SCT, also non-contagion model
Asked 39 subjects to rate each model:

How close to human (this measures absolute fidelity)

Whether it was best or worst of all models (relative fidelity)

Ordinal Scale: 1 (least similar) … 6 (most similar)
Gal Kaminka galk@cs.biu.ac.il
11
Gal Kaminka galk@cs.biu.ac.il
Experiment Design

Compared models from literature:
Individual choice: Each agent makes decision independently
 SCT with wide (2-6.5) and narrow (5-6.5), both with gain
 SCT with no gain, constant gains (2, 3, 4, 5)
 Pilot experiment threw out some of these models



Subjects: 39 subjects (male 28)
Movies were randomly selected
From several clips of horizontal (Vancouver), vertical (Paris)
 From several clips of each of the simulation movies
 Compare horizontal to horizontal, vertical to vertical

12
Gal Kaminka galk@cs.biu.ac.il
6
5
4
3
2
1
0
Mean
Median
In
di
vi
du
al
SC
T
26.
5
SC
T
5SC
6.
5
T
no
ga
SC
in
T
ga
SC
in
3
T
ga
in
4.
5
Grade
Results: Absolute Fidelity
Higher results: Greater similarity to human pedestrian behavior
SCT2-6.5 significantly different than Individual and SCT 5-6.5 (two tailed t-test)
SCT 5-6.5 significantly different than Individual (two tailed t-test)
13
Gal Kaminka galk@cs.biu.ac.il
Results: Relative Fidelity
Higher is better
Lower is better
14
Gal Kaminka galk@cs.biu.ac.il
Adding Culture
A Variety of documented cultural phenomena:
• Passing side
• Movement in groups, vs. independently
• Family formations
• Leisurely walking speed
• Personal space (proxemics)
• Tendency to communicate information
• Upward/downward comparison tendencies
• …
A very small subset of culture results
• Use webcam data, tourist videos from various locations
•
England, France, Israel, Iraq, Canada
• Measured mean parameters based on data
• Were able to show good fidelity of simulation
•
Also, simulated mixed-culture crowds
September 2012
Gal Kaminka galk@cs.biu.ac.il
Modeling macro phenomena
View of psycho-history:
“Implicit […] is the assumption that the human conglomerate
[…] is sufficiently large for valid statistical treatment.”
– Gaal Dornick, “Foundation” by Isaac Asimov
September 2012
Gal Kaminka galk@cs.biu.ac.il
Modeling Demonstrations, Rallies, …
Goals:
• Predict violence level (none, property damage, casualties)
• Assist police decision making process
Constraints
• Expert knowledge not accurate nor complete
• Mostly partial macro-level qualitative descriptions
• Simulation is of large groups
Proposal:
Use QR (qualitative reasoning) modeling
September 2012
Gal Kaminka galk@cs.biu.ac.il
Qualitative Reasoning (QR)
[Kuipers AIJ 84, 86, Forbus AIJ 84]
• Ordinal variables: qualitative values rather than real numbers
• Monotonic functions (increasing/decreasing, derivatives)
• Algorithms simulate how variables affect each other
• With partial and imprecise information
•
Draw useful qualitative conclusions
• Physics, economics, …
September 2012
Gal Kaminka galk@cs.biu.ac.il
Base Model
Fear of
Punishment
Willing
Personal Price
-
Hostility for
the police
+
+
Group
Cohesiveness
+
History of
Violence
+
Violence
September 2012
Gal Kaminka galk@cs.biu.ac.il
Qualitative Simulation
Develops all possible behaviors from initial conditions
Input: Initial state of the world
• Contains a structural description of the model
Output: State transition graph
• Captures the set of all possible behaviors
• developed from initial state
September 2012
Gal Kaminka galk@cs.biu.ac.il
What are the influencing factors on violence level?
•
Several theories regarding influencing factors
• Each theory: focuses on a sub-set of factors
• Challenge: combine all of them to one model
•
To address this challenge:
• Israeli police initiated a comprehensive study, based on:
• database of 102 demonstrations
• interviews with 87 officers
• Result: report which provides collection of factors and their influences
We use this report as source of knowledge
To develop QR models which enable reasoning
September 2012
Gal Kaminka galk@cs.biu.ac.il
Comparison of following models:
•
Base model: Based on literature review provided to us
•
•
By Israeli Police
Israeli Police model
• Extension of the Base model
• Based on the review conclusions
•
Bar Ilan model
• Extension of the Israeli Police model
• Based on consultations with social and cognitive scientists
September 2012
Gal Kaminka galk@cs.biu.ac.il
Base Model
Population
Fear of
Punishment
Willing
Personal Price
Hostility for
the police
Group
Cohesiveness
History of
Violence
Population
Violence
September 2012
Gal Kaminka galk@cs.biu.ac.il
Israeli Police Model
Population
Group
Cohesiveness
Number
Participants
License
United identity
Personal
Price
Hostility for
the police
Punishment
History of
Violence
Group
Speaker
Violent core
Demonstrat
ion purpose
Population
Violence
Police
Time
intervention
Environment
Intervention
strength
September 2012
Weather
Time
Time
sensitivity
Place
sensitivity
Gal Kaminka galk@cs.biu.ac.il
Bar Ilan Model
Population
Personal
Price
License
Group
Speaker
Number
Participants
Order
Hostility for
the police
History of
Violence
United
identity
Group
Cohesiveness
Visual
cohesiveness
Punishment
Anonymity
Violent core
Demonstrat
ion purpose
Population
Violence
Police
Time
intervention
Environment
Intervention
strength
September 2012
Weather
Time
Light
Place
sensitivity
Time
sensitivity
Gal Kaminka galk@cs.biu.ac.il
Query 1: Predictions
Compared the models on 24 real-life events
• 20 demonstrations in Israel (wikipedia, in Hebrew)
• 3 reported riots, with expert analysis:
• Violence in Heysel stadium (1985, reported in Lewis 1989)
• Los Angeles riots (1992, reported in Useem 1997)
• London riot (1990, reported in Stott and Drury 2000)
•
Calm protest
• Petach Tikva (Israel) protest (2009, video taped by us)
September 2012
Gal Kaminka galk@cs.biu.ac.il
Typical Qualitative Simulation Graphs
Base model
Police model
Likelihood of each outcome:
BIU model
(#behavior paths to specific outcome)
(total #paths
September 2012
Gal Kaminka galk@cs.biu.ac.il
Subset of results: prediction accuracy
The results show:
1. Police model provides poor results in prediction of Exp4
2. Base model and BIU model provide good results in all examined cases
September 2012
Gal Kaminka galk@cs.biu.ac.il
Results
• Level 1 errors: Off by one level
• Level 2 errors: Off by two levels
September 2012
Gal Kaminka galk@cs.biu.ac.il
Experiment 2: Sensitivity Analysis
Expert analysis of reported cases:
• Police used too much (case 1,2), or
• too little (case 3) force.
Overall, BIU model changes classification when police strength is changed
September 2012
Gal Kaminka galk@cs.biu.ac.il
Sensitivity Analysis (more results)
Changed “police strength” variable in all 24 cases:
• Police model: distribution change in 3 cases, outcome change in 2
• BIU model: distribution change in 24 cases, outcome change in 7
Compared to decision-tree learning:
• Use Weka J48 (C4.5) for learning
• Variables as attributes, so learning DTs for Police model, for BIU model
• Use all 24 cases for learning (specialization is a conservative assumption)
• 100% accurate on original cases
• Outcome change in 3 cases (no distribution)
September 2012
Gal Kaminka galk@cs.biu.ac.il
Analysis query: What affects outcome?
• Only subset of variables are actionable
•
•
Cannot change weather
Can change police strength used
• Want to know what actionable variables affect outcome
•
And when, under what set of conditions
Algorithm analyzes simulation graph:
• Find nodes with high entropy over outcomes
•
i.e., nodes in which outcome is uncertain yet
• Contrast variables in node and in children
• Determine variable changes that shift outcome
September 2012
Gal Kaminka galk@cs.biu.ac.il
Analysis query: Results
• Partial agreement between algorithm and experts
• Algorithm does not contradict the experts
•
•
Algorithm specifies settings in which actions should be taken
Experts accounted for general conditions
September 2012
Gal Kaminka galk@cs.biu.ac.il
Conclusions
• There are different queries, that build on each other
•
•
•
Prediction:
Analysis:
Plan:
agent-based simulation, qualitative modeling
qualitative modeling
?
• Key obstacles to progress:
•
•
•
No (open) repository of data
Need for interdisciplinarity
No institutionalized, or funder-guided technology transfer
process
September 2012
Gal Kaminka galk@cs.biu.ac.il
Download