Slide Deck 2 - Game Theory Lab, CSA

advertisement
Game Theory
Quick Intro to Game Theory
Analysis of Games
Design of Games (Mechanism Design)
Some References
1
John von Neumann
The Genius who created two intellectual currents in the 1930s, 1940s
Founded Game Theory
with Oskar Morgenstern
(1928-44)
Pioneered the Concept of
a Digital Computer and
Algorithms (1930s)
2
Robert Aumann
Nobel 2005
Leonid Hurwicz
Nobel 2007
Recent Excitement :
Nobel Prizes for
Game Theory and
Mechanism Design
The Nobel Prize was awarded to
two Game Theorists in 2005
Thomas Schelling
Nobel 2005
Eric Maskin
Nobel 2007
The prize was awarded to three
mechanism designers in 2007
Roger Myerson
Nobel 2007
3
Game Theory
Mathematical framework for rigorous study of conflict
and cooperation among rational, intelligent agents
Market
Buying Agents
(rational and
intelligent)
Social Planner
Selling Agents
(rational and
intelligent)
In the Internet Era, Game Theory has become a
valuable tool for analysis and design
4
Applications of Game Theory
Microeconomics, Sociology, Evolutionary Biology
Auctions and Market Design: Spectrum Auctions,
Procurement Markets, Double Auctions
Industrial Engineering, Supply Chain Management,
E-Commerce, Procurement, Logistics
Computer Science: Algorithmic Game Theory,
Internet and Network Economics,
Protocol Design, Resource Allocation, etc.
5
A Familiar Game
Mumbai
Indians
1
Kolkata
Knight Riders
2
Bangalore
RoyalChallengers
3
Punjab Lions
Sachin Tendulkar
4
IPL Franchisees
IPL CRICKET AUCTION
Sponsored Search Auction
Advertisers
1
2
n
CPC
Major money spinner for all search engines and web portals
7
DARPA Red Balloon Contest
Mechanism Design Meets Computer Science, Communications of the ACM, August 2010
8
Procurement Auctions
SUPPLIER 1
SUPPLIER 2
Buyer
SUPPLIER n
Supply (cost) Curves
Budget Constraints, Lead Time Constraints, Learning by Suppliers,
Learning by Buyer, Logistics constraints, Combinatorial Auctions,
Cost Minimization, Multiple Attributes
KEY OBSERVATIONS
Players are rational,
Intelligent, strategic
Both conflict and
cooperation are “issues”
Some information is
“common knowledge”
Other information is
“private”, “incomplete”,
“distributed”
Our Goal: To implement a system wide solution
(social choice function) with desirable properties
Game theory is a natural choice for modeling
such problems
10
Strategic Form Games (Normal Form Games)
S1
Sn
N = {1,…,n}
Players
S1, … , Sn
Strategy Sets
S = S1 X … X Sn
11
U1 : S
R
Un : S
R
Payoff functions
(Utility functions)
Example 1: Coordination Game
B
RVCE
MG Road
RVCE
100,100
0,0
MG Road
0,0
10,10
A
Models the strategic conflict when two players
have to choose their priorities
12
Example 2: Prisoner’s Dilemma
No Confess
Confess
NC
C
No Confess
NC
- 2, - 2 - 10, - 1
Confess
C
13
-1, - 10 - 5, - 5
Pure Strategy Nash Equilibrium


A profile of strategies s1* , s 2* ,...,s n*
is said to be
a pure strategy Nash Equilibrium if si* is a best
response strategy against s*i i  1,2,...,n
A Nash equilibrium profile is robust to unilateral
deviations and captures a stable, self-enforcing
agreement among the players
14
Nash Equilibria in Coordination Game
B
College
Movie
College
100,100
0,0
Movie
0,0
10,10
A
Two pure strategy Nash equilibria: (College,College)
and (Movie, Movie);
one mixed strategy Nash equilibrium
15
Nash Equilibrium in Prisoner’s Dilemma
No Confess
Confess
NC
C
No Confess
NC
- 2, - 2 - 10, - 1
Confess
C
-1, - 10 - 5, - 5
(C,C) is a Nash equilibrium
16
Relevance/Implications of
Nash Equilibrium
17
Players are happy
the way they are;
Do not want to
deviate unilaterally
Stable, self-enforcing,
self-sustaining
agreement
Provides a principled
way of predicting a
steady-state outcome of
a dynamic
Adjustment process
Need not correspond
to a socially optimal or
Pareto optimal
solution
Example 3: Traffic Routing Game
C
45
x/100
B
A2
Destination
Source
x/100
45
D
N = {1,…,n}; S1 = S2 = … = Sn = {C,D}
Traffic Routing Game: Nash Equilibrium
C
45
x/100
B
A2
Destination
Source
x/100
45
D
Assume n = 4000
U1 (C,C, …, C) = - (40 + 45) = - 85
U1 (D,D, …, D) = - (45 + 40) = - 85
U1 (D,C, …, C) = - (45 + 0.01) = - 45.01
U1 (C, …,C;D, …,D) = - (20 + 45) = - 65
Any Strategy Profile
with 2000 C’s and
2000 D’s is a
Nash Equilibrium
Traffic Routing Game: Braess’ Paradox
C
45
x/100
B
0
A2
Destination
Source
x/100
45
D
Assume n = 4000
S1 = S2 = … = Sn = {C,CD, D}
U1 (CD,CD, …, CD) = - (40+0+40) = - 80
U1 (C,CD, …, CD) = - (40+45) = - 85
U1 (D,CD, …, CD) = - (45+40) = - 85
Strategy Profile
with 4000 CD’s is
the unique
Nash Equilibrium
Nash’s Beautiful Theorem
Every finite strategic form
game has at least one mixed
strategy Nash equilibrium;
Computing NE is one of the
grand challenge problems in CS
Game theory is all about analyzing
games through such solution concepts and
predicting the behaviour of the players
Non-cooperative game theory and cooperative
game theory are the major categories
21
MECHANISM DESIGN
Game Theory involves analysis of games –
computing NE, DSE, MSNE, etc and
analyzing equilibrium behaviour
Mechanism Design is the design of games or
reverse engineering of games; could be called
Game Engineering
Involves inducing a game among the players
such that in some equilibrium of the game,
a desired social choice function is implemented
22
Example 1: Mechanism Design
Fair Division of a Cake
Mother
Social Planner
Mechanism Designer
Kid 1
Rational and
Intelligent
Kid 2
Rational and
Intelligent
Example 2: Mechanism Design
Truth Elicitation through an Indirect Mechanism
Tenali Rama
(Birbal)
Mechanism Designer
Mother 1
Rational and
Intelligent Player
Baby
Mother 2
Rational and
Intelligent Player
Mechanism Design: Example 3
Vickrey Auction
1 1
40
2
45
3
60
4
80
Buyers
William Vickrey
(1914 – 1996 )
Nobel Prize: 1996
25
Winner = 4
Price = 60
Four Basic Types of Auctions
Dutch Auction
English Auction
1
1
0, 10, 20, 30,
40, 45, 50, 55,
58, 60, stop.
n
100, 90, 85,
75, 70, 65, 60,
stop.
Seller
Buyers
Auctioneer or seller
Buyers
Vickrey Auction
First Price Auction
1
40
2
50
3
55
4
60
Buyers
26
40
1
Winner = 4
Price = 60
n
2
45
3
60
4
80
Buyers
Winner = 4
Price = 60
Vickrey-Clarke-Groves (VCG)
Mechanisms
Vickrey
Clarke
Groves
Only mechanisms under a quasi-linear setting satisfying
Allocative Efficiency
Dominant Strategy Incentive Compatibility
27
Concluding Remarks
Game Theory and Mechanism Design have
numerous, high impact applications in the
Internet era
Game Theory, Machine Learning, Optimization,
and Statistics have emerged as the most
important mathematical tools for engineers
Algorithmic Game Theory is now one of the most
active areas of research in CS, ECE, Telecom, etc.
Mechanism Design is extensively being used in IEM
It is a wonderful idea to introduce
game theory and mechanism design at the
BE level for CS, IS, EC, IEM; to be done with care
28
REFERENCES
Martin Osborne. Introduction to Game Theory.
Oxford University Press, 2003
Roger Myerson. Game Theory and Analysis of
Conflict. Harvard University Press, 1997
A, Mas-Colell, M.D. Whinston, and J.R. Green.
Microeconomic Theory, Oxford University Press, 1995
N. Nisan, T. Roughgarden, E. Tardos, V. Vazirani
Algorithmic Game Theory, Cambridge Univ. Press, 2007
29
REFERENCES (contd.)
Y. Narahari,
Essentials of Game Theory and Mechanism Design
IISc Press, 2012 (forthcoming)
http://www.gametheory.net
A rich source of material on game theory and game
theory courses
http://lcm.csa.iisc.ernet.in/hari
Course material and
several survey articles can be downloaded
Y. Narahari, Dinesh Garg, Ramasuri, and Hastagiri
Game Theoretic Problems in Network Economics
and Mechanism Design Solutions, Springer, 2009
30
Cooperative Game with Transferable
Utilities
T  ( N , v)
N  {1,2,...,n} set of players
v : 2 N   characteristic function ; v( )  0
C  N is called a c o a litio.n
T hereare 2| N |  1 possible coalitions
Divide the Dollar Game
There are three players who have to share 300 dollars.
Each one proposes a particular allocation of dollars to
players.
N  {1,2,3}
S1  S 2  S3  {( x1 , x2 , x3 )  3 : x1  0; x2  0; x3  0;
x1  x2  x3  300}
Divide the Dollar : Version 1

The allocation is decided by what is proposed by player 0
ui ( s1 , s2 , s3 )  xi
0

if s1  ( x1 , x2 , x3 )
otherwise
Characteristic Function
v({1})  300
v({2})  v({3})  v({2,3})  0
v({1,2})  v({1,3})  v({1,2,3})  300
Divide the Dollar : Version 2

It is enough 1 and 2 propose the same allocation
ui ( s1 , s2 , s3 )  xi
0

if s1  s2  ( x1 , x2 , x3 )
otherwise
Players 1 and 2 are equally powerful; Characteristic Function is:
v({1})  v({2})  v({3})  0
v({1,2})  300
v({1,3})  v({2,3})  0
v({1,2,3})  300
Divide the Dollar : Version 3

Either 1 and 2 should propose the same allocation or 1 and 3
should propose the same allocation
ui ( s1 , s2 , s3 )  xi
0

if s1  s2  ( x1 , x2 , x3 ) or s1  s3  ( x1 , x2 , x3 )
otherwise
Characteristic Function
v({1})  v({2})  v({3})  v({2,3})  0
v({1,2})  v({1,3})  v({1,2,3})  300
Divide the Dollar : Version 4

It is enough any pair of players has the same proposal
ui ( s1 , s2 , s3 )  xi
if s1  s2  ( x1 , x2 , x3 )
or s1  s3  ( x1 , x2 , x3 )
or s2  s3  ( x1 , x2 , x3 )
0
otherwise

Also called the Majority Voting Game

Characteristic Function
v({1})  v({2})  v({3})  0
v({1,2})  v({1,3})  v({2,3})  v({1,2,3})  300
Shapley Value of a Cooperative Game
Captures how competitive forces
influence the outcomes of a game
Describes a reasonable and fair way
of dividing the gains from cooperation
given the strategic realities
Shapley value of a player finds its
average marginal contribution across
all permutation orderings
Lloyd Shapley
37
Unique solution concept that satisfies
symmetry, preservation of carrier,
additivity, and Pareto optimality
Shapley Value : A Fair Allocation Scheme

Provides a unique payoff allocation that describes a fair way
of dividing the gains of cooperation in a game (N, v)
(v)  ( 0 (v),..., n (v))
w here
 i (v ) 
| C |!(| N |  | C | 1)!
{v(C  {i})  v(C )}

| N |!
C  N i
Shapley Value: Examples
Version of Divide-the-Dollar
Shapley Value
Version 1
(300, 0, 0)
Version 2
(150, 150, 0)
Version 3
(200, 50, 50)
Version 4
(100, 100, 100)
Download