Subgame perfect equilibrium
Subgame Perfect Equilibrium | |
---|---|
A Extensive form games | |
Example | Ultimatum game |
In
A common method for determining subgame perfect equilibria in the case of a finite game is
A subgame perfect equilibrium necessarily satisfies the one-shot deviation principle.
The set of subgame perfect equilibria for a given game is always a subset of the set of Nash equilibria for that game. In some cases the sets can be identical.
The ultimatum game provides an intuitive example of a game with fewer subgame perfect equilibria than Nash equilibria.
Example
Determining the subgame perfect equilibrium by using backward induction is shown below in Figure 1. Strategies for Player 1 are given by {Up, Uq, Dp, Dq}, whereas Player 2 has the strategies among {TL, TR, BL, BR}. There are 4 subgames in this example, with 3 proper subgames.
![](http://upload.wikimedia.org/wikipedia/commons/d/de/Backwards_Induction_Example_2.png)
Using the backward induction, the players will take the following actions for each subgame:
- Subgame for actions p and q: Player 1 will take action p with payoff (3, 3) to maximize Player 1's payoff, so the payoff for action L becomes (3,3).
- Subgame for actions L and R: Player 2 will take action L for 3 > 2, so the payoff for action D becomes (3, 3).
- Subgame for actions T and B: Player 2 will take action T to maximize Player 2's payoff, so the payoff for action U becomes (1, 4).
- Subgame for actions U and D: Player 1 will take action D to maximize Player 1's payoff.
Thus, the subgame perfect equilibrium is {Dp, TL} with the payoff (3, 3).
An extensive-form game with incomplete information is presented below in Figure 2. Note that the node for Player 1 with actions A and B, and all succeeding actions is a subgame. Player 2's nodes are not a subgame as they are part of the same information set.
![](http://upload.wikimedia.org/wikipedia/commons/thumb/e/e7/A_Game_of_imperfect_information_with_subgames_shown..svg/641px-A_Game_of_imperfect_information_with_subgames_shown..svg.png)
The first normal-form game is the normal form representation of the whole extensive-form game. Based on the provided information, (UA, X), (DA, Y), and (DB, Y) are all Nash equilibria for the entire game.
The second normal-form game is the normal form representation of the subgame starting from Player 1's second node with actions A and B. For the second normal-form game, the Nash equilibrium of the subgame is (A, X).
For the entire game Nash equilibria (DA, Y) and (DB, Y) are not subgame perfect equilibria because the move of Player 2 does not constitute a Nash equilibrium. The Nash equilibrium (UA, X) is subgame perfect because it incorporates the subgame Nash equilibrium (A, X) as part of its strategy.[3]
To solve this game, first find the Nash Equilibria by mutual best response of Subgame 1. Then use backwards induction and plug in (A,X) → (3,4) so that (3,4) become the payoffs for Subgame 2.[3]
The dashed line indicates that player 2 does not know whether player 1 will play A or B in a simultaneous game.
![](http://upload.wikimedia.org/wikipedia/commons/thumb/c/ca/Subgame_1_solved.svg/544px-Subgame_1_solved.svg.png)
Player 1 chooses U rather than D because 3 > 2 for Player 1's payoff. The resulting equilibrium is (A, X) → (3,4).
![](http://upload.wikimedia.org/wikipedia/commons/thumb/8/89/Subgame-Perfect-Solution.svg/740px-Subgame-Perfect-Solution.svg.png)
Thus, the subgame perfect equilibrium through backwards induction is (UA, X) with the payoff (3, 4).
Repeated games
For finitely repeated games, if a stage game has only one unique Nash equilibrium, the subgame perfect equilibrium is to play without considering past actions, treating the current subgame as a one-shot game. An example of this is a finitely repeated Prisoner's dilemma game. The Prisoner's dilemma gets its name from a situation that contains two guilty culprits. When they are interrogated, they have the option to stay quiet or defect. If both culprits stay quiet, they both serve a short sentence. If both defect, they both serve a moderate sentence. If they choose opposite options, then the culprit that defects is free and the culprit who stays quiet serves a long sentence. Ultimately, using backward induction, the last subgame in a finitely repeated Prisoner's dilemma requires players to play the unique Nash equilibrium (both players defecting). Because of this, all games prior to the last subgame will also play the Nash equilibrium to maximize their single-period payoffs.[4] If a stage-game in a finitely repeated game has multiple Nash equilibria, subgame perfect equilibria can be constructed to play non-stage-game Nash equilibrium actions, through a "carrot and stick" structure. One player can use the one stage-game Nash equilibrium to incentivize playing the non-Nash equilibrium action, while using a stage-game Nash equilibrium with lower payoff to the other player if they choose to defect.[5]
Finding subgame-perfect equilibria
![](http://upload.wikimedia.org/wikipedia/commons/thumb/3/32/Tic_tac_toe.svg/220px-Tic_tac_toe.svg.png)
The subgame-perfect Nash equilibrium is normally deduced by "
The interesting aspect of the word "credible" in the preceding paragraph is that taken as a whole (disregarding the irreversibility of reaching sub-games) strategies exist which are superior to subgame perfect strategies, but which are not credible in the sense that a threat to carry them out will harm the player making the threat and prevent that combination of strategies. For instance in the game of "chicken" if one player has the option of ripping the steering wheel from their car they should always take it because it leads to a "sub game" in which their rational opponent is precluded from doing the same thing (and killing them both). The wheel-ripper will always win the game (making his opponent swerve away), and the opponent's threat to suicidally follow suit is not credible.
See also
- Centipede game
- Dynamic inconsistency
- Glossary of game theory
- Minimax theorem
- Retrograde analysis
- Solution concept
- Bellman's principle of optimality
References
- ^ a b Osborne, M. J. (2004). An Introduction to Game Theory. Oxford University Press.
- ISBN 978-1-4008-8197-0.
- ^ )
- ^ Yildiz, Muhamet (2012). "12 Repeated Games". 14.12 Economic Applications of Game Theory. Massachusetts Institute of Technology: MIT OpenCourseWare. Retrieved April 27, 2021.
- )
External links
- Selten, R. (1965). Spieltheoretische behandlung eines oligopolmodells mit nachfrageträgheit. Zeitschrift für die gesamte Staatswissenschaft/Journal of Institutional and Theoretical Economics, (H. 2), 301-324, 667-689. [in German - part 1, part 2]
- Example of Extensive Form Games with imperfect information
- Java applet to find a subgame perfect Nash Equilibrium solution for an extensive form game from gametheory.net.
- Java applet to find a subgame perfect Nash Equilibrium solution for an extensive form game from gametheory.net.
- Kaminski, M.M. Generalized Backward Induction: Justification for a Folk Algorithm. Games 2019, 10, 34.