Max-dominated strategy

From HandWiki
Short description: Mathematical criterion in game theory

In game theory a max-dominated strategy is a strategy which is not a best response to any strategy profile of the other players. This is an extension to the notion of strictly dominated strategies, which are max-dominated as well.

Definition

Max-dominated strategies

A strategy [math]\displaystyle{ s_i\in S_i }[/math] of player [math]\displaystyle{ i }[/math] is max-dominated if for every strategy profile of the other players [math]\displaystyle{ s_{-i}\in S_{-i} }[/math] there is a strategy [math]\displaystyle{ s^\prime_i\in S_i }[/math] such that [math]\displaystyle{ u_i(s^\prime_i,s_{-i})\gt u_i(s_i,s_{-i}) }[/math]. This definition means that [math]\displaystyle{ s_i }[/math] is not a best response to any strategy profile [math]\displaystyle{ s_{-i} }[/math], since for every such strategy profile there is another strategy [math]\displaystyle{ s^\prime_i }[/math] which gives higher utility than [math]\displaystyle{ s_i }[/math] for player [math]\displaystyle{ i }[/math].

If a strategy [math]\displaystyle{ s_i\in S_i }[/math] is strictly dominated by strategy [math]\displaystyle{ s^\prime_i \in S_i }[/math] then it is also max-dominated, since for every strategy profile of the other players [math]\displaystyle{ s_{-i}\in S_{-i} }[/math], [math]\displaystyle{ s^\prime_i }[/math] is the strategy for which [math]\displaystyle{ u_i(s^\prime_i,s_{-i})\gt u_i(s_i,s_{-i}) }[/math].

Even if [math]\displaystyle{ s_i }[/math] is strictly dominated by a mixed strategy it is also max-dominated.

Weakly max-dominated strategies

A strategy [math]\displaystyle{ s_i\in S_i }[/math] of player [math]\displaystyle{ i }[/math] is weakly max-dominated if for every strategy profile of the other players [math]\displaystyle{ s_{-i}\in S_{-i} }[/math] there is a strategy [math]\displaystyle{ s^\prime_i\in S_i }[/math] such that [math]\displaystyle{ u_i(s^\prime_i,s_{-i}) \geq u_i(s_i,s_{-i}) }[/math]. This definition means that [math]\displaystyle{ s_i }[/math] is either not a best response or not the only best response to any strategy profile [math]\displaystyle{ s_{-i} }[/math], since for every such strategy profile there is another strategy [math]\displaystyle{ s^\prime_i }[/math] which gives at least the same utility as [math]\displaystyle{ s_i }[/math] for player [math]\displaystyle{ i }[/math].

If a strategy [math]\displaystyle{ s_i\in S_i }[/math] is weakly dominated by strategy [math]\displaystyle{ s^\prime_i \in S_i }[/math] then it is also weakly max-dominated, since for every strategy profile of the other players [math]\displaystyle{ s_{-i}\in S_{-i} }[/math], [math]\displaystyle{ s^\prime_i }[/math] is the strategy for which [math]\displaystyle{ u_i(s^\prime_i,s_{-i})\geq u_i(s_i,s_{-i}) }[/math].

Even if [math]\displaystyle{ s_i }[/math] is weakly dominated by a mixed strategy it is also weakly max-dominated.

Max-solvable games

Definition

A game [math]\displaystyle{ G }[/math] is said to be max-solvable if by iterated elimination of max-dominated strategies only one strategy profile is left at the end.

More formally we say that [math]\displaystyle{ G }[/math] is max-solvable if there exists a sequence of games [math]\displaystyle{ G_0, ..., G_r }[/math] such that:

  • [math]\displaystyle{ G_0 = G }[/math]
  • [math]\displaystyle{ G_{k+1} }[/math] is obtained by removing a single max-dominated strategy from the strategy space of a single player in [math]\displaystyle{ G_k }[/math].
  • There is only one strategy profile left in [math]\displaystyle{ G_r }[/math].

Obviously every max-solvable game has a unique pure Nash equilibrium which is the strategy profile left in [math]\displaystyle{ G_r }[/math].

As in the previous part one can define respectively the notion of weakly max-solvable games, which are games for which a game with a single strategy profile can be reached by eliminating weakly max-dominated strategies. The main difference would be that weakly max-dominated games may have more than one pure Nash equilibrium, and that the order of elimination might result in different Nash equilibria.

Example

Cooperate Defect
Cooperate -1, -1 -5, 0
Defect 0, -5 -3, -3
Fig. 1: payoff matrix of the prisoner's dilemma

The prisoner's dilemma is an example of a max-solvable game (as it is also dominance solvable). The strategy cooperate is max-dominated by the strategy defect for both players, since playing defect always gives the player a higher utility, no matter what the other player plays. To see this note that if the row player plays cooperate then the column player would prefer playing defect and go free than playing cooperate and serving one year in jail. If the row player plays defect then the column player would prefer playing defect and serve three years in jail rather than playing cooperate and serving five years in jail.

Max-solvable games and best-reply dynamics

In any max-solvable game, best-reply dynamics ultimately leads to the unique pure Nash equilibrium of the game. In order to see this, all we need to do is notice that if [math]\displaystyle{ s_1, s_2, s_3, ..., s_k }[/math] is an elimination sequence of the game (meaning that first [math]\displaystyle{ s_1 }[/math] is eliminated from the strategy space of some player since it is max-dominated, then [math]\displaystyle{ s_2 }[/math] is eliminated, and so on), then in the best-response dynamics [math]\displaystyle{ s_1 }[/math] will be never played by its player after one iteration of best responses, [math]\displaystyle{ s_2 }[/math] will never be played by its player after two iterations of best responses and so on. The reason for this is that [math]\displaystyle{ s_1 }[/math] is not a best response to any strategy profile of the other players [math]\displaystyle{ s_{-i} }[/math] so after one iteration of best responses its player must have chosen a different strategy. Since we understand that we will never return to [math]\displaystyle{ s_1 }[/math] in any iteration of the best responses, we can treat the game after one iteration of best responses as if [math]\displaystyle{ s_1 }[/math] has been eliminated from the game, and complete the proof by induction.

A weakly max-solvable game
1, 1 0, 0
1, 0 0, 1
0, 1 1, 0

It may come by surprise then that weakly max-solvable games do not necessarily converge to a pure Nash equilibrium when using the best-reply dynamics, as can be seen in the game on the right. If the game starts of the bottom left cell of the matrix, then the following best replay dynamics is possible: the row player moves one row up to the center row, the column player moves to the right column, the row player moves back to the bottom row, the column player moves back to the left column and so on. This obviously never converges to the unique pure Nash equilibrium of the game (which is the upper left cell in the payoff matrix).

See also

Dominance (game theory)

External links and references