On Canonical Forms for Zero‐Sum Stochastic Mean Payoff Games

On Canonical Forms for Zero‐Sum Stochastic Mean Payoff Games

0.00 Avg rating0 Votes
Article ID: iaor20134331
Volume: 3
Issue: 2
Start Page Number: 128
End Page Number: 161
Publication Date: Jun 2013
Journal: Dynamic Games and Applications
Authors: , , ,
Keywords: zero sum game, stochastic games
Abstract:

We consider two‐person zero‐sum mean payoff undiscounted stochastic games and obtain sufficient conditions for the existence of a saddle point in uniformly optimal stationary strategies. Namely, these conditions enable us to bring the game, by applying potential transformations, to a canonical form in which locally optimal strategies are globally optimal, and hence the value for every initial position and the optimal strategies of both players can be obtained by playing the local game at each state. We show that these conditions hold for the class of additive transition (AT) games, that is, the special case when the transitions at each state can be decomposed into two parts, each controlled completely by one of the two players. An important special case of AT‐games form the so‐called BWR‐games which are played by two players on a directed graph with positions of three types: Black, White and Random. We give an independent proof for the existence of a canonical form in such games, and use this result to derive the existence of a canonical form (and hence, of a saddle point in uniformly optimal stationary strategies) in a wide class of games, which includes stochastic games with perfect information (PI), switching controller (SC) games and additive rewards, additive transition (ARAT) games. Unlike the proof for AT‐games, our proof for the BWR‐case does not rely on the existence of a saddle point in stationary strategies. We also derive some algorithmic consequences from these our reductions to BWR‐games, in terms of solving PI‐, and ARAT‐games in sub‐exponential time.

Reviews

Required fields are marked *. Your email address will not be published.