Every n-person stochastic game with a countable state space, finite action sets for the players and bounded, upper semi-continuous payoffs has an ϵ-equilibrium for every ϵ > 0.
