Mertens and Parthasarathy (1987) proved the existence of sub-game perfect equilibria in discounted stochastic games.  Their method involved new techniques in dynamic programming, which were presented in a very general framework, with no expense spared in highlighting versatility and scope. ...

A long-standing open question raised in the seminal paper of Kalai and Lehrer (1993) is whether or not the play of a repeated game, in the rational learning model introduced there, must eventually resemble play of exact equilibria, and not just play of approximate equilibria as demonstrated...

Two-player zero-sum stochastic games with finite state and action spaces are known to have undiscounted values. We study such games under the assumption that one or both players observe the actions of their opponent after some time-dependent delay. We develop criteria for the rate of growth of...

We study nonzero-sum continuous-time stochastic games, also known as continuous-time Markov games, of fixed duration. We concentrate on Markovian strategies. We show by way of example that equilibria need not exist in Markovian strategies, but they always exist in Markovian public-signal...

Levy (2013) presents examples of discounted stochastic games that do not have stationary equilibria. The second named author has pointed out that one of these examples is incorrect. In addition to describing the details of this error, this note presents a new example by the first named author...