In this paper we prove a deterministic approximation theorem for a sequence of Markov decision processeswith finitely many actions and general state spaces as they appear frequently in economics, game theory and operations research. Using viscosity solution methods no a-priori differentiabililty...

This note contains complementary information to the paper Staudigl and Steg (2014). We present a martingale characterization of continuation payoff processes in a class of repeated games with imperfect public monitoring. Our martingale approach allows us to work out a clear connection between...