In this paper we prove a deterministic approximation theorem for a sequence of Markov decision processeswith finitely many actions and general state spaces as they appear frequently in economics, game theory and operations research. Using viscosity solution methods no a-priori differentiabililty...

This note contains complementary information to the paper Staudigl and Steg (2014). We present a martingale characterization of continuation payoff processes in a class of repeated games with imperfect public monitoring. Our martingale approach allows us to work out a clear connection between...

We study a continuous-time problem of optimal public good contribution under uncertainty for an economy with a finite number of agents. Each agent can allocate his wealth between private consumption and repeated but irreversible contributions to increase the stock of some public good. We study...

We describe the large deviations properties, stationary distribution asymptotics, and stochastically stable states of stochastic evolutionary processes based on the logit choice rule, focusing on behavior in the small noise double limit. These aspects of the stochastic evolutionary process can...

We consider a model of stochastic evolution under general noisy best response protocols, allowing the probabilities of suboptimal choices to depend on their payoff consequences. Our analysis focuses on behavior in the small noise double limit: we first take the noise level in agents’ decisions...