This book presents recent findings and results concerning the solutions of especially finite state-space Markov decision problems and determining Nash equilibria for related stochastic games with average and total expected discounted reward payoffs. In addition, it focuses on a new class of...

We show that the equivalence between certain problems of singular stochastic control (SSC) and related questions of optimal stopping known for convex performance criteria (see, for example, Karatzas and Shreve (1984)) continues to hold in a non convex problem provided a related discretionary...

In this paper we provide a complete theoretical analysis of a two-dimensional degenerate non convex singular stochastic control problem. The optimisation is motivated by a storage-consumption model in an electricity market, and features a stochastic real-valued spot price modelled by Brownian...

This paper studies an optimal irreversible extraction problem of an exhaustible commodity in presence of regime shifts. A company extracts a natural resource from a reserve with finite capacity, and sells it in the market at a spot price that evolves according to a Brownian motion with...

We study a continuous-time problem of optimal public good contribution under uncertainty for an economy with a finite number of agents. Each agent can allocate his wealth between private consumption and repeated but irreversible contributions to increase the stock of some public good. We study...

We consider a class of non-cooperative N-player non-zero-sum stochastic differential games with singular controls, in which each player can affect a linear stochastic differential equation in order to minimize a cost functional which is quadratic in the state and linear in the control. We call...