This note concerns Markov decision chains with finite state and action sets. The decision maker is assumed to be risk-averse with constant risk sensitive coefficient λ, and the performance of a control policy is measured by the risk-sensitive average cost criterion. In their seminal paper...

This note concerns Markov decision chains with finite state and action sets. The decision maker is assumed to be risk-averse with constant risk sensitive coefficient λ, and the performance of a control policy is measured by the risk-sensitive average cost criterion. In their seminal paper...

This work concerns finte-state Markov decision chains endowed with the long-run average reward criterion. Assuming that the optimality equation has a solution, it is shown that a nearly optimal stationary policy, as well as an approximation to the optimal average reward within a specified error,...

This work concerns finte-state Markov decision chains endowed with the long-run average reward criterion. Assuming that the optimality equation has a solution, it is shown that a nearly optimal stationary policy, as well as an approximation to the optimal average reward within a specified error,...

SUMMARY We give an explicit PDE characterization for the solution of a robust utility maximization problem in an incomplete market model, whose volatility, interest rate process, and long-term trend are driven by an external stochastic factor process. The robust utility functional is defined in...

We study a zero-sum game where the evolution of a spectrally one-sided Lévy process is modified by a singular controller and is terminated by the stopper. The singular controller minimizes the expected values of running, controlling and terminal costs while the stopper maximizes them. Using...

In this paper we extend standard dynamic programming results for the risk sensitive optimal control of discrete time Markov chains to a new class of models. The state space is only finite, but now the assumptions about the Markov transition matrix are much less restrictive. Our results are then...

We propose a stochastic control approach to the dynamic maximization of robust utility functionals that are defined in terms of logarithmic utility and a dynamically consistent convex risk measure. The underlying market is modeled by a diffusion process whose coefficients are driven by an...