The paper provides a systematic way for finding a partial differential equation that characterize directly the optimal control, in the framework of one?dimensional stochastic control problems of Mayer, with no constraints on the controls. The results obtained are applied to some significative...

These notes provide an intuitive introduction to dynamic programming. The first two Sections, which can be skipped, present the standard deterministic Ramsey model using the Lagrangian approach. Section 3 reformulates the Ramsey problem by means of a Bellman equation, while Section 4 shows how...

We introduce a novel simulated certainty equivalent approximation (SCEQ) method for solving dynamic stochastic problems. Our examples show that SCEQ can quickly solve high-dimensional finite- or infinite-horizon, stationary or non- stationary dynamic stochastic problems with hundreds of state...

<Para ID="Par1">We develop a theory for a general class of discrete-time stochastic control problems that, in various ways, are time-inconsistent in the sense that they do not admit a Bellman optimality principle. We attack these problems by viewing them within a game theoretic framework, and we look for...</para>

We consider minimizing the probability of falling below a target growth rate of the wealth process up to a time horizon T in an incomplete market model under partial information and then study the asymptotic behavior of the minimizing probability as T → ∞. This problem is closely related to...

This paper seeks to highlight two approaches to the solution of stochastic control and optimal stopping problems in continuous time. Each approach transforms the stochastic problem into a deterministic problem. Dynamic programming is a well-established technique that obtains a partial/ordinary...

We consider the optimal dividend problem in the so-called degenerate bivariate risk model under the assumption that the surplus of one branch may become negative. More specific, we solve the stochastic control problem of maximizing discounted dividends until simultaneous ruin of both branches of...