Models of consumer learning and inventory behavior have both proven to be valuable for explaining consumer choice dynamics. In their pure form these models assume consumers solve complex dynamic programming (DP) problems to determine optimal choices. For this reason, these models are best viewed...

We show that the equivalence between certain problems of singular stochastic control (SSC) and related questions of optimal stopping known for convex performance criteria (see, for example, Karatzas and Shreve (1984)) continues to hold in a non convex problem provided a related discretionary...

This paper studies an optimal irreversible extraction problem of an exhaustible commodity in presence of regime shifts. A company extracts a natural resource from a reserve with finite capacity, and sells it in the market at a spot price that evolves according to a Brownian motion with...

A problem of optimally purchasing electricity at a real-valued spot price (that is, with potentially negative cost) has been recently addressed in De Angelis, Ferrari and Moriarty (2015) [SIAM J. Control Optim. 53(3)]. This problem can be considered one of irreversible investment with a cost...

We consider a real options model for the optimal irreversible investment problem of a profit maximizing company. The company has the opportunity to invest into a production plant capable of producing two products, of which the prices follow two independent geometric Brownian motions. After...

We study an optimal liquidation problem with multiplicative price impact in which the trend of the asset's price is an unobservable Bernoulli random variable. The investor aims at selling over an infinite time-horizon a fixed amount of assets in order to maximize a net expected profit...

Economists who want to numerically approximate an elaborate dynamic stochastic programming problem (DSPP), either for structural estimation or policy evaluation purposes, are often confined by the curse of dimensionality: richer models with various state and control variables cannot be solved on...

This paper, using the different alternative methods of dynamic optimization (the Lagrange/Kuhn-Tucker (LKT) method, the substitution method, the Hamiltonian method, and the dynamic programming approach) derives the conditions that must be satisfied by the solution to the so-called Ramsey...

In an incomplete market we study the optimal consumption-portfolio decision of an investor with recursive preferences of Epstein-Zin type. Applying a classical dynamic programming approach, we formulate the associated Hamilton-Jacobi-Bellman equation and provide a suitable verification theorem....

One attractive objective for a pensioner using the income drawdown option is to minimise the deviation of the pension fund from a prescribed deterministic target. Typically, this problem is formulated as a linear-quadratic optimal control problem, which has the shortcoming that over-performance...