Dynamic programming is the essential tool in dynamic economic analysis. Problems such as portfolio allocation for individuals and optimal economic growth are typical examples. Numerical methods typically approximate the value function. Recent work has focused on making numerical methods more...

We introduce a novel simulated certainty equivalent approximation (SCEQ) method for solving dynamic stochastic problems. Our examples show that SCEQ can quickly solve high-dimensional finite- or infinite-horizon, stationary or non- stationary dynamic stochastic problems with hundreds of state...

Climate change is a phenomenon beset with major uncertainties and researchers should include them in Integrated Assessment Models. However, including further dimensions in IAM models comes at a cost. In particular, it makes most of these models suffer from the curse of dimensionality. In this...

On most modern energy markets, electricity is traded in advance and a power producer has to commit to deliver a certain amount of electricity some time before the actual delivery. This is especially difficult for power producers with renewable energy sources that are stochastic (like wind and...

This paper provides a concise guide to dynamic optimization with an integral treatment on various optimal control and dynamic programming problems. It presents essential theorems and methods for obtaining and characterizing solutions to these problems. The paper discusses Pontryagin's maximum...

In this contribution we propose a dynamic tracking error problem and we consider the problem of monitoring at discrete point the shortfall of the portfolio below a set of given reference levels of wealth. We formulate and solve the resulting dynamic optimization problem using stochastic...

In this contribution we propose an approach to solve a multistage stochastic programming problem which allows us to obtain a time and nodal decomposition of the original problem. This double decomposition is achieved applying a discrete time optimal control formulation to the original stochastic...

This paper derives a maximum principle for dynamic systems with continuous lags, i.e., systems governed by integrodifferential equations, using dynamic programming. As a result, the adjoint variables can be provided with useful economic interpretations

In this paper, we treat an optimal control problem of a stochastic two-machine flowshop with machines subject to random breakdown and repair. While the problem is difficult to solve, it can be approximated by a deterministic problem when the rates of machine failure and repair become large....