These notes provide an intuitive introduction to dynamic programming. The first two Sections, which can be skipped, present the standard deterministic Ramsey model using the Lagrangian approach. Section 3 reformulates the Ramsey problem by means of a Bellman equation, while Section 4 shows how...

Cross-sector labor reallocation is associated with costs at the micro level ranging from the costs of geographical relocation and skill change/adaptation to unemployment. We show that monotonous reallocation paths minimize the aggregate reallocation costs in the three-sector framework (relating...

This paper, using the different alternative methods of dynamic optimization (the Lagrange/Kuhn-Tucker (LKT) method, the substitution method, the Hamiltonian method, and the dynamic programming approach) derives the conditions that must be satisfied by the solution to the so-called Ramsey...

I introduce and evaluate a new stochastic simulation method for dynamic economic models. It is based on recent work in the operations research and engineering literatures (Van Roy et. al, 1997; Powell, 2007; Bertsekas, 2011). The baseline method involves rewriting the household's dynamic program in...

A version of the classical secretary problem is studied, in which one is interested in selecting one of the b best out of a group of n differently ranked persons who are presented one by one in a random order. It is assumed that b is bigger than or equal to 1 is a preassigned number. It is...

Increasing renewable generation results in growing supply uncertainty. By now hydrostorages are the most efficient way of smoothing uncertain power supply. In liberalized and competitive markets the valuation of hydro storages investment projects needs to take the market information and...

We study the gap between the state pension provided by the Italian pension system pre-Dini reform and post-Dini reform. The goal is to fill the gap between the old and the new pension by joining a defined contribution pension scheme and adopting an optimal investment strategy that is...

We introduce a computational technique- precomputation of integrals - that makes it possible to construct conditional expectation functions in dynamic stochastic models in the initial stage of a solution procedure. This technique is very general: it works for a broad class of approximating...

This paper develops an approximate closed-form optimal portfolio allocation formula for a spot asset whose variance follows a GARCH(1,1) process. We consider an investor with constant relative risk aversion (CRRA) utility who wants to maximize the expected utility from terminal wealth under a...

The computational time required to solve and estimate dynamic economic models is one of the main constraints in empirical research. The Endogenous Grid Method (EGM) proposed by Carroll (2006) is known to offer impressive speed gains over more traditional stochastic dynamic programming methods,...