Discrete-time stochastic models of groundwater management have been extensively used for understanding a variety of issues in groundwater management for agriculture. Most models used suffer from two drawbacks: relatively simplistic treatment of extraction cost (remarked in many papers in the...

In this report, we outline a method for approximating a Markovian (or feedback-Nash) equilibrium of a dynamic game, possibly subject to coupled-constraints. We treat such a game as a "multiple" optimal control problem. A method for approximating a solution to a given optimal control problem via...

Strategies for constructing a Markov decision chain approximating a continuous-time finite-horizon optimal control problem are investigated. Some simple, analytically soluble, examples are treated and low computational complexity is reported. Extensions to the method and implementation are...

This paper describes a method for solving a class of forward-looking Markov-switching Rational Expectations models under noisy measurement, by specifying the unobservable expectations component as a general-measurable function of the observable states of the system, to be determined optimally...

These notes provide an intuitive introduction to dynamic programming. The first two Sections, which can be skipped, present the standard deterministic Ramsey model using the Lagrangian approach. Section 3 reformulates the Ramsey problem by means of a Bellman equation, while Section 4 shows how...

Based on a dynamic life cycle model, this study analyzes health-related risks of consumption and old-age poverty. The model allows for health effects on employment risks, on productivity, on longevity, the correlation between health risks, productivity and preferences, and the financial...

The focus of our analysis is on nexus issues among energy use, incomes, employment, investment decisions, and agricultural production for meeting food and feed demands, as well as health-related effects on rural households. As an example we investigate potential policies, such as public...

Workers’absenteeism due to illness represents a major concern in several countries. Absenteeism are however not very well understood in economics. This paper presents a model where absenteeism is understood in relation to health. Its main predictions are (i) intermediate welfare state...

In this paper we study the behavior of optimal paths in dynamic programming models with a strictly convex return function. Such a model has been investigated in Dawid and Kopel (1997) who assume that the growth of a renewable resource is governed by a piecewise linear function. We prove that in...

Monitoring is an important and costly activity in resource management problems such as containing invasive species, protecting endangered species, preventing soil erosion, and regulating contracts for environmental services. Recent studies have viewed optimal monitoring as a Partially Observable...