Gradient-based approaches to direct policy search in reinforcement learning have received much recent attention as a means to solve problems of partial observability and to avoid some of the problems associated with policy degradation in value-function methods. In this paper we introduce GPOMDP,...

I compare the performance of solution methods in solving a standard real business cycle model with labor market search frictions. Under the conventional calibration, the model is solved by the projection method using the Chebyshev polynomials as its basis, and the perturbation methods up to...

A stochastic discrete choice model and its related estimation method are presented which allow to disentangle non-linear externalities from the intrinsic features of the objects of choice and from the idiosyncratic preferences of agents. Having veried for the ergodicity of the underlying...

We introduce the market resources method (MRM) for solving dynamic optimization problems. MRM extends Carroll's (2006) endogenous grid point method (EGM) for problems with more than one control variable using policy function iteration. The MRM algorithm is simple to implement and provides...

This paper introduces a general method for computing equilibria with heteroge- neous agents and aggregate shocks that is particularly suitable for economies with private infor- mation. Instead of the cross-sectional distribution of agents across individual states, the method uses as a state...

We propose a new numerical method to solve stochastic models that combines the parameterized expectations (PEA) and the Smolyak algorithms. This method is especially convenient to address problems with occasionally binding constraints (a feature inherited from PEA) and/or a large number of state...

Transaction costs on financial markets may have important consequences for volumes of trade, asset pricing, and welfare. This paper introduces an algorithm for the computation of equilibria in the general equilibrium model with incomplete asset markets and transaction costs. We show that...

Our aim is to provide insights into some basic facts of US government debt management by introducing simple financial frictions in a Ramsey model of fiscal policy. We find that the share of short bonds in total U.S. debt is large, persistent, and highly correlated with total debt. A well known...

This paper uses an economic agent-based model of land use in a growing community on the urban fringe to explore the importance of key economic variables on the spatial patterns of development over time. Understanding dispersed patterns of urban development is important for designing policies for...

In this paper we present a nonparametric approach to solving a simple one-sector stochastic growth model. A distinct advantage of our approach is that it does not require placing restrictions on the generally unknown conditional expectations functions. Our method is shown to be accurate and...