Strong convergence and dynamic economic models

Robert L. Bray

Morton and Wecker (1977) stated that the value iteration algorithm solves a dynamic program's policy function faster than its value function when the limiting Markov chain is ergodic. I show that their proof is incomplete, and provide a new proof of this classic result. I use this result to accelerate the estimation of Markov decision processes and the solution of Markov perfect equilibria.

MoreLess

Year of publication:	2019
Authors:	Bray, Robert L.
Published in:	Quantitative economics : QE ; journal of the Econometric Society. - Oxford [u.a.] : Wiley, ISSN 1759-7331, ZDB-ID 2569569-1. - Vol. 10.2019, 1, p. 43-65
Subject:	Markov decision process \| Markov perfect equilibrium \| strong convergence \| relative value iteration \| dynamic discrete choice \| nested fixed point \| nested pseudo‐likelihood \| Markov-Kette \| Markov chain \| Spieltheorie \| Game theory \| Diskrete Entscheidung \| Discrete choice \| Dynamische Wirtschaftstheorie \| Economic dynamics \| Gleichgewichtstheorie \| Equilibrium theory