We consider an agent interacting with an unmodeled environment. At each time, the agent makes an observation, takes an action, and incurs a cost. Its actions can influence future observations and costs. The goal is to minimize the long-term average cost. We propose a novel algorithm, known as...

This paper explores the connection between three important threads of economic research offering different approaches to studying the dynamics of an industry with heterogeneous firms. Finite models of the form pioneered by Ericson and Pakes (1995) capture the dynamics of a finite number of...

Oblivious equilibrium is a new solution concept for approximating Markov perfect equilibrium in dynamic models of imperfect competition among heterogeneous firms and has recently been used in multiple economic studies. In this paper, we present algorithms for computing oblivious equilibrium and...

We propose an approximation method for analyzing Ericson and Pakes (1995)-style dynamic models of imperfect competition. We develop a simple algorithm for computing an ``oblivious equilibrium,'' in which each firm is assumed to make decisions based only on its own state and knowledge of the long...

This paper explores the connection between three important threads of economic research offering different approaches to studying the dynamics of an industry with heterogeneous firms. Finite models of the form pioneered by Ericson and Pakes (1995) capture the dynamics of a finite number of...

We propose an approximation method for analyzing Ericson and Pakes (1995)-style dynamic models of imperfect competition. We develop a simple algorithm for computing an "oblivious equilibrium," in which each firm is assumed to make decisions based only on its own state and knowledge of the long...

Oblivious equilibrium is a new solution concept for approximating Markov perfect equilibrium in dynamic models of imperfect competition among heterogeneous firms and has recently been used in multiple economic studies. In this paper, we present algorithms for computing oblivious equilibrium and...