We provide an equilibrium framework for modeling the behavior of an agent who holds a simplified view of a dynamic optimization problem. The agent faces a Markov Decision Process, where a transition probability function determines the evolution of a state variable as a function of the previous...

We study Markov decision problems where the agent does not know the transition probability function mapping current states and actions to future states. The agent has a prior belief over a set of possible transition functions and updates beliefs using Bayes' rule. We allow her to be misspecified...

This paper considers maximum likelihood (ML) estimation in a large class of models with hidden Markov regimes. We investigate consistency and local asymptotic normality of the ML estimator under general conditions which allow for autoregressive dynamics in the observable process,...