Bayesian and Classical Approaches to Instrumental Variable Regression

We establish the relationships between certain Bayesian and classical approaches to instrumental variables regression. We determine the form of priors that lead to posteriors for structural parameters that have similar properties as classical 2SLS and LIML and in doing so provide some new insight to the small sample behavior of Bayesian and classical procedures in the limited information simultaneous equations model. Our approach is motivated by the relationship between Bayesian and classical procedures in linear regression models; i.e., Bayesian analysis with a diffuse prior leads to posteriors that are idnetical in form to the finite sample density of classical least squares estimators. We use the fact that the instrumental variables regression model can be obtained from a reduced rank restriction on a multivariate linear model to determine the priors that give rise to posteriors that have properties similar to classical 2SLS and LIML. As a by-product of this approach we provide a novel way to determine the exact finite sample density of the LIML estimator and the prior that corresponds with classical LIML. We show that the traditional Dreze approach and a new Bayesian Two Stage approach are similar to 2SLS wheresas the approach based on Jeffreys' prior corresponds to LIML.