A comparison of Bayesian and frequentist variable selection methods for estimating average treatment effects in logistic regression
Alex H. Martinez, Brian Christensen, Elizabeth F. Sutton, Andrew G. Chapple
In many manuscripts, researchers use multivariable logistic regression to adjust for potential confounding variables when estimating a direct relationship of a treatment or exposure on a binary outcome. After choosing how variables are entered into that model, researchers can calculate an estimated average treatment effect (ATE), or the estimated change in the outcome probability with and without an exposure present. Which potential confounding variables should be included in that logistic regression model is often a concern, which is sometimes determined from variable selection methods. We explore how forward, backward, and stepwise confounding variable selection estimate the ATE compared to spike-and-slab Bayesian variable selection across 1,000 randomly generated scenarios and various sample sizes. Our large simulation study allow us to make pseudo-theoretical conclusions about which methods perform best for different sample sizes, rarities of coutcomes, and number of confounders. An R package is also described to implement variable selection on the confounding variables only and provide estimates of the ATE. Overall, results suggest that Bayesian variable selection is more appealing in smaller sample sizes than frequentist variable selection methods in terms of estimating the ATE. Differences are minimal in larger sample sizes.
Year of publication: |
[2025]
|
---|---|
Authors: | Martinez, Alex H. ; Christensen, Brian ; Sutton, Elizabeth F. ; Chapple, Andrew G. |
Publisher: |
Brussels, Belgium : EERI, Economics and Econometrics Research Institute |
Subject: | Average Treatment Effect | ATE | Bayesian | Frequentist | Variable Selection | Bayes-Statistik | Bayesian inference | Schätztheorie | Estimation theory | Regressionsanalyse | Regression analysis | Kausalanalyse | Causality analysis |
Saved in:
freely available
Extent: | 1 Online-Ressource (circa 44 Seiten) Illustrationen |
---|---|
Series: | EERI research paper series. - Brussels : EERI, ISSN 2031-4892, ZDB-ID 2861229-2. - Vol. no 2025, 01 |
Type of publication: | Book / Working Paper |
Type of publication (narrower categories): | Graue Literatur ; Non-commercial literature ; Arbeitspapier ; Working Paper |
Language: | English |
Other identifiers: | hdl:10419/311746 [Handle] |
Classification: | C01 - Econometrics ; C11 - Bayesian Analysis ; C21 - Cross-Sectional Models; Spatial Models |
Source: | ECONIS - Online Catalogue of the ZBW |
Persistent link: https://www.econbiz.de/10015202692