A growing body of correlational studies suggests that sex hormones such as those contained in, or affected by, oral contraceptives (OCs) may impact economic behavior. However, despite widespread use of OCs among women in Western countries, little is known about their potential behavioral...

Robustness reproductions and replicability discussions are on the rise in response to concerns about a potential credibility crisis in economics. This paper proposes a protocol to structure reproducibility and replicability assessments, with a focus on robustness. Starting with a computational...

Bosch-Domènech et al. (2014) reported a negative association between 2D:4D, a suggested marker of prenatal testosterone exposure, and the Cognitive Reflection Test (CRT) in a sample of 623 university students. In this pre-registered study, we test whether we can replicate their findings in a...

This article reviews and summarizes current reproduction and replication practices in political science. We first provide definitions for reproducibility and replicability. We then review data availability policies for 28 leading political science journals and present the results from a survey...

We estimate the robustness reproducibility of key results from 17 non-experimental AER papers published in 2013 (8 papers) and 2022/23 (9 papers). We find that many of the results are not robust, with no improvement over time. The fraction of significant robustness tests (p0.05) varies between...

Placebo tests, where a null result is used to support the validity of the research design, is common in economics. Such tests provide an incentive to underreport statistically significant tests, a form of reversed p-hacking. Based on a pre-registered analysis plan, we test for such...

Robustness reproductions and replicability discussions are on the rise in response to concerns about a potential credibility crisis in economics. This paper proposes a protocol to structure reproducibility and replicability assessments, with a focus on robustness. Starting with a computational...