Amazon's Mechanical Turk is a very widely-used tool in business and economics research, but how trustworthy are results from well-published studies that use it? Analyzing the universe of hypotheses tested on the platform and published in leading journals between 2010 and 2020 we find evidence of...

This is a replication of Mayshar et al. (2022) (henceforth MMP).1 The article posits that the state (defined as societal hierarchy such as tax-levying elites) originated from cultivation of appropriable cereal grains, contrary to the conventional theory that the state originated from increased...

This is a replication of Mayshar et al. (2022) (henceforth MMP).1 The article posits that the state (defined as societal hierarchy such as tax-levying elites) originated from cultivation of appropriable cereal grains, contrary to the conventional theory that the state originated from increased...

This study pushes our understanding of research reliability by reproducing and replicating claims from 110 papers in leading economic and political science journals. The analysis involves computational reproducibility checks and robustness assessments. It reveals several patterns. First, we...

This analysis is an independent replication of Heft-Neal et al. (2020).1 The original authors (HBBVB) provide evidence that particulate matter air pollution increases infant mortality in 30 African nations between 2000 and 2015. They provide three effect estimates. Using ordinary least squares,...

Figueiredo (2022) examines wage cyclicality across the skill mismatch distribution finding large differences. Some key results include finding that wages are acyclical in good labor market matches but procyclical in poor matches. Using the public replication material provided by the authors, we...

Vlassopoulos et al. (2024) find that after providing two hours of telephone counseling over three months, a sample of Bangladeshi women saw significant reductions in stress and depression after ten months. We find three anomalies. First, estimates are almost entirely driven by reverse-scored...

This article reviews and summarizes current reproduction and replication practices in political science. We first provide definitions for reproducibility and replicability. We then review data availability policies for 28 leading political science journals and present the results from a survey...

We estimate the robustness reproducibility of key results from 17 non-experimental AER papers published in 2013 (8 papers) and 2022/23 (9 papers). We find that many of the results are not robust, with no improvement over time. The fraction of significant robustness tests (p0.05) varies between...

Naidu and Yuchtman (2013) find that labor demand shocks in 19th-century Britain had an impact on master and servant prosecutions, as breaking an employee contract was a criminal offense until 1875. We first reproduce all regression tables in Naidu and Yuchtman (2013) and then test for robustness...