Analyzing US macro data via a structural vector-autoregressive model (SVAR), Deleidi and Mazzucato (2021) find strong positive spillovers from mission-oriented government spending on private research and development, as well as on overall economic activity (“crowding in”). Deleidi and...

Holt and Vinopal (2023) provides evidence of an income-based gap in time spent waiting for services on the typical day in the United States. The gap was estimated at the extensive margin, unconditional intensive margin, and intensive margin conditional on some waiting time. The analysis was...

Adema et al. (2025a) critically reassesses the findings of Ciacci (2024), arguing that the reported effects result from statistical errors and flawed empirical implementation. This response systematically addresses those claims by applying their proposed methodology to the corrected sample...

Müller (2023) presents evidence for electoral cycles in macroprudential policy in a sample of 58 countries from 2000 through 2014. Consistent with theoretical arguments, the pattern of looser regulation is larger when election outcomes are uncertain and institutions are weak. In this...

Cox et al. (2023) investigated the acoustic features of infant-directed speech. They used Bayesian meta-analyses to investigate five acoustic features with data from 88 studies. In the present robustness reproduction, we first check if the reported results are reproducible based on the data and...

This study evaluates the effectiveness of varying levels of human and artificial intelligence (AI) integration in reproducibility assessments of quantitative social science research. We computationally reproduced quantitative results from published articles in the social sciences with 288...

In his comment on our replication of Ciacci (2024), Ciacci (2025b) again finds large and statistically significant treatment effects on rape from Sweden's ban on sex purchases. These estimates derive from overfitted control functions and incorrect clustering in the regression discontinuity in...

Webb, Holyoak & Lu (2023) compared human reasoners and GPT-3 on several tasks involving analogy resolution, documenting human-level or superhuman performance in most conditions. In this direct replication, we tested a different, open-weights language model (Mixtral-8x7B) on the same materials...

Experimental asset markets provide a controlled approach to studying financial markets. We attempt to replicate 17 key results from four prominent studies, collecting new data from 166 markets with 1,544 participants. Only 3 of the 14 original results reported as statistically significant were...

4207 In a recent paper, Fack et al. (2019, American Economic Review) convincingly argue and theoretically demonstrate that there may be strong incentives for students to play non-truth-telling strategies when reporting preferences over schools, even when the celebrated deferred acceptance...

This paper successfully replicates Autor et al. (2008) and extends their analysis through 2022. The extension to an additional 17 years of analysis underscores the original finding that rising wage inequality was not an episodic event of the 1980s. That being said, overall 90/10 inequality and...

Experimental research has explored the effects of wage delegation on employee performance, with the pioneering attempt by (Charness et al., Am Econ Rev 102:2358–2379, 2012) in “The Hidden Advantage of Delegation: Pareto Improvements in a Gift Exchange Game”, published in the American...

4207 In a recent paper, Fack et al. (2019, American Economic Review) convincingly argue and theoretically demonstrate that there may be strong incentives for students to play non-truth-telling strategies when reporting preferences over schools, even when the celebrated deferred acceptance...

Ambuehl et al. (2022) explore ways to evaluate interventions designed to enhance decision-making quality when individuals misjudge the outcomes of their choices. The authors propose a novel outcome metric that can distinguish between interventions better than conventional metrics such as...

Carvalho et al. (2023) propose a theoretical framework that explains longrun inflation expectations' dynamic using short-run inflation surprises and beliefs about monetary policy. In an empirical exercise, they show that this concise framework predicts long-term inflation expectations well over...

Zhang (2023) used an online, pre-registered, large-scale controlled experiment to test the effect of an endorsement of Joe Biden by the scientific journal Nature on several perceptual and behavioural outcomes. The main results of the paper were the following: the endorsement of Biden caused a...

Rigorous replication efforts is crucial for good social science, and I am grateful to Jetter and Swasito (2024), who replicate and extend the results of a recent published paper (Mattingly, 2024). My original paper examined, among other things, the ways in which periods of foreign and domestic...

Liu et al. (2023) examines the effect of climate change on labor allocation in India over a long time span. The authors find that rising temperatures are correlated with lower shares of workers in non agricultural sectors. They also identify a likely mechanism: falling agricultural productivity...

I would like to thank Hong and Luparello (2024) for their effort in replicating, as well as partially extending, the results in Orr (2022). This replication report makes what I believe to be three key points: 1. The replication package of Orr (2022) is computationally reproducible (up to two...

This report inspects the reproducibility of a study by Dizon-Ross and Jayachandran (2023), which focused on differences in parents' spending on their daughters relative to sons on a large sample of 6,673 observations in 1,084 households in Uganda. The original study found that the willingness to...

This is a replication study of Cook et al.(2023), a paper that investigates the determinants of access to nondiscriminatory public accommodations for African-Americans before the 1964 Civil Rights Act. They utilize the Negro Motorist Green Books and World War II casualty data to examine the...

Elisa Macchi (2023) investigates the impact of obesity on the perceived wealth of individuals using primary data collected in Kampala, Uganda. The study includes two complementary experiments: a beliefs experiment and a credit experiment. In the beliefs experiment, individuals assess the wealth...

Kao et al. (2024) use phone-based survey experiments in Jordan, Tunisia and Morocco to test whether established theories about the effect of descriptive representation on perceived democratic legiti- macy hold in the Middle East. They find that the presence of women in deliberative bodies...

Tappin, Berinsky, and Rand (2023) find that the effectiveness of persuasive messaging is not diminished by countervailing in-party leader cues, using a survey experiment fielded in the United States. In this robustness reproduction, we briefly summarize the original design and results before...

Guinaudeau and Jankowski reassess our recent study on the use of strategic descriptive representation among political parties in Europe. The authors successfully replicate the vast majority of our findings and perform a number of additional robustness checks. They claim that one of our key...

Lee (2022) evaluates whether elected officials update their policy positions based on expert evidence. His cross-subject and within-subject designs run in the American local and state policy-making context both confirm the capacity for politicians to update their beliefs in response to expert...

Tong and Wei (2020) study the impact of unconventional monetary interventions on credit markets during the 2008 global financial crisis. They find that stock prices increase on intervention days, particularly for firms operating in sectors perceived to be more reliant on external funding....

The experimental study "Letting Down the Team? Social Effects of Team Incentives" by Philip Babcock and colleagues (2015) proposes that team incentives significantly enhance individual performance through social pressure and peer effects. The findings suggest that individuals are motivated by a...

Experimental asset markets provide a controlled approach to studying financial markets. We attempt to replicate 17 key results from four prominent studies, collecting new data from 166 markets with 1,544 participants. Only 3 of the 14 original results reported as statistically significant were...

This study compares the estimation errors of several present value discounting conventions (end-of-year, mid-year, and the more recently proposed harmonic mean convention) for a uniform distribution of intra-period cash flow - continuous and discrete. Our results show that the mid-year...

We replicate the primary results from Ahlquist and Downey (2023, AD), who examine the effects of Chinese import competition on both industry-and state-level unionization in the US. We are able to directly replicate the main results in AD Tables 1 and 2. We consider two main extensions. First, we...

Gendron-Carrier et al. (2022) studies the effect of subway openings on urban air pollution. The authors find a null average effect, but a negative effect in cities with high initial pollution. In this comment, I perform several robustness checks on the negative effect for high-pollution cities,...

We estimate the robustness reproducibility of key results from 17 non-experimental AER papers published in 2013 (8 papers) and 2022/23 (9 papers). We find that many of the results are not robust, with no improvement over time. The fraction of significant robustness tests (p0.05) varies between...

Equivalence testing methods can provide statistically significant evidence that relationships are practically equal to zero. I demonstrate their necessity in a systematic reproduction of estimates defending 135 null claims made in 81 articles from top economics journals. 37-63% of these...

Moya Chin's (2023) paper argues that politicians in two-round majoritarian systems have to appeal more broadly than those in single-round elections. The author uses data for mayoral elections in Brazil. The key findings of the paper conclude that of two-round systems (1) fostering inclusiveness,...

This study replicates and extends the work of Falk and Hermle (2018. “Relationship of Gender Differences in Preferences to Economic Development and Gender Equality.” Science 362 (6412): eaas9899), who hypothesized that gender differences in economic preferences (patience, altruism,...

This study replicates and extends the work of Falk and Hermle (2018. “Relationship of Gender Differences in Preferences to Economic Development and Gender Equality.” Science 362 (6412): eaas9899), who hypothesized that gender differences in economic preferences (patience, altruism,...

This paper replicates the analysis of Kim and Albert Kim (2018). Kim and Albert Kim (2018) find asizeable and negative impact of the Charlie Hebdo terrorist attack on various indicators of mentalhealth. Overall, our results confirm the conclusions of Kim and Albert Kim (2018).

In a recent simulation study, Goodman et al. (2019) compare several methods with regard to their type I and type II error rates when considering a thick null hypothesis that includes all values that are practically equivalent to the point null hypothesis. They propose a hybrid decision criterion...

Mangonnet et al. (2022) examine whether political alignment at the national and sub-national levels explain the spatial designation of Protected Areas (PAs) in Brazil. Their identification relies on spatial discontinuities in political alignment across municipalities. They find that a...

Cheeseman and Peiffer (2022) field a survey experiment in Nigeria to test the effect of five different anti-corruption messages on participants' willingness to bribe public officials. They find that these messages generally fail to reduce bribes and could, in fact, increase bribes. They further...

Baron (2022) explores the independent effects of operational expenditure and capital expenditure on student outcomes in school districts across Wisconsin from the outcomes of close referendum approvals. By utilizing a dynamic regression discontinuity framework and cubic specification, the author...

Cheeseman and Peiffer (2022) field a survey experiment in Nigeria to test the effect of five different anti-corruption messages on participants' willingness to bribe public officials. They find that these messages generally fail to reduce bribes and could, in fact, increase bribes. They further...