Holt and Vinopal (2023) provides evidence of an income-based gap in time spent waiting for services on the typical day in the United States. The gap was estimated at the extensive margin, unconditional intensive margin, and intensive margin conditional on some waiting time. The analysis was...

Adema et al. (2025a) critically reassesses the findings of Ciacci (2024), arguing that the reported effects result from statistical errors and flawed empirical implementation. This response systematically addresses those claims by applying their proposed methodology to the corrected sample...

Müller (2023) presents evidence for electoral cycles in macroprudential policy in a sample of 58 countries from 2000 through 2014. Consistent with theoretical arguments, the pattern of looser regulation is larger when election outcomes are uncertain and institutions are weak. In this...

Cox et al. (2023) investigated the acoustic features of infant-directed speech. They used Bayesian meta-analyses to investigate five acoustic features with data from 88 studies. In the present robustness reproduction, we first check if the reported results are reproducible based on the data and...

This study evaluates the effectiveness of varying levels of human and artificial intelligence (AI) integration in reproducibility assessments of quantitative social science research. We computationally reproduced quantitative results from published articles in the social sciences with 288...

In his comment on our replication of Ciacci (2024), Ciacci (2025b) again finds large and statistically significant treatment effects on rape from Sweden's ban on sex purchases. These estimates derive from overfitted control functions and incorrect clustering in the regression discontinuity in...

Webb, Holyoak & Lu (2023) compared human reasoners and GPT-3 on several tasks involving analogy resolution, documenting human-level or superhuman performance in most conditions. In this direct replication, we tested a different, open-weights language model (Mixtral-8x7B) on the same materials...

Experimental asset markets provide a controlled approach to studying financial markets. We attempt to replicate 17 key results from four prominent studies, collecting new data from 166 markets with 1,544 participants. Only 3 of the 14 original results reported as statistically significant were...

Ambuehl et al. (2022) explore ways to evaluate interventions designed to enhance decision-making quality when individuals misjudge the outcomes of their choices. The authors propose a novel outcome metric that can distinguish between interventions better than conventional metrics such as...

Carvalho et al. (2023) propose a theoretical framework that explains longrun inflation expectations' dynamic using short-run inflation surprises and beliefs about monetary policy. In an empirical exercise, they show that this concise framework predicts long-term inflation expectations well over...

Zhang (2023) used an online, pre-registered, large-scale controlled experiment to test the effect of an endorsement of Joe Biden by the scientific journal Nature on several perceptual and behavioural outcomes. The main results of the paper were the following: the endorsement of Biden caused a...

Rigorous replication efforts is crucial for good social science, and I am grateful to Jetter and Swasito (2024), who replicate and extend the results of a recent published paper (Mattingly, 2024). My original paper examined, among other things, the ways in which periods of foreign and domestic...

Liu et al. (2023) examines the effect of climate change on labor allocation in India over a long time span. The authors find that rising temperatures are correlated with lower shares of workers in non agricultural sectors. They also identify a likely mechanism: falling agricultural productivity...

I would like to thank Hong and Luparello (2024) for their effort in replicating, as well as partially extending, the results in Orr (2022). This replication report makes what I believe to be three key points: 1. The replication package of Orr (2022) is computationally reproducible (up to two...

This report inspects the reproducibility of a study by Dizon-Ross and Jayachandran (2023), which focused on differences in parents' spending on their daughters relative to sons on a large sample of 6,673 observations in 1,084 households in Uganda. The original study found that the willingness to...

This is a replication study of Cook et al.(2023), a paper that investigates the determinants of access to nondiscriminatory public accommodations for African-Americans before the 1964 Civil Rights Act. They utilize the Negro Motorist Green Books and World War II casualty data to examine the...

Elisa Macchi (2023) investigates the impact of obesity on the perceived wealth of individuals using primary data collected in Kampala, Uganda. The study includes two complementary experiments: a beliefs experiment and a credit experiment. In the beliefs experiment, individuals assess the wealth...

Kao et al. (2024) use phone-based survey experiments in Jordan, Tunisia and Morocco to test whether established theories about the effect of descriptive representation on perceived democratic legiti- macy hold in the Middle East. They find that the presence of women in deliberative bodies...

Tappin, Berinsky, and Rand (2023) find that the effectiveness of persuasive messaging is not diminished by countervailing in-party leader cues, using a survey experiment fielded in the United States. In this robustness reproduction, we briefly summarize the original design and results before...

Guinaudeau and Jankowski reassess our recent study on the use of strategic descriptive representation among political parties in Europe. The authors successfully replicate the vast majority of our findings and perform a number of additional robustness checks. They claim that one of our key...

Lee (2022) evaluates whether elected officials update their policy positions based on expert evidence. His cross-subject and within-subject designs run in the American local and state policy-making context both confirm the capacity for politicians to update their beliefs in response to expert...

Tong and Wei (2020) study the impact of unconventional monetary interventions on credit markets during the 2008 global financial crisis. They find that stock prices increase on intervention days, particularly for firms operating in sectors perceived to be more reliant on external funding....

The experimental study "Letting Down the Team? Social Effects of Team Incentives" by Philip Babcock and colleagues (2015) proposes that team incentives significantly enhance individual performance through social pressure and peer effects. The findings suggest that individuals are motivated by a...

Experimental asset markets provide a controlled approach to studying financial markets. We attempt to replicate 17 key results from four prominent studies, collecting new data from 166 markets with 1,544 participants. Only 3 of the 14 original results reported as statistically significant were...

We replicate the primary results from Ahlquist and Downey (2023, AD), who examine the effects of Chinese import competition on both industry-and state-level unionization in the US. We are able to directly replicate the main results in AD Tables 1 and 2. We consider two main extensions. First, we...

Gendron-Carrier et al. (2022) studies the effect of subway openings on urban air pollution. The authors find a null average effect, but a negative effect in cities with high initial pollution. In this comment, I perform several robustness checks on the negative effect for high-pollution cities,...

We estimate the robustness reproducibility of key results from 17 non-experimental AER papers published in 2013 (8 papers) and 2022/23 (9 papers). We find that many of the results are not robust, with no improvement over time. The fraction of significant robustness tests (p0.05) varies between...

Equivalence testing methods can provide statistically significant evidence that relationships are practically equal to zero. I demonstrate their necessity in a systematic reproduction of estimates defending 135 null claims made in 81 articles from top economics journals. 37-63% of these...

Moya Chin's (2023) paper argues that politicians in two-round majoritarian systems have to appeal more broadly than those in single-round elections. The author uses data for mayoral elections in Brazil. The key findings of the paper conclude that of two-round systems (1) fostering inclusiveness,...

Gethin, Martínez-Toledano and Piketty (2022) analyze the long-run evolution of political cleavages using a new database on socioeconomic determinants of voting from approximately 300 elections in 21 Western democracies between 1948 and 2020. They find that, in the 1950s and 1960s, voting for...

We replicate the analysis conducted by Frederiksen, 2022a. We focus on assessing the computational and robustness replicability of their work. We find that their main exhibits and supplementary analysis are replicable, both when running their original Stata replication package, and when we...

Baron (2022) explores the independent effects of operational expenditure and capital expenditure on student outcomes in school districts across Wisconsin from the outcomes of close referendum approvals. By utilizing a dynamic regression discontinuity framework and cubic specification, the author...

Vellore Arthi, Brian Beach and W. Walker Hanlon (2022) investigate the effect of the Lancashire Cotton Famine on mortality, accounting for the migration response to the downturn. They use difference-in-differences to estimate the effect of the cotton famine on mortality. To account for the...

This paper presents a framework to standardize crowd-sourced computational reproductions in economics through the Social Science Reproduction Platform (SSRP). The approach address four main challenges for computational reproductions: a lack of standardization, aggregation issues, existing...

When studying policy-relevant topics, researchers' policy preferences may shape the design, execution, analysis, and interpretation of results. Detection of such bias is challenging because the research process itself is not normally part of a controlled experimental setting. Our analysis...

The anomalies literature is infested with widespread p-hacking. We replicate this literature by compiling a large data library with 447 anomalies. With microcaps alleviated via NYSE breakpoints and value-weighted returns, 286 anomalies (64%) including 95 out of 102 liquidity variables (93%) are...