This paper provides a preliminary assessment of recent reforms of German employment promotion policy. While several recent studies analyze the impact of measures of employment promotion for the case of Germany, no comparable study exists on the aggregate level, thus precluding any assessment of...

The economics 'credibility revolution' has promoted the identification of causal relationships using difference-in-differences (DID), instrumental variables (IV), randomized control trials (RCT) and regression discontinuity design (RDD) methods. The extent to which a reader should trust claims...

Sixty-seven field experiments of discrimination in markets conducted since 2000 across seventeen countries were surveyed. Significant and persistent discrimination was found on all bases in all markets. High levels of discrimination were recorded against ethnic groups, older workers, men...

Strategy research often aims to empirically establish a causal relationship between an independent variable and a dependent variable such as firm performance. For many important strategy research questions, however, traditional empirical techniques are not sufficient to establish causal effects...

Replication studies are considered a hallmark of good scientific practice. Yet they are treated among researchers as an ideal to be professed but not practiced. To provide incentives and favorable boundary conditions for replication practice, the main stakeholders need to be aware of what drives...

Randomized controlled trials (RCTs) are increasingly prominent in economics, with pre-registration and pre-analysis plans (PAPs) promoted as important in ensuring the credibility of findings. We investigate whether these tools reduce the extent of p-hacking and publication bias by collecting and...

We use Michigan Panel Study of Income Dynamics data and data from a 2008 telephone survey of adults conducted by Westat for the Princeton Data Improvement Initiative (PDII) to explore the importance and feasibility of adding retrospective questions about actual work experience to cross-sectional...

Social preference research has received considerable attention among economists in recent years. However, the empirical foundation of social preferences is largely based on laboratory experiments with self-selected students as participants. This is potentially problematic as students...

Social experiments are powerful sources of information about the effectiveness of interventions. In practice, initial randomization plans are almost always compromised. Multiple hypotheses are frequently tested. "Significant" effects are often reported with p-values that do not account for...

This paper advances the use of pre-analysis plans in non-experimental research settings. In a study of recent minimum wage changes, we demonstrate how analyses of medium- and long-run impacts of policy interventions can be pre-specified as extensions to short-run analyses. Further, our...