Estimating microcredit impact with low take-up, contamination and inconsistent data : a replication study of Crépon, Devoto, Duflo, and Pariente (American Economic Journal: Applied Economics, 2015) (Research Synthesis Methods, 2018)
Florent Bédécarrats, Isabelle Guérin, Solène Morvant-Roux, and François Roubaud
We replicate a flagship randomised control trial carried out in rural Morocco that showed substantial and significant impacts of microcredit on the assets, the outputs, the expenses and the profits of self-employment activities. The original results rely primarily on trimming, which is the exclusion of observation with the highest values on some variables. However, the applied trimming procedures are inconsistent between the baseline and the endline. Using identical specifications as the original paper reveals large and significant imbalances at the baseline and, at the endline, impacts on implausible outcomes, like household head gender, language or education. This calls into question the reliability of the data and the integrity of the experiment protocol. We find a series of coding, measurement and sampling errors. Correcting the identified errors lead to different results. After rectifying identified errors, we still find substantial imbalances at baseline and implausible impacts at the endline. Our re-analysis focused on the lack of internal validity of this experiment, but several of the identified issues also raise concerns about its external validity.
Year of publication: |
2019
|
---|---|
Authors: | Bédécarrats, Florent ; Guérin, Isabelle ; Morvant-Roux, Solène ; Roubaud, François |
Other Persons: | Crépon, Bruno (contributor) ; Devoto, Florencia (contributor) ; Duflo, Esther (contributor) ; Parienté, William (contributor) |
Published in: |
International Journal for Re-Views in Empirical Economics : IREE. - Kiel : ZBW – German National Library of Economics, Leibniz Information Centre for Economics, ISSN 2566-8269, ZDB-ID 2899133-3. - Vol. 3.2019, 3, p. 1-22
|
Subject: | Meta-Analysis | Publication Bias | Funnel Asymmetry Test (FAT) | Precision Effect Estimate with Standard Error (PEESE) | Monte Carlo Simulations | Replication Study | Monte-Carlo-Simulation | Monte Carlo simulation | Mikrofinanzierung | Microfinance | Meta-Analyse | Meta-analysis | Wissenschaftliche Methode | Scientific method | Wirtschaftswissenschaft | Economics | Schätztheorie | Estimation theory | Systematischer Fehler | Bias |
Saved in:
freely available
Type of publication: | Article |
---|---|
Type of publication (narrower categories): | Aufsatz in Zeitschrift ; Article in journal |
Language: | English |
Research data: | |
Other identifiers: | 10.18718/81781.12 [DOI] hdl:10419/206819 [Handle] |
Classification: | c18 ; C83 - Survey Methods; Sampling Methods ; C93 - Field Experiments ; G21 - Banks; Other Depository Institutions; Mortgages |
Source: | ECONIS - Online Catalogue of the ZBW |
Persistent link: https://www.econbiz.de/10012123202