Evaluating replicability of laboratory experiments in economics

The replicability of some scientific findings has recently been called into question. To contribute data about replicability in economics, we replicated 18 studies published in the American Economic Review and the Quarterly Journal of Economics between 2011 and 2014. All of these replications followed predefined analysis plans that were made publicly available beforehand, and they all have a statistical power of at least 90% to detect the original effect size at the 5% significance level. We found a significant effect in the same direction as in the original study for 11 replications (61%); on average, the replicated effect size is 66% of the original. The replicability rate varies between 67% and 78% for four…

• AP
  Alfred P. Sloan Foundation

  Award: G-2015-13929
• JW
  Jan Wallanders och Tom Hedelius Stiftelse samt Tore Browaldhs Stiftelse

  Awards: P2013-0156:1, P2015-0001:1
• AS
  Austrian Science Fund

  Award: Y617-G11
• ON
  Oesterreichische Nationalbank

  Award: OeNB 14953
• KO
  Knut och Alice Wallenbergs Stiftelse