Discussion Paper

No. 2017-74 | September 28, 2017
A replication recipe: list your ingredients before you start cooking
(Published in Special Issue The practice of replication)


The author argues that researchers should do replications using preanalysis plans. These plans should specify at least three characteristics: (1) how much flowtime the researchers will spend, (2) how much money and effort (working hours) the researchers will spend, and (3) the intended results and the precision of the replication necessary for “success”. A researcher’s replication will be “successful” according to context-specific criteria in the preanalysis plan. The author also argues that the two biggest drawbacks of preanalysis plans—(1) that they discount unexpected but extraordinary findings and (2) that they make it difficult for researchers to prespecify all possible actions in their decision trees—are less relevant for replications compared with new research. The author concludes with describing a preanalysis plan for replicating a paper on housing demand and household formation.

JEL Classification:

B41, C80, C81, R21


  • Downloads: 87


Cite As

Andrew C. Chang (2017). A replication recipe: list your ingredients before you start cooking. Economics Discussion Papers, No 2017-74, Kiel Institute for the World Economy. http://www.economics-ejournal.org/economics/discussionpapers/2017-74

Comments and Questions

Anonymous - Referee report 1
October 18, 2017 - 09:42

see attached file