Discussion Paper

No. 2017-77 | September 28, 2017
Which tests not witch hunts: a diagnostic approach for conducting replication research
(Published in Special Issue The practice of replication)


This paper provides researchers with an objective list of checks to consider when planning a replication study with the objective of validating findings for informing policy. These replication studies should begin with a pure replication of the published results and then reanalyse the original data to address the original research question. The authors present tips for replication exercises in four categories: validity of assumptions, data transformations, estimation methods, and heterogeneous impacts. For each category they offer an introduction, a tips checklist, some examples of how these checks have been employed, and a set of resources that provide statistical and econometric details.

JEL Classification:

C10, B41, A20


  • Downloads: 88


Cite As

Annette N. Brown and Benjamin Douglas Kuflick Wood (2017). Which tests not witch hunts: a diagnostic approach for conducting replication research. Economics Discussion Papers, No 2017-77, Kiel Institute for the World Economy. http://www.economics-ejournal.org/economics/discussionpapers/2017-77

Comments and Questions

Anonymous - Referee report 1
October 19, 2017 - 08:55

This paper suggests check lists to consider in planning and doing a replication study. I agree with the authors on all the points made and I think that these "tips" will be helpful for many researchers interested in doing replication studies. Furhermore, they are for sure helpful for any original ...[more]

... study, too.