Discussion Paper

No. 2017-23 | May 09, 2017
Treatment-effect identification without parallel paths: an illustration in the case of Objective 1–Hainaut/Belgium, 1994–2006

Abstract

Imagine an impoverished region that becomes eligible for a generous transfer programme (the treatment). Imagine difference-in-differences analysis (DiD)—a before-and-after comparison of the income-level handicap—shows that the handicap has risen. Most observers would conclude to the policy's inefficiency. The point made in this paper is that second thoughts are needed, because DiD rests heavily on the validity of a key assumption: parallel paths in the absence of treatment. What is more, when several pre-treatment periods are available in the data, it can easily be assessed and, if necessary, abandoned in favour of more relevant ones.

Data Set

JEL Classification:

C21, R11, R15, O52

Assessment

  • Downloads: 241

Links

Cite As

Vincent Vandenberghe (2017). Treatment-effect identification without parallel paths: an illustration in the case of Objective 1–Hainaut/Belgium, 1994–2006. Economics Discussion Papers, No 2017-23, Kiel Institute for the World Economy. http://www.economics-ejournal.org/economics/discussionpapers/2017-23


Comments and Questions


Anonymous - Referee Report 1
September 21, 2017 - 08:00

This was an interesting paper to read. I strongly agree that the “common trends” assumption is often not tenable; and that it can be tested when there is sufficient pretreatment data. I also agree that with sufficient pretreatment data alternative assumptions, such as “common acceleration” can identify a treatment effect. ...[more]

...

The problem is that this is all, I believe, pretty well known. So I do not see a methodological contribution here (although the issues are laid out nicely). These issues are discussed in standard textbooks. For example, Angrist and Pischke’s well-known “Mostly Harmless Econometrics” from 2008 discusses the common trends assumption and the inclusion of group specific trends to relax that assumption (and cites earlier papers that do this). The Mora & Reggio paper that the author does cite does not really offer any methodological innovation, but does offer a nice taxonomy and nomenclature for alternatives to the common trends assumption in standing difference-in-difference designs (the Mora & Reggio paper has never been published although they did publish a STATA Journal article introducing a software package that implements the various alternatives).

So the contribution of this paper would need to lie in the empirical application, rather than the methodical discussion. I am less qualified to judge the contribution here. However, I do have a further concern. It is now widely appreciated that standard inference methods are not appropriate in difference-in-difference (and related) settings where the number of groups are small. There are particular challenges when, as in this case, there is a single treated unit. Methods to deal with these situations have been developed by, eg., Conley and Taber (ReStat,2011) and by Abadie et al. (JASA, 2010). Appropriate methods do not seem to have been applied here.