Synthetic control method

From HandWiki

The synthetic control method is a statistical method used to evaluate the effect of an intervention in comparative case studies. It involves the construction of a weighted combination of groups used as controls, to which the treatment group is compared.[1] This comparison is used to estimate what would have happened to the treatment group if it had not received the treatment. Unlike difference in differences approaches, this method can account for the effects of confounders changing over time, by weighting the control group to better match the treatment group before the intervention.[2] Another advantage of the synthetic control method is that it allows researchers to systematically select comparison groups.[3] It has been applied to the fields of political science,[3] health policy,[2] criminology,[4] and economics.[5]

The synthetic control method combines elements from matching and difference-in-differences techniques. Difference-in-differences methods are often-used policy evaluation tools that estimate the effect of an intervention at an aggregate level (e.g. state, country, age group etc.) by averaging over a set of unaffected units. Famous examples include studies of the employment effects of a raise in the minimum wage in New Jersey fast food restaurants by comparing them to fast food restaurants just across the border in Philadelphia that were unaffected by a minimum wage raise,[6] and studies that look at crime rates in southern cities to evaluate the impact of the Mariel boat lift on crime.[7] The control group in this specific scenario can be interpreted as a weighted average, where some units effectively receive zero weight while others get an equal, non-zero weight.

The synthetic control method tries to offer a more systematic way to assign weights to the control group. It typically uses a relatively long time series of the outcome prior to the intervention and estimates weights in such a way that the control group mirrors the treatment group as closely as possible. In particular, assume we have J observations over T time periods where the relevant treatment occurs at time [math]\displaystyle{ T_{0} }[/math] where [math]\displaystyle{ T_{0}\lt T. }[/math] Let

[math]\displaystyle{ \alpha_{it}=Y_{it}-Y^N_{it}, }[/math]

be the treatment effect for unit [math]\displaystyle{ i }[/math] at time [math]\displaystyle{ t }[/math], where [math]\displaystyle{ Y^N_{it} }[/math] is the outcome in absence of the treatment. Without loss of generality, if unit 1 receives the relevant treatment, only [math]\displaystyle{ Y^N_{1t} }[/math]is not observed for [math]\displaystyle{ t\gt T_{0} }[/math]. We aim to estimate [math]\displaystyle{ (\alpha_{1T_{0}+1}......\alpha_{1T}) }[/math].

Imposing some structure

[math]\displaystyle{ Y^N_{it}=\delta_{t}+\theta_{t}Z_{i}+\lambda_{t}\mu_{i}+\varepsilon_{it} }[/math]

and assuming there exist some optimal weights [math]\displaystyle{ w_2, \ldots, w_J }[/math] such that

[math]\displaystyle{ Y_{1t} = \Sigma^J_{j=2} w_{j}Y_{jt} }[/math]

for [math]\displaystyle{ t\leqslant T_{0} }[/math], the synthetic controls approach suggests using these weights to estimate the counterfactual

[math]\displaystyle{ Y^N_{1t}=\Sigma^J_{j=2}w_{j}Y_{jt} }[/math]

for [math]\displaystyle{ t\gt T_{0} }[/math]. So under some regularity conditions, such weights would provide estimators for the treatment effects of interest. In essence, the method uses the idea of matching and using the training data pre-intervention to set up the weights and hence a relevant control post-intervention.[8]

Synthetic controls have been used in a number of empirical applications, ranging from studies examining natural catastrophes and growth,[9] studies that examine the effect of vaccine mandates on childhood immunisation,[10] and studies linking political murders to house prices.[11]

See also

References

  1. Abadie, Alberto (2021). "Using Synthetic Controls: Feasibility, Data Requirements, and Methodological Aspects" (in en). Journal of Economic Literature 59 (2): 391–425. doi:10.1257/jel.20191450. ISSN 0022-0515. 
  2. 2.0 2.1 Kreif, Noémi; Grieve, Richard; Hangartner, Dominik; Turner, Alex James; Nikolova, Silviya; Sutton, Matt (December 2016). "Examination of the Synthetic Control Method for Evaluating Health Policies with Multiple Treated Units". Health Economics 25 (12): 1514–1528. doi:10.1002/hec.3258. PMID 26443693. 
  3. 3.0 3.1 Abadie, Alberto; Diamond, Alexis; Hainmueller, Jens (February 2015). "Comparative Politics and the Synthetic Control Method". American Journal of Political Science 59 (2): 495–510. doi:10.1111/ajps.12116. 
  4. Saunders, Jessica; Lundberg, Russell; Braga, Anthony A.; Ridgeway, Greg; Miles, Jeremy (3 June 2014). "A Synthetic Control Approach to Evaluating Place-Based Crime Interventions". Journal of Quantitative Criminology 31 (3): 413–434. doi:10.1007/s10940-014-9226-5. 
  5. Billmeier, Andreas; Nannicini, Tommaso (July 2013). "Assessing Economic Liberalization Episodes: A Synthetic Control Approach". Review of Economics and Statistics 95 (3): 983–1001. doi:10.1162/REST_a_00324. 
  6. Card, D.; Krueger, A. (1994). "Minimum Wages and Employment: A Case Study of the Fast-Food Industry in New Jersey and Pennsylvania". American Economic Review 84 (4): 772–793. 
  7. Billy, Alexander (2022). "Crime and the Mariel Boatlift". International Review of Law and Economics 72: 106094. doi:10.1016/j.irle.2022.106094. https://www.sciencedirect.com/science/article/pii/S0144818822000503. 
  8. Abadie, A.; Diamond, A.; Hainmüller, J. (2010). "Synthetic Control Methods for Comparative Case Studies: Estimating the Effect of California's Tobacco Control Program". Journal of the American Statistical Association 105 (490): 493–505. doi:10.1198/jasa.2009.ap08746. http://papers.nber.org/papers/w12831.pdf. 
  9. Cavallo, E.; Galliani, S.; Noy, I.; Pantano, J. (2013). "Catastrophic Natural Disasters and Economic Growth". Review of Economics and Statistics 95 (5): 1549–1561. doi:10.1162/REST_a_00413. http://www.economics.hawaii.edu/research/workingpapers/WP_10-6.pdf. 
  10. Li, Ang.; Toll, Mathew. (2020). "Removing conscientious objection: The impact of 'No Jab No Pay' and 'No Jab No Play' vaccine policies in Australia". Preventive Medicine 145: 106406. doi:10.1016/j.ypmed.2020.106406. ISSN 0091-7435. PMID 33388333. https://www.sciencedirect.com/science/article/abs/pii/S0091743520304370. 
  11. Gautier, P. A.; Siegmann, A.; Van Vuuren, A. (2009). "Terrorism and Attitudes towards Minorities: The effect of the Theo van Gogh murder on house prices in Amsterdam". Journal of Urban Economics 65 (2): 113–126. doi:10.1016/j.jue.2008.10.004.