Skip to main content

Quasi-experiments

  • Chapter
  • First Online:
Statistical Tools for Program Evaluation

Abstract

Quasi-experimental evaluation estimates the causal impact of an intervention based on observational data. The approach differs from a randomized controlled experiment in that the subjects are not randomly assigned between a treatment and a control group. Hence, the issue is to find a proper comparison group, the so-called counterfactual, that resembles the treatment group in everything but the fact of receiving the intervention (Sect. 14.1). Several methods exist. The differences in differences method uses panel data and calculates the effect of an intervention by comparing the changes in outcome over time between the treated and non-treated groups (Sect. 14.2). Propensity score matching relies on the estimation of scores (probability of participating in the treatment) to select and pair subjects with similar characteristics. The impact is then computed as the difference in means between the two selected groups (Sect. 14.3). Regression discontinuity design compares subjects in the vicinity of a cutoff point around which the intervention is dispensed. The underlying assumption is that subjects lying closely on either side of the threshold share similar characteristics (Sect. 14.4). Last, instrumental variable estimation addresses the problem of endogeneity in individual participation (Sect. 14.5). Examples are provided all along this chapter, with detailed R-CRAN programs, to provide the reader with a complete description of these approaches.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Ashenfelter, O., & Card, D. (1985). Using the longitudinal structure of earnings to estimate the effect of training programs. Review of Economics and Statistics, 67, 648ā€“660.

    ArticleĀ  Google ScholarĀ 

  • Basmann, R. L. (1957). A generalized classical method of linear estimation of coefficients in a structural equation. Econometrica, 25, 77ā€“83.

    ArticleĀ  Google ScholarĀ 

  • European Commission. (2013). Evalsed sourcebook: Method and techniques. Brussels: EC.

    Google ScholarĀ 

  • Hirano, K., & Imbens, G. (2004). The propensity score with continuous treatments. In Missing data and Bayesian methods. Hoboken, NJ: Wiley.

    Google ScholarĀ 

  • Imbens, G. (2014). Instrumental variables: An econometricianā€™s perspective (NBER Working Papers 19983). National Bureau of Economic Research.

    Google ScholarĀ 

  • Imbens, G. W., & Wooldridge, J. M. (2009). Recent developments in the econometrics of program evaluation. Journal of Economic Literature, 47, 5ā€“86.

    ArticleĀ  Google ScholarĀ 

  • Khandker, S. R., Koolwal, G. B., & Samad, H. A. (2010). Handbook on impact evaluation: Quantitative methods and practices. Washington, DC: World Bank.

    Google ScholarĀ 

  • Lee, D. S., & Lemieux, T. (2010). Regression discontinuity designs in economics. Journal of Economic Literature, 48, 281ā€“355.

    ArticleĀ  Google ScholarĀ 

  • McCrary, J. (2008). Manipulation of the running variable in the regression discontinuity design: A density test. Journal of Econometrics, 142, 698ā€“714.

    ArticleĀ  Google ScholarĀ 

  • Rosenbaum, P. R., & Rubin, D. B. (1983). The central role of the propensity score in observational studies for causal effects. Biometrika, 70, 41ā€“55.

    ArticleĀ  Google ScholarĀ 

  • Sargan, J. (1958). The estimation of economic relationships using instrumental variables. Econometrica, 26, 393ā€“415.

    ArticleĀ  Google ScholarĀ 

  • Stock, J. H., & Trebbi, F. (2003). Retrospectives: Who invented instrumental variable regression? Journal of Economic Perspectives, 17, 177ā€“194.

    ArticleĀ  Google ScholarĀ 

  • Theil, H. (1953). Estimation and simultaneous correlation in complete equation systems. Central Planning Bureau: The Hague.

    Google ScholarĀ 

  • Thistlewaite, D. L., & Campbell, D. T. (1960). Regression-discontinuity analysis: An alternative to the ex-post facto experiment. Journal of Educational Psychology, 51, 309ā€“317.

    ArticleĀ  Google ScholarĀ 

  • Wright, P. G. (1915). Mooreā€™s economic cycles. Quarterly Journal of Economics., 29, 631ā€“641.

    ArticleĀ  Google ScholarĀ 

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

Copyright information

Ā© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Josselin, JM., Le Maux, B. (2017). Quasi-experiments. In: Statistical Tools for Program Evaluation . Springer, Cham. https://doi.org/10.1007/978-3-319-52827-4_14

Download citation

Publish with us

Policies and ethics