Empirical Economics

, Volume 52, Issue 3, pp 925–954 | Cite as

Assessing the evidence on neighborhood effects from Moving to Opportunity

Article

Abstract

The Moving to Opportunity (MTO) experiment randomly assigned housing vouchers that could be used in low-poverty neighborhoods. Consistent with the literature, I find that receiving an MTO voucher had no effect on outcomes like earnings, employment, and test scores. However, after studying the assumptions identifying neighborhood effects with MTO data, this paper reaches a very different interpretation of these results than found in the literature. I first specify a model in which the absence of effects from the MTO program implies an absence of neighborhood effects. I present theory and evidence against two key assumptions of this model: that poverty is the only determinant of neighborhood quality and that outcomes only change across one threshold of neighborhood quality. I then show that in a more realistic model of neighborhood effects that relaxes these assumptions, the absence of effects from the MTO program is perfectly compatible with the presence of neighborhood effects. This analysis illustrates why the implicit identification strategies used in the literature on MTO can be misleading.

Keywords

Moving to Opportunity Neighborhood effect Program effect 

JEL Classification

C30 H50 I38 J10 R00 

References

  1. Aliprantis D (2015a) Covariates and causal effects: the problem of context. Federal Reserve Bank of Cleveland Working Paper 13-10RGoogle Scholar
  2. Aliprantis D (2015b) A distinction between causal effects in structural and rubin causal models. Federal Reserve Bank of Cleveland Working Paper 15-05Google Scholar
  3. Aliprantis D, Kolliner D (2015) Neighborhood poverty and neighborhood quality in the Moving to Opportunity experiment. Federal Reserve Bank of Cleveland Economic Commentary Number 2015-04. https://clevelandfed.org/~/media/content/newsroom%20and%20events/publications/economic%20commentary/2015/ec%20201504%20neighborhood%20poverty/ec%20201504%20neighborhood%20poverty%20and%20quality%20in%20the%20moving%20to%20opportunity%20experiment%20pdf.pdf?la=en
  4. Aliprantis D, Richter FG-C (2016) Evidence of neighborhood effects from Moving to Opportunity: LATEs of neighborhood quality. Federal Reserve Bank of Cleveland Working Paper no. 12-08R. http://dionissialiprantis.com/pdfs/LATEs_of_nbd_quality_REStat1.pdf
  5. Angrist JD (2014) The perils of peer effects. Labour Econ. doi:10.1016/j.labeco.2014.05.008
  6. Angrist JD, Imbens GW (1995) Two-stage least squares estimation of average causal effects in models with variable treatment intensity. J Am Stat Assoc 90(430):431–442CrossRefGoogle Scholar
  7. Angrist JD, Pischke J-S (2010) The credibility revolution in empirical economics: how better research design is taking the con out of econometrics. J Econ Perspect 24(2):3–30CrossRefGoogle Scholar
  8. Brock W, Durlauf S (2007) Identification of binary choice models with social interactions. J Econom 140(1):52–75CrossRefGoogle Scholar
  9. Carneiro P, Heckman JJ, Vytlacil EJ (2011) Estimating marginal returns to education. Am Econ Rev 101(6):2754–2781CrossRefGoogle Scholar
  10. Clampet-Lundquist S, Massey DS (2008) Neighborhood effects on economic self-sufficiency: a reconsideration of the Moving to Opportunity experiment. Am J Sociol 114(1):107–143CrossRefGoogle Scholar
  11. de Souza Briggs X, Popkin SJ, Goering J (2010) Moving to Opportunity: the story of an American experiment to fight ghetto poverty. Oxford University Press, OxfordCrossRefGoogle Scholar
  12. DeLuca S, Rosenbaum JE (2003) If low-income blacks are given a chance to live in white neighborhoods, will they stay? Examining mobility patterns in a quasi-experimental program with administrative data. Hous Policy Debate 14(3):305–345CrossRefGoogle Scholar
  13. Friedman M (1955) The role of government in education. In: Solo R (ed) Economics and the public interest. Rutgers University Press, New BrunswickGoogle Scholar
  14. Gennetian LA, Sciandra M, Sanbonmatsu L, Ludwig J, Katz LF, Duncan GJ, Kling JR, Kessler RC (2012) The long-term effects of Moving to Opportunity on youth outcomes. Cityscape 14(2):137–167Google Scholar
  15. Goering J (2003) The impacts of new neighborhoods on poor families: evaluating the policy implications of the Moving to Opportunity demonstration. Econ Policy Rev 9(2):113–140Google Scholar
  16. Heckman JJ (2010) Building bridges between structural and program evaluation approaches to evaluating policy. J Econ Lit 48(2):356–398CrossRefGoogle Scholar
  17. Heckman JJ, Urzúa S, Vytlacil E (2006) Understanding instrumental variables in models with essential heterogeneity. Rev Econ Stat 88(3):389–432CrossRefGoogle Scholar
  18. Heckman JJ, Vytlacil E (2005) Structural equations, treatment effects, and econometric policy evaluation. Econometrica 73(3):669–738CrossRefGoogle Scholar
  19. Imbens G, Rubin D (2015) Causal inference for statistics, social, and biomedical sciences: an introduction. Cambridge University Press, CambridgeCrossRefGoogle Scholar
  20. Imbens GW, Angrist JD (1994) Identification and estimation of local average treatment effects. Econometrica 62(2):467–475CrossRefGoogle Scholar
  21. Keels M, Duncan GJ, Deluca S, Mendenhall R, Rosenbaum J (2005) Fifteen years later: can residential mobility programs provide a long-term escape from neighborhood segregation, crime, and poverty? Demography 42(1):51–73CrossRefGoogle Scholar
  22. Kling JR, Liebman JB, Katz LF (2007a) Experimental analysis of neighborhood effects. Econometrica 75(1):83–119CrossRefGoogle Scholar
  23. Kling JR, Liebman JB, Katz LF (2007b) Supplement to “Experimental analysis of neighborhood effects”: web appendix. Econometrica 75(1):83–119CrossRefGoogle Scholar
  24. Kling JR, Ludwig J, Katz LF (2005) Neighborhood effects on crime for female and male youths: evidence from a randomized housing voucher experiment. Q J Econ 120(1):87–130Google Scholar
  25. Ludwig J, Duncan GJ, Gennetian LA, Katz LF, Kessler RC, Kling JR, Sanbonmatsu L (2013) Long-term neighborhood effects on low-income families: evidence from Moving to Opportunity. Am Econ Rev 103(3):226–231CrossRefGoogle Scholar
  26. Ludwig J, Duncan GJ, Hirschfield P (2001) Urban poverty and juvenile crime: evidence from a randomized housing-mobility experiment. Q J Econ 116(2):655–679CrossRefGoogle Scholar
  27. Ludwig J, Kling JR (2007) Is crime contagious? J Law Econ 50(3):491–518CrossRefGoogle Scholar
  28. Ludwig J, Liebman JB, Kling JR, Duncan GJ, Katz LF, Kessler RC, Sanbonmatsu L (2008) What can we learn about neighborhood effects from the Moving to Opportunity experiment? Am J Sociol 114(1):144–188CrossRefGoogle Scholar
  29. Manski CF (1993) Identification of endogenous social effects: the reflection problem. Rev Econ Stud 60(3):531–542CrossRefGoogle Scholar
  30. Manski CF (2011) Choosing treatment policies under ambiguity. Annu Rev Econ 3:25–49CrossRefGoogle Scholar
  31. Manski CF (2013a) Identification of treatment response with social interactions. Econom J 16(1):S1–S23CrossRefGoogle Scholar
  32. Manski CF (2013b) Public policy in an uncertain world: analysis and decisions. Harvard University Press, CambridgeGoogle Scholar
  33. Mendenhall R, DeLuca S, Duncan G (2006) Neighborhood resources, racial segregation, and economic mobility: results from the Gautreaux program. Soc Sci Res 35(4):892–923CrossRefGoogle Scholar
  34. Minnesota Population Center (2004) National historical geographic information system (pre-release version 0.1 ed.). University of Minnesota, Minneapolis. http://www.nhgis.org
  35. Orr LL, Feins JD, Jacob R, Beecroft E, Sanbonmatsu L, Katz LF, Liebman JB, Kling JR (2003) Moving to Opportunity: interim impacts evaluation. US Department of Housing and Urban Development, Office of Policy Development and Research, Washington, DCGoogle Scholar
  36. Pearl J (2009) Causality: models, reasoning and inference, 2nd edn. Cambridge University Press, CambridgeCrossRefGoogle Scholar
  37. Pinto R (2014) Selection bias in a controlled experiment: the case of Moving to Opportunity. University of Chicago, ChicagoGoogle Scholar
  38. Polikoff A (2006) Waiting for Gautreaux. Northwestern University Press, EvanstonGoogle Scholar
  39. Quigley JM, Raphael S (2008) Neighborhoods, economic self-sufficiency, and the MTO program. Brook Whart Pap Urban Aff 8(1):1–46Google Scholar
  40. Rosenbaum JE (1995) Changing the geography of opportunity by expanding residential choice: lessons from the Gautreaux program. Hous Policy Debate 6(1):231–269CrossRefGoogle Scholar
  41. Rubin DB (1978) Bayesian inference for causal effects: the role of randomization. Ann Stat 6(1):34–58CrossRefGoogle Scholar
  42. Rubinowitz LS, Rosenbaum JE (2000) Crossing the class and color lines: from public housing to white suburbia. University of Chicago Press, ChicagoGoogle Scholar
  43. Sampson RJ (2008) Moving to inequality: neighborhood effects and experiments meet social structure. Am J Sociol 114(1):189–231CrossRefGoogle Scholar
  44. Sampson RJ (2012) Great American city: Chicago and the enduring neighborhood effect. The University of Chicago Press, ChicagoCrossRefGoogle Scholar
  45. Sampson RJ, Sharkey P, Raudenbush SW (2008) Durable effects of concentrated disadvantage on verbal ability among African-American children. Proc Natl Acad Sci USA 105(3):845–852CrossRefGoogle Scholar
  46. Sanbonmatsu L, Kling JR, Duncan GJ, Brooks-Gunn J (2006) Neighborhoods and academic achievement: results from the Moving to Opportunity experiment. J Hum Resour 41(4):649–691CrossRefGoogle Scholar
  47. Sanbonmatsu L, Marvakov J, Potter NA, Yang F, Adam E, Congdon WJ, Duncan GJ, Gennetian LA, Katz LF, Kling JR, Kessler RC, Lindau ST, Ludwig J, McDade TW (2012) The long-term effects of moving to opportunity on adult health and economic self-sufficiency. Cityscape 14(2):109–136Google Scholar
  48. Sobel ME (2006) What do randomized studies of housing mobility demonstrate? Causal inference in the face of interference. J Am Stat Assoc 101(476):1398–1407CrossRefGoogle Scholar
  49. Votruba ME, Kling JR (2009) Effects of neighborhood characteristics on the mortality of black male youth: evidence from Gautreaux, Chicago. Soc Sci Med 68(5):814–823CrossRefGoogle Scholar
  50. Wilson WJ (1987) The truly disadvantaged: the inner city, the underclass, and public policy. University of Chicago, ChicagoGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2017

Authors and Affiliations

  1. 1.Research DepartmentFederal Reserve Bank of ClevelandClevelandUSA

Personalised recommendations