Skip to main content

Remarks on the analysis of causal relationships in population research

Demography volume 42, pages 91–108 (2005)Cite this article

Abstract

The problem of determining cause and effect is one of the oldest in the social sciences, where laboratory experimentation is generally not possible. This article provides a perspective on the analysis of causal relationships in population research that draws upon recent discussions of this issue in the field of economics. Within economics, thinking about causal estimation has shifted dramatically in the past decade toward a more pessimistic reading of what is possible and a retreat in the ambitiousness of claims of causal determination. In this article, the framework that underlies this conclusion is presented, the central identification problem is discussed in detail, and examples from the field of population research are given. Some of the more important aspects of this framework are related to the problem of the variability of causal effects for different individuals; the relationships among structural forms, reduced forms, and knowledge of mechanisms; the problem of internal versus external validity and the related issue of extrapolation; and the importance of theory and outside evidence.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price includes VAT (USA)
Tax calculation will be finalised during checkout.

References

  • Adams, P., M. Hurd, D. McFadden, A. Merrill, and T. Ribeiro. 2003. “Healthy, Wealthy, and Wise? Tests for Direct Causal Paths Between Health and Socioeconomic Status.” Journal of Econometrics 112:3–56.

    Article  Google Scholar 

  • Angrist, J., G. Imbens, and D. Rubin. 1996. “Identification of Causal Effects Using Instrumental Variables.” Journal of the American Statistical Association 91:444–55.

    Article  Google Scholar 

  • Angrist, J. and A. Krueger. 1991. “Does Compulsory School Attendance Affect Schooling and Earnings?” Quarterly Journal of Economics 106:979–1014.

    Article  Google Scholar 

  • Björklund, A. and R. Moffitt. 1987. “Estimation of Wage Gains and Welfare Gains in Self-Selection Models.” Review of Economics and Statistics 69:42–49.

    Article  Google Scholar 

  • Bound, J., D. Jaeger, and R. Baker. 1995. “Problems With Instrumental Variables Estimation When the Correlation Between the Instruments and the Endogenous Explanatory Variable Is Weak.” Journal of the American Statistical Association 90:443–50.

    Article  Google Scholar 

  • Bound, J. and G. Solon. 1999. “Double Trouble: On the Value of Twins-Based Estimation of the Return to Schooling.” Economics of Education Review 18:169–82.

    Article  Google Scholar 

  • Duncan, G., K. Magnuson, and J. Ludwig. 2003. “The Endogeneity Problem in Developmental Studies.” Mimeographed. Institute for Policy Research, Northwestern University, Evanston, IL.

    Google Scholar 

  • Fricke, T. 2003. “Culture and Causality: An Anthropological Comment.” Population and Development Review 29:470–79.

    Article  Google Scholar 

  • Geronimus, A. and S. Korenman. 1992. “The Socioeconomic Consequences of Teen Childbearing Reconsidered.” Quarterly Journal of Economics 107:1187–214.

    Article  Google Scholar 

  • Geronimus, A., S. Korenman, and M. Hillemeier. 1994. “Does Maternal Age Adversely Affect Child Development? Evidence From Cousin Comparisons in the United States.” Population and Development Review 20:585–609.

    Article  Google Scholar 

  • Grogger, J. and S. Bronars. 1993. “The Socioeconomic Consequences of Teen Childbearing: Findings From a Natural Experiment.” Family Planning Perspectives 25:156–61.

    Article  Google Scholar 

  • Haavelmo, T. 1943. “The Statistical Implications of a System of Simultaneous Equations.” Econometrica 11:1–12.

    Article  Google Scholar 

  • — 1944. “The Probability Approach in Econometrics.” Econometrica 12(Suppl.):1–115.

    Google Scholar 

  • Heckman, J. 1978. “Dummy Endogenous Variables in a Simultaneous Equation System.” Econometrica 46:931–60.

    Article  Google Scholar 

  • — 2000. “Causal Parameters and Policy Analysis in Economics: A Twentieth Century Retrospective.” Quarterly Journal of Economics 115:45–97.

    Article  Google Scholar 

  • — 2004. “The Scientific Model of Causality.” Mimeographed. Department of Economics, University of Chicago.

    Google Scholar 

  • Heckman, J. and S. Navarro-Lozano. 2004. “Using Matching, Instrumental Variables and Control Functions to Estimate Economic Choice Models.” Review of Economics and Statistics 86: 30–57.

    Article  Google Scholar 

  • Heckman, J. and R. Robb. 1985. “Alternative Models for Evaluating the Impact of Interventions.” Pp. 156–245 in Longitudinal Analysis of Labor Market Data, edited by J. Heckman and B. Singer. Cambridge, England: Cambridge University Press.

    Chapter  Google Scholar 

  • Heckman, J. and E. Vytlacil. 1999. “Local Instrumental Variables and Latent Variable Models for Identifying and Bounding Treatment Effects.” Proceedings of the National Academy of Sciences 96:4730–34.

    Article  Google Scholar 

  • — 2001. “Policy-Relevant Treatment Effects.” American Economic Review 91: 107–11.

    Article  Google Scholar 

  • Heckman, J. and E. Vytlacil. Forthcoming. “The Econometric Evaluation of Social Programs.” In Handbook of Econometrics, Vol. 6, edited by J. Heckman and E. Leamer. New York: Elsevier.

  • Hoffman, S., E.M. Foster, and F. Furstenberg. 1993. “Re-evaluating the Costs of Teenage Childbearing.” Demography 30:1–13.

    Article  Google Scholar 

  • Holland, P. 1986. “Statistics and Causal Inference.” Journal of the American Statistical Association 81:945–60.

    Article  Google Scholar 

  • Hotz, V.J., S. McElroy, and S. Sanders. 1997. “The Impacts of Teenage Childbearing on the Mothers and the Consequences of Those Impacts for the Government.” Pp. 55–94 in Kids Having Kids: Economic Costs and Social Consequences of Teen Pregnancy, edited by R. Maynard. Washington, DC: Urban Institute Press.

    Google Scholar 

  • Hotz, V.J., C. Mullin, and S. Sanders. 1997. “Bounding Causal Effects Using Data From a Contaminated Natural Experiment: Analysing the Effect of Teenage Childbearing.” Review of Economic Studies 64:575–603.

    Article  Google Scholar 

  • Imbens, G. and J. Angrist. 1994. “Identification and Estimation of Local Average Treatment Effects.” Econometrica 62:467–76.

    Article  Google Scholar 

  • Kelley, A. and J. Williamson. 1984. What Drives Third World City Growth? A Dynamic General Equilibrium Approach. Princeton, NJ: Princeton University Press.

    Google Scholar 

  • Krueger, A. and J.-S. Pischke. 1992. “The Effect of Social Security on Labor Supply: A Cohort Analysis of the Notch Generation.” Journal of Labor Economics 10:412–37.

    Article  Google Scholar 

  • Kuznets, S. 1966. Modern Economic Growth. New Haven, CT: Yale University Press.

    Google Scholar 

  • Manski, C. 1995. Identification Problems in the Social Sciences. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Maynard, R., ed. 1997. Kids Having Kids: Economic Costs and Social Consequences of Teen Pregnancy. Washington, DC: Urban Institute.

    Google Scholar 

  • McFadden, D. 1974. “Conditional Logit Analysis of Qualitative Choice Behavior.” Pp. 105–42 in Frontiers in Econometrics, edited by P. Zarembka. New York: Academic Press.

    Google Scholar 

  • Moffitt, R. 1991. “Program Evaluation With Nonexperimental Data.” Evaluation Review 15: 291–314.

    Article  Google Scholar 

  • —. 2003. “Causal Analysis in Population Research: An Economist’s Perspective.” Population and Development Review 29:448–58.

    Article  Google Scholar 

  • Neyman, J. 1923. “On the Application of Probability Theory to Agricultural Experiments. Essay on Principles.” Roczniki Nauk Rolniczych 10:1–51 [in Polish], English translation of Section 9 by D.M. Dabrowska and T.P. Speed (1990), Statistical Science 9:465-80.

    Google Scholar 

  • — 1935. “Statistical Problems in Agricultural Experimentation.” Supplement to the Journal of the Royal Statistical Society 2:107–80.

    Article  Google Scholar 

  • Quandt, R. 1972. “Methods for Estimating Switching Regressions.” Journal of the American Statistical Association 67:306–10.

    Article  Google Scholar 

  • Robins, J.M. 1999. “Association, Causation, and Marginal Structural Models”. Synthese 121: 151–79.

    Article  Google Scholar 

  • Rosenbaum, P. 1995. Observational Studies. New York: Springer-Verlag.

    Google Scholar 

  • Rosenzweig, M. and K. Wolpin. 2000. “Natural ‘Natural Experiments’ in Economics.” Journal of Economic Literature 38:827–74.

    Article  Google Scholar 

  • Roy, A. 1951. “Some Thoughts on the Distribution of Earnings.” Oxford Economic Papers 3: 135–46.

    Google Scholar 

  • Rubin, D. 1974. “Estimating Causal Effects of Treatments in Randomized and Nonrandomized Studies.” Journal of Educational Psychology 66:688–701.

    Article  Google Scholar 

  • — 1978. “Bayesian Inference for Causal Effects.” Annals of Statistics 6:34–58.

    Article  Google Scholar 

  • Schultz, T.P. 1985. “Changing World Prices, Women’s Wages, and the Fertility Transition: Sweden 1860–1910.” Journal of Political Economy 93:1126–54.

    Article  Google Scholar 

  • Smith, H. 2003. “Some Thoughts on Causation as It Relates to Demography and Population Studies.” Population and Development Review 29:459–69.

    Article  Google Scholar 

  • Stock, J., J. Wright, and M. Yogo. 2002. “A Survey of Weak Instruments and Weak Identification in Generalized Method of Moments.” Journal of Business and Economic Statistics 20:518–29.

    Article  Google Scholar 

  • U.S. Department of Health and Human Services. 1995. Report to Congress on Out-of-Wedlock Childbearing. Washington, DC: U.S. Government Printing Office.

    Google Scholar 

  • Winship, C. and S. Morgan. 1999. “The Estimation of Causal Effects From Observational Data.” Annual Review of Sociology 25:659–706

    Article  Google Scholar 

  • Wu, L. and B. Wolfe, eds. 2001. Out of Wedlock: The Causes and Consequences of Nonmarital Fertility. New York: Russell Sage Foundation.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Economics, Johns Hopkins University, 3400 North Charles Street, 21218, Baltimore, MD

    Robert Moffitt

Authors
  1. Robert Moffitt
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

A previous version of this article, titled “Causal and Non-Causal Research in Population: An Economist’s Perspective,” was presented at the 2003 annual meeting of the Population Association of America, May 1-3, Minneapolis. The author thanks Chris Bachrach, Greg Duncan, Tom Fricke, Geoffrey McNicoll, Herb Smith, and two anonymous referees for their helpful discussions and comments.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Moffitt, R. Remarks on the analysis of causal relationships in population research. Demography 42, 91–108 (2005). https://doi.org/10.1353/dem.2005.0006

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1353/dem.2005.0006

Keywords

  • Instrumental Variable
  • Causal Effect
  • Internal Migration
  • Population Research
  • Teenage Birth