Skip to main content

Alternative Methods for Solving the Problem of Selection Bias in Evaluating the Impact of Treatments on Outcomes

  • Chapter

Abstract

Social scientists never have access to true experimental data of the type sometimes available to laboratory scientists.1 Our inability to use laboratory methods to independently vary treatments to eliminate or isolate spurious channels of causation places a fundamental limitation on the possibility of objective knowledge in the social sciences. In place of laboratory experimental variation, social scientists use subjective thought experiments. Assumptions replace data. In the jargon of modern econometrics, minimal identifying assumptions are invoked.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Bibliography

  • Amemiya, T. (1981). “Qualitative response models: A survey.” J. Econ. Lit., 19, 1483–1536.

    Google Scholar 

  • Ashenfelter, O. (1978). “Estimating the effect of training programs on earnings.” Rev. Econ. Statist., 60, 47–57.

    Article  Google Scholar 

  • Barnow, B., Cain, G., and Goldberger, A. (1980). “Issues in the analysis of selectivity bias.” In E. Stromsdorfer and G. Farkas (eds.), Evaluation Studies, vol. 5. San Francisco: Sage.

    Google Scholar 

  • Barros, R. (1986). Three Essays on Selection and Identification Problems in Economics. Ph.D. thesis, University of Chicago, Chicago, Illinois.

    Google Scholar 

  • Bassi, L. (1983). Estimating the Effect of Training Programs with Nonrandom Selection. Ph.D. thesis, Princeton University, Princeton, New Jersey.

    Google Scholar 

  • Chamberlain, G. (1982). “Multivariate regression models for panel data.” J. Econometrics, 18, 1–46.

    Article  MathSciNet  Google Scholar 

  • Coleman, J.C. (1985). “Schools, families and children.” Ryerson Lecture, University of Chicago, April 1985.

    Google Scholar 

  • Cox, D.R. The Planning of Experiments. New York: John Wiley, (1958).

    Google Scholar 

  • Dawid, A.P. (1979). “Conditional independence in statistical theory” (with discussion). J. Roy. Statist. Soc. Ser. B, 41, 1–31.

    MathSciNet  Google Scholar 

  • Fienberg, S., Singer, B., and Tanur, J. (1985). “Large-scale social experimentation inthe United States.” In A.C. Atkinson and S. Fienberg (eds.), A Celebration of Statistics. Berlin/New York: Springer-Verlag.

    Google Scholar 

  • Fisher, R.A. (1953). The Design of Experiments. London: Hafner.

    Google Scholar 

  • Goldfeld, S. and Quandt, R. (1976). “Techniques for estimating switching regressions.” In S. Goldfeld and R. Quandt (eds.), Studies in Nonlinear Estimation. Cambridge, Massachusetts: Ballinger.

    Google Scholar 

  • Heckman, J. (1976). “Simultaneous equations models with continuous and discrete endogenous variables and structural shifts.” In S. Goldfeld and R. Quandt (eds.), Studies in Nonlinear Estimation. Cambridge, Massachusetts: Ballinger.

    Google Scholar 

  • Heckman, J. “Dummy endogenous variables in a simultaneous equations system.” Econometrica, 46, 931–961.

    Google Scholar 

  • Heckman, J. (1979). “Sample selection bias as a specification error.” Econometrica, 47, 153–161.

    Article  MathSciNet  MATH  Google Scholar 

  • Heckman, J. (1980). “Addendum to sample selection bias as a specification error.” In E. Stromsdorfer and G. Farkas (eds.), Evaluation Studies, vol. 5. San Francisco: Sage.

    Google Scholar 

  • Heckman, J. and Neumann, G. (1977). “Union wage differentials and the decision to join unions.” Unpublished manuscript, University of Chicago, Chicago, Illinois.

    Google Scholar 

  • Heckman, J. and Robb, R. (1985). “Alternative methods for evaluating the impact of interventions.” In J. Heckman and B. Singer (eds.), Longitudinal Analysis of Labor Market Data., New York: Cambridge University Press, pp. 156–245.

    Chapter  Google Scholar 

  • Heckman, J. and Wolpin, K. (1976). “Does the contract compliance program work?: An analysis of Chicago data.” Indust. Labor Relations Rev., 19, 415–433.

    Google Scholar 

  • Lee, L.F. (1978). “Unionism and wage rates: A simultaneous equations model with qualitative and limited dependent variables.” Intl. Econ. Rev., 19, 415–433.

    Article  MATH  Google Scholar 

  • Little, R.J. (1985). “A note about models for selectivity bias.” Econometrica, 53 (6), 1469–1474.

    Article  MATH  Google Scholar 

  • MaCurdy, T. (1982). “The use of time series processes to model the error structure of earnings in a longitudinal data analysis.” J. Econometrics, 18 (1), 83–114.

    Article  Google Scholar 

  • Manski, C. and Lerman, S. (1977). “The estimation of choice probabilities from choice-based samples.” Econometrica, 45, 1977–1988.

    Article  MathSciNet  MATH  Google Scholar 

  • Manski, C. and McFadden, D. (1981). “Alternative estimators and sample designs for discrete choice analysis.” In C. Manski and D. McFadden (eds.), Structural Analysis of Discrete Data with Econometric Applications. Cambridge, Massachusetts: MIT Press, pp. 117–136.

    Google Scholar 

  • Mundlak, Y. (1961). “Empirical production functions free of management bias.” J. Farm Econometrics, 43, 45–56.

    Google Scholar 

  • Mundlak, Y. (1978). “On the pooling of time series and cross section data.” Econometrica, 46, 69–85.

    Article  MathSciNet  MATH  Google Scholar 

  • Rosenbaum, P. and Rubin, D. (1983). “The central role of the propensity score in observational studies for causal effects.” Biometrika, 70, 41–55.

    Article  MathSciNet  MATH  Google Scholar 

  • Rosenbaum, P. and Rubin, D. (1985). “Constructing a control group using multivariate sampling methods that incorporate the propensity score.” Amer. Statist., 39 (1), 33–38.

    Article  MathSciNet  Google Scholar 

  • Roy, A. (1951). “Some thoughts on the distribution of earnings.” Oxford Econ. Pap., 3, 135–146.

    Google Scholar 

  • Rubin, D. (1977). “Formalizing subjective notions about the effects of nonrespondents in sample surveys.” J. Amer. Statist. Assoc., 72 (359), 538–543.

    Article  MathSciNet  MATH  Google Scholar 

  • Scheuren, F. (1985). “Evaluating manpower training: Some notes on data handling issues.” Report to JTLS Panel, U.S. Department of Labor, Washington, D.C.

    Google Scholar 

  • Simon, H. (1957). “Spurious correlation: A causal interpretation.” In H. Simon (ed.), Models of Man. New York: John Wiley, 37–49.

    Google Scholar 

Download references

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1986 Springer-Verlag New York Inc.

About this chapter

Cite this chapter

Heckman, J.J., Robb, R. (1986). Alternative Methods for Solving the Problem of Selection Bias in Evaluating the Impact of Treatments on Outcomes. In: Wainer, H. (eds) Drawing Inferences from Self-Selected Samples. Springer, New York, NY. https://doi.org/10.1007/978-1-4612-4976-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-1-4612-4976-4_7

  • Publisher Name: Springer, New York, NY

  • Print ISBN: 978-1-4612-9381-1

  • Online ISBN: 978-1-4612-4976-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics