Survey Item Nonresponse and its Treatment

  • Susanne Rässler
  • Regina T. Riphahn

Abstract

One of the most salient data problems empirical researchers face is the lack of informative responses in survey data. This contribution briefly surveys the literature on item nonresponse behavior and its determinants before it describes four approaches to address item nonresponse problems: Casewise deletion of observations, weighting, imputation, and model-based procedures. We describe the basic approaches, their strengths and weaknesses and illustrate some of their effects using a simulation study. The paper concludes with some recommendations for the applied researcher.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Barnard, J., Rubin, D. B. (1999). Small-sample degrees of freedom with multiple imputation. Biometrika86 948–955.MATHCrossRefMathSciNetGoogle Scholar
  2. Dempster, A. P., Laird, N. M., Rubin, D. B. (1977). Maximum likelihood estimation from incomplete data via the EM algorithm (with discussion). Journal of the Royal Statistical Society, Series B39 1–38.MATHMathSciNetGoogle Scholar
  3. Deville, J. C, Särndal, C. E. (1992). Calibration estimators in survey sampling. Journal of the American Statistical Association87 376–382.MATHCrossRefMathSciNetGoogle Scholar
  4. Deville, J.C., Särndal, C. E., Sautory, O, (1993). Generalized raking procedures in survey sampling. Journal of the American Statistical Association88 1013–1020.MATHCrossRefGoogle Scholar
  5. Dillman, D. A., Eltinge, J. L., Groves, R. M., Little, R. J. A. (2002). Survey nonresponse in design, data collection, and analysis. In Survey Nonresponse (R.M. Groves, D. A. Dillman, J. L. Eltinge, R.J.A. Little, eds.), 3–26. Wiley, New York.Google Scholar
  6. Esser, H. (1984). Determinanten des Interviewer-und Befragtenverhaltens: Probleme der theoretischen Erklärung und empirischen Untersuchung von Interviewereffekten. In Allgemeine Bevölkerungsumfrage der Sozialwissenschaften (K. Mayer, P. Schmidt, eds.), 26–71. Campus, Frankfurt.Google Scholar
  7. Frick, J. R., Grabka, M. M. (2003). Missing income data in the German SOEP: Incidence, imputation and its impact on the income distribution. DIW Discussion Papers 376, DIW Berlin.Google Scholar
  8. Gelman, A., Carlin, J. B. (2002). Poststratification and weighting adjustment. In Survey Nonresponse (R. M. Groves, D. A. Dillman, J. L. Eltinge, R. J. A. Little, eds.), 289–302. Wiley, New York.Google Scholar
  9. Glynn, R., Laird, N.M., Rubin, D. B. (1986). Selection modeling versus mixture modeling with nonignorable nonresponse. In Drawing Inferences from Self-Selected Samples (H. Wainer, ed.), 119–146. Springer, New York.Google Scholar
  10. Groves, R. M., Dillman, D. A., Eltinge, J. L., Little, R. J. A. (2002). Survey Nonresponse. Wiley, New York.MATHGoogle Scholar
  11. Hartley, H. O., Hocking, R. R. (1971). The analysis of incomplete data. Biometrics27 783–808.CrossRefGoogle Scholar
  12. Heckman, J. J. (1976). The common structure of statistical models of truncation, sample selection and limited dependent variables and a simple estimator for such models. Annals of Economic and Social Measurement5 475–492.Google Scholar
  13. Horton, N. J., Lipsitz, S. R. (2001). Multiple imputation in practice: Comparison of software packages for regression models with missing variables. American Statistician55 244–254.CrossRefMathSciNetGoogle Scholar
  14. Lee, H., Rancourt, E., Särndal, C. E. (2002). Variance estimation from survey data under single imputation. In Survey Nonresponse (R. M. Groves, D. A. Dillman, J. L. Eltinge, R. J. A. Little, eds.), 315–328. Wiley, New York.Google Scholar
  15. Little, R. J. A. (1993). Pattern-mixture models for multivariate incomplete data. Journal of the American Statistical Association 88 125–134.MATHCrossRefGoogle Scholar
  16. Little, R. J. A., Rubin, D. B. (1987, 2002). Statistical analysis with missing data. 1. and 2. ed., Wiley, Hoboken, New Jersey.MATHGoogle Scholar
  17. Madow, W. G., Olkin, I., Rubin, D.B. (1983). Incomplete Data in Sample Surveys. Academic Press, New York.Google Scholar
  18. McLachlan, G. J., Krishnan, T. (1997). The EM Algorithm and Extensions. Wiley, New York.MATHGoogle Scholar
  19. Münnich, R., Rässler, S. (2005). PRIMA: A new multiple imputation procedure for binary variables. Journal of Official Statistics (to appear).Google Scholar
  20. Oh, J.L., Scheuren, F. (1983). Weighting adjustment for unit nonresponse. In Incomplete Data in Sample Surveys 2 (W. G. Madow, I. Olkin, D. B. Rubin, eds.), 143–184. Academic Press, New York.Google Scholar
  21. Raghunathan, T. E., Rubin, D.B. (1998). Roles for Bayesian Techniques in Survey Sampling. Proceedings of the Silver Jubilee Meeting of the Statistical Society of Canada 51–55.Google Scholar
  22. Rässler, S., Rubin, D.B., Schenker, N. (2003). Imputation. In Encyclopedia of Social Science Research Methods (A. Bryman, M. Lewis-Beck, T.F. Liao, eds.), 477–482. Sage, Thousand Oaks.Google Scholar
  23. Rässler, S., Schnell, R. (2004). Multiple imputation for unit nonresponse versus weighting including a comparison with a nonresponse follow-up study. Diskussionspapier der Lehrstühle für Statistik 65/2004, Nürnberg.Google Scholar
  24. Riphahn, R. T., Serfling, O. (2002). Item non-response on income and wealth questions. IZA Discussion Paper No. 573, IZA Bonn.Google Scholar
  25. Riphahn, R. T., Serfling, O. (2005). Item non-response on income and wealth questions. Empirical Economics (to appear).Google Scholar
  26. Rubin, D. B. (1972). A non-iterative algorithm for least squares estimation of missing values in any analysis of variance design. The Journal of the Royal Statistical Society, Series C21 136–141.Google Scholar
  27. Rubin, D.B. (1974). Characterizing the estimation of parameters in incomplete-data problems. Journal of the American Statistical Association69 467–474.MATHCrossRefGoogle Scholar
  28. Rubin, D. B. (1976). Inference and missing data. Biometrika63 581–592.MATHCrossRefMathSciNetGoogle Scholar
  29. Rubin, D.B. (1978). Multiple imputation in sample surveys-a phenomenological Bayesian approach to nonresponse. Proceedings of the Survey Research Methods Sections of the American Statistical Association 20–40.Google Scholar
  30. Rubin, D. B. (1987, 2004). Multiple Imputation for Nonresponse in Surveys. 1. and 2. ed., Wiley, Hoboken, New Jersey.Google Scholar
  31. Rubin, D. B. (1996). Multiple imputation after 18+ years (with discussion). Journal of the American Statistical Association91 473–489.MATHCrossRefGoogle Scholar
  32. Rubin, D. B., Schenker, N. (1986). Multiple imputation for interval estimation from simple random samples with ignorable nonresponse. Journal of the American Statistical Association81 366–374.MATHCrossRefMathSciNetGoogle Scholar
  33. Schafer, J. L. (1997). Analysis of Incomplete Multivariate Data. Chapman and Hall, London.MATHGoogle Scholar
  34. Schräpler, J. P. (2004). Respondent behavior in panel studies. A case study for income nonresponse by means of the Germany Socio-Economic Panel (SOEP). Sociological Methods and Research33 118–156.CrossRefMathSciNetGoogle Scholar
  35. Sudman, S., Bradburn, N. M., Schwarz, N. (1996). Thinking about Answers. The Application of Cognitive Processes to Survey Methodology. Jossey Bass Publishers, San Francisco.Google Scholar

Copyright information

© Springer Berlin · Heidelberg 2006

Authors and Affiliations

  • Susanne Rässler
    • 1
  • Regina T. Riphahn
    • 2
  1. 1.Kompetenzzentrum für Empirische MethodenIAB Institut für Arbeitsmarkt- und BerufsforschungDeutschland
  2. 2.Lehrstuhl für Statistik und empirische WirtschaftsforschungUniversität Erlangen-NürnbergDeutschland

Personalised recommendations