Donor Limited Hot Deck Imputation: A Constrained Optimization Problem
Hot deck methods impute missing data by matching records that are complete to those that are missing values. Observations absent within the recipient are then replaced by replicating the values from the matched donor. Some hot deck procedures constrain the frequency with which any donor may be matched to increase the precision of post-imputation parameter-estimates. This constraint, called a donor limit, also mitigates risks of exclusively using one donor for all imputations or using one donor with an extreme value or values “too often.” Despite these desirable properties, imputation results of a donor limited hot deck are dependent on the recipients’ order of imputation, an undesirable property. For nearest neighbor type hot deck procedures, the implementation of a constraint on donor usage causes the stepwise matching between each recipient and its closest donor to no longer minimize the sum of all donor–recipient distances. Thus, imputation results may further be improved by procedures that minimize the total donor–recipient distance-sum. The discrete optimization problem is formulated and a simulation detailing possible improvements when solving this integer program is presented.
KeywordsDonor Limit Miss Data Mechanism Missingness Mechanism Multivariate Parameter Imputation Quality
- Bankhofer, U., & Joenssen, D. W. (2014). On limiting donor usage for imputation of missing data via hot deck methods. In M. Spiliopoulou, L. Schmidt–Thieme, & R. Jannings (Eds.), Data analysis, machine learning and knowledge discovery (pp. 3–11). Berlin: Springer.Google Scholar
- Domschke, W. (1995). Logistik: Transport. München: Oldenbourg.Google Scholar
- Enders, C. K. (2010). Applied missing data analysis. New York: Guilford.Google Scholar
- Ford B. (1983). An overview of hot-deck procedures. In W. Madow, H. Nisselson, & I. Olkin (Eds.), Incomplete data in sample surveys (pp. 185–207). New York: Academic Press.Google Scholar
- Genz, A., Bretz, F., Miwa, T., Mi, X., Leisch, F., Scheipl, F., et al. (2013). mvtnorm: Multivariate normal and distributions. R package version 0.9-9995. http://CRAN.R-project.org/package=mvtnorm.
- Joenssen, D. W. (2013). HotDeckImputation: Hot deck imputation methods for missing data. R package version 0.1.0. http://CRAN.R-project.org/package=HotDeckImputation.
- Kovar, J. G., & Whitridge, J. (1995). Imputation of business survey data. In B. G. Cox, D. A. Binder, B. N. Chinnappa, A. Christianson, M. J. Colledge, & P. S. Kott (Eds.), Business survey methods (pp. 403–423). New York: Wiley.Google Scholar
- R Core Team. (2013). R: A language and environment for statistical computing. R Vienna: Foundation for Statistical Computing. http://www.R-project.org/
- Reinfeld, N. V., & Vogel, W. R. (1958). Mathematical programming. New Jersey: Prentice-Hall.Google Scholar
- Sande I. (1983). Hot-deck imputation procedures. In W. Madow, H. Nisselson, & I. Olkin (Eds.), Incomplete data in sample surveys (pp. 339–349). New York: Academic Press.Google Scholar