Abstract
The missing value is a common phenomenon in real-world datasets, which makes the analysis of incomplete data become an active research area. In this paper, a correlation-enhanced auto-associative neural network (CE-AANN) is proposed for imputations of missing values. We design correlation-enhanced hidden neurons and combine them with traditional hidden neurons organically, thereby constructing CE-AANN. Compared with the traditional auto-associative neural network (AANN), the improved architecture can mine cross-correlations among attributes more effectively. The introduction of correlation-enhanced hidden neurons keeps the network from learning a meaningless identity mapping. Moreover, a training scheme named MVPT is used for network training. Missing values are regarded as variables of the loss function and adjusted dynamically based on optimization algorithms. The dynamic processing mechanism takes account of the incompleteness of data during training, which makes the imputation accuracy increase as the training goes further. Experiments validate the effectiveness of the proposed method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Garcíalaencina, P.J., Sanchogómez, J., Figueirasvidal, A.R.: Pattern classification with missing data: a review. Neural Comput. Appl. 19(2), 263–282 (2010)
Masoud, S.A., Negin, D.: Missing value imputation using a novel grey based fuzzy c-means, mutual information based feature selection, and regression model. Expert Syst. Appl. 115, 68–94 (2019)
Azim, S., Aggarwal, S.: Using fuzzy c means and multi layer perceptron for data imputation: simple v/s complex dataset. In: 2016 3rd International Conference on Recent Advances in Information Technology (RAIT), pp. 197–202. IEEE (2016)
Abdella, M., Marwala, T.: The use of genetic algorithms and neural networks to approximate missing data in database. In: 2015 3rd IEEE International Conference on Computational Cybernetics (ICCC), pp. 207–212. IEEE (2005)
Nelwamondo, F.V., Golding, D.: A dynamic programming approach to missing data estimation using neural networks. Inf. Sci. 237, 49–58 (2013)
Aydilek, I.B., Arslan, A.: A novel hybrid approach to estimating missing values in databases using k-nearest neighbors and neural networks. Int. J. Innovative Comput. Inf. Control 7(8), 4705–4717 (2012)
Ravi, V., Krishna, M.: A new online data imputation method based on general regression auto associative neural network. Neurocomputing 138, 106–113 (2014)
Gautam, C., Ravi, V.: Counter propagation auto-associative neural network based data imputation. Inf. Sci. 325, 288–299 (2015)
Mistry, F.J., Nelwamondo, F.V., Marwala, T.: Missing data estimation using principle component analysis and autoassociative neural networks. J. Syst. Cybern. Inf. 7(3), 72–79 (2009)
Goodfellow, I., Bengio, Y., Courville, A.: Deep Learning. MIT press, Cambridge (2016)
Acknowledgement
This work was supported by National Key R&D Program of China (2018YFB1700200).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Lai, X., Wu, X., Zhang, L., Zhang, G. (2019). Imputation Using a Correlation-Enhanced Auto-Associative Neural Network with Dynamic Processing of Missing Values. In: Lu, H., Tang, H., Wang, Z. (eds) Advances in Neural Networks – ISNN 2019. ISNN 2019. Lecture Notes in Computer Science(), vol 11554. Springer, Cham. https://doi.org/10.1007/978-3-030-22796-8_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-22796-8_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-22795-1
Online ISBN: 978-3-030-22796-8
eBook Packages: Computer ScienceComputer Science (R0)