Abstract
Data dimensionality reduction is a long-standing pre-processing step in machine learning algorithms. Many of the efficient methods are devised to reduce the dimensionality of data very effectively; however, they are incapable of recovering the original data. But the autoencoders are effective not only in reducing the dimensionality but also reconstructing the original data. In this paper, we are attempting to explore the dimensionality reduction capability of autoencoders, and try to comprehend the difference between autoencoder and PCA dimensionality reduction methods. Experiments are conducted on both the methods using MNIST datasets. The results show that the autoencoder can indeed learn somewhat dissimilar from PCA method.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Hotelling, H.: Analysis of a complex of statistical variables into principal components. J. Educ. Psychol. 24, 417–441 (1933)
Mika, S., Schölkopf, B., Smola, A.J., Müller, K.-R., Scholz, M., Rätsch, G.: Kernel PCA and de-noising in feature spaces. In: Advances in Neural Information Processing Systems, vol. 11. The MIT Press, Cambridge, MA, USA (1999)
Bell, A.J., Sejnowski, T.J.: An information maximization approach to blind separation and blind deconvolution. Neural Comput. 7(6), 1129–1159 (1995)
Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500), 2323–2326 (2000)
Tenenbaum, J.B.: Mapping a manifold of perceptual observations. In: Advances in Neural Information Processing Systems, vol. 10, pp. 682–688. The MIT Press, Cambridge, MA, USA (1998)
Tenenbaum, J.B., de Silva, V., Langford, J.C.: A global geometric framework for nonlinear dimensionality reduction. Science 290(5500), 2319–2323 (2000)
Van der Maaten, L.: A New Benchmark Dataset for Handwritten Character Recognition. Tilburg University (2009)
Krizhevsky, A., Geoff, H.: Convolutional deep belief networks on CIFAR-10. Unpublished Manuscript 40(7) (2010)
Fei-Fei, L., Fergus, R., Perona, P.: Learning generative visual models from few training examples: an incremental Bayesian approach tested on 101 object categories. In: CVPR 2004, Workshop on Generative-Model Based Vision. IEEE (2004)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Janakiramaiah, B., Kalyani, G., Narayana, S., Bala Murali Krishna, T. (2020). Reducing Dimensionality of Data Using Autoencoders. In: Satapathy, S., Bhateja, V., Mohanty, J., Udgata, S. (eds) Smart Intelligent Computing and Applications . Smart Innovation, Systems and Technologies, vol 160. Springer, Singapore. https://doi.org/10.1007/978-981-32-9690-9_6
Download citation
DOI: https://doi.org/10.1007/978-981-32-9690-9_6
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-32-9689-3
Online ISBN: 978-981-32-9690-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)