Abstract
In this paper, we explore the performance of Linear Discriminant Analysis (LDA) by replacing the scatter matrix with the distance matrix for image classification. First we present the intuitive arguments for using the distance matrix in LDA. Based on the experiments on face image database, it is observed that the performance in terms of prediction accuracy is better when the distance matrix is used instead of scatter matrix in Linear Discriminant Analysis (LDA) under certain circumstances. Above all, it is observed consistently that the variation of percentage of success with the selection of training set is less when distance matrix is used when compared with the case when scatter matrix is used. The results obtained from the experiments recommend the usage of distance matrix in place of scatter matrix in LDA. The relationship between the scatter matrix and the proposed distance matrix is also deduced.
Keywords
- Principal component analysis (PCA)
- Linear discriminant analysis (LDA)
- Inner product
- Similarity measurements
This is a preview of subscription content, access via your institution.
Buying options
Preview
Unable to display preview. Download preview PDF.
References
Jolliffe, T.: Principal Component Analysis. Springer Verlag (1986)
Hyvarinen, A.: Survey on Independent Component Analysis. Neural Computing Surveys 2, 94–128 (1999)
Park, C., Park, H.: A Comparison of generalized linear discriminant analysis algorithms. Pattern Recognition 41, 1083–1097 (2008)
Nenadic, Z.: Information discriminant analysis:Feature Extraction with an Information-Theoritic objective. IEEE Transactions on Pattern Analysis and Machine Intelligence 29(8), 1394–1407 (2007)
Fisher, R.A.: The use of Multiple Measures in Taxonomic Problems. Ann. Eugenics 7, 179–188 (1936)
Kumar, N., Andreou, A.G.: Heteroscedastic Discriminant Analysis and Reduced Rank HMMs for Improved Speech Recognition. Speech Comm. 26, 283–297 (1998)
Torkkola, K.: Discriminative Features for Document Classification. In: Proceedings of 16th International Conference on Pattern Recognition, pp. 472–475 (2002)
Chen, L.-F., Liao, H.-Y.M., Ko, M.-T., Lin, J.-C., Yu, G.-J.: A New LDA-Based Face Recognition System which Can Solve the Small Sample Size Problem. Pattern Recognition 33(10), 1713–1726 (2000)
Cevikalp, H., Wilkes, M.: Discriminative Common vectors for Face Recognition. IEEE Transactions in Pattern Analysis and Machine Intelligence 27(1), 4–13 (2005)
Martinez, A.M., Kak, A.C.: PCA versus LDA. IEEE Transactions in Pattern Analysis and Machine Intelligence 23(2), 228–233 (2001)
Bishop, C.M.: Pattern recognition and Machine intelligece (2006)
Strang, G.: Linear algebra and its applications, pp. 102–107. Thomson, Brooks/Cole (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Gopi, E.S., Palanisamy, P. (2014). Scatter Matrix versus the Proposed Distance Matrix on Linear Discriminant Analysis for Image Pattern Recognition. In: Kumar Kundu, M., Mohapatra, D., Konar, A., Chakraborty, A. (eds) Advanced Computing, Networking and Informatics- Volume 1. Smart Innovation, Systems and Technologies, vol 27. Springer, Cham. https://doi.org/10.1007/978-3-319-07353-8_12
Download citation
DOI: https://doi.org/10.1007/978-3-319-07353-8_12
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-07352-1
Online ISBN: 978-3-319-07353-8
eBook Packages: EngineeringEngineering (R0)