Abstract
Feature extraction is a hot topic in machine learning and pattern recognition. This paper proposes a new nonparametric linear feature extraction method called nonparametric discriminant analysis based on the trace ratio criterion (TRNDA). The motivation comes principally from the nonparametric maximum margin criterion (NMMC). Based on nonparametric extensions of commonly used scatter matrices, an NMMC is one of the effective nonparametric methods of discriminant analysis for linear feature extraction. However, it is sensitive to outliers. By the proposed TRNDA, new scatter matrices are designed for reducing the influence of outliers, and the trace ratio algorithm is used to learn a set of orthogonal projections in succession. We evaluate the proposed method by several benchmark datasets and the results confirm its effectiveness.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Fukunaga, K.: Introduction to Statistical Pattern Recognition, 2nd edn. Academic Press, New York (1990)
Fukunaga, K., Mantock, J.M.: Nonparametric discriminant analysis. IEEE Trans. Pattern Anal. Mach. Intell. 6, 671–678 (1983)
Li, Z., Lin, D., Tang, X.: Nonparametric discriminant for face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(4), 755–761 (2009)
Yan, S., Xu, D., Zhang, B., Zhang, H.J., Yang, Q., Lin, S.: Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans. Pattern Anal. Mach. Intell. 29(1), 40–51 (2007)
Qiu, X., Wu, L.: Nonparametric Maximum Margin Criterion for Face Recognition. In: IEEE International Conference on Image Processing. ICIP 2005, 2, 918—921, IEEE press, (2005)
Gu, Z., Yang, J., Zhang, L.: Push-pull marginal discriminant analysis for feature extraction. Pattern Recogn. Lett. 31(15), 2345–2352 (2010)
Yang, N., He, R., Zheng, W.S., Wang, X.: Robust large margin discriminant tangent analysis for face recognition. J. Neural Comput. Appl. 21(2), 269–279 (2012)
Wang, H., Yan, S., Xu, D., Tang, X., Huang, T.: Trace ratio vs. ratio trace for dimensionality reduction. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8. IEEE press (2007)
Yan, S., Tang, X.: Trace quotient problems revisited. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 232–244. Springer, Heidelberg (2006)
Zhao, M., Zhang, Z., Chow, T.W. S.: ITR-score algorithm: an efficient trace ratio criterion based algorithm for supervised dimensionality reduction. In: The 2011 International Joint Conference on Neural Networks, pp. 145–152. IEEE press (2011)
Ngo, T.T., Bellalij, M., Saad, Y.: The trace ratio optimization problem. J. SIAM Rev. 54(3), 545–569 (2012)
Wang, L., Sugiyama, M., Yang, C., Zhou, Z.H., Feng, J.: On the margin explanation of boosting algorithms. In: COLT, pp. 479–490 (2008)
Schapire, R.E., Freund, Y., Bartlett, P., Lee, W.S.: Boosting the margin: a new explanation for the effectiveness of voting methods. In: Proceedings of the Fourteenth International Conference on Machines Learning, Nashville, Tennessee, USA, pp. 1651–1686 (1998)
Li, G., Wen, C., Wei, W., Xu, Y., Ding, J., Zhao, G., Shi, L.: Trace ratio criterion for feature extraction in classification. J. Math. Probl. Eng. 2014, 1–9 (2014)
ORL dataset. http://www.cad.zju.edu.cn/home/dengcai/Data/FaceData.html
XM2VTS dataset. http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/
YALE B dataset. http://www.cad.zju.edu.cn/home/dengcai/Data/FaceData.html
Acknowledgments
We would like to thank the associate editor and all anonymous reviewers for their constructive comments and suggestions. This research was partially supported by the National Science Foundation of China (Grant No. 61101246) and the Fundamental Research Funds for the Central Universities (Grant No. JB150209).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Liu, J., Ge, Q., Liu, Y., Dai, J. (2015). Nonparametric Discriminant Analysis Based on the Trace Ratio Criterion. In: He, X., et al. Intelligence Science and Big Data Engineering. Image and Video Data Engineering. IScIDE 2015. Lecture Notes in Computer Science(), vol 9242. Springer, Cham. https://doi.org/10.1007/978-3-319-23989-7_27
Download citation
DOI: https://doi.org/10.1007/978-3-319-23989-7_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23987-3
Online ISBN: 978-3-319-23989-7
eBook Packages: Computer ScienceComputer Science (R0)