Abstract
A novel supervised dimensionality reduction algorithm, named discriminant embedding by sparse representation and nonparametric discriminant analysis (DESN), was proposed for face recognition. Within the framework of DESN, the sparse local scatter and multi-class nonparametric between-class scatter were exploited for within-class compactness and between-class separability description, respectively. These descriptions, inspired by sparse representation theory and nonparametric technique, are more discriminative in dealing with complex-distributed data. Furthermore, DESN seeks for the optimal projection matrix by simultaneously maximizing the nonparametric between-class scatter and minimizing the sparse local scatter. The use of Fisher discriminant analysis further boosts the discriminating power of DESN. The proposed DESN was applied to data visualization and face recognition tasks, and was tested extensively on the Wine, ORL, Yale and Extended Yale B databases. Experimental results show that DESN is helpful to visualize the structure of high-dimensional data sets, and the average face recognition rate of DESN is about 9.4%, higher than that of other algorithms.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
JAIN A, DUIN R, MAO J. Statistical pattern recognition: A review [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(1): 4–37.
JOLLIFFE I T. Principal component analysis, second edition [M]. New York: Springer-Verlag, 2002: 6–10.
BELHUMEUR P, HEPANHA J, KRIEGMAN D. Eigenfaces vs. fisherfaces: Recognition using class specific linear projection [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997, 19(7): 711–720.
LIN Tong, ZHA Hong-bin. Riemannian manifold learning [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(5): 796–809.
TENENBAUM J B, SILVA V D, LANGFORD J C. A global geometric framework for nonlinear dimensionality reduction [J]. Science, 2000, 290: 2319–2323.
ROWEIS S T, SAUL L K. Nonlinear dimensionality reduction by locally linear embedding [J]. Science, 2000, 290: 2323–2326.
HE Xiao-fei, CAI Deng, YAN Shui-cheng, ZHANG Hong-Jiang. Neighborhood preserving embedding [C]// Proceedings of the IEEE International Conference on Computer Vision (ICCV). New York: IEEE Computer Society, 2005: 1208–1213.
HE Xiao-fei, YAN Shui-cheng, HU Yu-xiao, NIYOGI P, ZHANG Hong-Jiang. Face recognition using Laplacianfaces [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(3): 328–340.
YAN Shui-cheng, XU Dong, ZHANG Ben-yu, ZHANG Hong-Jiang, YANG Qiang, LIN Stephen. Graph embedding and extensions: A general framework for dimensionality reduction [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(1): 40–51.
XIANG Shi-ming, NIE Fei-ping, ZHANG Chang-shui, ZHANG Chun-xia. Nonlinear dimensionality reduction with local spline embedding [J]. IEEE Transactions on Knowledge and Data Engineering, 2009, 21(9): 1285–1298.
QIAO Hong, ZHANG Peng, WANG Di, ZHANG Bo. An explicit nonlinear mapping for manifold learning [J]. IEEE Transactions on System, Man and Cybernetics-Part B: Cybernetics, 2012, 99: 1–13.
WANG Hai-xian. Structured sparse linear graph embedding [J]. Neural Networks, 2012, 27: 38–44.
QIAO Li-shan, CHEN Song-can, TAN Xiao-yang. Sparsity preserving projections with applications to face recognition [J]. Pattern Recognition, 2010, 43: 331–341.
RADU T, LUC V G. Sparse representation based projections [C]// Proceedings of the 22nd British Machine Vision Conference (BMVC). Dundee: BMVA Press, 2011: 1–12.
FUKUNAGA K. Introduction to statistical pattern recognition [M]. Boston: Academic Press, 1990: 466–479.
ZHANG Zhen-yue, WANG Jing, ZHA Hong-yuan. Adaptive manifold learning [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(2): 253–265.
GAO Xiao-fang, LIANG Ji-ye. The dynamical neighborhood selection based on the sampling density and manifold curvature for isometric data embedding [J]. Pattern Recognition Letters, 2011, 32: 202–209.
WRIGHT J, YANG A Y, GANESH A, SASTRY S S, MA Yi. Robust face recognition via sparse representation [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, 31(2): 210–227.
YAN Shui-cheng, WANG Huan. Semi-supervised learning by sparse representation [C]// Proceedings of the SIAM International Conference on Data Mining. Philadelphia: SIAM Press, 2009: 792–801.
BRESSAN M, VITRIA J. Nonparametric discriminant analysis and nearest neighbor classification [J]. Pattern Recognition Letters, 2003, 24(15): 2743–2749.
LI Zhi-feng, LIN Da-hua, TANG Xiao-ou. Nonparametric discriminant analysis for face recognition [J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2009, 31(4): 755–761.
JIA Yang-qing, NIE Fei-ping, ZHANG Chang-shui. Trace ratio problem revisited [J]. IEEE Transactions on Neural Network, 2009, 20(4): 729–735.
ZHAO Ming-bo, ZHANG Zhao, CHOW T W. Trace ratio criterion based generalized discriminative learning for semi-supervised dimensionality reduction [J]. Pattern Recognition, 2012, 45: 1482–1499.
Author information
Authors and Affiliations
Corresponding author
Additional information
Foundation item: Project(40901216) supported by the National Natural Science Foundation of China
Rights and permissions
About this article
Cite this article
Du, C., Zhou, Sl., Sun, Jx. et al. Discriminant embedding by sparse representation and nonparametric discriminant analysis for face recognition. J. Cent. South Univ. 20, 3564–3572 (2013). https://doi.org/10.1007/s11771-013-1882-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11771-013-1882-3