Abstract
Kernel sparse representation-based classifier (KSRC) has been proposed, which has good representation and classification performance on face image data. The performance of KSRC on face image data is partly dependent on the random projection matrix when using the random projection method and the kernel Gram matrix. This paper develops the kernel sparse representation-based classifier ensemble (KSRCE), which does not require to consider the effect of random projection and kernel Gram matrix on KSRC. Actually, the random projection matrix and the kernel Gram matrix could be used for designing the diversity schemes for KSRCE. In the combination stage, we can combine the labels or the reconstruction errors of a test sample. Experimental results on three face data sets show that KSRCE is very promising.
Similar content being viewed by others
References
Breiman, L.: Bagging predictors. Machine Learning 24, 123–140 (1996)
Candès, E., Romberg, J.: ℓ1-magic: recovery of sparse signals via convex programming (2005). http://www.acm.caltech.edu/l1magic/. Accessed 10 March 2010
Chen, S., Donoho, D., Saunders, M.: Atomic decomposition by basis pursuit. SIAM Rev. 43(1), 129–159 (2001)
Duda, R., Hart, P., Stork, D.: Pattern Classification, 2nd edn. John Wiley & Sons (2000)
Freund, Y., Shapire, R.: Experiments with a new boosting algorithm. In: Proceedings of the Thirteenth International Conference on Machine Learning, pp. 148–156. Morgan Kaufmann, Bary, Italy (1996)
Fumera, G., Roli, F.: A theoretical and experimental analysis of linear combiners for multiple classifier systems. IEEE Trans. Pattern Anal. Mach. Intell. 27(6), 942–956 (2005)
Graham, D.B., Allinson, N.M.: Characterizing virtual Eigensignatures for general purpose face recognition. In: Face Recognition: from Theory to Applications, NATO ASI Series F, Computer and Systems Sciences, vol. 163, pp. 446–456 (1998)
Ho, T.K., Hull, J.J., Srihari, S.N.: Decision combination in multiple classifier systems. IEEE Trans. Pattern Anal. Mach. Intell. 16(1), 66–75 (1994)
Kittler, J., Hatef, M., Duin, R.P.W., Matas, J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20(3), 226–239 (1998)
Kuncheva, L.I.: Combining Pattern Classifiers: Methods and Algorithms. John Wiley & Sons, Inc., Hoboken, N.J. (2004)
Lee, K.C., Ho, J., Kriegman, D.: Acquiring linear subspaces for face recognition under variable lighting. IEEE Trans. Pattern Anal. Mach. Intell. 27(5), 684–698 (2005)
Li, S.Z.: Face recognition based on nearest linear combinations. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 839–844. IEEE Computer Society, Washington, DC, USA (1998)
Makhorin, A.: Introduction to GLPK. http://www.gnu.org/software/glpk/glpk.html (2004). Accessed 5 May 2009
Mika, S., Rätsch, G., Weston, J., Schölkopf, B., Müller, K.R.: Fisher discriminant analysis with kernels. In: IEEE International Workshop on Neural Networks for Signal Processing IX, Madison, USA, pp. 41–48 (1999)
Roli, F., Kittler, J., Windeatt, T. (eds.): Multiple Classifier Systems. Lecture Notes in Computer Science, vol. 3077. Springer (2004)
Samaria, F.S., Harter, A.C.: Parameterisation of a stochastic model for human face identification. In: Proceedings of the 2nd IEEE International Workshop on Applications of Computer Vision, Sarasota Florida, pp. 138–142 (1994)
Schölkopf, B., Smola, A.J., Müller, K.R.: Nonlinear component analysis as a kernel Eigenvalue problem. Neural Comput. 10(5), 1299–1319 (1998)
Wright, J., Yang, A.Y., Ganesh, A., Sastry, S.S., Ma, Y.: Robust face recognition via sparse representation. IEEE Trans. Pattern Anal. Mach. Intell. 31(2), 210–226 (2009)
Yang, A.Y., Wright, J., Ma, Y., Sastry, S.S.: Feature selection in face recognition: a sparse representation perspective. Tech. Rep. UCB/EECS-2007-99. EECS Department, University of California, Berkeley (2007). http://www.eecs.berkeley.edu/Pubs/TechRpts/2007/EECS-2007-99.html. Accessed 10 May 2008
Zhang, L., Zhou, W.D.: Sparse ensembles using weighted combination methods based on linear programming. Pattern Recogn. 44(1), 97–106 (2011)
Zhang, L., Zhou, W.D., Jiao, L.C.: Wavelet support vector machine. IEEE Trans. Syst. Man Cybern., Part B 34(1), 34–39 (2004)
Zhang, L., Zhou, W.D., Jiao, L.C.: Support vector machines based on the orthogonal projection kernel of father wavelet. Int. J. Comput. Intell. Appl. 5(3), 283–303 (2005)
Zhang, L., Zhou, W.D., Chang, P.C., Liu, J., Yan, Z., Wang, T., Li, F.Z.: Kernel sparse representation-based classifier. IEEE Trans. Signal Process. 60(4), 1684–1695 (2012)
Author information
Authors and Affiliations
Corresponding author
Additional information
Supported in part by the National Natural Science Foundation of China under Grant Nos. 60970067 and 61033013, by the Natural Science Foundation of Jiangsu Province of China under Grant Nos. BK2011284, BK201222725, by the Natural Science Pre-research Project of Soochow University under Grant No. SDY2011B09 and by the Qing Lan Project.
Rights and permissions
About this article
Cite this article
Zhang, L., Zhou, WD. & Li, FZ. Kernel sparse representation-based classifier ensemble for face recognition. Multimed Tools Appl 74, 123–137 (2015). https://doi.org/10.1007/s11042-013-1457-1
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-013-1457-1