Face Detection Using Kernel PCA and Imbalanced SVM

  • Yi-Hung Liu
  • Yen-Ting Chen
  • Shey-Shin Lu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4221)


The task of face detection can be accomplished by performing a sequence of binary classification: face/nonface classification, in an image. Support vector machine (SVM) has shown to be successful in this task due to its excellent generalization ability. However, we find that the performance of SVM is actually limited in such a task due to the imbalanced face/nonface data structure: the face training images outnumbered by the nonface images in general, which causes the class-boundary-skew (CBS) problem. The CBS problem would greatly increase the false negatives, and result in an unsatisfactory face detection rate. This paper proposes the imbalanced SVM (ISVM), a variant of SVM, to deal with this problem. To enhance the detection rate and speed, the kernel principal component analysis (KPCA) is used for the representation and reduction of input dimensionality. Experimental results carried out on CYCU multiview face database show that the proposed system (KPCA+ISVM) outperforms SVM. Also, results indicate that without using KPCA as the feature extractor, ISVM is also superior to SVM in terms of multiview face detection rate.


Support Vector Machine Face Recognition Face Image Face Detection Face Database 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Osuna, E., Freund, R., Girosit, F.: Training Support Vector Machines: an Application to Face Detection. In: Proc. CVPR, pp. 130–136 (1997)Google Scholar
  2. 2.
    Buciu, L., Kotropoulos, C., Pitas, I.: Combining Support Vector Machines for Accurate Face detection. In: Proc. Intl. Conf. Image Processing, vol. 1, pp. 1054–1057 (2001)Google Scholar
  3. 3.
    Romdhani, S., Torr, P., Schölkopf, B., Blake, A.: Computationally Efficient Face Detection. In: Proc. Eighth IEEE Intl. Conf. Computer Vision, vol. 2, pp. 695–700 (2001)Google Scholar
  4. 4.
    Terrillon, T.J., Shirazi, M.N., Sadek, M., Fukamachi, H., Akamatsu, S.: Invariant Face Detection with Support Vector Machines. In: Proc. Int. Conf. Pattern Recognition, vol. 4, pp. 210–217 (2000)Google Scholar
  5. 5.
    Li, Y., Gong, S., Liddell, H.: Support Vector Regression and Classification Based Multi-view Face Detection and Recognition. In: Proc. 4th IEEE Intl. Conf. Automatic Face and Gesture Recognition, pp. 300–305 (2000)Google Scholar
  6. 6.
    Li, Y., Gong, S., Sherrah, J., Liddell, H.: Multi-view Face Detection using Support Vector Machines and Eigenspace Modeling. In: Proc. 4th Intl. Conf. Knowledge-Based Intelligent Engineering Systems and Allied Technologies, vol. 1, pp. 241–244 (2000)Google Scholar
  7. 7.
    Corts, C., Vapnik, V.N.: Support Vector Networks. Machine Learning 20, 273–297 (1995)Google Scholar
  8. 8.
    Vapnik, V.N.: Statistical Learning Theory. Springer, Berlin, Heidelberg, New York (1998)MATHGoogle Scholar
  9. 9.
    Burges, J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery 2, 121–167 (1998)CrossRefGoogle Scholar
  10. 10.
    Veropoulos, K., Campbell, C., Cristianini, N.: Controlling the Sensitivity of Support Vector Machines. In: Proc. Int. Joint Conf. Artificial Intelligence (IJCAI 1999) (1999)Google Scholar
  11. 11.
    Akbani, R., Kwek, S., Japkowicz, N.: Applying Support Vector Machines to Imbalanced Datasets. In: Boulicaut, J.-F., Esposito, F., Giannotti, F., Pedreschi, D. (eds.) ECML 2004. LNCS (LNAI), vol. 3201, pp. 39–50. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  12. 12.
    Wu, G., Cheng, E.: Class-boundary alignment for imbalanced dataset learning. In: ICML 2003 Workshop on Learning from Imbalanced Data Sets II (2003)Google Scholar
  13. 13.
    Japkowicz, N.: The Class Imbalance Problem: Significance and Strategies. In: Proc. 2000 Int. Conf. Artificial Intelligence: Special Track on Inductive Learning, pp. 111–117 (2000)Google Scholar
  14. 14.
    Ling, C., Li, C.: Data Mining for Direct Marketing Problems and Solutions. In: Proc. 4th Int. Conf. Knowledge Discovery and Data Mining (1998)Google Scholar
  15. 15.
    Chawla, N., Bowyer, K., Kegelmeyer, W.: SMOTE: Synthetic Minority Over-sampling Technique. Journal of Artificial Intelligence Research 16, 321–357 (2002)MATHGoogle Scholar
  16. 16.
    Liu, Y.H., Chen, Y.T.: Face Recognition Using Total Margin-Based Adaptive Fuzzy Support Vector Machines. IEEE Trans. Neural Networks 17 (in press, 2006)Google Scholar
  17. 17.
    Lu, J., Plataniotis, K.N., Venetsanopoulos, A.N.: Face Recognition Using Kernel Direct Discriminant Analysis Algorithms. IEEE Trans. Neural Networks 14 (2003)Google Scholar
  18. 18.
    Schölkopf, B., Smola, A., Müller, K.R.: Nonlinear Component Analysis as a Kernel Eigenvalue Problem. Neural Computation 10, 1299–1319 (1998)CrossRefGoogle Scholar
  19. 19.
    Kim, K.I., Jung, K., Kim, H.J.: Face Recognition Using Kernel Principal Component Analysis. IEEE Signal Processing Letters 9, 40–42 (2002)CrossRefGoogle Scholar
  20. 20.
  21. 21.
    Kecman, V.: Learning and Soft Computing, Support Vector machines, Neural Networks and Fuzzy Logic Models. The MIT Press, Cambridge (2001)MATHGoogle Scholar
  22. 22.
    Wang, L.P. (ed.): Support Vector Machines: Theory and Application. Springer, Berlin, Heidelberg, New York (2005)Google Scholar
  23. 23.
    Tan, Y.P., Yap, K.H., Wang, L.P. (eds.): Intelligent Multimedia Processing with Soft Computing. Springer, Berlin, Heidelberg, New York (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Yi-Hung Liu
    • 1
  • Yen-Ting Chen
    • 1
  • Shey-Shin Lu
    • 1
  1. 1.Visual-Servoing Control Lab., Department of Mechanical EngineeringChung Yuan Christian UniversityChung-LiTaiwan, China

Personalised recommendations