Discriminant Transform Based on Scatter Difference Criterion in Hidden Space

  • Cai-kou Chen
  • Jing-yu Yang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4153)


In this paper, a novel feature extraction method based on scatter difference criterion in hidden space is developed. Its main idea is that the original input space is first mapped into a hidden space through a kernel function, where the feature extraction is conducted using the difference of between-class scatter and within-class scatter as the discriminant criterion. Different from the existing kernel-based feature extraction methods, the kernel function used in the proposed one is not required to satisfy Mercer’s theorem so that they can be chosen from a wide range. It is more important that due to adoption of the scatter difference as the discriminant criterion for feature extraction, the proposed method essentially avoids the small size samples problem usually occurred in the kernel Fisher discriminant analysis. Finally, extensive experiments are performed on a subset of FERET face database. The experimental results indicate that the proposed method outperforms the traditional scatter difference discriminant analysis in recognition performance.


Kernel Function Training Image Radial Basis Function Network Feature Extraction Method Average Recognition Rate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Vapnik, V.: The Nature of Statistical Learning Theory. Springer, New york (1995)zbMATHGoogle Scholar
  2. 2.
    Mika, S., Rätsch, G., Weston, J., Schölkopf, B., Müller, K.-R.: Fisher discriminant analysis with kernels. In: IEEE International Workshop on Neural Networks for Signal Processing IX, Madison (USA), pp. 41–48 (August 1999)Google Scholar
  3. 3.
    Mika, S., Smola, A.J., Schölkopf, B.: An improved training algorithm for kernel fisher discriminants. In: Jaakkola, T., Richardson, T. (eds.) Proceedings AISTATS 2001, San Francisco, CA, pp. 98–104 (2001)Google Scholar
  4. 4.
    Mika, S., Rätsch, G., Weston, J., Schölkopf, B., Smola, A., Müller, K.-R.: Constructing descriptive and discriminative non-linear features: Rayleigh coefficients in kernel feature spaces. IEEE Trans. Pattern Anal. Machine Intell. 25(5), 623–628 (2003)CrossRefGoogle Scholar
  5. 5.
    Baudat, G., Anouar, F.: Generalized discriminant analysis using a kernel approach. Neural Computation 12(10), 2385–2404 (2000)CrossRefGoogle Scholar
  6. 6.
    Yang, M.H.: Kernel Eigenfaces vs. kernel Fisherfaces: face recognition using kernel methods. In: Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition (RGR 2002), Washington D. C., pp. 215–220 (May 2002)Google Scholar
  7. 7.
    Yu, H., Yang, J.: A direct LDA algorithm for high-dimensional data—with application to face recognition. Pattern Recognition 34(10), 2067–2070 (2001)zbMATHCrossRefGoogle Scholar
  8. 8.
    Song, F., Liu, S., Yang, J., et al.: Maximum scatter difference classifier and its application to text categorization. Computer Engineering 31(5), 890–896 (2005)Google Scholar
  9. 9.
    Yun-peng, C.: Matrix theory (in chinese). Northwest Industry University Press, Xi’an (1999)Google Scholar
  10. 10.
    Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The FERET Evaluation Methodology for Face-Recognition Algorithms. IEEE Trans. Pattern Anal. Machine Intell. 22(10), 1090–1104 (2000)CrossRefGoogle Scholar
  11. 11.
    Phillips, P.J.: The Facial Recognition Technology (FERET) Database,

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Cai-kou Chen
    • 1
    • 2
  • Jing-yu Yang
    • 2
  1. 1.Department of Computer Science and EngineeringYangzhou UniversityYangzhouChina
  2. 2.Department of Computer Science and EngineeringNanjing University of Science and TechnologyNanjingChina

Personalised recommendations