Advertisement

Hidden Space Principal Component Analysis

  • Weida Zhou
  • Li Zhang
  • Licheng Jiao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3918)

Abstract

A new nonlinear principle component analysis (PCA) method, hidden space principal component analysis (HSPCA) is presented in this paper. Firstly, the data in the input space is mapped into a high hidden space by a nonlinear function whose role is similar to that of hidden neurons in Artificial Neural Networks. Then the goal of features extraction and data compression will be implemented by performing PCA on the mapped data in the hidden space. Compared with linear PCA method, our algorithm is a nonlinear PCA one essentially and can extract the data features more efficiently. While compared with kernel PCA method presented recently, the mapped samples are exactly known and the conditions satisfied by nonlinear mapping functions are more relaxed. The unique condition is symmetry for kernel function in HSPCA. Finally, experimental results on artificial and real-world data show the feasibility and validity of HSPCA.

Keywords

Principle Component Analysis Hide Neuron Radial Basis Function Network Mercer Kernel Nonlinear Mapping Function 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Schölkopf, B., Smola, A.J., Müller, K.-R.: Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation 10, 1299–1319 (1998)CrossRefGoogle Scholar
  2. 2.
    Cover, T.M.: Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition. IEEE Transactions on Electronic Computers EC-14, 326–334 (1965)CrossRefMATHGoogle Scholar
  3. 3.
    Zhang, L., Zhou, W., Jiao, L.: Hidden space support vector machines. IEEE Trans. NNs 15(6), 1424–1434 (2004)CrossRefGoogle Scholar
  4. 4.
    Lang, K.J., Witbrock, M.J.: Learning to tell two spirals apart. In: Proc.1989 Connectionist Models Summer School, pp.52-61 (1989)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Weida Zhou
    • 1
  • Li Zhang
    • 1
  • Licheng Jiao
    • 1
  1. 1.Institute of Intelligence Information ProcessingXidian UniversityXi’anChina

Personalised recommendations