Advertisement

A New Neural Implementation of Exploratory Projection Pursuit

  • Colin Fyfe
  • Emilio Corchado
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2412)

Abstract

We investigate an extension of the learning rules in a Principal Component Analysis network which has been derived to be optimal for a specific probability density function(pdf). We note that this probability density function is one of a family of pdfs and investigate the learning rules formed in order to be optimal for several members of this family. We show that, whereas previous authors [5] have viewed the single member of the family as an extension of PCA, it is more appropriate to view the whole family of learning rules as methods of performing Exploratory Projection Pursuit(EPP). We explore the performance of our method first in response to an artificial data type, then to a real data set.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bishop, C.M, Neural Networks for Pattern Recognition, Oxford, 1995.Google Scholar
  2. 2.
    Diaconis, P. and Freedman D., Asymptotics of Graphical Projections. The Annals of Statistics. 12(3): 793–815, 1984.zbMATHMathSciNetCrossRefGoogle Scholar
  3. 3.
    Fyfe, C., “PCA Properties of Interneurons”, From Neurobiology to Real World Computing, Proceedings of International Conference on Artificial on Artificial Neural Networks, ICAAN93, pages 183–188, 1993.Google Scholar
  4. 4.
    Fyfe, C. and Baddeley, R. Non-linear Data Structure Extraction using Simple Hebbian Learning, Biological Cybernetics, 72(6), 533–541, 1995.zbMATHCrossRefGoogle Scholar
  5. 5.
    Fyfe, C. and MacDonald, D., •-Insensitive Hebbian learning, Neurocomputing, 2001Google Scholar
  6. 6.
    Hyverinnen, A. Complexity Pursuit: Separating interesting components from time series. Neural Computation, 13: 883–898, 2001.CrossRefGoogle Scholar
  7. 7.
    Karhunen, J. and Joutsensalo, J., Representation and Separation of Signals Using Nonlinear PCA Type Learning, Neural Networks, 7:113–127, 1994.CrossRefGoogle Scholar
  8. 8.
    Oja, E., Neural Networks, Principal Components and Subspaces, International Journal of Neural Systems, 1:61–68, 1989.CrossRefMathSciNetGoogle Scholar
  9. 9.
    Oja, E., Ogawa, H., Wangviwattana, J., Principal Components Analysis by Homogeneous Neural Networks, part 1, The Weighted Subspace Criterion, IEICE Transaction on Information and Systems, E75D: 366–375, May 1992.Google Scholar
  10. 10.
    Oimola, A.J. and. Scholkopf, B. A Tutorial on Support Vector Regression. Technical Report NC2-TR-1998-030, NeuroCOLT2 Technical Report Series, Oct.1998.Google Scholar
  11. 11.
    Xu L., Least Mean Square Error Reconstruction for Self-Organizing Nets”, Neural Networks, Vol. 6, pp. 627–648, 1993.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Colin Fyfe
    • 1
  • Emilio Corchado
    • 1
  1. 1.Applied Computational Intelligence Research UnitThe University of PaisleyScotland

Personalised recommendations