Analysing Spectroscopic Data Using Hierarchical Cooperative Maximum Likelihood Hebbian Learning

  • Donald MacDonald
  • Emilio Corchado
  • Colin Fyfe
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2972)


A novel approach to feature selection is presented in this paper, in which the aim is to visualize and extract information from complex, high dimensional spectroscopic data. The model proposed is a mixture of factor analysis and exploratory projection pursuit based on a family of cost functions proposed by Fyfe and MacDonald [12] which maximizes the likelihood of identifying a specific distribution in the data while minimizing the effect of outliers [9,12]. It employs cooperative lateral connections derived from the Rectified Gaussian Distribution [8,14] to enforce a more sparse representation in each weight vector. We also demonstrate a hierarchical extension to this method which provides an interactive method for identifying possibly hidden structure in the dataset.


Cost Function Energy Function Spectroscopic Data Support Vector Regression Learning Rule 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bertsekas, D.P.: Nonlinear Programming. Athena Scientific, Belmont (1995)zbMATHGoogle Scholar
  2. 2.
    Charles, D., Fyfe, C.: Modeling Multiple Cause Structure Using Rectification Constraints. Network: Computation in Neural Systems 9, 167–182 (1998)zbMATHCrossRefGoogle Scholar
  3. 3.
    Charles, D.: Unsupervised Artificial Neural Networks for the Identification of Multiple Causes in Data. PhD thesis, University of Paisley (1999)Google Scholar
  4. 4.
    Fyfe, C.: Negative Feedback as an Organising Principle for Artificial Neural Networks, PhD Thesis, Strathclyde University (1995)Google Scholar
  5. 5.
    Fyfe, C.: A Neural Network for PCA and Beyond. Neural Processing Letters 6, 33–41 (1996)CrossRefGoogle Scholar
  6. 6.
    Fyfe, C., Corchado, E.: Maximum Likelihood Hebbian Rules. In: European Symposium on Artificial Neural Networks (2002)Google Scholar
  7. 7.
    Oja, E.: Neural Networks, Principal Components and Subspaces. International Journal of Neural Systems 1, 61–68 (1989)CrossRefMathSciNetGoogle Scholar
  8. 8.
    Seung, H.S., Socci, N.D., Lee, D.: The Rectified Gaussian Distribution. Advances in Neural Information Processing Systems 10, 350 (1998)Google Scholar
  9. 9.
    Smola, A.J., Scholkopf, B.: A Tutorial on Support Vector Regression. Technical Report NC2-TR-1998-030, NeuroCOLT2 Technical Report Series (1998)Google Scholar
  10. 10.
    Xu, L.: Least Mean Square Error Reconstruction for Self-Organizing Nets. Neural Networks 6, 627–648 (1993)CrossRefGoogle Scholar
  11. 11.
    Karhunen, J., Joutsensalo, J.: Representation and Separation of Signals Using Nonlinear PCA Type Learning. Neural Networks 7, 113–127 (1994)CrossRefGoogle Scholar
  12. 12.
    Fyfe, C., MacDonald, D.: ε-Insensitive Hebbian learning. Neuro Computing (2002)Google Scholar
  13. 13.
    Friedman, J., Tukey, J.: A Projection Pursuit Algorithm for Exploratory Data Analysis. IEEE Transaction on Computers (23), 881–890 (1974)zbMATHCrossRefGoogle Scholar
  14. 14.
    Corchado, E., Fyfe, C.: Orientation Selection Using Maximum Likelihood Hebbian Learning. International Journal of Knowledge-Based Intelligent Engineering Systems 7(2), Brighton, United Kingdom (April 2003) ISSN: 1327-2314Google Scholar
  15. 15.
    Bishop, C.M.: Neural Networks for Pattern Recognition, Oxford (1995)Google Scholar
  16. 16.
    Corchado, E., MacDonald, D., Fyfe, C.: Maximum and Minimum Likelihood Hebbian Learning for Exploratory Projection Pursuit. In: Data mining and Knowledge Discovery, Kluwer Academic Publishing, Dordrecht (in press)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2004

Authors and Affiliations

  • Donald MacDonald
    • 1
    • 2
  • Emilio Corchado
    • 1
    • 2
  • Colin Fyfe
    • 2
  1. 1.Department of Civil EngineeringUniversity of BurgosSpain
  2. 2.Applied Computational Intelligence Research UnitUniversity of PaisleyScotland

Personalised recommendations