Advertisement

An Autonomous Learning Algorithm of Resource Allocating Network

  • Toshihisa Tabuchi
  • Seiichi Ozawa
  • Asim Roy
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5788)

Abstract

Selecting proper parameters of RBF networks has been a puzzling problem even for batch learning. The parameter selection is usually carried out by an external supervisor. To exclude the intervention by an external supervisor from the parameter selection, we propose a new learning scheme called Autonomous Learning algorithm for Resource Allocating Network (AL-RAN). AL-RAN is an incremental learning algorithm which consists of the following functions: automated data normalization and automated adjustment of RBF widths. In the experiments, we evaluate AL-RAN using nine benchmark datasets in terms of the decision accuracy of data normalization and the final classification accuracy. The experimental results demonstrate that the above two functions in AL-RAN work well and the final classification accuracy of AL-RAN is almost the same as that of a non-autonomous model whose parameters are manually tuned by an external supervisor.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Carpenter, G.A., Grossberg, S.: The ART of Adaptive Pattern Recognition by a Self-Organizing Neural Network. IEEE Computer 21(3), 77–88 (1988)CrossRefGoogle Scholar
  2. 2.
    Haykin, S.: Neural Networks: A Comprehensive Foundation. Prentice-Hall, Englewood Cliffs (1999)zbMATHGoogle Scholar
  3. 3.
    Kasabov, N.: Evolving Connectionist Systems: Methods and Applications in Bioinformatics, Brain Study and Intelligent Machines. Springer, Heidelberg (2002)zbMATHGoogle Scholar
  4. 4.
    Okamoto, K., Ozawa, S., Abe, S.: A Fast Incremental Learning Algorithm of RBF Networks with Long-Term Memory. In: Proc. Int. Joint Conf. on Neural Networks, pp. 102–107 (2003)Google Scholar
  5. 5.
    Ozawa, S., Toh, S.-L., Abe, S., Pang, S., Kasabov, N.: Incremental Learning of Feature Space and Classifier for Face Recognition. Neural Networks 18(5-6), 575–584 (2005)CrossRefGoogle Scholar
  6. 6.
    Platt, J.: A Resource-allocating Network for Function Interpolation. Neural Computation 3, 213–225 (1991)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Peng, J.-X., Li, K., Irwin, G.W.: A Novel Continuous Forward Algorithm for RBF Neural Modelling. IEEE Trans. Automatic Control 52, 117–122 (2007)MathSciNetCrossRefGoogle Scholar
  8. 8.
    Roy, A., Govil, S., Miranda, R.: An Algorithm to Generate Radial Basis Function (RBF)-like Nets for Classification Problems. Neural Networks 8(2), 179–202 (1995)CrossRefGoogle Scholar
  9. 9.
    Roy, A.: Connectionism, Controllers and a Brain Theory. IEEE Trans. on Sys., Man and Cybern., Part A 38(6), 1434–1441 (2008)CrossRefGoogle Scholar
  10. 10.
    Asuncion, A., Newman, D.J.: UCI Machine Learning Repository. UC, Irvine, School of Info. and Comp. Sci. (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Toshihisa Tabuchi
    • 1
  • Seiichi Ozawa
    • 1
  • Asim Roy
    • 2
  1. 1.Graduate School of EngineeringKobe UniversityKobeJapan
  2. 2.Arizona State UniversityTempeUSA

Personalised recommendations