A multilayer real-time, recurrent learning algorithm for improved convergence

  • Kürt Meert
  • Jacques Ludik
Part III: Learning: Theory and Algorithms
Part of the Lecture Notes in Computer Science book series (LNCS, volume 1327)


In this paper an algorithm is described, which is based on the Real-Time Recurrent Learning (RTRL) algorithm by Williams and Zipser


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    R.J. Williams and D. Zipser. Experimental Analysis of the Real-Time Recurrent Learning Algorithm. Connection Science, (1), 87–111, 1989.Google Scholar
  2. 2.
    G. Cybenko. Approximation by Superpositions of a Sigmoidal Function. Mathematical Control Signals and Systems, (2), 303–314, 1989.Google Scholar
  3. 3.
    K. Funahashi and Y. Nakamura. Approximation of Dynamcal Systems by Continuous Time Recurrent Networks. Neural Networks, (6), 801–806, 1993.Google Scholar
  4. 4.
    B.A. Pearlmutter. Gradient Calculations for Dynamic Recurrent Neural Networks: a Survey. IEEE Transactions on Neural Networks, (6), 1212–1228, 1995.Google Scholar
  5. 5.
    G.V. Puskorius and L.A.Feldkamp. Neurocontrol of Nonlinear Dynamcal Systems with Kalman Filter Trained Recurrent Networks. IEEE Transactions on Neural Networks, (5), 279–297, 1994.Google Scholar
  6. 6.
    A.G. Parlos, K.T. Chong and A.F. Atiya. Application of the Recurrent Multilayer Perceptron in Modelling Complex Process Dynamics. IEEE Transactions on Neural Networks, (5). 255–266, 1994.Google Scholar
  7. 7.
    C.B. Miller and C.L.Giles. Experimental Comparison of the Effect of Order in Recurrent Neural Networks. International Journal of Pattent Recognition and Artificial Intelligence. (7), 849–872, 1993.Google Scholar
  8. 8.
    S. Miyoshi and K. Nakayama. Probabilistic Memory Capacity of Recurrent Neural Networks. Proc. of the IEEE International Conference on Neural Networks 96, Washington. DC., (2), 1291–1296. 1996.Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 1997

Authors and Affiliations

  • Kürt Meert
    • 1
  • Jacques Ludik
    • 2
  1. 1.Expert Systems Applications Development GroupDept. of Chemical EngineeringHeverleeBelgium
  2. 2.Department of Computer ScienceUniversity of StellenboschStellenboschSouth Africa

Personalised recommendations