The Adaptive Learning Rates of Extended Kalman Filter Based Training Algorithm for Wavelet Neural Networks

  • Kyoung Joo Kim
  • Jin Bae Park
  • Yoon Ho Choi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4293)


Since the convergence of neural networks depends on learning rates, the learning rates of training algorithm for neural networks are very important factors. Therefore, we propose the Adaptive Learning Rates(ALRs) of Extended Kalman Filter(EKF) based training algorithm for wavelet neural networks(WNNs). The ALRs of the EFK based training algorithm produce the convergence of the WNN. Also we derive the convergence analysis of the learning process from the discrete Lyapunov stability theorem. Several simulation results show that the EKF based WNN with ALRs adapt to abrupt change and high nonlinearity with satisfactory performance.


Extend Kalman Filter Asymptotic Convergence Wavelet Neural Network Past Output Adaptive Learn Rate 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Slotin, J.E., Li, W.: Applied Nonlinear Control. Prentice-Hall, Englewood Cliffs (1991)Google Scholar
  2. 2.
    Ren, X.M., Rad, A.B., Chan, P.T., Lo, W.L.: Identification and Control of Continuous-Time Nonlinear Systems via Dynamic Neural Networks. IEEE Trans. Industrial Electronics 50, 478–486 (2003)CrossRefGoogle Scholar
  3. 3.
    Yoo, S.J., Park, J.B., Choi, Y.H.: Stable Predictive Control of Chaotic Systems Using Self-Recurrent Wavelet Neural Network. Int. Journal of Control, Automation, and Systems 3, 43–55 (2005)Google Scholar
  4. 4.
    Zhang, Q., Benveniste, A.: Wavelet Networks. IEEE Trans. Neural Networks 3, 889–898 (1992)CrossRefGoogle Scholar
  5. 5.
    Oh, J.S., Park, J.B., Choi, Y.H.: Path Tracking Control using a Wavelet Neural Network for Mobile Robot with Extended Kalman Filter. In: Proc. of the Int. Conf. Control, Automation and Systems, pp. 1283–1288 (2003)Google Scholar
  6. 6.
    Lee, B.J., Park, J.B., Lee, H.J., Joo, Y.H.: Fuzzy-logic-based IMM algorithm for tracking a manoeuvring target. IEE Proc. Radar, Sonar and Navigation 152, 16–22 (2005)CrossRefGoogle Scholar
  7. 7.
    Yoo, S.J., Park, J.B., Choi, Y.H.: Direct Adaptive Control Using Self Recurrent Wavelet Neural Network Via Adaptive Learning Rates for Stable Path Tracking of Mobile Robots. In: Proc. of American Control Conference, vol. 1, pp. 288–293 (2005)Google Scholar
  8. 8.
    Singhal, S., Wu, L.: Training Feed-forward Networks with the Extended Kalman Algorithm. In: Proc. of Int. Conf. on Acoustics, Speech, and Signal Processing, vol. 2, pp. 1187–1190 (1989)Google Scholar
  9. 9.
    Wu, Q., Saif, M.: Neural Adaptive Observer Based Fault Detection and Identification for Satellite Attitude Control Systems. In: Proc. of American Control Conference, vol. 2, pp. 1054–1059 (2005)Google Scholar
  10. 10.
    Mallet, S.G.: A Theory for Multiresolution Signal Decompisition- the wavelet representation. IEEE Trans. Pattern Alanysis and Machine Intelligence 11, 674–693 (1989)CrossRefGoogle Scholar
  11. 11.
    Ljung, L., Söderström, T.: Theory and Practice of Recursive Identification. MIT Press, Massachusetts (1983)zbMATHGoogle Scholar
  12. 12.
    Alessandri, A., Cuneo, M., Pagnan, S., Sanguineti, M.: On the Convergence of EKF-Based Parameters Optimization for Neural Networks. In: Proc. of 42nd IEEE Conference on Decision and Control, vol. 6, pp. 6181–6186 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Kyoung Joo Kim
    • 1
  • Jin Bae Park
    • 1
  • Yoon Ho Choi
    • 2
  1. 1.Yonsei UniversitySeoulKorea
  2. 2.Kyonggi UniversitySuwon, Kyonggi-DoKorea

Personalised recommendations