Deterministic Annealing Integrated with ε-Insensitive Learning in Neuro-fuzzy Systems

  • Robert Czabański
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4029)


In this paper a new method of parameters estimation for neuro-fuzzy system with parameterized consequents is presented. The novelty of the learning algorithm consists of an application of the deterministic annealing method integrated with ε-insensitive learning. This method allows to improve neuro-fuzzy modeling quality in the sense of an increase in generalization ability and outliers robustness. To demonstrate performance of the proposed procedure two numerical experiments concerning benchmark problems of prediction and identification are given.


Root Mean Square Error Fuzzy System Radial Basis Function Neural Network Generalization Ability Parameterized Consequents 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bezdek, J.C.: Pattern Recognition with Fuzzy Objective Function Algorithms, Plenum, New York (1981)Google Scholar
  2. 2.
    Box, G.E.P., Jenkins, G.M.: Time Series Analysis. In: Forecasting and Control, Holden-Day, San Francisco (1976)Google Scholar
  3. 3.
    Czabański, R.: Automatic Fuzzy If-Then Rules Extraction From Numerical Data (in Polish) Ph.D. Thesis, Gliwice (2003)Google Scholar
  4. 4.
    Czogała, E., Łęski, J.: Fuzzy and Neuro-Fuzzy Intelligent Systems. Springer, Heidelberg (2000)zbMATHGoogle Scholar
  5. 5.
    Kashyap, R.L., Ho, Y.C.: An Algorithm for Linear Inequalities and its Applications. IEEE Trans. Elec. Comp. 14, 683–688 (1965)CrossRefGoogle Scholar
  6. 6.
    Jang, J.-S.R.: ANFIS: Adaptive-Network-Based Fuzzy Inference System. IEEE Trans. on Systems Man and Cybernetics 23, 665–685 (1993)CrossRefGoogle Scholar
  7. 7.
    Łęski, J.: ε-Insensitive Learning Techniques for Approximate Reasoning Systems (Invited Paper). Int. J. of Computational Cognition 1, 21–77 (2003)Google Scholar
  8. 8.
    Łęski, J., Czogała, T.: A Fuzzy System with ε-Insensitive Learning of Premises and Consequences of If-Then Rules. Int. J. Appl. Math. Comput. Sci. 15, 257–273 (2005)zbMATHMathSciNetGoogle Scholar
  9. 9.
    Mitra, S., Hayashi, Y.: Neuro-Fuzzy Rule Generation: Survey in Soft Computing Framework. IEEE Trans. Neural Networks 3, 748–768 (2000)CrossRefGoogle Scholar
  10. 10.
    Nowland, S., Hinton, G.: Simplifying Neural Networks by Soft Weight-Sharing. Neural Comput. 4, 473–493 (1992)CrossRefGoogle Scholar
  11. 11.
    Rementeria, S., Olabe, X.B.: Predicting Sunspots with a Self-Configuring Neural System. In: Proc. 8th Int. Conf. Information Processing Management Uncertainty Knowledge-Based Systems, pp. 1184–1190 (2000)Google Scholar
  12. 12.
    Rose, K.: Deterministic Annealing for Clustering, Compression, Classification, Regression and Related Optimization Problems. Proceedings IEEE 11, 2210–2239 (1998)CrossRefGoogle Scholar
  13. 13.
    Tong, H., Lim, K.S.: Threshold Autoregression, Limit Cycle and Cyclical Data. Journal of The Royal Statistical Society B 42, 245–292 (1980)zbMATHGoogle Scholar
  14. 14.
    Weigend, A.S., Huberman, B.A., Rumelhart, D.E.: Predicting the Future: a Connectionist Approach. Int. J. Neural Syst. 1, 193–209 (1990)CrossRefGoogle Scholar
  15. 15.
    Waterhouse, S.R., Robinson, A.J.: Non-linear Prediction of Acoustic Vectors Using Hierarchical Mixtures of Experts. Advances of Neural Information Processing Systems MIT Press Cambridge MA 7, 835–842 (1995)Google Scholar
  16. 16.
    Xie, X.L., Beni, G.: A Validity Measure for Fuzzy Clustering. IEEE Trans. Pattern Analysis and Machine Intelligence 13, 841–847 (1991)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Robert Czabański
    • 1
  1. 1.Institute of ElectronicsSilesian University of TechnologyGliwicePoland

Personalised recommendations