Exploiting the Functional Training Approach in Takagi-Sugeno Neuro-fuzzy Systems

  • Cristiano L. Cabrita
  • António E. Ruano
  • Pedro M. Ferreira
  • László T. Kóczy
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 195)

Abstract

When used for function approximation purposes, neural networks and neuro-fuzzy systems belong to a class of models whose parameters can be separated into linear and nonlinear, according to their influence in the model output. This concept of parameter separability can also be applied when the training problem is formulated as the minimization of the integral of the (functional) squared error, over the input domain. Using this approach, the computation of the derivatives involves terms that are dependent only on the model and the input domain, and terms which are the projection of the target function on the basis functions and on their derivatives with respect to the nonlinear parameters, over the input domain. These later terms can be numerically computed with the data.

The use of the functional approach is introduced here for Takagi-Sugeno models. An example shows that this approach obtains better results than the standard, discrete technique, as the performance surface employed is more similar to the one obtained with the function underlying the data. In some cases, as shown in the example, a complete analytical solution can be found.

Keywords

Takagi-Sugeno models Functional training Parameter separability 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Golub, G.H., Pereyra, V.: Differentiation of pseudo-inverses and nonlinear least-squares problems whose varables separate. Siam Journal on Numerical Analysis 10(2), 413–432 (1973)MathSciNetMATHCrossRefGoogle Scholar
  2. 2.
    Golub, G., Pereyra, V.: Separable nonlinear least squares: the variable projection method and its applications. Inverse Problems 19(2), R1–R26 (2003)Google Scholar
  3. 3.
    Ruano, A.E.B., Jones, D.I., Fleming, P.J.: A New Formulation of the Learning Problem for a Neural Network Controller. In: 30th IEEE Conference on Decision and Control, Brighton, UK, December 11-13, pp. 865–866 (1991)Google Scholar
  4. 4.
    Ferreira, P.M., Ruano, A.E.: Exploiting the separability of linear and nonlinear parameters in radial basis function networks. In: Adaptive Systems for Signal Processing, Communications, and Control Symposium (AS-SPCC), Lake Louise, Canada, pp. 321–326 (October 2000)Google Scholar
  5. 5.
    Ruano, A.E., Cabrita, C., Oliveira, J.V., Koczy, L.T.: Supervised training algorithms for B-Spline neural networks and neuro-fuzzy systems. Int. J. Syst. Sci. 33(8), 689–711 (2002), doi:10.1080/00207720210155062MATHCrossRefGoogle Scholar
  6. 6.
    Werbos, P.: Beyond Regression: New Tools for Prediction and Analysis in the Behavioral Sciences. PhD, Harvard University (1974)Google Scholar
  7. 7.
    Ruano, A.E., Cabrita, C.L., Ferreira, P.M.: Towards a More Analytical Training of Neural Networks and Neuro-Fuzzy Systems. In: IEEE 7th International Symposium on Intelligent Signal Processing (WISP 2011), Floriana, Malta, September 19-21 (2011)Google Scholar
  8. 8.
    Gill, P.E., Murray, W., Wright, M.H.: Practical Optimization. Academic Press, Inc. (1981)Google Scholar
  9. 9.
    Cabrita, C.L., Ruano, A.E., Ferreira, P.M., Koczy, L.T.: Extending the functional training approach for B-Splines. In: 2012 IEEE International Joint Conference on Neural Networks (IJCNN), Brisbane, Australia, June 10-15, pp. 2702–2709. IEEE (2012)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Cristiano L. Cabrita
    • 1
  • António E. Ruano
    • 2
  • Pedro M. Ferreira
    • 3
  • László T. Kóczy
    • 4
  1. 1.University of AlgarveFaroPortugal
  2. 2.Centre for Intelligent SystemsIDMEC, IST and the University of AlgarveFaroPortugal
  3. 3.Algarve STP – Algarve Science & Technology ParkUniversity of AlgarveFaroPortugal
  4. 4.Faculty of Engineering SciencesSzéchenyi István UniversityGyõrHungary

Personalised recommendations