Skip to main content
Log in

Nonlinear Recursive Regression Transformers: Dynamic Systems and Optimization

  • Systems Analysis
  • Published:
Cybernetics and Systems Analysis Aims and scope

Abstract

An approximation-prediction problem for functions represented by empirical data is analyzed. A class of functions as predictors, the so-called RFT-transformers, based on the least-square and superposition methods is proposed. Special classes of dynamic systems with delay are introduced and analyzed to obtain classical results for calculation of gradients. These results are used to optimize RFT-transformers.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

REFERENCES

  1. A. N. Kolmogorov, “Representation of continuous functions of several variables by superpositions of continuous functions of a smaller number of variables,” Dokl. AN SSSR, 108, No.2, 179–182 (1956).

    Google Scholar 

  2. V. I. Arnol'd, “Functions of three variables,” Dokl. AN SSSR, 114, No.4, 953–956 (1957).

    Google Scholar 

  3. Yu. V. Linnik, The Least-Squares Method and the Fundamentals of Mathematical and Statistical Theory of Processing Observations [in Russian], Fizmatgiz, Moscow (1969).

    Google Scholar 

  4. V. N. Vapnik, Restoration of Functions from Empirical Data [in Russian], Nauka, Moscow (1979).

    Google Scholar 

  5. A. G. Ivakhnenko, Self-Organizing Systems of Recognition and Automatic Control [in Russian], Tekhnika, Kiev (1969).

    Google Scholar 

  6. N. F. Kirichenko, Yu. V. Krack, and A. A. Polishchuk, “Pseudoinverse and projection matrices in problems of synthesis of functional transformers,” Kibern. Sist. Analiz, No. 3, 407–419 (2004).

  7. N. F. Kirichenko, “Analytical representation of perturbations of pseudoinverse matrices,” Kibern. Sist. Analiz, No. 2, 230–238 (1997).

  8. N. F. Kirichenko and N. P. Lepekha, “Perturbation of pseudoinverse and projectional matrices as applied to identification of linear and nonlinear dependences,” Probl. Upravl. Inform., No. 1, 6–22 (2001)

  9. N. F. Kirichenko and N. P. Lepekha, “Application of pseudoinverse and projective matrices to studying control, observation, and identification problems,” Kibern. Sist. Analiz, No. 4, 568–585 (2002).

  10. A. Albert, Regression, Pseudoinversion, Recurrent Estimation [Russian translation], Nauka, Moscow (1977).

    Google Scholar 

  11. A. I. Propoi, Elements of the Theory of Optimal Discrete Processes [in Russian], Nauka, Moscow (1973).

    Google Scholar 

  12. B. N. Bublik and N. F. Kirichenko, Fundamentals of Control Theory [in Russian], Vyssh. Shk., Kiev (1975).

    Google Scholar 

  13. V. M. Kuntsevich and M. M. Lychak, Synthesis of Optimal and Adaptive Control Systems: Game Approach [in Russian], Naukova Dumka, Kiev (1985).

    Google Scholar 

  14. B. N. Bublik, F. G. Garashchenko, and N. F. Kirichenko, Structural and Parametric Optimization and Stability of Dynamic Bundles [in Russian], Naukova Dumka, Kiev (1985).

    Google Scholar 

  15. F. O. Sopronyuk, Simulation and Optimization of Control Systems with Branching Structures [in Russian], Ruta, Chernovtsy (1995).

    Google Scholar 

  16. Yu. Tu, Modern Control Theory [in Russian], Mashinostroenie, Moscow (1971).

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Additional information

__________

Translated from Kibernetika i Sistemnyi Analiz, No. 3, pp. 58–68, May–June 2005.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kirichenko, N.F., Donchenko, V.S. & Serbaev, D.P. Nonlinear Recursive Regression Transformers: Dynamic Systems and Optimization. Cybern Syst Anal 41, 364–373 (2005). https://doi.org/10.1007/s10559-005-0070-3

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10559-005-0070-3

Keywords

Navigation