Skip to main content
SpringerLink
Log in

Iterative processes: A survey of convergence theory using Lyapunov second method

  • System Analysis
  • Published:
Cybernetics and Systems Analysis Aims and scope

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  1. A. M. Lyapunov, General Problem of Stability of Motion [in Russian], Gostekhizdat, Moscow-Leningrad (1950).

    Google Scholar 

  2. A. A. Voronov and V. M. Matrosov (eds.), The Method of Lyapunov Vector Functions in Stability Theory [in Russian], Nauka, Moscow (1987).

    Google Scholar 

  3. A. Halanay and D. Wechsler, Qualitative Theory of Sampled-Data Systems [Russian translation], Mir, Moscow (1971).

    Google Scholar 

  4. G. I. Marchuk and Yu. A. Kuznetsov, “Iterative methods and quadratic functionals,” in: Methods of Computational Mathematics [in Russian], Nauka, Novosibirsk (1975), pp. 4–143.

    Google Scholar 

  5. Yu. I. Lyubich and G. D. Maistrovskii, “General theory of relaxation processes,” UMN,25, No. 1, 57–112 (1970).

    Google Scholar 

  6. J. Doob, Stochastic Processes [Russian translation], IL, Moscow (1956).

    Google Scholar 

  7. R. S. Bucy, “Stability and positive supermartingales,” J. Diff. Eq.,1, No. 2, 151–155 (1965).

    MATH  MathSciNet  Google Scholar 

  8. J. B. Blum, “Multidimensional stochastic approximation method,” Ann. Math. Stat.,25, No. 4, 737–744 (1954).

    MATH  MathSciNet  Google Scholar 

  9. É. M. Braverman and L. I. Rozonoer, “Convergence of stochastic processes in machine learning theory. I,” Avtomat. Telemekh., No. 1, 57–77 (1969).

    MathSciNet  Google Scholar 

  10. B. T. Polyak, “Convergence and rate of convergence of iterative stochastic algorithms, I. The general case,” Avtomat. Telemekh., No. 12, 83–94 (1976).

    MATH  MathSciNet  Google Scholar 

  11. V. Ya. Katkovnik, Linear Estimators and Stochastic Optimization Problems [in Russian], Nauka, Moscow (1976).

    Google Scholar 

  12. L. Armijo, “Minimization of functions having Lipschitz-continuous first partial derivatives,” Pacific J. Math.,16, 1–3 (1966).

    MATH  MathSciNet  Google Scholar 

  13. Yu. M. Ermol'ev, Stochastic Programming Methods [in Russian], Nauka, Moscow (1976).

    Google Scholar 

  14. A. V. Nazin and A. S. Poznyak, Adaptive Choice of Alternatives [in Russian], Nauka, Moscow (1986).

    Google Scholar 

  15. H. Robbins and D. Siegmund, “A convergence theorem for non-negative almost supermartingales and some applications,” in: Optimizing Methods in Statistics, Academic Press, New York (1971), pp. 233–257.

    Google Scholar 

  16. A. N. Nakonechnyi, “Probabilistic-theoretical generalization of Lyapunov second method,” Dokl. Akad. Nauk UkrSSR, Ser. A, No. 2, 18–19 (1990).

    MathSciNet  Google Scholar 

  17. A. N. Nakonechnyi, “Probabilistic-theoretical generalization of Lyapunov second method,” Kibern. Sistem. Anal., No. 1, 68–81 (1993).

    MathSciNet  Google Scholar 

  18. W. I. Zangwill, Nonlinear Programming: A Unified Approach, Prentice Hall, Englewood Cliffs, NJ (1969).

    Google Scholar 

  19. E. A. Nurminskii, “Convergence conditions for nonlinear programming algorithms,” Kibernetika, No. 6, 79–81 (1972).

    MATH  MathSciNet  Google Scholar 

  20. V. I. Norkin, “Necessary and sufficient convergence conditions for iterative nonlinear programming algorithms,” Kibernetika, No. 4, 50–55 (1987).

    MATH  MathSciNet  Google Scholar 

  21. I. K. Argyros and F. Szidarovszky, “Convergence of general iteration schemes,”J. Math. Anal. Appl.,168, No. 1, 42–62 (1992).

    MathSciNet  Google Scholar 

  22. A. N. Nakonechnyi, “Extremal problems with rare events. II (Method of successive random approximations),” Kibern. Sistem. Anal., No. 2, 41–48 (1992).

    Google Scholar 

  23. M. T. Wasan, Stochastic Approximation, Cambridge Univ. Press (1969).

  24. A. N. Nakonechnyi and V. D. Shpak, “Adaptive optimization of the Monte-Carlo method,” Kibern. Sistem. Anal., No. 1, 51–57 (1994).

    MathSciNet  Google Scholar 

  25. R. Bellman, “Vector Lyapunov function,” SIAM J. Contr., Ser. A, No. 1, 32–34 (1962).

    MATH  Google Scholar 

  26. V. M. Matrosov, “On the theory of stability of motion,” PMM,26, No. 6, 992–1000 (1962).

    MATH  MathSciNet  Google Scholar 

  27. G. Ladde and D. Siljak, “Convergence and stability of distributed stochastic iterative processes,” IEEE Trans. Autom. Contr.,35, No. 6, 665–672 (1990).

    MathSciNet  Google Scholar 

  28. A. N. Nakonechnyi, “Probabilistic-theoretical analog of the method of vector Lyapunov functions,” Kibern. Sistem. Anal., No. 3, 110–119 (1994).

    MATH  MathSciNet  Google Scholar 

  29. E. G. Gladyshev, “On stochastic approximation,” Teor. Veroyatn. Ee Primen,10, No. 2, 297–300 (1965).

    Google Scholar 

  30. A. A. Martynyuk, “The Lyapunov matrix-function,” Nonlinear Analysis,8, No. 10, 1223–1226 (1984).

    MATH  MathSciNet  Google Scholar 

  31. S. M. Ermakov, Monte-Carlo Method and Related Topics [in Russian], Nauka, Moscow (1975).

    Google Scholar 

  32. I. N. Kovalenko and N. Yu. Kuznetsov, Computational Methods for High-Reliability Systems [in Russian], Radio i Svyaz', Moscow (1988).

    Google Scholar 

  33. G. A. Mikhailov, Optimization of Weighted Monte-Carlo Methods [in Russian], Nauka, Moscow (1987).

    Google Scholar 

  34. E. L. Pugh, “A gradient technique of adaptive Monte-Carlo,” SIAM Rev.,8 No. 3, 346–355 (1966).

    MATH  MathSciNet  Google Scholar 

  35. E. S. Troubetzkoy, “Optimization of linear Monte-Carlo calculation,” Nucl. Sci. Eng.,107, No. 4, 356–364 (1991).

    Google Scholar 

  36. B. T. Polyak, An Introduction to Optimization [in Russian], Nauka, Moscow (1983).

    Google Scholar 

  37. D. Bertsekas, Conditional Optimization and Lagrange Multiplier Methods [Russian translation], Radio i Svyaz', Moscow (1987).

    Google Scholar 

  38. J. B. Dennis and R. B. Schnabel, Numerical Methods for Unconstrained Minimization and Nonlinear Equations [Russian translation], Mir, Moscow (1988).

    Google Scholar 

  39. G. N. Saridis, “Stochastic approximation methods for identification and control,” IEEE Trans. Autom. Contr.,19, No. 6, 798–809 (1974).

    MATH  MathSciNet  Google Scholar 

  40. G. Saridis, Self-Organizing Stochastic Control Systems [Russian translation], Mir, Moscow (1980).

    Google Scholar 

  41. A. M. Rodionov, “Some modifications of theorems of Lyapunov second method for discrete systems,” Avtomat. Telemekh., No. 9, 86–92 (1992).

    MATH  MathSciNet  Google Scholar 

  42. I. N. Kovalenko and A. N. Nakonechnyi, Approximate Computation and Optimization of Reliability [in Russian], Naukova Dumka, Kiev (1989).

    Google Scholar 

  43. A. N. Nakonechnyi, “Extremal problems with rare events. I,” Kibernetika, No. 5, 55–58 (1990).

    MathSciNet  Google Scholar 

  44. E. M. Braverman and L. I. Rozonoer, “Convergence of stochastic processes in machine learning theory. II,” Avtomat. Telemekh., No. 3, 87–103 (1969).

    MathSciNet  Google Scholar 

  45. A. V. Nazin, B. T. Polyak and A. B. Tsybakov, “Passive stochastic approximation,” Avtomat. Telemekh., No. 11, 127–134 (1989).

    MathSciNet  Google Scholar 

  46. A. B. Tsybakov, “Recursive estimation of the mode of a multivariate distribution,” Probl. Peredachi Inform.,21, No. 4, 38–45 (1990).

    MathSciNet  Google Scholar 

  47. O. N. Granichin, “Stochastic approximation procedure with noisy input,” Avtomat. Telemekh. No. 2, 98–104 (1992).

    Google Scholar 

  48. O. Yu. Kul'chitskii, “A method of convergence analysis for adaptive filtering algorithms using stochastic Lyapunov functions,” Probl. Peredachi Inform.,21, No. 4, 49–63 (1985).

    MathSciNet  Google Scholar 

Download references

Authors
  1. A. N. Nakonechnyi
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Translated from Kibernetika i Sistemnyi Analiz, No. 4, pp.66–85, July–August 1994.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Nakonechnyi, A.N. Iterative processes: A survey of convergence theory using Lyapunov second method. Cybern Syst Anal 30, 528–544 (1994). https://doi.org/10.1007/BF02366563

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF02366563

Keywords

Search

Navigation