Skip to main content
SpringerLink
Log in

Asymptotics of Normalized Control with Markov Switchings

  • Published:
Ukrainian Mathematical Journal Aims and scope

We study the process of transfer of Markov perturbations and control over this process under the condition of existence of the equilibrium point of the quality criterion. For this control, we construct a normalized process and establish its asymptotic normality in the form of Ornstein–Uhlenbeck process in the case where the transfer process varies under the influence of Markov switchings along a new trajectory of evolution from the state in which it was at the time of switching.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. I. I. Gikhman and A. V. Skorokhod, Controlled Random Processes [in Russian], Naukova Dumka, Kiev (1977).

  2. J. Jacod and A. N. Shiryaev, Limit Theorems for Stochastic Processes, Springer, Berlin (1994).

    MATH  Google Scholar 

  3. M. B. Nevel'son and R. Z. Khas'minskii, Stochastic Approximation and Recurrence Estimation [in Russian], Nauka, Moscow (1972).

  4. V. B. Kolmanovskii, “Problems of optimal estimation,” Soros. Obrazov. Zh., No. 11, 122–127 (1999).

  5. A. V. Skorokhod, Asymptotic Methods of the Theory of Stochastic Differential Equations [in Russian], Naukova Dumka, Kiev (1987).

  6. V. Koroliuk and N. Limnios, Stochastic Systems in Merging Phase Space, World Scientific Publishing, Singapore (2005).

    Book  MATH  Google Scholar 

  7. Ya. M. Chabanyuk, “Asymptotic normality for a continuous procedure of stochastic approximation in Markov media,” Dop. Nats. Akad. Nauk Ukr., No 11, 29–34 (2005).

  8. Ya. M. Chabanyuk, “Continuous procedure of stochastic approximation in a semi-Markov medium,” Ukr. Mat. Zh., 56, No. 5, 713–720 (2004); English translation: Ukr. Math. J., 56, No. 5, 862–872 (2004).

Download references

Author information

Authors and Affiliations

  1. Shevchenko Kiev National University, Kiev, Ukraine

    A. V. Nikitin

  2. “L’vivs’ka Politekhnika” National University, Lviv, Ukraine

    U. T. Khimka

Authors
  1. A. V. Nikitin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. U. T. Khimka
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Translated from Ukrains’kyi Matematychnyi Zhurnal, Vol. 68, No. 8, pp. 1092–1101, August, 2016.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Nikitin, A.V., Khimka, U.T. Asymptotics of Normalized Control with Markov Switchings. Ukr Math J 68, 1252–1262 (2017). https://doi.org/10.1007/s11253-017-1291-0

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11253-017-1291-0

Search

Navigation