Skip to main content
SpringerLink
Log in

Optimal control for linear discrete systems with respect to probabilistic criteria

  • Stochastic Systems, Queueing Systems
  • Published:
Automation and Remote Control Aims and scope Submit manuscript

Abstract

We consider the optimal control problem for a linear discrete stochastic system. The optimality criterion is the probability for the first coordinate of the system to fall into a given neighborhood of zero in time not exceeding a predefined value. The problem reduces to an equivalent stochastic optimal control problem with probabilistic terminal criterion. The latter can be solved analytically with dynamical programming. We give sufficient conditions for which the resulting optimal control turns out to be also optimal with respect to the quantile criterion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Malyshev, V.V. and Kibzun, A.I., Analiz i sintez vysokotochnogo upravleniya letatel’nymi apparatami (Analysis and Synthesis of High Accuracy Control for Flying Vehicles), Moscow: Mashinostroenie, 1987.

    Google Scholar 

  2. Zubov, V.I., Lektsii po teorii upravleniya (Lectures in Control Theory), Moscow: Nauka, 1975.

    MATH  Google Scholar 

  3. Afanas’ev, V.N., Kolmanovskii, V.B., and Nosov, V.R., Matematicheskaya teoriya konstruirovaniya sistem upravleniya (Mathematical Theory of Constructing Control Systems), Moscow: Vysshaya Shkola, 2003.

    Google Scholar 

  4. Krasovskii, N.N., On Optimal Control under Random Perturbations, Prikl. Mat. Mekh., 1960, vol. 24, no. 1, pp. 64–79.

    MathSciNet  Google Scholar 

  5. Kan, Yu.S., Control Optimization by the Quantile Criterion, Autom. Remote Control, 2001, vol. 62, no. 5, pp. 746–757.

    Article  MathSciNet  MATH  Google Scholar 

  6. Vishnaykov, V.B. and Kibzun, A.I., Deterministic Equivalents for the Problems of Stochastic Programming with Probabilistic Criteria, Autom. Remote Control, 2006, vol. 67, no. 6, pp. 945–961.

    Article  MathSciNet  MATH  Google Scholar 

  7. Kan, Yu.S. and Kibzun, A.I., Zadachi stokhasticheskogo programmirovaniya s veroyatnostnymi kriteriyami (Stochastic Programming Problems with Probabilistic Criteria), Moscow: Fizmatlit, 2009.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Moscow Aviation Institute, Moscow, Russia

    V. M. Azanov

Authors
  1. V. M. Azanov
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to V. M. Azanov.

Additional information

Original Russian Text © V.M. Azanov, 2014, published in Avtomatika i Telemekhanika, 2014, No. 10, pp. 39–51.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Azanov, V.M. Optimal control for linear discrete systems with respect to probabilistic criteria. Autom Remote Control 75, 1743–1753 (2014). https://doi.org/10.1134/S0005117914100038

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0005117914100038

Keywords

Search

Navigation