Skip to main content
SpringerLink
Log in

On stochastic optimality for a linear controller with attenuating disturbances

  • Stochastic Systems, Queueing Systems
  • Published:
Automation and Remote Control Aims and scope Submit manuscript

Abstract

For a linear stochastic control system with quadratic objective functional, we introduce various generalizations of the notions of optimality on average and stochastic optimality on an infinite time interval that take into account possible degeneration of the parameter of the disturbing process with time (attenuation of the disturbances) or the presence of a discount function in the objective functional. This lets us improve upon the quality estimate for a well known optimal control in this problem from the point of view of both asymptotic behavior of the functional’s expectation and its asymptotic probabilistic properties. In particular, in the considered case we have found an improvement for the well known logarithmic upper bound on the optimal control for a family of defect processes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Letov, A.M., Analytical Controller Design, I–III, Autom. Remote Control, 1960, vol. 21, no. 4, pp. 303–306; no. 5, pp. 389–393; no. 6, pp. 458–461.

    MATH  Google Scholar 

  2. Kwakernaak, H. and Sivan, R., Linear Optimal Control Systems, New York: Wiley, 1972. Translated under the title Lineinye optimal’nye sistemy upravleniya, Moscow: Mir, 1977.

    MATH  Google Scholar 

  3. Belkina, T.A. and Rotar’, V.I., On Optimality in Probability and Almost Surely for Processes with a Communication Property. I. The Discrete Time Case, Theor. Veroyat. Primen., 2005, vol. 50, no. 1, pp. 3–26.

    MathSciNet  Google Scholar 

  4. Belkina, T.A., Kabanov, Yu.M., and Presman, E.L., On a Stochastic Optimality of the Feedback Control in the LQG-Problem, Theor. Veroyat. Primen., 2003, vol. 48, no. 1, pp. 661–675.

    MathSciNet  Google Scholar 

  5. Leizarowitz, A., Controlled Diffusion Processes on Infinite Horizon with the Overtaking Criterion, Appl. Math. Optim., 1988, vol. 17, no. 1, pp. 61–78.

    Article  MathSciNet  MATH  Google Scholar 

  6. Chan, D. and Williams, D., An “Excursion” Approach to an Annealing Problem, Proc. Camb. Philos. Soc., Cambridge: Cambridge Univ. Press, 1989, vol. 105, no. 1, pp. 169–176.

    Article  MathSciNet  MATH  Google Scholar 

  7. Di Masi, G.B. and Kabanov, Yu., On Sensitive Probabilistic Criteria in the Linear Regulator Problem with Infinite Horizon, Obozr. Prikl. Prom. Mat., 1998, vol. 5, no. 2, pp. 410–422.

    MATH  Google Scholar 

  8. Loewenstein, G. and Prelec, D., Anomalies in Intertemporal Choice: Evidence and an Interpretation, The Quarterly J. Econ., Oxford: Oxford Univ. Press, 1992, vol. 107, no. 1, pp. 573–597.

    Google Scholar 

  9. Ekeland, I. and Pirvu, T.A., Investment and Consumption without Commitment, Math. Finan. Econ., 2008, vol. 2, no. 1, pp. 57–86.

    Article  MathSciNet  MATH  Google Scholar 

  10. Palamarchuk, E.S., Controlling the Process of Price Convergence to Equilibrium under Random Factors, in Analiz i modelirovanie ekonomicheskikh protsessov (Analysis and Modelling of Economic Processes), Moscow: TsEMI, 2010, no. 7, pp. 123–136.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Central Economics and Mathematics Institute, Russian Academy of Sciences, Moscow, Russia

    T. A. Belkina & E. S. Palamarchuk

Authors
  1. T. A. Belkina
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. E. S. Palamarchuk
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Original Russian Text © T.A. Belkina, E.S. Palamarchuk, 2013, published in Avtomatika i Telemekhanika, 2013, No. 4, pp. 110–128.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Belkina, T.A., Palamarchuk, E.S. On stochastic optimality for a linear controller with attenuating disturbances. Autom Remote Control 74, 628–641 (2013). https://doi.org/10.1134/S0005117913040061

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0005117913040061

Keywords

Search

Navigation