Skip to main content
SpringerLink
Log in

Optimal control with irregular performance

  • Research Paper
  • Published:
Science China Information Sciences Aims and scope Submit manuscript

Abstract

In this paper, we solve the long-standing fundamental problem of irregular linear-quadratic (LQ) optimal control, which has received significant attention since the 1960s. We derive the optimal controllers via the key technique of finding the analytical solutions to two different forward and backward differential equations (FBDEs). We give a complete solution to the finite-horizon irregular LQ control problem using a new ‘two-layer optimization’ approach. We also obtain the necessary and sufficient condition for the existence of optimal and stabilizing solutions in the infinite-horizon case in terms of solutions to two Riccati equations and the stabilization of one specific system. For the first time, we explore the essential differences between irregular and standard LQ control, making a fundamental contribution to classical LQ control theory. We show that irregular LQ control is totally different from regular control as the irregular controller must guarantee the terminal state constraint of P1(T)x(T) = 0.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ho Y C. Linear stochastic singular control problems. J Opt Theor Appl, 1972, 9: 24–31

    Article  MathSciNet  MATH  Google Scholar 

  2. Ho Y C. Linear stochastic singular control problems. J Opt Theor Appl, 1972, 9: 24–31

    Article  MathSciNet  MATH  Google Scholar 

  3. Jacobson D H, Speyer J L. Necessary and sufficient conditions for optimality for singular control problems: a limit approach. J Math Anal Appl, 1971, 34: 239–266

    Article  MathSciNet  MATH  Google Scholar 

  4. Chen H-F. Unified controls applicable to general case under quadratic index. Acta Math Appl Sin, 1982, 5: 45–52

    MathSciNet  Google Scholar 

  5. Chen S P, Li X J, Zhou X Y. Stochastic linear quadratic regulators with indefinite control weight costs. SIAM J Control Opt, 1998, 36: 1685–1702

    Article  MathSciNet  MATH  Google Scholar 

  6. Sun J R, Li X, Yong J M. Open-loop and closed-loop solvabilities for stochastic linear quadratic optimal control problems. SIAM J Control Opt, 2016, 54: 2274–2308

    Article  MathSciNet  MATH  Google Scholar 

  7. Bell D J. Singular problems in optimal control-a survey. Int J Control, 1975, 21: 319–331

    Article  MathSciNet  MATH  Google Scholar 

  8. Clements D, Anderson B D O. Singular Optimal Control: The Linear-Quadratic Problem. New York: Springer, 1978

    Book  MATH  Google Scholar 

  9. Bellman R, Glicksberg I, Gross O. Some Aspects of the Mathematical Theory of Control Processes. Rand Corporation, R-313. 1958

  10. Anderson B D O, Moore J B. Optimal Control: Linear Quadratic Methods. Englewood Cliffs: Prentice Hall, 1990

    MATH  Google Scholar 

  11. Lewis F L, Vrabie D L, Syrmos V L. Optimal Control. Hoboken: John Wiley & Sons, Inc., 2012

    Book  MATH  Google Scholar 

  12. Xu J J, Shi J T, Zhang H S. A leader-follower stochastic linear quadratic differential game with time delay. Sci China Inf Sci, 2018, 61: 112202

    Article  MathSciNet  Google Scholar 

  13. Qi Q Y, Zhang H S. Time-inconsistent stochastic linear quadratic control for discrete-time systems. Sci China Inf Sci, 2017, 60: 120204

    Article  MathSciNet  Google Scholar 

  14. Shi J T, Wang G C, Xiong J. Linear-quadratic stochastic stackelberg differential game with asymmetric information. Sci China Inf Sci, 2017, 60: 092202

    Article  Google Scholar 

  15. Ju P J, Zhang H S. Achievable delay margin using LTI control for plants with unstable complex poles. Sci China Inf Sci, 2018, 61: 092203

    Article  MathSciNet  Google Scholar 

  16. Zhang H S, Li L, Xu J J, et al. Linear quadratic regulation and stabilization of discrete-time systems with delay and multiplicative noise. IEEE Trans Automat Contr, 2015, 60: 2599–2613

    Article  MathSciNet  MATH  Google Scholar 

  17. Zhang H S, Xu J J. On irregular linear quadratic control: deterministic case. 2017. ArXiv: 1712.08866v1

  18. Xu J J, Zhang H S. Consensus control of multi-agent systems with optimal performance. 2018. ArXiv: 1803.09412

  19. Zhang H S, Xu J J. Control for Itô stochastic systems with input delay. IEEE Trans Automat Contr, 2017, 62: 350–365

    Article  MATH  Google Scholar 

  20. Kalman R E. Contributions to the theory of optimal control. Bol Soc Mat Mexicana, 1960, 5: 102–119

    MathSciNet  Google Scholar 

  21. Letov A M. The analytical design of control systems. Autom Remote Control, 1961, 22: 363–372

    MathSciNet  MATH  Google Scholar 

  22. Pontryagin L S, Boltyanskii V G, Gamkrelidze R V, et al. The Mathematical Theory of Optimal Process. Hoboken: John Wiley & Sons Inc, 1962

    MATH  Google Scholar 

  23. Bellman R. The theory of dynamic programming. Bull Amer Math Soc, 1954, 60: 503–516

    Article  MathSciNet  MATH  Google Scholar 

  24. Gurman V. The method of multiple maxima and optimization problems for space maneuvers. In: Proceedings of the 2nd Readings of K. E. Tsiolkovskii, Moscow, 1968. 39–51

  25. Moore J B. The singular solutions to a singular quadratic minimization problem. Int J Control, 1974, 20: 383–393

    Article  MathSciNet  MATH  Google Scholar 

  26. Willems J C, Kitapçi A, Silverman L M. Singular optimal control: a geometric approach. SIAM J Control Opt, 1986, 24: 323–337

    Article  MathSciNet  MATH  Google Scholar 

  27. Gabasov R, Kirillova F M. High order necessary conditions for optimality. SIAM J Control, 1972, 10: 127–168

    Article  MathSciNet  MATH  Google Scholar 

  28. Krener A J. The high order maximal principle and its application to singular extremals. SIAM J Control Opt, 1977, 15: 256–293

    Article  MathSciNet  MATH  Google Scholar 

  29. Hoehener D. Variational approach to second-order optimality conditions for control problems with pure state constraints. SIAM J Control Opt, 2012, 50: 1139–1173

    Article  MathSciNet  MATH  Google Scholar 

  30. Bonnans J F, Silva F J. First and second order necessary conditions for stochastic optimal control problems. Appl Math Opt, 2012, 65: 403–439

    Article  MathSciNet  MATH  Google Scholar 

  31. Zhang H S, Zhang X. Pointwise second-order necessary conditions for stochastic optimal controls. Part I: the case of convex control constraint. SIAM J Control Opt, 2015, 53: 2267–2296

    MATH  Google Scholar 

  32. Penrose R. A generalized inverse for matrices. In: Mathematical Proceedings of the Cambridge Philosophical Society. Cambrige: Cambrige University Press, 1955. 52: 17–19

    Google Scholar 

  33. Rami M A, Moore J B, Zhou X Y. Indefinite stochastic linear quadratic control and generalized differential riccati equation. SIAM J Control Opt, 2002, 40: 1296–1311

    Article  MathSciNet  MATH  Google Scholar 

  34. Kliger I, Wonham W. Discussion on the stability of the singular trajectory with respect to “Bang-bang” control. IEEE Trans Autom Contr, 1964, 9: 583–585

    Article  Google Scholar 

  35. Hsia T. On the existence and synthesis of optimal singular control with quadratic performance index. IEEE Trans Autom Contr, 1967, 12: 778–779

    Article  Google Scholar 

  36. Yong J M, Zhou X Y. Stochatic Controls: Hamiltonian Systems and HJB Equations. Berlin: Springer, 1999

    Book  MATH  Google Scholar 

  37. Zhang F F, Zhang H S, Tan C, et al. A new approach to distributed control for multi-agent systems based on approximate upper and lower bounds. Int J Control Autom Syst, 2017, 15: 2507–2515

    Article  Google Scholar 

  38. Xu J J, Zhang H S, Chai T Y. Necessary and sufficient condition for two-player stackelberg strategy. IEEE Trans Autom Contr, 2015, 60: 1356–1361

    Article  MathSciNet  MATH  Google Scholar 

  39. Zhang H S, Qi Q Y, Fu M Y. Optimal stabilization control for discrete-time mean-field stochastic systems. IEEE Trans Autom Contr, 2019, 64: 1125–1136

    Article  MathSciNet  MATH  Google Scholar 

  40. Tan C, Zhang H S. Necessary and sufficient stabilizing conditions for networked control systems with simultaneous transmission delay and packet dropout. IEEE Trans Autom Contr, 2017, 62: 4011–4016

    Article  MathSciNet  MATH  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China (Grant Nos. 61633014, 61573221, 61873332) and the Qilu Youth Scholar Discipline Construction Funding from Shandong University.

Author information

Authors and Affiliations

  1. School of Control Science and Engineering, Shandong University, Jinan, 250061, China

    Huanshui Zhang & Juanjuan Xu

Authors
  1. Huanshui Zhang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Juanjuan Xu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Huanshui Zhang.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zhang, H., Xu, J. Optimal control with irregular performance. Sci. China Inf. Sci. 62, 192203 (2019). https://doi.org/10.1007/s11432-018-9685-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11432-018-9685-8

Keywords

Search

Navigation