Skip to main content

Integral Reinforcement Learning-Based \(H_\infty \) Tracking Control for Uncertain Linear Systems and Its Application

  • Conference paper
  • First Online:
Proceedings of 2021 5th Chinese Conference on Swarm Intelligence and Cooperative Control

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 934))

Abstract

In this paper, a robust optimal tracking strategy is presented for linear system with systems uncertainty and bounded disturbance. Firstly, an integral sliding mode control policy is designed to guarantee system trajectories tend to a defined sliding mode surface and the influence of system uncertainty is eliminated. Then the robust tracking control problem of original system is transformed into the \(H_\infty \) control problem of an auxiliary error system. Furthermore, an off-policy integral reinforcement learning (IRL) algorithm based \(H_\infty \) controller is designed, where the optimal tracking performance is guaranteed under the adverse effect of external disturbance. Finally, simulation test for near space vehicle (NSV) attitude model is introduced to verify the effectiveness of the proposed strategy.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 469.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 599.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 599.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Zhao, Z., He, X., Ren, Z., Wen, G.: Boundary adaptive robust control of a flexible riser system with input nonlinearities. IEEE Trans. Syst. Man Cybern. Syst. 49(10), 1971–1980 (2018)

    Article  Google Scholar 

  2. Chen, W.H., Ding, K., Lu, X.: Disturbance-observer-based control design for a class of uncertain systems with intermittent measurement. J. Franklin Inst. 354(13), 5266–5279 (2017)

    Article  MathSciNet  Google Scholar 

  3. Pan, Y., Yang, C., Pan, L., Yu, H.: Integral sliding mode control: performance, modification, and improvement. IEEE Trans. Industr. Inf. 14(7), 3087–3096 (2017)

    Article  Google Scholar 

  4. Jiang, B., Karimi, H.R., Kao, Y., Gao, C.: A novel robust fuzzy integral sliding mode control for nonlinear semi-Markovian jump T-S fuzzy systems. IEEE Trans. Fuzzy Syst. 26(6), 3594–3604 (2018)

    Article  Google Scholar 

  5. Van, M., Ge, S.S.: Adaptive fuzzy integral sliding-mode control for robust fault-tolerant control of robot manipulators with disturbance observer. IEEE Trans. Fuzzy Syst. 29(5), 1284–1296 (2020)

    Article  Google Scholar 

  6. Qin, C.B., Zhang, H.G., Luo, Y.H.: Online optimal tracking control of continuous-time linear systems with unknown dynamics by using adaptive dynamic programming. Int. J. Control 87(5), 1000–1009 (2014)

    Article  MathSciNet  Google Scholar 

  7. Jiang, H.Y., Zhou, B., Liu, G.P.: \(H_\infty \) optimal control of unknown linear systems by adaptive dynamic programming with applications to time-delay systems. Int. J. Robust Nonlinear Control 31(12), 5602–5617 (2021)

    Article  MathSciNet  Google Scholar 

  8. Wen, Y., Si, J., Brandt, A., Gao, X., Huang, H.: Online reinforcement learning control for the personalization of a robotic knee prosthesis. IEEE Trans. Cybern. 50(6), 2346–2356 (2019)

    Article  Google Scholar 

  9. Bian, T., Jiang, Z.: Reinforcement learning for linear continuous-time systems: an incremental learning approach. IEEE/CAA J. Automatica Sinica 6(2), 433–440 (2019)

    Article  MathSciNet  Google Scholar 

  10. Moghadam, R., Lewis, F.L.: Output-feedback \(H_{\infty }\) quadratic tracking control of linear systems using reinforcement learning. Int. J. Adapt. Control Signal Process. 33(2), 300–314 (2017)

    Article  Google Scholar 

  11. Wang, G., Luo, B., Xue, S.: Integral reinforcement learning based optimal feedback control for nonlinear continuous time systems with input delay. Neurocomputing 460, 31–38 (2021)

    Article  Google Scholar 

  12. Yang, Q.: Robust control for near space vehicle with input saturation. Nanjing University of Aeronautics and Astronautics (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rongsheng Xia .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Xia, R., Wu, J., Shen, H. (2023). Integral Reinforcement Learning-Based \(H_\infty \) Tracking Control for Uncertain Linear Systems and Its Application. In: Ren, Z., Wang, M., Hua, Y. (eds) Proceedings of 2021 5th Chinese Conference on Swarm Intelligence and Cooperative Control. Lecture Notes in Electrical Engineering, vol 934. Springer, Singapore. https://doi.org/10.1007/978-981-19-3998-3_97

Download citation

  • DOI: https://doi.org/10.1007/978-981-19-3998-3_97

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-19-3997-6

  • Online ISBN: 978-981-19-3998-3

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics