Skip to main content
SpringerLink
Log in

Adaptive Dynamic Programming-Based Robust Output Regulation of Discrete-Time Linear Systems via Output Feedback

  • Conference paper
  • First Online:
Proceedings of 2021 Chinese Intelligent Systems Conference

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 804))

Abstract

This note studies robust output regulation problem for discrete-time linear systems with unknown system dynamics. Combining standard internal model and approximate/adaptive dynamic programming (ADP), an adaptive optimal output feedback controller is developed in the case that the state and disturbance of the system are unmeasurable. It is shown that the proposed controller can achieve asymptotic tracking while making the system exponentially stable. Quarter passive suspension vehicle model is given to illustrated the effectiveness of the algorithm.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 349.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 449.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 449.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bardi, M., Italo, C.D.: Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations. Birkhauser, Boston (1997)

    Book  Google Scholar 

  2. Chen, C., Modares, H., Xie, K., Lewis, F.L., Wan, Y., Xie, S.: Reinforcement learning-based adaptive optimal exponential tracking control of linear systems with unknown dynamics. IEEE Trans. Autom. Control 64, 4423–4438 (2019). https://doi.org/10.1109/TAC.2019.2905215

    Article  MathSciNet  MATH  Google Scholar 

  3. Chen, C., Sun, W., Zhao, G., Peng, Y.: Reinforcement Q-learning incorporated with internal model method for output feedback tracking control of unknown linear systems. IEEE Acess. 8, 134456–134467 (2020). https://doi.org/10.1109/ACCESS.2020.3011194

    Article  Google Scholar 

  4. Fan, Q.Y., Yang, G.H.: Adaptive actor-critic design-based integral sliding-mode control for partially unknown nonlinear systems with input disturbances. IEEE Trans. Neural Netw. Learn. Syst. 27, 165–177 (2016). https://doi.org/10.1109/TNNLS.2015.2472974

    Article  MathSciNet  Google Scholar 

  5. Gao, W., Jiang, Z.P.: Adaptive dynamic programming and adaptive optimal output regulation of linear systems. IEEE Trans. Autom. Control 61, 4164–4169 (2016). https://doi.org/10.1109/TAC.2016.2548662

    Article  MathSciNet  MATH  Google Scholar 

  6. Gao, W., Jiang, Z.P.: Adaptive optimal output regulation of time-delay systems via measurement feedback. IEEE Trans. Neural Netw. Learn. Syst. 30, 938–944 (2019). https://doi.org/10.1109/TNNLS.2018.2850520

    Article  MathSciNet  Google Scholar 

  7. Gao, W., Jiang, Z.P., Lewis, F.L., Wang, Y.: Leader-to-formation stability of multi-agent systems: an adaptive optimal control approach. IEEE Trans. Autom. Control 63, 3581–3587 (2018). https://doi.org/10.1109/TAC.2018.2799526

    Article  MATH  Google Scholar 

  8. Hewer, G.: An iterative technique for the computation of the steady state gains for the discrete optimal regulator. IEEE Trans. Autom. Control 16, 382–384 (1971). https://doi.org/10.1109/TAC.1971.1099755

    Article  Google Scholar 

  9. Jiang, Y., Jiang, Z.P.: Computational adaptive optimal control for continuous-time linear systems with completely unknown dynamics. Automatica 48, 2699–2704 (2012). https://doi.org/10.1016/j.automatica.2012.06.096

    Article  MathSciNet  MATH  Google Scholar 

  10. Liu, D., Wei, Q.: Policy iteration adaptive dynamic programming algorithm for discrete-time nonlinear systems. IEEE Trans. Neural. Netw. Learn. Syst. 25, 621–634 (2014). https://doi.org/10.1109/TNNLS.2013.2281663

    Article  Google Scholar 

  11. Powell, W.B.: Approximate Dynamic Programming: Solving the Curses of Dimensionality. Wiley, Hoboken (2011)

    Book  Google Scholar 

  12. Rajamani, R.: Vehicle Dynamics and Control. Springer, New York (2006)

    MATH  Google Scholar 

  13. Rizvi, S.A.A., Lin, Z.: Output feedback Q-learning control for the discrete-time linear quadratic regulator problem. IEEE Trans. Neural Netw. Learn. Syst. 30, 1523–1536 (2018). https://doi.org/10.1109/TNNLS.2018.2870075

  14. Sutton, R.S., Barto, A.G.: Introduction to Reinforcement Learning. MIT Press, Cambridge (1998)

    Google Scholar 

  15. Su, Y., Huang, J.: Cooperative robust output regulation of a class of heterogeneous linear uncertain multi-agent systems. Int. J. Robust. Nonlin. 24, 2819–1839 (2014). https://doi.org/10.1002/rnc.3027

    Article  MathSciNet  MATH  Google Scholar 

  16. Wang, D., Liu, D., Li, H., Luo, B., Ma, H.: An approximate optimal control approach for robust stabilization of a class of discrete-time nonlinear systems with uncertainties. IEEE Trans. Syst. Man. Cybern. Syst. 46, 713–717 (2016). https://doi.org/10.1109/TSMC.2015.2466191

    Article  Google Scholar 

  17. Zhu, L.M., Modares, H., Peen, G.O., Lewis, F.L.: Adaptive suboptimal output-feedback control for linear systems using integral reinforcement learning. IEEE Trans. Control Syst. Technol. 23, 264–273 (2015). https://doi.org/10.1109/TNNLS.2015.2472974

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by National Natural Science Foundation of China (Grant No. 61773122).

Author information

Authors and Affiliations

  1. College of Mathematics and Statistics, Fuzhou University, Fuzhou, 350116, China

    Qinlin Feng

  2. College of Computer and Data Science, Fuzhou University, Fuzhou, 350116, China

    Youfeng Su

Authors
  1. Qinlin Feng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Youfeng Su
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Youfeng Su .

Editor information

Editors and Affiliations

  1. School of Automatic Science and Electrical Engineering, Beihang University, Beijing, China

    Yingmin Jia

  2. School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, China

    Weicun Zhang

  3. School of Mechanical Engineering and Automation, Beihang University, Beijing, China

    Yongling Fu

  4. Beijing Institute of Precision Mechatronics and Controls, Beijing, China

    Zhiyuan Yu

  5. College of Electrical Engineering and Automation, Fuzhou University, Fuzhou, Fujian, China

    Song Zheng

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Feng, Q., Su, Y. (2022). Adaptive Dynamic Programming-Based Robust Output Regulation of Discrete-Time Linear Systems via Output Feedback. In: Jia, Y., Zhang, W., Fu, Y., Yu, Z., Zheng, S. (eds) Proceedings of 2021 Chinese Intelligent Systems Conference. Lecture Notes in Electrical Engineering, vol 804. Springer, Singapore. https://doi.org/10.1007/978-981-16-6324-6_30

Download citation

Publish with us

Policies and ethics

Search

Navigation