Skip to main content
SpringerLink
Log in

Distributed Optimization Algorithm for Multi-agent System with Time-Varying Communication Delay Based on the Game Theory

  • Conference paper
  • First Online:
Proceedings of 2023 Chinese Intelligent Systems Conference (CISC 2023)

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 1089))

Included in the following conference series:

  • 411 Accesses

Abstract

In this paper, the distributed optimization problem for multi-agent system with time-varying communication delay \(\tau (t)\) is studied based on game theory. Firstly, the distributed optimization problem \(\min _{x} \phi (x)\) is modeled as a state based ordinal potential game model G. Then, the existence and validity of the Nash equilibrium in the game model are verified. In addition, a revenue-based strategy learning algorithm is designed under topology network with \(\tau (t)\) to find the Nash equilibrium. Finally, a numerical simulation illustrates the results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Yu, W., Chen, G., Ren, W., et al.: Distributed higher order consensus protocols in multiagent dynamical systems. IEEE Trans. Circuits Syst. I: Regul. Pap. 58(8), 1924–1932 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  2. Xiang, X., Liu, L., Gang, F.: Consensus of single integrator multi-agent systems with directed topology and communication delays. Control Theory Technol. 14, 21–27 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  3. Deng, Z., Liang, S., Hong, Y.: Distributed continuous-time algorithms for resource allocation problems over weight-balanced digraphs. IEEE Trans. Cybern. 1–10 (2017)

    Google Scholar 

  4. Qiu, Z., Xie, L., Hong, Y.: Distributed optimal consensus of multiple double integrators under bounded velocity and acceleration. Control Theory Technol. 17(1), 85–98 (2019)

    Article  MathSciNet  Google Scholar 

  5. Tsitsiklis, J.N.: Problems in decentralized decision making and computation. Thesis, Department of EECS, Massachusetts Institute of Technology (1984)

    Google Scholar 

  6. Nedié, A., Ozdaglar, A.: Distributed subgradient methods for multi-agent optimization. IEEE Trans. Autom. Control 54(1), 48–61 (2009)

    Article  MathSciNet  MATH  Google Scholar 

  7. Cortes, J., Gharesifard, B.: Continuous-time distributed convex optimization on directed graphs (2012)

    Google Scholar 

  8. Shi, P., Wei, S., Xu, J., et al.: Push-pull gradient methods for distributed optimization in networks (2018)

    Google Scholar 

  9. Nedié, A., Olshevsky, A., Shi, W.: Achieving geometric convergence for distributed optimization over time-varying graphs. SIAM J. Optim. 27(4) (2016)

    Google Scholar 

  10. Vamvoudakis, K.G., Lewis, F.L., Hudas, G.R.: Multi-agent differential graphical games: online adaptive learning solution for synchronization with optimality. Automatica 48(8), 1598–1611 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  11. Abouheaf, M.I., Lewis, F.L., Vamvoudakis, K.G., et al.: Multi-agent discrete-time graphical games and reinforcement learning solutions. Automatica 50(12), 3038–3053 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  12. Marden, J.R., Arslan, G., Shamma, J.S.: Cooperative control and potential games. IEEE Trans. Syst. Man Cybern. Part B Cybern. 39(6), 1393 (2009)

    Article  Google Scholar 

  13. Xue, L., Wang, Q.L., Sun, C.Y.: Game theoretical approach for the leader selection of the second-order multi-agent system. Control Theory Appl. (2016)

    Google Scholar 

  14. Zhang, J., Qi, D., Zhao, G.: A new game model for distributed optimization problems with directed communication topologies. Neurocomputing 148, 278–287 (2015)

    Article  Google Scholar 

  15. Zhang, J., Qi, D., Zhao, G.: Distributed optimization and state based ordinal potential games. Commun. Comput. Inf. Sci. 355, 113–121 (2013)

    Google Scholar 

Download references

Acknowledgements

This work was supported by the Open Fund of Key Laboratory of Dependable Service Computing in Cyber Physical Society of Chongqing University (Grant No. CPSDSC202202), and the National Natural Science Foundation of China (Grant No. 62103203).

Author information

Authors and Affiliations

  1. Key Laboratory of Dependable Service Computing in Cyber Physical Society, Ministry of Education of China, Chongqing University, Chongqing, 400044, China

    Chen Wang & Fuyong Wang

  2. College of Artificial Intelligence, Nankai University, Tianjin, 300350, China

    Chen Wang, Rui Zhu, Fuyong Wang & Zhongxin Liu

Authors
  1. Chen Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rui Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fuyong Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Zhongxin Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fuyong Wang .

Editor information

Editors and Affiliations

  1. School of Automation Science and Electrical Engineering, Beihang University, Beijing, China

    Yingmin Jia

  2. School of Automation and Electrical Engineering, University of Science and Technology Beijing, Beijing, China

    Weicun Zhang

  3. School of Mechanical Engineering and Automation, Beihang University, Beijing, China

    Yongling Fu

  4. Ningbo Institute of Materials Technology&Engineering, Chinese Academy of Sciences, Ningbo, Zhejiang, China

    Jiqiang Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Wang, C., Zhu, R., Wang, F., Liu, Z. (2023). Distributed Optimization Algorithm for Multi-agent System with Time-Varying Communication Delay Based on the Game Theory. In: Jia, Y., Zhang, W., Fu, Y., Wang, J. (eds) Proceedings of 2023 Chinese Intelligent Systems Conference. CISC 2023. Lecture Notes in Electrical Engineering, vol 1089. Springer, Singapore. https://doi.org/10.1007/978-981-99-6847-3_62

Download citation

Publish with us

Policies and ethics

Search

Navigation