Skip to main content

Intelligent Decision-Making of MAV/UAV in Air Combat Based on DDPG Algorithm

  • Conference paper
  • First Online:
Advances in Guidance, Navigation and Control

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 644))

Abstract

In order to perform the operational advantages of manned aerial vehicle (MAV) /unmanned aerial vehicle (UAV) cooperative system, a method of MAV/UAV intelligent decision-making in air combat based on deep deterministic policy gradient (DDPG) algorithm is proposed. Based on the continuous action space, four typical intentions of MAV were introduced, and the optimization models under different intentions were established. The simulation results show that the multiple UAVs can realize the cooperative operations under the guidance of MAV with a favorable effect. In addition, it makes up the gap for the 1VS1 air combat.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 429.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 549.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 549.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Fan, J., Li, D., Li, R.: Evaluation of MAV/UAV collaborative combat capability based on network structure. Int. J. Aerospace Eng. 1–12. https://doi.org/10.1155/2018/5301752

  2. Zhong, Y., Yao, P., Wan, L., Xiong, Y.: Optimal placement of CRNs in manned/unmanned aerial vehicle cooperative engagement system. KSII Trans. Internet Inf. Syst. 13(1), 52–68 (2019). https://doi.org/10.3837/tiis.2019.01.004

    Article  Google Scholar 

  3. Reim, G.: Unmanned support: using semi-autonomous UAVs—so-called Loyal Wingmen—alongside fighters could reverse a decades-long shrinking of the US Air Force’s attack fleet, and bolster effectiveness. (cover story). Flight Int. 5652, 36–37 (2018)

    Google Scholar 

  4. Loyal Wingmen could redefine air combat—Defence Special Report. The Australian (National, Australia). https://search.ebscohost.com.nudtproxy.yitlink.com:80/login.aspx?direct=true&db=edsgao&AN=edsgcl.586417285&lang=zh-cn&site=eds-live. Published 2019. Accessed 17 May 2020

  5. Bлaдимиpoвa TE. Ceмaнтичecкий кoнтинyyм мифa. (Russian). RUDN J. Language Stud. Semiot. Semant. 11(2), 161 (2020)

    Google Scholar 

  6. Byrum, J.: Allying a military Mooel to financial Chaos: developed for jet fighter pilots, the four-stage OODA Loop can help financial analysts manage an overwhelming flow of information. OR/MS Today 1, 40 (2019)

    Google Scholar 

  7. Jatkevicius, J.: Observation, orientation, decision, action: applying the OODA loop concept to libraries. Publ. Libr. 57(2), 24 (2018)

    Google Scholar 

  8. Zeng, Y., Xu, K., Qin, L., Yin, Q.: A Semi-Markov decision model with inverse reinforcement learning for recognizing the destination of a Maneuvering agent in real time strategy games. IEEE Access 8, 15392–15409 (2020). https://doi.org/10.1109/ACCESS.2020.2967642

    Article  Google Scholar 

  9. Chen, X., Chen, J., Cheng, G., Gong, T.: Topics and trends in artificial intelligence assisted human brain research. PLoS ONE 15(4), 1–27 (2020). https://doi.org/10.1371/journal.pone.0231192

    Article  Google Scholar 

  10. Ding, R.X., Palomares, I., Wang, X., et al.: Large-scale decision-making: characterization, taxonomy, challenges and future directions from an artificial intelligence and applications perspective. Inf. Fusion 59, 84–102 (2020). https://doi.org/10.1016/j.inffus.2020.01.006

    Article  Google Scholar 

  11. Yaacoub, J.P., Salman, O.: Security analysis of drones systems: attacks, limitations, and recommendations. Internet Things (2020). https://doi.org/10.1016/j.iot.2020.100218

    Article  Google Scholar 

  12. Becker, S., Kunze, C.: Transcending community energy: collective and politically motivated projects in renewable energy (CPE) across Europe. People Place Policy Online 8(3), 180 (2014)

    Article  Google Scholar 

  13. Li, Y., Han, W., Wang, Y.: Deep reinforcement learning with application to air confrontation intelligent decision-making of manned/unmanned aerial vehicle cooperative system. IEEE Access 8, 67887–67897 (2020)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yue Li .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Li, Y., Han, W., Zhong, W., Ji, J., Mu, W. (2022). Intelligent Decision-Making of MAV/UAV in Air Combat Based on DDPG Algorithm. In: Yan, L., Duan, H., Yu, X. (eds) Advances in Guidance, Navigation and Control . Lecture Notes in Electrical Engineering, vol 644. Springer, Singapore. https://doi.org/10.1007/978-981-15-8155-7_403

Download citation

Publish with us

Policies and ethics