Abstract
In the context of UAV trajectory planning for data collection, challenges such as the uncertainty of a large-scale dynamic unknown environment and the need for multi-UAV coordination are prevalent. To address these challenges, this paper proposes a UAV data collection trajectory planning algorithm based on the D3QN (Double Dueling Deep Q-Network) algorithm. The proposed algorithm enables multiple UAVs to dynamically plan their flight paths for data collection in unknown environments through centralized training and distributed application. The algorithm’s performance is improved by incorporating competition mechanisms, candidate node queues, and reward function reshaping techniques. Based on the simulation results, the proposed algorithm outperforms similar algorithms in terms of success rates and task durations.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wei, Z., Zhu, M., Zhang, N., et al.: UAV-assisted data collection for internet of things: a survey. IEEE Internet Things J. 9(17), 15460–15483 (2022)
Zeng, Y., Zhang, R., Lim, T.J.: Wireless communications with unmanned aerial vehicles: opportunities and challenges. IEEE Commun. Mag. 54(5), 36–42 (2016)
Mozaffari, M., et al.: A tutorial on UAVs for wireless networks: applications, challenges, and open problems. IEEE Commun. Surv. Tutorials 21(3), 2334–2360 (2019)
Han, S., Zhu, K., Zhou, M.C., et al.: Joint deployment optimization and flight trajectory planning for UAV assisted IoT data collection: a bilevel optimization approach. IEEE Trans. Intell. Transp. Syst. 23(11), 21492–21504 (2022)
Hua, M., Yang, L., Wu, Q., et al.: 3D UAV trajectory and communication design for simultaneous uplink and downlink transmission. IEEE Trans. Commun. 68(9), 5908–5923 (2020)
Wei, Z., Chen, Q., Liu, S., et al.: Capacity of unmanned aerial vehicle assisted data collection in wireless sensor networks. IEEE Access 8, 162819–162829 (2020)
Hsu, Y.H., Gau, R.H.: Reinforcement learning-based collision avoidance and optimal trajectory planning in UAV communication networks. IEEE Trans. Mob. Comput. 21(1), 306–320 (2020)
Zhang, B., Liu, C.H., Tang, J., et al.: Learning-based energy-efficient data collection by unmanned vehicles in smart cities. IEEE Trans. Industr. Inf. 14(4), 1666–1676 (2017)
Wang, X., Gursoy, M.C., Erpek, T., et al.: Learning-based UAV path planning for data collection with integrated collision avoidance. IEEE Internet Things J. 9(17), 16663–16676 (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Miao, Y., Lei, L., Zhang, L. (2024). Deep Reinforcement Learning Based Trajectory Planning for Multi-UAV Cooperative Data Collection. In: Dong, J., Zhang, L., Cheng, D. (eds) Proceedings of the 2nd International Conference on Internet of Things, Communication and Intelligent Technology. IoTCIT 2023. Lecture Notes in Electrical Engineering, vol 1197. Springer, Singapore. https://doi.org/10.1007/978-981-97-2757-5_11
Download citation
DOI: https://doi.org/10.1007/978-981-97-2757-5_11
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-2756-8
Online ISBN: 978-981-97-2757-5
eBook Packages: Computer ScienceComputer Science (R0)