Abstract
The robot path planning technology based on deep reinforcement learning algorithm enables the robot arm to realize intelligent trajectory planning and capture task in unknown environment. However, due to the characteristics of redundant degrees of freedom, continuous workspace and non-unique mapping between joint space and Cartesian space, deep reinforcement learning algorithms often have the problems of unnecessary exploration, slow learning efficiency, low accuracy and poor robustness. In order to improve this problem, this paper proposes a path planning algorithm based on twin delayed deep deterministic policy gradient (TD3) algorithm to train an end-to-end network between the expected pose and current joint space variables. In addition, to measure the tip position and attitude of the robot more reasonably, the reward function is improved to clarify its physical meaning. Training and testing in the simulation environment proved that this method can realize the auto-path planning and capture task. Compared with other reward function, this method can avoid unnecessary exploration and improved the convergence speed and robustness.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Zhu, Q., Yan, Y., Xing, Z.: Robot path planning based on artificial potential field approach with simulated annealing. Sixth International Conference on Intelligent Systems Design and Applications, pp. 622–627 (2006). https://doi.org/10.1109/ISDA.2006.253908
Vadakkepat, P., Tan, K.C., Wang, M.: Evolutionary artificial potential fields and their application in real time robot path planning. In: Proceedings of the 2000 Congress on Evolutionary Computation. CEC00 (Cat. No.00TH8512), vol. 1, pp. 256–263 (2000). https://doi.org/10.1109/CEC.2000.870304
Rodriguez, S., Tang, X., Lien, J.M., Amato, N.M.: An obstacle-based rapidly-exploring random tree. robotics and automation. In: Proceedings 2006 IEEE International Conference on ICRA 2006. IEEE (2006)
Kang, L., Zhao, C.X., Guo, J.H.: Improved path planning based on rapidly-exploring random tree for mobile robot in unknown environment. Pattern Recogn. Artif. Intell. 22(3), 337–343 (2009)
Mnih, V., Kavukcuoglu, K., Silver, D.: Human-level control through deep reinforcement learning. Nature 518, 529–533 (2015). https://doi.org/10.1038/nature14236
Zhao, D., Wang, H., Shao, K., Zhu, Y.: Deep reinforcement learning with experience replay based on SARSA. IEEE Sympos. Series Comput. Intell. (SSCI) 2016, 1–6 (2016). https://doi.org/10.1109/SSCI.2016.7849837
Lillicrap, T.P., Hunt, J.J., Pritzel, A.: Continuous control with deep reinforcement learning, Computerence (2015). https://doi.org/10.1016/S1098-3015(10)67722-4
Mnih, V., Badia, A.P., Mirza, M.: Asynchronous methods for deep reinforcement learning. In: Proceedings of International Conference on Machine Learning, pp. 1928–1937, New York, USA (2016)
Fujimoto, S., Hoof, H.V., Meger, D.: Addressing function approximation error in actor-critic methods (2018). https://arxiv.org/abs/1611.06256
Haarnoja, T., Pong, V., Zhou, A., Dalal, M., Abbeel, P., Levine, S.: Composable Deep Reinforcement Learning for Robotic Manipulation, pp. 6244–6251 (2018). https://arxiv.org/abs/1803.06773
Tai, L., Paolo, G., Liu, M.: Virtual-to-real deep reinforcement learning: continuous control of mobile robots for mapless navigation. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 31–36 (2017). https://doi.org/10.1109/IROS.2017.8202134
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Guo, M., Wang, Y., Liang, B., Chen, Z., Lin, J., Huang, K. (2022). Robot Path Planning via Deep Reinforcement Learning with Improved Reward Function. In: Jia, Y., Zhang, W., Fu, Y., Yu, Z., Zheng, S. (eds) Proceedings of 2021 Chinese Intelligent Systems Conference. Lecture Notes in Electrical Engineering, vol 805. Springer, Singapore. https://doi.org/10.1007/978-981-16-6320-8_68
Download citation
DOI: https://doi.org/10.1007/978-981-16-6320-8_68
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-6319-2
Online ISBN: 978-981-16-6320-8
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)