Abstract
Rock crushing task for excavators has harsh working environments. With the development of vision sensors and intelligent algorithms, it is possible to achieve autonomous intelligent mining for unmanned excavators. This paper presents an autonomous path planning system for mining robots based on stereo vision. For semantic obstacles such as excavators and loaders in the quarry environment, a recognition network for construction vehicles is trained. The positions and sizes of the construction vehicles are determined by stereo vision. To avoid the rollover hazard that may occur, a gradient map is derived from the elevation map. The traffic cost considering the energy consumption is adopted to build a graph, where the Dijkstra graph search algorithm is used to obtain the path with the lowest cost. Finally, ROS and Gazebo are utilized to simulate and verify the autonomous path planning system. The results show that the proposed system based on stereo vision can complete the autonomous intelligent navigation task in the quarry environment.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Borthwick, J., Lawrence, P., Hall, R.: Mining haul truck localization using stereo vision. In: Proceedings of the Robotics and Applications Conference, p. 9, University of British Columbia (2009)
Chae, S.: Application of image processing to detecion of workers around heavy eqipment. Water Resour. Manage 24(1), 139–156 (2011)
Ganganath, N., Cheng, C.T., Chi, K.T.: A constraint-aware heuristic path planner for finding energy-efficient paths on uneven terrains. IEEE Trans. Industr. Inf. 11(3), 601–611 (2015)
Zeng, Q.X.: Research on Passing Ability of Autonomous Prospecting Vehicle Based on Binocular Vision, Jilin University (2015)
Sun, W.Y.: Research on the Environment Recognition Based on Binocular Stereovision for Autonomous Resource Prospecting Vehicle, Jilin University (2014)
Deng, B.W., Zhang, C.H., Li, J., Lei, Y.N., Wang, Q., Zhang, S.H.: Application of local path plan for unmanned construction machinery autonomous task. Ordnance Ind. Autom. 35(10), 70–73, 79 (2016)
Zhao, M.T., Li, Y.H., Fan, J.J.: Study on time optimal path planning based on improved ant colony algorithm. Veh. Power Technol. 1(3), 7–10, 14 (2020)
Yadav, R., Vierling, A., Berns, K.: Radar + RGB fusion for robust object detection in autonomous vehicle. In: 2020 IEEE International Conference on Image Processing (ICIP), Abu Dhabi, pp. 1986–1990 (2020)
Kemsaram, N., Das, A., Dubbelman, G.: A stereo perception framework for autonomous vehicles. In: 2020 IEEE 91st Vehicular Technology Conference (VTC2020-Spring), pp. 1–6 (2020)
Farhadi, A., Redmon, J.: Yolov3: an incremental improvement. In: Computer Vision and Pattern Recognition, Salt Lake City (2018)
Kaehler, A., Bradski, G.: Learning OpenCV 3: Computer Vision in C++ with the OpenCV Library. O’Reilly Media, Sebastopol (2016)
Labbé, M., Michaud, F.: RTAB-Map as an open-source lidar and visual simultaneous localization and mapping library for large-scale and long-term online operation. J. Field Robot. 36(2), 416–446 (2019)
Fankhauser, P., Hutter, M.: A universal grid map library: implementation and use case for rough terrain navigation. In: Koubaa, A. (ed.) Robot Operating System (ROS). SCI, vol. 625, pp. 99–120. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-26054-9_5
Connor, M., Kumar, P.: Fast construction of k-nearest neighbor graphs for point clouds. IEEE Trans. Visual Comput. Graphics 16(4), 599–608 (2010)
Klasing, K., Althoff, D., Wollherr, D.: Comparison of surface normal estimation methods for range sensing applications. In: 2009 IEEE International Conference on Robotics and Automation, pp. 3206–3211. IEEE (2009)
Santos, A.S., Azpúrua, H.P., Pessin, G., Freitas, G.M.: Path planning for mobile robots on rough terrain. In: 2018 Latin American Robotic Symposium, 2018 Brazilian Symposium on Robotics (SBR) and 2018 Workshop on Robotics in Education (WRE), pp. 265–270. IEEE (2018)
Dijkstra, E.W.: A note on two problems in connexion with graphs. Numer. Math. 1(1), 269–271 (1959)
Robotic Operating System Homepage. https://www.ros.org
Koenig, N., Howard, A.: Design and use paradigms for Gazebo, an open-source multi-robot simulator. In: Intelligent Robots and Systems, Sendai (2004)
Pecka, M., Zimmermann, K., Svoboda, T.: Fast simulation of vehicles with non-deformable tracks. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vancouver (2017)
Acknowledgements
This work was supported by National Natural Science Foundation of China (61703127, 51475331), Zhejiang Provincial Natural Science Foundation of China (LY17F020026), and the Fundamental Research Funds for the Central Universities.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 Springer Nature Switzerland AG
About this paper
Cite this paper
Su, Y., Bu, W., Chen, J., Li, S., Liu, M. (2021). Design of the Autonomous Path Planning System for Mining Robots Based on Stereo Vision. In: Liu, XJ., Nie, Z., Yu, J., Xie, F., Song, R. (eds) Intelligent Robotics and Applications. ICIRA 2021. Lecture Notes in Computer Science(), vol 13016. Springer, Cham. https://doi.org/10.1007/978-3-030-89092-6_54
Download citation
DOI: https://doi.org/10.1007/978-3-030-89092-6_54
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-89091-9
Online ISBN: 978-3-030-89092-6
eBook Packages: Computer ScienceComputer Science (R0)