Skip to main content
SpringerLink
Log in

A High-Precision Road Network Construction Method Based on Deep Learning for Unmanned Vehicle in Open Pit

  • Review
  • Published:
Mining, Metallurgy & Exploration Aims and scope Submit manuscript

Abstract

To solve the problem of time-consuming and low precision in updating the open-pit vehicle transportation network, a high precision road network model construction method for unmanned vehicles in open-pit mines is proposed. This method can be divided into two steps. In the first step, an improved deep learning image processing model named DeepLabv3 + C (DeepLabv3 + Concat) is presented. Then, the road information extracted by the DeepLabv3 + C network is used to construct a three-dimensional model of the open-pit mine road network. In the second step, aiming at the time-consuming problem of unmanned vehicle meeting in open-pit mines, a vehicle meeting strategy was proposed. This strategy is used to guide the navigation of unmanned vehicles in open-pit mines. Besides, the DeepLabv3 + C network is verified by comparing the mIOU (means Intersection Over Union), accuracy, and continuity of road image extraction with the mainstream networks. The road network model constructed in the first step is quantitatively analyzed, and its performance is compared with GPS trajectory clustering methods. At the end of the paper, vehicle running simulation is carried out on the road network model by using Unity (a 3D visualization simulation software). The results show that the road network model constructed by this method can meet the navigation requirements of unmanned vehicles in open-pit mines, and the feasibility of the vehicle meeting strategy is proved.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

References

  1. Miracle A, Opoku M (2021) A vehicles for open-pit mining with smart scheduling system for transportation based on 5G. Int J Sci Res Manag 7:2395–2566. https://doi.org/10.17762/turcomat.v12i5.1490

    Article  Google Scholar 

  2. Sun XY, Zhang WG (2012) Traffic flow programming model for various matchs of hauling fleet and materials in open-pit mine. J Northeastern University(Natural Science) 33:1487–1491. https://doi.org/10.12068/j.issn.1005-3026.2012.10.029

  3. May MA (2013) Applications of queuing theory for open-pit truck/shovel haulage systems. dissertation, virginia tech. http://hdl.handle.net/10919/19218

  4. Chaowasakoo P, Seppälä H, Koivo H, Zhou Q (2017) Improving fleet management in mines: the benefit of heterogeneous match factor. Eur J Oper Res 3:1052–1065. https://doi.org/10.1016/j.ejor.2017.02.039

    Article  Google Scholar 

  5. Glebov AV (2012) The methods of forming the fleet of open-pit dump trucks. Eurasian Mining 1: 33–36. https://elibrary.ru/item.asp?id=32342146

  6. Tolouei K, Moosavi E, Bangian AH et al (2020) Improving performance of open-pit mine production scheduling problem under grade uncertainty by hybrid algorithms. J Cent South Univ 27:2479–2493. https://doi.org/10.1007/s11771-020-4474-z

    Article  Google Scholar 

  7. Li XX, Gu. QH, Ruan SL and Feng. ZD (2021) Optimal path planning of truck transportation in open-pit mine considering dynamic change of energy consumption. J China Coal Soc 1–12. https://doi.org/10.13225/j.cnki.jccs.xr20.1687

  8. Zhang C. and Jiang S (2020) Intelligent scheduling of unmanned trucks in open-pit mine based on improved ant colony algorithm. J Anhui Univ(Natural Science Edition) 37: 267–275. https://doi.org/10.3969/j.issn.1671-7872.2020.03.012

  9. Mo MH (2020) Multi objective vehicle flow assignment scheduling algorithm and its application for driverless trucks in open-pit mines. Dissertation, Xi’an University of architecture and technology. https://doi.org/10.27393/d.cnki.gxazu.2020.000149

  10. Tian FL, Sun XY, Gu XW, Xin FY and Ma L (2019) Updating road information in open-pit mines using truck trajectories. Math Probl Eng 1-8https://doi.org/10.1155/2019/7053189

  11. Schroedl S, Wagstaff K, Rogers S, Langley P, Wilson C (2004) Mining GPS traces for map refinement. Data Min Knowl Disc 9:59–87. https://doi.org/10.1023/B:DAMI.0000026904.74892.89

    Article  MathSciNet  Google Scholar 

  12. Sun XY, Tian FL, Zhang H, Li Z (2017) Automatic extraction of road network in open-pit mine based on GPS data. J China Coal Soc 42:3059–3064. https://doi.org/10.13225/j.cnki.jccs.2017.0308

    Article  Google Scholar 

  13. Gu QH, Xue BQ, Lu CW, Song JS (2020) Open-pit mine road intelligent recognition and road network modeling based on D-LinkNet. J China Coal Soc 1–9. https://doi.org/10.13225/j.cnki.jccs.2020.0414

  14. Guo ML, Ruan SL, Lu CW, Gu QH (2021) Extraction method of open-pit mine road network based on improved deep labv3 + network. Progress of laser and Optoelectronics: 1–10

  15. Gu QH, Xue BQ, Ruan SL, Li XX (2021) A road extraction method for intelligent dispatching based on MD-LinkNeSt network in open-pit mine. Int J Min Reclam Environ 35:656–669. https://doi.org/10.1080/17480930.2021.1949800

    Article  Google Scholar 

  16. Ouyang H, Liu JX, Liu YZ et al. (2014) An extraction method of road network based on walking GPS Trajectories. Computer and modernization 124–128

  17. Zhang YH, He J, Kan X, Xia GH, Zhu LL, Ge TT (2018) Overview of road extraction methods from remote sensing images. Comput Eng Appl 54:1–10. https://doi.org/10.3778/j.issn.1002-8331.1804-0271

    Article  Google Scholar 

  18. Cai HY, Yao GQ (2013) Optimization method of road extraction from high resolution remote sensing image based on watershed algorithm. Land and Resources Remote Sensing 25:25–29. https://doi.org/10.6046/gtzyyg.2013.03.05

    Article  Google Scholar 

  19. Cao YG, Wang ZP, Shen L et al (2016) Fusion of pixel-based and object-based features for road centerline extraction from high-resolution satellite imagery. J Surv Mapping 45:1231–1240. https://doi.org/10.11947/j.AGCS.2016.20160158

    Article  Google Scholar 

  20. Wang JH, Qin QM, Gao ZL (2016) Road extraction of remote sensing images with spatial texture information. J Hunan Univ 43:153–156. https://doi.org/10.16339/j.cnki.hdxbzkb.2016.04.021

    Article  Google Scholar 

  21. Li PK, Zang Y, Wang C, Li J (2016) Road network extraction via deep learning and line integral convolution. In Geoscience and Remote Sensing Symposium 1599-1602https://doi.org/10.1109/IGARSS.2016.7729408

  22. Wang Q, Gao JY, Yuan Y (2017) Embedding structured contour and location prior in siamesed fully convolutional networks for road detection. IEEE Trans Intell Transp Syst 219-224https://doi.org/10.1109/TITS.2017.2749964

  23. Mendes CCT, Fremont V, Wolf DF (2016) Exploiting fully convolutional networks for fast road detection. IEEE Int Conf Robotics Autom. https://doi.org/10.1109/ICRA.2016.7487486

    Article  Google Scholar 

  24. He H, Wang SC, Yang DF (2019) Road extraction from remote sensing image based on encoder decoder network. J Surv Mapping 48:330–338. https://doi.org/10.11947/j.AGCS.2019.20180005

    Article  Google Scholar 

  25. Jiang X, Zhang XC, Zhang ZQ, Wu F (2019) Road extraction of high-resolution remote sensing images derived from DenseUNet. Remote Sensing 21:2499–2516. https://doi.org/10.3390/rs11212499

    Article  Google Scholar 

  26. He KM, Zhang XY, Ren SQ, Sun J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition: 770–778. https://openaccess.thecvf.com/content_cvpr_2016/html/He_Deep_Residual_Learning_CVPR_2016_paper.html

  27. Iandola F, Moskewicz M, Karayev S, Girshick R et al. (2014) Densenet: implementing efficient convnet descriptor pyramids. arXiv preprint arXiv:1404.1869. https://arxiv.org/abs/1404.1869

  28. Wu PD, Cui ZG, Gan ZL, Liu F (2020) Three-dimensional resnext network using feature fusion and label smoothing for hyperspectral image classification. Sensors 20:1652–1680. https://doi.org/10.3390/s20061652

    Article  Google Scholar 

  29. Zhou LC, Zhang C, Wu M (2018) D-linknet: Linknet with pretrained encoder and dilated convolution for high resolution satellite imagery road extraction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops: 182-186https://doi.org/10.1109/CVPRW.2018.00034

  30. Wang SQ, Liu YF, Qing YH et al (2020) Detection of insulator defects with improved ResNeSt and Region proposal network. IEEE Access 8:184841–184850. https://doi.org/10.1109/ACCESS.2020.3029857

    Article  Google Scholar 

  31. Yang MK, Yu K, Zhang C, Li ZW et al. (2018) Denseaspp for semantic segmentation in street scenes. In Proceedings of the IEEE conference on computer vision and pattern recognition: 3684-3692https://doi.org/10.1109/CVPR.2018.00388

  32. Miao ZL, Shi WZ, Zhang H (2013) An algorithm for road centerline extraction from high resolution image. Int J Min Sci Technol 05:887–892. https://doi.org/10.13247/j.cnki.jcumt.2013.05.028

    Article  Google Scholar 

  33. Zhou ZW, Siddiquee MMR, Tajbakhsh N, Liang J (2018) Unet++: a nested u-net architecture for medical image segmentation. In Deep learning in medical image analysis and multimodal learning for clinical decision support: 3-11https://doi.org/10.1007/978-3-030-00889-5_1

  34. Chen LC, Zhu YK, Papandreou G, Schroff F, Adam H (2018) Encoder-decoder with atrous separable convolution for semantic image segmentation. In Proceedings of the European conference on computer vision (ECCV): 801–818. https://doi.org/10.1007/978-3-030-01234-2_49

  35. Chaurasia A, Culurciello E (2017) Linknet: exploiting encoder representations for efficient semantic segmentation. In 2017 IEEE Visual Communications and Image Processing (VCIP): 1–4. https://doi.org/10.1109/VCIP.2017.8305148

  36. Goodchild MF, Hunter GJ (1997) A simple positional accuracy measure for linear features. Int J Geogr Inf Sci 11:299–306. https://doi.org/10.1080/136588197242419

    Article  Google Scholar 

  37. Zhang T, Lu XY, Li L, Qin XH, Luan XF (2019) Key technologies and standards of unmanned transportation in open-pit mines. Control Inf Technol 13–19. https://doi.org/10.13889/j.issn.2096-5427.2019.02.003

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China under Grant No. 52074205 and Grant No. 51774228, Shaanxi Province Fund for Distinguished Young Scholars (Grant No. 2020JC-44).

Author information

Authors and Affiliations

  1. School of Resources Engineering, Xi’an University of Architecture and Technology, Xi’an, 710055, Shaanxi, China

    Qinghua Gu, Buqing Xue & Jiangshan Song

  2. Key Laboratory for Intelligent Industrial Perception, Calculation and Decision, Xi’an University of Architecture and Technology, No. 13, Middle Yanta Road, Beilin District, Xi’an, 710055, China

    Qinghua Gu, Buqing Xue, Jiangshan Song, Xuexian Li & Qian Wang

Authors
  1. Qinghua Gu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Buqing Xue
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiangshan Song
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Xuexian Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Qian Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Buqing Xue.

Ethics declarations

Conflict of Interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gu, Q., Xue, B., Song, J. et al. A High-Precision Road Network Construction Method Based on Deep Learning for Unmanned Vehicle in Open Pit. Mining, Metallurgy & Exploration 39, 397–411 (2022). https://doi.org/10.1007/s42461-022-00548-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42461-022-00548-6

Keywords

Search

Navigation