Skip to main content
SpringerLink
Log in

Perceptive Driving Assistant System for Opencast Mines During Foggy Weather

  • Published:
Mining, Metallurgy & Exploration Aims and scope Submit manuscript

Abstract

During harsh weather conditions, the presence of fog, dust in the environment degrades the image’s quality, which affects the visibility of drivers of heavy earth-moving machinery in opencast mines. Due to low visibility, mining operations cannot be carried out as drivers are easily prone to accidents. This paper proposes a technique that includes developing a vision enhancement system called perceptive driving assistant system for increasing visibility of real-time video of the road in front of the vehicle for operators of heavy earth-moving machinery at opencast mines during harsh weather conditions to overcome the problem. The system consists of high-quality Internet Protocol cameras and thermal cameras for real-time image processing and other well-defined devices, which is quite capable of enhancing the visibility of the image, outlining edges of the road, and detecting obstacles present on the path of operators for smooth driving and reducing threat of accidents. A high-speed graphical processing unit has been used for quality-performance parallel computing, which is well suited for real-time operations to empower fast real-time operations. The calculated frame per second (fps) of image enhancement, object detection, and edge detection is 17.91, 15.91, and 25.09 fps, respectively. The actual frame rate is 26.07 fps, and after applying the algorithm, the final frame rate is 19.65 fps. The calculated accuracy of the object detection model is 81.23%. Field trials indicate that the developed system has performed adequately during foggy weather.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Ruttinger L, Sharma V (2016) Climate change and mining: a foreign policy perceptive. Adelphi, Berlin, Germany. https://climate-diplomacy.org/sites/default/files/2020-10/Report-Climate-Diplomacy-Climate-Change-and-Mining.pdf. Accessed 19 May 2021

  2. Naseeba T, Harish BKP (2016) Visibility restoration of the single hazy image captured in real-world weather conditions. Int Res J Eng Technol 3(7):135–139

    Google Scholar 

  3. Sun E, Nieto A, Li Z et al (2010) An integrated information technology assisted driving system to improve mine trucks-related safety. Saf Sci 48(10):490–1497. https://doi.org/10.1016/j.ssci.2010.07.012

    Article  Google Scholar 

  4. Chatterjee D, Chaulya SK (2018) Vision improvement system using image processing technique for adverse weather condition of opencast mines. Int J Min Reclam Environ 33(7):1–12. https://doi.org/10.1080/17480930.2018.1496886

    Article  Google Scholar 

  5. Saurabh K, Chaulya SK, Prasad GM et al (2016) Assessment of different technologies for improving visibility during foggy weather in mining and transportation sectors. Int J Recent Innov Trends Comput Commun 4(4):31–40. https://doi.org/10.17762/ijritcc.v4i4.1949

    Article  Google Scholar 

  6. Hussain F, Jeong J (2016) Visibility enhancement of scene image degraded by foggy weather conditions with deep neural networks. J Sensors :1–9. https://doi.org/10.1155/2016/3894832

  7. Dannheim C, Icking C, Mäder M et al (2014) Weather detection in vehicles by means of camera and LIDAR systems. 2014 Sixth International Conference on Computational Intelligence, Communication Systems and Networks, 186–191. https://doi.org/10.1109/CICSyN.2014.47

  8. Hautiere N, Tarel JP, Lavenant J, Aubert D (2006) Automatic fog detection and estimation of visibility distance through use of an onboard camera. Mach Vis Appl 17:8–20. https://doi.org/10.1007/s00138-005-0011-1

    Article  Google Scholar 

  9. Huang SC, Chen BH, Wang WJ (2014) Visibility restoration of single hazy images captured in real-world weather conditions. IEEE Trans Circuits Syst Video Technol 24(10):1814–1824. https://doi.org/10.1109/TCSVT.2014.2317854

    Article  Google Scholar 

  10. Ngo H, Tao L, Zhang M et al (2005) A visibility improvement system for low vision drivers by nonlinear enhancement of fused visible and infrared video. IEEE Comp Society Conf on Comp Vision and Pattern Recognit :25–25. https://doi.org/10.1109/CVPR.2005.400

  11. Spinneker R, Koch C, Park BP et al (2014) Fast fog detection for camera-based advanced driver assistance systems. IEEE 17th Int Conf on Intell Transp Syst :1369–1374. https://doi.org/10.1109/ITSC.2014.6957878

  12. Colores SS, JMRA, Oretega JCP et al (2019) Efficient single image dehazing by modifying the dark channel prior. J Image Video Proc :1–8. https://doi.org/10.1186/s13640-019-0447-2

  13. Shukla KN, Potnis A, Dwivedy P (2017) A review on image enhancement technique. Int J Eng Appl Comp Sci 2(7):232–235. https://doi.org/10.1186/s13640-019-0447-2

    Article  Google Scholar 

  14. He K, Sun J, Tang X (2011) Single image haze removal using dark channel prior. IEEE Trans Pattern Anal Mach Intell 33(12):2341–2353. https://doi.org/10.1109/TPAMI.2010.168

    Article  Google Scholar 

  15. Fattal R (2008) Single image dehazing. ACM - Spec Interest Group Comp Graph Interact Tech 8:1–9. https://doi.org/10.1145/1399504.1360671

    Article  Google Scholar 

  16. Tan RT (2008) Visibility in bad weather from a single image IEEE Comp Soc Conf Comp Vision Pattern Recognit :1–8. https://doi.org/10.1109/CVPR.2008.4587643

  17. He K, Sun J, Tang X (2013) Guided image filtering. IEEE - Trans Pattern Anal Mach Intell 35(6):1397–409. https://doi.org/10.1109/TPAMI.2012.213

    Article  Google Scholar 

  18. Lee S, Yun S, Nam JH, Won CS, Jung SW (2016) A review on dark channel prior based image dehazing algorithms. J Image Video Proc 4:1–23. https://doi.org/10.1186/s13640-016-0104-y

    Article  Google Scholar 

  19. Tripathi A, Kumar TVA, Dhansetty TK, Kumar JS (2018) Real-time object detection using CNN. Int J Eng Tech 7:33–36. https://doi.org/10.14419/ijet.v7i2.24.11994

    Article  Google Scholar 

  20. Pathak AR, Pandey M, Rautaray S (2018) Application of deep learning for object detection. Int Conf Comp Intell Data Sci 132:1706–1717. https://doi.org/10.1016/j.procs.2018.05.144

    Article  Google Scholar 

  21. Liu W, Anguelov D, Erhan D, Szegedy C, Reed S, Fu C, Berg AC (2016) Single shot multibox detector. Europ Conf Comp V 9905:21–37. https://doi.org/10.1007/978-3-319-46448-0_2

    Article  Google Scholar 

  22. SSD_MobileNetV2 configuration model, (May 19, 2020). https://github.com/tensorflow/models. Accessed 11 June 2020

  23. Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans Pattern Anal Mach Intell 39(6):1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031

    Article  Google Scholar 

  24. Yang F, Chen H, Li J, Li F, Wang L, Yan X (2019) Single shot multibox detector with Kalman filter for online pedestrian detection in video. IEEE Access 7:15478–15488. https://doi.org/10.1109/ACCESS.2019.2895376

    Article  Google Scholar 

  25. Zhang Z, Qiao S, Xie C, Shen W, Wang B, Yuille AL (2018) Single-shot object detection with enriched semantics. Comp V IEEE – Conf Comp Vision Pattern Recognit :5813–5821. https://doi.org/10.1109/CVPR.2018.00609

  26. Kohavi R (1995) A study of cross-validation and bootstrap for accuracy estimation and model selection. Int Joint Conf on Art Int. https://doi.org/10.5555/1643031.1643047

    Article  Google Scholar 

  27. Bengio Y, Grandvalet Y (2004) No unbiased estimator of the variance of k-fold cross-validation. J Mach Learn Res 5:1089–1105

    MathSciNet  MATH  Google Scholar 

  28. Wong TT, Yeh PY (2020) Reliable accuracy estimates from k-fold cross validation. IEEE Trans Knowl Data Eng 32(8):1586–1594. https://doi.org/10.1109/TKDE.2019.2912815

    Article  Google Scholar 

  29. Refaeilzadeh P, Tang, L, Liu H (2016) Cross-validation. Encyclop Datab Syst :1–7. https://doi.org/10.1007/978-1-4899-7993-3_565-2

  30. Lin TY, Goyal P, Girshick R, He K, Dollár P (2018) Focal loss for dense object detection. IEEE Trans Pattern Anal Mach Intell 42(2):318–327. https://doi.org/10.1109/TPAMI.2018.2858826

    Article  Google Scholar 

  31. Yadav G, Maheshwari S, Agarwal A (2014) Contrast limited adaptive histogram equalization based enhancement for real time video system. Int Conf Adv Comput Commun Inform (ICACCI) :2392–2397. https://doi.org/10.1109/ICACCI.2014.6968381

Download references

Acknowledgements

The authors are grateful to the Director of CSIR-Central Institute of Mining and Fuel Research, Dhanbad, India, for granting permission to publish this paper. The authors are also thankful to the Ministry of Electronics and Information Technology, Government of India, and National Mineral Development Corporation Limited, Hyderabad, India, for jointly supporting the project.

Author information

Authors and Affiliations

  1. CSIR - Central Institute of Mining and Fuel Research, Dhanbad, 826001, India

    Monika Choudhary, Sushma Kumari, Swades Kumar Chaulya, Girendra Mohan Prasad, Vikash Kumar & Naresh Kumar

Authors
  1. Monika Choudhary
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sushma Kumari
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Swades Kumar Chaulya
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Girendra Mohan Prasad
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Vikash Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Naresh Kumar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Swades Kumar Chaulya.

Ethics declarations

Conflict of Interest

The authors declare no competing interests.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Choudhary, M., Kumari, S., Chaulya, S.K. et al. Perceptive Driving Assistant System for Opencast Mines During Foggy Weather. Mining, Metallurgy & Exploration 39, 2431–2447 (2022). https://doi.org/10.1007/s42461-022-00678-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42461-022-00678-x

Keywords

Search

Navigation