Skip to main content

Detection System Potholes on Roads based on Recurrent Neuronal Network

  • Conference paper
  • First Online:
Intelligent Sustainable Systems

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 333))

Abstract

The supervision of road quality is among the main lines of research in road  security, exploiting the various techniques of machine learning. Our goal is to propose an efficient and accurate system to provide a complete and detailed report on the state of the road and anticipate the maintenance to be done to road or decision support if the system uses real-time in the context of an autonomous car example. For this, we propose a deep learning architecture in two steps. In the first step, we start a segmentation to determine the sides of the road and limiting the area detection of potholes. The second step to detecting potholes in this area reduces the number of false positives detected by the model. It reduces the detections of potholes that are not relevant for this detection, including potholes at the side of the road or the sidewalk. For this, each model was training on images from a public database. The result of our approach showed its effectiveness by reaching accuracy 93%.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Lin, J., Liu, Y.: Potholes detection based on SVM in the pavement distress image. In:2010 Ninth International Symposium on Distributed Computing and Applications to Business, Engineering and Science, pp. 544–547. IEEE (2010)

    Google Scholar 

  2. Ahmed, A., Ashfaque, M., Ulhaq, M.U., Mathavan, S., Kamal, K., Rahman, M.: Pothole 3d reconstruction with a novel imaging system and structure from motion techniques. IEEE Trans. Intell. Transport. Syst. (2021)

    Google Scholar 

  3. Moazzam, I., Kamal, K., Mathavan, S., Usman, S., Rahman, M.: Metrology and visualization of potholes using the microsoft kinect sensor. In: 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013), pp. 1284–1291. IEEE (2013)

    Google Scholar 

  4. Fan, R., Bocus, M.J., Zhu, Y., Jiao, J., Wang, L., Ma, F., Cheng, S., Liu, M.: Road crack detection using deep convolutional neural network and adaptive thresholding. In: 2019 IEEE Intelligent Vehicles Symposium (IV), pp. 474–479. IEEE (2019)

    Google Scholar 

  5. Fan, R., Liu, Y., Yang, X., Bocus, M.J., Dahnoun, N., Tancock, S.: Real-time stereo vision for road surface 3-d reconstruction. In: 2018 IEEE International Conference on Imaging Systems and Techniques (IST), pp. 1–6. IEEE (2018)

    Google Scholar 

  6. Fan, R., Bocus, M.J., Dahnoun, N.: A novel disparity transformation algorithm for road segmentation. Inf. Process. Lett. 140, 18–24 (2018)

    Google Scholar 

  7. Maeda, H., Sekimoto, Y., Seto, T., Kashiyama, T., Omata, H.: Road damage detection and classification using deep neural networks with smartphone images. Comput.-Aided Civil Infrastruct. Eng. 33(12), 1127–1141 (2018)

    Article  Google Scholar 

  8. Cao, M.-T., Tran, Q.-V., Nguyen, N.-M., Chang, K.-T.: Survey on performance of deep learning models for detecting road damages using multiple dashcam image resources. Adv. Eng. Inform. 46, 101182 (2020)

    Article  Google Scholar 

  9. Pereira, V., Tamura, S., Hayamizu, S., Fukai, H.: Semantic segmentation of paved road and pothole image using u-net architecture. In: 2019 International Conference of Advanced Informatics: Concepts, Theory and Applications (ICAICTA), pp. 1–4. IEEE (2019)

    Google Scholar 

  10. Sarmiento, J.-A.: Pavement distress detection and segmentation using YOLOv4 and DeepLabv3 on pavements in the Philippines. arXiv:2103.06467 (2021)

  11. Bochkovskiy, A., Wang, C.-Y., Liao, H.-Y.M.: YOLOv4: Optimal speed and accuracy of object detection. arXiv:2004.10934 (2020)

  12. Krizhevsky, A., Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural iInformation Processing Systems, pp. 1097–1105 (2012)

    Google Scholar 

  13. Badrinarayanan, V., Kendall, A., Cipolla, R.: Segnet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)

    Article  Google Scholar 

  14. Nienaber, S., Booysen, M.J., Kroon, R.S.: Detecting potholes using simple image processing techniques and real-world footage (2015)

    Google Scholar 

  15. Nienaber, S., Kroon, R.S., Booysen, M.J.: A comparison of low-cost monocular vision techniques for pothole distance estimation. In: 2015 IEEE Symposium Series on Computational Intelligence, pp. 419–426. IEEE (2015)

    Google Scholar 

  16. Tan, M., Le, Q.: Efficientnet: Rethinking model scaling for convolutional neural networks. In: International Conference on Machine Learning, pp. 6105–6114. PMLR (2019)

    Google Scholar 

  17. Yang, M., Yu, K., Zhang, C., Li, Z., Yang, K.: Denseaspp for semantic segmentation in street scenes. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3684–3692 (2018)

    Google Scholar 

  18. Redmon, J., Farhadi, A.: YOLO3: an incremental improvement. arXiv:1804.02767 (2018)

  19. Huang, Y., Cheng, Y., Bapna, A., Firat, O., Chen, M.X., Chen, D., Lee, H.J., Ngiam, J., Le, Q.V., Wu, Y., et al.: GPipe: Efficient training of giant neural networks using pipeline parallelism. arXiv:1811.06965, 2018

  20. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

    Google Scholar 

  21. Al-Qizwini, M., Barjasteh, I., Al-Qassab, H., Radha, H.: Deep learning algorithm for autonomous driving using googlenet. In: 2017 IEEE Intelligent Vehicles Symposium (IV), pp. 89–96. IEEE (2017)

    Google Scholar 

  22. Zifeng, W., Shen, C., Van Den Hengel, A.: Wider or deeper: revisiting the resnet model for visual recognition. Pattern Recogn. 90, 119–133 (2019)

    Article  Google Scholar 

  23. Ronneberger, O., Fischer, P., Brox, T.: U-net: convolutional networks for biomedical image segmentation. In: International Conference on Medical Image Computing and Computer-Assisted Intervention, pp. 234–241. Springer (2015)

    Google Scholar 

  24. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

    Google Scholar 

  25. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556 (2014)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Younes Ed-Doughmi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ed-Doughmi, Y., El Ayachi, R. (2022). Detection System Potholes on Roads based on Recurrent Neuronal Network. In: Nagar, A.K., Jat, D.S., Marín-Raventós, G., Mishra, D.K. (eds) Intelligent Sustainable Systems. Lecture Notes in Networks and Systems, vol 333. Springer, Singapore. https://doi.org/10.1007/978-981-16-6309-3_14

Download citation

Publish with us

Policies and ethics