Skip to main content

Detection and Classification of Road Damage Using R-CNN and Faster R-CNN: A Deep Learning Approach

  • Conference paper
  • First Online:
Cyber Security and Computer Science (ICONCS 2020)

Abstract

Road surface monitoring is mostly done manually in cities which is an intensive process of time consuming and labor work. The intention of this paper is to research on road damage detection and classification from road surface images using object detection method. This paper applied multiple convolutional neural network (CNN) algorithm to classify road damage and discovered which algorithm performs better in road damage detection and classification. The damages are classified in three categories pothole, crack and revealing. For this research data was collected from street of Dhaka city using smartphone camera and prepossessed the data like image resize, white balance, contrast transformation, labeling. This study applies R-CNN and faster R-CNN for object detection of road damages and apply Support Vector Machine (SVM) for classification and gets a better result from previous studies. Then losses are calculated using different loss functions. The results demonstrate the highest 98.88% accuracy and the lowest loss is 0.01.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 119.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 159.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Fan, R.: Real-time computer stereo vision for automotive applications. Dissertation, University of Bristol (2018)

    Google Scholar 

  2. Kim, T., Ryu, S.K.: Review and analysis of pothole detection methods. J. Emerg. Trends Comput. Inform. Sci. 5(8), 603–608 (2015)

    Google Scholar 

  3. Mathavan, S., Kamal, K., Rahman, M.: A review of three-dimensional imaging technologies for pavement distress detection and measurements. IEEE Trans. Intell. Transp. Syst. 16(5), 2353–2362 (2015)

    Article  Google Scholar 

  4. Lin, J., Liu, Y.: Potholes detection based on SVM in the pavement distress image. In: 2010 Ninth International Symposium on Distributed Computing and Applications to Business, Engineering and Science, pp. 544–547 (2010)

    Google Scholar 

  5. Cha, Y.J., Choi, W., Büyüköztürk, O.: Deep learning-based crack damage detection using convolutional neural networks. Comput. Aided Civ. Infrastruct. Eng. 32(5), 361–378 (2017)

    Article  Google Scholar 

  6. Koch, C., Georgieva, K., Kasireddy, V., Akinci, B., Fieguth, P.: A review on computer vision-based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv. Eng. Inform. 29(2), 196–210 (2015)

    Article  Google Scholar 

  7. Zhang, L., Yang, F., Zhang, Y.D., Zhu, Y.J.: Road crack detection using deep convolutional neural networks. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3708–3712 (2016)

    Google Scholar 

  8. Hoang, N.D.: An artificial intelligence method for asphalt pavement pothole detection using least squares support vector machine and neural network with steerable filter-based feature extraction. Adv. Civ. Eng. 2018, 12 (2018)

    Google Scholar 

  9. Akagic, A., Buza, E., Omanovic, S.: Pothole detection: an efficient vision-based method using RGB color space image segmentation. In: 2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 1104–1109 (2017)

    Google Scholar 

  10. Maeda, H., Sekimoto, Y., Seto, T., Kashiyama, T., Omata, H.: Road damage detection and classification using deep neural networks with smartphone images. Comput. Aided Civ. Infrastruct. Eng. 33(12), 1127–1141 (2018)

    Article  Google Scholar 

  11. Ren, S., He, K., Girshick, R., Sun, J.: Faster r-cnn.: Towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)

    Google Scholar 

  12. Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014)

    Google Scholar 

  13. Kingma, DP., Ba, J.: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  14. Xia, W.: An approach for extracting road pavement disease from HD camera videos by deep convolutional networks. In: 2018 International Conference on Audio, Language and Image Processing (ICALIP), pp. 418–422 (2018)

    Google Scholar 

  15. Wang, W., Wu, B., Yang, S., Wang, Z.: Road damage detection and classification with Faster R-CNN. In: 2018 IEEE International Conference on Big Data (Big Data), USA, pp. 5220–5223 (2018)

    Google Scholar 

  16. Fan, R, Liu, M.: Road damage detection based on unsupervised disparity map segmentation. arXiv preprint arXiv:1910.04988 (2019)

  17. Bhatia, Y., Rai, R., Gupta, V., Aggarwal, N., Akula, A.: Convolutional neural networks-based potholes detection using thermal imaging. J. King Saud Univ. Comput. Inf. Sci. 11, 1–11 (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Md. Shohel Arman .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Arman, M.S., Hasan, M.M., Sadia, F., Shakir, A.K., Sarker, K., Himu, F.A. (2020). Detection and Classification of Road Damage Using R-CNN and Faster R-CNN: A Deep Learning Approach. In: Bhuiyan, T., Rahman, M.M., Ali, M.A. (eds) Cyber Security and Computer Science. ICONCS 2020. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 325. Springer, Cham. https://doi.org/10.1007/978-3-030-52856-0_58

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-52856-0_58

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-52855-3

  • Online ISBN: 978-3-030-52856-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics