Abstract
Road surface monitoring is mostly done manually in cities which is an intensive process of time consuming and labor work. The intention of this paper is to research on road damage detection and classification from road surface images using object detection method. This paper applied multiple convolutional neural network (CNN) algorithm to classify road damage and discovered which algorithm performs better in road damage detection and classification. The damages are classified in three categories pothole, crack and revealing. For this research data was collected from street of Dhaka city using smartphone camera and prepossessed the data like image resize, white balance, contrast transformation, labeling. This study applies R-CNN and faster R-CNN for object detection of road damages and apply Support Vector Machine (SVM) for classification and gets a better result from previous studies. Then losses are calculated using different loss functions. The results demonstrate the highest 98.88% accuracy and the lowest loss is 0.01.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Fan, R.: Real-time computer stereo vision for automotive applications. Dissertation, University of Bristol (2018)
Kim, T., Ryu, S.K.: Review and analysis of pothole detection methods. J. Emerg. Trends Comput. Inform. Sci. 5(8), 603–608 (2015)
Mathavan, S., Kamal, K., Rahman, M.: A review of three-dimensional imaging technologies for pavement distress detection and measurements. IEEE Trans. Intell. Transp. Syst. 16(5), 2353–2362 (2015)
Lin, J., Liu, Y.: Potholes detection based on SVM in the pavement distress image. In: 2010 Ninth International Symposium on Distributed Computing and Applications to Business, Engineering and Science, pp. 544–547 (2010)
Cha, Y.J., Choi, W., Büyüköztürk, O.: Deep learning-based crack damage detection using convolutional neural networks. Comput. Aided Civ. Infrastruct. Eng. 32(5), 361–378 (2017)
Koch, C., Georgieva, K., Kasireddy, V., Akinci, B., Fieguth, P.: A review on computer vision-based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv. Eng. Inform. 29(2), 196–210 (2015)
Zhang, L., Yang, F., Zhang, Y.D., Zhu, Y.J.: Road crack detection using deep convolutional neural networks. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 3708–3712 (2016)
Hoang, N.D.: An artificial intelligence method for asphalt pavement pothole detection using least squares support vector machine and neural network with steerable filter-based feature extraction. Adv. Civ. Eng. 2018, 12 (2018)
Akagic, A., Buza, E., Omanovic, S.: Pothole detection: an efficient vision-based method using RGB color space image segmentation. In: 2017 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp. 1104–1109 (2017)
Maeda, H., Sekimoto, Y., Seto, T., Kashiyama, T., Omata, H.: Road damage detection and classification using deep neural networks with smartphone images. Comput. Aided Civ. Infrastruct. Eng. 33(12), 1127–1141 (2018)
Ren, S., He, K., Girshick, R., Sun, J.: Faster r-cnn.: Towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)
Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014)
Kingma, DP., Ba, J.: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)
Xia, W.: An approach for extracting road pavement disease from HD camera videos by deep convolutional networks. In: 2018 International Conference on Audio, Language and Image Processing (ICALIP), pp. 418–422 (2018)
Wang, W., Wu, B., Yang, S., Wang, Z.: Road damage detection and classification with Faster R-CNN. In: 2018 IEEE International Conference on Big Data (Big Data), USA, pp. 5220–5223 (2018)
Fan, R, Liu, M.: Road damage detection based on unsupervised disparity map segmentation. arXiv preprint arXiv:1910.04988 (2019)
Bhatia, Y., Rai, R., Gupta, V., Aggarwal, N., Akula, A.: Convolutional neural networks-based potholes detection using thermal imaging. J. King Saud Univ. Comput. Inf. Sci. 11, 1–11 (2019)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering
About this paper
Cite this paper
Arman, M.S., Hasan, M.M., Sadia, F., Shakir, A.K., Sarker, K., Himu, F.A. (2020). Detection and Classification of Road Damage Using R-CNN and Faster R-CNN: A Deep Learning Approach. In: Bhuiyan, T., Rahman, M.M., Ali, M.A. (eds) Cyber Security and Computer Science. ICONCS 2020. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 325. Springer, Cham. https://doi.org/10.1007/978-3-030-52856-0_58
Download citation
DOI: https://doi.org/10.1007/978-3-030-52856-0_58
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-52855-3
Online ISBN: 978-3-030-52856-0
eBook Packages: Computer ScienceComputer Science (R0)