Abstract
Roads make a huge contribution to the economy of a territory. As a platform for transportation, roads are widely used by every countries in the world. Potholes in road are one of the major concerns in the transportation infrastructure. A lot of research works have been proposed using Computer Vision to detect potholes that include wide range of image processing and object detection algorithms. There is a need for potholes detection with adequate accuracy and speed, and that can be implemented with ease and low setup cost. In this paper, we have developed efficient deep learning Convolution Neural Networks (CNNs) to detect potholes in real-time with adequate accuracy. This paper compares the performance of YOLOv5 Large (Y\(_{l}\)), YOLOv5 Medium (Y\(_{m}\)) and YOLOv5 Small (Y\(_{s}\)) with ResNet101 backbone and Faster R-CNN with ResNet50 (FPN), VGG16 and MobileNetV2 backbone. The experiments results show that YOLOv5s is more applicable for real-time potholes detection because of its speed. It is able to detect potholes in high as well as low resolution images in 0.009s. With the use of Inverse Perspective Mapping with YOLOv5 to estimate area, we concluded that the detection can still be done in real time with area estimation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abadi, M., et al.: TensorFlow: large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:1603.04467 (2016)
Ai, X., Gao, Y., Rarity, J.G., Dahnoun, N.: Obstacle detection using U-disparity on quadratic road surfaces. In: 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013), pp. 1352–1357. IEEE (2013)
The American Automobile Association. Pothole damage costs drivers \$3 billion annually nationwide (2016). http://news.aaa-calif.com/news/pothole-damage-costs-drivers-3-billion-annually-nationwide. Accessed 07 Sep 2020
Bradski, G.: The OpenCV library. Dr. Dobb’s J. Softw. Tools (2000)
Buslaev, A., Iglovikov, V.I., Khvedchenya, E., Parinov, A., Druzhinin, M., Kalinin, A.A.: Albumentations: fast and flexible image augmentations. Information 11(2) (2020)
Gerum, R.C., et al.: CameraTransform: a Python package for perspective corrections and image mapping. SoftwareX 10, 100333 (2019)
Golub, G.H., Von Matt, U.: Quadratically constrained least squares and quadratic problems. Numerische Mathematik 59(1), 561–580 (1991)
Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision, 2nd edn. Cambridge University Press, Cambridge (2004)
He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)
Howard, A.G., et al.: MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861 (2017)
Jiao, L., et al.: A survey of deep learning-based object detection. IEEE Access 7, 128837–128868 (2019)
Ketkar, N.: Introduction to PyTorch, pp. 195–208, October 2017
Kirk, D.: NVIDIA CUDA software and GPU parallel computing architecture, vol. 7, pp. 103–104, January 2007
Liao, P., Chen, T.-S., Chung, P.: A fast algorithm for multilevel thresholding. J. Inf. Sci. Eng. 17, 713–727 (2001)
Lin, J., Liu, Y.: Potholes detection based on SVM in the pavement distress image. In: 2010 Ninth International Symposium on Distributed Computing and Applications to Business, Engineering and Science, pp. 544–547. IEEE (2010)
Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., Belongie, S.: Feature pyramid networks for object detection. arXiv preprint arXiv:1612.03144 (2017)
Lin, T.: Labelimg (2021). https://github.com/tzutalin/labelImg
Liu, L., et al.: Deep learning for generic object detection: a survey. Int. J. Comput. Vision 128, 261–318 (2020)
Liu, S., Deng, W.: Very deep convolutional neural network based image classification using small training sample size. In: 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), pp. 730–734 (2015)
Liu, W., et al.: SSD: single shot MultiBox detector. In: Leibe B., Matas J., Sebe N., Welling M. (eds.) Computer Vision – ECCV 2016. LNCS, vol. 9905, pp. 21–37. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46448-0_2
Mednis, A., Strazdins, G., Zviedris, R., Kanonirs, G., Selavo, L.: Real time pothole detection using android smartphones with accelerometers, pp. 1–6, June 2011
Nienaber, S., Booysen, M.J.(Thinus), Kroon, R.: Detecting potholes using simple image processing techniques and real-world footage, July 2015
City of San Antonio. Potholes (2018). https://www.sanantonio.gov/PublicWorks/FAQs/Streets/Potholes. Accessed 16 Dec 2020
Bureau of Transportation Statistics. Road condition (2018). https://www.bts.gov/road-condition. Accessed 07 Sep 2020
Oliphant, T.E.: A guide to NumPy, vol. 1 (2006)
Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)
Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. In: Advances in Neural Information Processing Systems, pp. 91–99 (2015)
Ryu, S., Kim, T., Kim, Y.-R.: Image-based pothole detection system for its service and road management system. Math. Probl. Eng. 1–10(09), 2015 (2015)
Silvister, S., et al.: Deep learning approach to detect potholes in real-time using smartphone. In: 2019 IEEE Pune Section International Conference (PuneCon), pp. 1–4 (2019)
Solanke, V.L., Patil, D.D., Patkar, A.S., Tamrale, G.S., Kale, A.G.: Analysis of existing road surface on the basis of pothole characteristics. Global J. Res. Eng. (2019)
Economics Times | India Times. Supreme court takes note of 3,597 deaths due to pothole-related accidents in 2017 (2018). https://economictimes.indiatimes.com/news/politics-and-nation/supreme-court-takes-note-of-3597-deaths-due-to-pothole-related-accidents-in-2017/articleshow/65858401.cms. Accessed 16 Dec 2020
Yu, X., Salari, E.: Pavement pothole detection and severity measurement using laser imaging. In: 2011 IEEE International Conference on Electro/Information Technology, pp. 1–5 (2011)
Zhang, Z., Ai, X., Chan, C.K., Dahnoun, N.: An efficient algorithm for pothole detection using stereo vision. In: 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 564–568 (2014)
Zviedris, R., Elsts, A., Strazdins, G., Mednis, A., Selavo, L.: LynxNet: wild animal monitoring using sensor networks. In: Marron, P.J., Voigt, T., Corke, P., Mottola, L. (eds.) REALWSN 2010. LNCS, vol. 6511, pp. 170–173. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-17520-6_18
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Kharel, S., Ahmed, K.R. (2022). Potholes Detection Using Deep Learning and Area Estimation Using Image Processing. In: Arai, K. (eds) Intelligent Systems and Applications. IntelliSys 2021. Lecture Notes in Networks and Systems, vol 296. Springer, Cham. https://doi.org/10.1007/978-3-030-82199-9_24
Download citation
DOI: https://doi.org/10.1007/978-3-030-82199-9_24
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-82198-2
Online ISBN: 978-3-030-82199-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)