Concrete Crack Pixel Classification Using an Encoder Decoder Based Deep Learning Architecture

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11844)


Civil infrastructure inspection in hazardous areas such as underwater beams, bridge decks, etc., is a perilous task. In addition, other factors like labor intensity, time, etc. influence the inspection of infrastructures. Recent studies [11] represent that, an autonomous inspection of civil infrastructure can eradicate most of the problems stemming from manual inspection. In this paper, we address the problem of detecting cracks in the concrete surface. Most of the recent crack detection techniques use deep architecture. However, finding the exact location of crack efficiently has been a difficult problem recently. Therefore, a deep architecture is proposed in this paper, to identify the exact location of cracks. Our architecture labels each pixel as crack or non-crack, which eliminates the need for using any existing post-processing techniques in the current literature [5, 11]. Moreover, acquiring enough data for learning is another challenge in concrete defect detection. According to previous studies, only 10% of an image contains edge pixels (in our case defected areas) [31]. We proposed a robust data augmentation technique to alleviate the need for collecting more crack image samples. The experimental results show that, with our method, significant accuracy can be obtained with very less sample of data. Our proposed method also outperforms the existing methods of concrete crack classification.


Crack detection Pixel labeling Deep learning architecture Data augmentation 


  1. 1.
    Badrinarayanan, V., Handa, A., Cipolla, R.: Segnet: A deep convolutional encoder-decoder architecture for robust semantic pixel-wise labelling. arXiv preprint arXiv:1505.07293 (2015)
  2. 2.
    Bai, X., Zhou, F., Xue, B.: Multiple linear feature detection based on multiple-structuring-element center-surround top-hat transform. Appl. Opt. 51(21), 5201–5211 (2012)CrossRefGoogle Scholar
  3. 3.
    Billah, U.H., La, H.M., Tavakkoli, A., Gucunski, N.: Classification of concrete crack using deep residual network. In: 9th International Conference on Structural Health Monitoring of Intelligent Infrastructure (SHMII-9), pp. 1–6, August 2019Google Scholar
  4. 4.
    Bray, J., Verma, B., Li, X., He, W.: A neural network based technique for automatic classification of road cracks. In: 2006 International Joint Conference on Neural Networks, IJCNN 2006, pp. 907–912. IEEE (2006)Google Scholar
  5. 5.
    Cha, Y.J., Choi, W., Büyüköztürk, O.: Deep learning-based crack damage detection using convolutional neural networks. Comput. Aided Civil Infrastruct. Eng. 32(5), 361–378 (2017)CrossRefGoogle Scholar
  6. 6.
    Dinh, T.H., Ha, Q., La, H.M.: Computer vision-based method for concrete crack detection. In: 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV), pp. 1–6. IEEE (2016)Google Scholar
  7. 7.
    Elbehiery, H., Hefnawy, A., Elewa, M.: Surface defects detection for ceramic tiles using image processing and morphological techniques (2005)Google Scholar
  8. 8.
    Gavilán, M., et al.: Adaptive road crack detection system by pavement classification. Sensors 11(10), 9628–9657 (2011)CrossRefGoogle Scholar
  9. 9.
    Gibb, S., La, H.M., Louis, S.: A genetic algorithm for convolutional network structure optimization for concrete crack detection. In: 2018 IEEE Congress on Evolutionary Computation (CEC), pp. 1–8, July 2018Google Scholar
  10. 10.
    Gibb, S., Le, T., La, H.M., Schmid, R., Berendsen, T.: A multi-functional inspection robot for civil infrastructure evaluation and maintenance. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2672–2677, September 2017Google Scholar
  11. 11.
    Gibb, S., La, H.M., Le, T., Nguyen, L., Schmid, R., Pham, H.: Nondestructive evaluation sensor fusion with autonomous robotic system for civil infrastructure inspection. J. Field Rob. 35(6), 988–1004 (2018)CrossRefGoogle Scholar
  12. 12.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp. 1097–1105 (2012)Google Scholar
  13. 13.
    La, H.M., Gucunski, N., Kee, S.H., Nguyen, L.: Data analysis and visualization for the bridge deck inspection and evaluation robotic system. Vis. Eng. 3(1), 1–16 (2015)CrossRefGoogle Scholar
  14. 14.
    La, H.M., Gucunski, N., Kee, S.-H., Yi, J., Senlet, T., Nguyen, L.: Autonomous robotic system for bridge deck data collection and analysis. In: 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1950–1955, September 2014Google Scholar
  15. 15.
    La, H.M.: Mechatronic systems design for an autonomous robotic system for high-efficiency bridge deck inspection and evaluation. IEEE/ASME Trans. Mechatron. 18(6), 1655–1664 (2013)CrossRefGoogle Scholar
  16. 16.
    La, H.M., Gucunski, N., Dana, K., Kee, S.H.: Development of an autonomous bridge deck inspection robotic system. J. Field Rob. 34(8), 1489–1504 (2017)CrossRefGoogle Scholar
  17. 17.
    Landstrom, A., Thurley, M.J.: Morphology-based crack detection for steel slabs. IEEE J. Sel. Top. Signal process. 6(7), 866–875 (2012)CrossRefGoogle Scholar
  18. 18.
    LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521(7553), 436 (2015)CrossRefGoogle Scholar
  19. 19.
    Li, Q., Liu, X.: Novel approach to pavement image segmentation based on neighboring difference histogram method. In: 2008 Congress on Image and Signal Processing, CISP 2008, vol. 2, pp. 792–796. IEEE (2008)Google Scholar
  20. 20.
    Lim, R.S., La, H.M., Shan, Z., Sheng, W.: Developing a crack inspection robot for bridge maintenance. In: 2011 IEEE International Conference on Robotics and Automation, pp. 6288–6293, May 2011Google Scholar
  21. 21.
    Lim, R.S., La, H.M., Sheng, W.: A robotic crack inspection and mapping system for bridge deck maintenance. IEEE Trans. Autom. Sci. Eng. 11(2), 367–378 (2014)CrossRefGoogle Scholar
  22. 22.
    Maode, Y., Shaobo, B., Kun, X., Yuyao, H.: Pavement crack detection and analysis for high-grade highway. In: 2007 8th International Conference on Electronic Measurement and Instruments, ICEMI 2007, pp. 4–548. IEEE (2007)Google Scholar
  23. 23.
    Noh, H., Hong, S., Han, B.: Learning deconvolution network for semantic segmentation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1520–1528 (2015)Google Scholar
  24. 24.
    Oliveira, H., Correia, P.L.: Automatic road crack segmentation using entropy and image dynamic thresholding. In: 2009 17th European Conference on Signal Processing, pp. 622–626. IEEE (2009)Google Scholar
  25. 25.
    Prasanna, P., Dana, K., Gucunski, N., Basily, B.: Computer-vision based crack detection and analysis. In: Sensors and Smart Structures Technologies for Civil, Mechanical, and Aerospace Systems 2012, vol. 8345, p. 834542. International Society for Optics and Photonics (2012)Google Scholar
  26. 26.
    Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). Scholar
  27. 27.
    Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)
  28. 28.
    Sun, Y., Salari, E., Chou, E.: Automated pavement distress detection using advanced image processing techniques. In: 2009 IEEE International Conference on Electro/Information Technology, EIT 2009, pp. 373–377. IEEE (2009)Google Scholar
  29. 29.
    Sy, N., Avila, M., Begot, S., Bardet, J.C.: Detection of defects in road surface by a vision system. In: 2008 14th IEEE Mediterranean Electrotechnical Conference, MELECON 2008, pp. 847–851. IEEE (2008)Google Scholar
  30. 30.
    Tanaka, N., Uematsu, K.: A crack detection method in road surface images using morphology. MVA 98, 17–19 (1998)Google Scholar
  31. 31.
    Xie, S., Tu, Z.: Holistically-nested edge detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1395–1403 (2015)Google Scholar
  32. 32.
    Zhao, H., Qin, G., Wang, X.: Improvement of canny algorithm based on pavement edge detection. In: 2010 3rd International Congress on Image and Signal Processing. vol. 2, pp. 964–967. IEEE (2010)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.University of NevadaRenoUSA

Personalised recommendations