Advertisement

Automatic crack detection for tunnel inspection using deep learning and heuristic image post-processing

  • Eftychios Protopapadakis
  • Athanasios VoulodimosEmail author
  • Anastasios Doulamis
  • Nikolaos Doulamis
  • Tania Stathaki
Article
  • 13 Downloads

Abstract

In this paper, a crack detection mechanism for concrete tunnel surfaces is presented. The proposed methodology leverages deep Convolutional Neural Networks and domain-specific heuristic post-processing techniques to address a variety of challenges, including high accuracy requirements, low operational times and limited hardware resources, poor and variable lighting conditions, low textured lining surfaces, scarcity of training data, and abundance of noise. The proposed framework leverages the representational power of the convolutional layers of CNNs, which inherently selects effective features, thus obviating the need for the tedious task of handcrafted feature extraction. Additionally, the good performance rates attained by the proposed framework are acquired at a significantly lower execution time compared to other techniques. The presented mechanism was designed and developed as a core component of an autonomous robotic inspector deployed and validated in the tunnels of Egnatia Motorway in Metsovo, Greece. The obtained results denote the proposed approach’s superiority over a variety of methods and suggest a promising potential as a driver of autonomous concrete-lining tunnel-inspection robots.

Keywords

Crack detection Tunnel inspection Structural evaluation Convolutional neural networks Deep learning 

Notes

Acknowledgements

The authors would like to thank all members of the ROBO-SPECT project for their collaboration and support throughout the project lifetime. This research is partly implemented through IKY scholarships programme and co-financed by the European Union (European Social Fund - ESF) and Greek national funds through the action titled “Reinforcement of Postdoctoral Researchers”, in the framework of the Operational Programme “Human Resources Development Program, Education and Lifelong Learning” of the National Strategic Reference Framework (NSRF) 2014 – 2020.

References

  1. 1.
    Shi Y, Cui L, Qi Z, Meng F, Chen Z (2016) Automatic road crack detection using random structured forests. IEEE Trans Intell Transp Syst 17(12):3434–3445CrossRefGoogle Scholar
  2. 2.
    Amhaz R, Chambon S, Idier J, Baltazart V (2016) Automatic crack detection on two-dimensional pavement images: an algorithm based on minimal path selection. IEEE Trans Intell Transp Syst 17(10):2718–2729CrossRefGoogle Scholar
  3. 3.
    Prasanna P et al (2016) Automated crack detection on concrete bridges. IEEE Trans Autom Sci Eng 13(2):591–599CrossRefGoogle Scholar
  4. 4.
    Li G, Zhao X, Du K, Ru F, Zhang Y (2017) Recognition and evaluation of bridge cracks with modified active contour model and greedy search-based support vector machine. Autom Constr 78:51–61CrossRefGoogle Scholar
  5. 5.
    Halfawy MR, Hengmeechai J (2014) Efficient algorithm for crack detection in sewer images from closed-circuit television inspections. J Infrastruct Syst 20(2):04013014CrossRefGoogle Scholar
  6. 6.
    Voulodimos A, Kosmopoulos D, Veres G, Grabner H, Van Gool L, Varvarigou T (2011) Online classification of visual tasks for industrial workflow monitoring. Neural Netw 24(8):852–860.  https://doi.org/10.1016/j.neunet.2011.06.001 CrossRefGoogle Scholar
  7. 7.
    Kosmopoulos DI, Voulodimos AS, Varvarigou TA (2010) Robust human behavior modeling from multiple cameras. In 2010 20th International Conference on Pattern Recognition (ICPR), Istanbul, pp 3575–3578.  https://doi.org/10.1109/ICPR.2010.872
  8. 8.
    Voulodimos AS, Kosmopoulos DI, Doulamis ND, Varvarigou TA (2014) A top-down event-driven approach for concurrent activity recognition. Multimed Tools Appl 69(2):293–311.  https://doi.org/10.1007/s11042-012-0993-4 CrossRefGoogle Scholar
  9. 9.
    Yu S-N, Jang J-H, Han C-S (2007) Auto inspection system using a mobile robot for detecting concrete cracks in a tunnel. Autom Constr 16(3):255–261CrossRefGoogle Scholar
  10. 10.
    Voulodimos A, Doulamis N, Doulamis A, Protopapadakis E (2018) Deep learning for computer vision: a brief review. Comput Intell Neurosci 2018.  https://doi.org/10.1155/2018/7068349
  11. 11.
    Doulamis N, Voulodimos A (2016) FAST-MDL: Fast Adaptive Supervised Training of multi-layered deep learning models for consistent object tracking and classification. In 2016 IEEE International Conference on Imaging Systems and Techniques (IST), pp 318–323Google Scholar
  12. 12.
    Protopapadakis E, Makantasis K, Kopsiaftis G, Doulamis N, Amditis A (2016) Crack identification via user feedback, convolutional neural networks and laser scanners for tunnel infrastructures. In VISIGRAPP (4: VISAPP), pp 725–734Google Scholar
  13. 13.
    Touil DE, Terki N, Medouakh S (2017) Learning spatially correlation filters based on convolutional features via PSO algorithm and two combined color spaces for visual tracking. Appl IntellGoogle Scholar
  14. 14.
    Kuang P, Ma T, Chen Z, Li F (2018) Image super-resolution with densely connected convolutional networks. Appl IntellGoogle Scholar
  15. 15.
    “ROBO-SPECT” 2014. [Online]. Available: http://www.robo-spect.eu/. [Accessed: 08-Aug-2018]
  16. 16.
    Liu Z, Suandi SA, Ohashi T, Ejima T (2002) Tunnel crack detection and classification system based on image processing. Mach Vis Appl Ind Inspect X 4664:145–153Google Scholar
  17. 17.
    Abdel-Qader I, Abudayyeh O, Kelly Michael E (2003) Analysis of edge-detection techniques for crack identification in bridges. J Comput Civ Eng 17(4):255–263CrossRefGoogle Scholar
  18. 18.
    Mohanty A, Wang TT (2011) Image mosaicking of a section of a tunnel lining and the detection of cracks through the frequency histogram of connected elements concept. In 2012 International Workshop on Image Processing and Optical Engineering, vol 8335, p 83351PGoogle Scholar
  19. 19.
    German S, Brilakis I, DesRoches R (2012) Rapid entropy-based detection and properties measurement of concrete spalling with machine vision for post-earthquake safety assessments. Adv Eng Inform 26(4):846–858CrossRefGoogle Scholar
  20. 20.
    Halfawy MR, Hengmeechai J (2014) Automated defect detection in sewer closed circuit television images using histograms of oriented gradients and support vector machine. Autom Constr 38:1–13CrossRefGoogle Scholar
  21. 21.
    Zhao Z, Chen C (2002) A fuzzy system for concrete bridge damage diagnosis. Comput Struct 80(7):629–641CrossRefGoogle Scholar
  22. 22.
    Kawamura K, Miyamoto A (2003) Condition state evaluation of existing reinforced concrete bridges using neuro-fuzzy hybrid system. Comput Struct 81(18):1931–1940CrossRefGoogle Scholar
  23. 23.
    Zhang W, Zhang Z, Qi D, Liu Y (2014) Automatic crack detection and classification method for subway tunnel safety monitoring. Sensors 14(10):19307–19328CrossRefGoogle Scholar
  24. 24.
    Choudhary GK, Dey S (2012) Crack detection in concrete surfaces using image processing, fuzzy logic, and neural networks. In 2012 IEEE Fifth International Conference on Advanced Computational Intelligence (ICACI), pp 404–411Google Scholar
  25. 25.
    Koch C, Paal SG, Rashidi A, Zhu Z, König M, Brilakis I (2014) Achievements and challenges in machine vision-based inspection of large concrete structures. Adv Struct Eng 17(3):303–318CrossRefGoogle Scholar
  26. 26.
    Protopapadakis E, Voulodimos A, Doulamis A, Doulamis N, Dres D, Bimpas M (2017) Stacked autoencoders for outlier detection in over-the-horizon radar signals. Comput Intell Neurosci 2017.  https://doi.org/10.1155/2017/5891417
  27. 27.
    Ghodrati H, Hamza AB (2017) Nonrigid 3D shape retrieval using deep auto-encoders. Appl Intell 47(1):44–61CrossRefGoogle Scholar
  28. 28.
    Chen FC, Jahanshahi MR (2018) NB-CNN: deep learning-based crack detection using convolutional neural network and Na #239;ve Bayes data fusion. IEEE Trans Ind Electron 65(5):4392–4400CrossRefGoogle Scholar
  29. 29.
    Janwe NJ, Bhoyar KK (2018) Multi-label semantic concept detection in videos using fusion of asymmetrically trained deep convolutional neural networks and foreground driven concept co-occurrence matrix. Appl Intell 48(8):2047–2066CrossRefGoogle Scholar
  30. 30.
    Makantasis K, Protopapadakis E, Doulamis A, Doulamis N, Loupos C (2015) Deep convolutional neural networks for efficient vision based tunnel inspection. In Intelligent Computer Communication and Processing (ICCP), 2015 IEEE International Conference on, pp 335–342Google Scholar
  31. 31.
    Protopapadakis E, Voulodimos A, Doulamis A (2018) On the impact of labeled sample selection in semisupervised learning for complex visual recognition tasks. Complexity 2018.  https://doi.org/10.1155/2018/6531203
  32. 32.
    Loupos K et al (2018) Autonomous robotic system for tunnel structural inspection and assessment. Int J Intell Robot Appl 2(1):43–66CrossRefGoogle Scholar
  33. 33.
    Koch C, Georgieva K, Kasireddy V, Akinci B, Fieguth P (2015) A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv Eng Inform 29(2):196–210CrossRefGoogle Scholar
  34. 34.
    Bastien F et al (2012) Theano: new features and speed improvements. ArXiv12115590 CsGoogle Scholar
  35. 35.
    Li Y, Zhao W, Pan J (2017) Deformable patterned fabric defect detection with fisher criterion-based deep learning. IEEE Trans Autom Sci Eng 14(2):1256–1264CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.National Technical University of AthensAthensGreece
  2. 2.Department of Informatics and Computer EngineeringUniversity of West AtticaAthensGreece
  3. 3.Imperial College LondonLondonUK

Personalised recommendations