Skip to main content

Advertisement

SpringerLink
Log in

Surface crack detection using deep learning with shallow CNN architecture for enhanced computation

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Surface cracks on the concrete structures are a key indicator of structural safety and degradation. To ensure the structural health and reliability of the buildings, frequent structure inspection and monitoring for surface cracks is important. Surface inspection conducted by humans is time-consuming and may produce inconsistent results due to the inspectors’ varied empirical knowledge. In the field of structural health monitoring, visual inspection of surface cracks on civil structures using deep learning algorithms has gained considerable attention. However, these vision-based techniques require high-quality images as inputs and depend on high computational power for image classification. Thus, in this study, shallow convolutional neural network (CNN)-based architecture for surface concrete crack detection is proposed. LeNet-5, a well-known CNN architecture, is optimized and trained for image classification using 40,000 images in the Middle East Technical University (METU) dataset. To achieve maximum accuracy for crack detection with minimum computation, the hyperparameters of the proposed model were optimized. The proposed model enables the employment of deep learning algorithms using low-power computational devices for a hassle-free monitoring of civil structures. The performance of the proposed model is compared with those of various pretrained deep learning models, such as VGG16, Inception, and ResNet. The proposed shallow CNN architecture was found to achieve a maximum accuracy of 99.8% in the minimum computation. Better hyperparameter optimization in CNN architecture results in higher accuracy even with a shallow layer stack for enhanced computation. The evaluation results confirm the incorporation of the proposed method with autonomous devices, such as unmanned aerial vehicle, for real-time inspection of surface crack with minimum computation.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26

Similar content being viewed by others

Code availability

Not applicable.

References

  1. Kim H, Ahn E, Shin M, Sim SH (2018) Crack and non-crack classification from concrete surface images using machine learning. Struct Health Monit 18:725–738

    Article  Google Scholar 

  2. Kang D, Cha Y-J (2019) Autonomous UAVs for structural health monitoring using deep learning and an ultrasonic beacon system with geo-tagging. Comput-Aided Civ Infrastruct Eng 33:885–902. https://doi.org/10.1111/mice.12375

    Article  Google Scholar 

  3. Gibb S, La HM, Louis S (2018) A genetic algorithm for convolutional network structure optimization for concrete crack detection. IEEE Congress Evolut Comput. https://doi.org/10.1109/CEC.2018.8477790

    Article  Google Scholar 

  4. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86:2278–2324

    Article  Google Scholar 

  5. Zhang C-W, Yang M-Y, Zeng H-J, Wen J-P (2019) Pedestrian detection based on improved LeNet-5 convolutional neural network. J Algorithms Comput Technol. https://doi.org/10.1177/1748302619873601

    Article  Google Scholar 

  6. Cook W, Barr PJ (2017) Observations and trends among collapsed bridges in New York state. J Perform Constr Facil. https://doi.org/10.1061/(ASCE)CF.1943-5509.0000996

    Article  Google Scholar 

  7. Road Bureau, Ministry of Land, Infrastructure, Transportation, and Tourism, Roads in Japan. Accessed on http://www.mlit.go.jp/road/road_e/index_e.html.

  8. National Transportation Safety Board (2007) Collapse of I-35W Highway Bridge, Minneapolis, Minnesota. http://www.dot.state.mn.us/i35wbridge/ntsb/finalreport.pdf

  9. Spencer BF, Hoskere V, Narazaki Y (2019) Advances in computer vision-based civil infrastructure inspection and monitoring. Engineering. https://doi.org/10.1016/j.eng.2018.11.030

    Article  Google Scholar 

  10. Asakura T, Kojima Y (2003) Tunneling and underground space technology. Tunnel Maint Jpn 18:161–169. https://doi.org/10.1016/S0886-7798(03)00024-5

    Article  Google Scholar 

  11. Dung CV, Anh LD (2019) Autonomous concrete crack detection using deep fully convolutional neural network. Autom Constr. https://doi.org/10.1016/j.autcon.2018.11.028

    Article  Google Scholar 

  12. Koch C, Georgieva K, Kasireddy V, Akinci B, Fieguth P (2015) A review on computer vision based defect detection and condition assessment of concrete and asphalt civil infrastructure. Adv Eng Inform 29:196–210. https://doi.org/10.1016/j.aei.2015.01.008

    Article  Google Scholar 

  13. Kim I-H, Jeon H, Baek S-C, Hong W-H, Jung H-J (2018) Application of crack identification techniques for an aging concrete bridge inspection using an unmanned aerial vehicle. Sensors. https://doi.org/10.3390/s18061881

    Article  Google Scholar 

  14. Yan J, Downey A, Cancelli A, Laflamme S, Chen A, Li J, Ubertini F (2019) Concrete crack detection and monitoring using a capacitive dense sensor array. Sensors. https://doi.org/10.3390/s19081843

    Article  Google Scholar 

  15. Teidj S, Khamlichi A, Driouach A (2016) Identification of beam cracks by solution of an inverse problem. Procedia Technol 22:86–93. https://doi.org/10.1016/j.protcy.2016.01.014

    Article  Google Scholar 

  16. Chatzi EN, Hiriyur B, Waisman H, Smyth AW (2011) Experimental application and enhancement of the XFEM–GA algorithm for the detection of flaws in structures. Comput Struct 89:556–570

    Article  Google Scholar 

  17. Rabinovich D, Givoli D, Vigdergauz S (2007) XFEM based crack detection scheme using a genetic algorithm. Int J Numer Methods Eng 71:1051–1080. https://doi.org/10.1002/nme.1975

    Article  MathSciNet  MATH  Google Scholar 

  18. Cha Y-J, Choi W (2017) Deep learning-based crack damage detection using convolutional neural networks. Comput-Aided Civ Infrastr Eng 32:361–378

    Article  Google Scholar 

  19. Adhikari RS, Moselhi O, Bagchi A (2014) Image-based retrieval of concrete crack properties for bridge inspection. Autom Constr 39:180–194. https://doi.org/10.1016/j.autcon.2013.06.011

    Article  Google Scholar 

  20. Noh Y, Koo D, Kang Y, Park D, Lee D (2017) Automatic crack detection on concrete images using segmentation via fuzzy C-means clustering. In: Proceedings of the 2017 international conference on applied system innovation (ICASI), Sapporo, Japan, pp 877–880

  21. Dawood T, Zhu Z, Zayed T (2017) Machine vision-based model for spalling detection and quantification in subway networks. Autom Constr 81:149–160

    Article  Google Scholar 

  22. Ali R, Gopal L G, Cha Y J (2018) Vision-based concrete crack detection technique using cascade features. In: Proceedings of the SPIE 10598, sensors and smart structures technologies for civil mechanical, and aerospace systems. https://doi.org/10.1117/12.2295962

  23. Dinh T H, Ha Q, La H M (2016) Computer vision-based method for concrete crack detection. In: Proceedings of the 2016 14th international conference on control, automation, robotics and vision (ICARCV), pp 1–6

  24. Fathi H, Dai F, Lourakis M (2015) Automated as-built 3D reconstruction of civil infrastructure using computer vision: achievements, opportunities, and challenges. Adv Eng Inform 29:149–161. https://doi.org/10.1016/j.aei.2015.01.012

    Article  Google Scholar 

  25. Seo J, Han S, Lee S, Kim H (2015) Computer vision techniques for construction safety and health monitoring. Adv Eng Inform 29:239–251

    Article  Google Scholar 

  26. Nishikawa T, Yoshida J, Sugiyama T, Fujino Y (2012) Concrete crack detection by multiple sequential image filtering. Comput Aided Civ Infrastruct Eng 27:29–47

    Article  Google Scholar 

  27. Islam M, Kim J-M (2019) Vision-based autonomous crack detection of concrete structures using a fully convolutional encoder–decoder network. Sensors. https://doi.org/10.3390/s19194251

    Article  Google Scholar 

  28. Teizer J (2015) Status quo and open challenges in vision-based sensing and tracking of temporary resources on infrastructure construction sites. Adv Eng Inform 29:225–238. https://doi.org/10.1016/j.aei.2015.03.006

    Article  MathSciNet  Google Scholar 

  29. Yang J, Park M-W, Vela PA, Golparvar-Fard M (2015) Construction performance monitoring via still images, time-lapse photos, and video streams: now, tomorrow, and the future. Adv Eng Inform 29:211–224

    Article  Google Scholar 

  30. Radopoulou SC, Brilakis I (2015) Patch detection for pavement assessment. Autom Constr 53:95–104

    Article  Google Scholar 

  31. Abdel-Qader I, Abudayyeh O, Kelly ME (2003) Analysis of edge-detection techniques for crack identification in bridges. J Comput Civ Eng 17:255–263

    Article  Google Scholar 

  32. Prasanna P, Dana KJ, Gucunski N, Basily BB, La HM, LimParvardeh RSH (2016) Automated crack detection on concrete bridges. IEEE Trans Autom Sci Eng 13:591–599

    Article  Google Scholar 

  33. Oh JK, Jang G, Oh S, Lee JH, Yi B, Moon YS, Lee JS, Choi Y (2009) Bridge inspection robot system with machine vision. Autom Constr 18:929–941

    Article  Google Scholar 

  34. Li G, Zhao X, Du K, Ru F, Zhang Y (2017) Recognition and evaluation of bridge cracks with modified active contour model and greedy search-based support vector machine. Autom Constr 78:51–61

    Article  Google Scholar 

  35. Na W, Tao W (2012) Proximal support vector machine based pavement image classification. In: IEEE Fifth international conference on advanced computational intelligence (ICACI), pp 686–688

  36. Abdel-Qader I, Pashaie-Rad S, Abudayyeh O, Yehia S (2006) PCA - based algorithm for unsupervised bridge crack detection. Adv Eng Softw 37:771–778

    Article  Google Scholar 

  37. Choudhary GK, Dey S (2012) Crack detection in concrete surfaces using image processing, fuzzy logic, and neural networks. In: Proceedings of the 2012 IEEE fifth international conference on advanced computational intelligence (ICACI), Nanjing, China, pp 404–411

  38. Sri Preethaa KR, Sabari A (2020) Intelligent video analysis for enhanced pedestrian detection by hybrid metaheuristic approach. Soft Comput 24(16):12303–12311

    Article  Google Scholar 

  39. Bishop CM (2006) Pattern recognition and machine learning. Springer-Verlag, New York City

    MATH  Google Scholar 

  40. Mhathesh TSR, Andrew J, Martin Sagayam K, Henesey L (2020) 3D convolutional neural network for bacterial image classification. In: Peter J, Fernandes S, Alavi A (eds) Intelligence in big data technologies beyond the hype. Advances in intelligent systems and computing, vol 1167. Springer, Singapore. https://doi.org/10.1007/978-981-15-5285-4_42

    Chapter  Google Scholar 

  41. Zhang H, Tan J, Liu L, Wu Q M J, Wang Y, Jie L (2017) Automatic crack inspection for concrete bridge bottom surfaces based on machine vision. In Proceedings of the 2017 Chinese automation congress (CAC), Jinan, China, 20–22 Oct 2017, pp 4938–4943

  42. Cha YJ, Choi W, Suh G, Mahmoudkhani S, Buyukozturk O (2017) Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Comput Aided Civ Infrastruct Eng. https://doi.org/10.1111/mice

    Article  Google Scholar 

  43. Zhang K, Cheng HD, Zhang B (2018) Unified approach to pavement crack and sealed crack detection using preclassification based on transfer learning. J Comput Civ Eng 32:04018001

    Article  Google Scholar 

  44. Chen FC, Jahanshahi MR (2017) NB-CNN: Deep learning-based crack detection using convolutional neural network and Naïve Bayes data fusion. IEEE Trans Ind Electron. https://doi.org/10.1109/TIE.2017.2764844

    Article  Google Scholar 

  45. Fan Z, Wu Y, Lu J, Li W (2018) Automatic pavement crack detection based on structured prediction with the convolutional neural network. arXiv:1802.02208.

  46. Wang K C, Zhang A, Li J Q, Fei Y, Chen C, Li B (2017) Deep learning for asphalt pavement cracking recognition using convolutional neural network. Airfeld and Highway Pavements, pp 166–177

  47. Zhang L, Yang F, Zhang Y D, Zhu Y J (2016) Road crack detection using deep convolutional neural network. In: IEEE international conference on image processing (ICIP), pp 3708–3712. https://doi.org/10.1109/ICIP.2016.7533052

  48. Pauly L, Hogg R D, Fuentes, Peel H (2017) Deeper networks for pavement crack detection. In: Proceedings of the 34th ISARC. 34th international symposium in automation and robotics in construction, IAARC, Taipei, Taiwan, pp 479–485

  49. Ren S, He K, Girshick R, Sun J (2017) Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Tran Pattern Anal Mach Intell 39:1137–1149. https://doi.org/10.1109/TPAMI.2016.2577031

    Article  Google Scholar 

  50. Rawat W, Wang Z (2017) Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput 29:2352–2449. https://doi.org/10.1162/neco_a_00990

    Article  MathSciNet  MATH  Google Scholar 

  51. Gopala Krishnan K (2018) Deep learning in data-driven pavement image analysis and automated distress detection: a review. Data 3:28. https://doi.org/10.3390/data3030028

    Article  Google Scholar 

  52. Cao QD, Choe Y (2020) Building damage annotation on post-hurricane satellite imagery based on convolutional neural networks. Nat Hazards 103:3357–3376

    Article  Google Scholar 

  53. LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436

    Article  Google Scholar 

  54. Kim B, Yuvaraj N, Sri Preethaa KR, Santhosh R, Sabari A (2020) Enhanced pedestrian detection using optimized deep convolution neural network for smart building surveillance. Soft Comput 24(22):17081–17092

    Article  Google Scholar 

  55. Zhang C, Patras P, Haddadi H (2019) Deep learning in mobile and wireless networking a survey. IEEE Commun Surv Tutor 21:2224–2287

    Article  Google Scholar 

  56. Ortega-Zamorano F, Jerez JM, Gómez I, Franco L (2017) Layer multiplexing FPGA implementation for deep back-propagation learning. Integr Comput-Aided Eng 24(2):171–185

    Article  Google Scholar 

  57. Yamaguchi T, Nakamura S, Saegusa R, Hashimoto S (2008) Image-based crack detection for real concrete surfaces. IEEJ Trans Electr Electron Eng 3:128–135

    Article  Google Scholar 

  58. ASCE (2017) American Society of Civil Engineers (ASCE), Infrastructure Report Card. https://www.infrastructurereportcard.org/

  59. Yuvaraj N, Sabari A (2016) Twitter sentiment classification using binary shuffled frog algorithm. Intell Autom Soft Comput 1:1–9

    Google Scholar 

  60. Yuvaraj N, Sri Preethaa KR (2017) Diabetes prediction in healthcare systems using machine learning algorithms on Hadoop cluster. Cluster Comput 22:1–9. https://doi.org/10.1007/s10586-017-1532-x

    Article  Google Scholar 

Download references

Funding

This work was supported by Korea Research Fellowship Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science and ICT (No. 2019H1D3A1A01101442). This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea Government (MSIT) (No. 2019R1G1A1095215).

Author information

Authors and Affiliations

  1. Department of Architectural Engineering, Dong-A University, Busan, 49315, South Korea

    Bubryur Kim & N. Yuvaraj

  2. Department of Artificial Intelligence and Data Science, KPR Institute of Engineering and Technology, Coimbatore, 641407, India

    K. R. Sri Preethaa

  3. Artificial Intelligence and Data Science Lab, KPR Institute of Engineering and Technology, Coimbatore, 641407, India

    R. Arun Pandian

Authors
  1. Bubryur Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. N. Yuvaraj
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. K. R. Sri Preethaa
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. R. Arun Pandian
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to N. Yuvaraj.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kim, B., Yuvaraj, N., Sri Preethaa, K.R. et al. Surface crack detection using deep learning with shallow CNN architecture for enhanced computation. Neural Comput & Applic 33, 9289–9305 (2021). https://doi.org/10.1007/s00521-021-05690-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-021-05690-8

Keywords

Search

Navigation