Abstract
Rapid and accurate detection of internal defects in bridges has always been a major concern of the management and maintenance departments. In the present study, an intelligent method for the detection of structural internal defects is proposed based on infrared thermography and deep learning. Through theoretical analysis, numerical simulations and laboratory experiments, the classification, localization and quantification of internal defects of concrete structures were achieved with the infrared thermography and deep learning method. The mean average precision for classification and localization of internal defects is 96.59%, the mIoU for pixel-level segmentation is 95.19%, and the average relative error for damage quantification is 0.70%. The feasibility of the trained model is verified with new images, and the results show that the trained model can capture infrared thermal features of internal defects with different sizes and depths. This method has the advantages of low cost, high accuracy, easy operation, and large area scanning of concrete structures, which can provide a good reference for the detection of internal defects of concrete structures.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abu Dabous S, Yaghi S, Alkass S, Moselhi O (2017) Concrete bridge deck condition assessment using IR Thermography and Ground Penetrating Radar technologies. Automation in Construction 81: 340–354, DOI: https://doi.org/10.1016/j.autcon.2017.04.006
ASCE (2021) Report card for America’s infrastructure. Retrieved February 10, 2022, https://infrastructurereportcard.org/cat-item/bridges-infrastructure/
Bodnar JL, Nicolas JL, Candoré JC, Detalle V (2012) Non-destructive testing by infrared thermography under random excitation and ARMA analysis. International Journal of Thermophysics 33(10–11): 2011–2015, DOI: https://doi.org/10.1007/s10765-012-1265-2
Cheng C, Cheng T, Chiang C (2008) Defect detection of concrete structures using both infrared thermography and elastic waves. Automation in Construction 18(1):87–92, DOI: https://doi.org/10.1016/j.autcon.2008.05.004
Cheng C, Na R Shen Z (2019a) Thermographic Laplacian-pyramid filtering to enhance delamination detection in concrete structure. Infrared Physics & Technology 97:162–176, DOI: https://doi.org/10.1016/j.infrared.2018.12.039
Cheng C, Shang Z, Shen Z (2019b) Bridge deck delamination segmentation based on aerial thermography through regularized grayscale morphological reconstruction and gradient statistics. Infrared Physics & Technology 98:240–249, DOI: https://doi.org/10.1016/j.infrared.2019.03.018
Cheng C, Shang Z, Shen Z (2020) Automatic delamination segmentation for bridge deck based on encoder-decoder deep learning through UAV-based thermography. NDT & E International 116:102341, DOI: https://doi.org/10.1016/j.ndteint.2020.102341
Cheng C, Shen Z (2018) Detecting concrete abnormality using time-series thermal imaging and supervised learning, ArXiv Preprint ArXiv:1804.05406, DOI: https://doi.org/10.48550/arXiv.1804.05406
Cheng C, Shen Z (2020) The application of gray-scale level-set method in segmentation of concrete deck delamination using infrared images. Construction and Building Materials 240:117974, DOI: https://doi.org/10.1016/j.conbuildmat.2019.117974
Cotič P, Kolarič D, Bosiljkov V B, Bosiljkov V, Jagličić Z (2015) Determination of the applicability and limits of void and delamination detection in concrete structures using infrared thermography. NDT & E International 74:87–93, DOI: https://doi.org/10.1016/j.ndteint.2015.05.003
FHWA (2016) Highway bridges by deck structure type 2016. Retrieved February 10, 2022, https://www.fhwa.dot.gov/bridge/nbi/no10/deck16.cfm
Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation, Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), June 23–28, Columbus, OH, USA
He K, Gkioxari G, Doll ARP, Girshick R (2017) Mask r-cnn, Proceedings of the IEEE international conference on computer vision (ICCV), October 22–29, Venice, Italy
Hiasa S, Birgul R, Catbas FN (2017a) Investigation of effective utilization of infrared thermography (IRT) through advanced finite element modeling. Construction and Building Materials 150:295–309, DOI: https://doi.org/10.1016/j.conbuildmat.2017.05.175
Hiasa S, Birgul R, Necati Catbas F (2017b) A data processing methodology for infrared thermography images of concrete bridges. Computers & Structures 190:205–218, DOI: https://doi.org/10.1016/j.compstruc.2017.05.011
Jiao L, Ye Q, Cao X, Huston D, Xia T (2020) Identifying concrete structure defects in GPR image. Measurement 160:107839, DOI: https://doi.org/10.1016/j.measurement.2020.107839
Karpathy A, Toderici G, Shetty S, Leung T, Sukthankar R, Fei-Fei L (2014) Large-scale video classification with convolutional neural networks, Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), June 23–28, Columbus, OH, USA
Kashif Ur Rehman S, Ibrahim Z, Memon SA, Jameel M (2016) Nondestructive test methods for concrete bridges: A review. Construction and Building Materials 107:58–86, DOI: https://doi.org/10.1016/j.conbuildmat.2015.12.011
Kylili A, Fokaides P A, Christou P, Kalogirou SA (2014) Infrared thermography (IRT) applications for building diagnostics: A review. Applied Energy 134:531–549, DOI: https://doi.org/10.1016/j.apenergy.2014.08.005
Lee I, Kwon S, Park J, Oh T (2018) The effective near-surface defect identification by dynamic behavior associated with both impact-echo and flexural modes for concrete structures. KSCE Journal of Civil Engineering 22(2):747–754, DOI: https://doi.org/10.1007/s12205-017-1433-9
Luo Q, Gao B, Woo WL, Yang Y (2019) Temporal and spatial deep learning network for infrared thermal defect detection. NDT & E International 108:102164, DOI: https://doi.org/10.1016/j.ndteint.2019.102164
Maierhofer C, Arndt R, Röllig M, Helmerich R, Walther A, Hillemeier B, Rieck C (2006) Quantification of voids and delaminations in real concrete and masonry structures with active thermography: Case studies, Proceedings of the quantitative infrared thermography (QIRT), June 28–30, Padova, Italy
Maierhofer C, Brink A, Röllig M, Wiggenhauser H (2003) Detection of shallow voids in concrete structures with impulse thermography and radar. NDT & E International 36(4):257–263, DOI: https://doi.org/10.1016/S0963-8695(02)00063-4
Omar T, Nehdi ML, Zayed T (2018) Infrared thermography model for automated detection of delamination in RC bridge decks. Construction and Building Materials 168:313–327, DOI: https://doi.org/10.1016/j.conbuildmat.2018.02.126
Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: Unified, real-time object detection, Proceedings of the IEEE conference on computer vision and pattern recognition (CVPR), June 27–30, Las Vegas, NV, USA
Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: Towards real-time object detection with region proposal networks. ArXiv Preprint ArXiv:1506.01497, DOI: https://doi.org/10.48550/arXiv.1506.01497
Russell BC, Torralba A, Murphy KP, Freeman WT (2008) LabelMe: A database and web-based tool for image annotation. International Journal of Computer Vision 77(1–3):157–173, DOI: https://doi.org/10.1007/s11263-007-0090-8
Saeed N, Omar MA, Abdulrahman Y (2018) A neural network approach for quantifying defects depth, for nondestructive testing thermograms. Infrared Physics & Technology 94:55–64, DOI: https://doi.org/10.1016/j.infrared.2018.08.022
Sakagami T, Kubo S (2002) Development of a new non-destructive testing technique for quantitative evaluations of delamination defects in concrete structures based on phase delay measurement using lock-in thermography. Infrared Physics & Technology 43(3):311–316, DOI: https://doi.org/10.1016/S1350-4495(02)00157-3
Schmidt F W, Henderson R E, Wohlgemuth C H (1993) Introduction to thermal sciences: Thermodynamics, fluid dynamics, heat transfer. Wiley, New York, USA, 13–14
Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. ArXiv Preprint ArXiv:1409.1556, DOI: https://doi.org/10.48550/arXiv.1409.1556
Srikanth I, Arockiasamy M (2020) Deterioration models for prediction of remaining useful life of timber and concrete bridges: A review. Journal of Traffic and Transportation Engineering (English Edition) 7(2):152–173, DOI: https://doi.org/10.1016/j.jtte.2019.09.005
Tekin I, Birgul R, Ozgur Yaman I, Gencel O, Yilmaz Aruntas H (2015) Monitoring macro voids in mortars by computerized tomography method. Measurement 63:299–308, DOI: https://doi.org/10.1016/j.measurement.2014.11.034
Van Hieu B, Choi S, Kim YU, Park Y, Jeong T (2011) Wireless transmission of acoustic emission signals for real-time monitoring of leakage in underground pipes. KSCE Journal of Civil Engineering 15(5):805, DOI: https://doi.org/10.1007/s12205-011-0899-0
Wang J, Wang C, Han Z (2020) Multi-frequency ultrasonic underground cavity scanning detection technology in borehole. Measurement 161:107889, DOI: https://doi.org/10.1016/j.measurement.2020.107889
Washer G, Fenwick R, Nelson S, Rumbayan R (2013) Guidelines for thermographic inspection of concrete bridge components in shaded conditions. Transportation Research Record 2360(1):13–20, DOI: https://doi.org/10.3141/2360-02
Wu Y, Kirillov A, Massa F, Lo W, Girshick R (2019) Detectron2. Retrieved February 10, 2022, https://github.com/facebookresearch/detectron2
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Deng, L., Zuo, H., Wang, W. et al. Internal Defect Detection of Structures Based on Infrared Thermography and Deep Learning. KSCE J Civ Eng 27, 1136–1149 (2023). https://doi.org/10.1007/s12205-023-0391-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12205-023-0391-7