Abstract
Cracks on bridge surfaces represent a significant defect that demands accurate and efficient inspection methods. However, current approaches for segmenting cracks suffer from low accuracy and slow detection speed, particularly when dealing with fine and small cracks that occupy only a few pixels. In this work, we propose a novel crack image semantic segmentation method based on an enhanced SegNet. The proposed approach addresses these challenges through three key innovations. First, we reduce the network depth to improve computational efficiency while maintaining accuracy. Furthermore, we employ ConvNeXt-V2 to effectively extract and fuse crack features, thereby improving segmentation performance. To handle pixel imbalance during loss calculation, we integrate the Dice coefficient into the original cross-entropy loss function. Experimental results demonstrate that our enhanced SegNet achieves remarkable improvements in mIoU for non-steel and steel crack segmentation tasks, reaching 82.37% and 77.26%, respectively. Our approach outperforms state-of-the-art methods in both inference speed and accuracy.
Supported by the National Natural Science Foundation of China (No. 61976247) and Chongqing Traffic Science and Technology Project(No.CQJT2022ZC05).
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Abdel-Qader, I., Abudayyeh, O., Kelly, M.E.: Analysis of edge-detection techniques for crack identification in bridges. J. Comput. Civil Eng. 17(4), 255–263 (2013)
Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39(12), 2481–2495 (2017)
Cao, H., et al.: Swin-Unet: unet-like pure transformer for medical image segmentation. In: European Conference on Computer Vision, pp. 205–218. Springer (2022). https://doi.org/10.1007/978-3-031-25066-8_9
Carr, T.A., Jenkins, M.D., Iglesias, M.I., Buggy, T., Morison, G.: Road crack detection using a single stage detector based deep neural network. In: 2018 IEEE Workshop on Environmental, Energy, and Structural Monitoring Systems (EESMS), pp. 1–5. IEEE (2018)
Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818 (2018)
Chen, T., et al.: Pavement crack detection and recognition using the architecture of SegNet. J. Ind. Inf. Integr. 18, 100144 (2020)
Chong, W.-K., Low, S.-P.: Assessment of defects at construction and occupancy stages. J. Perform. Constr. Facil. 19(4), 283–289 (2005)
Delagnes, P., Barba, D.: A markov random field for rectilinear structure extraction in pavement distress image analysis. In: Proceedings of International Conference on Image Processing, vol. 1, pp. 446–449. IEEE (1995)
Jin, T., Li, Z., Ding, Y., Ma, S., Ou, Y.: Bridge crack library. In: Harvard Dataverse (2021)
Jin, X., et al.: Development of nanomodified self-healing mortar and a u-net model based on semantic segmentation for crack detection and evaluation. Construct. Build. Mater. 365, 129985 (2023)
Lei, B., Wang, N., Pengcheng, X., Song, G.: New crack detection method for bridge inspection using UAV incorporating image processing. J. Aerosp. Eng. 31(5), 04018058 (2018)
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3431–3440 (2015)
Munawar, H.S., Hammad, A.W.A., Haddad, A., Pereira Soares, C.A., Waller, S.T.: Image-based crack detection methods: a review. Infrastructures 6(8), 115 (2021)
Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)
Qin, Y., Dong, S., Pang, R., Xia, Z., Zhou, Q., Yang, J.: Design and kinematic analysis of a wall-climbing robot for bridge appearance inspection. In: IOP Conference Series: Earth and Environmental Science, vol. 638, 012062. IOP Publishing (2021)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Song, C., et al.: Pixel-level crack detection in images using SegNet. In: Chamchong, R., Wong, K.W. (eds.) MIWAI 2019. LNCS (LNAI), vol. 11909, pp. 247–254. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-33709-4_22
Woo, S., et al.: ConvNeXt V2: co-designing and scaling convnets with masked autoencoders. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 16133–16142 (2023)
Xu, X., Nguyen, M.C., Yazici, Y., Lu, K., Min, H., Foo, C.-S.: Semi-supervised curvilinear structure segmentation. Semicurv. IEEE Trans. Image Process. 31, 5109–5120 (2022)
Yamaguchi, T., Nakamura, S., Saegusa, R., Hashimoto, S.: Image-based crack detection for real concrete surfaces. IEEJ Trans. Electr. Electron. Eng. 3(1), 128–135 (2008)
Yang, F., Zhang, L., Sijia, Yu., Prokhorov, D., Mei, X., Ling, H.: Feature pyramid and hierarchical boosting network for pavement crack detection. IEEE Trans. Intell. Transp. Syst. 21(4), 1525–1535 (2019)
Zhang, J., Qian, S., Tan, C.: Automated bridge crack detection method based on lightweight vision models. Complex Intell. Syst. 9(2), 1639–1652 (2023)
Zheng, Y., Gao, Y., Lu, S., Mosalam, K.M.: Multistage semisupervised active learning framework for crack identification, segmentation, and measurement of bridges. Comput.-Aided Civil Infrastruct. Eng. 37(9), 1089–1108 (2022)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Pang, R., Tan, H., Yang, Y., Xu, X., Liu, N., Zhang, P. (2024). A Novel SegNet Model for Crack Image Semantic Segmentation in Bridge Inspection. In: Yang, DN., Xie, X., Tseng, V.S., Pei, J., Huang, JW., Lin, J.CW. (eds) Advances in Knowledge Discovery and Data Mining. PAKDD 2024. Lecture Notes in Computer Science(), vol 14647. Springer, Singapore. https://doi.org/10.1007/978-981-97-2259-4_26
Download citation
DOI: https://doi.org/10.1007/978-981-97-2259-4_26
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-2261-7
Online ISBN: 978-981-97-2259-4
eBook Packages: Computer ScienceComputer Science (R0)