Abstract
A complete set of engineering blueprints often contains a wealth of design experience and a profound comprehension of the structure from the designers. Consequently, the analysis and study of the visual data contained in these blueprints are vital. Structure feature extraction refers to extracting the external contour lines and internal structure layout of the target structure from engineering blueprints. This study proposes the Edge Detection-based and multi-conditional filtering method (EDMFM), an innovative method utilizing Computer Vision Technology. The EDMFM uses image processing techniques to optimize traditional manual extraction methods, which rely heavily on keying software to remove the background of the image, with the disadvantage of time-consuming, labor-intensive and imprecise extraction results. Additionally, this study conducts a qualitative and quantitative analysis of the extraction results from three aspects, followed by ablation experiments on the functional modules of the proposed method. The experimental results demonstrate that the proposed method exhibits good applicability in extracting key structural features from blueprint images, providing a foundation for further exploration and analysis of structural features at an advanced level.
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-023-02952-x/MediaObjects/11760_2023_2952_Fig1_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-023-02952-x/MediaObjects/11760_2023_2952_Fig2_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-023-02952-x/MediaObjects/11760_2023_2952_Fig3_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-023-02952-x/MediaObjects/11760_2023_2952_Fig4_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-023-02952-x/MediaObjects/11760_2023_2952_Fig5_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-023-02952-x/MediaObjects/11760_2023_2952_Fig6_HTML.png)
![](http://media.springernature.com/m312/springer-static/image/art%3A10.1007%2Fs11760-023-02952-x/MediaObjects/11760_2023_2952_Fig7_HTML.png)
Similar content being viewed by others
Data availability
The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.
References
O’Mahony, N., Campbell, S., Carvalho, A., Harapanahalli, S., Hernandez, G.V., Krpalkova, L., Riordan, D., Walsh, J.: Deep learning versus traditional computer vision. In: Advances in computer vision: proceedings of the 2019 computer vision conference (CVC), pp. 128–144 (2020). https://doi.org/10.1007/978-3-030-17795-9_10
Zhang, X., Peng, J., He, K., Gao, X.: Nondestructive inspection of holes with distinct spacing in plate using the moving mode of induction thermography. Infrared Phys. Technol. 122, 104045 (2022). https://doi.org/10.1016/j.infrared.2022.104045
Wang, Z., Lei, X., Gao, W.: Study on SDR extraction of ring weld defects of pipeline. Weld. World 66, 1645–1652 (2022). https://doi.org/10.1007/s40194-022-01323-3
Wang, W., Li, L., Zhang, F.: Crack image recognition on fracture mechanics cross valley edge detection by fractional differential with multi-scale analysis. SIViP 17, 47–55 (2023). https://doi.org/10.1007/s11760-022-02202-6
Zhang, J., Zhu, Q., Song, F., Zhang, L., Wang, J., Liu, C.: Multi-scale edge detection of crack in extra-high arch dam based on orthogonal wavelet construction. Traitement du Sig. 39, 977–989 (2022). https://doi.org/10.18280/ts.390325
Hu, T., Yuan, J., Zhou, X., Ran, M.: A two-dimensional entropy-based method for detecting the degree of segregation in asphalt mixture. Constr. Build. Mater. 347, 128450 (2022). https://doi.org/10.1016/j.conbuildmat.2022.128450
Luo, K., Chen, L., Liang, W., Weng, H.: A dual-scale morphological filtering method for composite damage identification using FBP. Mech. Syst. Signal Process. 184, 109683 (2023). https://doi.org/10.1016/j.ymssp.2022.109683
Cha, Y.J., You, K., Choi, W.: Vision-based detection of loosened bolts using the Hough transform and support vector machines. Autom. Constr. 71, 181–188 (2016). https://doi.org/10.1016/j.autcon.2016.06.008
Ramana, L., Choi, W., Cha, Y.J.: Fully automated vision-based loosened bolt detection using the Viola–Jones algorithm. Struct. Health Monit. 18, 422–434 (2019). https://doi.org/10.1177/1475921718757459
Cha, Y.J., Choi, W., Suh, G., Mahmoudkhani, S., Büyüköztürk, O.: Autonomous structural visual inspection using region-based deep learning for detecting multiple damage types. Comput. Aided Civil Infrastruct. Eng. 33, 731–747 (2018). https://doi.org/10.1111/mice.12334
Zhou, Q., Qu, Z., Ju, F.R.: A multi-scale learning method with dilated convolutional network for concrete surface cracks detection. IET Image Proc. 16, 1389–1402 (2022). https://doi.org/10.1049/ipr2.12417
Li, Y., Chai, G., Wang, Y., Lei, L., Zhang, X.: Ace r-cnn: an attention complementary and edge detection-based instance segmentation algorithm for individual tree species identification using uav rgb images and lidar data. Remote Sens. 14, 3035 (2022). https://doi.org/10.3390/rs14133035
Dey, S., Roychoudhury, R., Malakar, S., Sarkar, R.: Screening of breast cancer from thermogram images by edge detection aided deep transfer learning model. Multimed Tools Appl 81, 9331–9349 (2022). https://doi.org/10.1007/s11042-021-11477-9
Zhu, J., Zhong, J., Ma, T., Huang, X., Zhang, W., Zhou, Y.: Pavement distress detection using convolutional neural networks with images captured via UAV. Autom. Constr. 133, 103991 (2022). https://doi.org/10.1016/j.autcon.2021.103991
Xiong, F., Xu, C., Ren, W., Zheng, R., Gong, P., Ren, Y.: A blockchain-based edge collaborative detection scheme for construction internet of things. Autom. Constr. 134, 104066 (2022). https://doi.org/10.1016/j.autcon.2021.104066
Suárez, I., Buenaposada, J.M., Baumela, L.: ELSED: enhanced line SEgment drawing. Pattern Recogn. 127, 108619 (2022). https://doi.org/10.1016/j.patcog.2022.108619
Wang, X., Wang, S., Guo, Y., Hu, K., Wang, W.: Coal gangue image segmentation method based on edge detection theory of star algorithm. Int. J. Coal Prep. Util. 43, 119–134 (2023). https://doi.org/10.1080/19392699.2021.2024173
You, X., Yan, G., Yang, Z.: Intelligent edge computing detection vehicle and detection method based on tunnel lining concrete. Int. Trans. Electr. Energy Syst. 2022, 1–13 (2022). https://doi.org/10.1155/2022/1837800
Cha, Y.J., Choi, W., Büyüköztürk, O.: Deep learning-based crack damage detection using convolutional neural networks. Comput. Aided Civil. Infrastruct. Eng. 32, 361–378 (2017). https://doi.org/10.1111/mice.12263
Gonzales, R.C., Woods, R.E.: Digital image processing, 4th edn. Pearson, New York (2018)
Kelishadrokhi, M.K., Ghattaei, M., Fekri-Ershad, S.: Innovative local texture descriptor in joint of human-based color features for content-based image retrieval. SIViP 17, 4009–4017 (2023). https://doi.org/10.1007/s11760-023-02631-x
Ziou, D., Tabbone, S.: Edge detection techniques-an overview. Pattern Recognit. Image Anal. C/C Raspozn. Obrazov I Analiz Izobrazhenii 8, 537–559 (1998)
Jing, J., Liu, S., Wang, G., Zhang, W., Sun, C.: Recent advances on image edge detection: a comprehensive review. Neurocomputing 503, 259–271 (2022). https://doi.org/10.1016/j.neucom.2022.06.083
Van Heesch, D.: Image processing in OpenCV. https://docs.opencv.org/4.1.2/d2/d96/tutorial_py_table_of_contents_imgproc.html. Accessed 20 May 2022
Jeffrey A.: Pillow (PIL Fork) 10.1.0 documentation. Fredrik Lundh. https://pillow.readthedocs.io/en/stable/handbook/overview.html#image-processing. Accessed 26 May 2022
Sobel, I., Feldman, G.: A 3x3 isotropic gradient operator for image processing. A talk at the Stanford Artificial Project in, pp 271–272 (1968)
Ben Chaabane, S., Bushnag, A.: Color edge detection using multidirectional Sobel filter and fuzzy fusion. Cmc-Comput. Mater. Cont 74, 2839–2852 (2023). https://doi.org/10.32604/cmc.2023.032760
China Communications Press Co.,Ltd.: Specifications for Design of Highway Steel Bridge: JTG D64–2015. http://www.jtysbz.cn:8009/pdf/viewer/1122438120d37. Accessed 21 Nov 2023
Yang, D., Peng, B., Al-Huda, Z., Malik, A., Zhai, D.: An overview of edge and object contour detection. Neurocomputing 488, 470–493 (2022). https://doi.org/10.1016/j.neucom.2022.02.079
Otsu, N.: A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9, 62–66 (1979). https://doi.org/10.1109/TSMC.1979.4310076
Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European conference on computer vision (ECCV), pp. 801–818 (2018). https://doi.org/10.1007/978-3-030-01234-2_49
Funding
This work was supported by the Postgraduate Research and Practice Innovation Program of Jiangsu Province (Grant No. KYCX22_3289). The authors would like to appreciate Mr. Pang Xiangrun for providing bridge design blueprints that were used in this study.
Author information
Authors and Affiliations
Contributions
ZY designed and conducted the study, processed the experimental data, and wrote the original draft. DW collected the data, analyzed the experimental results, and contributed to writing—review and editing. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflicts of financial or non-financial interest that may have appeared to influence the work reported in this study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
You, Z., Wang, D. An extraction method for structural features based on edge detection and multi-conditional filtering: a case study of the steel box girder from engineering blueprints. SIViP 18, 2819–2828 (2024). https://doi.org/10.1007/s11760-023-02952-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-023-02952-x