Abstract
Deep neural network (DNN) exhibits state-of-the-art performance in many fields including weld defect classification. However, there is still a large room for improving the classification performance over the generic DNN models. In this paper, a unified deep neural network with multi-level features is proposed for weld defect classification. Firstly, we define 11 weld defect features as inputs of our proposed classification model. Not limited to geometric and intensity features, 4 features based on the intensity contrast between weld defect and its background are proposed in this paper. Secondly, we construct a novel deep learning framework: a unified deep neural network, where multi-level features of each hidden layer are fused by the last hidden layer to predict the type of weld defect comprehensively. In addition, we investigate pre-training and fine-turning strategies to get better generalization performance with small dataset. Comparing with other classification methods like SVM and generic DNN model, our framework takes full advantage of multi-level features extracted from each hidden layer, an outstanding performance is shown where the classification accuracy is improved by 3.18% and 4.33% on the test dataset, to reach 91.36%.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ahn, B., Choi, D., Park, J., & Kweon, I. S. (2018). Real-time head pose estimation using multi-task deep neural network. Robotics and Autonomous Systems, 103, 1–12. https://doi.org/10.1016/j.robot.2018.01.005.
Baniukiewicz, P. (2014). Automated defect recognition and identification in digital radiography. Journal of Nondestructive Evaluation, 33(3), 327–334. https://doi.org/10.1007/s10921-013-0216-6.
Da Silva, R. R., & Mery, D. (2007a). The state of the art of weld seam radiographic testing: Part I-image processing. Materials Evaluation, 65(6), 643–647.
Da Silva, R. R., & Mery, D. (2007b). The state of the art of weld seam radiographic testing: Part II-pattern recognition. Materials Evaluation, 65(9), 833–838.
Feng, S., Zhou, H., & Dong, H. (2019). Using deep neural network with small dataset to predict material defects. Materials and Design, 162, 300–310. https://doi.org/10.1016/j.matdes.2018.11.060.
Hinton, G. E., Deng, L., Yu, D., Dahl, G. E., Mohamed, A.-R., Jaitly, N., et al. (2012). Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups. IEEE Signal Processing Magazine, 29(6), 82–97. https://doi.org/10.1109/MSP.2012.2205597.
Hinton, G. E., Osindero, S., & Teh, Y. W. (2006). A fast learning algorithm for deep belief nets. Neural Computation, 18(7), 1527–1554. https://doi.org/10.1162/neco.2006.18.7.1527.
Hinton, G. E., & Salakhutdinov, R. R. (2006). Reducing the dimensionality of data with neural networks. Science, 313(5786), 504–507. https://doi.org/10.1126/science.1127647.
Hou, W., Wei, Y., Guo, J., & Jin, Y. (2018). Automatic detection of welding defects using deep neural network. Journal of Physics Conference Series, 933, 012006. https://doi.org/10.1088/1742-6596/933/1/012006.
Jia, F., Lei, Y., Lin, J., Zhou, X., & Lu, N. (2016). Deep neural networks: A promising tool for fault characteristic mining and intelligent diagnosis of rotating machinery with massive data. Mechanical Systems and Signal Processing, 72, 303–315. https://doi.org/10.1016/j.ymssp.2015.10.025.
Jiang, H., Wang, R., Gao, Z., Gao, J., & Wang, H. (2019). Classification of weld defects based on the analytical hierarchy process and Dempster–Shafer evidence theory. Journal of Intelligent Manufacturing, 30(4), 2013–2024. https://doi.org/10.1007/s10845-017-1369-4.
Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2017). Imagenet classification with deep convolutional neural networks. Communications of the ACM, 60(6), 84–90. https://doi.org/10.1145/3065386.
Lecun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539.
Lecun, Y., Bottou, L., Bengio, Y., & Haffner, P. (1998). Gradient-based learning applied to document recognition. Proceedings of the IEEE, 86(11), 2278–2324. https://doi.org/10.1109/5.726791.
Liao, T. W. (2003). Classification of welding flaw types with fuzzy expert systems. Expert Systems with Applications, 25(1), 101–111. https://doi.org/10.1016/s0957-4174(03)00010-1.
Liao, T. W. (2009). Improving the accuracy of computer-aided radiographic weld inspection by feature selection. NDT and E International, 42(4), 229–239. https://doi.org/10.1016/j.ndteint.2008.11.002.
Mai, G., Cao, K., Yuen, P. C., & Jain, A. K. (2017). Face image reconstruction from deep templates. IEEE Transactions on Pattern Analysis & Machine Intelligence. https://doi.org/10.1109/tpami.2018.2827389.
Mu, W., Gao, J., Jiang, H., Wang, Z., Chen, F., & Dang, C. (2013). Automatic classification approach to weld defects based on PCA and SVM. Insight-Non-Destructive Testing and Condition Monitoring, 55(10), 535–539. https://doi.org/10.1784/insi.2012.55.10.535.
Nacereddine, N., Goumeidane, A. B., & Ziou, D. (2019). Unsupervised weld defect classification in radiographic images using multivariate generalized Gaussian mixture model with exact computation of mean and shape parameters. Computers in Industry, 108, 132–149. https://doi.org/10.1016/j.compind.2019.02.010.
Richardson, F., Reynolds, D., & Dehak, N. (2015). A unified deep neural network for speaker and language recognition. In Conference of the international speech communication association (Vol. 1–5, pp. 1146–1150).
Schmidhuber, J. (2015). Deep learning in neural networks: An overview. Neural Networks, 61, 85–117. https://doi.org/10.1016/j.neunet.2014.09.003.
Shen, Q., Gao, J., & Li, C. (2010). Automatic classification of weld defects in radiographic images. Insight-Non-Destructive Testing and Condition Monitoring, 52(3), 134–139. https://doi.org/10.1784/insi.2010.52.3.134.
Vilar, R., Zapata, J., & Ruiz, R. (2009). An automatic system of classification of weld defects in radiographic images. NDT and E International, 42(5), 467–476. https://doi.org/10.1016/j.ndteint.2009.02.004.
Wang, Y., & Guo, H. (2014). Weld defect detection of X-ray images based on support vector machine. IETE Technical Review, 31(2), 137–142. https://doi.org/10.1080/02564602.2014.892739.
Wang, L., Lu, H., Ruan, X., & Yang, M. (2015). Deep networks for saliency detection via local estimation and global search. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 3183–3192). https://doi.org/10.1109/cvpr.2015.7298938.
Yao, Z., Li, J., Guan, Z., Ye, Y., & Chen, Y. (2020). Liver disease screening based on densely connected deep neural networks. Neural Networks, 123, 299–304. https://doi.org/10.1016/j.neunet.2019.11.005.
Yuan, X., Huang, B., Wang, Y., Yang, C., & Gui, W. (2018). Deep learning-based feature representation and its application for soft sensor modeling with variable-wise weighted SAE. IEEE Transactions on Industrial Informatics, 14(7), 3235–3243. https://doi.org/10.1109/TII.2018.2809730.
Zapata, J., Vilar, R., & Ruiz, R. (2012). Automatic inspection system of welding radiographic images based on ANN under a regularisation process. Journal of Nondestructive Evaluation, 31(1), 34–45. https://doi.org/10.1007/s10921-011-0118-4.
Zhang, P., Wang, D., Lu, H., Wang, H., & Ruan, X. (2017). Amulet: Aggregating multi-level convolutional features for salient object detection. In Proceedings of the IEEE international conference on computer vision (pp. 202–211). https://doi.org/10.1109/iccv.2017.31.
Zhao, R., Ouyang, W., Li, H., & Wang, X. (2015). Saliency detection by multi-context deep learning. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1265–1274). https://doi.org/10.1109/cvpr.2015.7298731.
Acknowledgements
This work was supported by the National Key Research and Development Program of China (2017YFF0210502), Natural Science Basic Research Plan in Shanxi Province of China (Program No. 2019JM-214) and the Service Quality Assessment and Management of Pressure Vessels in Process Industry (3211000781). Great thanks to Dongfang Turbine Co., Ltd. for providing the practical image datasets.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Electronic supplementary material
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Yang, L., Jiang, H. Weld defect classification in radiographic images using unified deep neural network with multi-level features. J Intell Manuf 32, 459–469 (2021). https://doi.org/10.1007/s10845-020-01581-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10845-020-01581-2