Skip to main content
SpringerLink
Log in

Automated steel surface defect detection and classification using a new deep learning-based approach

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

In this study, a new deep learning-based approach has been developed that detects and classifies surface defects that occur in the steel production process. The proposed methodology was created in four steps. In the first step, a deep learning model is designed that trains the residual and attention structures in parallel, thus increasing the classification performance. In the second step, deep features were extracted from the Parallel Attention Residual-Convolutional Neural Network model. The extracted features in the third step were selected by a new and simple algorithm (NCA-ReliefF Matched Index) based on matching the indexes obtained from the Neighborhood Component Analysis and Relief algorithms. In the last process, classification was done with the support vector machine algorithm. The proposed methodology was used for dual and multi-class classification tasks and evaluated on a dataset in the Kaggle database named Severstal: Steel Defect Detection.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Data availability

The datasets generated during and/or analyzed during the current study are available in the Severstal: Steel Defect Detection repository, [https://www.kaggle.com/c/severstal-steel-defect-detection/overview].

References

  1. Zhang D, Song K, Xu J et al (2021) MCnet: multiple context information segmentation network of no-service rail surface defects. IEEE Trans Instrum Meas 70:1–9. https://doi.org/10.1109/TIM.2020.3040890

    Article  Google Scholar 

  2. Hanbay K, Talu MF, Özgüven ÖF (2016) Fabric defect detection systems and methods—a systematic literature review. Optik (Stuttg) 127:11960–11973. https://doi.org/10.1016/j.ijleo.2016.09.110

    Article  Google Scholar 

  3. Zhao W, Chen F, Huang H et al (2021) A new steel defect detection algorithm based on deep learning. Comput Intell Neurosci. https://doi.org/10.1155/2021/5592878

    Article  Google Scholar 

  4. Dong H, Song K, He Y et al (2020) PGA-Net: pyramid feature fusion and global context attention network for automated surface defect detection. IEEE Trans Ind Inform 16:7448–7458. https://doi.org/10.1109/TII.2019.2958826

    Article  Google Scholar 

  5. Cao J, Yang G, Yang X (2021) A pixel-level segmentation convolutional neural network based on deep feature fusion for surface defect detection. IEEE Trans Instrum Meas 70:1–12. https://doi.org/10.1109/TIM.2020.3033726

    Article  Google Scholar 

  6. Konovalenko I, Maruschak P, Brezinová J et al (2020) Steel surface defect classification using deep residual neural network. Metals (Basel) 10:1–15. https://doi.org/10.3390/met10060846

    Article  Google Scholar 

  7. den Bakker I (2007) Python deep learning cookbook: over 75 practical recipes on neural network modeling, reinforcement learning, and transfer learning using Python. Packt Publishing Ltd, Birmingham

    Google Scholar 

  8. Martins LAO, Pádua FLC, Almeida PEM (2010) Automatic detection of surface defects on rolled steel using computer vision and artificial neural networks. In: IECON proceedings (Industrial Electronics Conference). IEEE, pp 1081–1086

  9. Liu YC, Hsu YL, Sun YN et al (2010) A computer vision system for automatic steel surface inspection. In: Proceedings of the 2010 5th IEEE conference on ındustrial electronics and applications, ICIEA 2010. IEEE, pp 1667–1670

  10. Suvdaa B, Ahn J, Ko J (2012) Steel surface defects detection and classification using SIFT and voting strategy. Int J Softw Eng its Appl 6:161–166

    Google Scholar 

  11. Yi L, Li G, Jiang M (2017) An end-to-end steel strip surface defects recognition system based on convolutional neural networks. Steel Res Int 88:176–187. https://doi.org/10.1002/srin.201600068

    Article  Google Scholar 

  12. Zhao YJ, Yan YH, Song KC (2017) Vision-based automatic detection of steel surface defects in the cold rolling process: considering the influence of industrial liquids and surface textures. Int J Adv Manuf Technol 90:1665–1678. https://doi.org/10.1007/s00170-016-9489-0

    Article  Google Scholar 

  13. Li J, Su Z, Geng J, Yin Y (2018) Real-time detection of steel strip surface defects based on improved YOLO detection network. IFAC-PapersOnLine 51:76–81. https://doi.org/10.1016/j.ifacol.2018.09.412

    Article  Google Scholar 

  14. Fu G, Sun P, Zhu W et al (2019) A deep-learning-based approach for fast and robust steel surface defects classification. Opt Lasers Eng 121:397–405. https://doi.org/10.1016/j.optlaseng.2019.05.005

    Article  Google Scholar 

  15. Liu Y, Xu K, Xu J (2019) Periodic surface defect detection in steel plates based on deep learning. Appl Sci 9:3127. https://doi.org/10.3390/app9153127

    Article  Google Scholar 

  16. Liu Y, Yuan Y, Balta C, Liu J (2020) A light-weight deep-learning model with multi-scale features for steel surface defect classification. Materials (Basel) 13:1–13. https://doi.org/10.3390/ma13204629

    Article  Google Scholar 

  17. Guan S, Lei M, Lu H (2020) A steel surface defect recognition algorithm based on improved deep learning network model using feature visualization and quality evaluation. IEEE Access 8:49885–49895. https://doi.org/10.1109/ACCESS.2020.2979755

    Article  Google Scholar 

  18. Amin D, Akhter S (2020) Deep learning-based defect detection system in steel sheet surfaces. In: 2020 IEEE region 10 symposium, TENSYMP 2020. IEEE, pp 444–448

  19. Severstal: Steel Defect Detection. https://www.kaggle.com/c/severstal-steel-defect-detection/overview

  20. Wang S, Xia X, Ye L, Yang B (2021) Automatic detection and classification of steel surface defect using deep convolutional neural networks. Metals (Basel) 11:1–23. https://doi.org/10.3390/met11030388

    Article  Google Scholar 

  21. Demir F, Akbulut Y (2022) A new deep technique using R-CNN model and L1NSR feature selection for brain MRI classification. Biomed Signal Process Control 75:103625. https://doi.org/10.1016/j.bspc.2022.103625

    Article  Google Scholar 

  22. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: Advances in neural information processing systems. pp 1097–1105

  23. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Preprint http://arxiv.org/abs/14091556

  24. Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shift. In: 32nd Int Conf Mach Learn ICML 2015, vol 1, pp 448–456

  25. Santurkar S, Tsipras D, Ilyas A, Mądry A (2018) How does batch normalization help optimization? In: Proceedings of the 32nd international conference on neural information processing systems, pp 2488–2498

  26. Agarap AF (2018) Deep learning using rectified linear units (relu). arXiv Prepr arXiv180308375

  27. Weng L, Zhang H, Chen H, et al (2018) Towards fast computation of certified robustness for relu networks. In: International conference on machine learning. PMLR, pp 5276–5285

  28. Liang X, Wang X, Lei Z, et al (2017) Soft-margin softmax for deep classification. In: International conference on neural ınformation processing, pp 413–421

  29. Zang F, Zhang J (2011) Softmax discriminant classifier. In: 2011 third ınternational conference on multimedia ınformation networking and security, pp 16–19

  30. Atila O, Şengür A (2021) Attention guided 3D CNN-LSTM model for accurate speech based emotion recognition. Appl Acoust 182:108260. https://doi.org/10.1016/j.apacoust.2021.108260

    Article  Google Scholar 

  31. Niu Z, Zhong G, Yu H (2021) A review on the attention mechanism of deep learning. Neurocomputing 452:48–62. https://doi.org/10.1016/j.neucom.2021.03.091

    Article  Google Scholar 

  32. Abdelaziz Ismael SA, Mohammed A, Hefny H (2020) An enhanced deep learning approach for brain cancer MRI images classification using residual networks. Artif Intell Med 102:101779. https://doi.org/10.1016/j.artmed.2019.101779

    Article  Google Scholar 

  33. Baygin M, Yaman O, Tuncer T et al (2021) Automated accurate schizophrenia detection system using Collatz pattern technique with EEG signals. Biomed Signal Process Control 70:102936. https://doi.org/10.1016/j.bspc.2021.102936

    Article  Google Scholar 

  34. Tuncer T, Dogan S, Subasi A (2021) EEG-based driving fatigue detection using multilevel feature extraction and iterative hybrid feature selection. Biomed Signal Process Control 68:102591. https://doi.org/10.1016/j.bspc.2021.102591

    Article  Google Scholar 

  35. Turkoglu M (2021) COVIDetectioNet: COVID-19 diagnosis system based on X-ray images using features selected from pre-learned deep features ensemble. Appl Intell 51:1213–1226. https://doi.org/10.1007/s10489-020-01888-w

    Article  Google Scholar 

  36. Tuncer T, Ertam F (2020) Neighborhood component analysis and reliefF based survival recognition methods for Hepatocellular carcinoma. Phys A Stat Mech its Appl 540:123143. https://doi.org/10.1016/j.physa.2019.123143

    Article  MATH  Google Scholar 

  37. Demir F, Taşcı B (2021) An effective and robust approach based on R-CNN+LSTM model and NCAR feature selection for ophthalmological disease detection from fundus images. J Pers Med 11:1276. https://doi.org/10.3390/jpm11121276

    Article  Google Scholar 

  38. Robnik-Šikonja M, Kononenko I (2003) Theoretical and empirical analysis of ReliefF and RReliefF. Mach Learn 53:23–69

    Article  MATH  Google Scholar 

  39. Fadli VF, Herlistiono IO (2020) Steel surface defect detection using deep learning. Int J Innov Sci Res Technol 5:244–250. https://doi.org/10.38124/ijisrt20jul240

    Article  Google Scholar 

  40. Guo X, Liu X, Królczyk G et al (2022) Damage detection for conveyor belt surface based on conditional cycle generative adversarial network. Sensors 22:3485. https://doi.org/10.3390/s22093485

    Article  Google Scholar 

  41. Song K, Yan Y (2013) A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects. Appl Surf Sci 285:858–864. https://doi.org/10.1016/j.apsusc.2013.09.002

    Article  Google Scholar 

  42. Yeung CC, Lam KM (2022) Efficient fused-attention model for steel surface defect detection. IEEE Trans Instrum Meas. https://doi.org/10.1109/TIM.2022.3176239

    Article  Google Scholar 

  43. Tian S, Huang P, Ma H, et al (2022) CASDD: Automatic surface defect detection using a complementary adversarial network. IEEE Sens J

Download references

Author information

Authors and Affiliations

  1. Mechatronics Engineering Department, Technology Faculty, Firat University, Elazig, Turkey

    Kursat Demir, Mustafa Ay & Mehmet Cavas

  2. Vocational School of Technical Sciences, Electronic and Automation Department, Firat University, Elazig, Turkey

    Fatih Demir

Authors
  1. Kursat Demir
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mustafa Ay
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mehmet Cavas
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Fatih Demir
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Fatih Demir.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict to interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Appendix

Appendix

See Table

Table 9 Layers info the PAR-CNN model
Full size table

9.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Demir, K., Ay, M., Cavas, M. et al. Automated steel surface defect detection and classification using a new deep learning-based approach. Neural Comput & Applic 35, 8389–8406 (2023). https://doi.org/10.1007/s00521-022-08112-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-022-08112-5

Keywords

Search

Navigation