Skip to main content
SpringerLink
Log in

Multiscale image quality measures for defect detection in thin films

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

Manufacturing defects in flat surface products such as thin films, paper, foils, aluminum plates, steel slabs, fabrics, and glass sheets result in degradation of the visual quality of the product image. This leads to less satisfied customers, waste of material, and bad company reputation. This research presents a novel application of image visual quality measures such as the multiscale structural similarity index (MS-SSIM). A novel algorithm has been implemented for fast detection and location of defects in many flat surface products. Comparison of the proposed algorithm with the state-of-the-art approaches indicate promising results. A defect detection accuracy of 99.1 % has been achieved with 98.62 % precision, 97.7 % recall/sensitivity, and 100 % specificity. The discriminant power shows how well the MS-SSIM discriminates very effectively between normal and abnormal surfaces. The MS-SSIM has resulted in much better performance than the single-scale SSI approach but at the cost of relatively lower processing speed. The major advantages of the presented approach are as follows: scale invariance, avoiding the problem of parameter selection in the case of the state-of-the-art Gabor filter banks based approach, the higher detection accuracy, and the quasi real-time processing speed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Ngan HYT, Pang GKH, Yung NHC (2011) Automated fabric defect detection—a review. Image Vis Comput 29(7):442–458

    Article  Google Scholar 

  2. Tsai D-M, Chen M-C, Li W-C, Chiu W-Y (2012) A fast regularity measure for surface defect detection. Mach Vis Appl 23(5):869–886

    Article  Google Scholar 

  3. Tolba AS, Atwan A, Amanneddine N, Mutawa AM, Khan HA (2010) Defect detection in flat surface products using log-Gabor filters. Int J Hybrid Intell Syst 7(3):187–201

    Google Scholar 

  4. Hamid Alimohamadi, Alireza Ahmadyfard, Esmaeil Shojaee (2009) Defect detection in textiles using morphological analysis of optimal Gabor wavelet filter response. ICCAE, International Conference on Computer and Automation Engineering, pp. 26–30

  5. Kumar A, Member, IEEE, Pang GKH (2002) Defect detection in textured materials using Gabor filters. IEEE Trans Ind Appl 38(2):425–439

    Article  Google Scholar 

  6. K. L. Mak, and P. Peng, Detecting defects in textile fabrics with optimal Gabor filters, in World Academy of Science, Engineering and Technology 13 2008

  7. Mak KL, Peng P, Yiu KFC (2009) Fabric defect detection using morphological filters. Image Vis Comput 27:1585–1592

    Article  Google Scholar 

  8. Tolba AS (2012) A novel multiscale-multidirectional autocorrelation approach for defect detection in homogeneous flat surfaces. Mach Vis Appl 23(4):739–750

    Article  Google Scholar 

  9. Escofet J, Navarro R, Milla’n MS (1998) Detection of local defects in textile webs using Gabor filters. Opt Eng 37(8):2297–2307

    Article  Google Scholar 

  10. K. N. Sivabalan, D. Gnanadurai (2011) Efficient defect detection algorithm for gray level digital images using Gabor wavelet filter and Gaussian filter. Int J Eng Sci Technol (IJEST), Vol. 3 No. 4

  11. V Asha, N U Bhajantri, and P Nagabhushan, Automatic detection of texture defects using texture-periodicity and Gabor wavelets. http:// arxiv.org/pdf/1212.1329

  12. Arivazhagan S, Ganesan L, Bama S (2006) Fault segmentation in fabric images using Gabor wavelet transform. Mach Vis Appl 16(6):356–363

    Article  Google Scholar 

  13. Sajid T, Ali B (2012) Fabric defect detection in textile images using Gabor filter. IOSR J Electric Electron Eng 3(2):33–38

    Article  MathSciNet  Google Scholar 

  14. Narges Heidari, Reza Azmi & Boshra Pishgoo (2011) Fabric textile defect detection, by selecting a suitable subset of wavelet coefficients, through genetic algorithm. Int J Image Process 5(1):701–710

  15. Rashmi S Deshmukh, P R Deshmukh and Abhijit M Taley (2012) Comparison analysis for efficient defect detection algorithm for gray level digital images using median filters Gabor filter and ICA. Int J Adv Res Comput Sci Software Eng 2(1)

  16. Kumar A (2008) Computer vision-based fabric defect detection: a survey. IEEE Trans Ind Electron 55(1):348–363

    Article  Google Scholar 

  17. Tolba AS, Khan HA, Mutawa AM, Alsaleem SM (2010) Decision fusion for visual inspection of textiles. Text Res J 80(19):2094–2106

    Article  Google Scholar 

  18. Mahajan P.M., Kolhe S.R. and Patil P.MA (2009) Review of automatic fabric defect detection techniques. Adv Comput Res 1(2):18–29

  19. Tolba AS (2011) Neighborhood-preserving cross correlation for automated visual inspection of fine-structured textile fabrics. Textile Res 81(19):2033–2012

    Article  Google Scholar 

  20. Shanbhag PM, Deshmukh MP, Suralkar SR (2012) Overview: methods of automatic fabric defect detection. Global J Eng Des Technol 1(2):42–46

    Google Scholar 

  21. R. S. Sabeenian, M. E. Paramasivam, P. M. Dinesh (2012) Computer vision based defect detection and identification in handloom silk fabrics. Int J Comput Applic 42(17):41–48

  22. Mahajan P.M., Kolhe S.R. and Patil P.M. (2009) A review of automatic fabric defect detection techniques. Adv Comput Res 1(2):18–29

  23. Xiem X (2008) A review of recent advances in surface defect detection using texture analysis techniques. Electronic Lett Comput Vision Imag Anal 7(3):1–22

    Google Scholar 

  24. Iivarinen, J., Rauhamaa, J. (1998) Surface inspection of web materials using the self-organizing map. In: Casasent, D.P. (ed.) Proceedings of the SPIE, vol. 3522, Intelligent Robots and Computer Vision XVII: Algorithms, Techniques, and Active Vision, pp. 96–103

  25. Turtinen M, Pietik¨ainen M and Silven O (2005) Visual characterization of paper using isomap and local binary patterns, MVA2005 IAPR Conference on Machine VIsion Applications, pp. 210–213, May 16–18, Tsukuba Science City, Japan

  26. Iivarinen J and Pakkanen J (2002) Content-based retrieval o defect images, Proceedings of ACIVS 2002 (Advanced Concepts for Intelligent Vision Systems), Ghent, Belgium, September 9–11

  27. Shubo, Q, Shuai, G, Tongxing, Z. Research on paper defects recognition based on SVM, 2010 WASE Int Conference Inform Eng

  28. Rauhamaa J, and Reinius, R. Paper web imaging with advanced defect classification, TAPPI Paper Sumit 2002

  29. Zhai M, Shan F, Shimin G, Xie Z, Luo X (2011) Defect detection in aluminum foil by measurement-residual-based chi-square detector. Int J Adv Manuf Technol 53:661–667

    Article  Google Scholar 

  30. Lin S-W, Chou S-Y, Chen S-C (2006) Irregular shapes classification by back-propagation neural networks. Int J Adv Manuf Technol. doi:10.1007/s00170-006-0667-3

    Google Scholar 

  31. Jia H, Murphey Y L, Shi J, Chang T-S. (2004) An intelligent real-time vision system for surface defect detection, ICPR (3):239–242

  32. Wu Xiu-yong, Xu Ke and Xu Jin-wu (2008) Application of undecimated wavelet transform to surface defect detection of hot rolled steel plates, 2008 Congress on Image and Signal Processing

  33. Liu Weiwei, Yan Yunhui, Li Jun, Zhang Yao, Sun Hongwei (2008) Automated on-line fast detection for surface defect of steel strip based on multivariate discriminant function second international symposium on intelligent information technology application. IEEE

  34. Mohammad Reza Yazdchi, Arash Golibagh Mahyari, Ali Nazeri, Detection and Classification of Surface Defects of Cold Rolling Mill Steel Using Morphology and Neural Network, CIMCA 2008, IAWTIC 2008, and ISE 2008

  35. Jia H, Murphey Y L, Shi J, Chang T-S. An intelligent real-time vision system for surface defect detection, proceedings of the 17th International Conference on Pattern Recognition (ICPR’04)

  36. Gamage P, Xie S (2008) A real-time vision system for defect inspection in cast extrusion manufacturing process. Int J Adv Manuf Technol 40:144–156

    Article  Google Scholar 

  37. Johnson, J T Defect and thickness inspection system for cast thin films using machine vision and full-field transmission densitometry, MSc. Thesis, School of George W. Woodruff School of Mechanical Engineering Georgia Institute of Technology, December 2009

  38. Young- Geun Y, Seok Lyong L, Chin-Wan C, Sang Hee K (2008) An effective defect inspection system for polarized film images using image segmentation and template matching techniques. Comput Ind Eng 5:567–583

    Google Scholar 

  39. Shang X (2006) Structural similarity based image quality assessment: pooling strategies and applications to image compression and digit recognition. M.Sc. Thesis Presented to the Faculty of the Graduate School of The University of Texas at Arlington, August

    Google Scholar 

  40. Z. Wang and A. C. Bovik (2006) Modern image quality assessment. Morgan and Claypool

  41. Zhou Wang1, Eero P. Simoncelli1 and Alan C. Bovik (2003) Multi-scale structural similarity for image quality assessment, Proceedings of the 37th IEEE Asilomar conference on signals, systems and computers, Pacific Grove, CA, Nov. 9–12

  42. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, “Image quality assessment: From error measurement to structural similarity,” IEEE Trans. Image Processing, vol. 13, Jan. 2004

  43. Gonzalez RC, Woods RE (1992) Digital image processing. Addison-Wesley, New York

    Google Scholar 

  44. Donoho DL (1995) De-noising by soft-thresholding. IEEE Trans Inf Theory 41(3):613–662

    Article  MathSciNet  MATH  Google Scholar 

  45. D. G. Altman and J. M. Bland (1994) Statistics notes: diagnostic tests. 1: Sensitivity and specificity. BMJ 308(6943):1552

  46. Lu Z et al (2004) Predicting subcellular localization of proteins using machine-learned classifiers. Bioinformatics 20(4):547–556

    Article  Google Scholar 

  47. R. Eisner et al. (2005) Improving protein function prediction using the hierarchical structure of the gene ontology, IEEE Symposium on Computational Intelligence in Bioinformatics and Computational Biology

  48. Sokolova M, Japkowicz N, Szpakowicz S (2006) Beyond accuracy, F-score and ROC: a family of discriminant measures for performance evaluation. Australian conference on artificial intelligence, Vol. 4304. LNCS, Germany, pp: 1015–1021

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Mansoura University, Mansoura, Egypt

    A. S. Tolba

  2. Computer Science Department, Kuwait University, Kuwait, Kuwait

    Hazem M. Raafat

Authors
  1. A. S. Tolba
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hazem M. Raafat
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. S. Tolba.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tolba, A.S., Raafat, H.M. Multiscale image quality measures for defect detection in thin films. Int J Adv Manuf Technol 79, 113–122 (2015). https://doi.org/10.1007/s00170-014-6758-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-014-6758-7

Keywords

Search

Navigation