Journal of Intelligent Manufacturing

, Volume 30, Issue 3, pp 1047–1055 | Cite as

Automatic inspection of salt-and-pepper defects in OLED panels using image processing and control chart techniques

  • Jueun Kwak
  • Ki Bum Lee
  • Jaeyeon Jang
  • Kyong Soo Chang
  • Chang Ouk KimEmail author


In the manufacture of flat display panels, salt-and-pepper defects are caused by a malfunction in the chemical process. The defects are characterized by the dispersion of many black and white pixels in the display panels; these pixels are difficult to detect with conventional automatic fault detection methods that specialize in recognizing certain shapes, such as line or mura defects (stains). This study proposes a simple but high-performance salt-and-pepper defect detection method. First, the background image of the original image is generated using the mean filter in the spatial domain to create a noise image, which is the subtraction of the two images. A binary image is then obtained from the noise image to count the defective pixels, and a statistical control chart that monitors the number of defective pixels identifies the panel defects. Two experiments were conducted with images collected from an organic light-emitting diode inspection process, and the proposed method showed excellent performance with respect to classification accuracy and processing time.


Automated visual inspection Flat panel display Salt-and-pepper defect Image processing technique Statistical control chart 



This work was supported in part by Samsung Display Co., Ltd., South Korea, by the Technology Innovation Program (10045913, Development of Big Data-Based Analysis and Control Platform for Semiconductor Manufacturing Plants) funded by the Ministry of Trade, Industry & Energy (MOTIE, South Korea), by the National Research Foundation (NRF) of Korea Grant funded by the Korean government (MSIP) (NRF-2016R1A2B4008337), and by the Global PhD Fellowship Program through the NRF of Korea funded by the Ministry of Education (NRF-2015H1A2A1031081).


  1. Agarwal, K., & Shivpuri, R. (2015). On line prediction of surface defects in hot bar rolling based on Bayesian hierarchical modeling. Journal of Intelligent Manufacturing, 26(4), 785–800. doi: 10.1007/s10845-013-0834-y.CrossRefGoogle Scholar
  2. Ahmed, N., Natarajan, T., & Rao, K. R. (1974). Discrete cosine transform. IEEE Transactions on Computers, C–23(1), 90–93. doi: 10.1109/T-C.1974.223784.CrossRefGoogle Scholar
  3. Armitage, D., Underwood, I., & Wu, S. T. (2006). Introduction to microdisplays (Vol. 11). Chichester: Wiley.CrossRefGoogle Scholar
  4. Burrus, C. S., Gopinath, R. A., & Guo, H. (1997). Introduction to wavelets and wavelet transforms: A primer. Upper Saddle River, NJ: Prentice Hall.Google Scholar
  5. Chang, C., Li, C., Chang, Y., & Jeng, M. (2011). Wafer defect inspection by neural analysis of region features. Journal of Intelligent Manufacturing, 22(6), 953–964. doi: 10.1007/s10845-009-0369-4.CrossRefGoogle Scholar
  6. Chen, L., & Kuo, C. (2008). Automatic TFT-LCD mura defect inspection using discrete cosine transform-based background filtering and ’just noticeable difference’ quantification strategies. Measurement Science and Technology, 19(1), 015507. doi: 10.1088/0957-0233/19/1/015507.CrossRefGoogle Scholar
  7. Chen, S., & Chang, J. (2008). TFT-LCD mura defects automatic inspection system using linear regression diagnostic model. Proceedings of the Institution of Mechanical Engineers, Part B: Journal of Engineering Manufacture, 222(11), 1489–1501. doi: 10.1243/09544054JEM1067.CrossRefGoogle Scholar
  8. Chen, S., & Chou, S. (2008). TFT-LCD mura defect detection using wavelet and cosine transforms. Journal of Advanced Mechanical Design, Systems, and Manufacturing, 2(3), 441–453. doi: 10.1299/jamdsm.2.441.CrossRefGoogle Scholar
  9. Chen, S., & Perng, D. (2014). Automatic optical inspection system for IC molding surface. Journal of Intelligent Manufacturing, 27, 1–12. doi: 10.1007/s10845-014-0924-5.CrossRefGoogle Scholar
  10. Fabijańska, A., & Sankowski, D. (2009). Computer vision system for high temperature measurements of surface properties. Machine Vision and Applications, 20(6), 411–421. doi: 10.1007/s00138-008-0135-1.CrossRefGoogle Scholar
  11. Fan, S. S., & Chuang, Y. (2010). Automatic detection of mura defect in TFT-LCD based on regression diagnostics. Pattern Recognition Letters, 31(15), 2397–2404. doi: 10.1016/j.patrec.2010.07.013.CrossRefGoogle Scholar
  12. Kim, W. S., Kwak, D. M., Song, Y. C., Choi, D. H., & Park, K. H. (2004). Detection of spot-type defects on liquid crystal display modules. Key Engineering Materials, 270–273, 808–813.CrossRefGoogle Scholar
  13. Kwak, J., Lee, T., & Kim, C. O. (2015). An incremental clustering-based fault detection algorithm for class-imbalanced process data. IEEE Transactions on Semiconductor Manufacturing, 28(3), 318–328. doi: 10.1109/TSM.2015.2445380.CrossRefGoogle Scholar
  14. Li, W., & Tsai, D. (2011). Defect inspection in low-contrast LCD images using Hough transform-based nonstationary line detection. IEEE Transactions on Industrial Informatics, 7(1), 136–147. doi: 10.1109/TII.2009.2034844.CrossRefGoogle Scholar
  15. Lissner, I., & Urban, P. (2010). How perceptually uniform can a hue linear color space be? In 18th Color and imaging conference (Vol. 2010, No. 1, pp. 97–102). Society for Imaging Science and Technology.Google Scholar
  16. Liu, Y., Lin, S., Hsueh, Y., & Lee, M. (2009). Automatic target defect identification for TFT-LCD array process inspection using kernel FCM-based fuzzy SVDD ensemble. Expert Systems with Applications, 36(2), 1978–1998. doi: 10.1016/j.eswa.2007.12.015.CrossRefGoogle Scholar
  17. Lu, R. S. (2016). Surface defect inspection of TFT-LCD panels based on 1D Fourier method. In Seventh international symposium on precision mechanical measurements (pp. 990308–990308). International Society for Optics and Photonics.Google Scholar
  18. Nam, G., Lee, H., Oh, S., & Kim, M. H. (2016). Measuring color defects in flat panel displays using HDR imaging and appearance modeling. IEEE Transactions on Instrumentation and Measurement, 65(2), 297–304. doi: 10.1109/TIM.2015.2485341.CrossRefGoogle Scholar
  19. Oh, J. H., Kwak, D. M., Lee, K. B., Song, Y. C., Choi, D. H., & Park, K. H. (2004). Line defect detection in TFT-LCD using directional filter bank and adaptive multilevel thresholding. Key Engineering Materials, 270–273, 233–238.CrossRefGoogle Scholar
  20. Otsu, N. (1979). A threshold selection method from gray-level histograms. IEEE Transactions on Systems, Man, and Cybernetics, 9(1), 62–66. doi: 10.1109/TSMC.1979.4310076.CrossRefGoogle Scholar
  21. Park, Y., & Kweon, I. S. (2016). Ambiguous surface defect image classification of AMOLED displays in smartphones. IEEE Transactions on Industrial Informatics, 12(2), 597–607. doi: 10.1109/TII.2016.2522191.CrossRefGoogle Scholar
  22. Ryu, J.-S., Oh, J.-H., Kim, J.-G., Koo, T. K., & Park, K.-H. (2004). TFT-LCD panel blob-Mura inspection using the correlation of wavelet coefficients. In TENCON 2004. IEEE Region 10 Conference (Vol. A, pp. 219–222). IEEE.Google Scholar
  23. Sun, T., Tien, F., Tien, F., & Kuo, R. (2016). Automated thermal fuse inspection using machine vision and artificial neural networks. Journal of Intelligent Manufacturing, 27(3), 639–651. doi: 10.1007/s10845-014-0902-y.CrossRefGoogle Scholar
  24. Tsai, D., & Tsai, H. (2011). Low-contrast surface inspection of mura defects in liquid crystal displays using optical flow-based motion analysis. Machine Vision and Applications, 22(4), 629–649. doi: 10.1007/s00138-010-0256-1.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2017

Authors and Affiliations

  1. 1.Department of Information and Industrial EngineeringYonsei UniversitySeoulKorea
  2. 2.System Engineering TeamSamsung Display Co., Ltd.AsanKorea

Personalised recommendations