Advertisement

Defects and Components Recognition in Printed Circuit Boards Using Convolutional Neural Network

  • Leong Kean Cheong
  • Shahrel Azmin SuandiEmail author
  • Saimunur Rahman
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 547)

Abstract

This paper introduces an automated components recognition system for printed circuit boards using Convolutional Neural Network (CNN). In addition to that, localization on the defects of the PCB components is also presented. In the first stage, a simple convolutional neural network-based component recognition classifier is developed. Since training a convolutional neural network from scratch is expensive, transfer learning with pre-trained models is performed instead. Pre-trained models such as VGG-16, DenseNet169 and Inception V3 are used to investigate which model suits the best for components recognition. Using transfer learning with VGG-16, the best result achieved is 99% accuracy with the capability of recognizing up to 25 different components. Following that, object localization is performed using faster region-based convolutional neural network (R-CNN). The best mean average precision (mAP) achieved for the defects localization system is 96.54%.

Keywords

Printed circuit boards Convolutional neural network Automated vision inspection system Transfer learning Mean average precision 

References

  1. 1.
    Malge, P.S.: PCB defect detection, classification and localization using mathematical morphology and image processing tools. Int. J. Comput. Appl. 87(9), 40–45 (2014)Google Scholar
  2. 2.
    Takada, Y., Shiina, T., Usami, H., Iwahori, Y.: Defect detection and classification of electronic circuit boards using keypoint extraction and CNN features. In: The Ninth International Conferences on Pervasive Patterns and Applications Defect, pp. 113–116 (2017)Google Scholar
  3. 3.
    Anitha, D.B., Mahesh, R.: A survey on defect detection in bare PCB and assembled PCB using image processing techniques. In: 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET), pp. 39–43 (2017)Google Scholar
  4. 4.
    Crispin, A.J., Rankov, V.: Automated inspection of PCB components using a genetic algorithm template-matching approach. Int. J. Adv. Manuf. Technol. 35(3–4), 293–300 (2007)CrossRefGoogle Scholar
  5. 5.
    Raihan, F., Ce, W.: PCB defect detection USING OPENCV with image subtraction method. In: 2017 International Conference on Information Management and Technology (ICIMTech), pp. 204–209 (2017)Google Scholar
  6. 6.
    Hosseini, H., Xiao, B., Jaiswal, M., Poovendran, R.: On the limitation of convolutional neural networks in recognizing negative images. In: 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA), pp. 352–358 (2017)Google Scholar
  7. 7.
    Tao, X., Wang, Z., Zhang, Z., et al.: Wire defect recognition of spring-wire socket using multitask convolutional neural networks. IEEE Trans. Compon. Packag. Manuf. Technol. 8(4), 689–698 (2018)CrossRefGoogle Scholar
  8. 8.
    Uijlings, J.R.R., Van De Sande, K.E.A., Gevers, T., Smeulders, A.W.M.: Selective search for object recognition. Int. J. Comput. Vis. 104(2), 154–171 (2012)CrossRefGoogle Scholar
  9. 9.
    Girshick, R., Donahue, J., Darrell, T., Malik, J.: Rich feature hierarchies for accurate object detection and semantic segmentation. In: 2014 IEEE Conference on Computer Vision and Pattern Recognition, pp. 580–587 (2014)Google Scholar
  10. 10.
    Ren, S., He, K., Girshick, R., Sun, J.: Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Trans. Pattern Anal. Mach. Intell. 39(6), 1137–1149 (2017)CrossRefGoogle Scholar
  11. 11.
    He, K., Zhang. X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778 (2016)Google Scholar
  12. 12.
    Henderson, P., Ferrari, V.: End-to-end training of object class detectors for mean average precision. In: Computer Vision – ACCV 2016, pp. 198–213. Springer, Cham (2017)Google Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2019

Authors and Affiliations

  • Leong Kean Cheong
    • 2
    • 1
  • Shahrel Azmin Suandi
    • 1
    Email author
  • Saimunur Rahman
    • 2
  1. 1.School of Electrical & Electronic Engineering, Engineering CampusUniversiti Sains MalaysiaNibong TebalMalaysia
  2. 2.Vitrox Corporation, Berhad No. 85-ABayan LepasMalaysia

Personalised recommendations