Heuristic hybrid genetic algorithm based shape matching approach for the pose detection of backlight units in LCD module assembly

  • Huiying Cai
  • Feng Zhu
  • Qingxiao Wu
  • Sicong Li


Backlight unit (BLU) and open cell are two critical parts of the liquid crystal display (LCD) module (LCM) which is the most significant component of LCD TV. To place the open cell into a BLU automatically using an assembly robot, this paper proposes a heuristic hybrid genetic algorithm (HHGA) based shape matching approach to detect the pose (orientation and position) of the BLU. The approach takes advantages of line structures of the BLUs to avoid the most time-consuming exhaustive search. Firstly, obtain initial orientation of a BLU by the dominant orientations which can be obtained with the statistical gradient orientation histograms. Secondly, search the optimal pose through the HHGA which mainly consists of local search strategy, crossover strategy, clone strategy, and mutation strategy. Local search strategy is designed according to the rising trend of matching features around the optimal pose and along the lines. Crossover and clone are heuristic strategies designed according to the distribution characteristics of local maxima to produce new meaningful offspring. Mutation is a necessary strategy to keep the diversity of the population. The performance of the proposed approach has been tested on an image database acquired from the LCM assembly lines and compared with standard hybrid GA and exhaustive search by a new statistical indicator. Experimental results show that the proposed approach has a high efficiency within limited time and is suitable for the pose detection of the BLUs.


Pose detection Backlight unit Heuristic hybrid genetic algorithm Dominant orientation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    DisplaySearch China (2011) Cell morphology LCD TV panel shipments are expected to grow thirty percent. Consumer Electronics Review 3:70–70Google Scholar
  2. 2.
    Davies ER (2012) Computer and machine vision: theory, algorithms, practicalities. Academic PressGoogle Scholar
  3. 3.
    Cho HJ, Park TH (2010) Wavelet transform based image template matching for automatic component inspection. Int J Adv Manuf Technol 50(9–12):1033–1039CrossRefGoogle Scholar
  4. 4.
    Zeng Z, Ma LZ, Suwa M (2011) Algorithm of locating PCB components based on colour distribution of solder joints. Int J Adv Manuf Technol 53(5–8):601–614CrossRefGoogle Scholar
  5. 5.
    Wang XJ, Shi YH, Yu GQ, Liang B, Li Y (2016) Groove-center detection in gas metal arc welding using a template-matching method. Int J Adv Manuf Technol:1–11. doi: 10.1007/s00170-016-8389-7
  6. 6.
    Zhong FQ, He SP, Li B (2015) Blob analyzation-based template matching algorithm for LED chip localization. Int J Adv Manuf Technol:1–9. doi: 10.1007/s00170-015-7638-5
  7. 7.
    Hel-Or Y, Hel-Or H, David E (2014) Matching by tone mapping: photometric invariant template matching. IEEE T Pattern Anal 36(2):317–330CrossRefGoogle Scholar
  8. 8.
    Mahmood A, Khan S (2012) Correlation-coefficient-based fast template matching through partial elimination. IEEE T Image Process 21(4):2099–2108MathSciNetCrossRefGoogle Scholar
  9. 9.
    Mikolajczyk K, Schmid C (2005) A performance evaluation of local descriptors. IEEE T Pattern Anal 27(10):1615–1630CrossRefGoogle Scholar
  10. 10.
    Steger C (2001) Similarity measures for occlusion, clutter, and illumination invariant object recognition. Pattern Recogn:148–154Google Scholar
  11. 11.
    Sun J, Sun Q (2015) Further development of adaptable automated visual inspection-part II: implementation and evaluation. Int J Adv Manuf Technol 81(5):1077–1069CrossRefGoogle Scholar
  12. 12.
    Ulrich M (2003) Hierarchical real-time recognition of compound objects in images. PhD thesis, Technische Universität MünchenlGoogle Scholar
  13. 13.
    Crispin AJ, Rankov V (2007) Automated inspection of PCB component using a genetic algorithm template-matching approach. Int J Adv Manuf Technol 35(3–4):293–300CrossRefGoogle Scholar
  14. 14.
    Canny J (1986) A computational approach to edge detection. IEEE T Pattern Anal 8(6):679–698CrossRefGoogle Scholar
  15. 15.
    Steger C (2006) System and method for object recognition. US Patent 7,062,093Google Scholar
  16. 16.
    Hinterstoisser S, Lepetit V, Ilic S, Fua P, Navab N (2010) Dominant orientation templates for real-time detection of texture-less objects. In: Proceedings of the CVPR IEEE, pp 2257–2264Google Scholar
  17. 17.
    Xu XY, Beek PV, Feng XF (2014) High-speed object matching and localization using gradient orientation features. In: Proceedings of the SPIE 9025, Intelligent Robots and Computer Vision XXXI: Algorithms and Techniques, 902507Google Scholar
  18. 18.
    Amin-Naseri MR, Afshari AJ (2012) A hybrid genetic algorithm for integrated process planning and scheduling problem with precedence constraints. Int J Adv Manuf Technol 59(1–4):273–287CrossRefGoogle Scholar
  19. 19.
    Rashidi E, Hahandar M, Zandieh M (2010) An improved hybrid multi-objective parallel genetic algorithm for hybrid flow shop scheduling with unrelated parallel machines. Int J Adv Manuf Technol 49(9):1129–1139CrossRefGoogle Scholar
  20. 20.
    Derringer GC, Suich R (1980) Simultaneous optimization of several response variables. J Qual Technol 12(4):214–219Google Scholar
  21. 21.
    Franca PM, Mendes A, Moscato P (2001) A memetic algorithm for the total tardiness single machine scheduling. Eur J Oper Res 132(1):224–242MathSciNetCrossRefMATHGoogle Scholar
  22. 22.
    Kucukkoc I, Zhang DZ (2016) Integrating ant colony and genetic algorithms in the balancing and scheduling of complex assembly lines. Int J Adv Manuf Technol 82(1):265–285CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London 2016

Authors and Affiliations

  • Huiying Cai
    • 1
    • 2
  • Feng Zhu
    • 1
  • Qingxiao Wu
    • 1
  • Sicong Li
    • 1
  1. 1.Shenyang Institute of AutomationChinese Academy of SciencesShenyangChina
  2. 2.University of Chinese Academy of SciencesBeijingChina

Personalised recommendations