Skip to main content
Log in

Approximation algorithm based on greedy approach for face recognition with partial occlusion

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The problem of partial occlusion in face recognition has received less attention over the last few years. Partial occlusion is an important challenge of the face recognition, in which certain parts of a face are hidden by the objects such as sunglasses, hats, scarves, and a mask that can cause significant degradation in the performance of the recognition system. This paper specifically addresses face recognition with partial occlusion. The proposed algorithm is an approximate version of conventional dynamic time warping (DTW), which is an exact algorithm and based on dynamic programming. An exact algorithm provides an exact result and involves huge computation efforts when there is a gallery with more images. Hence, a faster approximation algorithm based on greedy approach is proposed to solve the partially occluded face recognition problem by finding a near optimal solution with a guarantee on its performance. Many image processing applications are real-time and need a near-optimal solution. The proposed work has two contributions, the first one is in designing a string generation algorithm for converting a face into a sequence of strings and the second is designing an approximation algorithm based on greedy approach for matching strings. The proposed work uses standard face databases such as FEI, IAB, ORL, and Extended Yale-B for evaluating the effectiveness of the system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18

Similar content being viewed by others

References

  1. Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041

    Article  MATH  Google Scholar 

  2. Amaral V, Thomaz CE (2008) Normalizacao Espacial de Imagens Frontais de Face. Technical Report. Department of Electrical Engineering, FEI, São Bernardo do Campo, São Paulo, Brazil., Portuguese

    Google Scholar 

  3. Amaral V, Figaro-Garcia C, Gattas GJF, Thomaz CE (2009) Normalizacao espacial de imagens frontais de face em ambientes controlados e nao-controlados. Portuguese, Periodico Cientifico Eletronico da FATEC Sao Caetano do Sul (FaSCi-Tech) 1( 1)

  4. Bartlett MS, Movellan JR, Sejnowski TJ (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13:1450–1464

    Article  Google Scholar 

  5. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fishy faces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  6. Chen W, Gao Y (2010) Recognizing partially occluded faces from a single sample per class using string-based matching. Proc 11th Eur Conf Comput Vision 3:496–509

    Google Scholar 

  7. Chen W, Gao Y (2013) Face recognition using ensemble string matching. IEEE Trans Image Process 22(12):4798–4808

    Article  MathSciNet  MATH  Google Scholar 

  8. Dagnes N, Vezzetti E, Marcolin F, Tornincasa S (2017) Occlusion detection and restoration techniques for 3D face recognition: a literature review. Mach Vis Appl 29:789–813

    Article  Google Scholar 

  9. Dhamecha TI, Nigam A, Singh R, Vatsa M (2013) Disguise detection and face recognition. Proceedings of international conference on biometrics

  10. Dhamecha TI, Singh R, Vatsa M, Kumar A (2014) Recognizing Disguised Faces: Human and Machine Evaluation. PLoS One 9(7):e99212

    Article  Google Scholar 

  11. Ekenel HK, Stiefelhagen R (2009) Why is facial occlusion a challenging problem. Proc IAPR 3rd International Conference Biometrics (ICB): 299–308

  12. Fuino M (2014) Face recognition using approximate string matching, Program Studi Teknik Informatika ITB

  13. Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. PAMI

  14. Grm K, Struc V, Artiges A, Caron M, Ekenel HK (2017) Strengths and weaknesses of deep learning models for face recognition against image degradations. IET Biometr 7(1):81–89

    Article  Google Scholar 

  15. Hu G, Peng X, Yang Y, Hospedales T. M, Verbeek, J. Frankenstein (2018) Learning deep face representations using small data. IEEE Trans Image Process 27:293–303.

  16. Jia H, Martinez AM (2008) Face recognition with occlusions in the training and testing sets. Proc IEEE International Conference Automatic Face Gesture Recognition (FG): 1–6.

  17. Jia H, Martinez AM (2009) Support vector machines in face recognition with occlusions. Proceedings of the IEEE 10 the scientific world journal computer society conference on computer vision and pattern recognition workshops (CVPR ‘09):136–141

  18. Kim J, Choi J, Yi J, Turk M (2005) Effective representation using ICA for face recognition robust to local distortion and partial occlusion. IEEE Trans Pattern Anal Mach Intell 27(12):1977–1981

    Article  Google Scholar 

  19. Kirby M, Sirovich L (1990) Application of the Karhunen–Loève procedure for the characterization of the human face. IEEE Trans Pattern Anal Mach Intell 12(1)

  20. Lee K-C, Ho J, Kriegman D (2005) Acquiring linear subspaces for face recognition under variable lighting. PAMI.

  21. Liao S, Jain AK (2011) Partial face recognition: an alignment-free approach. Proceedings of the international joint conference on biometrics (IJCB ‘11)

  22. Lin D, Tang X (2007) Quality-driven face occlusion detection and recovery. Proc IEEE Conference on Computer Vision and Pattern Recognition (CVPR):1–7

  23. Lu J, Wang G, Zhou J (2017) Simultaneous feature and dictionary learning for image set based face recognition. IEEE Trans Image Process 26:4042–4054

    Article  MathSciNet  MATH  Google Scholar 

  24. Martinez AM (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Mach Intell 24(6):748–763

    Article  Google Scholar 

  25. Mehdipour Ghazi M, Kemal Ekenel H (2016) A comprehensive analysis of deep learning based representation for face recognition. Proceedings of the IEEE conference on computer vision and pattern recognition workshops: 34–41

  26. Miar-Naimi H, Davari P (2008) A new fast and efficient HMM-based face recognition system using a 7-state HMM along with SVD coefficients. Iranian Journal of Electrical & Electronic Engineering 4(1 & 2)

  27. Min R, Hadid A, Dugelay J-L (2011) Improving the recognition of faces occluded by facial accessories. Proc. IEEE International Conference Automatic Face Gesture Recognition (FG): 442–447

  28. Oh HJ, Lee KM, Lee SU (2008) Occlusion invariant face recognition using selective local non-negative matrix factorization basis images. Image Vis Comput 26(11):1515–1523

    Article  Google Scholar 

  29. Rama A, Tarres F, Goldmann L, Sikora T (2008) More robust face recognition by considering occlusion information. Proceedings of the 8th IEEE international conference on automatic face and gesture recognition (FG ‘08)

  30. Rawat W, Wang Z (2017) Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput 29:2352–2449

    Article  MathSciNet  MATH  Google Scholar 

  31. Schmidhuber J (2013) Deep learning in neural networks: An overview. Neural Netw 61:85–117

    Article  Google Scholar 

  32. Storer M, Urschler M, Bischof H (2010) Occlusion detection for ICAO compliant facial photographs. Proc IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW): 122–129

  33. Tan X, Chen S, Zhou Z-H, Zhang F (2005) Recognizing partially occluded, expression variant faces from a single training image per person with SOM and soft k-NN ensemble. IEEE Trans Neural Netw 16(4):875–886

    Article  Google Scholar 

  34. Tan X, Chen S, Zhou Z-H, Liu J (2009) Face recognition under occlusions and variant expressions with partial similarity. IEEE Trans Inform Forensics Sec 4(2):217–230

    Article  Google Scholar 

  35. The Database of Faces (2002) AT&T Laboratories Cambridge [Online]. Available: http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html

  36. Turk MA, Pentland AP (1991) Face recognition using eigenfaces. Proceedings of the IEEE Conference on CVPR: 586–591

  37. Vezzetti E, Marcolin F, Tornincasa S, Ulrich L, Dagnes N (2018) 3D geometry-based automatic landmark localization in presence of facial occlusions. Multimed Tools Appl 77:14177–14205

    Article  Google Scholar 

  38. Wan M, Li M, Yang G, Gai S, Jin Z (2014) Feature extraction using two-dimensional maximum embedding difference. Inf Sci 27:455–469

    Google Scholar 

  39. Wan M, Yang G, Gai S, Yang Z (2017) Two-dimensional discriminant locality preserving projections (2DDLPP) and its application to feature extraction via fuzzy set. Multimed Tools Appl 76:355–371

    Article  Google Scholar 

  40. Wan M, Lai Z, Yang G, Yang Z, Zhang F, Zheng H (2017) Local graph embedding based on maximum margin criterion via fuzzy set. Science Direct, Fuzzy Sets Syst 318:120–131

    Article  MathSciNet  Google Scholar 

  41. Wei X, Li C-T, Lei Z, Yi D, Li SZ (Dec. 2014) Dynamic image-to-class warping for occluded face recognition. IEEE Trans Inform Forensics Sec 9(12):2035–2050

    Article  Google Scholar 

  42. Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227

    Article  Google Scholar 

  43. Yang M, Zhang L (2010) Gabor feature based sparse representation for face recognition with Gabor occlusion dictionary. Eur Conf Comput Vision (ECCV) 6316:448–461

    Google Scholar 

  44. Yu H, Yang J (2001) A direct LDA algorithm for high-dimensional data with application to face recognition. Pattern Recogn 34:2067–2070

    Article  MATH  Google Scholar 

  45. Zhou Z, Wagner A, Mobahi H, Wright J, Ma Y (2009) Face recognition with contiguous occlusion using Markov random fields. IEEE international conference computer vision (ICCV):1050–1057

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Krishnaveni B.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Krishnaveni B, Sridhar S Approximation algorithm based on greedy approach for face recognition with partial occlusion. Multimed Tools Appl 78, 27511–27531 (2019). https://doi.org/10.1007/s11042-019-07831-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-019-07831-7

Keywords

Navigation