Abstract
The problem of partial occlusion in face recognition has received less attention over the last few years. Partial occlusion is an important challenge of the face recognition, in which certain parts of a face are hidden by the objects such as sunglasses, hats, scarves, and a mask that can cause significant degradation in the performance of the recognition system. This paper specifically addresses face recognition with partial occlusion. The proposed algorithm is an approximate version of conventional dynamic time warping (DTW), which is an exact algorithm and based on dynamic programming. An exact algorithm provides an exact result and involves huge computation efforts when there is a gallery with more images. Hence, a faster approximation algorithm based on greedy approach is proposed to solve the partially occluded face recognition problem by finding a near optimal solution with a guarantee on its performance. Many image processing applications are real-time and need a near-optimal solution. The proposed work has two contributions, the first one is in designing a string generation algorithm for converting a face into a sequence of strings and the second is designing an approximation algorithm based on greedy approach for matching strings. The proposed work uses standard face databases such as FEI, IAB, ORL, and Extended Yale-B for evaluating the effectiveness of the system.
Similar content being viewed by others
References
Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041
Amaral V, Thomaz CE (2008) Normalizacao Espacial de Imagens Frontais de Face. Technical Report. Department of Electrical Engineering, FEI, São Bernardo do Campo, São Paulo, Brazil., Portuguese
Amaral V, Figaro-Garcia C, Gattas GJF, Thomaz CE (2009) Normalizacao espacial de imagens frontais de face em ambientes controlados e nao-controlados. Portuguese, Periodico Cientifico Eletronico da FATEC Sao Caetano do Sul (FaSCi-Tech) 1( 1)
Bartlett MS, Movellan JR, Sejnowski TJ (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13:1450–1464
Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fishy faces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720
Chen W, Gao Y (2010) Recognizing partially occluded faces from a single sample per class using string-based matching. Proc 11th Eur Conf Comput Vision 3:496–509
Chen W, Gao Y (2013) Face recognition using ensemble string matching. IEEE Trans Image Process 22(12):4798–4808
Dagnes N, Vezzetti E, Marcolin F, Tornincasa S (2017) Occlusion detection and restoration techniques for 3D face recognition: a literature review. Mach Vis Appl 29:789–813
Dhamecha TI, Nigam A, Singh R, Vatsa M (2013) Disguise detection and face recognition. Proceedings of international conference on biometrics
Dhamecha TI, Singh R, Vatsa M, Kumar A (2014) Recognizing Disguised Faces: Human and Machine Evaluation. PLoS One 9(7):e99212
Ekenel HK, Stiefelhagen R (2009) Why is facial occlusion a challenging problem. Proc IAPR 3rd International Conference Biometrics (ICB): 299–308
Fuino M (2014) Face recognition using approximate string matching, Program Studi Teknik Informatika ITB
Georghiades A, Belhumeur P, Kriegman D (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. PAMI
Grm K, Struc V, Artiges A, Caron M, Ekenel HK (2017) Strengths and weaknesses of deep learning models for face recognition against image degradations. IET Biometr 7(1):81–89
Hu G, Peng X, Yang Y, Hospedales T. M, Verbeek, J. Frankenstein (2018) Learning deep face representations using small data. IEEE Trans Image Process 27:293–303.
Jia H, Martinez AM (2008) Face recognition with occlusions in the training and testing sets. Proc IEEE International Conference Automatic Face Gesture Recognition (FG): 1–6.
Jia H, Martinez AM (2009) Support vector machines in face recognition with occlusions. Proceedings of the IEEE 10 the scientific world journal computer society conference on computer vision and pattern recognition workshops (CVPR ‘09):136–141
Kim J, Choi J, Yi J, Turk M (2005) Effective representation using ICA for face recognition robust to local distortion and partial occlusion. IEEE Trans Pattern Anal Mach Intell 27(12):1977–1981
Kirby M, Sirovich L (1990) Application of the Karhunen–Loève procedure for the characterization of the human face. IEEE Trans Pattern Anal Mach Intell 12(1)
Lee K-C, Ho J, Kriegman D (2005) Acquiring linear subspaces for face recognition under variable lighting. PAMI.
Liao S, Jain AK (2011) Partial face recognition: an alignment-free approach. Proceedings of the international joint conference on biometrics (IJCB ‘11)
Lin D, Tang X (2007) Quality-driven face occlusion detection and recovery. Proc IEEE Conference on Computer Vision and Pattern Recognition (CVPR):1–7
Lu J, Wang G, Zhou J (2017) Simultaneous feature and dictionary learning for image set based face recognition. IEEE Trans Image Process 26:4042–4054
Martinez AM (2002) Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class. IEEE Trans Pattern Anal Mach Intell 24(6):748–763
Mehdipour Ghazi M, Kemal Ekenel H (2016) A comprehensive analysis of deep learning based representation for face recognition. Proceedings of the IEEE conference on computer vision and pattern recognition workshops: 34–41
Miar-Naimi H, Davari P (2008) A new fast and efficient HMM-based face recognition system using a 7-state HMM along with SVD coefficients. Iranian Journal of Electrical & Electronic Engineering 4(1 & 2)
Min R, Hadid A, Dugelay J-L (2011) Improving the recognition of faces occluded by facial accessories. Proc. IEEE International Conference Automatic Face Gesture Recognition (FG): 442–447
Oh HJ, Lee KM, Lee SU (2008) Occlusion invariant face recognition using selective local non-negative matrix factorization basis images. Image Vis Comput 26(11):1515–1523
Rama A, Tarres F, Goldmann L, Sikora T (2008) More robust face recognition by considering occlusion information. Proceedings of the 8th IEEE international conference on automatic face and gesture recognition (FG ‘08)
Rawat W, Wang Z (2017) Deep convolutional neural networks for image classification: a comprehensive review. Neural Comput 29:2352–2449
Schmidhuber J (2013) Deep learning in neural networks: An overview. Neural Netw 61:85–117
Storer M, Urschler M, Bischof H (2010) Occlusion detection for ICAO compliant facial photographs. Proc IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW): 122–129
Tan X, Chen S, Zhou Z-H, Zhang F (2005) Recognizing partially occluded, expression variant faces from a single training image per person with SOM and soft k-NN ensemble. IEEE Trans Neural Netw 16(4):875–886
Tan X, Chen S, Zhou Z-H, Liu J (2009) Face recognition under occlusions and variant expressions with partial similarity. IEEE Trans Inform Forensics Sec 4(2):217–230
The Database of Faces (2002) AT&T Laboratories Cambridge [Online]. Available: http://www.cl.cam.ac.uk/research/dtg/attarchive/facedatabase.html
Turk MA, Pentland AP (1991) Face recognition using eigenfaces. Proceedings of the IEEE Conference on CVPR: 586–591
Vezzetti E, Marcolin F, Tornincasa S, Ulrich L, Dagnes N (2018) 3D geometry-based automatic landmark localization in presence of facial occlusions. Multimed Tools Appl 77:14177–14205
Wan M, Li M, Yang G, Gai S, Jin Z (2014) Feature extraction using two-dimensional maximum embedding difference. Inf Sci 27:455–469
Wan M, Yang G, Gai S, Yang Z (2017) Two-dimensional discriminant locality preserving projections (2DDLPP) and its application to feature extraction via fuzzy set. Multimed Tools Appl 76:355–371
Wan M, Lai Z, Yang G, Yang Z, Zhang F, Zheng H (2017) Local graph embedding based on maximum margin criterion via fuzzy set. Science Direct, Fuzzy Sets Syst 318:120–131
Wei X, Li C-T, Lei Z, Yi D, Li SZ (Dec. 2014) Dynamic image-to-class warping for occluded face recognition. IEEE Trans Inform Forensics Sec 9(12):2035–2050
Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227
Yang M, Zhang L (2010) Gabor feature based sparse representation for face recognition with Gabor occlusion dictionary. Eur Conf Comput Vision (ECCV) 6316:448–461
Yu H, Yang J (2001) A direct LDA algorithm for high-dimensional data with application to face recognition. Pattern Recogn 34:2067–2070
Zhou Z, Wagner A, Mobahi H, Wright J, Ma Y (2009) Face recognition with contiguous occlusion using Markov random fields. IEEE international conference computer vision (ICCV):1050–1057
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Krishnaveni B, Sridhar S Approximation algorithm based on greedy approach for face recognition with partial occlusion. Multimed Tools Appl 78, 27511–27531 (2019). https://doi.org/10.1007/s11042-019-07831-7
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-07831-7