Neural Computing and Applications

, Volume 31, Supplement 1, pp 607–616 | Cite as

Pose-invariant features and personalized correspondence learning for face recognition

  • Yongbin Gao
  • Hyo Jong LeeEmail author
Original Article


In surveillance systems, face recognition plays an important role for human identification. In such systems, human faces are spatially unconstrained, which results in a significant change in pose, and face recognition becomes more challenging when only one frontal image of the face has been registered in the gallery. In this study, we attempt to solve the problem where only one frontal image of the face is registered in the gallery, and the probe faces are captured in unconstrained poses. The face likelihood is measured using pose-invariant features of scale-invariant feature transform (SIFT) and personalized correspondence learning method. A generic correspondence is first learned between the poses, and the pose-invariant SIFT is fulfilled by extracting the keypoints on virtual patches that are generated by a generic correspondence with the pose variation. The generic correspondence is further personalized to fit each subject, and the learning error of the personalized correspondence is combined with pose-invariant SIFT to measure the face likelihood. The experimental results indicated that our proposed algorithm achieved an average performance of 95% across poses within \(40^\circ\), which is better than other well-known algorithms.


Face recognition Pose-invariant features Personalized correspondence 



This work was supported by the Brain Korea 21 PLUS Project, National Research Foundation of Korea. This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (GR 2016R1D1A3B03931911). This research was also supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2016-R0992-16-1023) supervised by the IITP (Institute for Information and communications Technology Promotion). This research was supported by Research Base Construction Fund Support Program funded by Chonbuk National University in 2016.

Compliance with ethical standards

Conflicts of interest

The authors declare no conflict of interest. We declare that we do not have any commercial or associative interest that represents a conflict of interest in connection with the work entitled “Pose-invariant features and Personalized Correspondence Learning for Face Recognition”.


  1. 1.
    Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041CrossRefzbMATHGoogle Scholar
  2. 2.
    Arashloo SR, Kittler J (2011) Energy normalization for pose-invariant face recognition based on mrf model image matching. IEEE Trans Pattern Anal Mach Intell 33(6):1274–1280CrossRefGoogle Scholar
  3. 3.
    Ashraf AB, Lucey S, Chen T (2008) Learning patch correspondences for improved viewpoint invariant face recognition. In: IEEE Conference on computer vision and pattern recognition 2008. CVPR 2008. IEEE, pp 1–8Google Scholar
  4. 4.
    Asthana A, Marks TK, Jones MJ, Tieu KH, Rohith M (2011) Fully automatic pose-invariant face recognition via 3d pose normalization. In: 2011 IEEE international conference on computer vision (ICCV). IEEE, pp 937–944Google Scholar
  5. 5.
    Baker S, Matthews I (2004) Lucas–Kanade 20 years on: a unifying framework. Int J Comput Vis 56(3):221–255CrossRefGoogle Scholar
  6. 6.
    Blanz V, Vetter T (2003) Face recognition based on fitting a 3d morphable model. IEEE Trans Pattern Anal Mach Intell 25(9):1063–1074CrossRefGoogle Scholar
  7. 7.
    Chai X, Shan S, Chen X, Gao W (2007) Locally linear regression for pose-invariant face recognition. IEEE Trans Image Process 16(7):1716–1725MathSciNetCrossRefGoogle Scholar
  8. 8.
    Chan CH, Tahir MA, Kittler J, Pietikainen M (2013) Multiscale local phase quantization for robust component-based face recognition using kernel fusion of multiple descriptors. IEEE Trans Pattern Anal Mach Intell 35(5):1164–1177CrossRefGoogle Scholar
  9. 9.
    Chen D, Cao X, Wen F, Sun J (2013) Blessing of dimensionality: High-dimensional feature and its efficient compression for face verification. In: 2013 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 3025–3032Google Scholar
  10. 10.
    Du H, Zhang X, Hu Q, Hou Y (2015) Sparse representation-based robust face recognition by graph regularized low-rank sparse representation recovery. Neurocomputing 164:220–229CrossRefGoogle Scholar
  11. 11.
    Gao S, Zhang Y, Jia K, Lu J, Zhang Y (2015) Single sample face recognition via learning deep supervised auto-encoders. IEEE Trans Inform Forensics Secur 10(10):2018–2118CrossRefGoogle Scholar
  12. 12.
    Gao Y, Lee HJ (2014) Pose unconstrained face recognition based on sift and alignment error. In: 2014 International conference on audio, language and image processing (ICALIP). IEEE, pp 277–281Google Scholar
  13. 13.
    Gao Y, Lee HJ (2015) Cross-pose face recognition based on multiple virtual views and alignment error. Pattern Recogn Lett 65:170–176CrossRefGoogle Scholar
  14. 14.
    Gao Y, Leung M, Wang W, Hui SC (2001) Fast face identification under varying pose from a single 2-d model view. IEE Proc Vis Image Sign Process 148(4):248–253CrossRefGoogle Scholar
  15. 15.
    Ho HT, Chellappa R (2013) Pose-invariant face recognition using Markov random fields. IEEE Trans Image Process 22(4):1573–1584MathSciNetCrossRefzbMATHGoogle Scholar
  16. 16.
    Jiang D, Hu Y, Yan S, Zhang L, Zhang H, Gao W (2005) Efficient 3d reconstruction for face recognition. Pattern Recognit 38(6):787–798CrossRefGoogle Scholar
  17. 17.
    Kan M, Shan S, Chang H, Chen X (2014) Stacked progressive auto-encoders (spae) for face recognition across poses. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1883–1890Google Scholar
  18. 18.
    Kan M, Shan S, Zhang H, Lao S, Chen X (2012) Multi-view discriminant analysis. In: Computer Vision–ECCV 2012. Springer, pp 808–821Google Scholar
  19. 19.
    Li A, Shan S, Chen X, Gao W (2009) Maximizing intra-individual correlations for face recognition across pose differences. In: IEEE conference on computer vision and pattern recognition 2009. CVPR 2009. IEEE, pp 605–611Google Scholar
  20. 20.
    Li A, Shan S, Gao W (2012) Coupled bias-variance tradeoff for cross-pose face recognition. IEEE Trans Image Process 21(1):305–315MathSciNetCrossRefzbMATHGoogle Scholar
  21. 21.
    Li S, Liu X, Chai X, Zhang H, Lao S, Shan S (2012) Morphable displacement field based image matching for face recognition across pose. In: Computer vision–ECCV 2012. Springer, pp 102–115Google Scholar
  22. 22.
    Li S, Liu X, Chai X, Zhang H, Lao S, Shan S (2014) Maximal likelihood correspondence estimation for face recognition across pose. IEEE Trans Image Process 23(10):4587–4600MathSciNetCrossRefzbMATHGoogle Scholar
  23. 23.
    Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110CrossRefGoogle Scholar
  24. 24.
    Lu J, Liong VE, Wang G, Moulin P (2015) Joint feature learning for face recognition. IEEE Trans Inform Forensics Secur 10(7):1371–1383CrossRefGoogle Scholar
  25. 25.
    Mikolajczyk K, Schmid C (2004) Scale and affine invariant interest point detectors. Int J Comput Vis 60(1):63–86CrossRefGoogle Scholar
  26. 26.
    Mikolajczyk K, Tuytelaars T, Schmid C, Zisserman A, Matas J, Schaffalitzky F, Kadir T, Van Gool L (2005) A comparison of affine region detectors. Int J Comput Vis 65(1–2):43–72CrossRefGoogle Scholar
  27. 27.
    Morel JM, Yu G (2009) Asift: a new framework for fully affine invariant image comparison. SIAM J Imaging Sci 2(2):438–469MathSciNetCrossRefzbMATHGoogle Scholar
  28. 28.
    Phillips J (2009) Video challenge problem multiple biometric grand challenge preliminary: results of version 2. In: MBGC 3rd workshopGoogle Scholar
  29. 29.
    Phillips PJ, Wechsler H, Huang J, Rauss PJ (1998) The FERET database and evaluation procedure for face-recognition algorithms. Image Vis Comput 16(5):295–306CrossRefGoogle Scholar
  30. 30.
    Prabhu U, Heo J, Savvides M (2011) Unconstrained pose-invariant face recognition using 3d generic elastic models. IEEE Trans Pattern Anal Mach Intell 33(10):1952–1961CrossRefGoogle Scholar
  31. 31.
    Prince SJ, Warrell J, Elder JH, Felisberti FM (2008) Tied factor analysis for face recognition across large pose differences. IEEE Trans Pattern Anal Mach Intell 30(6):970–984CrossRefGoogle Scholar
  32. 32.
    Sharma A, Al Haj M, Choi J, Davis LS, Jacobs DW (2012) Robust pose invariant face recognition using coupled latent space discriminant analysis. Comput Vis Image Underst 116(11):1095–1110CrossRefGoogle Scholar
  33. 33.
    Taigman Y, Yang M, Ranzato M, Wolf L (2014) Deepface: closing the gap to human-level performance in face verification. In: 2014 IEEE conference on computer vision and pattern recognition (CVPR). IEEE, pp 1701–1708Google Scholar
  34. 34.
    Vetter T, Poggio T (1997) Linear object classes and image synthesis from a single example image. IEEE Trans Pattern Anal Mach Intell 19(7):733–742CrossRefGoogle Scholar
  35. 35.
    Wolf L, Hassner T, Taigman Y (2011) Effective unconstrained face recognition by combining multiple descriptors and learned background statistics. IEEE Trans Pattern Anal Mach Intell 33(10):1978–1990CrossRefGoogle Scholar
  36. 36.
    Wright J, Yang AY, Ganesh A, Sastry SS, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227CrossRefGoogle Scholar
  37. 37.
    Yang M, Zhang L, Shiu SCK, Zhang D (2013) Robust kernel representation with statistical local features for face recognition. IEEE Trans Neural Netw Learn Syst 24(6):900–912CrossRefGoogle Scholar
  38. 38.
    Zhang W, Shan S, Gao W, Chen X, Zhang H (2005) Local gabor binary pattern histogram sequence (lgbphs): a novel non-statistical model for face representation and recognition. In: Tenth IEEE international conference on computer vision, 2005. ICCV 2005, vol 1. IEEE, pp 786–791Google Scholar

Copyright information

© The Natural Computing Applications Forum 2017

Authors and Affiliations

  1. 1.Division of Computer Science and EngineeringChonbuk National UniversityJeonjuRepublic of Korea
  2. 2.Division of Computer Science and Engineering, Center for Advanced Image and Information TechnologyChonbuk National UniversityJeonjuRepublic of Korea

Personalised recommendations