Abstract
Face recognition is a significant and pervasively applied computer vision task. With the specific application scenarios being explored gradually, general face recognition methods dealing with visible light images are unqualified. Cross-domain face recognition refers to a series of methods in response to face recognition problems whose inputs may come from multiple modalities, such as visible light images, sketch, near infrared images, 3D data, low-resolution images, thermal infrared images, or cross different ages, expressions, and ethnicities. Compared with general face recognition, cross-domain face recognition has not been widely explored and only few literatures systematically discuss this topic. Face recognition aiming at matching face images from photographs and other image modalities, which is usually called heterogeneous face recognition, has larger cross-domain gap and is a harder problem in this topic. This paper mainly investigates heterogeneous face databases, provides an up-to-date review of research efforts, and addresses common problems and related issues in cross-domain face recognition techniques.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Wang, X., Tang, X.: Face photo-sketch synthesis and recognition. IEEE Trans. Pattern Anal. Mach. Intell. 31(11), 1955–1967 (2009)
Zhang, W., Wang, X., Tang, X.: Coupled information-theoretic encoding for face photo-sketch recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 513–520 (2011)
Li, S., Yi, D., Lei, Z., et al.: The casia nir-vis 2.0 face database. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops (2013)
Socolinsky, D.A., Selinger, A.: Thermal face recognition in an operational scenario. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, pp. II-1012–II-1019 (2004)
Kevin, X., Bowyer, W.: Visible-light, infrared face recognition. In: Workshop on Multimodal User Authentication, p. 48 (2003)
Socolinsky, D.A., Selinger, A.: A comparative analysis of face recognition performance with visible and thermal infrared imagery. Equinox Corp., Baltimore (2002)
Espinosa-Dur, V., Faundez-Zanuy, M., Mekyska, J.: A new face database simultaneously acquired in visible, near-infrared and thermal spectrums. Cogn. Comput. 5(1), 119–135 (2013)
Tang, X., Wang, X.: Face photo recognition using sketch. In: IEEE International Conference on Image Processing, pp. I-257–I-260 (2002)
Liu, Q., Tang, X., Jin, H., et al.: A nonlinear approach for face sketch synthesis and recognition. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 1005–1010 (2005)
Uhl Jr., R.G., Lobo, N.D.V., Kwon, Y.H.: Recognizing a facial image from a police sketch. In: IEEE Conference on Applications of Computer Vision Workshop, pp. 129–137 (1994)
Li, Y., Savvides, M., Bhagavatula, V.: Illumination tolerant face recognition using a novel facefrom sketch synthesis approach and advanced correlation filters. In: IEEE Conference on Acoustics, Speech, and Signal Processing, pp. 357–360 (2006)
Lei, Z., Liao, S., Jain, A.K., et al.: Coupled discriminant analysis for heterogeneous face recognition. IEEE Trans. Inf. Forensics Secur. 7(6), 1707–1716 (2012)
Choi, J., Hu, S., Young, S.S., et al.: Thermal to visible face recognition. In: SPIE Defense, Security, Sensing. International Society for Optics, Photonics, pp. 83711L–83711L-10 (2012)
Bourlai, T., Ross, A., Chen, C., et al.: A study on using mid-wave infrared images for face recognition. In: SPIE Defense, Security, and Sensing. International Society for Optics and Photonics, pp. 83711K–83711K-13 (2012)
Klare, B.F., Jain, A.K.: Heterogeneous face recognition using kernel prototype similarities. IEEE Trans. Pattern Anal. Mach. Intell. 35(6), 1410–1422 (2013)
Hu, S., Choi, J., Chan, A.L., et al.: Thermal-to-visible face recognition using partial least squares. JOSA A 32(3), 431–442 (2015)
Peng, C., Gao, X., Wang, N., et al.: Graphical Representation for Heterogeneous Face Recognition. arXiv preprint arXiv:1503.00488 (2015)
Rama, A., Tarres, F., Onofrio, D., et al.: Mixed 2D-3D Information for pose estimation and facerecognition. In: IEEE Conference on Acoustics, Speech and Signal Processing, vol. 2, pp. II-211–II-217 (2006)
Riccio, D., Dugelay, J.L.: Geometric invariants for 2D/3D face recognition. Pattern Recogn. Lett. 28(14), 1907–1914 (2007)
Yang, W., Yi, D., Lei, Z., et al.: 2D3D face matching using CCA. In: IEEE Conference on Automatic Face & Gesture Recognition, pp. 1–6 (2008)
Wang, X., Ly, V., Guo, G., et al.: A new approach for 2d–3d heterogeneous face recognition. In: IEEE International Symposium on Multimedia, pp. 301–304 (2013)
Huang, D., Ardabilian, M., Wang, Y., et al.: Oriented gradient maps based automatic asymmetric 3D-2D face recognition. In: International Conference on Biometrics, pp. 125–131 (2012)
Kakadiaris, I.A., Toderici, G., Evangelopoulos, G., et al.: 3D–2D face recognition with pose and illumination normalization. Comput. Vis. Image Underst. (2016)
Zhang, Q., Zhou, F., Yang, F., et al.: Face super-resolution via semi-kernel partial least squares and dictionaries coding. In: IEEE Conference on Digital Signal Processing, pp. 590–594 (2015)
Li, B., Chang, H., Shan, S., et al.: Low-resolution face recognition via coupled locality preserving mappings. IEEE Sig. Process. Lett. 17(1), 20–23 (2010)
Biswas, S., Bowyer, K.W., Flynn, P.J.: Multidimensional scaling for matching low-resolution face images. IEEE Trans. Pattern Anal. Mach. Intell. 34(10), 2019–2030 (2012)
Shi, J., Qi, C.: From local geometry to global structure: learning latent subspace for low-resolution face image recognition. IEEE Sig. Process. Lett. 22(5), 554–558 (2015)
Wang, X., Hu, H., Gu, J.: Pose robust low-resolution face recognition via coupled kernel-based enhanced discriminant analysis. IEEE/CAA J. Autom. Sin. 3(2), 203–212 (2016)
Liu, X., Song, L., Wu, X., Tan, T.: Transferring deep representation for NIR-VIS heterogeneous face recognition. In: International Conference on Biometrics (2016)
Ngiam, J., Khosla, A., Kim, M., et al.: Multimodal deep learning. In: International Conference on Machine Learning, pp. 689–696 (2011)
Pan, S.J., Tsang, I.W., Kwok, J.T., et al.: Domain adaptation via transfer component analysis. IEEE Trans. Neural Netw. 22(2), 199–210 (2011)
Srivastava, N., Salakhutdinov, R.R.: Multimodal learning with deep boltzmann machines. In: Advances in Neural Information Processing Systems, pp. 2222–2230 (2012)
Tang, X., Wang, X.: Face sketch synthesis and recognition. In: IEEE Conference on Computer Vision, pp. 687–694 (2003)
Wang, R., Yang, J., Yi, D., Li, S.Z.: An analysis-by-synthesis method for heterogeneous face biometrics. In: Tistarelli, M., Nixon, M.S. (eds.) ICB 2009. LNCS, vol. 5558, pp. 319–326. Springer, Heidelberg (2009). doi:10.1007/978-3-642-01793-3_33
Yi, D., Lei, Z., Li, S.Z.: Shared representation learning for heterogeneous face recognition. In: IEEE Conference and Workshops on Automatic Face and Gesture Recognition, vol. 1, pp. 1–7 (2015)
Dhamecha, T.I., Sharma, P., Singh, R., et al.: On effectiveness of histogram of oriented gradient features for visible to near infrared face matching. In: International Conference on Pattern Recognition, pp. 1788–1793 (2014)
Klare, B.F., Li, Z., Jain, A.K.: Matching forensic sketches to mug shot photos. IEEE Trans. Pattern Anal. Mach. Intell. 33(3), 639–646 (2011)
Li, S.Z., Zhang, L., Liao, S.C., et al.: A near-infrared image based face recognition system. In: FG, pp. 455–460 (2006)
Juefei-Xu, F., Pal, D., Savvides, M.: NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction. In: IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 141–150 (2015)
Acknowledgments
This work is supported by the Youth Innovation Promotion Association of the Chinese Academy of Sciences (CAS) (Grant No. 2015190), the National Natural Science Foundation of China (Grant No. 61473289) and the Strategic Priority Research Program of the Chinese Academy of Sciences (Grant No. XDB02070000).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Liu, X., Sun, X., He, R., Tan, T. (2016). Recent Advances on Cross-Domain Face Recognition. In: You, Z., et al. Biometric Recognition. CCBR 2016. Lecture Notes in Computer Science(), vol 9967. Springer, Cham. https://doi.org/10.1007/978-3-319-46654-5_17
Download citation
DOI: https://doi.org/10.1007/978-3-319-46654-5_17
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-46653-8
Online ISBN: 978-3-319-46654-5
eBook Packages: Computer ScienceComputer Science (R0)