Abstract
Depth information has been proven useful for face recognition. However, existing depth-image-based face recognition methods still suffer from noisy depth values and varying poses and expressions. In this paper, we propose a novel method for normalizing facial depth images to frontal pose and neutral expression and extracting robust features from the normalized depth images. The method is implemented via two deep convolutional neural networks (DCNN), normalization network (\(Net_{N}\)) and feature extraction network (\(Net_{F}\)). Given a facial depth image, \(Net_{N}\) first converts it to an HHA image, from which the 3D face is reconstructed via a DCNN. \(Net_{N}\) then generates a pose-and-expression normalized (PEN) depth image from the reconstructed 3D face. The PEN depth image is finally passed to \(Net_{F}\), which extracts a robust feature representation via another DCNN for face recognition. Our preliminary evaluation results demonstrate the superiority of the proposed method in recognizing faces of arbitrary poses and expressions with depth images.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Liu, W., Wen, Y., Yu, Li, M., Raj, B., Song, L.: Sphereface: deep hypersphere embedding for face recognition. In: CVPR (2017)
Lee Y., et al.: Accurate and robust face recognition from RGB-D images with a deep learning approach. In: BMVC, pp. 123.1–123.14 (2016)
Liu, F., Zhu, R., Zeng, D., Zhao, Q.: Disentangling features in 3D face shapes for joint face reconstruction and recognition. In: CVPR (2018)
Krizhevsky, A., Sutskever, A., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: NIPS (2012)
Zhang, J., et al.: Lock3DFace: a large-scale database of low-cost Kinect 3D faces. In: ICB, pp. 1–8 (2016)
Li, B.Y.L., et al.: Using Kinect for face recognition under varying poses, expressions, illumination and disguise. In: WACV, pp. 186–192 (2013)
Berretti, S., Pala, P., Bimbo, A.D.: Face recognition by super-resolved 3D models from consumer depth cameras. IEEE Trans. Inf. Forensics Secur. 9(9), 1436–1449 (2014)
Blanz, V., Vetter, T.: Face recognition based on fitting a 3D morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 25(9), 1063–1074 (2003)
Min, R., Kose, N., Dugelay, J.L.: KinectFaceDB: a kinect database for face recognition. IEEE Trans. Syst. Man Cybern. Syst. 4(11), 1534–1548 (2017)
Sang, G., Li, J., Zhao, Q.: Pose-invariant face recognition via RGB-D images. In: CIN, pp. 1–9 (2015)
Aissaoui, A., Martinet, J., Djeraba, C.: DLBP: a novel descriptor for depth image based face recognition. In: ICIP, pp. 298–302 (2017)
Mantecon, T., Del-Bianco, C.R., Jaureguizar, F.: Depth-based face recognition using local quantized patterns adapted for range data. In: ICIP, pp. 293–297 (2015)
Mantecon, T., et al.: Visual face recognition using bag of dense derivative depth patterns. IEEE Signal Process. Lett. 23(6), 771–775 (2016)
Olegs, N., Kamal, N., Modris, G., Thomas, B.M.: RGB-D-T based face recognition. In: ICPR (2014)
Goswami, G., et al.: On RGB-D face recognition using Kinect. In: BTAS, pp. 1–6 (2014)
Gupta, S., Girshick, R., Arbeláez, P., Malik, J.: Learning rich features from RGB-D images for object detection and segmentation. In: Fleet, D., Pajdla, T., Schiele, B., Tuytelaars, T. (eds.) ECCV 2014. LNCS, vol. 8695, pp. 345–360. Springer, Cham (2014). https://doi.org/10.1007/978-3-319-10584-0_23
Cao, C., et al.: FaceWarehouse: a 3D facial expression database for visual computing. IEEE Trans. Vis. Comput. Graph. 20(3), 413–425 (2014)
Wu, X., He, R., Sun, Z.: A lightened CNN for deep face representation. In: CVPR (2015)
Zhu, X., Lei, Z., Liu, X., Shi, H., Li, S.: Face alignment across large poses: a 3D solution. In: CVPR, pp. 146–155 (2016)
Phillips, P., et al.: Overview of the face recognition grand challenge. In: CVPR, pp. 947–954 (2005)
Tian, W., Liu, F., Zhao, Q.: Landmark-based 3D face reconstruction from an arbitrary number of unconstrained images. In: FGW (2018)
Zhu, X., et al.: High-fidelity pose and expression normalization for face recognition in the wild. In: CVPR, pp. 787–796 (2015)
Acknowledgements
This work is supported by the National Key Research and Development Program of China (2017YFB0802300) and the National Natural Science Foundation of China (61773270).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Feng, Z., Zhao, Q. (2018). Robust Face Recognition with Deeply Normalized Depth Images. In: Zhou, J., et al. Biometric Recognition. CCBR 2018. Lecture Notes in Computer Science(), vol 10996. Springer, Cham. https://doi.org/10.1007/978-3-319-97909-0_45
Download citation
DOI: https://doi.org/10.1007/978-3-319-97909-0_45
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-97908-3
Online ISBN: 978-3-319-97909-0
eBook Packages: Computer ScienceComputer Science (R0)