Abstract
RGB-D data collected from Microsoft Kinect are an easily available media providing the additional depth information besides RGB, which has great potentials in improving the performance of the facial analysis applications. In this paper, we focus on facial descriptor extraction from depth channel. First, we design a facial shape descriptor based on local binary patterns encoding from surface normal. The novelty lies in that it considers local structures involved in both inner component and inter-components of surface normal. Second, we propose a tensor representation for histogram arrays embedded in multidimensional space and further use multilinear principal component analysis to obtain an optimal trade-off between efficacy and efficiency. The experiments conducted on two publicly available databases, named CurtinFaces and Eurecom, have demonstrated the promising results achieved by proposed schemes on identity and ethnicity classification.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Li, B.Y.L., Mian, A., Liu, W., et al.: Using Kinect for face recognition under varying poses, expressions, illumination and disguise. In: 2013 IEEE Workshop on Applications of Computer Vision (WACV), pp. 186–192. IEEE (2013)
Huynh, T., Min, R., Dugelay, J.L.: An efficient LBP-based descriptor for facial depth images applied to gender recognition using RGB-D face data. In: Computer Vision-ACCV, 2012 Workshops, pp. 133–145. Springer, Berlin (2013)
Boutellaa, E., Hadid, A., Bengherabi, M., et al.: On the use of Kinect depth data for identity, gender and ethnicity classification from facial images. Pattern Recognit. Lett. 68, 270–277 (2015)
Huang, Y., Wang, Y., Tan, T.: Combining statistics of geometrical and correlative features for 3D face recognition. In: Proceedings of British Machine Vision Conference, Edinburgh, UK (2006)
Goswami, G., Vatsa, M., Singh, R.: RGB-D face recognition with texture and attribute features. IEEE Trans. Inf. Forensics Secur. 9(10), 1629–1640 (2014)
Berkmann, J., Caelli, T.: Computation of surface geometry and segmentation using covariance techniques. IEEE Trans. Pattern Anal. Mach. Intell. 16(11), 1114–1116 (1994)
Li, H., Huang, D., Morvan, J.M., et al.: Expression-robust 3D face recognition via weighted sparse representation of multi-scale and multi-component local normal patterns. Neurocomputing 133, 179–193 (2014)
Lei, Z., Liao, S., Pietikäinen, M., et al.: Face recognition by exploring information jointly in space, scale and orientation. IEEE Trans. Image Process. 20(1), 247–256 (2011)
Zhao, G., Pietikainen, M.: Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 915–928 (2007)
De Lathauwer, L., De Moor, B., Vandewalle, J.: On the best rank-1 and rank-(\(r_1, r_2,\ldots, r_n\)) approximation of higher-order tensors. SIAM J. Matrix Anal. Appl. 21(4), 1324–1342 (2000)
Lu, H., Plataniotis, K.N., Venetsanopoulos, A.N.: MPCA: multilinear principal component analysis of tensor objects. IEEE Trans. Neural Netw. 19(1), 18–39 (2008)
Acknowledgments
This work was supported by Shanghai Municipal Natural Science Foundation under Grant No. 16ZR1411100, National Natural Science Foundation of China under Grant No. 61471230, and the Program for Professor of Special Appointment (Eastern Scholar) at Shanghai Institutions of Higher Learning.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Sun, G., Dong, Y., Zhou, X. et al. Facial descriptor for Kinect depth using inner–inter-normal components local binary patterns and tensor histograms. Machine Vision and Applications 27, 997–1003 (2016). https://doi.org/10.1007/s00138-016-0783-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-016-0783-5