Abstract
Performing face recognition across 3D scans of different resolution is now attracting an increasing interest thanks to the introduction of a new generation of depth cameras, capable of acquiring color/depth images over time. However, these devices have still a much lower resolution than the 3D high-resolution scanners typically used for face recognition applications. Due to this, comparing low- and high-resolution scans can be misleading. Based on these considerations, in this paper we define an approach for reconstructing a higher-resolution 3D face model from a sequence of low-resolution 3D scans. The proposed solution uses the scaled ICP algorithm to align the low-resolution scans with each other, and estimates the value of the high-resolution 3D model through a 2D Box-spline approximation. The approach is evaluated on the The Florence face dataset that collects high- and low-resolution data for about 50 subjects. Measures of the quality of the reconstructed models with respect to high-resolution scans and in comparison with two alternative techniques, demonstrate the viability of the proposed solution.
Chapter PDF
References
Passalis, G., Perakis, P., Theoharis, T., Kakadiaris, I.A.: Using facial symmetry to handle pose variations in real-world 3D face recognition. IEEE Trans. on Pattern Analysis and Machine Intelligence 33(10), 1938–1951 (2011)
Drira, H., Ben Amor, B., Srivastava, A., Daoudi, M., Slama, R.: 3D face recognition under expressions, occlusions, and pose variations. IEEE Trans. on Pattern Analysis and Machine Intelligence 35(9), 2270–2283 (2013)
Pamplona Segundo, M., Silva, L., Bellon, O.: Real-time scale-invariant face detection on range images. In: Proc. IEEE Int. Conf. on Systems, Man, and Cybernetics (SMC), Anchorage, Alaska, USA, pp. 914–919 (2011)
Pamplona Segundo, M., Sarkar, S., Goldgof, D., Silva, L., Bellon, O.: Continuous 3D face authentication using RGB-D cameras. In: Proc. IEEE Work. on Biometrics, Portland, Oregon, USA, pp. 1–6 (June 2013)
Min, R., Choi, J., Medioni, G., Dugelay, J.L.: Real-time 3D face identification from a depth camera. In: Proc. Int. Conf. on Pattern Recognition (ICPR), Tsukuba, Japan, pp. 1739–1742 (November 2012)
Li, B.Y.L., Mian, A.S., Liu, W., Krishna, A.: Using kinect for face recognition under varying poses, expressions, illumination and disguise. In: Proc. IEEE Work. on Applications of Computer Vision (WACV), Clearwater, Florida, pp. 186–192 (January 2013)
Goswami, G., Bharadwaj, S., Vatsa, M., Singh, R.: On RGB-D face recognition using Kinect. In: Proc. IEEE Int. Conf. on Biometrics: Theory, Applications and Systems (BTAS), Washington DC, USA (September 2013)
Huang, T., Tsai, R.: Multi-frame image restoration and registration. Advances in Computer Vision and Image Processing 1(10), 317–339 (1984)
Hardie, R., Barnard, K., Armstrong, E.: Joint map registration and high-resolution image estimation using a sequence of undersampled images. IEEE Trans. on Image Processing 6(12), 1621–1633 (1997)
Baker, S., Kanade, T.: Limits on super-resolution and how to break them. IEEE Trans. on Pattern Analysis and Machine Intelligence 24(9), 1167–1183 (2002)
Farsiu, S., Robinson, M., Elad, M., Milanfar, P.: Fast and robust multiframe super resolution. IEEE Trans. on Image Processing 13(10), 1327–1344 (2004)
Ebrahimi, M., Vrscay, E.: Multi-frame super-resolution with no explicit motion estimation. In: Proc. Int. Conf. on Image Processing, Computer Vision, and Pattern Recognition (IPCV), Las Vegas, Nevada, USA, pp. 455–459 (July 2008)
Yang, Q., Yang, R., Davis, J., Nister, D.: Spatial-depth super resolution for range images. In: Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition (CVPR), Minneapolis, Minnesota, USA, pp. 1–8 (June 2007)
Schuon, S., Theobalt, C., Davis, J., Thrun, S.: Lidarboost: Depth superresolution for ToF 3D shape scanning. In: Proc. IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR), Miami, Florida, USA, pp. 343–350 (June 2009)
Peng, S., Pan, G., Wu, Z.: Learning-based super-resolution of 3D face model. In: Proc. IEEE Int. Conf. on Image Processing (ICIP), Genoa, Italy, vol. II, pp. 382–385 (September 2005)
Pan, G., Han, S., Wu, Z., Wang, Y.: Super-resolution of 3D face. In: Leonardis, A., Bischof, H., Pinz, A. (eds.) ECCV 2006. LNCS, vol. 3952, pp. 389–401. Springer, Heidelberg (2006)
Newcombe, R., Izadi, S., Hilliges, O., Molyneaux, D., Kim, D., Davison, A., Kohli, P., Shotton, J., Hodges, S., Fitzgibbon, A.: Kinectfusion: Real-time dense surface mapping and tracking. In: Proc. IEEE Int. Symposium on Mixed and Augmented Reality (ISMAR), Basel, Switzerland, pp. 1–10 (October 2011)
Hernandez, M., Choi, J., Medioni, G.: Laser scan quality 3-D face modeling using a low-cost depth camera. In: Proc. European Signal Processing Conf. (EUSIPCO), Bucharest, Romania, pp. 1995–1999 (August 2012)
Choi, J., Sharma, A., Medioni, G.: Comparing strategies for 3D face recognition from a 3D sensor. In: Proc. IEEE Int. Symposium on Robot and Human Interactive Communication (RO-MAN), Gyeongju, Korea, pp. 1–6 (August 2013)
Izadi, S., Newcombe, R., Kim, D., Hilliges, O., Molyneaux, D., Hodges, S., Kohli, P., Shotton, J., Davison, A., Fitzgibbon, A.:Kinectfusion: realtime dynamic 3D surface reconstruction and interaction. In: Proc. ACM SIGGRAPH, Vancouver, Canada, p. 1 (August 2011)
Berretti, S., Del Bimbo, A., Pala, P.: Superfaces: A super-resolution model for 3D faces. In: Fusiello, A., Murino, V., Cucchiara, R. (eds.) ECCV 2012 Ws/Demos, Part I. LNCS, vol. 7583, pp. 73–82. Springer, Heidelberg (2012)
Du, S., Zheng, N., Xiong, L., Ying, S., Xue, J.: Scaling iterative closest point algorithm for registration of m-D point sets. Journal of Visual Communication and Image Representation 21, 442–452 (2010)
Charina, M., Conti, C., Jetter, K., Zimmermann, G.: Scalar multivariate subdivision schemes and box splines. Computer Aided Geometric Design 28(5), 285–306 (2011)
The Florence face dataset (2013). http://www.micc.unifi.it/datasets/4d-faces/
Huynh, T., Min, R., Dugelay, J.-L.: An efficient LBP-based descriptor for facial depth images applied to gender recognition using RGB-D face data. In: Park, J.-I., Kim, J. (eds.) ACCV Workshops 2012, Part I. LNCS, vol. 7728, pp. 133–145. Springer, Heidelberg (2013)
Erdogmus, N., Marcel, S.: Spoofing in 2D face recognition with 3D masks and anti-spoofing with kinect. In: IEEE Int. Conf. on Biometrics: Theory, Applications and Systems, (BTAS), Washington DC, USA (September 2013)
Xu, C., Tan, T., Wang, Y., Quan, L.: Combining local features for robust nose location in 3D facial data. Pattern Recognition Letters 27(13), 1487–1494 (2006)
Rusinkiewicz, S., Levoy, M.: Efficient variants of the ICP algorithm. In: Proc. Int. Conf. on 3D Digital Imaging and Modeling (3DIM), Quebec City, Canada, pp. 145–152 (May 2001)
Volumental (2013). http://www.volumental.com/
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Berretti, S., Pala, P., del Bimbo, A. (2015). Increasing 3D Resolution of Kinect Faces. In: Agapito, L., Bronstein, M., Rother, C. (eds) Computer Vision - ECCV 2014 Workshops. ECCV 2014. Lecture Notes in Computer Science(), vol 8925. Springer, Cham. https://doi.org/10.1007/978-3-319-16178-5_45
Download citation
DOI: https://doi.org/10.1007/978-3-319-16178-5_45
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16177-8
Online ISBN: 978-3-319-16178-5
eBook Packages: Computer ScienceComputer Science (R0)