A Space-Time Depth Super-Resolution Scheme for 3D Face Scanning

  • Karima Ouji
  • Mohsen Ardabilian
  • Liming Chen
  • Faouzi Ghorbel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6915)


Current 3D imaging solutions are often based on rather specialized and complex sensors, such as structured light camera/projector systems, and require explicit user cooperation for 3D face scanning under more or less controlled lighting conditions. In this paper, we propose a cost effective 3D acquisition solution with a 3D space-time super-resolution scheme which is particularly suited to 3D face scanning. The proposed solution uses a low-cost and easily movable hardware involving a calibrated camera pair coupled with a non calibrated projector device. We develop a hybrid stereovision and phase-shifting approach using two shifted patterns and a texture image, which not only takes advantage of the assets of stereovision and structured light but also overcomes their weaknesses. We carry out a new super-resolution scheme to correct the 3D facial model and to enrich the 3D scanned view. Our scheme performs the super-resolution despite facial expression variation using a CPD non-rigid matching. We demonstrate both visually and quantitatively the efficiency of the proposed technique.


Stereo Match Coherent Point Drift Sinusoidal Fringe Facial Expression Variation Digital Fringe Projection Technique 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Blais, F.: Review of 20 years of range sensor development. J. Electronic Imaging. 13, 231–240 (2004)CrossRefGoogle Scholar
  2. 2.
    Zhang, S., Yau, S.: Absolute phase-assisted three-dimensional data registration for a dual-camera structured light system. J. Applied Optics. 47, 3134–3142 (2008)CrossRefGoogle Scholar
  3. 3.
    Zhang, L., Curless, B., Seitz, S.M.: Rapid shape acquisition using color structured light and multipass dynamic programming. In: 3DPVT Conference (2002)Google Scholar
  4. 4.
    Zhang, S., Yau, S.: Generic nonsinusoidal phase error correction for three-dimensional shape measurement using a digital video projector. J. Applied Optics. 46, 36–43 (2007)CrossRefGoogle Scholar
  5. 5.
    Zhang, S.: Recent progresses on real-time 3D shape measurement using digital fringe projection techniques. J. Optics an Lasers in Engineering. 48, 149–158 (2010)CrossRefGoogle Scholar
  6. 6.
    Cox, I., Hingorani, S., Rao, S.: A maximum likelihood stereo algorithm. J. Computer Vision and Image Understanding 63, 542–567 (1996)CrossRefGoogle Scholar
  7. 7.
    Ouji, K., Ardabilian, M., Chen, L., Ghorbel, F.: Pattern analysis for an automatic and low-cost 3D face acquisition technique. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds.) ACIVS 2009. LNCS, vol. 5807, pp. 300–308. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  8. 8.
    Lu, Z., Tai, Y., Ben-Ezra, M., Brown, M.S.: A Framework for Ultra High Resolution 3D Imaging. In: CVPR Conference (2010)Google Scholar
  9. 9.
    Klaudiny, M., Hilton, A., Edge, J.: High-detail 3D capture of facial performance. In: 3DPVT Conference (2010)Google Scholar
  10. 10.
    Zhang, Z.: Flexible Camera Calibration by Viewing a Plane from Unknown Orientations. In: ICCV Conference (1999)Google Scholar
  11. 11.
    Kil, Y., Mederos, Y., Amenta, N.: Laser scanner super-resolution. In: Eurographics Symposium on Point-Based Graphics (2006)Google Scholar
  12. 12.
    Schuon, S., Theobalt, C., Davis, J., Thrun, S.: LidarBoost: Depth Superresolution for ToF 3D Shape Scanning. In: CVPR Conference (2009)Google Scholar
  13. 13.
    Myronenko, A., Song, X., Carreira-Perpinan, M.A.: Non-rigid point set registration: Coherent Point Drift. In: NIPS Conference (2007)Google Scholar
  14. 14.
    Myronenko, A., Song, X.: Point set registration: Coherent Point Drift. IEEE Trans. PAMI 32, 2262–2275 (2010)CrossRefGoogle Scholar
  15. 15.
    Cui, Y., Schuon, S., Chan, D., Thrun, S., Theobalt, C.: 3D Shape Scanning with a Time-of-Flight Camera. In: 3DPVT Conference (2010)Google Scholar
  16. 16.
    Farsiu, S., Robinson, D., Elad, M., Milanfar, P.: Fast and robust multi-frame super-resolution. IEEE Trans. Image Processing (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Karima Ouji
    • 1
  • Mohsen Ardabilian
    • 1
  • Liming Chen
    • 1
  • Faouzi Ghorbel
    • 2
  1. 1.LIRIS, Lyon Research Center for Images and Intelligent Information SystemsEcole Centrale de LyonEcullyFrance
  2. 2.GRIFT, Groupe de Recherche en Images et Formes de TunisieEcole Nationale des Sciences de l’InformatiqueTunisie

Personalised recommendations