3D Face Modeling Based on Structured-Light Assisted Stereo Sensor

  • Boulbaba Ben Amor
  • Mohsen Ardabilian
  • Liming Chen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3617)


In this paper we present a 3D human face reconstruction framework based on stereo sensor coupled with a structured lighting source. Starting from two calibrated images, the active part (video projector) which project controlled lights, allows the operator to locate two sets of structured features with sub-pixel accuracy in both left and right images. Then, exploiting epipolar geometry improves the matching process by reducing its complexity from a bidirectional to a unidirectional search problem. Finally, we perform an adapted dynamic programming algorithm to obtain corresponding features in each conjugated scanline separately. Final three dimensional face models are achieved by a pipeline of four steps: (a) stereo triangulation, (b) data interpolation based on cubic spline models, (c) Delaunay triangulation-based meshing, and (d) texture mapping process.


Voronoi Diagram Delaunay Triangulation Dynamic Programming Algorithm Epipolar Line Structure From Motion 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Tsishkou, D., Chen, L., Bovbel, E.: Semi-Automatic Face Segmentation for Face Detection in Video. In: Proc. of MEDIANET 2004, Tozeur, Tunisia, pp. 107–118 (2004)Google Scholar
  2. 2.
    Peng, K., Chen, L., Ruan, S.: Face Image Encryption and Reconstruction for Smart Cards Using Fourrier-Mellin Transform. In: Proc. of MEDIANET 2004, Tunisia, pp. 311–317 (2004)Google Scholar
  3. 3.
  4. 4.
  5. 5.
    Trucco, E., Verri, A.: Introductory Techniques for 3D Computer Vision. Prentice-Hall, Englewood Cliffs (1998) ISBN 0-13-261108-2Google Scholar
  6. 6.
    D’Apuzzo, N.: Modeling human faces with multi-image photogrammetry. In: Corner, B.D., Pargas, R., Nurre, J.H. (eds.) Proc. of SPIE, Three-Dimensional Image Capture and Applications V, San Jose, USA, vol. 4661, pp. 191–197 (2002)Google Scholar
  7. 7.
    Lao, S., Kawade, M., Sumi, Y., Tomita, F.: Building 3D Facial Models and Detecting Face Pose in 3D Space. 3DIM, 390–404 (1999)Google Scholar
  8. 8.
    Chowdhury, A.R., Chellappa, R., Krishnamurthy, S., Vu, T.: 3D Face Reconstruction from Video Using a Generic Model. In: International Conference on Multimedia, Switzerland, vol. I, pp. 449–452 (2002)Google Scholar
  9. 9.
    Garcia, E., Dugelay, J.-L., Delingette, H.: Low Cost 3D Face Acquisition and Modeling. In: ITCC, Las Vegas, Nevada (April 2001)Google Scholar
  10. 10.
    Zhang, L., Curless, B., Seitz, S.M.: Rapid shape acquisition using color structured light and multi-pass dynamic programming. In: Int. Symposium on 3D Data Processing Visualization and Transmission, Padova, Italy (June 2002)Google Scholar
  11. 11.
    Liu, Y., Chen, G., Max, N., Hofsetz, C., McGuinness, P.: Visual Hull Rendering with Multi-view Stereo. Journal of WSCG (February 2004)Google Scholar
  12. 12.
    Chen, C.-Y., Klette, R., Chen, C.-F.: 3D Reconstruction Using Shape from Photometric Stereo and Contours (October 2003)Google Scholar
  13. 13.
    Horace, H.S.I., Yin, L.J.: Constructing a 3D Head Model from Two Orthogonal Views. The Visual Computer 12(5), 254–266 (1996)Google Scholar
  14. 14.
    Zhang, Z.: A flexible new technique for camera calibration. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(11), 1330–1334 (2000)CrossRefGoogle Scholar
  15. 15.
    de Boor, C.: A Practical Guide to Splines. Springer, Heidelberg (1978)zbMATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Boulbaba Ben Amor
    • 1
  • Mohsen Ardabilian
    • 1
  • Liming Chen
    • 1
  1. 1.LIRIS LabLyon Research Center for Images and Intelligent Information Systems, UMR 5205 CNRSCentrale LyonFrance

Personalised recommendations