3-D Face Modeling from Two Views and Grid Light

  • Lei Shi
  • Xin Yang
  • Hailang Pan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3617)


In this paper, an algorithm for extracting three-dimension shape of human face from two 2D images using grid light is presented. The grid pattern is illuminated by incandescence light instead of laser in order to protect human eyes or skin and reduce cost . An uncoded grid pattern is projected on human face to solve the problem of correspondence between a pair of stereo images. Two images acquired at same time are smoothed to diminish noise at first. Then grid stripes from these images are extracted and thinned by a marked watershed algorithm. A new method based on graph connectivity to locate and label grid intersections from these images is also presented. According to labeling principles, a set of matched points is build. The set of matched points are further used to calculate three-dimension-depth information of human face. Experiment results show the feasibility of the proposed method.


Human Face Face Modeling Grid Pattern Facial Animation Grid Intersection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    DeCarlo, D., Metaxas, D., Stone, M.: An anthropometric face model using variational techniques. In: Proc. SICGRAPH, July 1998, pp. 67–74 (1998)Google Scholar
  2. 2.
    Parke, F.I., Waters, K.: Appendix 1: Three-dimensional muscle model facial animation. Computer Facial Animation (September 1996)Google Scholar
  3. 3.
    Kawai, Y., Ueshiba, T., Yoshimi, T., Oshima, M.: Reconstruction of 3D Objects by Integration of Multiple Range Data. In: Proc.11th International Conference Pattern Recognition, vol. I, pp. 154–157 (1992)Google Scholar
  4. 4.
    Chen, Q., Medioni, G.: Building human face models from two images. In: Proc. IEEE 2nd Workshop Multimedia Signal Processing, December 1998, pp. 117–122 (1998)Google Scholar
  5. 5.
    Guenter, B., Grimm, C., Wood, D., Malvar, H., Pighin, F.: Making faces. In: Proc. SIGGRAPH, July 1998, pp. 55–66 (1998)Google Scholar
  6. 6.
    Ansari, A.-N.: 3D face modeling using two orthogonal views and a generic model. In: Proc. International Conference on Multimedia and Expo., vol. 3, pp. 289–292 (2003)Google Scholar
  7. 7.
    Zhang, Z.: Image-based modeling of objects and human faces. In: Proc. SPIE, vol. 4309 (January 2001)Google Scholar
  8. 8.
    Naftel, A., Mao, Z.: Acquiring Dense 3D Facial Models Using Structured-Light Assisted Stereo Correspondence, Technique Report, Department of Computation, UMIST (2002)Google Scholar
  9. 9.
    Lavoie, P., Ionescu, D., Petriu, E.M.: 3-D Object Model Recovery From 2-D Images Using Structured Light. IEEE Transactions on Instrumentation and Measurement 53(2), 437–443 (2004)CrossRefGoogle Scholar
  10. 10.
    Dunn, S.M., Keizer, R.L., Yu, J.: Measuring the Area and Volume of the Human Body with Structured Light. IEEE Transactions on Systems, Man And Cybernetics 19(6), 1350–1354 (1989)CrossRefGoogle Scholar
  11. 11.
    Petriu, E.M., Sakr, Z., Spoelder, H.J.W., Moica, A.: Object recognition using pseudo-random color encoded structured light. In: Proc. the 17th IEEE Instrumentation and Measurement Technology Conference, vol. 3, pp. 1237–1241, May 1-14 (2000)Google Scholar
  12. 12.
    Guisser, L., Payrissat, R., Castan, S.: A new 3-D surface measurement system using a structured light. In: Proc. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, June 15-18, pp. 784–786 (1992)Google Scholar
  13. 13.
    Hu, G., Stockman, G.: 3-D Surface Solution Using Structured Light and Constraint Propagation. IEEE Transactions on Pattern Analysis and Machine Intelligence 11(4), 390–402 (1989)CrossRefGoogle Scholar
  14. 14.
    Lavoie, P., Ionescu, D., Petriu, E.M.: A high precision 3D object reconstruction method using a color coded grid and nurbs. In: Proc. the International Conference on Image Analysis and Processing, Venice, Italy, September 1999, pp. 370–375 (1999)Google Scholar
  15. 15.
    Luc, V., Soille, P.: Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations. IEEE Transactions on Pattern Analysis and Machine Intelligence 13(6), 583–598 (1991)CrossRefGoogle Scholar
  16. 16.
    Hill, P.R., Canagarajah, C.N., Bull, D.R.: Image Segmentation Using a Texture Gradient Based Watershed Transform. IEEE Transactions on Image Process 12(12), 1618–1634 (2003)CrossRefMathSciNetGoogle Scholar
  17. 17.
    Roerdink, Meijster: The Watershed Transform: Definitions, Algorithms and Parallelization Strategies. FUNDINF: Fundamental Information 41, 187–228 (2001)MathSciNetGoogle Scholar
  18. 18.
    Wegner, S., Pleissner, K.-P., Oswald, H., Fleck, E.: Hierarchical watershed transformation based on a-priori information for spot detection in 2D gel electrophoresis images. In: Proc. SPIE Int. Soc. Opt. Eng., vol. 3661, p. 749 (1999)Google Scholar
  19. 19.
    Géraud, T., Strub, P.-Y., Darbon, J.: Color Image Segmentation Based on Automatic Morphological Clustering. In: Proc. IEEE International Conference on Image Processing (ICIP 2001), Thessaloniki, Greece, October 2001, vol. 3, pp. 70–73 (2001)Google Scholar
  20. 20.
    Beucher, S., Bilodeau, M.: Road segmentation and obstacle recognition by a fast watershed transformation. In: Intelligent Vehicles Symposium 1994, pp. 296–301 (October 1994)Google Scholar
  21. 21.
    Meyer, F.: Color Image Segmentation. In: 4th IEEE Conference on Image Processing and Applications, vol. 354(53), pp. 303–306 (1992)Google Scholar
  22. 22.
    Gao, H., Siu, W.-C., Hou, C.-H.: Improved techniques for automatic image segmentation. IEEE Transactions on Circuits and Systems for Video Technology 11(12), 1273–1280 (2001)CrossRefGoogle Scholar
  23. 23.
    Otsu, N.: A Threshold Selection Method from Gray-Level Histograms. IEEE Transactions on Systems, Man, and Cybernetics 9(1), 62–66 (1979)CrossRefMathSciNetGoogle Scholar
  24. 24.
    Bergmann, D.: New approach for automatic surface reconstruction with coded light. In: Proc. Remote Sensing and Reconstruction for Three Dimensional Objects and Scenes, August 1995. SPIE, vol. 2572, pp. 2–9 (1995)Google Scholar
  25. 25.
    Stockman, G., Hu, G.: Sensing 3-D surface patches using a projected grid. Computer Vision Pattern Recognition, 602–607 (1986)Google Scholar
  26. 26.
    Shrikhande, N., Stockman, G.: Surface orientation from a projected grid. IEEE Trans. Pattern Anal. Mach. Intel. 11(6), 650–655 (1989)CrossRefGoogle Scholar
  27. 27.
    Tajima, J., Iwakawa, M.: 3-D data acquisition by rainbow range finder. In: Proc. International Conference on Pattern Recognition, pp. 309–313 (1990)Google Scholar
  28. 28.
    Yang, H.S., Boyer, K.L., Kak, A.C.: Range data extraction and interpretation by structured light, Purdue Univ, West Lafayette, In Tech. Rep., pp. 199–205 (1984)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Lei Shi
    • 1
  • Xin Yang
    • 1
  • Hailang Pan
    • 1
  1. 1.Institute of Image Processing and Pattern RecognitionShanghai Jiaotong UniversityShanghaiChina

Personalised recommendations