Approximating 3D Facial Shape from Photographs Using Coupled Statistical Models

  • Mario Castelán
  • William A. P. Smith
  • Edwin R. Hancock
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4225)


In this paper we focus on the problem of developing a coupled statistical model that can be used to recover surface height from frontal photographs of faces. The idea is to couple intensity and height by jointly modeling their combined variations. We perform Principal Component Analysis (PCA) on the shape coefficients for both intensity and height training data in order to construct the coupled statistical model. Using the best-fit coefficients of an intensity image, height information can be implicitly recovered through the coupled statistical model. Experiments show that the method can generate good approximations of the facial surface shape from out-of-training photographs of faces.


Face Recognition Couple Model Input Image Sample Covariance Matrix Active Appearance Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Bors, A.G., Hancock, E.R., Wilson, R.C.: Terrain analysis using radar shape-from-shading. IEEE Trans. on Pattern Analysis and Machine Intelligence 25(5) (2003)Google Scholar
  2. 2.
    Frankot, R., Chellapa, R.: A method for enforcing integrability in shape from shading algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence 10, 438–451 (1988)CrossRefGoogle Scholar
  3. 3.
    Wu, Z., Li, L.: A line integration based method for depth recovery from surface normals. CVGIP 43(1), 53–66 (1988)Google Scholar
  4. 4.
    Zhao, W., Chellapa, R.: Illumination-insensitive face recognition using symmetric shape-from-shading. In: Proc. Conference on Computer Vision and Pattern Recognition, pp. 286–293 (2000)Google Scholar
  5. 5.
    Samaras, D., Metaxas, D.: Incorporating illumination constraints in deformable models for shape and light direction estimation. IEEE Trans. PAMI 25(2), 247–264 (2003)Google Scholar
  6. 6.
    Castelán, M., Hancock, E.: Acquiring height maps of faces from a single image. In: Proc. IEEE 3DPVT, pp. 183–190 (2004)Google Scholar
  7. 7.
    Prados, E., Camilli, F., Faugeras, O.: A unifying and rigorous shape from shading method adapted to realistic data and applications. Journal of Mathematical Imaging and Vision (2006)Google Scholar
  8. 8.
    Atick, J., Griffin, P., Redlich, N.: Statistical approach to shape from shading: Reconstruction of three-dimensional face surfaces from single two-dimensional images. Neural Computation 8, 1321–1340 (1996)CrossRefGoogle Scholar
  9. 9.
    Dovgard, R., Basri, R.: Statistical symmetric shape from shading for 3d structure recovery of faces. In: Proc. European Conference on Computer Vision, May 2004, pp. 99–113 (2004)Google Scholar
  10. 10.
    Blanz, V., Vetter, T.: Face recognition based on fitting a 3d morphable model. IEEE Trans. Pattern Anal. Mach. Intell. 25(9), 1063–1074 (2003)CrossRefGoogle Scholar
  11. 11.
    Cootes, T.F., Edwards, G.C., Taylor, C.J.: Active appearance models. In: Proc. European Conference in Computer Vision, pp. 484–498 (1998)Google Scholar
  12. 12.
    Turk, M., Pentland, A.: Face recognition using eigenfaces. In: Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 586–591 (1991)Google Scholar
  13. 13.
    Sirovich, L., Everson, R.: Management and analysis of large scientific datasets. The International Journal of Supercomputer Applications 6(1), 50–68 (1992)Google Scholar
  14. 14.
    Blanz, V., Vetter, T.: A morphable model for the synthesis of 3d faces. In: SIGGRAPH ’99: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pp. 187–194. ACM Press/Addison-Wesley Publishing Co., New York (1999)CrossRefGoogle Scholar
  15. 15.
    Georghiades, A., Belhumeur, D., Kriegman, D.: From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Transactions on Pattern Analysis and Machine Intelligence, 634–660 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Mario Castelán
    • 1
  • William A. P. Smith
    • 1
  • Edwin R. Hancock
    • 1
  1. 1.Department of Computer ScienceUniversity of YorkYorkUK

Personalised recommendations