Skip to main content
SpringerLink
Log in

Photometric Stereo for 3D Face Reconstruction Using Non Linear Illumination Models

  • Conference paper
  • First Online:
Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction (MPRSS 2016)

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 10183))

Abstract

Face recognition in presence of illumination changes, variant pose and different facial expressions is a challenging problem. In this paper, a method for 3D face reconstruction using photometric stereo and without knowing the illumination directions and facial expression is proposed in order to achieve improvement in face recognition. A dimensionality reduction method was introduced to represent the face deformations due to illumination variations and self shadows in a lower space. The obtained mapping function was used to determine the illumination direction of each input image and that direction was used to apply photometric stereo. Experiments with faces were performed in order to evaluate the performance of the proposed scheme. From the experiments it was shown that the proposed approach results very accurate 3D surfaces without knowing the light directions and with a very small differences compared to the case of known directions. As a result the proposed approach is more general and requires less restrictions enabling 3D face recognition methods to operate with less data.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alldrin, N.G., Mallick, S.P., Kriegman, D.J.: Resolving the generalized bas-relief ambiguity by entropy minimization. In 2007 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–7, June 2007

    Google Scholar 

  2. Argyriou, V., Zafeiriou, S., Villarini, B., Petrou, M.: A sparse representation method for determining the optimal illumination directions in photometric stereo. Signal Process. 93(11), 3027–3038 (2013)

    Article  Google Scholar 

  3. Atkinson, G.A., Hansen, M.F., Smith, W.A.P., Argyriou, V., Petrou, M., Smith, M.L., Smith, L.N.: Face recognition and verification using photometric stereo: the photoface database and a comprehensive evaluation. In: IEEE Transactions on Information Forensics and Security (2013)

    Google Scholar 

  4. Basri, R., Jacobs, D., Kemelmacher, I.: Photometric stereo with general, unknown lighting. IJCV 72(3), 239–257 (2007)

    Article  Google Scholar 

  5. Belhumeur, P.N., Hespanha, J.P., Kriegman, D.J.: Eigenfaces vs fisherfaces: recognition using class-specific linear projection. IEEE Trans. Pattern Anal. Mach. Intell. 19(7), 711–720 (1997)

    Article  Google Scholar 

  6. Belkin, M., Nivogi, P.: Laplacian eigenmaps and spectral techniques for embedding and clustering. In: NISP 14 (2001)

    Google Scholar 

  7. Chandraker, M.K., Agarwal, S., Kriegman, D.J.: Shadowcuts: photometric stereo with shadows. In: CVPR, June 2007

    Google Scholar 

  8. Elgammal, A., Lee, C.: Body pose tracking from uncalibrated camera using supervised manifold learning. In: NIPS EHuM Workshop (2006)

    Google Scholar 

  9. Georghiades, A.: Incorporating the torrance and sparrow model of reflectance in uncalibrated photometric stereo. In: 9th ICCV, vol. 2 (2003)

    Google Scholar 

  10. Hallinan, P.: A low-dimensional representation of human faces for arbitrary lighting conditions. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (1994)

    Google Scholar 

  11. He, X., Yan, S., Hu, Y., Niyogi, P., Zhang, H.: Face recognition using laplacianfaces. IEEE Trans. PAMI 27, 328–340 (2005)

    Article  Google Scholar 

  12. Hong, J., Song, K.: Facial expression recognition under illumination variation. In: IEEE Workshop on Advanced Robotics and Its Social Impacts, pp. 1–6 (2007)

    Google Scholar 

  13. Silva, V., Tenenbaum, J., Langford, J.: A global geometric framework for nonlinear dimensionality reduction. Science 290(5500), 2319–2323 (2000)

    Article  Google Scholar 

  14. Fleet, D., Wang, J., Hertzmann, A.: Gaussian process dynamical models. In: NISP, vol. 18 (2006)

    Google Scholar 

  15. Kakadiaris, I.A., Passalis, G., Toderici, G., Murtuza, M.N., Lu, Y., Karampatziakis, N., Theoharis, T.: Three-dimensional face recognition in the presence of facial expressions: an annotated deformable model approach. IEEE Trans. Pattern Anal. Mach. Intell. 29(4), 640–649 (2007)

    Article  Google Scholar 

  16. Kautkar, S.N., Atkinson, G.A., Smith, M.L.: Face recognition in 2d and 2.5d using ridgelets and photometric stereo. Pattern Recogn. 45, 3317–3327 (2012)

    Article  Google Scholar 

  17. Kemelmacher-Shlizerman, I.: Internet based morphable model. In: 2013 IEEE International Conference on Computer Vision, pp. 3256–3263, December 2013

    Google Scholar 

  18. Kemelmacher-Shlizerman, I., Seitz, S.M.: Face reconstruction in the wild. In: 2011 International Conference on Computer Vision, pp. 1746–1753, November 2011

    Google Scholar 

  19. Lawrence, N.: Gaussian process latent variable models for visualisation of high dimensional data. In: NISP, vol. 16 (2004)

    Google Scholar 

  20. Lee, K.C.: Acquiring linear subspaces for face recognition under variable lighting. IEEE PAMI (2005)

    Google Scholar 

  21. Lu, F., Matsushita, Y., Sato, I., Okabe, T., Sato, Y.: Uncalibrated photometric stereo for unknown isotropic reflectances. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1490–1497, June 2013

    Google Scholar 

  22. Papadhimitri, T., Favaro, P.: A closed-form, consistent and robust solution to uncalibrated photometric stereo via local diffuse reflectance maxima. Int. J. Comput. Vis. 107(2), 139–154 (2014)

    Article  MATH  Google Scholar 

  23. Robles-Kelly, A., Hancock, E.R.: A graph-spectral approach to shapefrom-shading. IEEE Trans. Image Process. 13(7), 912–926 (2004)

    Article  Google Scholar 

  24. Roweis, S.T., Saul, L.K.: Nonlinear dimensionality reduction by locally linear embedding. Science 290, 2323–2326 (2000)

    Article  Google Scholar 

  25. Schindler, G.: Photometric stereo via computer screen lighting for real-time surface reconstruction. In: Proceedings of the 3DPVT 2008 (2008)

    Google Scholar 

  26. Shi, B., Matsushita, Y., Wei, Y., Xu, C., Tan, P.: Self-calibrating photometric stereo. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1118–1125, June 2010

    Google Scholar 

  27. Shi, B., Wu, Z., Mo, Z., Duan, D., Yeung, S., Tan, P.: A benchmark dataset and evaluation for non-lambertian and uncalibrated photometric stereo. In: IEEE Conference on CVPR, pp. 3707–3716 (2016)

    Google Scholar 

  28. van Der-Maaten, G., Hinton, L.: Visualizing data using t-sne. J. Mach. Learn. Res. 9, 2579–2605 (2008)

    MATH  Google Scholar 

  29. Argyriou, V., Petrou, M.: Recursive photometric stereo when multiple shadows and highlights are present. In: Proceedings of CVPR (2008)

    Google Scholar 

  30. Woodham, R.: Photometric method for determining surface orientation from multiple images. Opt. Eng. 19(1), 139–144 (1980)

    Article  Google Scholar 

  31. Wu, Z., Tan, P.: Calibrating photometric stereo by holistic reflectance symmetry analysis. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1498–1505, June 2013

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of Westminster, London, UK

    Barbara Villarini

  2. Imperial College, London, UK

    Athanasios Gkelias

  3. Kingston University, London, UK

    Vasilios Argyriou

Authors
  1. Barbara Villarini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Athanasios Gkelias
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Vasilios Argyriou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Barbara Villarini .

Editor information

Editors and Affiliations

  1. Universität Ulm, Ulm, Germany

    Friedhelm Schwenker

  2. Multimodal Communication and Computation, University of Southern California, Playa Vista, California, USA

    Stefan Scherer

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this paper

Cite this paper

Villarini, B., Gkelias, A., Argyriou, V. (2017). Photometric Stereo for 3D Face Reconstruction Using Non Linear Illumination Models. In: Schwenker, F., Scherer, S. (eds) Multimodal Pattern Recognition of Social Signals in Human-Computer-Interaction. MPRSS 2016. Lecture Notes in Computer Science(), vol 10183. Springer, Cham. https://doi.org/10.1007/978-3-319-59259-6_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-59259-6_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-59258-9

  • Online ISBN: 978-3-319-59259-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation