Skip to main content
SpringerLink
Log in

A Variational Approach to Shape-from-Shading Under Natural Illumination

  • Conference paper
  • First Online:
Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR 2017)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 10746))

Abstract

A numerical solution to shape-from-shading under natural illumination is presented. It builds upon an augmented Lagrangian approach for solving a generic PDE-based shape-from-shading model which handles directional or spherical harmonic lighting, orthographic or perspective projection, and greylevel or multi-channel images. Real-world applications to shading-aware depth map denoising, refinement and completion are presented.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Durou, J.D., Falcone, M., Sagona, M.: Numerical methods for shape-from-shading: a new survey with benchmarks. Comput. Vis. Image Underst. 109, 22–43 (2008)

    Article  Google Scholar 

  2. Horn, B.K.P., Brooks, M.J.: The variational approach to shape from shading. Comput. Vis. Graph. Image Process. 33, 174–208 (1986)

    Article  MATH  Google Scholar 

  3. Lions, P.L., Rouy, E., Tourin, A.: Shape-from-shading, viscosity solutions and edges. Numer. Math. 64, 323–353 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  4. Han, Y., Lee, J.Y., Kweon, I.S.: High quality shape from a single RGB-D image under uncalibrated natural illumination. In: Proceedings of the ICCV (2013)

    Google Scholar 

  5. Basri, R., Jacobs, D.P.: Lambertian reflectances and linear subspaces. IEEE Trans. Pattern Anal. Mach. Intell. 25, 218–233 (2003)

    Article  Google Scholar 

  6. Quéau, Y., Mecca, R., Durou, J.D.: Unbiased photometric stereo for colored surfaces: a variational approach. In: Proceedings of the CVPR (2016)

    Google Scholar 

  7. Johnson, M.K., Adelson, E.H.: Shape estimation in natural illumination. In: Proceedings of the CVPR (2011)

    Google Scholar 

  8. Huang, R., Smith, W.A.P.: Shape-from-shading under complex natural illumination. In: Proceedings of the ICIP (2011)

    Google Scholar 

  9. Or-El, R., Rosman, G., Wetzler, A., Kimmel, R., Bruckstein, A.: RGBD-fusion: real-time high precision depth recovery. In: Proceedings of the CVPR (2015)

    Google Scholar 

  10. Frolova, D., Simakov, D., Basri, R.: Accuracy of spherical harmonic approximations for images of Lambertian objects under far and near lighting. In: Pajdla, T., Matas, J. (eds.) ECCV 2004. LNCS, vol. 3021, pp. 574–587. Springer, Heidelberg (2004). https://doi.org/10.1007/978-3-540-24670-1_44

    Chapter  Google Scholar 

  11. Barron, J.T., Malik, J.: Shape, illumination, and reflectance from shading. IEEE Trans. Pattern Anal. Mach. Intell. 37, 1670–1687 (2015)

    Article  Google Scholar 

  12. Cristiani, E., Falcone, M.: Fast semi-Lagrangian schemes for the eikonal equation and applications. SIAM J. Numer. Anal. 45, 1979–2011 (2007)

    Article  MathSciNet  MATH  Google Scholar 

  13. Breuß, M., Cristiani, E., Durou, J.D., Falcone, M., Vogel, O.: Perspective shape from shading: ambiguity analysis and numerical approximations. SIAM J. Imaging Sci. 5, 311–342 (2012)

    Article  MathSciNet  MATH  Google Scholar 

  14. Quéau, Y., Durou, J.D., Aujol, J.F.: Normal integration: a survey. J. Math. Imaging Vis. (2017)

    Google Scholar 

  15. Graber, G., Balzer, J., Soatto, S., Pock, T.: Efficient minimal-surface regularization of perspective depth maps in variational stereo. In: Proceedings of the CVPR (2015)

    Google Scholar 

  16. Glowinski, R., Marroco, A.: Sur l’approximation, par éléments finis d’ordre un, et la résolution, par pénalisation-dualité d’une classe de problèmes de Dirichlet non linéaires. Revue française d’automatique, informatique, recherche opérationnelle. Analyse numérique 9, 41–76 (1975)

    Article  MATH  Google Scholar 

  17. Boyd, S., Parikh, N., Chu, E., Peleato, B., Eckstein, J.: Distributed optimization and statistical learning via the alternating direction method of multipliers. Found. Trends Mach. Learn. 3, 1–122 (2011)

    Article  MATH  Google Scholar 

  18. Li, G., Pong, T.K.: Global convergence of splitting methods for nonconvex composite optimization. SIAM J. Optim. 25, 2434–2460 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  19. Hong, M., Luo, Z.Q., Razaviyayn, M.: Convergence analysis of alternating direction method of multipliers for a family of nonconvex problems. SIAM J. Optim. 26, 337–364 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  20. Zollhöfer, M., Dai, A., Innman, M., Wu, C., Stamminger, M., Theobalt, C., Nießner, M.: Shading-based refinement on volumetric signed distance functions. ACM Trans. Graph. 34, 96:1–96:14 (2015)

    Article  MATH  Google Scholar 

  21. Jancosek, M., Pajdla, T.: Multi-view reconstruction preserving weakly-supported surfaces. In: Proceedings of the CVPR (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Informatics, Technical University of Munich, Munich, Germany

    Yvain Quéau & Daniel Cremers

  2. IRIT, UMR CNRS 5505, Université de Toulouse, Toulouse, France

    Jean Mélou & Jean-Denis Durou

  3. Mikros Image, Levallois-Perret, France

    Jean Mélou & Fabien Castan

Authors
  1. Yvain Quéau
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jean Mélou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Fabien Castan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Daniel Cremers
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Jean-Denis Durou
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yvain Quéau .

Editor information

Editors and Affiliations

  1. Ca’ Foscari University of Venice, Venice, Italy

    Marcello Pelillo

  2. University of York, York, United Kingdom

    Edwin Hancock

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG, part of Springer Nature

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Quéau, Y., Mélou, J., Castan, F., Cremers, D., Durou, JD. (2018). A Variational Approach to Shape-from-Shading Under Natural Illumination. In: Pelillo, M., Hancock, E. (eds) Energy Minimization Methods in Computer Vision and Pattern Recognition. EMMCVPR 2017. Lecture Notes in Computer Science(), vol 10746. Springer, Cham. https://doi.org/10.1007/978-3-319-78199-0_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-78199-0_23

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-78198-3

  • Online ISBN: 978-3-319-78199-0

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation