Skip to main content
Log in

Adaptively weighted discrete Laplacian for inverse rendering

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Reconstructing a triangular mesh from images by a differentiable rendering framework often exploits discrete Laplacians on the mesh, e.g., the cotangent Laplacian, so that a stochastic gradient descent-based optimization in the framework can become stable by a regularization term formed with the Laplacians. However, the stability stemming from using such a regularizer often comes at the cost of over-smoothing a resulting mesh, especially when the Laplacian of the mesh is not properly approximated, e.g., too-noisy or overly-smoothed Laplacian of the mesh. This paper presents a new discrete Laplacian built upon a kernel-weighted Laplacian. We control the kernel weights using a local bandwidth parameter so that the geometry optimization in a differentiable rendering framework can be improved by avoiding blurring high-frequency details of a surface. We demonstrate that our discrete Laplacian with a local adaptivity can improve the quality of reconstructed meshes and convergence speed of the geometry optimization by plugging our discrete Laplacian into recent differentiable rendering frameworks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

We use publicly available data (see the information on tested 3D models in the acknowledgments), and our source code will be available at https://github.com/CGLab-GIST/awl.

References

  1. Belkin, M., Sun, J., Wang, Y.: Discrete laplace operator on meshed surfaces. In: Proceedings of the Twenty-Fourth Annual Symposium on Computational Geometry, SCG ’08, p. 278-287. Association for Computing Machinery, USA (2008)

  2. Community, B.O.: Blender - a 3D modelling and rendering package. Blender Foundation, Stichting Blender Foundation, Amsterdam (2018). http://www.blender.org

  3. Dziuk, G.: Finite Elements for the Beltrami operator on arbitrary surfaces. Springer, Berlin (1988)

    Book  MATH  Google Scholar 

  4. Kazhdan, M., Solomon, J., Ben-Chen, M.: Can mean-curvature flow be modified to be non-singular? Comput. Graph. Forum 31(5), 1745–1754 (2012)

    Article  Google Scholar 

  5. Kingma, D.P., Ba, J.: Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014)

  6. Luan, F., Zhao, S., Bala, K., Dong, Z.: Unified shape and svbrdf recovery using differentiable monte carlo rendering. Comput. Graph. Forum 40(4), 101–113 (2021)

    Article  Google Scholar 

  7. Nealen, A., Igarashi, T., Sorkine, O., Alexa, M.: Laplacian mesh optimization. In: Proceedings of the 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and Southeast Asia, GRAPHITE ’06, p. 381-389. Association for Computing Machinery, USA (2006)

  8. Nicolet, B., Jacobson, A., Jakob, W.: Large steps in inverse rendering of geometry. ACM Trans. Graph. 40(6), 1–13 (2021)

    Article  Google Scholar 

  9. Palfinger, W.: Continuous remeshing for inverse rendering. Comput. Animation Virt. Worlds 33(5), e2101 (2022)

    Google Scholar 

  10. Pinkall, U., Polthier, K.: Computing discrete minimal surfaces and their conjugates. Exp. Math. 2(1), 15–36 (1993)

    Article  MathSciNet  MATH  Google Scholar 

  11. Sharp, N., Crane, K.: A Laplacian for nonmanifold triangle meshes. Comput. Graph. Forum 39(5), 69–80 (2020)

    Article  Google Scholar 

  12. Wand, M.P., Jones, M.C.: Kernel Smoothing. CRC press (1994)

  13. Wang, N., Zhang, Y., Li, Z., Fu, Y., Liu, W., Jiang, Y.G.: Pixel2mesh: Generating 3d mesh models from single rgb images. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) Comput Vis - ECCV 2018, pp. 55–71. Springer International Publishing, Cham (2018)

    Chapter  Google Scholar 

  14. Wardetzky, M., Mathur, S., Kaelberer, F., Grinspun, E.: Discrete Laplace operators: No free lunch. In: A. Belyaev, M. Garland (eds.) Geometry Processing. The Eurographics Association (2007)

Download references

Acknowledgements

We appreciate the reviewers for their helpful comments and thank the following providers of the tested 3D models: Stanford 3D repository (Armadillo, Bunny, Lucy), Oliver Laric (Dark-finger-reef-crab, Elbo-crab), Smithsonian National Museum of Natural History (Cranium), yeg3d (Deer), and Natural History Museum Vienna (Smilodon).

Funding

This work was supported in part by Ministry of Culture, Sports and Tourism and Korea Creative Content Agency (No. R2021080001) and by Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT) (No. 2022-0-00566).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Bochang Moon.

Ethics declarations

Conflicts of interest

We do not have a conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file 1 (mp4 72725 KB)

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

An, H., Lee, W. & Moon, B. Adaptively weighted discrete Laplacian for inverse rendering. Vis Comput 39, 3211–3220 (2023). https://doi.org/10.1007/s00371-023-02955-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-023-02955-2

Keywords

Navigation