Skip to main content
SpringerLink
Log in

Real-time triple product relighting using spherical local-frame parameterization

  • Special Issue Paper
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

This paper addresses the problem of real-time rendering for objects with complex materials under varying all-frequency illumination and changing view. Our approach extends the triple product algorithm by using local-frame parameterization, spherical wavelets, per-pixel shading and visibility textures. Storing BRDFs with local-frame parameterization allows us to handle complex BRDFs and incorporate bump mapping more easily. In addition, it greatly reduces the data size compared to storing BRDFs with respect to the global frame. The use of spherical wavelets avoids uneven sampling and energy normalization of cubical parameterization. Finally, we use per-pixel shading and visibility textures to remove the need for fine tessellations of meshes and shift most computation from vertex shaders to more powerful pixel shaders. The resulting system can render scenes with realistic shadow effects, complex BRDFs, bump mapping and spatially-varying BRDFs under varying complex illumination and changing view at real-time frame rates on modern graphics hardware.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Bonneau, G.P.: Optimal triangular Haar bases for spherical data. In: IEEE Visualization 1999, pp. 279–284 (1999)

  2. Clarberg, P., Jarosz, W., Akenine-Moller, T., Jensen, H.W.: Wavelet importance sampling: Efficiently evaluating products of complex functions. ACM Trans. Graph. 24(3), 1166–1175 (2005)

    Article  Google Scholar 

  3. Green, P., Kautz, J., Matusik, W., Durand, F.: View-dependent precomputed light transport using nonlinear gaussian function approximations. In: Proceedings of I3D 2006, pp. 7–14 (2006)

  4. Gu, X., Gortler, S.J., Hoppe, H.: Geometry images. In: Proceedings of SIGGRAPH 2002, pp. 355–361 (2002)

  5. Kautz, J., Sloan, P.P., Snyder, J.: Fast, arbitrary brdf shading for low-frequency lighting using spherical harmonics. In: Proceedings of EGWR 2002, pp. 291–296 (2002)

  6. Lehtinen, J., Kautz, J.: Matrix radiance transfer. In: Proceedings of I3D 2003, pp. 59–64 (2003)

  7. Liu, X., Sloan, P.P., Shum, H.Y., Snyder, J.: All-frequency precomputed radiance transfer for glossy objects. In: Proceedings of the EGSR 2004, pp. 337–344 (2004)

  8. Ng, R., Ramamoorthi, R., Hanrahan, P.: All-frequency shadows using non-linear wavelet lighting approximation. ACM Trans. Graph. 22(3), 376–381 (2003)

    Article  Google Scholar 

  9. Ng, R., Ramamoorthi, R., Hanrahan, P.: Triple product wavelet integrals for all-frequency relighting. ACM Trans. Graph. 23(3), 477–487 (2004)

    Article  Google Scholar 

  10. Nielson, G.M., Jung, I.H., Sung, J.: Haar wavelets over triangular domains with applications to multiresolution models for flow over a sphere. In: Proceedings of the 8th conference on Visualization 1997, pp. 143–149 (1997)

  11. Ramamoorthi, R., Hanrahan, P.: An efficient representation for irradiance environment maps. In: Proceedings of SIGGRAPH 2001, pp. 497–500 (2001)

  12. Schröder, P., Sweldens, W.: Spherical wavelets: efficiently representing functions on the sphere. In: Proceedings of SIGGRAPH 1995, pp. 161–172 (1995)

  13. Schröder, P., Sweldens, W.: Spherical wavelets: texture processing. In: Proceedings of EGWR 1995, pp. 252–263 (1995)

  14. Sloan, P.P.: Normal mapping for precomputed radiance transfer. In: Proceedings of I3D 2006, pp. 23–26 (2006)

  15. Sloan, P.P., Hall, J., Hart, J., Snyder, J.: Clustered principal components for precomputed radiance transfer. ACM Trans. Graph. 22(3), 382–391 (2003)

    Article  Google Scholar 

  16. Sloan, P.P., Kautz, J., Snyder, J.: Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In: Proceedings of SIGGRAPH 2002, pp. 527–536 (2002)

  17. Sloan, P.P., Luna, B., Snyder, J.: Local, deformable precomputed radiance transfer. ACM Trans. Graph. 24(3), 1216–1224 (2005)

    Article  Google Scholar 

  18. Tsai, Y.T., Shih, Z.C.: All-frequency precomputed radiance transfer using spherical radial basis functions and clustered tensor approximation. In: Proceedings of SIGGRAPH 2006 (to appear)

  19. Wang, R., Tran, J., Luebke, D.: All-frequency relighting of non-diffuse objects using separable BRDF approximation. In: Proceedings of EGSR 2004, pp. 345–354 (2004)

  20. Wang, R., Tran, J., Luebke, D.: All-frequency interactive relighting of translucent objects with single and multiple scattering. ACM Trans. Graph. 24(3), 1202–1207 (2005)

    Article  Google Scholar 

  21. Wang, R., Tran, J., Luebke, D.: All-frequency relighting of glossy objects. ACM Trans. Graph. (to appear)

  22. Wang, Z., Leung, C.S., Zhu, Y.S., Wong, T.T.: Data compression with spherical wavelets and wavelets for the image-based relighting. Comput. Vision Image Underst. 96(3), 327–344 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Communication and Multimedia Laboratory, Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan

    Wan-Chun Ma, Chun-Tse Hsiao, Ken-Yi Lee, Yung-Yu Chuang & Bing-Yu Chen

Authors
  1. Wan-Chun Ma
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chun-Tse Hsiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ken-Yi Lee
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yung-Yu Chuang
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Bing-Yu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wan-Chun Ma.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Ma, WC., Hsiao, CT., Lee, KY. et al. Real-time triple product relighting using spherical local-frame parameterization. Visual Comput 22, 682–692 (2006). https://doi.org/10.1007/s00371-006-0064-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-006-0064-9

Keywords

Search

Navigation