Real-Time Camera Walks Using Light Fields

  • Biswarup Choudhury
  • Deepali Singla
  • Sharat Chandran
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4338)

Abstract

An interesting alternative to traditional geometry based rendering is Light Field Rendering [1,2]. A camera gantry is used to acquire authentic imagery and detailed novel views are synthetically generated from unknown viewpoints. The drawback is the significant data on disk.

Moving from static images, a walkthrough or a camera walk through the implied virtual world is often desirable but the repeated access of the large data makes the task increasingly difficult. We note that although potentially infinite walkthroughs are possible, for any given path, only a subset of the previously stored light field is required. Our prior work [3] exploited this and reduced the main memory requirement. However, considerable computational burden is encountered in processing even this reduced subset. This negatively impacts real-time rendering.

In this paper, we subdivide the image projection plane into “cells,” each of which gets all its radiance information from the cached portions of the light field at select “nodal points.” Once these cells are defined, the cache is visited systematically to find the radiance efficiently. The net result is real-time camera walks.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Levoy, M., Hanrahan, P.: Light field rendering. In: SIGGRAPH 1996: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, pp. 31–42. ACM Press, New York (1996)CrossRefGoogle Scholar
  2. 2.
    Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The lumigraph. In: SIGGRAPH 1996: Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, pp. 43–54. ACM Press, New York (1996)CrossRefGoogle Scholar
  3. 3.
    Pandey, A., Choudhury, B., Chandran, S.: Efficient lightfield based camera walk. In: Fourth Indian Conference on Computer Vision, Graphics and Image Processing ICVGIP, pp. 302–307 (2004)Google Scholar
  4. 4.
    Debevec, P., Gortler, S.: Image-based modeling and rendering. In: SIGGRAPH 1998 Course Notes. ACM SIGGRAPH, Addison Wesley, Reading (1998)Google Scholar
  5. 5.
    Shum, H.Y., Wang, L., Chai, J.X., Tong, X.: Rendering by Manifold Hopping. International Journal of Computer Vision 50, 185–201 (2002)MATHCrossRefGoogle Scholar
  6. 6.
    Chen, S.E.: Quicktime VR: an image-based approach to virtual environment navigation. In: SIGGRAPH 1995: Proceedings of the 22nd annual conference on Computer graphics and interactive techniques, pp. 29–38. ACM Press, New York (1995)CrossRefGoogle Scholar
  7. 7.
    Unger, J., Wenger, A., Hawkins, T., Gardner, A., Debevec, P.: Capturing and rendering with incident light fields. In: EGRW 2003: Proceedings of the 14th Eurographics workshop on Rendering, Aire-la-Ville, Switzerland, Switzerland, Eurographics Association, pp. 141–149 (2003)Google Scholar
  8. 8.
    Shum, H.Y., He, L.W.: Rendering with concentric mosaics. In: SIGGRAPH 1999: Proceedings of the 26th annual conference on Computer graphics and interactive techniques, pp. 299–306. ACM Press, New York (1999)CrossRefGoogle Scholar
  9. 9.
    Isaksen, A., McMillan, L., Gortler, S.J.: Dynamically reparameterized light fields. In: SIGGRAPH 2000: Proceedings of the 27th annual conference on Computer graphics and interactive techniques, pp. 297–306. ACM Press, New York (2000)CrossRefGoogle Scholar
  10. 10.
    Buehler, C., Bosse, M., McMillan, L., Gortler, S.J., Cohen, M.F.: Unstructured lumigraph rendering. In: SIGGRAPH 2001: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pp. 425–432. ACM Press, New York (2001)CrossRefGoogle Scholar
  11. 11.
    Adelson, E.H., Bergen, J.R.: The Plenoptic Function and the Elements of Early Vision. In: Computational Modeling of Vision Processing, MIT Press, Cambridge (1991)Google Scholar
  12. 12.
    Sloan, P.P., Cohen, M.F., Gortler, S.J.: Time critical lumigraph rendering. In: SI3D 1997: Proceedings of the 1997 symposium on Interactive 3D graphics, p. 17. ACM Press, New York (1997)CrossRefGoogle Scholar
  13. 13.
    Sharma, P., Parashar, A., Banerjee, S., Kalra, P.: An Uncalibrated Lightfield Acquisition System. In: Third Indian Conference on Computer Vision, Graphics and Image Processing ICVGIP, pp. 25–30 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Biswarup Choudhury
    • 1
  • Deepali Singla
    • 1
  • Sharat Chandran
    • 1
  1. 1.Indian Institute of Technology Bombay 

Personalised recommendations