The Visual Computer

, Volume 23, Issue 7, pp 453–465 | Cite as

Spatially varying image based lighting by light probe sequences

Capture, processing and rendering
  • Jonas UngerEmail author
  • Stefan Gustavson
  • Anders Ynnerman
Original Article


We present a novel technique for capturing spatially or temporally resolved light probe sequences, and using them for image based lighting. For this purpose we have designed and built a real-time light probe, a catadioptric imaging system that can capture the full dynamic range of the lighting incident at each point in space at video frame rates, while being moved through a scene. The real-time light probe uses a digital imaging system which we have programmed to capture high quality, photometrically accurate color images of 512×512 pixels with a dynamic range of 10000000:1 at 25 frames per second.

By tracking the position and orientation of the light probe, it is possible to transform each light probe into a common frame of reference in world coordinates, and map each point and direction in space along the path of motion to a particular frame and pixel in the light probe sequence. We demonstrate our technique by rendering synthetic objects illuminated by complex real world lighting, first by using traditional image based lighting methods and temporally varying light probe illumination, and second an extension to handle spatially varying lighting conditions across large objects and object motion along an extended path.


High dynamic range imaging Image based lighting 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Adelson, E.H., Bergen, J.R.: Computational Models of Visual Processing, The Plenoptic Function and the Elements of Early Vision, chap. 1. MIT Press, Cambridge, MA (1991)Google Scholar
  2. 2.
    Blinn, J.F.: Texture and reflection in computer generated images. Commun. ACM 19(10), 542–547 (1976)CrossRefGoogle Scholar
  3. 3.
    Debevec, P.: Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proceedings of SIGGRAPH 98 (1998)Google Scholar
  4. 4.
    Debevec, P., Hawkins, T., Tchou, C., Duiker, H.P., Sarokin, W., Sagar, M.: Acquiring the reflectance field of a human face. In: Proceedings of SIGGRAPH 2000, pp. 145–156 (2000)Google Scholar
  5. 5.
    Debevec, P.E., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: Proceedings of SIGGRAPH 97, pp. 369–378 (1997)Google Scholar
  6. 6.
    Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The Lumigraph. In: Proceedings of SIGGRAPH 96, pp. 43–54 (1996)Google Scholar
  7. 7.
    Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: High dynamic range video. ACM Trans. Graph. 22(3), 319–325 (2003)CrossRefGoogle Scholar
  8. 8.
    Krawczyk, G., Goesele, M., Seidel, H.P.: Photometric Calibration of High Dynamic Range Cameras. Tech. Rep. Research Report MPI-I-2005-4-005 (2005)Google Scholar
  9. 9.
    Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of SIGGRAPH 96, pp. 31–42 (1996)Google Scholar
  10. 10.
    Madden, B.C.: Extended Intensity Range Imaging. Tech. Rep., GRASP Laboratory, University of Pennsylvania (1993)Google Scholar
  11. 11.
    Mann, S., Picard, R.W.: Being undigital with digital cameras: Extending dynamic range by combining differently exposed pictures. In: Proceedings of IS&T 46th Annual Conference, pp. 422–428 (1995)Google Scholar
  12. 12.
    Masselus, V., Peers, P., Dutre, P., Willems, Y.D.: Relighting with 4D incident light fields. ACM Trans. Graph. 22(3), 613–620 (2003)CrossRefGoogle Scholar
  13. 13.
    Miller, G.S., Hoffman, C.R.: Illumination and reflection maps: Simulated objects in simulated and real environments. In: SIGGRAPH 84 Course Notes for Advanced Computer Graphics Animation (1984)Google Scholar
  14. 14.
    Mitsunaga, T., Nayar, S.: Radiometric self calibration. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 374–380 (1999)Google Scholar
  15. 15.
    Nayar, S., Mitsunaga, T.: High dynamic range imaging: spatially varying pixel exposures. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 472–479 (2000)Google Scholar
  16. 16.
    Reinhard, E., Ward, G., Pattanaik, S., Debevec, P.: High Dynamic Range Imaging, Acquisition, Display and Image-Based Lighting. Morgan Kaufmann, San Francisco, CA (2006)Google Scholar
  17. 17.
    Robertson, M.A., Borman, S., Stevenson, R.L.: Dynamic range improvement through multiple exposures. In: IEEE International Conference on Image Processing, pp. 159–163 (1999)Google Scholar
  18. 18.
    Sato, I., Sato, Y., Ikeuchi, K.: Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Trans. Visual. Comput. Graph. 5(1), 1–12 (1999)CrossRefGoogle Scholar
  19. 19.
    Swaminathan, R., Grossberg, M.D., Nayar, S.K.: Non-single viewpoint catadioptric cameras: geometry and analysis. Int. J. Comput. Vision 66(3), 211–229 (2006)CrossRefGoogle Scholar
  20. 20.
    Unger, J., Gustavson, S.: High-dynamic-range video for photometric measurement of illumination. In: Proceedings of Sensors, Cameras and Systems for Scientific/Industrial Applications X, IS&T/SPIE 19th International Symposium on Electronic Imaging, vol. 6501 (2007)Google Scholar
  21. 21.
    Unger, J., Gustavson, S., Ollila, M., Johannesson, M.: A real time light probe. In: Proceedings of the 25th Eurographics Annual Conference, vol. Short Papers and Interactive Demos, pp. 17–21 (2004)Google Scholar
  22. 22.
    Unger, J., Gustavson, S., Ynnerman, A.: Densely sampled light probe sequences for image based lighting. In: In Proceedings of the 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, vol. Conference Proceedings (2006)Google Scholar
  23. 23.
    Unger, J., Wenger, A., Hawkins, T., Gardner, A., Debevec, P.: Capturing and rendering with incident light fields. In: EGRW ’03: Proceedings of the 14th Eurographics Workshop on Rendering, pp. 141–149. Eurographics Association, Aire-la-Ville, Switzerland, Switzerland (2003)Google Scholar
  24. 24.
    Waese, J., Debevec, P.: A real-time high dynamic range light probe. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques: Conference Abstracts and Applications, p. 247. ACM/Addison-Wesley, New York (2002)Google Scholar
  25. 25.
    Ward, G.: Real pixels. In: Graphics Gems II, pp. 80–83 (1991)Google Scholar

Copyright information

© Springer-Verlag 2007

Authors and Affiliations

  • Jonas Unger
    • 1
    Email author
  • Stefan Gustavson
    • 1
  • Anders Ynnerman
    • 1
  1. 1.Visual Information Technology and Applications, VITA, Department of Science and TechnologyLinköpings UniversitetNorrköpingSweden

Personalised recommendations