We present a novel technique for capturing spatially or temporally resolved light probe sequences, and using them for image based lighting. For this purpose we have designed and built a real-time light probe, a catadioptric imaging system that can capture the full dynamic range of the lighting incident at each point in space at video frame rates, while being moved through a scene. The real-time light probe uses a digital imaging system which we have programmed to capture high quality, photometrically accurate color images of 512×512 pixels with a dynamic range of 10000000:1 at 25 frames per second.
By tracking the position and orientation of the light probe, it is possible to transform each light probe into a common frame of reference in world coordinates, and map each point and direction in space along the path of motion to a particular frame and pixel in the light probe sequence. We demonstrate our technique by rendering synthetic objects illuminated by complex real world lighting, first by using traditional image based lighting methods and temporally varying light probe illumination, and second an extension to handle spatially varying lighting conditions across large objects and object motion along an extended path.
This is a preview of subscription content, log in to check access.
Buy single article
Instant access to the full article PDF.
Tax calculation will be finalised during checkout.
Subscribe to journal
Immediate online access to all issues from 2019. Subscription will auto renew annually.
Tax calculation will be finalised during checkout.
Adelson, E.H., Bergen, J.R.: Computational Models of Visual Processing, The Plenoptic Function and the Elements of Early Vision, chap. 1. MIT Press, Cambridge, MA (1991)
Blinn, J.F.: Texture and reflection in computer generated images. Commun. ACM 19(10), 542–547 (1976)
Debevec, P.: Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proceedings of SIGGRAPH 98 (1998)
Debevec, P., Hawkins, T., Tchou, C., Duiker, H.P., Sarokin, W., Sagar, M.: Acquiring the reflectance field of a human face. In: Proceedings of SIGGRAPH 2000, pp. 145–156 (2000)
Debevec, P.E., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: Proceedings of SIGGRAPH 97, pp. 369–378 (1997)
Gortler, S.J., Grzeszczuk, R., Szeliski, R., Cohen, M.F.: The Lumigraph. In: Proceedings of SIGGRAPH 96, pp. 43–54 (1996)
Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: High dynamic range video. ACM Trans. Graph. 22(3), 319–325 (2003)
Krawczyk, G., Goesele, M., Seidel, H.P.: Photometric Calibration of High Dynamic Range Cameras. Tech. Rep. Research Report MPI-I-2005-4-005 (2005)
Levoy, M., Hanrahan, P.: Light field rendering. In: Proceedings of SIGGRAPH 96, pp. 31–42 (1996)
Madden, B.C.: Extended Intensity Range Imaging. Tech. Rep., GRASP Laboratory, University of Pennsylvania (1993)
Mann, S., Picard, R.W.: Being undigital with digital cameras: Extending dynamic range by combining differently exposed pictures. In: Proceedings of IS&T 46th Annual Conference, pp. 422–428 (1995)
Masselus, V., Peers, P., Dutre, P., Willems, Y.D.: Relighting with 4D incident light fields. ACM Trans. Graph. 22(3), 613–620 (2003)
Miller, G.S., Hoffman, C.R.: Illumination and reflection maps: Simulated objects in simulated and real environments. In: SIGGRAPH 84 Course Notes for Advanced Computer Graphics Animation (1984)
Mitsunaga, T., Nayar, S.: Radiometric self calibration. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 374–380 (1999)
Nayar, S., Mitsunaga, T.: High dynamic range imaging: spatially varying pixel exposures. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, pp. 472–479 (2000)
Reinhard, E., Ward, G., Pattanaik, S., Debevec, P.: High Dynamic Range Imaging, Acquisition, Display and Image-Based Lighting. Morgan Kaufmann, San Francisco, CA (2006)
Robertson, M.A., Borman, S., Stevenson, R.L.: Dynamic range improvement through multiple exposures. In: IEEE International Conference on Image Processing, pp. 159–163 (1999)
Sato, I., Sato, Y., Ikeuchi, K.: Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Trans. Visual. Comput. Graph. 5(1), 1–12 (1999)
Swaminathan, R., Grossberg, M.D., Nayar, S.K.: Non-single viewpoint catadioptric cameras: geometry and analysis. Int. J. Comput. Vision 66(3), 211–229 (2006)
Unger, J., Gustavson, S.: High-dynamic-range video for photometric measurement of illumination. In: Proceedings of Sensors, Cameras and Systems for Scientific/Industrial Applications X, IS&T/SPIE 19th International Symposium on Electronic Imaging, vol. 6501 (2007)
Unger, J., Gustavson, S., Ollila, M., Johannesson, M.: A real time light probe. In: Proceedings of the 25th Eurographics Annual Conference, vol. Short Papers and Interactive Demos, pp. 17–21 (2004)
Unger, J., Gustavson, S., Ynnerman, A.: Densely sampled light probe sequences for image based lighting. In: In Proceedings of the 4th International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, vol. Conference Proceedings (2006)
Unger, J., Wenger, A., Hawkins, T., Gardner, A., Debevec, P.: Capturing and rendering with incident light fields. In: EGRW ’03: Proceedings of the 14th Eurographics Workshop on Rendering, pp. 141–149. Eurographics Association, Aire-la-Ville, Switzerland, Switzerland (2003)
Waese, J., Debevec, P.: A real-time high dynamic range light probe. In: Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques: Conference Abstracts and Applications, p. 247. ACM/Addison-Wesley, New York (2002)
Ward, G.: Real pixels. In: Graphics Gems II, pp. 80–83 (1991)
About this article
Cite this article
Unger, J., Gustavson, S. & Ynnerman, A. Spatially varying image based lighting by light probe sequences. Visual Comput 23, 453–465 (2007). https://doi.org/10.1007/s00371-007-0127-6
- High dynamic range imaging
- Image based lighting