Abstract
Many computational photography applications require the user to take multiple pictures of the same scene with different camera settings. While this allows to capture more information about the scene than what is possible with a single image, the approach is limited by the requirement that the images be perfectly registered. In a typical scenario the camera is hand-held and is therefore prone to moving during the capture of an image burst, while the scene is likely to contain moving objects. Combining such images without careful registration introduces annoying artifacts in the final image. This paper presents a method to register exposure stacks in the presence of both camera motion and scene changes. Our approach warps and modifies the content of the images in the stack to match that of a reference image. Even in the presence of large, highly non-rigid displacements we show that the images are correctly registered to the reference.
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
Download to read the full chapter text
Chapter PDF
Similar content being viewed by others
References
Ward, G.: Fast, robust image registration for compositing high-dynamic range photographs from handheld exposures. Journal of Graphics Tools 8, 17–30 (2003)
Tzimiropoulos, G., Argyriou, V., Zafeiriou, S., Stathaki, T.: Robust FFT-based scale-invariant image registration with image gradients. IEEE Trans. on PAMI 32, 1899–1906 (2010)
Tomaszewska, A., Mantiuk, R.: Image registration for multi-exposure high dynamic range image acquisition. In: Proc. of International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, pp. 49–56 (2007)
Jacobs, K., Loscos, C., Ward, G.: Automatic high-dynamic range image generation for dynamic scenes. IEEE CG&A 28, 84–93 (2008)
Gallo, O., Gelfand, N., Chen, W., Tico, M., Pulli, K.: Artifact-free high dynamic range imaging. In: Proc. of IEEE ICCP, pp. 1–7 (2009)
Reinhard, E., Heidrich, W., Pattanaik, S., Debevec, P., Ward, G., Myszkowski, K.: High Dynamic Range Imaging: Acquisition, Display and Image-Based Lighting. Morgan Kaufmann (2010)
Mann, S., Picard, R.: Being ‘undigital’ with digital cameras: Extending dynamic range by combining differently exposed pictures. In: Proc. of IS&T, pp. 422–428 (1995)
Debevec, P.E., Malik, J.: Recovering high dynamic range radiance maps from photographs. In: ACM ToG (Proceedings of SIGGRAPH), pp. 369–378 (1997)
Akyüz, A.O., Reinhard, E.: Noise reduction in high dynamic range imaging. Journal of Visual Communication and Image Representation 18, 366–376 (2007)
Hasinoff, S.W., Durand, F., Freeman, W.T.: Noise-optimal capture for high dynamic range photography. In: Proc. of IEEE CVPR, pp. 553–560 (2010)
Granados, M., Ajdin, B., Wand, M., Theobalt, C., Seidel, H., Lensch, H.: Optimal HDR reconstruction with linear digital cameras. In: Proc. of IEEE CVPR, pp. 215–222 (2010)
Robertson, M.A., Borman, S., Stevenson, R.L.: Estimation-theoretic approach to dynamic range enhancement using multiple exposures. Journal of Electronic Imaging 12, 219–228 (2003)
Pece, F., Kautz, J.: HDR for dynamic scenes. In: Proc. of Conference for Visual Media Production (2010)
Eden, A., Uyttendaele, M., Szeliski, R.: Seamless image stitching of scenes with large motions and exposure differences. In: Proc. of IEEE CVPR, vol. 2, pp. 2498–2505 (2006)
Khan, E., Akyüz, A., Reinhard, E.: Ghost removal in high dynamic range images. In: Proc. of IEEE ICIP, pp. 2005–2008 (2006)
Zhang, W., Cham, W.K.: Gradient-directed composition of multi-exposure images. In: Proc. of IEEE CVPR, pp. 530–536 (2010)
Kang, S.B., Uyttendaele, M., Winder, S., Szeliski, R.: High dynamic range video. In: ACM ToG (Proceedings of SIGGRAPH), pp. 319–325 (2003)
Zimmer, H., Bruhn, A., Weickert, J.: Freehand HDR imaging of moving scenes with simultaneous resolution enhancement. In: CGF (Proc. of Eurographics), vol. 2, pp. 405–414 (2011)
Mertens, T., Kautz, J., Reeth, F.V.: Exposure fusion: A simple and practical alternative to high dynamic range photography. In: CGF, pp. 161–171 (2008)
HaCohen, Y., Shechtman, E., Goldman, D.B., Lischinski, D.: Non-rigid dense correspondence with applications for image enhancement. In: ACM ToG (Proceedings of SIGGRAPH), vol. 30, pp. 70:1–70:9 (2011)
Zwicker, M., Pfister, H., van Baar, J., Gross, M.: Surface splatting. In: ACM ToG (Proceedings of SIGGRAPH), pp. 371–378 (2001)
Liu, C., Yuen, J., Torralba, A.: SIFT flow: Dense correspondence across scenes and its applications. IEEE Trans. on PAMI, 978–994 (2011)
Brox, T., Malik, J.: Large displacement optical flow: descriptor matching in variational motion estimation. IEEE Trans. on PAMI, 500–513 (2011)
Kim, S.J., Lin, H.T., Lu, Z., Susstrunk, S., Lin, S., BrownHai, M.S.: A new in-camera imaging model for color computer vision and its application. IEEE Trans. on PAMI (2012)
Tico, M., Pulli, K.: Image enhancement method via blur and noisy image fusion. In: Proc. of ICIP, pp. 1521–1524 (2009)
Mann, S.: Comparametric equations with practical applications in quantigraphic image processing. IEEE Trans. on Image Processing 9, 1389–1406 (2000)
Grossberg, M., Nayar, S.: Determining the Camera Response from Images: What is Knowable? IEEE Trans. on PAMI 25, 1455–1467 (2003)
Pérez, P., Gangnet, M., Blake, A.: Poisson image editing. ACM ToG 22, 313–318 (2003)
http://www.mia.uni-saarland.de/Research/SR-HDR/limitations.shtml (accessed on March 3, 2012)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hu, J., Gallo, O., Pulli, K. (2012). Exposure Stacks of Live Scenes with Hand-Held Cameras. In: Fitzgibbon, A., Lazebnik, S., Perona, P., Sato, Y., Schmid, C. (eds) Computer Vision – ECCV 2012. ECCV 2012. Lecture Notes in Computer Science, vol 7572. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-33718-5_36
Download citation
DOI: https://doi.org/10.1007/978-3-642-33718-5_36
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-33717-8
Online ISBN: 978-3-642-33718-5
eBook Packages: Computer ScienceComputer Science (R0)