Computational Visual Media

, Volume 3, Issue 3, pp 263–271 | Cite as

Adaptive stray-light compensation in dynamic multi-projection mapping

  • Christian Siegl
  • Matteo Colaianni
  • Marc Stamminger
  • Frank Bauer
Open Access
Research Article


Projection-based mixed reality is an effective tool to create immersive visualizations on real-world objects. Its wide range of applications includes art installations, education, stage shows, and advertising. In this work, we enhance a multi-projector system for dynamic projection mapping by handling various physical stray-light effects: interreflection, projector black-level, and environmental light in real time for dynamic scenes. We show how all these effects can be efficiently simulated and accounted for at runtime, resulting in significantly improved projection mapping results. By adding a global optimization step, we can further increase the dynamic range of the projection.


mixed reality projection mapping multiprojector real time interreflection environmental light 


  1. [1]
    Siegl, C.; Colaianni, M.; Thies, L.; Thies, J.; Zollhöfer, M.; Izadi, S.; Stamminger, M.; Bauer, F. Realtime pixel luminance optimization for dynamic multiprojection mapping. ACM Transactions on Graphics Vol. 34, No. 6, Article No. 237, 2015.Google Scholar
  2. [2]
    Goral, C. M.; Torrance, K. E.; Greenberg, D. P.; Battaile, B. Modeling the interaction of light between diffuse surfaces. In: Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques, 213–222, 1984.Google Scholar
  3. [3]
    Sloan, P.-P.; Kautz, J.; Snyder, J. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, 527–536, 2002.Google Scholar
  4. [4]
    Raskar, R.; Welch, G.; Low, K. L.; Bandyopadhyay, D. Shader lamps: Animating real objects with image-based illumination. In: Rendering Techniques 2001. Gortler, S. J.; Myszkowski, K. Eds. Springer Vienna, 89–102, 2001.CrossRefGoogle Scholar
  5. [5]
    Bimber, O.; Grundhöfer, A.; Wetzstein, G.; Knodel, S. Consistent illumination within optical see-through augmented environments. In: Proceedings of the 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, 198–207, 2003.Google Scholar
  6. [6]
    Bimber, O.; Grundhöfer, A.; Zeidler, T.; Danch, D.; Kapakos, P. Compensating indirect scattering for immersive and semi-immersive projection displays. In: Proceedings of the IEEE Virtual Reality Conference, 151–158, 2006.CrossRefGoogle Scholar
  7. [7]
    Bermano, A.; Brüschweiler, P.; Grundhöfer, A.; Iwai, D.; Bickel, B.; Gross, M. Augmenting physical avatars using projector-based illumination. ACM Transactions on Graphics Vol. 32, No. 6, Article No. 189, 2013.Google Scholar
  8. [8]
    Sheng, Y.; Cutler, B.; Chen, C.; Nasman, J. Perceptual global illumination cancellation in complex projection environments. Computer Graphics Forum Vol. 30, No. 4, 1261–1268, 2011.CrossRefGoogle Scholar
  9. [9]
    Debevec, P. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proceedings of the ACM SIGGRAPH 2008 Classes, Article No. 32, 2008.Google Scholar
  10. [10]
    Grundhöfer, A. Practical non-linear photometric projector compensation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 924–929, 2013.Google Scholar
  11. [11]
    Lange, V.; Siegl, C.; Colaianni, M.; Kurth, P., Stamminger, M.; Bauer, F. Interactive painting and lighting in dynamic multi-projection mapping. In: Augmented Reality, Virtual Reality, and Computer Graphics. De Paolis, L.; Mongelli, A. Eds. Springer Cham, 113–125, 2016.Google Scholar

Copyright information

© The Author(s) 2017

Open Access The articles published in this journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Other papers from this open access journal are available free of charge from To submit a manuscript, please go to https://www.

Authors and Affiliations

  • Christian Siegl
    • 1
  • Matteo Colaianni
    • 1
  • Marc Stamminger
    • 1
  • Frank Bauer
    • 1
  1. 1.Computer Graphics GroupUniversity of Erlangen-NurembergErlangenGermany

Personalised recommendations