Abstract
Projection-based mixed reality is an effective tool to create immersive visualizations on real-world objects. Its wide range of applications includes art installations, education, stage shows, and advertising. In this work, we enhance a multi-projector system for dynamic projection mapping by handling various physical stray-light effects: interreflection, projector black-level, and environmental light in real time for dynamic scenes. We show how all these effects can be efficiently simulated and accounted for at runtime, resulting in significantly improved projection mapping results. By adding a global optimization step, we can further increase the dynamic range of the projection.
References
Siegl, C.; Colaianni, M.; Thies, L.; Thies, J.; Zollhöfer, M.; Izadi, S.; Stamminger, M.; Bauer, F. Realtime pixel luminance optimization for dynamic multiprojection mapping. ACM Transactions on Graphics Vol. 34, No. 6, Article No. 237, 2015.
Goral, C. M.; Torrance, K. E.; Greenberg, D. P.; Battaile, B. Modeling the interaction of light between diffuse surfaces. In: Proceedings of the 11th Annual Conference on Computer Graphics and Interactive Techniques, 213–222, 1984.
Sloan, P.-P.; Kautz, J.; Snyder, J. Precomputed radiance transfer for real-time rendering in dynamic, low-frequency lighting environments. In: Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, 527–536, 2002.
Raskar, R.; Welch, G.; Low, K. L.; Bandyopadhyay, D. Shader lamps: Animating real objects with image-based illumination. In: Rendering Techniques 2001. Gortler, S. J.; Myszkowski, K. Eds. Springer Vienna, 89–102, 2001.
Bimber, O.; Grundhöfer, A.; Wetzstein, G.; Knodel, S. Consistent illumination within optical see-through augmented environments. In: Proceedings of the 2nd IEEE and ACM International Symposium on Mixed and Augmented Reality, 198–207, 2003.
Bimber, O.; Grundhöfer, A.; Zeidler, T.; Danch, D.; Kapakos, P. Compensating indirect scattering for immersive and semi-immersive projection displays. In: Proceedings of the IEEE Virtual Reality Conference, 151–158, 2006.
Bermano, A.; Brüschweiler, P.; Grundhöfer, A.; Iwai, D.; Bickel, B.; Gross, M. Augmenting physical avatars using projector-based illumination. ACM Transactions on Graphics Vol. 32, No. 6, Article No. 189, 2013.
Sheng, Y.; Cutler, B.; Chen, C.; Nasman, J. Perceptual global illumination cancellation in complex projection environments. Computer Graphics Forum Vol. 30, No. 4, 1261–1268, 2011.
Debevec, P. Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proceedings of the ACM SIGGRAPH 2008 Classes, Article No. 32, 2008.
Grundhöfer, A. Practical non-linear photometric projector compensation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, 924–929, 2013.
Lange, V.; Siegl, C.; Colaianni, M.; Kurth, P., Stamminger, M.; Bauer, F. Interactive painting and lighting in dynamic multi-projection mapping. In: Augmented Reality, Virtual Reality, and Computer Graphics. De Paolis, L.; Mongelli, A. Eds. Springer Cham, 113–125, 2016.
Author information
Authors and Affiliations
Corresponding author
Additional information
This article is published with open access at Springerlink.com
Christian Siegl is a Ph.D. candidate at the Computer Graphics Group of the University of Erlangen-Nuremberg. His research is focused on mixed reality using projection mapping, medical image processing, and the virtual creation of apparel.
Matteo Colaianni is a Ph.D. candidate at the Computer Graphics Group of the University of Erlangen- Nuremberg. His focus of research is geometry processing in the field of apparel development as well as statistical shape analysis.
Marc Stamminger is a professor for visual computing at the Computer Graphics Group of the University of Erlangen-Nuremberg since 2002. His research is focused on real-time visual computing, in particular rendering, visualization, interactive computer vision systems, and augmented and mixed reality.
Frank Bauer is a research fellow at the Computer Graphics Group of the University of Erlangen-Nuremberg. His research is focused on 3D scene reconstruction, augmented, mixed, and virtual-reality applications, as well as accessible human–machine interactions.
Rights and permissions
Open Access The articles published in this journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www. editorialmanager.com/cvmj.
About this article
Cite this article
Siegl, C., Colaianni, M., Stamminger, M. et al. Adaptive stray-light compensation in dynamic multi-projection mapping. Comp. Visual Media 3, 263–271 (2017). https://doi.org/10.1007/s41095-017-0090-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41095-017-0090-8
Keywords
- mixed reality
- projection mapping
- multiprojector
- real time
- interreflection
- environmental light