Live Will Never Be the Same!

How Broadcasting Might Influence the Acceptance and Widespread Usage of Augmented Reality
  • Wolfgang Broll
  • Jan Herling
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8844)


While anticipated in Hollywood movies and sci-fi literature, a perfect artifical reality – i.e. the ultimate VR environment – will probably not become real within the next couple of years. However, using Augmented Reality (AR) technologies in order to seamlessly embed artificial content into the real environment, might be a much more feasible way to remove the clear border between reality and virtuality. In this paper we will look into lately developed AR technologies and how they relate to recent trends in movie and TV productions. We will further anticipate what this will mean to live broadcasts and which implications this might have for a widespread individual usage of sophisticated AR technology.


Augmented Reality (AR) Diminished Reality Broadcasting Postproduction Compositing Advertising Seamless integration 


  1. 1.
    Arbeláez, P., Maire, M., Fowlkes, C., Malik, J.: Contour detection and hierarchical image segmentation. IEEE Trans. Pattern Anal. Mach Intell. 33(5), 898–916 (2011)CrossRefGoogle Scholar
  2. 2.
    Barnes, C., Shechtman, E., Finkelstein, A., Goldman, D.B.: Patchmatch: a randomized correspondence algorithm for structural image editing. In: SIGGRAPH, pp. 1–11. ACM, New York (2009)Google Scholar
  3. 3.
    Bay, H., Ess, A., Tuytelaars, T., Van Gool, L.: Speeded-up robust features (surf). Comput. Vis. Image Underst. 110(3), 346–359 (2008)CrossRefGoogle Scholar
  4. 4.
    Debevec, P.: Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Computer Graphics, pp. 189–198. ACM (1998)Google Scholar
  5. 5.
    Enomoto, A., Saito, H.: Diminished reality using multiple handheld cameras. In: ACCV 2007 Workshop on Multidimensional and Multi-view Image Processing (2007)Google Scholar
  6. 6.
    Franke, T.A.: Delta light propagation volumes for mixed reality. In: Proceedings of 2013 IEEE International Symposium on Mixed and Augmented Reality (IEEE ISMAR 2013). IEEE Computer Society, Piscataway (2013)Google Scholar
  7. 7.
    Gordon, I., Lowe, D.G.: What and where: 3D object recognition with accurate pose. In: Ponce, J., Hebert, M., Schmid, C., Zisserman, A. (eds.) Toward Category-Level Object Recognition. LNCS, vol. 4170, pp. 67–82. Springer, Heidelberg (2006) CrossRefGoogle Scholar
  8. 8.
    Grosch, T., Eble, T., Mueller, S.: Consistent interactive augmentation of live camera images with correct near-field illumination. In: Proceedings of the 2007 ACM Symposium on Virtual Reality Software and Technology (ACM VRST 2007), pp. 125–132. ACM, New York (2007)Google Scholar
  9. 9.
    Herling, J., Broll, W.: The ocean framework: providing the basis for next-gen MR applications. In: Proceedings of the IEEE Virtual Reality 2010 Workshop, 3rd Workshop on Software Engineering and Architectures for Realtime Interactive Systems, SEARIS 2010 (2010)Google Scholar
  10. 10.
    Herling, J., Broll, W.: PixMix: a real-time approach to high-quality diminished reality. In: 11th IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2012, USA, pp. 141–150. IEEE, November 2012Google Scholar
  11. 11.
    Herling, J., Broll, W.: Random model variation for universal feature tracking. In: Proceedings of the 18th ACM Symposium on Virtual Reality Software and Technology, VRST 2012, pp. 169–176. ACM, New York (2012)Google Scholar
  12. 12.
    Herling, J., Broll, W.: High-quality real-time video inpainting with pixmix. IEEE Trans. Vis. Comput. Graph. 20(6), 866–879 (2014)CrossRefGoogle Scholar
  13. 13.
    Kawai, N., Sato, T., Yokoya, N.: Diminished reality considering background structures. In: 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 259–260, October 2013Google Scholar
  14. 14.
    Klein, G., Murray, D.: Parallel tracking and mapping for small AR workspaces. In: Proceedings of ISMAR 2007, Washington, DC, USA, pp. 1–10 (2007)Google Scholar
  15. 15.
    Lensing, P., Broll, W.: Instant indirect illumination for dynamic mixed reality scenes. In: Proceedings of the 11th IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE Computer Society, Piscataway (2012)Google Scholar
  16. 16.
    Newcombe, R.A., Davison, A.J., Izadi, S., Kohli, P., Hilliges, O., Shotton, J., Molyneaux, D., Hodges, S., Kim, D., Fitzgibbon, A.: Kinectfusion: real-time dense surface mapping and tracking. In: Proceedings of the 10th IEEE International Symposium on Mixed and Augmented Reality, pp. 127–136. IEEE Computer Society, Piscataway, October 2011Google Scholar
  17. 17.
    Reitmayr, G., Drummond, T.: Going out: robust model-based tracking for outdoor augmented reality. In: Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality, ISMAR 2006, pp. 109–118. IEEE Computer Society, Washington, DC (2006)Google Scholar
  18. 18.
    Rother, C., Kolmogorov, V., Blake, A.: “grabcut”: interactive foreground extraction using iterated graph cuts. In: SIGGRAPH, pp. 309–314. ACM, New York (2004)Google Scholar
  19. 19.
    Simakov, D., Caspi, Y., Shechtman, E., Irani, M.: Summarizing visual data using bidirectional similarity. In: CVPR, IEEE (2008)Google Scholar
  20. 20.
    Tomasland: American football sample scene “jake delhomme goes deep” (2009)., available under cc 2.0.
  21. 21.
    Wexler, Y., Shechtman, E., Irani, M.: Space-time completion of video. IEEE Trans. Pattern Anal. Mach. Intell. 29(3), 463–476 (2007)CrossRefGoogle Scholar
  22. 22.
    Wuest, H., Stricker, D.: Tracking of industrial objects by using cad models. JVRB J. Virtual Reality Broadcast. 4(1) (2007). URN: urn:nbn:de:0009-6-11595Google Scholar
  23. 23.
    Zokai, S., Esteve, J., Genc, Y. Navab, N.: Multiview paraperspective projection model for diminished reality. In: Proceedings of the 2nd IEEE/ACM International Symposium on Mixed and Augmented Reality, ISMAR 2003, USA, pp. 217–226. IEEE (2003)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Virtual Worlds and Digital Games GroupTU IlmenauIlmenauGermany
  2. 2.fayteq AGErfurtGermany

Personalised recommendations