Virtual Reality

, Volume 15, Issue 4, pp 267–278 | Cite as

Immersive interactive reality: Internet-based on-demand VR for cultural presentation

SI: Cultural Technology

Abstract

This paper presents an Internet-based virtual reality technology, called panoramic broadcasting (PanoCAST) where multiple viewers share an experience yet each having full control of what they see independent from other viewers. Our solution was developed for telepresence-based cultural presentation and entertainment services. The core architecture involves a compact spherical vision system that compresses and transmits data from multiple digital video sources to a central host computer, which in turn distributes the recorded information among multiple render- and streaming servers for personalized viewing over the Internet or mobile devices. In addition, using advanced computer vision, tracking and animation features, the PanoCAST architecture introduces the notion of Clickable Content Management (CCM), where each visual element in the image becomes a source for providing further information, educational content and cultural detail. Key contributions of our application to advance the state-of-the-art include bringing streaming panoramic video onto mobile platforms, an advanced tracking interface to turn visual elements into sources of interaction, physical simulation to combine the benefits of panoramic video with that of 3D models and animated, photo-realistic faces to help users express their emotions in shared online virtual cultural experiences as well as a feedback mechanism in such environments. Therefore, we argue that the PanoCAST system offers a low-cost and economical solution for personalized content distribution and as such it can serve as a unified basis for novel applications many of which are demonstrated in this paper.

Keywords

Immersive interactive reality Cultural presentation Virtual reality on-demand Virtual human interface Panoramic broadcasting (PanoCAST) 

References

  1. Adobe Flash player (2009) http://www.get.adobe.com/flashplayer/
  2. Baldwin J, Basu A, Zhang H (1999) Panoramic video with predictive windows for telepresence. In: Proceedings of IEEE international conference on roboticsGoogle Scholar
  3. Digital Elite Inc. (2009) http://www.digitalElite.US.com
  4. Fraunhofer HHI, Omnicam (2009) http://www.hhi.fraunhofer.de/
  5. Gross M, Würmlin S et al (2003) Blue-c: a spatially immersive display and 3D video portal for telepresence. ACM Trans Graph 22(3):819–827CrossRefGoogle Scholar
  6. Immersive Interactive Film (2009) “Metamorphosis” film adaptation of Franz Kafka’s short story. http://www.digitalelite.net/Metamorphosis.html
  7. Immersive Media, Dodeca Camera (2009) http://www.immersive-video.eu/en
  8. Interactive Panoramic Cinema (2005) http://www.turbulence.org/blog/archives/000562.html
  9. Kaidan, Go Pano (2009) http://www.kaidan.com/
  10. Kimber D, Foote J (2001) FlyAbout: spatially indexed panoramic video. In: Proceedings of ACM multimedia, OttawaGoogle Scholar
  11. Majumder A, Gopi M, Seales B, Fuchs H (1999) Immersive teleconferencing: a new algorithm to generate seamless panoramic video imagery. In: ACM multimedia, pp 169–178Google Scholar
  12. Neumann U, Pintaric T, Rizzo AA (2000) Immersive panoramic video. In: Proceedings of ACM international conference on multimedia, pp. 493–494Google Scholar
  13. Ng K-T, Chan S-C, Shum H-Y (2001) The compression issues of panoramic video. In: Proceedings of international symposium on intelligent multimedia, video & speech processingGoogle Scholar
  14. Ouglov A, Hjelsvold R (2004) Panoramic video in video-mediated education, in storage and retrieval methods and applications for multimedia 2005. In: Lienhart RW, Babaguchi N, Chang EY (eds) Proceedings of the SPIE, vol 5682, pp 326–336Google Scholar
  15. Patil R, Rybski PE, Kanade T, Veloso MM (2004) People detection and tracking in high resolution panoramic video mosaic. In: Proceedings of IEEE/RSJ international conference on intelligent robots and systems, Sendai, JapanGoogle Scholar
  16. Point Grey Research, LadyBug2 & LadyBug3 Cameras (2009) http://www.ptgrey.com/products/ladybug2/
  17. Pryor L, Rizzo AS (2000) User directed news, http://www.imsc.usc.edu/research/project/udn/udn_nsf.pdf
  18. Qin N, Song D (2007) On-demand sharing of a high-resolution panorama video from networked robotic cameras. In: Proceedings of IEEE international conference on intelligent robots and systems, San DiegoGoogle Scholar
  19. QuickTime, Apple (2009) http://www.apple.com/quicktime/
  20. Remote Reality (2009) http://www.remotereality.com/
  21. Rhee SM, Ziegler R et al (2007) Low-cost telepresence for collaborative virtual environments. IEEE Trans Vis Comput Graph 13(1):156–166CrossRefGoogle Scholar
  22. Rizzo AA, Neumann U, Pintaric T, Norden M (2001) Issues for application development using immersive HMD 360 degree panoramic video environments. In: Smith MJ, Salvendy G, Harris D, Koubek RJ (eds) Usability evaluation and interface design, vol 1. L.A. Erlbaum, New York, pp 792–796Google Scholar
  23. Rizzo AA, Ghahremani K, Pryor L, Gardner S (2003) Immersive 360-degree panoramic video environments: research on creating useful and usable applications. In: Jacko J, Stephanidis C (eds) Human–computer interaction: theory and practice, vol 1. L.A. Erlbaum, New York, pp 1233–1237Google Scholar
  24. Rizzo AA, Pryor L, Matheis R, Schultheis M, Ghahremani1 K, Sey A (2004) Memory assessment using graphics-based and panoramic video virtual environments. In: Proceedings of 5th international conference on disability, virtual reality & association technology, Oxford, UKGoogle Scholar
  25. Sun X, Kimber D, Foote J, Manjunath B (2002) Detecting path intersections in panoramic video. In: IEEE international conference on multimediaGoogle Scholar
  26. Takács B (2005) Special education and rehabilitation: teaching and healing with interactive graphics. IEEE Comput Graph Appl 25(5):40–48CrossRefGoogle Scholar
  27. Takács B (2006) Cognitive, mental and physical rehabilitation using a configurable virtual reality system. Int J Virtual Real 5(4):1–12Google Scholar
  28. Takács B (2007) PanoMOBI: a panoramic mobile entertainment system. In: Proceedings of ICEC07, Shanghai, ChinaGoogle Scholar
  29. Takács B (2008) How and why affordable virtual reality shapes the future education. Int J Virtual Real 7(1):53–66Google Scholar
  30. Takács B, Kiss B (2003) Virtual human interface: a photo-realistic digital human. IEEE Comput Graph Appl 23(5):38–45CrossRefGoogle Scholar
  31. Takács B, Fromherz T, Tice S, Metaxas D (1999) Digital clones and virtual celebrities: facial tracking, gesture recognition and animation for the movie industry. In: Proceedings of ICCV’99, Corfu, GreeceGoogle Scholar
  32. Transparent Telepresence Research Group (2007) http://www.telepresence.strath.ac.uk/telepresence.htm
  33. VirMED (2009) Virtual reality medicine, http://www.virmed.net
  34. Zheng J, Zhang Y, Ni G (2007) A fast global motion estimation method for panoramic video coding. In: Advances in multimedia information processing—PCMGoogle Scholar

Copyright information

© Springer-Verlag London Limited 2010

Authors and Affiliations

  1. 1.Digital Elite Inc.Los AngelesUSA
  2. 2.Technical University of Budapest (BME)BudapestHungary

Personalised recommendations