Responsive Multimedia System for Virtual Storytelling

  • Youngho Lee
  • Sejin Oh
  • Youngmin Park
  • Beom-Chan Lee
  • Jeung-Chul Park
  • Yoo Rhee Oh
  • Seokhee Lee
  • Han Oh
  • Jeha Ryu
  • Kwan H. Lee
  • Hong Kook Kim
  • Yong-Gu Lee
  • JongWon Kim
  • Yo-Sung Ho
  • Woontack Woo
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3767)

Abstract

In this paper, we propose Responsive Multimedia System (RMS) for a virtual storytelling. It consists of three key components; Multi-modal Tangible User Interface (MTUI), a Unified Context-aware Application Model for Virtual Environments (vr-UCAM), and Virtual Environment Manager (VEManager). MTUI allows users to interact with virtual environments (VE) through human’s senses by exploiting tangible, haptic and vision-based interfaces. vr-UCAM decides reactions of VE according to multi-modal input. VEManager generates dynamic VE by applying the reactions and display it through 3D graphics and 3D sounds, etc. To demonstrate an effectiveness of the proposed system, we implemented a virtual storytelling system which unfolds a legend of Unju Temple. We believe the proposed system plays an important role in implementing various entertainment applications.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Bobick, A., Intille, S., et al.: The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment. Technical report. MIT Media Laboratory, Cambridge (1996)Google Scholar
  2. 2.
    Roussos, M., Johnson, A., Leigh, J., Barnes, C., Vasilakis, C., Moher, T.: The NICE project: Narrative, Immersive, Constructionist/Collaborative Environments for Learning in Virtual Reality. In: Proceedings of ED-MEDIA/ED-TELECOM 1997, Calgary, Canada, June 1997, pp. 917–922 (1997)Google Scholar
  3. 3.
    Larsen, C.B., Petersen, B.C.: Interactive Storytelling in a Multimodal Environment, Aalborg University, Institute of Electronic Systems (1999)Google Scholar
  4. 4.
    Lee, S., Lee, Y., Jang, S., Woo, W.: vr-UCAM: Unified Context-aware Application Module for Virtual Reality. In: ICAT, pp. 495–498 (2004)Google Scholar
  5. 5.
    Oh, S., Lee, Y., Woo, W.: vr-UCAM2.0: A Unified Context-aware Application Model for Virtual Environments. In: ubiCNS (2005)Google Scholar
  6. 6.
    Hall, D.L.: An Introduction to Multisensor Data Fusion. Proc. of the IEEE 85(1), 6–23 (1997)CrossRefGoogle Scholar
  7. 7.
    Dasarathy, B.V.: Sensor fusion potential exploitation: Innovative architectures and illustrative approaches. Proc. IEEE 85, 24–38 (1997)CrossRefGoogle Scholar
  8. 8.
    Ishii, H., Ullmer, B.: Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In: Proc. of ACM CHI, March 1997, pp. 234–241 (1997)Google Scholar
  9. 9.
    Oh, S., Woo, W.: Manipulating multimedia contents with tangible media control system. In: Rauterberg, M. (ed.) ICEC 2004. LNCS, vol. 3166, pp. 57–67. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  10. 10.
    Park, Y., Woo, W.: Context based AR Interaction Table using Tangible Objects. In: ubiCNS (2005)Google Scholar
  11. 11.
    Salisbury, K., Barbagli, F., Conti, F.: Haptic Rendering: Introductory Concepts. IEEE Computer Graphics and Applications 24(2), 24–32 (2004)CrossRefGoogle Scholar
  12. 12.
    Kim, J.-P., Lee, B.-C., Ryu, J.: Haptic Rendering with Six Virtual Cameras. In: HCI international (2005) (accepted)Google Scholar
  13. 13.
  14. 14.
    Hiltmann, Y.: Miruk: Die Heiligen Steine Koreas. Qumran im Campus Verlag (edn.) (1993)Google Scholar
  15. 15.
    Lee, Y., Oh, S., Woo, W.: A Responsive Multimedia System (RMS): VR Platform for Immersive Multimedia with Stories. In: ICVS 2005 (2005) (accepted) Google Scholar
  16. 16.
    Jang, S., Woo, W.: Unified Context Representing User-Centric Context: Who, Where, When, What, How and Why. In: 1st International Workshop on Personalized Context Modeling and Management for UbiComp Applications (accepted)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Youngho Lee
    • 1
  • Sejin Oh
    • 1
  • Youngmin Park
    • 1
  • Beom-Chan Lee
    • 2
  • Jeung-Chul Park
    • 3
  • Yoo Rhee Oh
    • 4
  • Seokhee Lee
    • 6
  • Han Oh
    • 7
  • Jeha Ryu
    • 2
  • Kwan H. Lee
    • 3
  • Hong Kook Kim
    • 4
  • Yong-Gu Lee
    • 5
  • JongWon Kim
    • 6
  • Yo-Sung Ho
    • 7
  • Woontack Woo
    • 1
  1. 1.GIST U-VR Lab.GwangjuS.Korea
  2. 2.Human-Machine-Computer Interface Lab 
  3. 3.Intelligent Design & Graphics Lab 
  4. 4.Speech, Audio, and Language Communications Lab 
  5. 5.Nanoscale Simulation Lab 
  6. 6.Network Media Lab 
  7. 7.Visual Communications Lab 

Personalised recommendations