Abstract
In this paper, we propose Responsive Multimedia System (RMS) for a virtual storytelling. It consists of three key components; Multi-modal Tangible User Interface (MTUI), a Unified Context-aware Application Model for Virtual Environments (vr-UCAM), and Virtual Environment Manager (VEManager). MTUI allows users to interact with virtual environments (VE) through human’s senses by exploiting tangible, haptic and vision-based interfaces. vr-UCAM decides reactions of VE according to multi-modal input. VEManager generates dynamic VE by applying the reactions and display it through 3D graphics and 3D sounds, etc. To demonstrate an effectiveness of the proposed system, we implemented a virtual storytelling system which unfolds a legend of Unju Temple. We believe the proposed system plays an important role in implementing various entertainment applications.
This work was supported in part by CTRC, and in part by MIC through RBRC at GIST.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Bobick, A., Intille, S., et al.: The KidsRoom: A Perceptually-Based Interactive and Immersive Story Environment. Technical report. MIT Media Laboratory, Cambridge (1996)
Roussos, M., Johnson, A., Leigh, J., Barnes, C., Vasilakis, C., Moher, T.: The NICE project: Narrative, Immersive, Constructionist/Collaborative Environments for Learning in Virtual Reality. In: Proceedings of ED-MEDIA/ED-TELECOM 1997, Calgary, Canada, June 1997, pp. 917–922 (1997)
Larsen, C.B., Petersen, B.C.: Interactive Storytelling in a Multimodal Environment, Aalborg University, Institute of Electronic Systems (1999)
Lee, S., Lee, Y., Jang, S., Woo, W.: vr-UCAM: Unified Context-aware Application Module for Virtual Reality. In: ICAT, pp. 495–498 (2004)
Oh, S., Lee, Y., Woo, W.: vr-UCAM2.0: A Unified Context-aware Application Model for Virtual Environments. In: ubiCNS (2005)
Hall, D.L.: An Introduction to Multisensor Data Fusion. Proc. of the IEEE 85(1), 6–23 (1997)
Dasarathy, B.V.: Sensor fusion potential exploitation: Innovative architectures and illustrative approaches. Proc. IEEE 85, 24–38 (1997)
Ishii, H., Ullmer, B.: Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. In: Proc. of ACM CHI, March 1997, pp. 234–241 (1997)
Oh, S., Woo, W.: Manipulating multimedia contents with tangible media control system. In: Rauterberg, M. (ed.) ICEC 2004. LNCS, vol. 3166, pp. 57–67. Springer, Heidelberg (2004)
Park, Y., Woo, W.: Context based AR Interaction Table using Tangible Objects. In: ubiCNS (2005)
Salisbury, K., Barbagli, F., Conti, F.: Haptic Rendering: Introductory Concepts. IEEE Computer Graphics and Applications 24(2), 24–32 (2004)
Kim, J.-P., Lee, B.-C., Ryu, J.: Haptic Rendering with Six Virtual Cameras. In: HCI international (2005) (accepted)
ARToolKit, http://www.hitl.washington.edu/research/shared_space/download
Hiltmann, Y.: Miruk: Die Heiligen Steine Koreas. Qumran im Campus Verlag (edn.) (1993)
Lee, Y., Oh, S., Woo, W.: A Responsive Multimedia System (RMS): VR Platform for Immersive Multimedia with Stories. In: ICVS 2005 (2005) (accepted)
Jang, S., Woo, W.: Unified Context Representing User-Centric Context: Who, Where, When, What, How and Why. In: 1st International Workshop on Personalized Context Modeling and Management for UbiComp Applications (accepted)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, Y. et al. (2005). Responsive Multimedia System for Virtual Storytelling. In: Ho, YS., Kim, H.J. (eds) Advances in Multimedia Information Processing - PCM 2005. PCM 2005. Lecture Notes in Computer Science, vol 3767. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11581772_32
Download citation
DOI: https://doi.org/10.1007/11581772_32
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-30027-4
Online ISBN: 978-3-540-32130-9
eBook Packages: Computer ScienceComputer Science (R0)