Abstract
This chapter introduces a new reality interactive theater that combines the 3D Live human capturing system, spatial sound, augmented reality, human-oriented interaction, and ambient intelligence technologies. Actors/Dancers at different places remotely are captured by the 3D Live system and transmitted to the theater place in real time and rendered in 3D form and real size, thus they can play/dance with the local actors/dancers and virtual characters at the same place in real time. Audience interaction is allowed and handled by an Ambient Intelligence (AI) agent to generate new actions for virtual characters and send meaningful interactions to real actors. The spatial sound system provides the real 3D sound and at the same time generates special sound effects such as controlling the sound direction that only allows people in a certain direction to heard it. All these features combined together bring a totally new theater experience to both actors/dancers and audiences, and extend the grammar of the traditional theater.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abowd, G.D.: Context-awareness in wearable and ubiquitous computing. In: Proceedings of the 1st International Symposium on Wearable Computers, pp. 179–180. IEEE Comput. Soc., Cambridge (1997)
ARToolKit. http://www.hitl.washington.edu/artoolkit/
Brockett, O.: The History of the Theater, 5th edn. Allyn and Bacon, Needham Heights (1987)
Carey, R., Bell, G.: The Annotated Vrml 2.0 Reference Manual (1997)
Carlson, M.: Theories of the Theatre: A Historical and Critical Survey, from Greeks to the Present. Cornell University Press, Ithaca (1984)
Cohen, M.: Exclude and include for audio sources and sinks: analogs of mute & solo are deafen & attend. Presence: Teleoperators Virtual Environ. 9(1), 84–96 (2000). http://portal.acm.org/citation.cfm?id=1246867
Dertouzos, M.: The future of computing. Sci. Am. 2(281), 52–55 (1999)
Dow, S., Mehta, M., Harmon, E., MacIntyre, B., Mateas, M.: Presence and engagement in an interactive drama. In: CHI’07: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1475–1484. ACM, New York (2007). http://doi.acm.org/10.1145/1240624.1240847
Fernando, O.N.N., Adachi, K., Cohen, M.: Phantom sources for separation of listening and viewing positions for multipresent avatars in narrowcasting collaborative virtual environments. In: Proc. MNSA: Int. Workshop on Multimedia Network Systems and Applications (in conjunction with ICDCS: 24th Int. Conf. on Distributed Computing Systems), pp. 170–175, Hachiōji, Tokyo (2004)
Fernando, O.N.N., Adachi, K., Duminduwardena, U., Kawaguchi, M., Cohen, M.: Audio narrowcasting and privacy for multipresent avatars on workstations and mobile phones. IEICE Trans. Inf. Syst. E89-D(1), 73–87 (2006). http://ietisy.oxfordjournals.org/cgi/content/refs/E89-D/1/73
Gaver, W.W.: Auditory icons: using sound in computer interfaces. Hum.–Comput. Interact. 2(2), 167–177 (1986)
Handel, S.: Listening: An Introduction to the Perception of Auditory Events. MIT Press, Cambridge (1989)
Horprasert, T.: A statistical approach for robust background subtraction and shadow detection. In: Proc. IEEE ICCV’99 Frame Rate Workshop, Greece, 1999
Istag, scenarios for ambient intelligence in 2010. http://www.cordis.Iu/ist/istag.htm (2001)
Matusik, W., Buehler, C., McMillan, L.: Polyhedral visual hulls for real-time rendering. In: Proceedings of the 12th Eurographics Workshop on Rendering Techniques, 2001
Point Grey Research Inc. http://www.ptgrey.com
Qui, T.C.T., Nguyen, T.H.D., Mallawaarachchi, A., Xu, K., Liu, W., Lee, S.P., Zhou, Z.Y., Teo, S.L., Teo, H.S., Thang, L.N., Li, Y., Cheok, A.D., Kato, H.: Magic land: live 3d human capture mixed reality interactive system. In: CHI’05 Extended Abstracts on Human Factors in Computing Systems, pp. 1142–1143. ACM, New York (2005). http://doi.acm.org/10.1145/1056808.1056853
Reeves, B., Nass, C.: The Media Equation. Cambridge University Press, Cambridge (1996)
RGB “Bayer” Color and MicroLenses. http://www.siliconimaging.com/RGB
Rocchesso, D., Bresin, R., Fernström, M.: Sounding objects. IEEE Multimed. 10(2), 42–52 (2003). http://dx.doi.org/10.1109/MMUL.2003.1195160
Rumsey, F.: Spatial Audio. Focal Press, Boston and Oxford (2001)
Satyanarayanan, M.: Pervasive computing: vision and challenges. IEEE Pers. Commun. 8(4), 10–17 (2001). doi:10.1109/98.943998
Sparacino, F.: Directive: choreographing media for interactive virtual environments. Master Thesis, MIT Media Lab (1996)
Sparacino, F., Hall, K., Wren, C., Davenport, G., Pentland, A.: Improvisational theater space. In: The Sixth Biennial Symposium for Arts and Technology, Connecticut College, New London, 1997
Sparacino, F., Davenport, G., Pentland, A.: Media in performance: interactive spaces for dance, theater, circus and museum exhibits. IBM Syst. J. 39(3), 479 (2000). http://portal.acm.org/citation.cfm?id=1011424
Väänänen, R.: Parametrization, auralization, and authoring of room acoustics for virtual reality applications. Ph.D. Dissertation, Department of Electrical and Communications Engineering, Helsinki University of Technology, Espoo, Finland (2003)
Vasilakos, A., Pedrycz, W.: Ambient Intelligence, Wireless Networking, Ubiquitous Computing. Artech House, Norwood (2006)
Zhao, Y., amd Hui Xiang, Q.Z., Shi, J.: A simplified model for generating 3d realistic sound in multimedia and vr systems. Comput. Sci. Technol. 11(2), 461–470 (1996)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Copyright information
© 2010 Springer-Verlag London Limited
About this chapter
Cite this chapter
Cheok, A.D. (2010). Interactive Theater Experience with 3D Live Captured Actors and Spatial Sound. In: Art and Technology of Entertainment Computing and Communication. Springer, London. https://doi.org/10.1007/978-1-84996-137-0_3
Download citation
DOI: https://doi.org/10.1007/978-1-84996-137-0_3
Publisher Name: Springer, London
Print ISBN: 978-1-84996-136-3
Online ISBN: 978-1-84996-137-0
eBook Packages: Computer ScienceComputer Science (R0)