Abstract
The present paper describes a multisensory virtual reality (VR) system built for the exploration of the bodily ultra-reality. First, we introduce a new term ‘ultra-reality’ which was advocated by a government committee to explore future media technology in Japan. The ultra-reality has been recognized from both the aspects of the super-reality and the meta-reality. The author proposed a hypothesis that the ultra-reality has its base on the VR (the second reality), and it is embodied as rational and emotional entity built on pieces of rendered reality. The ultra-reality is the third reality grasped at the cognitive level rather than perception level. The author placed the forth reality hypothesis where the self-body is virtualized by projecting information backward from the body input to the brain. The dynamic virtual body illusion is the objective of the research to create in which the self-body makes a part of VR media to duplicate experience of other person. We consider that multisensory presentation plays a principal role for this bodily ultra-reality. To provide a framework for realization of the ultra-reality, we introduced exhibit prototypes of the multisensory presentation system. The five senses theater system, the FiveStar, provides multisensory stimulations to the user for the creation of ultra-realistic experiences. The contents of the exhibits were the mixed reality bodily experience, the interaction with CG creature, and the virtual first-person trip to the tourist sites. The multisensory display devices that were used to create the bodily ultra-reality were described to show the method and characteristics of this hypothesis.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Notes
- 1.
The Ultra-Realistic Communications Forum.
- 2.
Devices similar to an exoskeleton mechanism that assists user’s movement.
- 3.
In the title of ‘Ultra-ordinary experience through five senses media’.
References
H. Andoh. Factors of the sense of presence, chapter 6.2.2. VRSJ, 2010.
O. Blanke. Multisensory brain mechanisms of bodily self-consciousness. Nature reviews. Neuroscience, 13(8):556–71, aug 2012.
M. Botvinick and J. Cohen. Rubber hands ’feel’ touch that eyes see. Nature, 391:756, 1998.
K. E. Cullen. Sensory signals during active versus passive movement. Current Opinion in Neurobiology, 14:698–706, 2004.
P. K. Dick. Total Recall. Gollancz, 2012.
M. R. Dimitrijevic, Y. Gerasimenko, and M. M. Pinter. Evidence for a spinal central pattern generator in humans. Annals Of The New York Academy Of Sciences, 860(1):360–376, 1998.
K. Enami, M. Katsumoto, and R. Nishimura. Current techniques for. The Journal of the Acoustical Society of Japan, 64:322–327, 2008.
P. Haggard. Conscious intention and motor cognition. Trends in cognitive sciences, 9(6):290–5, Jun 2005.
N. K. Hayles. How We Became Posthuman: Virtual Bodies in Cybernetics, Literature, and Informatics, volume 4. 1999.
G. H. D. Hecht, M. Reiner. Multimodal virtual environments: Response times, attention, and presence. Presence: Teleoperators and Virtual Environments, pages 515–523, 2006.
R. M. Held and N. I. Durlack. Telepresence. Presence: Teleoperators and Virtual Environ- ments, 1:109–112, 2015.
Y. Ikei, K. Abe, K. Hirota, and T. Amemiya. A multisensory vr system exploring the ultra- reality. In Proc. VSMM2012, pages 71–78, 2012.
F. M. Lambert, D. Combes, J. Simmers, and H. Straka. Gaze Stabilization by Efference Copy Signaling without Sensory Feedback during Vertebrate Locomotion. Current Biology, pages 1–10, 2012.
J. M. Loomis. Distal attribution and presence. Presence: Teleoperators and virtual environ- ments, 1, pp., 1:113–119, 1992.
J. Perry. Gait Analysis: Normal and Pathological Function, volume 12. 1992.
V. I. Petkova and H. H. Ehrsson. If I Were You: Perceptual Illusion of Body Swapping. PLoS ONE, 3:9, 2008.
S. Rossignol, R. Dubuc, and J.-P. Gossard. Dynamic sensorimotor interactions in locomotion. Physiol Rev, 86(Physiol Rev 86: 89154, 2006;):89–154, 2006.
T. B. Sheridan. Musings on telepresence and virtual presence. Presence: Teleoperators and virtual environments, (1):120–126, 1992.
S. Shimojo. pages 21–29. 2015.
M. Shirow. Ghost in the Shell. Dark Horse Comics, 1996.
A. S. M. Slater. A virtual presence counter. Presence: Teleoperators and virtual environments, 9:413–434, 2000.
M. Slater, E. D, S. H, and V. M. Inducing illusory ownership of a virtual body. Frontiers in neuroscience, 3(2):214–20, 2009.
M. Slater, J. McCarthy, and F. Maringelli. The influence of body movement on subjective presence in virtual environments. Human Factors: The Journal of the Human Factors and Ergonomics Society, 1998.
S. Tachi, M. Sato, and M. Hirose. Virtual Reality. Corona Publishing Co.,LTD., 2010.
M. W. Whittle. An Introduction to Gait Analysis. 2007.
B. G. Witmer and M. J. Singer. Measuring presence in virtual environments: A presence questionnaires. Presence: Teleoperators and Virtual Environments, 7(3):225–240, 1998.
Acknowledgements
The authors wish to thank Professor Michitaka Hirose at the University of Tokyo for his valuable advice on the present research. We thank Dr. Koji Abe for his great contribution to the virtual trip project. This research was supported by the MIC/SCOPE #141203019 and a Grant-in-Aid for Scientific Research (A) from MEXT, and a past funding for the ultra-realistic communications technologies of NICT in Japan.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Ikei, Y., Hirota, K., Amemiya, T., Kitazaki, M. (2016). Five Senses Theater: A Multisensory Display for the Bodily Ultra-Reality. In: Fukuda, S. (eds) Emotional Engineering Volume 4. Springer, Cham. https://doi.org/10.1007/978-3-319-29433-9_8
Download citation
DOI: https://doi.org/10.1007/978-3-319-29433-9_8
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-29432-2
Online ISBN: 978-3-319-29433-9
eBook Packages: EngineeringEngineering (R0)