Skip to main content

Five Senses Theater: A Multisensory Display for the Bodily Ultra-Reality

  • Chapter
  • First Online:
Emotional Engineering Volume 4

Abstract

The present paper describes a multisensory virtual reality (VR) system built for the exploration of the bodily ultra-reality. First, we introduce a new term ‘ultra-reality’ which was advocated by a government committee to explore future media technology in Japan. The ultra-reality has been recognized from both the aspects of the super-reality and the meta-reality. The author proposed a hypothesis that the ultra-reality has its base on the VR (the second reality), and it is embodied as rational and emotional entity built on pieces of rendered reality. The ultra-reality is the third reality grasped at the cognitive level rather than perception level. The author placed the forth reality hypothesis where the self-body is virtualized by projecting information backward from the body input to the brain. The dynamic virtual body illusion is the objective of the research to create in which the self-body makes a part of VR media to duplicate experience of other person. We consider that multisensory presentation plays a principal role for this bodily ultra-reality. To provide a framework for realization of the ultra-reality, we introduced exhibit prototypes of the multisensory presentation system. The five senses theater system, the FiveStar, provides multisensory stimulations to the user for the creation of ultra-realistic experiences. The contents of the exhibits were the mixed reality bodily experience, the interaction with CG creature, and the virtual first-person trip to the tourist sites. The multisensory display devices that were used to create the bodily ultra-reality were described to show the method and characteristics of this hypothesis.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    The Ultra-Realistic Communications Forum.

  2. 2.

    Devices similar to an exoskeleton mechanism that assists user’s movement.

  3. 3.

    In the title of ‘Ultra-ordinary experience through five senses media’.

References

  1. H. Andoh. Factors of the sense of presence, chapter 6.2.2. VRSJ, 2010.

    Google Scholar 

  2. O. Blanke. Multisensory brain mechanisms of bodily self-consciousness. Nature reviews. Neuroscience, 13(8):556–71, aug 2012.

    Google Scholar 

  3. M. Botvinick and J. Cohen. Rubber hands ’feel’ touch that eyes see. Nature, 391:756, 1998.

    Google Scholar 

  4. K. E. Cullen. Sensory signals during active versus passive movement. Current Opinion in Neurobiology, 14:698–706, 2004.

    Google Scholar 

  5. P. K. Dick. Total Recall. Gollancz, 2012.

    Google Scholar 

  6. M. R. Dimitrijevic, Y. Gerasimenko, and M. M. Pinter. Evidence for a spinal central pattern generator in humans. Annals Of The New York Academy Of Sciences, 860(1):360–376, 1998.

    Google Scholar 

  7. K. Enami, M. Katsumoto, and R. Nishimura. Current techniques for. The Journal of the Acoustical Society of Japan, 64:322–327, 2008.

    Google Scholar 

  8. P. Haggard. Conscious intention and motor cognition. Trends in cognitive sciences, 9(6):290–5, Jun 2005.

    Google Scholar 

  9. N. K. Hayles. How We Became Posthuman: Virtual Bodies in Cybernetics, Literature, and Informatics, volume 4. 1999.

    Google Scholar 

  10. G. H. D. Hecht, M. Reiner. Multimodal virtual environments: Response times, attention, and presence. Presence: Teleoperators and Virtual Environments, pages 515–523, 2006.

    Google Scholar 

  11. R. M. Held and N. I. Durlack. Telepresence. Presence: Teleoperators and Virtual Environ- ments, 1:109–112, 2015.

    Google Scholar 

  12. Y. Ikei, K. Abe, K. Hirota, and T. Amemiya. A multisensory vr system exploring the ultra- reality. In Proc. VSMM2012, pages 71–78, 2012.

    Google Scholar 

  13. F. M. Lambert, D. Combes, J. Simmers, and H. Straka. Gaze Stabilization by Efference Copy Signaling without Sensory Feedback during Vertebrate Locomotion. Current Biology, pages 1–10, 2012.

    Google Scholar 

  14. J. M. Loomis. Distal attribution and presence. Presence: Teleoperators and virtual environ- ments, 1, pp., 1:113–119, 1992.

    Google Scholar 

  15. J. Perry. Gait Analysis: Normal and Pathological Function, volume 12. 1992.

    Google Scholar 

  16. V. I. Petkova and H. H. Ehrsson. If I Were You: Perceptual Illusion of Body Swapping. PLoS ONE, 3:9, 2008.

    Google Scholar 

  17. S. Rossignol, R. Dubuc, and J.-P. Gossard. Dynamic sensorimotor interactions in locomotion. Physiol Rev, 86(Physiol Rev 86: 89154, 2006;):89–154, 2006.

    Google Scholar 

  18. T. B. Sheridan. Musings on telepresence and virtual presence. Presence: Teleoperators and virtual environments, (1):120–126, 1992.

    Google Scholar 

  19. S. Shimojo. pages 21–29. 2015.

    Google Scholar 

  20. M. Shirow. Ghost in the Shell. Dark Horse Comics, 1996.

    Google Scholar 

  21. A. S. M. Slater. A virtual presence counter. Presence: Teleoperators and virtual environments, 9:413–434, 2000.

    Google Scholar 

  22. M. Slater, E. D, S. H, and V. M. Inducing illusory ownership of a virtual body. Frontiers in neuroscience, 3(2):214–20, 2009.

    Google Scholar 

  23. M. Slater, J. McCarthy, and F. Maringelli. The influence of body movement on subjective presence in virtual environments. Human Factors: The Journal of the Human Factors and Ergonomics Society, 1998.

    Google Scholar 

  24. S. Tachi, M. Sato, and M. Hirose. Virtual Reality. Corona Publishing Co.,LTD., 2010.

    Google Scholar 

  25. M. W. Whittle. An Introduction to Gait Analysis. 2007.

    Google Scholar 

  26. B. G. Witmer and M. J. Singer. Measuring presence in virtual environments: A presence questionnaires. Presence: Teleoperators and Virtual Environments, 7(3):225–240, 1998.

    Google Scholar 

Download references

Acknowledgements

The authors wish to thank Professor Michitaka Hirose at the University of Tokyo for his valuable advice on the present research. We thank Dr. Koji Abe for his great contribution to the virtual trip project. This research was supported by the MIC/SCOPE #141203019 and a Grant-in-Aid for Scientific Research (A) from MEXT, and a past funding for the ultra-realistic communications technologies of NICT in Japan.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Yasushi Ikei .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Ikei, Y., Hirota, K., Amemiya, T., Kitazaki, M. (2016). Five Senses Theater: A Multisensory Display for the Bodily Ultra-Reality. In: Fukuda, S. (eds) Emotional Engineering Volume 4. Springer, Cham. https://doi.org/10.1007/978-3-319-29433-9_8

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-29433-9_8

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-29432-2

  • Online ISBN: 978-3-319-29433-9

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics