Current Status

Chapter
First Online:
Part of the Palgrave Studies in Sound book series (PASTS)

Abstract

‘Current status’ brings us up to now with a review of how sound is currently treated within VR, plus speculations on future developments. Commencing with a hypothetical exploration of the likely integrated future of VR, this chapter asserts that (by way of technology that includes the Internet of Things, social media and collaborative virtual environments) integration is a pivotal theme when considering the shape of things to come. Sound does feature throughout this section and is argued to be a vitally important element of our virtual integration with both things and people. The subsequent sections of this chapter address VR sound more directly, with a review of contemporary hardware, software and design techniques.

This is a preview of subscription content, log in to check access.

References

  1. Adamatzky, A. (2009). Reaction-diffusion computing. In Encyclopedia of complexity and systems science (pp. 7548–7565). New York: Springer.Google Scholar
  2. Andersen, A. (2016). Why procedural game sound design is so useful. A Sound Effect. https://www.asoundeffect.com/procedural-game-sound-design/.
  3. Attias, B. (2013). Subjectivity in the groove: Phonography, digitality and fidelity. In B. Attias, A. Gavanas, & H. Rietveld (Eds.), DJ culture in the mix: Power, technology, and social change in electronic dance music. New York: Bloomsbury Publishing USA.Google Scholar
  4. Baker, E. (2017). What can you do with 3D sound that you can’t do with 2D sound? No Film School. http://nofilmschool.com/2017/02/3D-audio-virtual-reality-sound-designer-viktor-phoenix-interview.
  5. Barratt, E. L., & Davis, N. J. (2015). Autonomous Sensory Meridian Response (ASMR): A flow-like mental state. PeerJ, 3, e851.CrossRefGoogle Scholar
  6. Benford, S., Snowdon, D., Greenhalgh, C., Ingram, R., Knox, I., & Brown, C. (1995). VR-VIBE: A virtual environment for Co-operative information retrieval. In Computer Graphics Forum (Vol. 14, No. 3, pp. 349–360). Blackwell Science Ltd.Google Scholar
  7. Bergel, P. (2015). The internet of sound. Tech Crunch. https://techcrunch.com/2015/07/26/the-internet-of-sound/.
  8. Boer, J. R. (2003). Game audio programming. Hignham, USA: Charles River Media.Google Scholar
  9. Böttcher, N. (2013). Current problems and future possibilities of procedural audio in computer games. Journal of Gaming & Virtual Worlds, 5(3), 215–234.CrossRefGoogle Scholar
  10. Boyce, K. (2016). Sennheiser virtual reality mic showcase at CES. Visualise. http://visualise.com/2016/01/sennheiser-virtual-reality-mic-showcase-at-ces.
  11. Bradshaw, P. (2017). Carne y Arena review—Dazzling virtual reality exhibit offers a fresh look at the refugee crisis. The Guardian. https://www.theguardian.com/film/2017/may/22/carne-y-arena-review-inarritu-virtual-reality-refugee-cannes-2017.
  12. Branda, E. (2015). Review: Oculus Rift. Journal of the Society of Architectural Historians, 74(4), 526–528.CrossRefGoogle Scholar
  13. Britton, T. C., Day, B. L., Brown, P., Rothwell, J. C., Thompson, P. D., & Marsden, C. D. (1993). Postural electromyographic responses in the arm and leg following galvanic vestibular stimulation in man. Experimental Brain Research, 94(1), 143–151.CrossRefGoogle Scholar
  14. Buyya, R., & Dastjerdi, A. V. (Eds.). (2016). Internet of things: Principles and paradigms. Amsterdam: Elsevier.Google Scholar
  15. Chernyshov, G., Chen, J., Lai, Y., Noriyasu, V., & Kunze, K. (2016). Ambient rhythm: Melodic sonification of status information for IoT-enabled devices. In Proceedings of the 6th International Conference on the Internet of Things (pp. 1–6). ACM.Google Scholar
  16. Churchill, E. F., Snowdon, D. N., & Munro, A. J. (Eds.). (2012). Collaborative virtual environments: Digital places and spaces for interaction. Berlin: Springer Science & Business Media.Google Scholar
  17. Cohen, B., Yakushin, S. B., & Holstein, G. R. (2011). What does galvanic vestibular stimulation actually activate? Frontiers in neurology, 2.Google Scholar
  18. Collins, K. (2009). An introduction to procedural music in video games. Contemporary Music Review, 28(1), 5–15.CrossRefGoogle Scholar
  19. Cragg, O. (2016). Samsung Entrim 4D headphones let you ‘feel’ virtual reality with your whole body. International Business Times. http://www.ibtimes.co.uk/samsung-entrim-4d-headphones-let-you-feel-virtual-reality-your-whole-body-1549641.
  20. Cross, T. (2016). After Moore’s Law. Economist Technology Quarterly. http://www.economist.com/technology-quarterly/2016-03-12/after-moores-law.
  21. Devana, A. (2015). 3D Audio: Weighing the options. Designing Sound. http://designingsound.org/2015/04/3d-audio-weighing-the-options/.
  22. Domingo, M. C. (2012). An overview of the internet of things for people with disabilities. Journal of Network and Computer Applications, 35(2), 584–596.CrossRefGoogle Scholar
  23. Drago, E. (2015). The effect of technology on face-to-face communication. Elon Journal of Undergraduate Research in Communications, 6(1).Google Scholar
  24. Dredge, S. (2014). Facebook closes its $2bn Oculus Rift acquisition. What next? The Guardian. https://www.theguardian.com/technology/2014/jul/22/facebook-oculus-rift-acquisition-virtual-reality.
  25. Dvorak, J., Pirillo, C., & Taylor, W. (2004). Online!: The book. New Jersey, USA: Prentice Hall Professional.Google Scholar
  26. Farnell, A. (2007, September). An introduction to procedural audio and its application in computer games. In Audio mostly conference (pp. 1–31).Google Scholar
  27. Fellgett, P. (1975). Ambisonics. Part one: General system description. Studio Sound, 17(8), 20–22.Google Scholar
  28. Galvani, L. (1791). De Viribus Electricitatis in Motu Musculari Commentarius. Bologna: Institute of Sciences at Bologna.Google Scholar
  29. Gardner, W. G., & Martin, K. D. (1995). HRTF measurements of a KEMAR. The Journal of the Acoustical Society of America, 97(6), 3907–3908.CrossRefGoogle Scholar
  30. Garner, T. A. (2016). from sinewaves to physiologically-adaptive soundscapes: The evolving relationship between sound and emotion in video games. In Emotion in Games (pp. 197–214). Springer International Publishing.Google Scholar
  31. Garner, T. A. (2017a). Why connecting all the world’s robots will drive 2017/s tops technology trends. The Independent. http://www.independent.co.uk/life-style/gadgets-and-tech/why-connecting-all-the-world-s-robots-will-drive-2017-s-top-technology-trends-a7505181.html.
  32. Garner, T. A. (2017b). Virtual reality and new aesthetic opportunities for sound design. The Soundtrack. 9(1–2).Google Scholar
  33. Gerzon, M. A. (1975). Ambisonics. Part two: Studio techniques. Studio Sound, 17(8), 24–26.Google Scholar
  34. Gerzon, M. A. (1985). Ambisonics in multichannel broadcasting and video. Journal of the Audio Engineering Society, 33(11), 859–871.Google Scholar
  35. Gouveia, D. (2013). Getting started with C++audio programming for game development. Birmingham: Packt Publishing Ltd.Google Scholar
  36. Greengard, S. (2015). The internet of things. Cambridge: MIT Press.Google Scholar
  37. He, F. (2016). Oculus earphones review and comparison with ultra high-end earbuds. Road to VR. http://www.roadtovr.com/oculus-earphones-review-rift-earbuds-comparison/.
  38. He, J. (2016). Spatial audio reproduction with primary ambient extraction. Singapore: Springer.Google Scholar
  39. Hermann, T., Nehls, A. V., Eitel, F., Barri, T., & Gammel, M. (2012). Tweetscapes-real-time sonification of twitter data streams for radio broadcasting. Atlanta: Georgia Institute of Technology.Google Scholar
  40. Hirvensalo, M. (2013). Quantum computing (pp. 1922–1926). Netherlands: Springer.Google Scholar
  41. Hoover, A. K., Cachia, W., Liapis, A., & Yannakakis, G. N. (2015, April). Audioinspace: Exploring the creative fusion of generative audio, visuals and gameplay. In International Conference on Evolutionary and Biologically Inspired Music and Art (pp. 101–112). Springer International Publishing.Google Scholar
  42. Horrowitz, S., & Looney, S. (2014). Masterclass: Using game audio middleware. Electronic Musician. http://www.emusician.com/how-to/1334/masterclass-game-audio-middleware/48158.
  43. Hu, R., Dong, S., Wang, H., et al. (2012). Perceptual characteristic and compression research in 3D audio technology. In 9th International Symposium CMMR 2012. London, UK.Google Scholar
  45. James, P. (2015). Why the Oculus Rift’s integrated headphones might replace your gaming headset. Road to VR. http://www.roadtovr.com/why-the-oculus-rifts-integrated-headphones-might-replace-your-gaming-headset/.
  46. Jerald, J. (2015). The VR book: Human-centered design for virtual reality. San Rafael: Morgan & Claypool.Google Scholar
  47. Key, E., & Kanaga, D. (2013). Proteus. London, UK: Curve Studios.Google Scholar
  48. Kim, S., Ikeda, M., Takahashi, A., Ono, Y., & Martens, W. L. (2009). Virtual ceiling speaker: Elevating auditory imagery in a 5-channel reproduction. In Audio Engineering Society Convention 127. Audio Engineering Society.Google Scholar
  49. Kim, S., King, R., & Kamekawa, T. (2015). A cross-cultural comparison of salient perceptual characteristics of height channels for a virtual auditory environment. Virtual Reality, 19(3–4), 149–160.CrossRefGoogle Scholar
  50. Kohlrausch, A., Braasch, J., Kolossa, D., & Blauert, J. (2013). An introduction to binaural processing. In The technology of binaural listening (pp. 1–32). Berlin and Heidelberg: Springer.Google Scholar
  51. Leadbetter, R. (2016). Oculus Rift review. EuroGamer. http://www.eurogamer.net/articles/digitalfoundry-2016-oculus-rift-review.
  52. Leppänen, T., Heikkinen, A., Karhu, A., Harjula, E., Riekki, J., & Koskela, T. (2014). Augmented reality web applications with mobile agents in the internet of things. In Next Generation Mobile Apps, Services and Technologies (NGMAST), 2014 Eighth International Conference on (pp. 54–59). IEEE.Google Scholar
  53. Lockton, D., Bowden, F., Brass, C., & Gheerawo, R. (2014). Powerchord: Towards ambient appliance-level electricity use feedback through real-time sonification. In International Conference on Ubiquitous Computing and Ambient Intelligence (pp. 48–51). Springer International Publishing.Google Scholar
  54. Lopes, P., Liapis, A., & Yannakakis, G. N. (2015). Targeting horror via level and soundscape generation. In Eleventh Artificial Intelligence and Interactive Digital Entertainment Conference.Google Scholar
  55. Macias, J. A. G., Alvarez-Lozano, J., Estrada, P., & Lopez, E. A. (2011). Browsing the internet of things with sentient visors. Computer, 44(5), 46–52.CrossRefGoogle Scholar
  56. Maeda, T., Ando, H., Amemiya, T., Nagaya, N., Sugimoto, M., & Inami, M. (2005). Shaking the world: Galvanic vestibular stimulation as a novel sensation interface. In ACM SIGGRAPH 2005 Emerging technologies (p. 17). ACM.Google Scholar
  57. Malham, D. G., & Myatt, A. (1995). 3-D sound spatialization using ambisonic techniques. Computer Music Journal, 19(4), 58–70.CrossRefGoogle Scholar
  58. Marks, A. (2012). The complete guide to game audio: For composers, musicians, sound designers, game developers. Boca Raton: CRC Press.Google Scholar
  59. Martin, K. A., & Laviola, J. J. (2016). The transreality interaction platform: Enabling interaction across physical and virtual reality. In Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData), 2016 IEEE International Conference on (pp. 177–186). IEEE.Google Scholar
  60. Matsuda, K. (2016). Hyper-reality. Columbia: Fractal.Google Scholar
  61. Meshram, A., Mehra, R., Yang, H., Dunn, E., Franm, J. M., & Manocha, D. (2014). P-HRTF: Efficient personalized HRTF computation for high-fidelity spatial sound. In Mixed and Augmented Reality (ISMAR), 2014 IEEE International Symposium on (pp. 53–61). IEEE.Google Scholar
  62. Murphy, D., & Neff, F. (2010). Spatial sound for computer games and virtual reality. In M. Grimshaw (Ed.), Game sound technology and player interaction: Concepts and developments (pp. 287–312).Google Scholar
  63. Nagata, H., Mikami, D., Miyashita, H., Wakayama, K., & Takada, H. (2017). Virtual reality technologies in telecommunication services. Journal of Information Processing, 25, 142–152.CrossRefGoogle Scholar
  64. Nair, V. (2014). Audio and VR. Designing Sound. http://designingsound.org/2014/05/audio-and-vr/.
  65. Nelson, F. (2014). The past, present and future of VR and AR: The pioneers speak. Tom’s Hardware. http://www.tomshardware.co.uk/ar-vr-technology-discussion,review-32940-5.html.
  66. Ortolani, F. (2015). Introduction to Ambisonics. Ironbridge Electronics.Google Scholar
  67. Parisi, T. (2015). Learning virtual reality: Developing immersive experiences and applications for desktop, web, and mobile. Newton: O’Reilly Media, Inc.Google Scholar
  68. Parkin, S. (2014). What Zuckerberg sees in Oculus Rift. MIT Technology Review. https://www.technologyreview.com/s/525881.
  69. Pecino, I. (2014). Spatial and kinematic models for procedural audio in 3D virtual environments. In International Computer Music Conference.Google Scholar
  70. Percy, M. (2000). Implementing ZoomFX: 3D objects in 3D space using DS3D. Gamasutra features archive. http://www.gamasutra.com/features/gdcarchive/2000/ZoomFX2.pdf.
  71. Picinali, L., Afonso, A., Denis, M., & Katz, B. F. (2014). Exploration of architectural spaces by blind people using auditory virtual reality for the construction of spatial knowledge. International Journal of Human-Computer Studies, 72(4), 393–407.CrossRefGoogle Scholar
  72. Popper, B. (2016). Samsung’s new Entrim 4D headphones add movement to VR by tricking your inner ear. The Verge. https://www.theverge.com/2016/3/14/11220836.
  73. Porter, J. (2016). Star Trek: Bridge Crew proves that VR has a bright multiplayer future. Tech Radar. http://www.techradar.com/news/star-trek-bridge-crew-proves-that-vr-has-a-bright-multiplayer-future.
  74. Riach, J. (2013). Virtual reality simulators could end England’s penalty shootout woe. The Guardian. https://www.theguardian.com/football/2013/aug/23/virtual-reality-england-penalty-shootout.
  75. Robertson, A. (2016). The Unreal Engine now lets you build games inside virtual reality. The Verge. https://www.theverge.com/2016/2/4/10908444.
  76. Rorsman, I., Magnusson, M., & Johansson, B. B. (1999). Reduction of visuo-spatial neglect with vestibular galvanic stimulation. Scandinavian Journal of Rehabilitation Medicine, 31(2), 117–124.CrossRefGoogle Scholar
  77. Rosedale, P., et al. (2003). Second life. San Francisco, USA: Linden Lab.Google Scholar
  78. Rumsey, F. (2012). Spatial audio. Boca Raton: CRC Press.Google Scholar
  79. Rumsey, F., & McCormick, T. (2012). Sound and recording: An introduction. Boca Raton: CRC Press.Google Scholar
  80. Schissler, C., Nicholls, A., & Mehra, R. (2016). Efficient HRTF-based spatial audio for area and volumetric sources. IEEE Transactions on Visualization and Computer Graphics, 22(4), 1356–1366.CrossRefGoogle Scholar
  81. Shaker, N., Togelius, J., & Nelson, M. (2016). Procedural content generation in games. Switzerland: Springer International Publishing.CrossRefGoogle Scholar
  82. Simonite, T. (2016). Moore’s Law is dead. Now what? MIT Technology Review. https://www.technologyreview.com/s/601441/moores-law-is-dead-now-what/.
  83. Somberg, G. (Ed.). (2016). Game audio programming: Principles and practices. Boca Raton: CRC Press.Google Scholar
  84. Stevens, R., & Raybould, D. (2013). The game audio tutorial: A practical guide to creating and implementing sound and music for interactive games. Oxford: Taylor & Francis.Google Scholar
  85. Takahashi, D. (2016). Unity demonstrates new way to develop games inside virtual reality. VentureBeat. https://venturebeat.com/2016/02/10/unity-demonstrates-new-way-to-develop-games-inside-virtual-reality/.
  86. Ung, G. (1998, November). Vortex 2 and A3D 2.0. Maximum PC. Imagine.Google Scholar
  87. Völk, F. (2009). Externalization in data-based binaural synthesis: Effects of impulse response length. In Proceedings of International Conference on Acoustics NAG/DAGA (pp. 1075–1078).Google Scholar
  88. Waters, R. C., Anderson, D. B., Barrus, J. W., Brogan, D. C., Casey, M. A., McKeown, S. G., et al. (1997). Diamond park and spline: Social virtual reality with 3D animation, spoken interaction, and runtime extendability. Presence: Teleoperators and Virtual Environments, 6(4), 461–481.CrossRefGoogle Scholar
  89. Watkins, R. (2016). Procedural content generation for unity game development. Birmingham: Packt Publishing Ltd.Google Scholar
  90. Williamson, R. (2017). The sound of the internet of things (and why it matters for brands). Creative Review. https://www.creativereview.co.uk/sound-internet-things-matters-brands/.
  91. Willitis, T., Blackwell, M., Carmack, J., et al. (2004). Doom 3. USA: Id Software.Google Scholar
  92. Wooller, R., Brown, A. R., Miranda, E., Berry, R., & Diederich, J. (2005). A framework for comparison of processes in algorithmic music systems. In Generative arts practice (pp. 109–124). Sydney: Creativity and Cognition Studios Press.Google Scholar

Copyright information

© The Author(s) 2018

Authors and Affiliations

  1. 1.University of PortsmouthPortsmouthUK

Personalised recommendations