Advertisement

Development of a Sound Field Sharing System for Creating and Exchanging Music

  • Shiro IseEmail author
Chapter

Abstract

Many interactions in modern society have become virtual. To form deep bonds between people in our highly connected society, a mechanism for sharing one’s true feelings is required. Sound is one of the strongest tools that can be used to emulate an in-person experience, making 3D auditory interface technology a necessary area of exploration. There are several reasons for such a simple solution, realistic sound, not yet being realized. First, development of visual technology has been prioritized owing to its clarity and ease of understanding. Second, text-based technology has rapidly grown because of commercial requirements. Finally, the conventional theoretical basis of sound field reproduction is not sufficiently realizable. However, the principle of boundary surface control (BoSC) was proposed during the 1990s as a new theoretical basis of 3D sound field reproduction. After several trials of developing the sound field reproduction system based on the BoSC principle, this project started to clarify the applicability of the BoSC principle. As a result of this project over five years, we succeeded in being the first in the world to develop an immersive auditory display, which is named “sound cask” from its cask-shaped appearance. Since producing sound and listening to sound has been important to human interaction since early humanity, the sound cask will be an invaluable tool.

Keywords

Immersive auditory display Stereophonics Virtual reality 3D sound technology Sound sharing system 

References

  1. 1.
    ITU-R BS.775.1, Multichannel stereophonic sound system with and without accompanying picture, 1992–1994Google Scholar
  2. 2.
    SMPTE 2036-2-2008, Ultra high definition television–Audio characteristics and audio channel mapping for program production, 2008Google Scholar
  3. 3.
    A.J. Berkhout, D. de Vries, P. Vogel, Acoustic control by wave field synthesis. J. Acoust. Soc. Am. 93(5), 2764–2778 (1993)CrossRefGoogle Scholar
  4. 4.
    P.A. Gauthier, A. Berry, Adaptive wave field synthesis with independent radiation mode control for active sound field reproduction: Theory. J. Acoust. Soc. Am. 119(5), 2721–2737 (2006)CrossRefGoogle Scholar
  5. 5.
    P.A. Gauthier, A. Berry, Adaptive wave field synthesis for sound field reproduction: theory, experiments and future perspectives. J. Audio Eng. Soc. 55(12), 1107–1124 (2007)Google Scholar
  6. 6.
    P.A. Gauthier, A. Berry, Adaptive wave field synthesis for active sound field reproduction: experimental results. J. Acoust. Soc. Am. 123(4), 1991–2002 (2008)CrossRefGoogle Scholar
  7. 7.
    G. Theile, H. Wittek, Wave field synthesis: a promising spatial audio rendering concept. Acoust. Sci. Tech. 25(6), 393–399 (2004)CrossRefGoogle Scholar
  8. 8.
    K. Ueno, K. Yasuda, H. Tachibana, T. Ono, Sound field simulation for stage acoustics using 6-channel system. Acoust. Sci. Tech. 22(4), 307–309 (2001)CrossRefGoogle Scholar
  9. 9.
    S. Yokoyama, K. Ueno, S. Sakamoto, H. Tachibana, 6-channel recording/reproduction system for 3-dimensional auralization of sound fields. Acoust. Sci. Tech. 23(2), 93–103 (2002)CrossRefGoogle Scholar
  10. 10.
    D.H. Cooper, T. Shiga, Discrete-matrix multichannel stereo. J. Audio Eng. Soc. 20(5), 346–360 (1972)Google Scholar
  11. 11.
    M.A. Gerzon, Hierarchical system of surround sound transmission for HDTV, in Proc. AES 92nd Convention, Preprint 3339 (1992)Google Scholar
  12. 12.
    M.A. Poletti, Three-dimensional surround sound systems based on spherical harmonics. J. Audio Eng. Soc. 53, 1004–1025 (2005)Google Scholar
  13. 13.
    S. Ise, A study on the sound field reproduction in a wide area(1)–based on Kirchhoff-Helmholtz integral equation–(in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (1993), pp. 479–480Google Scholar
  14. 14.
    S. Ise, A principle of active control of sound based on the Kirchhoff-Helmholtz integral equation and the inverse system theory (in Japanese). J. Acoust. Soc. Jpn. 53(9), 706–713 (1997)Google Scholar
  15. 15.
    S. Ise, A principle of sound field control based on the Kirchhoff-Helmholtz integral equation and the theory of inverse systems. Acustica 85, 78–87 (1999)Google Scholar
  16. 16.
    S. Ise, M. Toyodaet, S. Enomoto, S. Nakamura, An attempt of sound field sharing system for profound communication–concept and basic stance of the project–(in Japanese), in Proc. Mtg. Acoust. Soc. Japan (2007), pp. 585–586Google Scholar
  17. 17.
    S. Enomoto, Y. Ikeda, S. Ise, S. Nakamura, Three dimensional sound field reproduction and recording system based on boundary surface control principle, in ICAD 2008—14th International Conference on Auditory Displays (June 2008)Google Scholar
  18. 18.
    S. Enomoto, 3D sound field recording/reproduction system for telecommunication (in Japanese). Arch. Acoust. Noise Cont. 38(4), 37–42 (2009)Google Scholar
  19. 19.
    S. Enomoto, Y. Ikeda, S. Ise, S. Nakamura, 3D sound field reproduction system for the sound field shared communication based on the boundary surface control principle (in Japanese), in Proc. Mtg. Acoust. Soc. Japan (2009), pp. 1411–1414Google Scholar
  20. 20.
    Y. Ikeda, S. Enomoto, S. Ise, S. Nakamura, Three-party sound field sharing system based on the boundary surface control principle, in ICA 2010—20th International Congress on Acoustics (2010)Google Scholar
  21. 21.
    S. Enomoto, Y. Ikeda, S. Ise, S. Nakamura, Optimization of loudspeaker and microphone configurations for sound reproduction system based on boundary surface control principle, in ICA 2010—20th International Congress on Acoustics (August 2010)Google Scholar
  22. 22.
    R. Kleinman, G. Roach, Boundary integral equations for the three dimensional Helmholtz equation. SIAM Rev. 16, 214–236 (1974)MathSciNetCrossRefzbMATHGoogle Scholar
  23. 23.
    S. Enomoto, Measurements of synthesized sound eld in vertical plane for sound reproduction system based on boundary surface control (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (2014), pp. 841–842Google Scholar
  24. 24.
    S.S. Stevens, Problems and method of psychophysics. Psychol. Bull. 55, 177–196 (1958)CrossRefGoogle Scholar
  25. 25.
    M. Yamashita, H. Nakajima, M. Kobayashi, Y. Ikeda, S. Enomoto, K. Ueno, S. Ise, Sound localization experiment of “sound cask”–Comparison between 62-channel and 96-channel sound field reproduction system based on the BoSC principle (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (March 2013)Google Scholar
  26. 26.
    J.C. Makous, J.C. Middlebrooks, Two-dimensional sound localization by human listeners. J. Acoust. Soc. Am. 87(5), 2188–200 (1990)CrossRefGoogle Scholar
  27. 27.
    P. Zahorik, Assessing auditory distance perception using virtual acoustics. J. Acoust. Soc. Am. 111(4), 1832–1846 (1990)CrossRefGoogle Scholar
  28. 28.
    D.S. Brungart, N.I. Durlach, W.M. Rabinowitz, Auditory localization of nearby source. II. Localization of a broadband source. J. Acoust. Soc. Am. 106(4), 1956–1968 (1999)CrossRefGoogle Scholar
  29. 29.
    M. Kobayashi, K. Ueno, M. Yamashita, S. Ise, S. Enomoto, Subjective evaluation of a virtual acoustic system: trials with three-dimensional sound field reproduced by the ‘Sound Cask’, in ICA 2013—21st International Congress on Acoustics (June 2013)Google Scholar
  30. 30.
    M. Kobayashi, Y. Ooishi, S. Enomoto, N. Kitagawa, K. Ueno, S. Ise, M. Kashino, Effects of the movement of speakers on the sense of presence Study by using the three-dimensional sound field reproduction system. in Proceedings of the Auditory Research Meeting sponsored by the Technical Committee of Psychological and Physiological Acoustics, vol. 42, (Feburary 2012), pp. 41–46Google Scholar
  31. 31.
    M. Kobayashi, K. Ueno, S. Ise, The effects of spatialized sounds on the sense of presence in auditory virtual environments: a psychological and physiological study. Presence 24(2), 163–174 (2015)CrossRefGoogle Scholar
  32. 32.
    K. Tsuchida, K. Ueno, S. Shimada, Motor area activity for action-related and nonaction-related sounds in a three-dimensional sound field reproduction system. NeuroReport 26(5), 291–295 (2015)CrossRefGoogle Scholar
  33. 33.
    K. Tsuchida, K. Ueno, S. Shimada, Brain activity to action- and non-action-related sounds in a three-dimensional sound reproduction system. in JSST 2013 International Conference on Simulation Technology (JSST2013) (2013), pp. 45Google Scholar
  34. 34.
    K. Tsuchida, K. Ueno, S. Shimada, Modulation of EEG mu and beta rhythm in the mirror neuron system to action-related sounds in a three-dimensional sound reproduction system, in 44th Annual Meeting of the Society for Neuroscience (Neuroscience2014) (2014)Google Scholar
  35. 35.
    M. Kobayashi, K. Tsuichida, K. Ueno, S. Shimada, Measurement of mirror neuron system activation for the 3-dimentional reproduction sound fields (in Japanese). Trans. Virtual Real. Soc. Jpn. 21(1), 73–79 (2016)Google Scholar
  36. 36.
    S. Kohno, Y. Watanabe, H. Yoshida, Y. Ikeda, S. Ise. Acoustic feedback cancellation for a sound-field simulation system based on boundary-surface control principle (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (March 2015), pp. 653–654Google Scholar
  37. 37.
    M. Kobayashi, S. Tamura, K. Ueno, Auditory impression of flutes at a concert hall (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (September 2013), pp. 889–890Google Scholar
  38. 38.
    A. Nagai, S. Numakami, Y. Ikeda, Y. Watanabe, S. Ise, K. Ueno, Development of virtual table tennis system between the two persons for sound cask (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (March 2016)Google Scholar
  39. 39.
    W. Woszczyk, J. Cooperstock, J. Roston, W.L. Martens, Shake, rattle, and roll: getting immersed in multisensory, interactive music via broadband networks. J. Audio Eng. Soc. (AES) 53(4), 336–344 (2005)Google Scholar
  40. 40.
    T. Nagao, T. Watanabe, Y. Ikeda, K. Ueno, S. Ise, Study on the effect of sound delay conditions on ensemble performance (in Japanese), In Proc. of Mtg. of Acoust. Soc. Japan (March 2012), pp. 997–998Google Scholar
  41. 41.
    H. Yoshida, Y. Kitagawa, Y. Watanabe, S. Ise, Implementation of low-latency convolver using FPGA and its application for sound-eld sharing system (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (September 2015), pp. 515–518Google Scholar
  42. 42.
    Y. Watanabe, H. Yoshida, S. Kohno, Y. Ikeda, S. Ise, Development of a sound-field simulation system and its evaluation on room acoustics—Examination of acoustic feedback cancellation (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (March 2015), pp. 1061–1062Google Scholar
  43. 43.
    H. Aso, K. Ueno, M. Takahashi, M. Kobayashi, Examination on performance of the sound filed sharing system based on boundary-surface control principle,–Subjective evaluation by perforiming musicians–(in Japanese), in Proc. of Mtg. of Acoust. Soc (September 2016). (Japan (in Press))Google Scholar
  44. 44.
    E.G. Williams, Fourier Acoustics: Sound Radiation and Nearfield Acoustical Holography (Academic Press, London, 1999)Google Scholar
  45. 45.
    B.P. Hildebrand, B.B. Brenden, An Introduction to Acoustical Holography (Plenum Press, New York, 1974)CrossRefGoogle Scholar
  46. 46.
    A. Omoto, S. Ise, Y. Ikeda, K. Ueno, S. Enomoto, M. Kobayashi, Sound field reproduction and sharing system based on the boundary surface control principle. Acoust. Sci. Technol. 36(1), 1–11 (2015)CrossRefGoogle Scholar

Copyright information

© Springer Japan KK 2017

Authors and Affiliations

  1. 1.Tokyo Denki UniversityChibaJapan

Personalised recommendations