Skip to main content

Development of a Sound Field Sharing System for Creating and Exchanging Music

  • Chapter
  • First Online:
Human-Harmonized Information Technology, Volume 2

Abstract

Many interactions in modern society have become virtual. To form deep bonds between people in our highly connected society, a mechanism for sharing one’s true feelings is required. Sound is one of the strongest tools that can be used to emulate an in-person experience, making 3D auditory interface technology a necessary area of exploration. There are several reasons for such a simple solution, realistic sound, not yet being realized. First, development of visual technology has been prioritized owing to its clarity and ease of understanding. Second, text-based technology has rapidly grown because of commercial requirements. Finally, the conventional theoretical basis of sound field reproduction is not sufficiently realizable. However, the principle of boundary surface control (BoSC) was proposed during the 1990s as a new theoretical basis of 3D sound field reproduction. After several trials of developing the sound field reproduction system based on the BoSC principle, this project started to clarify the applicability of the BoSC principle. As a result of this project over five years, we succeeded in being the first in the world to develop an immersive auditory display, which is named “sound cask” from its cask-shaped appearance. Since producing sound and listening to sound has been important to human interaction since early humanity, the sound cask will be an invaluable tool.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. ITU-R BS.775.1, Multichannel stereophonic sound system with and without accompanying picture, 1992–1994

    Google Scholar 

  2. SMPTE 2036-2-2008, Ultra high definition television–Audio characteristics and audio channel mapping for program production, 2008

    Google Scholar 

  3. A.J. Berkhout, D. de Vries, P. Vogel, Acoustic control by wave field synthesis. J. Acoust. Soc. Am. 93(5), 2764–2778 (1993)

    Article  Google Scholar 

  4. P.A. Gauthier, A. Berry, Adaptive wave field synthesis with independent radiation mode control for active sound field reproduction: Theory. J. Acoust. Soc. Am. 119(5), 2721–2737 (2006)

    Article  Google Scholar 

  5. P.A. Gauthier, A. Berry, Adaptive wave field synthesis for sound field reproduction: theory, experiments and future perspectives. J. Audio Eng. Soc. 55(12), 1107–1124 (2007)

    Google Scholar 

  6. P.A. Gauthier, A. Berry, Adaptive wave field synthesis for active sound field reproduction: experimental results. J. Acoust. Soc. Am. 123(4), 1991–2002 (2008)

    Article  Google Scholar 

  7. G. Theile, H. Wittek, Wave field synthesis: a promising spatial audio rendering concept. Acoust. Sci. Tech. 25(6), 393–399 (2004)

    Article  Google Scholar 

  8. K. Ueno, K. Yasuda, H. Tachibana, T. Ono, Sound field simulation for stage acoustics using 6-channel system. Acoust. Sci. Tech. 22(4), 307–309 (2001)

    Article  Google Scholar 

  9. S. Yokoyama, K. Ueno, S. Sakamoto, H. Tachibana, 6-channel recording/reproduction system for 3-dimensional auralization of sound fields. Acoust. Sci. Tech. 23(2), 93–103 (2002)

    Article  Google Scholar 

  10. D.H. Cooper, T. Shiga, Discrete-matrix multichannel stereo. J. Audio Eng. Soc. 20(5), 346–360 (1972)

    Google Scholar 

  11. M.A. Gerzon, Hierarchical system of surround sound transmission for HDTV, in Proc. AES 92nd Convention, Preprint 3339 (1992)

    Google Scholar 

  12. M.A. Poletti, Three-dimensional surround sound systems based on spherical harmonics. J. Audio Eng. Soc. 53, 1004–1025 (2005)

    Google Scholar 

  13. S. Ise, A study on the sound field reproduction in a wide area(1)–based on Kirchhoff-Helmholtz integral equation–(in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (1993), pp. 479–480

    Google Scholar 

  14. S. Ise, A principle of active control of sound based on the Kirchhoff-Helmholtz integral equation and the inverse system theory (in Japanese). J. Acoust. Soc. Jpn. 53(9), 706–713 (1997)

    Google Scholar 

  15. S. Ise, A principle of sound field control based on the Kirchhoff-Helmholtz integral equation and the theory of inverse systems. Acustica 85, 78–87 (1999)

    Google Scholar 

  16. S. Ise, M. Toyodaet, S. Enomoto, S. Nakamura, An attempt of sound field sharing system for profound communication–concept and basic stance of the project–(in Japanese), in Proc. Mtg. Acoust. Soc. Japan (2007), pp. 585–586

    Google Scholar 

  17. S. Enomoto, Y. Ikeda, S. Ise, S. Nakamura, Three dimensional sound field reproduction and recording system based on boundary surface control principle, in ICAD 2008—14th International Conference on Auditory Displays (June 2008)

    Google Scholar 

  18. S. Enomoto, 3D sound field recording/reproduction system for telecommunication (in Japanese). Arch. Acoust. Noise Cont. 38(4), 37–42 (2009)

    Google Scholar 

  19. S. Enomoto, Y. Ikeda, S. Ise, S. Nakamura, 3D sound field reproduction system for the sound field shared communication based on the boundary surface control principle (in Japanese), in Proc. Mtg. Acoust. Soc. Japan (2009), pp. 1411–1414

    Google Scholar 

  20. Y. Ikeda, S. Enomoto, S. Ise, S. Nakamura, Three-party sound field sharing system based on the boundary surface control principle, in ICA 2010—20th International Congress on Acoustics (2010)

    Google Scholar 

  21. S. Enomoto, Y. Ikeda, S. Ise, S. Nakamura, Optimization of loudspeaker and microphone configurations for sound reproduction system based on boundary surface control principle, in ICA 2010—20th International Congress on Acoustics (August 2010)

    Google Scholar 

  22. R. Kleinman, G. Roach, Boundary integral equations for the three dimensional Helmholtz equation. SIAM Rev. 16, 214–236 (1974)

    Article  MathSciNet  MATH  Google Scholar 

  23. S. Enomoto, Measurements of synthesized sound eld in vertical plane for sound reproduction system based on boundary surface control (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (2014), pp. 841–842

    Google Scholar 

  24. S.S. Stevens, Problems and method of psychophysics. Psychol. Bull. 55, 177–196 (1958)

    Article  Google Scholar 

  25. M. Yamashita, H. Nakajima, M. Kobayashi, Y. Ikeda, S. Enomoto, K. Ueno, S. Ise, Sound localization experiment of “sound cask”–Comparison between 62-channel and 96-channel sound field reproduction system based on the BoSC principle (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (March 2013)

    Google Scholar 

  26. J.C. Makous, J.C. Middlebrooks, Two-dimensional sound localization by human listeners. J. Acoust. Soc. Am. 87(5), 2188–200 (1990)

    Article  Google Scholar 

  27. P. Zahorik, Assessing auditory distance perception using virtual acoustics. J. Acoust. Soc. Am. 111(4), 1832–1846 (1990)

    Article  Google Scholar 

  28. D.S. Brungart, N.I. Durlach, W.M. Rabinowitz, Auditory localization of nearby source. II. Localization of a broadband source. J. Acoust. Soc. Am. 106(4), 1956–1968 (1999)

    Article  Google Scholar 

  29. M. Kobayashi, K. Ueno, M. Yamashita, S. Ise, S. Enomoto, Subjective evaluation of a virtual acoustic system: trials with three-dimensional sound field reproduced by the ‘Sound Cask’, in ICA 2013—21st International Congress on Acoustics (June 2013)

    Google Scholar 

  30. M. Kobayashi, Y. Ooishi, S. Enomoto, N. Kitagawa, K. Ueno, S. Ise, M. Kashino, Effects of the movement of speakers on the sense of presence Study by using the three-dimensional sound field reproduction system. in Proceedings of the Auditory Research Meeting sponsored by the Technical Committee of Psychological and Physiological Acoustics, vol. 42, (Feburary 2012), pp. 41–46

    Google Scholar 

  31. M. Kobayashi, K. Ueno, S. Ise, The effects of spatialized sounds on the sense of presence in auditory virtual environments: a psychological and physiological study. Presence 24(2), 163–174 (2015)

    Article  Google Scholar 

  32. K. Tsuchida, K. Ueno, S. Shimada, Motor area activity for action-related and nonaction-related sounds in a three-dimensional sound field reproduction system. NeuroReport 26(5), 291–295 (2015)

    Article  Google Scholar 

  33. K. Tsuchida, K. Ueno, S. Shimada, Brain activity to action- and non-action-related sounds in a three-dimensional sound reproduction system. in JSST 2013 International Conference on Simulation Technology (JSST2013) (2013), pp. 45

    Google Scholar 

  34. K. Tsuchida, K. Ueno, S. Shimada, Modulation of EEG mu and beta rhythm in the mirror neuron system to action-related sounds in a three-dimensional sound reproduction system, in 44th Annual Meeting of the Society for Neuroscience (Neuroscience2014) (2014)

    Google Scholar 

  35. M. Kobayashi, K. Tsuichida, K. Ueno, S. Shimada, Measurement of mirror neuron system activation for the 3-dimentional reproduction sound fields (in Japanese). Trans. Virtual Real. Soc. Jpn. 21(1), 73–79 (2016)

    Google Scholar 

  36. S. Kohno, Y. Watanabe, H. Yoshida, Y. Ikeda, S. Ise. Acoustic feedback cancellation for a sound-field simulation system based on boundary-surface control principle (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (March 2015), pp. 653–654

    Google Scholar 

  37. M. Kobayashi, S. Tamura, K. Ueno, Auditory impression of flutes at a concert hall (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (September 2013), pp. 889–890

    Google Scholar 

  38. A. Nagai, S. Numakami, Y. Ikeda, Y. Watanabe, S. Ise, K. Ueno, Development of virtual table tennis system between the two persons for sound cask (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (March 2016)

    Google Scholar 

  39. W. Woszczyk, J. Cooperstock, J. Roston, W.L. Martens, Shake, rattle, and roll: getting immersed in multisensory, interactive music via broadband networks. J. Audio Eng. Soc. (AES) 53(4), 336–344 (2005)

    Google Scholar 

  40. T. Nagao, T. Watanabe, Y. Ikeda, K. Ueno, S. Ise, Study on the effect of sound delay conditions on ensemble performance (in Japanese), In Proc. of Mtg. of Acoust. Soc. Japan (March 2012), pp. 997–998

    Google Scholar 

  41. H. Yoshida, Y. Kitagawa, Y. Watanabe, S. Ise, Implementation of low-latency convolver using FPGA and its application for sound-eld sharing system (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (September 2015), pp. 515–518

    Google Scholar 

  42. Y. Watanabe, H. Yoshida, S. Kohno, Y. Ikeda, S. Ise, Development of a sound-field simulation system and its evaluation on room acoustics—Examination of acoustic feedback cancellation (in Japanese), in Proc. of Mtg. of Acoust. Soc. Japan (March 2015), pp. 1061–1062

    Google Scholar 

  43. H. Aso, K. Ueno, M. Takahashi, M. Kobayashi, Examination on performance of the sound filed sharing system based on boundary-surface control principle,–Subjective evaluation by perforiming musicians–(in Japanese), in Proc. of Mtg. of Acoust. Soc (September 2016). (Japan (in Press))

    Google Scholar 

  44. E.G. Williams, Fourier Acoustics: Sound Radiation and Nearfield Acoustical Holography (Academic Press, London, 1999)

    Google Scholar 

  45. B.P. Hildebrand, B.B. Brenden, An Introduction to Acoustical Holography (Plenum Press, New York, 1974)

    Book  Google Scholar 

  46. A. Omoto, S. Ise, Y. Ikeda, K. Ueno, S. Enomoto, M. Kobayashi, Sound field reproduction and sharing system based on the boundary surface control principle. Acoust. Sci. Technol. 36(1), 1–11 (2015)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Shiro Ise .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Japan KK

About this chapter

Cite this chapter

Ise, S. (2017). Development of a Sound Field Sharing System for Creating and Exchanging Music. In: Nishida, T. (eds) Human-Harmonized Information Technology, Volume 2. Springer, Tokyo. https://doi.org/10.1007/978-4-431-56535-2_2

Download citation

  • DOI: https://doi.org/10.1007/978-4-431-56535-2_2

  • Published:

  • Publisher Name: Springer, Tokyo

  • Print ISBN: 978-4-431-56533-8

  • Online ISBN: 978-4-431-56535-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics