Abstract
This paper reports the recent works and progress on a PC and C++ language-based virtual auditory environment (VAE) system platform. By tracing the temporary location and orientation of listener’s head and dynamically simulating the acoustic propagation from sound source to two ears, the system is capable of recreating free-field virtual sources at various directions and distances as well as auditory perception in reflective environment via headphone presentation. Schemes for improving VAE performance, including PCA-based (principal components analysis) near-field virtual source synthesis, simulating six degrees of freedom of head movement, are proposed. Especially, the PCA-based scheme greatly reduces the computational cost of multiple virtual sources synthesis. Test demonstrates that the system exhibits improved performances as compared with some existing systems. It is able to simultaneously render up to 280 virtual sources using conventional scheme, and 4500 virtual sources using the PCA-based scheme. A set of psychoacoustic experiments also validate the performance of the system, and at the same time, provide some preliminary results on the research of binaural hearing. The functions of the VAE system is being extended and the system serves as a flexible and powerful platform for future binaural hearing researches and virtual reality applications.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Xie B S. Head Related Transfer Function and Virtual Auditory (in Chinese). Beijing: National Defense Industry Press, 2008
Blauert J, Lehnert H, Sahrhage J, et al. An interactive virtual-environment generator for psychoacoustic research I: Architecture and implementation. Acta Acust United Acust, 2000, 86: 94–102
Silzle A, Novo P, Strauss H. IKA-SIM: A system to generate auditory virtual environments. In: AES 116th Convention, Berlin, Germany, 2004. 6016
Wenzel E M, Miller J D, Abel J S. Sound Lab: A real-time, software-based system for the study of spatial hearing. In: AES 108th Convention, Paris, France, 2000. 5140
Miller J D, Wenzel E M. Recent developments in SLAB: A software-based system for interactive spatial sound synthesis. In: Proceedings of the 2002 International Conference on Auditory Display, Kyoto, Japan, 2002
Savioja L, Huopaniemi J, Lokki T, et al. Creating interactive virtual acoustic environments. J Audio Eng Soc, 1999, 47: 675–705
Scarpaci J W, Colburn H S, White J A. A system for real-time virtual auditory space. In: Proceedings of the 11th International Conference on Auditory Display, Limerick, Ireland, 2005. 241–246
Lentz T, Assenmacher I, Vorländer M, et al. Precise near-to-head acoustics with binaural synthesis. J Virtual Reality Broadcast, 2006, 3: urn:nbn:de:0009-6-5890
Sandvad J. Dynamic aspects of auditory virtual environments. In: AES 100th Convention, Copenhagen, Denmark, 1996. 4226
Begault D R, Wenzel E M, Godfroy M, et al. Applying spatial audio to human interfaces: 25 years of NASA experience. In: AES 40th Conference, Tokyo, Japan, 2010
Kulkarni A, Isabelle S K, Colburn H S. Sensitivity of human subjects to head-related transfer-function phase spectra. J Acoust Soc Am, 1999, 105: 2821–2840
Larcher V, Jot J M, Guyard J, et al. Study and comparison of efficient methods for 3D audio spatialization based on linear decomposition of HRTF data. In: AES 108th Convention, Paris, France, 2000. 5097
Kistler D J, Wightman F L. A model of head-related transfer functions based on principal components analysis and minimum-phase reconstruction. J Acoust Soc Am, 1992, 91: 1637–1647
Gardner W G, Martin K D. HRTF measurements of a KEMAR. J Acoust Soc Am, 1995, 97: 3907–3908
Xie B S, Zhong X L, Rao D, et al. Head-related transfer function database and analyses. Sci China Ser G: Phys Mech Astron, 2007, 50: 267–280
Yu G Z, Xie B S, Rao D. Characteristics of near-field head-related transfer function for KEMAR. In: AES 40th Conference, Tokyo, Japan, 2010
Xie B S, Zhang T T. The audibility of spectral detail of head-related transfer functions at high frequency. Acta Acust United Acust, 2010, 96: 328–339
Møller H. Fundamentals of binaural technology. Appl Acoust, 1992, 36: 171–218
Krebber W, Gierlich H W, Genuit K. Auditory virtual environments: Basics and applications for interactive simulations. Signal Processing, 2000, 80: 2307–2322
Lehnert H, Blauert J. Principle of binaural room simulation. Appl Acoust, 1992, 36: 259–291
Gardner W G. Reverberation algorithms. In: Kahrs M, Brandenburg K, eds. Applications of Signal Processing to Audio and Acoustics. Boston: Kluwer Academic Publishers, 1998
Zhang C Y, Xie B S, Rao D, et al. Dynamic parameters measurement of virtual auditory environment real-time rendering system. In: Proceedings of CISP, Yantai, China, 2010. 3852–3855
Zhang C Y, Xie B S. Analysis and verification on the accuracy of virtual sound source position reported by magnetic tracker (in Chinese). J South China Univ Tech (Nat Sci Ed), 2011, 39: 100–105
Leong P, Carlile S. Methods for spherical data analysis and visualization. J Neurosci Meth, 1998, 80: 191–200
Zahorik P. Assessing auditory distance perception using virtual acoustics. J Acoust Soc Am, 2002, 111: 1832–1846
Sheng Z, Xie S Q, Pan C Y. Probability Theory and Mathematical Statistics (in Chinese). 3rd ed. Beijing: Higher Education Press, 2001
Author information
Authors and Affiliations
Corresponding author
Additional information
This article is published with open access at Springerlink.com
Rights and permissions
This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.
About this article
Cite this article
Zhang, C., Xie, B. Platform for dynamic virtual auditory environment real-time rendering system. Chin. Sci. Bull. 58, 316–327 (2013). https://doi.org/10.1007/s11434-012-5523-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11434-012-5523-2