The Sound of Being There: Audiovisual Cartography with Immersive Virtual Environments
- 11k Downloads
In recent years, immersion has become a frequently emphasized factor in the geovisualization research agenda. A principal reason for this growing interest is the assumption that immersive virtual environments (IVE) facilitate the formation of spatial presence, generally understood as the sense of “being there”. In a virtually mediated environment, the feeling of being there is of particular concern for cartographic ambitions, in terms of generating insights through geospatial representation. Current literature indicates that immersive VR systems stimulate the experience of spatial presence; however, this assumption is mainly based upon user studies in the visual communication channel. Moreover, research on IVE for geovisualization matters has to date been focused on visual-graphical rather than on auditive or even multisensory representations in virtual space. In this context, the present paper aims to evaluate the potential of audiovisual cartography with immersive virtual environments. Following a brief discussion of basic concepts, such as immersion, spatial presence and embodiment, we will integrate these aspects into a geovisualization immersion pipeline (GIP), as a framework with which to systematically link the technical and cognitive aspects of IVE. In the subsequent sections, we will examine this framework in the audio channel by analyzing how sound is implemented and perceived in GeoIVE. As we shall see, the positive effect of a combined audio-visual vs. exclusively visual presentation is supported by a series of user studies of sound effects, making audiovisual cartography with IVE a rich and worthwhile field of research.
KeywordsVirtual reality Immersion Spatial presence Immersive virtual environments Audiovisual cartography
Virtuelle Realität (VR) und Immersion haben sich in den vergangenen Jahren auf der Forschungsagenda der Kartographie fest etabliert. Ein Hauptgrund dieses wachsenden Interesses ist die Annahme, dass immersive virtuelle Umgebungen räumliches Präsenzerleben induzieren, so dass sich Rezipient/inn/en in einer medialen Umgebung anwesend fühlen und Handlungsmöglichkeiten innerhalb derselben wahrnehmen. Für das grundsätzliche Ziel der Kartographie, raumbezogenes Wissen durch Repräsentationen zu vermitteln, ist das Phänomen räumlichen Präsenzerlebens von besonderem Interesse. Rezente Studien weisen zwar darauf hin, dass immersive VR-Systeme ein hohes Präsenzerleben erzeugen können, stützen sich dabei jedoch in erster Linie auf Untersuchungen des visuellen Kommunikationskanals. Ebenso hat sich die kartographische Erforschung immersiver Umgebungen bislang vor allem visuellen bzw. graphischen, weniger aber auditiven und multisensorischen Repräsentationsformen gewidmet. Vor diesem Hintergrund versucht der vorliegende Text, das Potenzial einer audiovisuellen Kartographie in immersiven virtuellen Umgebungen zu bewerten. Der einleitenden Diskussion zentraler Termini (z.B. Immersion, räumliches Präsenzerleben, Embodiment) folgt eine Verknüpfung dieser Schlüsselbegriffe innerhalb einer kartographischen Immersionspipeline – eine Modellvorstellung, die technische und kognitive Aspekte immersiver Umgebungen systematisch verbindet. Ausgehend von dieser Modellverstellung wird in den nachfolgenden Abschnitten untersucht, wie akustische Information in kartographischen VR-Systemem wahrgenommen und implementiert werden kann. Anhand einer Reihe empirischer Studien wird gezeigt, dass audiovisuelle Darstellungen verglichen mit ausschließlich visuellen Repräsentationen das räumliche Präsenzerleben verstärken können und somit audiovisuelle Kartographie in immersiven virtuellen Umgebungen zu einem reichen und lohnenden Gebiet zukünftiger Forschung machen.
SchlüsselwörterVirtuelle Realität Immersion räumliches Präsenzerleben immersive virtuelle Umgebungen audioviselle Kartographie
Cartography has always had the purpose of generating insights from geospatial data through representation. As already indicated by the terms cartography and geovisualization (cf. Çöltekin et al. 2017), graphical representation is the method of choice. For centuries, graphical representation was not just the preferred option, but rather the only option, since non-visual communication (e.g., aural, haptic or olfactory) to complement analog mapping was practically unavailable. These conditions changed with the dawn of digital cartography, when mapmakers began to understand cartographic products no longer just in terms of static paper-print maps, but rather as dynamic multimedia interfaces (Cartwright et al. 2007).
Multimedia cartography has significantly shaped the frontline of research into geovisualization over the last two decades, with audiovisual, three-dimensional (3D) and animated maps as already well-established topics on the cartographic research agenda. In this paper, we will focus on another representation technology arising from digital cartography, which has as yet been little studied and is most consistently described as immersive virtual environments (IVE; Slater and Usoh 1993; Schnabel and Kvan 2003; Heydarian et al. 2015).
We will begin the discussion by establishing a terminological framework regarding the key concepts of immersion and spatial presence. Following the maxim of “generating insights”, these concepts will then be linked within a process model that offers an explanation of how IVE can facilitate cartographic communication. While this model was proposed only recently in a rather general form by Hruby et al. (2018), the focus of this paper will be on the technical and cognitive possibilities of representing geospatial phenomena in IVE using auditive (together with visual) input.
2 Geovisualization Immersive Environments
Virtual reality (VR) has become a frequently emphasized factor in literature with a cartographical research agenda (Çöltekin et al. 2017; Griffin et al. 2017; Virrantaus et al. 2009; cf. also Huang et al. 2018). However, VR is currently defined and operationalized in ambiguous ways, e.g., as virtual globes (Yang et al. 2018), VRGIS (Boulos et al. 2017) or Virtual Geographic Environments (VGE; Chen and Lin 2018), applying different understandings of virtuality in each case. To avoid confusion with existing concepts, we refer to geovisualization immersive environments (GeoIVE; Hruby et al. 2018; Edler et al. 2018; cf. also MacEachren and Kraak 2001) in the following explanation, indicating explicitly the highly immersive visualizations of geospatial data we are interested in.
2.1 Immersive VR
In this document, and in line with current research (Cummings and Bailenson 2016; Skarbez et al. 2017), immersion is understood as a technological, hence objective, quality of media describing “[…] the extent to which the computer displays are capable of delivering an inclusive, extensive, surrounding and vivid illusion of reality to the senses of a human participant.” (Slater and Wilbur 1997, p. 3).
While the aforementioned definition of immersion rather relies on stereoscopic vision, it can be easily extended to other forms of perception. In the case of spatialized sound, for instance (cf. Sect. 3), stereophonic input (e.g., from headphones integrated in the HMD) needs to be provided in real time depending on the user’s position in VR space.
2.2 Spatial Presence
Spatial Presence is the user’s feeling of “being there” within a virtual environment (Skarbez et al. 2017). Two subdivisions of spatial presence, i.e., self-location and action possibilities can be distinguished. Consequently, spatially present IVE users have a subjective experience of being situated in virtual space and being able to interact directly with the virtual environment (Hartmann et al. 2015). These two aspects can be formalized in the two-step model of the formation of the spatial presence proposed by Wirth et al. (2007) and enhanced by Schubert (2009) and Wirth et al. (2012): Within this theoretical framework, a mental spatial model of the IVE is first developed as a function of user- (e.g., interest, attention, spatial ability) and application-specific features (e.g., spatial cues, consistency). Secondly, users must accept this mental model of the virtual environment as their “primary egocentric reference frame” Wirth et al. (2007), so that the spatial presence can emerge. Measures to access self-location and action possibilities were presented by Hartmann et al. (2015).
Immersive technology has been a driving force in the present research since the 1990s (Steuer 1992), based on the observation that IVE users have a stronger sense of the spatial presence, compared, for example, to those of low-immersive media types such as videos or desktop applications (Seibert and Shafer 2018; Kim et al. 2014). Moreover, it has been argued that an increased feeling of the presence improves the effectiveness of VR applications (e.g., as tools for learning and training, entertainment or therapy; Cummings and Bailenson 2016; Hartmann et al. 2015; Makowski et al. 2017). This effectiveness is considered to be particularly high when users experience the IVE from the perspective of an avatar, i.e., as a functional part of the represented environment (Bailey et al. 2016). In a series of tests, Ahn et al. (2016) demonstrated how such body transfer (Shapiro 2014) produces higher levels of identification and engagement with the phenomena being visualized, compared to when the subjects simply watch a video. To measure the interconnectedness between (the user’s) self and (virtually represented) nature, Schultz´s (2001). Inclusion of Nature in Self (INS) scale proved suitable (Ahn et al. 2016).
2.3 Geovisualization Immersion Pipeline
The idea of a 1:1 scale in GeoIVE applies to space, but also to the visualization of temporal changes (Magallanes et al. 2018). Moreover, perceptual data from different human senses must be considered to fully emulate the real world in VR, so that “the scenario corresponds to reality to the maximum extent possible” (Skarbez et al. 2017, p. 96:5). The rest of this paper will focus on the importance of sound, both for the realistic representation of physical space in VR and for the formation of the spatial presence among GeoIVE users, thus examining the GIP in the audio channel.
3 Sound in GeoIVE
3.1 Sound in Cartography
In the 1990s, mapmakers began to communicate geospace not just in the visual, but also in the auditive communication channel, leading to the emergence of audiovisual cartography (MacEachren 2004). Audio and vision have been used, on the one hand, in a rather reciprocal way, producing maps that graphically visualize acoustic features of the environment (e.g., noise: Kornfeld et al. 2011) and applications, where data attributes (e.g., elevation: Schito and Fabrikant 2018; Thebpanya 2010) or uncertainty (Ballatore et al. 2018) are translated into sound. The majority of audiovisual products, however, combine visual and audio information, either in a redundant form with graphics and sound transmitting the same information or in a complementary manner (Edler et al. 2012).
Probably, the most influential theoretical framework for low-immersive (generally speaking: desktop-based) cartography has been built around a set of nine sound variables, presented by Krygier (1994), and following Bertin´s (2010) concept of visual variables. These sound variables comprise location, loudness/volume, pitch, register, timbre, duration, rate of change, order and attack/decay. Moreover, Krygier (1994) draws a distinction between abstract and realistic sounds, where the latter can be further divided into sounds of anthropophonic (of human activities, incl. speech), biophonic (of non-human animate beings) and geophonic (e.g., the rushing sea) origins (Papadimitriou et al. 2009).
A wide range of topics has been covered with audiovisual maps, both by cartographers and mapmakers from neighboring domains, using sound to transmit both quantitative and qualitative data. Since representation of geospatial qualities is the primary focus of GeoIVE (cf. Sect. 2.3), quantitative aspects of sonic maps will be excluded from further discussion (referring the interested reader to Edler et al. (2012) and Brauen (2014) for further reading references).
3.2 High- vs. Low-Immersive Audiovisual Cartography
The main differences between low- and high-immersive audiovisual applications can be exemplified by the scenario of an audiovisual hiking map (Laakso and Tiina Sarjakoski 2010): In scenario A, a digital large-scale 2D base map showing topographic features via signs is supplemented by a series of play-button symbols, which give interactive access to georeferenced soundscapes recorded on site, e.g., singing birds in forest areas or traffic noise along roads. If we now, hypothetically, translate scenario A into a GeoIVE (scenario B), users could perceive main topographic features tridimensionally at 1:1 scale, as they would by physically being there. Navigating through the virtual environment, they would perceive all of the georeferenced soundscapes within hearing range.
While oversimplified in terms of a wide variety of additional setting options, the scenario described above allows us to establish some fundamental differences between low- and high-immersive audiovisual products in cartography. Firstly, as already indicated in Sect. 2, maps displayed on non-stereoscopic computer monitors offer an external, i.e., third-person perspective on a spatial representation that is scaled down to a 1:x (with x > 1) level (cf. Kraak and Fabrikant 2017). In contrast, GeoIVE offer a first-person, thus 1:1, experience where the user’s physical environment is completely excluded in favor of the virtual reality displayed on a HMD.
With respect to sound, the difference between the two exemplary settings is less obvious, since scenario A already uses realistic soundscapes, sonificating the environment at a 1:1 scale just as the user would experience by actually being there. Consequently, these sound recordings comply with the requirements established for GeoIVE in Sect. 2. In addition, the use of stereophonic sound is possible in both low- and high-immersive applications with appropriate audio equipment (e.g., stereo headphones). However, even transmitted in stereo, the correspondence between 3D sound space and map space will be limited if the map is shown on a non-stereoscopic display. For instance, you could hear birds singing above in a tree without being able to raise your head to see them. GeoIVE, by contrast, align sound space and map space such that, for example, you can turn your head to see an approaching car that has already been located aurally by the engine noise.
3.3 Sound Localization
Audiovisual cartography with GeoIVE has to reproduce the aforementioned perceptual constellation (cf. Fig. 4) to facilitate sound location within a VR system. A typical characteristic of physical reality, and thus of GeoIVE, is the blending of different sound sources reaching the ear from different directions. Surround sound, i.e., sound emitted by a series of loudspeakers located around the user is a well-established technique to rebuild a given sound space. In immersive VR systems, however, headphones prove more convenient than loudspeakers to simulate sound location, as they allow the complete exclusion of noise from the physical environment for the benefit of a fully controlled soundscape in the GeoIVE.
Since headphones produce sound already within or very close to the ear, the aforementioned interaural cues of sound location no longer apply. To overcome this drawback, sound played over headphones can be controlled by the so-called head-related transfer functions (HRTF), which “aim to accurately reproduce the waveform at the listener’s eardrum that would normally be produced by an external sound source” (Steadman et al. 2017). Consumer-oriented VR systems (e.g., Oculus Rift, HTC Vive) already include audio software development kits to include HRTF, thus approximating an average form of the user’s head as closely as possible.
In this section, we provide a very rough framework of key terms of sound localization to better inform the following discussion of empirical research on audio in IVE. Readers with a particular interest in sound localization are referred to recent textbooks on this subject, e.g., Moore (2012). Moore et al. (2010), Schnupp et al. (2011).
4 Empirical Research on Audio in IVE
We have argued in Sect. 2 how immersive VR systems can facilitate spatial presence, followed by an overview on sound and sound localization in GeoIVE in Sect. 3. We now link these aspects through a meta-analysis of empirical studies on the impact of sound on the formation of spatial presence. Following a top–down approach, we will begin with studies on the basic question of sound vs. no sound, followed by a discussion of tests on more specific auditory conditions in virtual environments.
4.1 Sound vs. No Sound in IVE
Another realistic, but indoor, IVE was designed by Larsson et al. (2007) to study the effect of auditory space on the spatial presence on the basis of a 3D model of Örgryte New Church in Gothenburg, Sweden. Participants were asked to find and cross five (numbered) parts of the nave under different auditive conditions (including no sound). The results of this experiment also showed the significant positive impact of sound on the users’ sense of spatial presence.
While we have mentioned only a few studies showing a relatively close connection to the subject matter of GeoIVE, the general findings regarding the positive effect of sound on spatial presence are supported by a series of other experiments, e.g., Fryer et al. (2013), Pettey et al. (2010), Salski and Whitbred (2010), Serafin and Serafin (2004), Hendrix and Barfield (1995).
4.2 Sound Parameters in IVE
Beyond the principle question of implementing audio in IVE, the importance of using spatialized vs. non-spatialized sound has been a recurrent issue of empirical research. A study by Larsen and Pilgaard (2015), which was relatively closely designed to what we have defined as GeoIVE, compared stereo vs. 3D (i.e., HRTF-based) audio within the setting of an immersive computer game. While no significant differences between both conditions were observed in a self-evaluation presence questionnaire, 3D audio produced a significantly increased phasic electrodermal activity in the IVE users, indicating a stronger feeling of spatial presence at least on a subconscious level.
While Larsen and Pilgaard (2015) provided both stereo and 3D audio via headphones, other experiments tested sound spatialization effects via external speakers only, which we have excluded from a typical GeoIVE setting for a reduced level of sound control and immersion (cf. Section 3.3). For instance, Salski and Whitbred (2010), again using a gamification approach, compared 5.1 surround against two-channel stereo sound from external speakers, concluding that surround sound “almost universally impacted outcomes of interest, including several dimensions of presence and enjoyment”. However, the transferability between results obtained from external loudspeakers and headphones remains an open question (cf. Lindquist et al. 2016).
4.3 Ancillary Studies on Sound in IVE
To conclude this section on sound-related studies in the realm of IVE, several experiments are worth mentioning to include additional aspects of audiovisual cartography with VR that have not been covered above.
Mapmakers usually approach audiovision from the visual viewpoint, understanding sound as a rather complementary element of the graphics. However, people with impaired vision represent an important user segment of spatial information, who completely or partly rely on non-visual media. Audio description is a well-established method to make audiovisual content available to users with special needs, by means of narrative description (Piety 2004). While pure audio is a low-immersive media, audio description can provide a visually impaired audience with the same level of presence as an audiovisual stimulus (without narration) does among sighted people (Fryer and Freeman 2012). However, adding sound effects (e.g., animal noises) to audio description has not been proven to affect the spatial presence significantly for users with or without impaired sight (Fryer et al. 2013). The inclusion of users with special needs is, therefore, challenging not only for VR-based cartography in particular, but also for digital geovisualization in general (Hennig et al. 2017; Thebpanya 2010). The incorporation of other senses (e.g., touch; Tatsumi et al. 2015) into next-generation IVE may facilitate the feeling of being there among the broad range of geovisualization users.
Another aspect of sound in audiovisual applications is the congruity of the visual and the auditive environment. It is assumed that the feeling of being there in mediated space will be intensified by matching inputs of sound and vision (Larsson et al. 2007). Focusing on a geospatial scenario, Lindquist et al. (2016) attached, in different combinations, recordings of human speech, road traffic and bird call sounds to the scenarios shown in Fig. 6. The results of the study indicate that presence ratings are significantly influenced by the congruence of the visual and auditory stimuli so that, for example, scenes showing primarily vegetation will generate stronger presence when paralleled by birdsongs than by traffic noise. Associated with congruity, the utility of spatialized sound for navigation purposes has also been investigated: Bormann (2005) found 3D audio to influence navigation performance (but not spatial presence) positively in a low-immersive (desktop) VR application, while Ruminski (2015) observed spatial sound to be an important cue for searching tasks within indoor augmented reality (AR) scenes.
In a much-quoted survey, Balmford et al. (2002) found UK primary pupils to be more familiar with Pokémon characters than with local fauna and flora. Since then, distance and estrangement from nature by people spending less time in natural environments and ever more time indoors have been a frequently emphasized research topic (Capaldi et al. 2014), prominently framed as “nature-deficit disorder” by Louv (2005); (for a critical review of the connection-with-nature discussion cf. Fletcher 2017). The present article shows how distance between user and physical realities can be reduced by the spatial presence, such as the feeling of “being there” in a mediated environment. GeoIVE have been discussed as a conceptual model to frame VR systems to the particular needs and objectives of cartography.
While IVE in general, and GeoIVE (just like other geovisualization products) in particular, have focused on vision, we directed our attention to how auditory perception can facilitate the spatial presence within VR systems. In both high- and low-immersive environments, user studies on sound effects indicate the positive effect of a combined audiovisual vs. exclusively visual presentation. This makes audiovisual cartography with IVE a very rich field of research, raising issues of not only spatial presence, but also a variety of other cognitive aspects, e.g., how sound affects information overload (cf. Makransky et al. 2017), collaboration tasks (cf. Khadka et al. 2016) or the accuracy of object-location memory (cf. Lammert-Siepmann et al. 2017).
However, it should not be overlooked that many of the experiments on audio in IVE conducted to date are in fact ad hoc studies using different scenarios in different levels of immersion and with different measures of spatial presence. This diagnosis is symptomatic of the state of empirical cartography in general, which still lacks a research agenda that can effectively coordinate the often fragmented current research projects.
In this paper, we analyzed the potential of sound in immersive environments, which is quite distinct from research on low-immersive audiovisual cartography, to stress the potential and particularities of a recently adopted technology for geovisualization purposes. However, it should be noted that, while adopting this position, we do not claim that GeoIVE provide a generally deeper or “better” understanding of spatial phenomena than desktop-based mapping applications. Instead, we argue that mapmakers should be aware of all of the relevant available technologies to select the most appropriate tools in each case to generate insights from geospatial data through representation. We have shown that audiovisual GeoIVE represent one such tool.
6 Final Note
Due to the format of publication chosen for this paper, we approached immersive VR and sound only in a non-immersive and soundless manner. In addition to the bibliography below, interested readers are referred to the following GeoIVE application: http://www.biodiversidad.gob.mx/region/descargas/L_2017jl25.7z. Provided in an executable, but also generic, file format, this application may serve not only as an example with which to experience the feeling of “being there” but also as a test material for further studies on the spatial presence with GeoIVE.
Open access funding provided by University of Vienna.
- Ahn SJ, Bostick J, Ogle E, Nowak KL, McGillicuddy KT, Bailenson JN (2016) Experiencing nature: embodying animals in immersive virtual environments increases inclusion of nature in self and involvement with nature. J Comput Mediat Commun 21(6):399–419. https://doi.org/10.1111/jcc4.12173 Google Scholar
- Bertin J (2010) Semiology of graphics: diagrams, networks, maps, trans. Esri Press, Redlands (Original work published 1983) Google Scholar
- Boulos MNK, Lu Z, Guerrero P, Jennett C, Steed A (2017) From urban planning and emergency training to Pokémon Go: applications of virtual reality GIS (VRGIS) and augmented reality GIS (ARGIS) in personal, public and environmental health. Int J Health Geogr 16(1):1–11. https://doi.org/10.1186/s12942-017-0081-0 Google Scholar
- Brauen G (2014) Interactive audiovisual design for cartography: survey, prospects, and example. In: Taylor DRF (ed) Modern cartography series, vol 5. Elsevier, Amsterdam, pp 141–159. https://doi.org/10.1016/B978-0-444-62713-1.00010-6 Google Scholar
- Cartwright W, Peterson M, Gartner G (eds) (2007) Multimedia cartography. Springer, Berlin, HeidelbergGoogle Scholar
- Edler D, Lammert-Siepmann N, Dodt J (2012) Die akustische Dimension in der Kartographie—eine Übersicht. Kartographische Nachrichten 62(4):185–194Google Scholar
- Edler D, Husar A, Keil J, Vetter M, Dickmann F (2018) Virtual Reality (VR) and open source software: a workflow for constructing an interactive cartographic VR environment to explore urban landscapes. Kartographische Nachrichten 68(1):3–11Google Scholar
- Fryer L, Freeman J (2012) Presence in those with and without sight: audio description and its potential for virtual reality applications. J CyberTherapy Rehabil 5(1):15–23Google Scholar
- Hendrix C, Barfield W (1995) Presence in virtual environments as a function of visual and auditory cues. In: Virtual reality, annual international symposium, pp 74–82. https://doi.org/10.1109/VRAIS.1995.512482
- Heydarian A, Carneiro JP, Gerber D, Becerik-Gerber B, Hayes T, Wood W (2015) Immersive virtual environments versus physical built environments: a benchmarking study for building design and user-built environment explorations. Autom Constr 54:116–126. https://doi.org/10.1016/j.autcon.2015.03.020 Google Scholar
- Khadka R, Shetty N, Whiting ET, Banic A (2016) Evaluation of collaborative actions to inform design of a remote interactive collaboration framework for immersive data visualizations. In: International symposium on visual computing, pp 472–481. https://doi.org/10.1007/978-3-319-50835-1_43
- Krygier JB (1994) Sound and geographic visualization. In: MacEachren AM, Taylor DRF (eds) Visualization in modern cartography. Academic Press, Oxford, pp 149–166Google Scholar
- Larsen JJ, Pilgaard M (2015) The effect of spatial audio on immersion, presence, and physiological (Master’s thesis). Aalborg University, AalborgGoogle Scholar
- Larsson P, Västfjäll D, Olsson P, Kleiner M (2007) When what you hear is what you see: presence and auditory-visual integration in virtual environments. In: Proceedings of the 10th annual international workshop on presence, pp 11–18Google Scholar
- Louv R (2005) Last child in the woods: saving our children from nature-deficit disorder. Algonquin, Chapel HillGoogle Scholar
- MacEachren AM (2004) How maps work: representation, visualization, and design. Guilford Press, New YorkGoogle Scholar
- Magallanes Guijón G, Hruby F, Ressl R, Aguilar Sierra V, de la Borbolla del Valle G, Rodríguez Paz O (2018) Modelling of collective movement in immersive environments. Int Arch Photogramm Remote Sens Spat Inf Sci 42(4):397–402. https://doi.org/10.5194/isprs-archives-XLII-4-397-2018 Google Scholar
- Makransky G, Terkildsen TS, Mayer RE (2017) Adding immersive virtual reality to a science lab simulation causes more presence but less learning. Learn Instr. https://doi.org/10.1016/j.learninstruc.2017.12.007 Google Scholar
- Moore BC (2012) An introduction to the psychology of hearing. Bingley, EmeraldGoogle Scholar
- Moore DR, Fuchs PA, Plack C, Rees A, Palmer AR (eds) (2010) Oxford handbook of auditory science: hearing, vol 3. Oxford University Press, OxfordGoogle Scholar
- Piety PJ (2004) The language system of audio description: an investigation as a discursive process. J Vis Impair Blind 98(8):453–469Google Scholar
- Poeschl S, Wall K, Doering N (2013) Integration of spatial sound in immersive virtual environments an experimental study on effects of spatial sound on presence. In: Virtual reality (VR), 2013 IEEE: pp 129–130. https://doi.org/10.1109/VR.2013.6549396
- Schnupp J, Nelken I, King A (2011) Auditory neuroscience: making sense of sound. MIT Press, MassachusettsGoogle Scholar
- Schulze JP, Kim HS, Weber P, Prudhomme A, Bohn RE, Seracini M, DeFanti TA (2011) Advanced applications of virtual reality. Adv Comput 82:217–260. https://doi.org/10.1016/B978-0-12-385512-1.00006-2 Google Scholar
- Serafin G, Serafin S (2004) Sound design to enhance presence in photorealistic virtual reality. In: Proceedings of ICAD 04-tenth meeting of the international conference on auditory display. Sydney, AustraliaGoogle Scholar
- Shapiro L (ed) (2014) The Routledge handbook of embodied cognition. Routledge, New YorkGoogle Scholar
- Skalski P, Whitbred R (2010) Image versus sound: a comparison of formal feature effects on presence and video game enjoyment. PsychNol J 8(1):67–84Google Scholar
- Steuer J (1992) Defining virtual reality: dimensions determining telepresence. J Commun 42(4):73–93. https://doi.org/10.1111/j.1460-2466.1992.tb00812.x Google Scholar
- Tatsumi H, Murai Y, Sekita I, Tokumasu S, Miyakawa M (2015) Cane walk in the virtual reality space using virtual haptic sensing: toward developing haptic VR technologies for the visually impaired. In: Systems, man, and cybernetics (SMC), 2015 IEEE international conference, pp 2360–2365. https://doi.org/10.1109/SMC.2015.413
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.