Audiovisual Cartography: Established and New Multimedia Approaches to Represent Soundscapes
- 469 Downloads
Since the mid-1990s, sound has been discussed and used in multimedia cartography. There are four main variants of auditory map elements that have been established in the theory and practice of audiovisual cartography, i.e. abstract sounds/abstract sound sequences, speech, music and, especially, audiorealistic sequences representing so-called “soundscapes”. In cartography, soundscapes are often addressed in large-scale representations. The term originates in multidisciplinary landscape research. Empirical findings of landscape research, and especially those of social constructivist landscape research, have shown the relevance of non-visual stimuli for people’s individual impressions and meanings of the experienced landscape. Amongst the non-visual landscape dimensions, the auditory dimension is the most prominent one. As 3D cartography offers new methods and techniques of designing and experiencing highly realistic, incl. photo- and audiorealistic landscape representation, this discipline becomes more and more interesting for simulating and presenting multisensory landscapes and for presenting the results of empirical findings in landscape research. After an introduction to traditional means of audiovisual cartography and the relevance of auditory stimuli for social constructivist approaches of landscape research, a modern software-based method is presented which highlights the opportunity to imbed 3D sound data representing a location’s soundscape into audiovisual 3D environments in Virtual Reality (VR). It is technically based on the cross-platform game engine Unity3D.
KeywordsAudiovisual cartography Multimedia cartography Multisensory cartography Landscapes Soundscapes Virtual reality (VR) Unity 3D
Audiovisuelle Kartographie: Etablierte und neue Methoden zur Repräsentation von Klanglandschaften
Seit Mitte der 1990er Jahren wird die akustische Dimension in der Multimediakartographie diskutiert und eingesetzt. Seither haben sich hauptsächlich vier Ausprägungen durchgesetzt, die als akustische Kartenelemente verwendet werden: abstrakte Töne und Tonfolgen, Sprache, Musik und audiorealistische Sequenzen zur Darstellung so genannter soundscapes (dt. „Klanglandschaften“). In der Kartographie beziehen sich Darstellungen von Klanglandschaften häufig auf großmaßstäbige Raumausschnitte. Der Begriff entstammt der multidisziplinären Landschaftsforschung. Empirische Erkenntnisse der Landschaftsforschung, insbesondere der sozialkonstruktivistischen Landschaftsforschung verdeutlichen, dass nicht-visuelle Reize der Landschaft die individuelle Interpretation der erfahrenen Landschaft maßgeblich beeinflussen. Unter den nicht-visuellen Landschaftsdimensionen gilt die akustische Dimension als bedeutendste. Aktuelle Entwicklungen zu Methoden und Techniken der 3D-Kartographie bieten Möglichkeiten zur hochrealistischen Gestaltung und Erfahrung audio-visueller 3D-Landschaften. Dies kann die Landschaftsforschung durch moderne multisensorische Darstellungsformen sowie Ergebnispräsentationen unterstützen. Dieses Paper führt ein in traditionelle Darstellungsvarianten der audiovisuellen Kartographie und diskutiert die Bedeutung der Klanglandschaften für die (sozialkonstruktivistische) Landschaftsforschung. Im Anschluss wird ein aktuelle Software-gestützte Methode zur Implementierung von audiorealistischem 3D-Sound in 3D-Landschaften in Virtual Reality (VR) vorgestellt. Dies basiert auf der plattformübergreifenden Spiele-Engine Unity3D.
SchlüsselwörterAudiovisuelle Kartographie Multimediakartographie Multisensorische Kartographie Landschaft Klanglandschaft Virtual Reality (VR) Unity 3D
The origins of using sound in maps are often associated with John B. Krygier. His pioneering research article entitled “Sound and Geographic Visualization” (Krygier 1994)—inspired by his own seminar paper in Psychology (Krygier 1991)—fundamentally changed a traditional point of view on making maps and cartographic communication. His set of “abstract sound variables”—influenced by Jacques Bertin’s (1967) six graphical variables—gave a ‘multisensory impulse’ to theoretical and practical cartography. The typology of Krygier’s nine abstract sound variables suggests that spatially represented information can be differentiated by specific attributes of sound, i.e. location (the position of a sound), loudness (the magnitude of a sound), pitch (the highness or lowness of a sound), register (the relative location of a pitch in a given range of pitches), timbre (the general prevailing quality or characteristic of a sound), duration (the length of time a sound is or is not heard), rate of change (the varying duration of a sound over time), order (the sequence of sound over time) and attack/decay (the time it takes a sound to reach its maximum/minimum). Perceivable changes/differences of these sound variables likely—a clear empirical verification is still missing by today (Ballatore et al. 2018; Lammert-Siepmann et al. 2017; Schiewe 2015)—facilitate a proper decoding of auditorily encoded spatial information.
Krygier’s idea of cartographically representing ordinal and nominal (geographical) data using sound features, i.e. spatio-temporal auditory map animations, was published at a time where cartography and neighbouring disciplines rapidly shifted from analogue to digital solutions (MacEachren 2004; Müller et al. 2001; Müller and Laurini 1997). The formation of information societies, going along with the computerization of the job market and private households, had caused the fast and competitive development of digital (multi-)media products as well as mass-market software. Animation (flagship) software, such as “Future Splash Animator” or “Macromedia Flash”, allowed the ‘programming’ of maps, instead of only drawing them as usual (Scharlach 2002).
The paradigm shift from analogue to digital cartography required new methodological fundamentals in cartography (see also Brauen 2006; Buziek 1999; Müller 1997). To create an audiovisually animated map, cartographers had the new task to handle (such as record or find and download, cut and edit) sounds and to implement these sound elements into interactive map frameworks—by writing (usually object-oriented) programming/scripting code.
From the mid-1990s onwards, a large bouquet of audiovisual maps has been published in academic papers and launched online—many of these maps were obviously influenced by animated spatial visualizations released by other creative industries, such as animated cartoons (Garfield 2012; Harrower 2004; Peterson 1999) and video/computer games (Edler et al. 2018b; Edler and Dickmann 2016, 2017; Ahlqvist 2011). Nevertheless, compared to purely graphical maps (originating in traditional methods of map-making), the today existing number of audiovisual maps is still very limited (Dickmann 2018, p 170). Without the possibility of considering each of these audiovisual cartographic publications, a set of specific variants of cartographic sound elements has become apparent: (1) computer-generated abstract sounds (and sound sequences), (2) human or computer-simulated speech, (3) recorded or computer-generated music and (4) ‘audiorealistic’ recordings of the real ‘soundscape’ (or computer-simulated imitations).
The most ‘geographical’ of these sound variants in audiovisual cartography is the audiorealistic representation of the “soundscape”, a term coined by Schafer (1977). The term represents the compilation of perceivable sounds in the physical landscape at a specific place over a specific period of time. The possibility of recording the soundscape allows a very close and detailed relation between the map and the multisensory landscape represented in the map (Edler et al. 2012; Laakso and Sarjakoski 2010). The represented soundscape may also document different experiences made by individuals and groups of society (see also Wissmann 2014). Thus, the soundscape and its technical representation based on audiovisual cartography can be closely related to social constructivist approaches of landscape research (Edler et al. 2018a).
This article is dedicated to the linkage between the meaning and relevance of soundscape for landscape research and modern interactive visualization techniques of audiovisual cartography (in 3D). Before going into these details, the established variants of sounds which have traditionally been used in audiovisual maps are introduced.
2 Examples of Established Sound Variants in Audiovisual Cartography
This chapter intends to give a short and compact overview of the four established variants of sound in audiovisual cartography. Some examples are contained in figures to offer, at least some, additional visual impressions.
2.1 Abstract Sounds
Speech, either a recorded human or computer-generated voice, is a multifaceted and adaptable tool in multimedia cartography (see also Dickmann 2018; Lammert-Siepmann et al. 2014, 2017; Morrison and Ramirez 2001). It addresses the linguistic code of transferring facts or concepts. Users of mobile navigation systems know that spoken instructions help people to improve the effectiveness and efficiency of getting from A to B. Apart from ‘acoustically enriched’ satnavs, cartographers have used speech in different scenarios of educational applications: At the beginning, an (original or simulated) voice can give introductory comments of how to use an application, like a ‘guiding agent’ (Edler and Dodt 2010; Borchert 1999; Reagan and Baldwin 2006). These introductory (spoken) words can also help to contextualize the contents of the map application, such as providing background information about history and geography (Pulsifer et al. 2007; Francis 1999).
In the map itself, speech can be linked with specific geographical areas and give information about data and facts that can be read already (redundant information transfer), such as place names, land use categories or precipitation values. Recent cartographic research shows that the additional auditory communication of object names improves not only the memory of names (object-identities), but also the spatial accuracy of their corresponding object-locations (Lammert-Siepmann et al. 2017). The audiovisual communication of semantic attributes of represented spatial objects seems to improve the binding of object identity and object location, which even enhances the spatial accuracy of object-location memory.
Speech can also contain information which is additional to the graphically represented map contents. In the context of learning a foreign language, speech can give, for instance, additional information about pronunciation, grammar and contextualized vocabulary (Edler et al. 2012; Lammert-Siepmann et al. 2011).
Music is a highly complex and diversified sound and rhythm system with its own structural logic (Sonnenschein 2001). Generally, music in maps and map-like applications seems to encourage user pacing, it also transports emotional cues and it can have a motivating function (Brauen 2014; see also Buziek 1999). The sound variant music does not have an equivalent in the visual/graphical dimension of cartography (Edler et al. 2012), unlike abstract sounds (abstract symbols, usually explained in a map key) and speech (map lettering). However, music seems to fascinate some multimedia cartographers and so it is not surprising that musical elements have been used as cartographic elements in some audiovisual maps (Théberge 2005; see also Dickmann 2018, p 171).
Examples exist where music is used in the “intro” of a multimedia cartographic application. In the intro (an opening sequence before the main applications (maps) can be read and used), music usually creates a link between the theme and/or geographical location of the map(s), as known from the film industry, where music is often linked and associated with real or fictional locations (e.g. Star Wars, The Fresh Prince of Bel-Air or the ‘Boom Chica Boom’ song, by Johnny Cash, pointing to the ‘Wild West’ in the opening theme of Bonanza). In other words, music ‘welcomes’ the user/reader/spectator and “invokes a broader geographical context” (Pulsifer et al. 2007, p 208).
A multimedia cartographic example is an intro song sequence of Irish folk in an interactive and audiovisual map tutorial for studying Irish placenames (Edler and Dodt 2010). In an interactive atlas, dedicated to different nautical Antarctica explorations, classical music (String Quartet No. 3 by Wolfgang A. Mozart) introduces the Cook expedition (1772–75). Here, music (of the similar historical period) creates an aesthetic environment (Pulsifer et al. 2007; Siekierska and Armenakis 2007). Accompanying geographical locations and attributes by corresponding music is also a familiar strategy found in video games, where spatial stories are told based on interactive maps or map-like applications, such as Super Mario World or Sim City (Edler and Dickmann 2016, 2017; Grimshaw 2014; Théberge 2005).
In other multimedia cartographic applications, music is also used as a variable encoding and transporting geographical contents which cannot be received from the graphics. In a map on Canada’s international trade relations (1976–2000), musical sequences and their different levels of loudness (see Krygier 1994) represent Canada’s trade balance with different world regions (Brauen and Taylor 2008). Using the ambiguous map title “Rock Music”, different particle sizes determined in sediment analyses of the Matanuska Glacier (Alaska) are represented by song sequences in another audiovisual map (Helmuth and Davis 2004). Compared to other sound variants, music is however rarely used in audiovisual cartography.
2.4 Audiorealstic Recordings/Simulations of the ‘Soundscape’
By ‘nature’, audiorealistic recordings or computer-generated simulations of what can be acoustically experienced in the (physical) landscape (“soundscape”, Schafer 1977) are closely linked. The signifier (sound element) and the signified (sound emitting object in the landscape) can have a high level of correspondence (‘iconicity’) in a map (Edler et al. 2012). An audiorealistic sound sequence can ‘echo’ an audible part of the whole concept it is supposed to represent (‘pars pro toto’), comparable to graphic icons (such as pictograms) in mono-sensory (visual-only) maps. An example for this is a recorded sound sequence of a ringing bell (in graphics, for, e.g. a Christian cross) representing locations of Catholic or Protestant churches or monasteries. The other sound variants introduced above would either need a legend to establish a proper cartographic communication (abstract sounds) or could only handle a language-based component to put across the meaning (speech), or would—even in the case of using recordings of a well-known church song—suppose a much higher degree of (socio-)cultural background knowledge to decode and understand the signified object properly.
The example sketched above—ringing bell representing church, but Catholic or Protestant (?)—also indicates the degree of uncertainty carried over by ‘pars pro toto audiorealistic sounds’, which—in a bad case of cartographic communication—may also end up in “unpredictable sound/image interactions” (Caquard et al. 2008). In the review of existing audiovisual maps containing audiorealistic sound elements, it becomes obvious that this variant of sound is more often used in large-scale maps (see also Aiello et al. 2016; Brauen 2014; Thirion 2007; Scharlach 2002)—to guarantee a high level of soundscape appropriateness and to avoid the problem of unpredictable uncertainty (Aiello et al. 2016; Axelsson 2015).
The public interest in ‘mapping’ audiorealistic sound sequences in the (physical) landscape becomes visible in such examples of large-scale audiovisual maps. It is also mirrored in social media and real-time cross-platform messengers (e.g. What’s App), video-sharing websites (incl. sound streams, e.g. https://www.youtube.com/) and widely known (free) online sound databases (e.g. https://freesound.org/). Individuals, but also groups with shared interests gather sound events they would like to keep, repeat and exchange. Apparently, audiorealistic sound seems to transport a special meaning to them and is considered as important (see also Papadimitriou et al. 2009).
The meaning and relevance of soundscapes are a research topic which is currently discussed in constructivist approaches of landscape research. Input of this multidisciplinary academic field bring in new discussions to cartography. In cartography, large-scale visualization methods are of rising importance, as these methods help to increase the currently demanded higher levels of realism in the final cartographic media (see Edler et al. 2018c; Hruby et al. 2018; Kersten et al. 2018; Coors et al. 2016; Günther-Diringer 2016; Dickmann and Dunker 2014).
3 The Meaning and Relevance of Soundscapes
Constructivist approaches of landscape research have established themselves in the last decades (e.g. Aschenbrand et al. 2017; Bruns and Kühne 2015; Gailing 2013; Greider and Garkovich 1994, Daniels and Cosgrove 1988; Cosgrove 1984, 1985; Kühne 2008a, 2009, 2018a). Especially the social constructivist landscape theory is suitable for the formation of ‘multisensory’ impressions. It is originating from phenomenological sociology (Schütz 1960, 1971 ). In comparison to approaches of radical constructivism and discourse theory, where the focus is put on processes of social communication, social constructivist landscape research is rather dedicated to the material world (cf. Kühne 2018b; Weber 2018).
From a constructivist perspective, landscape is not understood as an ‘objectively existing’ object, which it is, in positivism, or as an ‘entity’ from the mutual imprinting of culture and nature, which it is, in essentialism (for more details on the approaches, see Kühne 2018c). From a social constructivist perspective, the constitutive level of landscape is formed by social patterns of interpretation and evaluation. These patterns are incorporated by individuals in the process of socialization. This enables individuals to synthesize the sensory impressions of material objects in their consciousness. It also allows them to communicate via the formed ‘landscape’, without the loss of social recognition (for more details, see Kühne 2018b, d; Wojtkiewicz and Heiland 2012). In the process of synthesizing the sensory impressions of material objects into landscape within the consciousness, not all sensory impressions are considered in the same way. A selection takes place that is based on social conventions, going along with a reduction of complexity (Weber et al. 2018, Burckhardt 2006).
The socialization of social patterns of landscape interpretation and evaluation is a diversified process (for more details, see Kühne 2008a, e; Stotten 2013): The formation of the ‘native regular landscape’ primarily happens during the direct confrontation with phenomena around the parental home, which are then interpreted as ‘landscape’ by formative others (especially parents and relatives). This landscape is formed in a normative way and regarded as ‘normal’. The adolescent is then introduced to more general patterns of interpretation and evaluation of landscape. The mediation is more institutionally bound and influenced by school books, films, photos, paintings, and/or the Internet (see Kühne 2018e; Linke 2017). In this way, a ‘stereotypical landscape’ is shaped out. It represents a ‘common sense’ of an aesthetic, cognitive and functional nature, whereas the ‘native regular landscape’ has a more emotional quality. A third level of landscape socialization is formed by special knowledge of ‘experts’. It is usually formed by academic study. Here, the patterns of interpretation and evaluation are strongly cognitively influenced. They differ a lot from each other, and they are in a distinctive competition with each other in terms of their definitions, but also with respect to the ‘native regular landscape’ as well as the ‘stereotypical landscapes’ (Kühne 2018d).
In addition to its strong emotional linkage, the ‘native regular landscape’ shows clear references to non-visual sensory impressions. It is “filled with first memories of regional language, sounds, smells, colours, gestures, moods and speaking things and deeply anchored in the memory” (Hüppauf 2007 p 112; see also Proshansky et al. 1983; De Visscher and Bouverne-De Bie 2008). Moreover, it offers a “motherly landscaped home and security” (Hard 1969, p 11). Accordingly, stories about early landscape experiences in peoples’ biographies often refer to non-visual sensory stimuli (Kühne and Schönwald 2015; Kühne 2006). In contrast to the significance of non-visual stimuli in the formation of ‘native regular landscapes’, these are largely ignored in most ‘expert special knowledge’. Raab (2001) mentions some ‘quality criteria’ of Western science (freedom of values, general validity and comprehensibility) as justification for this (see also Kazig 2013, 2019; Bischoff 2007; Winkler 2005). The ‘expert special knowledge’ represents an essential basis for the formation of ‘stereotypical landscapes’. In textbooks, but also in documentaries and sometimes also in online videos, they make a significant contribution to the socialization of a positivist understanding of (geographic) space (amongst many: Ipsen 2006; Wardenga 2002; Läpple 1992). Accordingly, stereotypical notions of landscape are more intensively marked by visually perceptible elements than the ‘native regular landscape’. This is likely related to the fact that the human sense of vision is usually much more dominant than the sense of hearing (Tuan 1993). However, in comparison to holders of ‘expert landscape knowledge’, people without a focus on visual aspects rather go along with an acoustic, olfactory, tactile and gustatory dimension (Bischoff 2007; Porteous 1985). Hence, the non-visual dimensions of landscape—even if ‘unseen’—are an important part in the perception and (re-)construction of the entire landscape composite and its evaluation and meaning.
This can also be reconstructed empirically: In 2016, for instance, 447 inhabitants of the Saarland in Germany were asked in a closed questionnaire which aspects of the perceived landscape they considered as relevant for landscape representation. Approximately, two-thirds of the participants stated that sounds were part of the landscape (Kühne 2018d), which is also backed up by findings of similar earlier studies (see Rodaway 2011; Kühne 2006; Vining 1992). The interrelations between visual and non-visual landscape stimuli are particularly addressed in atmospheric landscape research (Kazig 2013, 2019).
In terms of representing non-visual stimuli of landscapes, it is a difficult challenge to grasp and ‘display’ the specific features helping to transport the multidimensionality and multisensory composite of the landscape. Traditional approaches of cartography often implied a ‘visual translation’ of this composite, as landscapes comprising other sensory dimensions were often only graphically represented (Dodt et al. 2017; Lauriault and Lindgaard 2006; Papadimitriou et al. 2009, Müller et al. 2001). Even if non-visual map elements were incorporated, they were usually linked with a 2D or highly generalized 3D visual representation of a landscape (see examples in chapter 2, incl. Figs. 1, 2 and 3). Ongoing developments of digital cartography and ‘virtual world-building’, however, allow a much more (photo-)realistic and flexible (interactive) representation of the visual dimension of landscape (Edler et al. 2018b; Hruby et al. 2018; Kersten et al. 2018): these (photo-)realistic models can be linked with audiorealistic contents. This multisensory mix of spatially referenced stimuli can be merged together in easily accessible audiovisual landscape representations, such as soundscape-featured environments constructed in (immersive) Virtual Reality (VR).
The use of VR appears as an enrichment for social constructivist landscape research and, vice versa, the theoretical framing offered by social constructivist landscape theory can be an enrichment for VR. In the first scenario, empirical settings can be prepared in an idealized form to test the possibilities and limits of theory more targeted. In the second scenario, settings can be constructed theoretically, and empirical outcomes can be integrated into a more general scientific framework of landscape research (Edler et al. 2018c).
In the literature on VR-based landscapes in cartography, and GI sciences, the auditory dimension has not been in the ‘focus’ so far. The following technically oriented chapter shows how 3D-sound can be physically integrated into these ‘walkable’ multisensory 3D-landscapes (approaching a 1:1 scale).
4 Using 3D Sound in Immersive Virtual Environments
To add 3D sound to a 3D environment which can be accessed in immersive virtual reality, modern software solutions are required that facilitate this linkage between visual and auditory landscape representations. Unity3D is a modern (cross-platform) game engine supporting the implementation of both dimensions by quite user-friendly options. It works with common sound formats such as.mp3, .wav, .aiff and .ogg (for further information on supported formats, see: https://docs.unity3d.com/Manual/AudioFiles.html), which, for instance, can be downloaded in online sound databases (e.g. https://freesound.org/) or generated with customary smartphones or mobile microphone devices.
The urban soundscape of cars and traffic is an example to illustrate the different patterns of interpretation and evaluation of some parts of society. Depending on the individual (socially influenced) preference (and its intensity) for different means of transport, the evaluation of standing and driving sounds also turn out to be incorrect: A bicycle activist will probably understand the sounds of motorized individual traffic as noise. However, a friend of tuned cars will understand the sound of an Opel Manta (whose exhaust produces an acoustical intensification) as an enrichment of the urban soundscape.
In the audio source component, an audio clip is defined which should be played in the immersive audiovisual VR environment. Additionally, the audio source component contains additional sound options which can be set and changed, such as volume, minimum and maximum distance, and Doppler level (Fig. 4). Within the defined minimum distance, the sound is hearable with the defined volume level. Outside of the minimum distance, the volume will gradually decrease until it reaches zero at the defined maximum distance (behind this ‘virtual 3D border’, the sound is no longer hearable). The Doppler level defines whether and how intensive a Doppler effect is applied. If the value is larger than zero, the played sounds are pitched based on the movement speed and direction of their audio source, relative to the position of an audio listener. It becomes apparent that some dominant variables of Krygier’s typology (1994) also occur in modern (VR-based) 3D animation software.
5 Summary and Outlook
This paper has given an overview of the use of different variants of sound established in audiovisual cartography. Amongst abstract sounds and abstract sound sequences (see Krygier 1994), speech and music, audiorealistic sequences representing the “soundscape” (see Schafer 1977, also Krause 2016) of a place are a highly complex entity which can transport and represent a lot of the socially constructed meaning of landscapes.
Current 3D visualization techniques used in modern cartography (cf. Hruby et al. 2018; Kersten et al. 2018; Edler et al. 2018c) go beyond the realism transported via traditional audiovisual maps. It is possible to incorporate audiorealistic sound clips that scatter sound (clips) in 3D and that can move their (dynamic) positions in spatio-temporal animations. These cartographic techniques allow a highly realistic representation of landscapes which can be used interactively and immersively, implying that the user takes an ego-perspective and can navigate through the audiovisual landscape simulation in real time.
Sounds have a special significance for people without expert knowledge in the construction of landscapes. In this respect, from the perspective of social constructivist landscape research, it seems very important to develop modern approaches to map and visualize this dimension of landscape. In terms of the creation of virtual landscapes, a new possibility is offered to explore the significance of the acoustic dimension in a firm way, due to the plannability of the acoustic stimuli by means of VR.
These modern options of cartographic 3D visualization, based on audiorealistic sound sequences and freely accessible game engines, bear a lot of potential for future approaches of landscape research, as these new opportunities of representing ‘multisensory realism’ offer a new dimension of simulated landscape experience and extend the repertoire of media that can be used in (social constructivist) landscape research. In other—and concluding—words, 3D visualization techniques and its immersive use in real time open a link between cartography and new interdisciplinary fields whose researchers had not shown a keen interest in cartography so far, due to the former lack of available innovations to create highly realistic 3D representations of different landscape dimensions.
- Aiello LM, Schifanella R, Quercia D, Aletta F (2016) Chatty maps: constructing sound maps of urban areas from social media data. Royal Society Open Science: 3(150690). Online available http://rsos.royalsocietypublishing.org/content/royopensci/3/3/150690.full.pdf. Accessed 11 Dec 2018
- Aschenbrand E, Kühne O, Weber F (2017) Rohstoffgewinnung in Deutschland: Auseinandersetzungen und Konflikte: Eine Analyse aus sozialkonstruktivistischer Perspektive. UmweltWirtschaftsForum, online firstGoogle Scholar
- Axelsson Ö (2015) How to measure soundscape quality. In: Proceedings of the euronoise conference. Maastricht, The Netherlands, 31 May–3 June 2015, pp 1477–1481Google Scholar
- Bertin J (1967) Semiologie graphique. Mouton et Gauthier- Villars, ParisGoogle Scholar
- Bischoff W (2007) Nicht-visuelle Dimensionen des Städtischen: Olfaktorische Wahrnehmung in Frankfurt am Main, dargestellt an zwei Einzelstudien zum Frankfurter Westend und Ostend. BIS-Verlag, OldenburgGoogle Scholar
- Brauen G (2014) Interactive audiovisual design for cartography: survey, prospects, and example. In: Lauriault T, Taylor DRF (eds) Developments in the theory and practice of cybercartography. Applications and indigenous mapping, 2nd edn. Elsevier, AmsterdamGoogle Scholar
- Brauen G, Taylor DRF (2008) Linked audio representation in cybercartography: guidance from animated and interactive cartography for using sound. Revista Brasileira de Cartografia 60(3):223–242Google Scholar
- Bruns D, Kühne O (2015) Gesellschaftliche Transformation und die Entwicklung von Landschaft – eine Betrachtung aus der Perspektive der sozialkonstruktivistischen Landschaftstheorie. In: Kühne O, Gawroński K, Hernik J (eds) Transformation und Landschaft. Die Folgen sozialer Wandlungsprozesse auf Landschaft. Springer VS, Wiesbaden, pp 9–13Google Scholar
- Burckhardt L (2006) Warum ist Landschaft schön? Die Spaziergangswissenschaft. Martin Schmitz Verlag, KasselGoogle Scholar
- Coors V, Andrae C, Böhm K-H (2016) 3D Stadtmodelle – Konzepte und Anwendungen mit CityGML. Wichmann, BerlinGoogle Scholar
- Cosgrove D (1984) Social formation and symbolic landscape. University of Wisconsin Press, LondonGoogle Scholar
- Daniels S, Cosgrove D (1988) Introduction: iconography and landscape. In: Cosgrove D, Daniels S (eds) The iconography of landscape. Essays on the symbolic representation, design and use of past environments. CUP, Cambridge, pp 1–10Google Scholar
- Dickmann F (2018) Kartographie. Westermann, BraunschweigGoogle Scholar
- Dickmann F, Dunker S (2014) Visualisierung von 3D-Gebäudemodellen – Welche Ansprüche stellt die Planung an dreidimensionale Stadtansichten? Kartographische Nachrichten 64(1):10–16Google Scholar
- Dodt J, Bestgen A-K, Edler D (2017) Ansätze der Erfassung und kartographischen Präsentation der olfaktorischen Dimension. Kartographische Nachrichten 67(5):245–256Google Scholar
- Edler D, Dickmann F (2016) Interaktive Multimediakartographie in frühen Videospielwelten – Das Beispiel „Super Mario World“. Kartographische Nachrichten 66(2):51–58Google Scholar
- Edler D, Dodt J (2010) Eine audio-visuelle Flash-Applikation zur Fremdsprachenvermittlung. Kartographische Nachrichten 60(5):276–278Google Scholar
- Edler D, Lammert-Siepmann N (2012) Audio-visuelle Karten für den Englischunterricht an Grundschulen. European University Press, BochumGoogle Scholar
- Edler D, Lammert-Siepmann N, Dodt J (2012) Die akustische Dimension in der Kartographie – eine Übersicht. Kartographische Nachrichten 62(4):185–195Google Scholar
- Edler D, Jebbink K, Dickmann F (2015) Einsatz audio-visueller Karten in der Schule – Eine Unterrichtsidee zum Strukturwandel im Ruhrgebiet. Kartographische Nachrichten 65(5):259–265Google Scholar
- Edler D, Kühne O, Jenal C, Vetter M, Dickmann F (2018a) Potenziale der Raumvisualisierung in Virtual Reality (VR) für die sozialkonstruktivistische Landschaftsforschung. Kartographische Nachrichten 68(5):245–254Google Scholar
- Edler D, Keil J, Dickmann F (2018b) Varianten interaktiver Karten in Video- und Computerspielen – eine Übersicht. Kartographische Nachrichten 68(2):57–65Google Scholar
- Edler D, Husar A, Keil J, Vetter M, Dickmann F (2018c) Virtual Reality (VR) and open source software: a workflow for constructing an interactive cartographic VR environment to explore urban landscapes. Kartographische Nachrichten 68(1):3–11Google Scholar
- Garfield S (2012) On the map. Why the world looks the way it does. Profile Books, LondonGoogle Scholar
- Greider T, Garkovich L (1994) Landscapes: the social construction of nature and the environment. Rural Sociol 59(1):1–24. https://doi.org/10.1111/j.1549-0831.1994.tb00519.x CrossRefGoogle Scholar
- Grimshaw M (2014) Sound. In: Wolf MJP, Perron B (eds) The Routledge companion to video game studies. Routledge, New York, pp 117–124Google Scholar
- Günther-Diringer D (2016) Historisches 3D-Stadtmodell von Karlsruhe. Kartographische Nachrichten 66(2):66–71Google Scholar
- Hard G (1969) Das Wort Landschaft und sein semantischer Hof: Zur Methode und Ergebnis eines linguistischen Tests. Wirkendes Wort 19:3–14Google Scholar
- Helmuth M, Davis T (2004) Rock music: a granular and stochastic synthesis based on the Matanuska glacier. In: Proceedings of ICMC 2004: the 30th annual international computer music conference. Miami, USA. http://marahelmuth.com/research/RockMusicFinalFinal.pdf. Accessed 11 Dec 2018
- Hüppauf B (2007) Heimat – die Wiederkehr eines verpönten Wortes: Ein Populärmythos im Zeitalter der Globalisierung. In: Gebhard G, Geisler O, Schröter S (eds) Heimat. Konturen und Konjunkturen eines umstrittenen Konzepts. Transcript Verlag, Bielefeld, pp 109–140Google Scholar
- Ipsen D (2006) Ort und Landschaft. VS Verlag für Sozialwissenschaften, WiesbadenGoogle Scholar
- Kazig R (2013) Landschaft mit allen Sinnen – Zum Wert des Atmosphärenbegriffs für die Landschaftsforschung. In: Bruns D, Kühne O (eds) Landschaften: theorie, Praxis und internationale Bezüge. Oceano Verlag, Schwerin, pp 221–232Google Scholar
- Kazig R (2019) Für ein alltagsästhetisches Verständnis von Heimat. In: Hülz M, Kühne O, Weber F (eds) Heimat. Ein vielfältiges Konstrukt. Springer VS, Wiesbaden. (Accepted, in print) Google Scholar
- Kersten TP, Deggim S, Tschirschwitz F, Lindstaedt M, Hinrichsen N (2018) Segeberg 1600 – Eine Stadtrekonstruktion in Virtual Reality. Kartographische Nachrichten 68(4):183–191Google Scholar
- Kornfeld A-L (2008) Die kartographische Visualisierung des akustischen Raums. Kartographische Nachrichten 58(6):294–301Google Scholar
- Krause B (2016) Wild soundscapes. Discovering the voice of the natural world. Yale University Press, New HavenGoogle Scholar
- Krygier JB (1991) An elemental approach to animation and sound in information graphics. Along with an apologia for doing it. [Seminar Paper, for Mark Detweiler, in Psychology 597a]. https://makingmaps.files.wordpress.com/2008/03/sound_paper_detweiler.pdf. Accessed 11 Dec 2018
- Krygier JB (1993) Mapping with sound. Online available https://makingmaps.net/author/environmentalgeography/page/7/. Accessed 11 Dec 2018
- Kühne O (2006) Landschaft in der Postmoderne: Das Beispiel des Saarlandes. DUV, WiesbadenGoogle Scholar
- Kühne O (2008a) Die Sozialisation von Landschaft – sozialkonstruktivistische Überlegungen, empirische Befunde und Konsequenzen für den Umgang mit dem Thema Landschaft in Geographie und räumlicher Planung. Geogr Z 96(4):189–206Google Scholar
- Kühne O (2008b) Distinktion – Macht – Landschaft: Zur sozialen Definition von Landschaft. VS Verlag für Sozialwissenschaften, WiesbadenGoogle Scholar
- Kühne O (2009) Heimat und Landschaft – Zusammenhänge und Zuschreibungen zwischen Macht und Mindermacht. Überlegungen auf sozialkonstruktivistischer Grundlage. Stadt + Grün 9:17–22Google Scholar
- Kühne O (2018b) Die Moralisierung von Landschaft – Überlegungen zu einer problematischen Kommunikation aus Sicht der Luhmannschen Systemtheorie. In: Hennecke S, Kegler H, Klaczynski K, Münderlein D (eds) Diedrich Bruns wird gelehrt haben. Eine Festschrift. Kassel University Press, Kassel, pp 115–121Google Scholar
- Kühne O (2018e) Der doppelte Landschaftswandel: physische Räume, soziale Deutungen, Bewertungen. Nachrichten der ARL 48(1):14–17Google Scholar
- Kühne O, Schönwald A (2015) San Diego: Eigenlogiken, Widersprüche und Hybriditäten in und von, America’s finest city’. Springer VS, WiesbadenGoogle Scholar
- Lammert-Siepmann N, Edler D, Redecker AP, Jürgens C (2011) Designing teaching units via WebGIS: remotely sensed imagery in the language classroom. EARSeL eProc 10(2):149–158Google Scholar
- Lammert-Siepmann N, Edler D, Dickmann F (2014) Die Effekte audiovisueller Informationsvermittlung in Topographischen Karten auf die Behaltensleistung – Das Beispiel geographische Namen. Kartographische Nachrichten 64(6):308–316Google Scholar
- Läpple D (1992) Essay über den Raum: Für ein gesellschaftswissenschaftliches Raumkonzept. In: Häußermann H, Ipsen D, Krämer-Badoni R, Läpple D, Rodenstein M, Siebel W (eds) Stadt und Raum. Soziologische Analysen. Centaurus, Pfaffenweiler, pp 157–207Google Scholar
- Linke S (2017) Ästhetik, Werte und Landschaft – eine Betrachtung zwischen philosophischen Grundlagen und aktueller Praxis der Landschaftsforschung. In: Kühne O, Megerle H, Weber F (eds) Landschaftsästhetik und Landschaftswandel. Springer VS, Wiesbaden, pp 23–40Google Scholar
- MacEachren AM (2004) How maps work. Representation, visualization, and design. Guilford Press, New YorkGoogle Scholar
- Morrison JL, Ramirez JR (2001) Integrating audio and user-controlled text to query digital databases and to present geographic names on digital maps and images. In: Proceedings of the 20th international cartographic conference, Beijing, China. http://icaci.org/files/documents/ICC_proceedings/ICC2001/icc2001/file/f12005.doc. Accessed 11 Dec 2018
- Müller J-C (1997) GIS, Multimedia und die Zukunft der Kartographie. Kartographische Nachrichten 47(2):41–51Google Scholar
- Müller J-C, Laurini R (1997) La cartographie de l’an 2000. Revue Internationale de Géomatique 7(1):87–106Google Scholar
- Müller J-C, Scharlach H, Jäger M (2001) Der Weg zu einer akustischen Kartographie. Kartographische Nachrichten 51(1):26–40Google Scholar
- Porteous DJ (1985) Smellscape. Prog Hum Geogr 9(3):356–378Google Scholar
- Raab J (2001) Soziologie des Geruchs: Über die soziale Konstruktion olfaktorischer Wahrnehmung. UVK Verlagsgesellschaft, KonstanzGoogle Scholar
- Rodaway P (2011) Sensuous geographies: body, sense, and place. Routledge, LondonGoogle Scholar
- Schafer RM (1977) The soundscape. Our sonic environment and the tuning of the world. Destiny Books, RochesterGoogle Scholar
- Scharlach H (2002) Lärmkarten. Kartographische Grundlagen und audiovisuelle Realisierung. PhD thesis, Ruhr University Bochum. http://www-brs.ub.ruhr-uni-bochum.de/netahtml/HSS/Diss/ScharlachHolger/diss.pdf. Accessed 11 Dec 2018
- Schiewe J (2015) Physiological and cognitive aspects of sound maps for representing quantitative data and changes in data. In: Brus J, Vondrakova A, Vozenilek V (eds) Modern trends in cartography. Selected papers of CARTOCON 2014, Springer, Heidelberg, pp 315–324Google Scholar
- Schiewe J, Weninger B (2012) Akustische Kodierung quantitativer Information in Karten – Ergebnisse einer Studie zum Vergleich mir klassischen Darstellungsformen. Kartographische Nachrichten 62(3):126–135Google Scholar
- Schito J (2011) Effizienzanalyse der akustischen Wahrnehmung einer Parameter Mapping Sonification eines digitalen Höhenmodells durch interaktive Datenexploration. Master Thesis, University of ZurichGoogle Scholar
- Schütz A (1971) Gesammelte Aufsätze 3: Studien zur phänomenologischen Philosophie. Martinus Nijhoff, Den HaagGoogle Scholar
- Sobue S-I, Araki H, Tazawa S, Noda H, Kamiya I, Yamamoto A, Fujita T, Higashiizumi I, Okumura H (2010) An application of lunar GIS with visualized and auditory Japan’s lunar explorer “KAGUYA” data. In: Elleithy K (ed) Advanced techniques in computing sciences and software engineering. Springer, Dordrecht, pp 159–163CrossRefGoogle Scholar
- Sonnenschein D (2001) Sound design. The expressive power of music, voice, and sound effects in cinema. Michael Wiese Productions, Studio CityGoogle Scholar
- Théberge P (2005) Sound maps: music and sound in cybercartography. In: Taylor DRF (ed) Cybercartography: theory and practice. Elsevier, Amsterdam, pp 380–410Google Scholar
- Thirion S (2007) Cascade on wheels: traffic mixer. http://www.trsp.net/cow/. Accessed 11 Dec 2018
- Tuan Y-F (1993) Voices, sounds and heavenly music. In: Tuan Y-F (ed) Passing strange and wonderful aesthetics, nature, and culture. Island Press, Washington, DC, pp 70–95Google Scholar
- Wardenga U (2002) Alte und neue Raumkonzepte für den Geographieunterricht. Geographie heute 23(200):8–11Google Scholar
- Winkler J (2005) Raumzeitphänomen Klanglandschaften. In: Denzer V, Hasse J, Kleefeld K-D, Recker U (eds) Kulturlandschaft. Wahrnehmung – Inventarisation – regionale Beispiele. Habelt, Bonn, pp 77–88Google Scholar
- Wissmann T (2014) Geographies of urban sound. Routledge, AbingdonGoogle Scholar
OpenAccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.