Stakeholder participation is an important component of modern urban planning processes. It can provide information about potential social conflicts related to specific urban planning scenarios. However, acquiring feedback from stakeholders is usually limited to explicit response types such as interviews or questionnaires. Such explicit response types are not suitable for the assessment of unconscious responses to specific parameters of an urban planning scenario. To address this limitation, we propose an approach for the assessment of affective and stress responses using implicit measures. Using a measure for electrodermal activity (EDA) and a virtual reality (VR)-based 3D urban model, we demonstrate how implicit physiological measurements can be visualized and temporally matched to specific parameters in an immersive representation of an urban planning scenario. Since this approach is supposed to support conventional stakeholder participation processes in urban planning, we designed it to be simple, cost-effective and with as little task interference as possible. Based on the additional insights gained from measuring physiological responses to urban planning scenarios, urban planners can further optimize planning scenarios by adjusting them to the derived implicitly expressed needs of stakeholders. To support simple implementation of the suggested approach, we provide sample scripts for visualization of EDA data. Limitations concerning the evaluation of raw EDA data and potentials for extending the described approach with additional physiological measures and real-time data evaluation are discussed.
Die Beteiligung von Interessenvertretern ist ein wichtiger Bestandteil moderner Stadtplanungsprozesse und kann Informationen über potenzielle soziale Konflikte im Zusammenhang mit bestimmten Stadtplanungsszenarien liefern. Die Erfassung von Feedback von Interessenvertretern ist jedoch in der Regel auf explizite Antworttypen wie Interviews oder Fragebögen beschränkt. Solch explizite Antworttypen sind nicht geeignet, um unbewusste Reaktionen auf bestimmte Parameter eines Stadtplanungsszenarios zu bewerten. Um diese Informationslücke zu schließen, schlagen wir einen Ansatz zur Erfassung von affektiven und Stressreaktionen unter Verwendung impliziter Messungen vor. Mithilfe von Messungen elektrodermaler Aktivität (EDA) und eines auf Virtual Reality (VR) basierenden 3D-Stadtmodells demonstrieren wir, wie implizite physiologische Messungen visualisiert und zeitlich mit bestimmten räumlichen Elementen in einer immersiven Darstellung eines Stadtplanungsszenarios in Zusammenhang werden können. Da dieser Ansatz herkömmliche Beteiligungsprozesse von Interessenvertretern in der Stadtplanung unterstützen soll, haben wir ihn so konzipiert, dass er einfach und kostengünstig ist und eine möglichst uneingeschränkte Erfahrung des virtuellen Szenarios ermöglicht. Basierend auf den zusätzlichen Erkenntnissen, die aus der Messung physiologischer Reaktionen auf Stadtplanungsszenarien gewonnen werden, können Stadtplaner diese Szenarien weiter optimieren, indem sie sie an die implizit geäußerten Bedürfnisse der Interessengruppen anpassen. Um die einfache Implementierung des entwickelten Ansatzes zu unterstützen, stellen wir Beispielskripte zur Visualisierung von EDA-Daten bereit. Einschränkungen bei der Auswertung von EDA-Rohdaten und Möglichkeiten zur Erweiterung des beschriebenen Ansatzes um zusätzliche physiologische Messungen und Echtzeit-Datenauswertung werden diskutiert.
Urban regions are subject to constant transformation processes. To ensure social acceptance of these transformations, modern urban planning needs to include stakeholders such as environmentalists and residents with different ages and genders in the planning processes. However, for effective participation of stakeholders in urban planning processes, visualizations are required to communicate different planning scenarios (Postert et al. 2022). Such visualizations can provide stakeholders with insights into planning details as well as broader overviews that cannot be communicated verbally or based on textual information (Al-Kodmany 1999; Gottwald et al. 2021; Jamei et al. 2017). Consequentially, choosing the most desirable or acceptable planning scenario can be based on more informed decision making.
The urban planning processes of developing, representing, communicating and exploring different planning scenarios are supported by cartographic visualization methods. The range of these cartographic visualization methods evolves with the availability of new technologies (Dickmann and Dunker 2014). Examples are the introduction of digital maps, web maps and 3D visualization techniques, e.g., based on methods from the video and gaming industries (Edler et al. 2018; Kolbe et al. 2005; Schmidt & Weiser 2012; Vosselman 2003).
In recent years, advances in virtual reality (VR) hardware and software have further expanded the possibilities of cartographic visualization and representation. Game engines such as Unity or the Unreal Engine provide ways to quickly and easily create interactive 3D spatial representations of real-world spaces, historical reproductions or planning scenarios (Chandler et al. 2022; Edler et al. 2019a, b; Ferworn et al. 2013; Indraprastha & Shinozaki 2009; Keil et al. 2021). Such 3D spaces can have a high realism, due to the availability of naturalistic physics in these engines, including simulated gravity, real-time lighting, collision calculations and 3D soundscapes (Edler et al. 2019a, b; Hruby 2019; Kersten et al. 2018). Furthermore, 3D models created in game engines can be easily adapted for use with VR hardware. Weber et al. (2022) demonstrated that providing people with information displayed in VR can affect decision making in political processes. This illustrates the potential of using VR visualizations during urban planning processes. Furthermore, Parsons (2014) argued that using VR environments not only provides experimental control of perceptual stimuli, is also supports ecological validity due to the representativeness of real-life situations.
VR models can be explored in an immersive way from an egocentric, stereoscopic perspective in a scale of 1:1 (Baños et al. 2004; Hruby et al. 2020; Slater et al. 1996), and thus more similar to the perception of real-world spaces compared to 2D and pseudo-3D maps or screen-based 3D representations. Consequentially, using VR for planning scenarios can provide stakeholders with a more engaging and realistic impression of specific planning scenarios compared to other visualization approaches (Meenar and Kitson 2020). Thus, potential conflicts with specific stakeholder groups when selecting certain planning scenarios can be better identified and the most suitable scenario is more likely to be selected.
Regardless of the selected type of visual representation, the informative value of most stakeholder participation processes can be limited due to the way in which responses are acquired. Preferences, expectations, fears and objections of stakeholders regarding specific planning scenarios are usually captured with explicit response methods, for example self-reports or questionnaires (e.g., Ballantyne et al. 2013; Ghorbanzadeh et al. 2019; Tress and Tress 2003). However, stakeholders can be unaware of certain environmental parameters that affect their responses to these planning scenarios. For example, studies demonstrate that people can be unaware of how air pollution and noise levels affect their physical comfort and their stress level (Hébert et al. 2005; Schnell et al. 2012). Thus, using merely explicit response methods during stakeholder participation in urban planning processes cannot uncover all potential comfort or health issues related to specific urban planning scenarios.
In psychological studies, physiological measures such as electrodermal activity (EDA), heart rate, blood pressure, skin temperature or pupil dilation are commonly used to assess implicit (unconscious) responses to stimuli. Such physiological measures can be used as indicators for stress, cognitive load and both positive and negative affects (emotional reactions) such as happiness, anger and fear or disgust (Chen et al. 2017; Ekman et al. 1983; Hyönä et al. 1995; Reinhardt et al. 2012; Sinha et al. 1992). In spatial research, physiological measures have been suggested to address the effects of stress on the formation of mental spatial models (Weibel et al. 2018). Applying physiological measures during the presentation of urban planning scenarios to stakeholders could not only provide helpful information about unconscious responses to these scenarios. Implicit measures have additional advantages over explicit ones. Firstly, implicit measures are not susceptible to the social desirability bias (participants giving responses that makes them look good to others, cf. Jo 2000; Nederhof 1985) and are less likely to produce an observer expectancy bias (e.g., participants trying to confirm the experimenters expectations, cf. Barber & Silver 1968; Meehan et al. 2005). Secondly, it is difficult to temporally relate explicit responses (e.g., with a stress rating scale) to specific stimuli of a planning scenario. The explicit responses can be gathered during the exploration of the planning scenario. In this case, the distraction created by the response can interfere with the perception of the scenario. Alternatively, explicit responses can be gathered after exploring the scenario. In this case, it is difficult to relate the responses to specific stimuli or a combination of stimuli in the scenario (Meehan et al. 2005). Implicit measures like EDA can be continuously recorded during planning scenario exploration with non-invasive hardware. Therefore, if short physiological response latencies are considered (cf. Benedek and Kaernbach 2010; Kappeler-Setz et al. 2013), physiological responses and the stress and affects associated with these responses can be temporally directly related to specific stimuli of a planning scenario.
In this article, we explore to what extent physiological measurements can be used to assess implicit responses of stakeholders during the exploration of VR-based urban planning scenarios. Using a low-cost EDA wristband, we focus on the development of an approach that is easily replicable with any urban planning model and generates data that is easy to evaluate. Opposed to other physiological measures (e.g., wired EDA or EEG), the used wristband does not restrict the mobility of the user and does not interfere with the exploration of a VR-based urban model. In addition to the low costs and ease of implementation, EDA measurement is characterized by the ability to be used as a measure of both stress and fear responses (Faghih et al. 2015; Reinhardt et al. 2012). Skin conductance, as measured with EDA measures, reflects activation of the sympathetic nervous system and the resulting stimulation of sweat glands (Faghih et al. 2015). In an exploratory study, we test to what extent VR-based urban planning scenarios can induce stress and fear responses that can be identified in the EDA data. Furthermore, we investigate to what extent the developed approach can be used to temporally relate such stress and fear responses to specific stimuli of a planning scenario. With our findings, we aim to support urban planners in harnessing implicit response information of stakeholders in addition to the usually merely explicit responses gathered during participation processes. Thus, the knowledge gained from letting stakeholders explore different planning scenarios could be expanded and decision making in urban planning processes could be improved.
Given that the focus of this manuscript was the development of an approach to easily assess and evaluate implicit responses to urban planning scenarios, we used an exploratory sample of six geography students from the Ruhr University Bochum (4 females, 2 males) for sample data acquisition. The study has been controlled and approved by the ethics committee of the Faculty of Geosciences at the Ruhr University Bochum (13 October 2022).
Using Unity (version 2019.4.28f1), we created a VR capable 3D city model designed to provide an example of a typical German city (see Fig. 1). The model was roughly based on the 3D model created by Weißmann et al. (2022). It consisted of an urban scene with an intersection composed of a four-lane main road with two tram tracks in the middle that was crossed by a two-lane side road. Large residential buildings were located alongside the roads. Furthermore, we implemented a traffic system consisting of pedestrians, cars, buses and trams. Three scenes were derived from this 3D city model and adjustments in terms of the modeling and the soundscape were made.
The purpose of the first scene was to asses to what extent a VR-based scenario can produce a fear reaction that can be identified in the EDA data and temporally related to a specific stimulus. In this scene, the location of the VR player was located in the middle of the two-lane road (see Fig. 2). Aside from birds flying around and subtle background traffic noises (Unity volume: 0.036), the scene started out quiet and static. This calm start was used to assess an EDA baseline. 60 s after the start key was pressed, two trucks appeared on opposite directions of the road, drove toward the participants, passed them 19 s later and disappeared in the distance after 19 more seconds. Diesel engine sounds (Unity volume: 1) were attached to the trucks to generate a realistic 3D soundscape (cf. Edler et al. 2019a, b). Colliders were placed on the road in front of the VR player location. These colliders were invisible to the observers and were used to trigger actions based on calculated object collisions. As soon as the trucks collided with them, the recording of a honking sound was played (Unity volume: 1). This scenario was meant to simulate a fear inducing crossing of a road where no traffic island is available to separate pedestrians from heavy traffic. After the trucks disappeared, the scene was then presented for 60 more seconds to assess the duration of the assumed peak in the EDA data.
The second and third scene were designed to induce different stress levels based on traffic density and traffic noise. In both scenes, the VR player was located next to where the two-lane road crossed the four-lane main road. The second scene (see Fig. 3) contained 20 motorized vehicles and a subtle background traffic noise was played (Unity volume: 0.036). Scene 3 (see Fig. 4) contained 52 motorized vehicles equipped with a combustion engine 3D sound (Unity volume: 1) and the background traffic noise was increased (Unity volume: 0.525). Furthermore, the model of a parked bus was placed in the side street, which was equipped with a 3D sound of a running diesel engine (Unity volume: 1). Both the second and the third scene were presented for 60 s. The vehicles in both scenes passed along the main road in four waves to simulate a traffic light-controlled traffic situation. The scenarios presented in these scenes aimed to compare a typical current traffic situation in a German city (Fig. 4) with a potential future traffic scenario where combustion engine cars are replaced by electric cars and the general traffic density is reduced (Fig. 3, e.g., by improving public transport options that replace private transport options).
Participants sat in a swivel chair and were equipped with an HTC Vive Pro VR head mounted display (HMD). Additionally, an Empatica E4 wristband used for EDA recording was wrapped around their non-dominant wrist. This watch-shaped wristband was selected, because it should produce less interference with the task compared to other EDA measures, e.g., wired EDA sensors on the fingertips. To prevent undesired data artifacts caused by arm movements (Kappeler-Setz et al. 2013), participants were asked to rest their non-dominant arm on the armrest of the chair and were instructed to look around and experience the environments displayed in the HMD. As it was not possible to temporally synchronize the EDA wristband with the VR model code based, we were required to set a timestamp for identifying the start of the experiment and the presentation of specific stimuli in the EDA recordings. For this purpose, the VR model started with the first scene in an idle state and no dynamic stimuli. The dynamic scenes were programmed to start with a key press. By pressing this key and a timestamp button on the EDA wristband simultaneously, we were able to record a timestamp for the EDA data that corresponded to the start of the experiment. After the start key was pressed, no additional input from the experimenter or the participants was necessary. At the end of each scene, the next scene was started automatically.
The used Empatica E4 wristband records EDA data with a temporal resolution of 4 Hz. In our approach, we investigate the unfiltered skin conductance level (SCL) in Microsiemens as provided by the wristband. The visualized data is investigated for phasic activations (sudden peaks in the SCL) that are assumed to reflect fear-induced stress and other stress reactions to the visual and auditory stimuli provided by the VR-based urban model (cf. Kappeler-Setz et al. 2013; Trujillo et al. 2019). The use of unfiltered EDA data not only allows for a simple and easily replicable approach. It also provides the potential to monitor and evaluate real-time data in future approaches.
All data processing and visualization was carried out using R Studio (Version 1.4.1717). To temporally align the EDA data of different participants and to identify the stimulus events within the data, we cropped the data of each participant using the recorded timestamp as the start time and 398 s (experiment duration) after the timestamp as the end time. Additionally, an adjusted timeline was applied to each recording beginning with zero seconds at the recorded timestamp. This allowed us to plot multiple recordings of different participants in a single graph and to visually compare their EDA responses to specific stimuli (see Fig. 5). R Scripts for the cropping and visualization together with sample data can be found in the supplementary material.
In Fig. 5, we can observe distinct phasic activation shortly after the trucks passed by the participants in the first scene and after the switch from the second to the third scene. Furthermore, moderate phasic activation occurred shortly after the switch from the first to the second scene. General SCLs of most participants were higher in the third scene compared to the second scene. Moreover, SCLs slowly dropped in the first scene after the trucks passed and after the start of the second and third scene. In the data of one participant (orange line), we can observe a few unique moderate phasic activations during the second scene. Furthermore, EDA values of some participants (blue, yellow and green line) are extremely low and seem to have no distinct temporal relation to the presented stimuli. However, if we set the dimensions of the EDA scale separately for each participant based on their individual minimum and maximum SCL values, we can observe similar patterns as visible in the EDA data of other participants (see Fig. 6).
With the described workflow, we intend to provide urban planners with a simple and affordable approach to assess implicit responses of stakeholders to specific urban planning scenarios. In our experiment, we investigated to what extent VR-based urban models can produce fear-induced stress and other stress reactions that are reflected in EDA data.
The visualized SCLs demonstrate some clear trends across the participants. Firstly, the trucks passing the participants in the first scene seem to have induced a pronounced fear response that is reflected in high phasic activations of the SCLs. Secondly, distinct phasic activations occurring shortly after the switch from the second to the third scene support our assumption that the increase of traffic noise levels and general traffic density in a VR-based city model produces a physical stress reaction that is reflected in SCLs. Thus, in agreement with previous studies (e.g., Faghih et al. 2015; Reinhardt et al. 2012; Tashjian et al. 2022), we were able to use EDA as a measure for fear and stress responses. Thirdly, SCLs of most participants showed a recovery trend after the trucks in the first scene disappeared and during the second and third scene. This is in agreement with statements of Kappeler-Setz et al. (2013) and Greco et al. (2016) that the peak of phasic EDA activation is usually followed by a recovery phase. The slow but steady and continuous drop of SCLs observed in the EDA data of several participants during the second and third scene is interpreted as a habituation to the auditory and visual stimuli. Similar habituation effect of skin conductance responses (SCRs) to auditory and visual stimuli have been reported by Lykken et al. (1988), Bacigalupo and Luck (2018) and Barry and Sokolov (1993). Fourth, we can observe short latencies of the phasic activations after the trucks passed in the first scene and after the switch to the second and third scene. This is in agreement with Benedek and Kaernbach (2010), Leiner et al. (2012) and Sjouwerman and Lonsdorf (2019), who report varying latencies between almost one and three seconds between the stimulus presentation and the incline of the SCL and a latency between 1.5 and 6.5 s after the stimulus presentation until the peak of the phasic activation is reached. These latency variations need to be considered when observed phasic activations in the EDA data are temporally matched to specific stimuli in the VR-based 3D model (Babaei et al. 2021). Otherwise, the wrong stimuli could be interpreted as stress or fear inducing, especially if many different stimuli are presented in quick succession. Thus, potentially conflicting parameters of a planning scenario should be presented separate from each other within sufficient time intervals (e.g., five to ten seconds) whenever possible. This can help to ensure that the physiological reactions can be clearly assigned to a specific stimulus. Furthermore, by temporally separating potentially relevant stimuli, potential overlaps of several phasic activations can be prevented (Greco et al. 2016).
In addition to the trends observed across participants, we also found some artifacts and differences between participants in the visualized data. For example, some peaks in the EDA data cannot be linked clearly to a specific stimulus. In the orange line in Fig. 5, we see some moderate phasic activations during the second scene that cannot be observed in the data of other participants. After the experiment, this participant reported to have looked barely to the left side during this scene. Therefore, due to the limited field of view of the HMD, this participant reported to have been surprised by the vehicles that appeared in waves in the field of view. This might explain the pattern of EDA peaks and demonstrates an issue related to VR-based stimulus presentation. As the user can freely choose the visual perspective of a VR scene by rotating and moving the head (Keil et al. 2021), experimenters have only limited control over the stimulus presentation. During stakeholder participation processes, this could make it difficult to match measured physiological responses to the stimuli that triggered these responses. Therefore, we propose to record the scene in the field of view that is dynamically selected by the stakeholders during the presentation of VR-based urban planning scenarios for later matching with SCL events. Even more relevant information on potentially stress or fear inducing stimuli can be obtained by using VR HMDs with eye tracking capabilities, for example the HTC Vive Pro Eye. As eye fixations are argued to reflect attentional processing (Henderson 2003; Just & Carpenter 1976; Poole & Ball 2006), investigating eye fixations can help to identify stimuli associated with a phasic activation in the SCL data. However, even if physiological measures, field of view recordings and eye tracking provide information that cannot be gathered with explicit response methods, applying subsequent interviews or think aloud techniques is highly recommended, as this can shed light on data artifacts that are otherwise difficult to explain.
Some general differences of SCLs between participants were also observed in the data. Some participants (e.g., the one represented by the orange line in Fig. 5) showed strong differences between tonic and phasic components in the EDA data whereas SCLs of others (the ones represented by the blue, yellow and green line in Fig. 5) appeared almost flat in comparison. This problem is amplified by the fact that certain (albeit small) groups of non-responders and hyper-responders have been identified in EDA experiments (Fung et al. 2005; Mirkin & Coppen 1980; Tran et al. 2023), as well as effects of caffeine consumption and medication on SCls and SCRs (Babaei et al. 2021). This illustrates the difficulty to compare SCL trends and events between participants when raw SCL data is investigated. Possible solutions for addressing different individual SCLs would be to standardize the data between participants using Z-scores, percentages based on individual maximum scores recorded after a startle stimulus, or to decompose the data into tonic (baseline levels) and phasic components (cf. Babaei et al. 2021; Benedek & Kaernbach 2010; Braithwaite et al. 2015; Leiner et al. 2012).
However, concerning the use of data post-processing techniques, a tradeoff between knowledge gained and technical feasibility needs to be considered. The approach described in this article is meant to provide urban planners with simple means to investigate affects and stress associated with specific elements of urban planning scenarios. Detailed data filtering and analyses, as usually applied in psychophysiological studies, would be difficult to integrate into conventional urban planning processes due to the time and expertise required. Instead, we suggest to further develop the described approach into a real-time evaluation tool. This would allow urban planners to identify potentially conflicting issues of urban planning scenarios already during the stakeholder participation process and to further address these issues during interviews. Additional detailed investigation and evaluation of the identified issues could be carried out in subsequent studies.
Concerning the generalizability of the reported results, it needs to be considered that a small and relatively uniform study sample was used. Approaches to measure implicit responses to VR-based urban models should also consider potential age differences of stakeholders. This includes, for example, technology acceptance or the susceptibility to VR sickness (LaViola 2000; Lee et al. 2019; Saredakis et al. 2020). Therefore, to ensure inclusion of all relevant age groups, stakeholder participation processes using VR methods need to ensure ease of use and need to reduce the risk of VR sickness, e.g., by choosing appropriate VR locomotion methods or by reducing the field of view (Edler et al. 2019a, b; Langbehn et al. 2018; LaViola 2000).
Another limitation concerning the application of the described approach in urban planning scenarios is the limited freedom of movement in our study design. Asking participants to stay seated helped to reduce EDA data artifacts (Tronstad et al. 2022). However, during planning participation processes, stakeholders should be able to explore virtual scenarios as freely as possible. Therefore, other ways to handle EDA data artifacts should be explored. We suggest to either measure EDA data at more than one skin location (Tronstad et al. 2022) or to use accelerometer data, which is also available in the Empatica E4 wristband. This data could be used to identify sudden wrist movements and to either remove the resulting EDA data artifacts or to add a timed note to the corresponding EDA data.
With regard to the choice of assessing EDA at the wrist, a tradeoff between user comfort and data validity must be considered. We chose to use the Empatica E4 wristband, because it is less obtrusive compared to measurements at the palm or fingers. Thus, participants should be less distracted from the VR experience. However, EDA data recorded at the wrist has been argued to be less representative of stimulus related responses, because it is superimposed by thermoregulatory activity (Babaei et al. 2021). Therefore, to ensure construct validity, using EDA devices that record EDA data at the fingers with as little distraction as possible (e.g., wireless recordings) should be considered.
Concerning the use of EDA as a measure for fear, it is important to mention that phasic activation of EDA may be seen as an indirect response to fear stimuli, Fear arousal causes a stress response (Rodrigues et al. 2009). This stress response is in turn reflected in increased phasic activation of the EDA data. However, for urban planning decisions it can be important to differentiate between fear-based stress and other forms of stress, for example caused by continuous noise pollution. This may be difficult in VR environments created for urban planning processes, because, opposed to the stimuli in our experiment, the stimuli in urban planning scenarios are not necessarily chosen to elicit specific emotional responses. Therefore, it may be desirable to simultaneously utilize additional physiological measures as skin temperature or blood pressure to better differentiate between different emotions and sources of stress (cf. Ekman et al. 1983; Sinha et al. 1992).
The described approach is a first step toward providing urban planners with more extensive feedback from stakeholder participation processes. In addition to the assessment of stress and fear induced by traffic situations investigated in our study, the approach could also be applied to other urban planning issues. For example, modern game engines allow to create comparisons of different construction project scenarios and to simulate shadows, daylight and artificial lighting within these scenarios. By visualizing and exploring these urban planning scenarios in VR, stress and fear issues could be identified and resolved. Future research should focus on the implementation of additional implicit measures as pupil dilation, heart rate, blood pressure and skin temperature as measures for stress, cognitive load, fear, anger, disgust or happiness (Chen et al. 2017; Ekman et al. 1983; Hyönä et al. 1995; Reinhardt et al. 2012; Sinha et al. 1992). Integrating additional physiological measures into a real-time indicator for stress and affective responses can be a promising approach for urban planners to assess previously uncovered unconscious responses to urban planning scenarios and, consequentially, to develop scenarios with a higher acceptance of stakeholders.
The sample scripts and data for the applied processing and visualization methods are provided as open supplementary material.
Al-Kodmany K (1999) Using visualization techniques for enhancing public participation in planning and design: process, implementation, and evaluation. Landsc Urban Plan 45(1):37–45. https://doi.org/10.1016/S0169-2046(99)00024-9
Babaei E, Tag B, Dingler T, Velloso E (2021) A critique of electrodermal activity practices at CHI. In: Kitamura Y, Quigley A, Isbister K, Igarashi T, Bjørn P, Drucker S (eds) Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems, pp. 1–14. ACM. https://doi.org/10.1145/3411764.3445370
Bacigalupo F, Luck SJ (2018) Event-related potential components as measures of aversive conditioning in humans. Psychophysiology. https://doi.org/10.1111/psyp.13015
Ballantyne EE, Lindholm M, Whiteing A (2013) A comparative study of urban freight transport planning: addressing stakeholder needs. J Transp Geogr 32:93–101. https://doi.org/10.1016/j.jtrangeo.2013.08.013
Baños RM, Botella C, Alcañiz M, Liaño V, Guerrero B, Rey B (2004) Immersion and emotion: their impact on the sense of presence. Cyberpsychol Behav 7(6):734–741. https://doi.org/10.1089/cpb.2004.7.734
Barber TX, Silver MJ (1968) Fact, fiction, and the experimenter bias effect. Psychol Bull 70(6):1–29. https://doi.org/10.1037/h0026724
Barry RJ, Sokolov EN (1993) Habituation of phasic and tonic components of the orienting reflex. Int J Psychophysiol 15(1):39–42. https://doi.org/10.1016/0167-8760(93)90093-5
Benedek M, Kaernbach C (2010) A continuous measure of phasic electrodermal activity. J Neurosci Methods 190(1):80–91. https://doi.org/10.1016/j.jneumeth.2010.04.028
Braithwaite JJ, Watson DG, Jones R, Rowe M (2015) A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. https://www.lancaster.ac.uk/media/lancaster-university/content-assets/documents/psychology/ABriefGuideforAnalysingElectrodermalActivityv4.pdf. Accessed 31 Jan 2023
Chandler T, Richards AE, Jenny B, Dickson F, Huang J, Klippel A, Neylan M, Wang F, Prober SM (2022) Immersive landscapes: modelling ecosystem reference conditions in virtual reality. Landscape Ecol 37(5):1293–1309. https://doi.org/10.1007/s10980-021-01313-8
Chen H, Dey A, Billinghurst M, Lindeman RW (2017) Exploring pupil dilation in emotional virtual reality environments. In ICAT-EGVE ‘17: Proceedings of the 27th International Conference on Artificial Reality and Telexistence and 22nd Eurographics Symposium on Virtual Environments (pp. 169–176). Eurographics Association. https://doi.org/10.2312/egve.20171355
Dickmann F, Dunker S (2014) Visualisierung von 3D-Gebäudemodellen - Welche Ansprüche stellt die Planung an dreidimensionale Stadtansichten? KN J Cartogr Geogr Inform 64(2):10–16. https://doi.org/10.1007/BF03544090
Edler D, Keil J, Dickmann F (2018) Varianten interaktiver Karten in Video- und Computerspielen — eine Übersicht. KN J Cartogr Geogr Inform 68(2):57–65. https://doi.org/10.1007/BF03544525
Edler D, Keil J, Wiedenlübbert T, Sossna M, Kühne O, Dickmann F (2019a) Immersive VR Experience of Redeveloped Post-industrial Sites: The Example of “Zeche Holland” in Bochum-Wattenscheid. KN J Cartogr Geogr Inform 69(4):267–284. https://doi.org/10.1007/s42489-019-00030-2
Edler D, Kühne O, Keil J, Dickmann F (2019b) Audiovisual cartography: established and new multimedia approaches to represent soundscapes. KN J Cartogr Geogr Inform 69(1):5–17. https://doi.org/10.1007/s42489-019-00004-4
Ekman P, Levenson RW, Friesen WV (1983) Autonomic nervous system activity distinguishes among emotions. Science (new York, NY) 221(4616):1208–1210. https://doi.org/10.1126/science.6612338
Faghih RT, Stokes PA, Marin M‑F, Zsido RG, Zorowitz S, Rosenbaum BL, Huijin S, Milad MR, Dougherty DD, Eskandar EN, Widge AS, Brown EN, Barbieri R (2015) Characterization of fear conditioning and fear extinction by analysis of electrodermal activity. Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual International Conference, 2015, 7814–7818. https://doi.org/10.1109/EMBC.2015.7320204
Ferworn A, Herman S, Tran J, Ufkes A, Mcdonald R (2013) Disaster scene reconstruction: modeling and simulating urban building collapse rubble within a game engine. In SCSC ’13, Proceedings of the 2013 Summer Computer Simulation Conference. Society for Modeling & Simulation International
Fung MT, Raine A, Loeber R, Lynam DR, Steinhauer SR, Venables PH, Stouthamer-Loeber M (2005) Reduced electrodermal activity in psychopathy-prone adolescents. J Abnorm Psychol 114(2):187–196. https://doi.org/10.1037/0021-843X.114.2.187
Ghorbanzadeh O, Moslem S, Blaschke T, Duleba S (2019) Sustainable Urban Transport Planning Considering Different Stakeholder Groups by an Interval-AHP Decision Support Model. Sustainability 11(1):9. https://doi.org/10.3390/su11010009
Gottwald S, Brenner J, Janssen R, Albert C (2021) Using Geodesign as a boundary management process for planning nature-based solutions in river landscapes. Ambio 50(8):1477–1496. https://doi.org/10.1007/s13280-020-01435-4
Greco A, Valenza G, Scilingo EP (2016) Modeling for the analysis of the EDA. In: Greco A, Valenza G, Scilingo EP (eds) Advances in electrodermal activity processing with applications for mental health. Springer International Publishing, New York, pp 19–33. https://doi.org/10.1007/978-3-319-46705-4_2
Hébert S, Béland R, Dionne-Fournelle O, Crête M, Lupien SJ (2005) Physiological stress response to video-game playing: The contribution of built-in music. Life Sci 76(20):2371–2380. https://doi.org/10.1016/j.lfs.2004.11.011
Henderson J (2003) Human gaze control during real-world scene perception. Trends Cogn Sci 7(11):498–504. https://doi.org/10.1016/j.tics.2003.09.006
Hruby F (2019) The Sound of Being There: Audiovisual Cartography with Immersive Virtual Environments. KN J Cartogr Geogr Inform 69(1):19–28. https://doi.org/10.1007/s42489-019-00003-5
Hruby F, Castellanos I, Ressl R (2020) Cartographic Scale in Immersive Virtual Environments. KN J Cartogr Geogr Inform 71(1):45–51. https://doi.org/10.1007/s42489-020-00055-y
Hyönä J, Tommola J, Alaja AM (1995) Pupil dilation as a measure of processing load in simultaneous interpretation and other language tasks. Q J Exp Psychol 48(3):598–612. https://doi.org/10.1080/14640749508401407
Indraprastha A, Shinozaki M (2009) The Investigation on Using Unity3D Game Engine in Urban Design Study. ITB J Inform Commun Technol 3(1):1–18. https://doi.org/10.5614/itbj.ict.2009.3.1.1
Jamei E, Mortimer M, Seyedmahmoudian M, Horan B, Stojcevski A (2017) Investigating the Role of Virtual Reality in Planning for Sustainable Smart Cities. Sustainability 9(11):2006. https://doi.org/10.3390/su9112006
Jo M-S (2000) Controlling social-desirability bias via method factors of direct and indirect questioning in structural equation models. Psychol Mark 17(2):137–148. https://doi.org/10.1002/(SICI)1520-6793(200002)17:2%3C137::AID-MAR5%3E3.0.CO;2-V
Just MA, Carpenter PA (1976) Eye fixations and cognitive processes. Cogn Psychol 8(4):441–480. https://doi.org/10.1016/0010-0285(76)90015-3
Kappeler-Setz C, Gravenhorst F, Schumm J, Arnrich B, Tröster G (2013) Towards Long Term Monitoring of Electrodermal Activity in Daily Life. Advance Online Publication. https://doi.org/10.3929/ethz-b-000043025
Keil J, Edler D, Schmitt T, Dickmann F (2021) Creating Immersive Virtual Environments Based on Open Geospatial Data and Game Engines. KN J Cartogr Geogr Inform 71(1):53–65. https://doi.org/10.1007/s42489-020-00069-6
Kersten TP, Deggim S, Tschirschwitz F, Lindstaedt M, Hinrichsen N (2018) Segeberg 1600 - Eine Stadtrekonstruktion in Virtual Reality. KN J Cartogr Geogr Inform 68(4):183–191
Kolbe TH, Gröger G, Plümer L (2005) CityGML: interoperable access to 3D city models. In: van Oosterom P, Zlatanova S, Fendel EM (eds) Geo-information for disaster management. Springer, Berlin Heidelberg, pp 883–899. https://doi.org/10.1007/3-540-27468-5_63
Langbehn E, Lubos P, Steinicke F (2018) Evaluation of Locomotion Techniques for Room-Scale VR: Joystick, Teleportation, and Redirected Walking. In: Richir S (eds) Proceedings of the Virtual Reality International Conference—Laval Virtual on - VRIC ‘18 (pp. 1–9). ACM Press. https://doi.org/10.1145/3234253.3234291
LaViola JJ (2000) A Discussion of Cybersickness in Virtual Environments. ACM SIGCHI Bulletin 32(1):47–56. https://doi.org/10.1145/333329.333344
Lee J, Kim J, Choi JY (2019) The adoption of virtual reality devices: The technology acceptance model integrating enjoyment, social interaction, and strength of the social ties. Telematics Inform 39:37–48. https://doi.org/10.1016/j.tele.2018.12.006
Leiner D, Fahr A, Früh H (2012) EDA Positive Change: A Simple Algorithm for Electrodermal Activity to Measure General Audience Arousal During Media Exposure. Commun Methods Meas 6(4):237–250. https://doi.org/10.1080/19312458.2012.732627
Lykken DT, Iacono WG, Haroian K, McGue M, Bouchard TJ (1988) Habituation of the skin conductance response to strong stimuli: A twin study. Psychophysiology 25(1):4–15. https://doi.org/10.1111/j.1469-8986.1988.tb00949.x
Meehan M, Razzaque S, Insko B, Whitton M, Brooks FP (2005) Review of four studies on the use of physiological reaction as a measure of presence in stressful virtual environments. Appl Psychophysiol Biofeedback 30(3):239–258. https://doi.org/10.1007/s10484-005-6381-3
Meenar M, Kitson J (2020) Using Multi-Sensory and Multi-Dimensional Immersive Virtual Reality in Participatory Planning. Urban Sci 4(3):34. https://doi.org/10.3390/urbansci4030034
Mirkin AM, Coppen A (1980) Electrodermal activity in depression: clinical and biochemical correlates. Br J Psychiatry 137:93–97. https://doi.org/10.1192/bjp.137.1.93
Nederhof AJ (1985) Methods of coping with social desirability bias: A review. Eur J Soc Psychol 15(3):263–280. https://doi.org/10.1002/ejsp.2420150303
Parsons TD (2014) Ecological validity in virtual reality-based neuropsychological assessment. In: Bhattacharyya S, Khosrow-Pour D (eds) Advances in information quality and management. Encyclopedia of Information Science and Technology, Third Edition (pp. 1006–1015). IGI Global. https://doi.org/10.4018/978-1-4666-5888-2.ch095
Poole A, Ball LJ (2006) eye tracking in hci and usability research. In Ghaoui C (Eds) Encyclopedia of human computer interaction, pp. 211–219. IGI Global. https://doi.org/10.4018/978-1-59140-562-7.ch034
Postert P, Wolf AEM, Schiewe J (2022) Integrating Visualization and Interaction Tools for Enhancing Collaboration in Different Public Participation Settings. ISPRS Int J Geo Inf 11(3):156. https://doi.org/10.3390/ijgi11030156
Reinhardt T, Schmahl C, Wüst S, Bohus M (2012) Salivary cortisol, heart rate, electrodermal activity and subjective stress responses to the Mannheim Multicomponent Stress Test (MMST). Psychiatry Res 198(1):106–111. https://doi.org/10.1016/j.psychres.2011.12.009
Rodrigues SM, LeDoux JE, Sapolsky RM (2009) The influence of stress hormones on fear circuitry. Annu Rev Neurosci 32:289–313. https://doi.org/10.1146/annurev.neuro.051508.135620
Saredakis D, Szpak A, Birckhead B, Keage HAD, Rizzo A, Loetscher T (2020) Factors Associated With Virtual Reality Sickness in Head-Mounted Displays: A Systematic Review and Meta-Analysis. Front Hum Neurosci 14:96. https://doi.org/10.3389/fnhum.2020.00096
Schmidt M, Weiser P (2012) Web mapping services: development and trends. In: Peterson MP (ed) Lecture notes in geoinformation and cartography. Online maps with APIs and WebServices. Springer, New York, pp 13–21. https://doi.org/10.1007/978-3-642-27485-5_2
Schnell I, Potchter O, Yaakov Y, Epstein Y, Brener S, Hermesh H (2012) Urban daily life routines and human exposure to environmental discomfort. Environ Monit Assess 184(7):4575–4590. https://doi.org/10.1007/s10661-011-2286-1
Sinha R, Lovallo WR, Parsons OA (1992) Cardiovascular differentiation of emotions. Psychosom Med 54(4):422–435. https://doi.org/10.1097/00006842-199207000-00005
Sjouwerman R, Lonsdorf TB (2019) Latency of skin conductance responses across stimulus modalities. Psychophysiology 56(4):e13307. https://doi.org/10.1111/psyp.13307
Slater M, Linakis V, Usoh M, Kooper R (1996) Immersion, presence, and performance in virtual environments: an experiment with tri-dimensional chess. In Green M, Fairchild K, Zyda M (Eds) Proceedings of the ACM Symposium on Virtual Reality Software and Technology (pp. 163–172). ACM Press. https://doi.org/10.1145/3304181.3304216
Tashjian SM, Fedrigo V, Molapour T, Mobbs D, Camerer CF (2022) Physiological Responses to a Haunted-House Threat Experience: Distinct Tonic and Phasic Effects. Psychol Sci 33(2):236–248. https://doi.org/10.1177/09567976211032231
Tran HT, Kong Y, Talati A, Posada-Quintero H, Chon KH, Chen I-P (2023) The use of electrodermal activity in pulpal diagnosis and dental pain assessment. Int Endod J 56(3):356–368. https://doi.org/10.1111/iej.13868
Tress B, Tress G (2003) Scenario visualisation for participatory landscape planning—a study from Denmark. Landsc Urban Plan 64(3):161–178. https://doi.org/10.1016/S0169-2046(02)00219-0
Tronstad C, Amini M, Bach DR, Martinsen ØG (2022) Current trends and opportunities in the methodology of electrodermal activity measurement. Physiol Measurement. https://doi.org/10.1088/1361-6579/ac5007
Trujillo JLH, Marín-Morales J, Rojas J‑C, Maldonado JL‑T, Millán CL, Provinciale JG, Raya MA (2019) Emotional cartography in design: a novel technique to represent emotional states altered by spaces. https://doi.org/10.5281/zenodo.2629385
Vosselman G (2003) 3d reconstruction of roads and trees for city modelling. In International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences (pp. 231–236). http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.117.1899. Accessed 31 Jan 2023
Weber W, Dingerkus F, Fabrikant SI, Zampa M, West M, Yildirim O (2022) Virtual reality as a tool for political decision-making? An empirical study on the power of immersive images on voting behavior. Front Commun. https://doi.org/10.3389/fcomm.2022.842186
Weibel RP, Grübel J, Zhao H, Thrash T, Meloni D, Hölscher C, Schinazi VR (2018) Virtual reality experiments with physiological measures. J Visualized Experiments. https://doi.org/10.3791/58318. (Advance online publication)
Weißmann M, Edler D, Keil J, Dickmann F (2022) The Development and simulation of an urban traffic system for the usage in immersive virtual environments. Abstracts ICA 5:1–2. https://doi.org/10.5194/ica-abs-5-101-2022
The template of the used virtual urban model has been created with funding of the Ministry of Education North Rhine-Westphalia (Az 412-5.01.02.03-154677). The study is part of a CO2 reduced research approach to support ecological sustainability. Based on a solar power plant installed in the Cartography Lab of the Ruhr University Bochum, all experiments and calculations were conducted using solar power. The authors have no competing interests to declare that are relevant to the content of this article.
Open Access funding enabled and organized by Projekt DEAL.
Below is the link to the electronic supplementary material.
About this article
Cite this article
Keil, J., Weißmann, M., Korte, A. et al. Measuring Physiological Responses to Visualizations of Urban Planning Scenarios in Immersive Virtual Reality. KN J. Cartogr. Geogr. Inf. 73, 117–126 (2023). https://doi.org/10.1007/s42489-023-00137-7
- Urban planning
- Physiological responses
- Virtual reality
- Implicit measures
- Electrodermal activity