Worldmaking: Designing for Audience Participation, Immersion and Interaction in Virtual and Real Spaces

  • Andreas SiessEmail author
  • Daniel Hepperle
  • Matthias Wölfel
  • Michael Johansson
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 265)


Artists often try to open up new experiences for people, challenging them to extend horizons and perception. This becomes particularly relevant when thinking about experiencing built environments: Here, technologies like Cave Automatic Virtual Environments (CAVE) or Head-Mounted Displays (HMD) can be used as a tool to offer richer experiences to the audience in both art installations and exhibitions. We have been developing several exhibitions tackling the challenges that come with exhibiting in (semi -) public spaces: how do we engage visitors in our exhibitions, what role do bystanders play and how can this be considered in the development and design process? The exhibitions were built in a chronological order (2015–2018) and increasing degree of immersion and interaction. For exhibition one (“step-in/Ideal Spaces”), we built a CAVE-like “tryptic” projection showing linear pre-rendered videos of seven different built environments. In exhibition two (“fly-over/Super Nubibus”) we build a replica of a hot-air-balloon and let people experience architecture from birds eye view using a HMD. Exhibition three (“cruise/Biketopia”) is also an immersive VR using a HMD, but from a very different angle. Here we use a bike to let people actively explore a space by regulating speed and direction of the bike. By using the discreet method of observation, we ensured that the visitors were not disturbed in their experience, which in turn would falsify our findings. So we are able to compare and discuss these three approaches in regards to the above mentioned criteria within this paper.


Virtual reality Spatial perception Exhibition (Semi-) public space Architecture Museum 


  1. 1.
    Allen, M.: Technology in Contemporary Hollywood Cinema. Taylor & Francis, New York (2013)Google Scholar
  2. 2.
    Boyd, J.: Organic design for command and control (2005). Accessed 15 July 2018
  3. 3.
    Carrozzino, M., Bergamasco, M.: Beyond virtual museums: experiencing immersive virtual reality in real museums. J. Cult. Herit. 11, 452–458 (2010)CrossRefGoogle Scholar
  4. 4.
    Eagleman, D., Brandt, A.: The Runaway Species: How Human Creativity Remakes the World. Catapult, London (2017)Google Scholar
  5. 5.
    Gehmann, U.: Exhibition Venice 2016–ideal spaces (2016). Accessed 29 Sept 2018
  6. 6.
    Hartson, R.: Cognitive, physical, sensory, and functional affordances in interaction design. Behav. Inf. Technol. 22(5), 315–338 (2003)CrossRefGoogle Scholar
  7. 7.
    Ishii, A., et al.: ReverseCAVE. In: ACM SIGGRAPH 2017. ACM Press (2017)Google Scholar
  8. 8.
    Jellicoe, G.: Motopia: A Study in the Evolution of Urban Landscape (1961)Google Scholar
  9. 9.
    Kajo, M., Johansson, M.: Common playground. In: Proceedings of Cast01 (2001)Google Scholar
  10. 10.
    Kuutti, J., Leiwo, J., Sepponen, R.E.: Local control of audio environment: a review of methods and applications. Technologies 2(1), 31–53 (2014)CrossRefGoogle Scholar
  11. 11.
    Kwatra, V., Frueh, C., Sud, A.: Headset “removal” for virtual and mixed reality. Accessed 15 July 2018
  12. 12.
    Lister, M., Giddings, S., Dovey, J., Grant, I., Kelly, K.: New Media: A Critical Introduction. Routledge, Abingdon (2010)Google Scholar
  13. 13.
    Mai, C., Rambold, L., Khamis, M.: TransparentHMD: revealing the HMD user’s face to bystanders. In: Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia. MUM 2017, pp. 515–520. ACM (2017)Google Scholar
  14. 14.
    Maynes-Aminzade, D., Pausch, R., Seitz, S.: Techniques for interactive audience participation. In: Proceedings of the 4th IEEE International Conference on Multimodal Interfaces, p. 15. IEEE Computer Society (2002)Google Scholar
  15. 15.
    Michelis, D., Müller, J.: The audience funnel: observations of gesture based interaction with multiple large displays in a city center. Int. J. HCI 27(6), 562–579 (2011)Google Scholar
  16. 16.
    Mori, M.: Bukimi no tani [the uncanny valley]. Energy 7, 33–35 (1970)Google Scholar
  17. 17.
    Revresh: Para parachute! Accessed 15 July 2018
  18. 18.
    Shaw, J., Groeneveld, D.: Legible city. Accessed 15 Sept 2018
  19. 19.
    Sieß, A., Häffner, N., Wölfel, M.: Color preference differences between head mounted displays and PC screens. IEEE (2018)Google Scholar
  20. 20.
    Slater, M., Wilbur, S.: A framework for immersive virtual environments (FIVE): speculations on the role of presence in virtual environments. Presence-Teleop. Virt. Environ. 6(6), 603–616 (1997)CrossRefGoogle Scholar
  21. 21.
    Somniacs: Birdly - the ultimate dream of flying. Accessed 15 July 2018
  22. 22.
    Tyrrell, J., Bancroft, J., Gerald, M.: Sharing VR through green screen mixed reality video (2017). Accessed 12 June 2018
  23. 23.
    Zenner, A., Kosmalla, F., Speicher, M., Daiber, F., Krüger, A.: A projection-based interface to involve semi-immersed users in substitutional realities. IEEE (2018)Google Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2019

Authors and Affiliations

  • Andreas Siess
    • 1
    Email author
  • Daniel Hepperle
    • 1
  • Matthias Wölfel
    • 1
  • Michael Johansson
    • 2
  1. 1.Karlsruhe University of Applied SciencesKarlsruheGermany
  2. 2.Kristianstad UniversityKristianstadSweden

Personalised recommendations