Skip to main content

Designing an Interactive and Collaborative Experience in Audio Augmented Reality

Part of the Lecture Notes in Computer Science book series (LNIP,volume 11883)


Audio Augmented Reality (AAR) consists of adding spatial audio entities into the real environment. Existing mobile applications and technologies open questions around interactive and collaborative AAR. This paper proposes an experiment to examine how spatial audio can prompt and support actions in interactive AAR experiences; how distinct auditory information influence collaborative tasks and group dynamics; and how gamified AAR can enhance participatory storytelling. We are developing an interactive multiplayer experience in AAR using the Bose “Frames” audio sunglasses. Four participants at a time will go through a gamified story that attempts to interfere with group dynamics. In this paper we present our AAR platform and collaborative game in terms of experience design, and detail the testing methodology and analysis that we will conduct to answer our research questions.


  • Audio Augmented Reality
  • Collaboration
  • 3D audio
  • Audio game
  • Storytelling
  • Experience design

Supported by the EPSRC and AHRC Centre for Doctoral Training in Media and Arts Technology at Queen Mary University London and BBC R&D.

The first two authors have equally contributed to the paper.

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-31908-3_20
  • Chapter length: 7 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
USD   59.99
Price excludes VAT (USA)
  • ISBN: 978-3-030-31908-3
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   79.99
Price excludes VAT (USA)
Fig. 1.


  1. Audiojack Homepage. Accessed 3 Jul 2019

  2. Barde, A., Helton, W.S., Lee, G., Billinghurst, M.: Binaural spatialization over a bone conduction headset: minimum discernable angular difference. In: Proceedings of the 140th Convention of the Audio Engineering Society (2016)

    Google Scholar 

  3. Begault, D.-R.: 3-D Sound for Virtual Reality and Multimedia. Academic Press Professional, San Diego (1994)

    Google Scholar 

  4. Boal, A.: Games for Actors and Non-actors, 2nd edn. Taylor and Francis e-Library, Abingdon (2005)

    Google Scholar 

  5. BOSE Frames Homepage. Accessed 3 Jul 2019

  6. Brungart, D.S., Kordik, A.J., Simpson, B.D.: Effects of headtracker latency in virtual audio displays. J. Audio Eng. Soc. 54(1), 13 (2006)

    Google Scholar 

  7. Chatzidimitris, T., Gavalas, D., Michael, D.: SoundPacman: audio augmented reality in location-based games. In: 18th Mediterranean Electrotechnical Conference (MELECON), Lemesos, Cyprus, pp. 1–6 (2016)

    Google Scholar 

  8. Cooke, H.: Audio AR: Sound Walk Research The Missing Voice (2019). Accessed 3 Jul 2019

  9. Darkfield Homepage. Accessed 3 Jul 2019

  10. Dead Drop Desperados App Store Preview. Accessed 3 Jul 2019

  11. Ekman, I.: Sound-based gaming for sighted audiences- experiences from a mobile multiplayer location aware game. In: Proceedings on 2nd Audio Mostly, Germany (2007)

    Google Scholar 

  12. Gorzel, M., Allen, A., Kelly, I., Kammerl, J., Gungormusler, A., Yeh, H.: Efficient encoding and decoding of binaural sound with resonance audio. In: Audio Engineering Society Convention 12 (2019)

    Google Scholar 

  13. Härmä, A., et al.: Augmented reality audio for mobile and wearable appliances. J. Audio Eng. Soc. 52(6), 618–639 (2004)

    Google Scholar 

  14. Hololens Homepage. Accessed 28 Jul 2019

  15. Kochhar-Lindgren, K.: Towards a communal body of art: the exquisite corpse and Augusto Boal’s theatre. Angelaki: J. Theor. Hum. 7(1), 217–226 (2002).

    CrossRef  Google Scholar 

  16. Lyons, K., Gandy, M., Starner, T.: Guided by voices: an audio augmented reality system. In: Online Proceedings of the International Conference on Auditory Display, Georgia Institute of Technology Atlanta, Georgia, USA (2000)

    Google Scholar 

  17. Mariette, N., Katz, B.: SoundDelta - large scale, multiuser audio augmented reality. In: EAA Symposium on Auralization, Espoo, Finland (2009)

    Google Scholar 

  18. Tikander, M.: Usability issues in listening to natural sounds with an augmented reality headset. J. Audio Eng. Soc. 57(6), 430–441 (2009)

    Google Scholar 

  19. Traverse Homepage. Accessed 3 Jul 2019

Download references

Author information

Authors and Affiliations


Corresponding authors

Correspondence to Valentin Bauer or Anna Nagele .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Bauer, V. et al. (2019). Designing an Interactive and Collaborative Experience in Audio Augmented Reality. In: Bourdot, P., Interrante, V., Nedel, L., Magnenat-Thalmann, N., Zachmann, G. (eds) Virtual Reality and Augmented Reality. EuroVR 2019. Lecture Notes in Computer Science(), vol 11883. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-31907-6

  • Online ISBN: 978-3-030-31908-3

  • eBook Packages: Computer ScienceComputer Science (R0)