Poème Numérique: Technology-Mediated Audience Participation (TMAP) Using Smartphones and High-Frequency Sound IDs

  • Fares KayaliEmail author
  • Christoph Bartmann
  • Oliver Hödl
  • Ruth Mateus-Berr
  • Martin Pichlmair
Conference paper
Part of the Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering book series (LNICST, volume 178)


In this paper we discuss a setup for technology-mediated audience participation using smartphones and high-frequency sound IDs. Drawing from the insights of a research project on audience participation in live music we describe a setup for playful music interaction composed of smartphones. In this setup the audience needs to install a smartphone app. Using high-frequency sound IDs music samples and colors can be triggered on the audience’s smartphones without the need to have an internet connection. The resulting soundscape is determined by the samples and parameters selected by the artist as well as by the location audience members choose in the performance space.


Technology-mediated audience participation TMAP Live music Smartphones High-frequency sound IDs 



“Breaking The Wall” is a project funded by the Funded by the Austrian Science Fund (FWF), AR 322-G21.

Project team: Geraldine Fitzpatrick, Simon Holland, Susanne Kirchmayr, Johannes Kretz, Ulrich Kühn, Peter Purgathofer, Hande Sağlam, Thomas Wagensommerer.


  1. 1.
  2. 2.
  3. 3.
    Bartmann, C: Exploring audience participation in live music with a mobile application. Master thesis, Vienna University of Technology (2016)Google Scholar
  4. 4.
    Mozart, W.A.: Anleitung so viel Walzer oder Schleifer mit zwei Würfeln zu componiren so viel man will ohne musikalisch zu seyn noch etwas von der Composition zu verstehen, J.J. Hummel, Berlin-Amsterdam (1793)Google Scholar
  5. 5.
    Zbikowski, L.M.: Conceptualizing Music. Cognitive Structures Theory, and Analysis. Oxford University Press, Oxford (2002)Google Scholar
  6. 6.
    Pichlmair, M., Kayali, F.: Levels of sound: on the principles of interactivity in music video games. In: Proceedings of the Digital Games Research Association 2007 Conference Situated play (2007)Google Scholar
  7. 7.
    Mazzanti, D., Zappi, V., Caldwell, D., Brogni, A.: Augmented stage for participatory performances. In: Proceedings of the International Conference on New Interfaces for Musical Expression, pp. 29–34 (2014)Google Scholar
  8. 8.
    Hirabayashi, M., Eshima, K.: Sense of space: the audience participation music performance with high-frequency sound ID. In: Proceedings of the NIME 2015 International Conference on New Interfaces for Musical Expression. LSU, Baton Rouge, LA (2015)Google Scholar
  9. 9.
  10. 10.
    Puckette, M.: Pure data: another integrated computer music environment. In: Proceedings of the Second Intercollege Computer Music Concerts, Tachikawa, Japan (1996)Google Scholar

Copyright information

© ICST Institute for Computer Sciences, Social Informatics and Telecommunications Engineering 2017

Authors and Affiliations

  • Fares Kayali
    • 1
    Email author
  • Christoph Bartmann
    • 1
  • Oliver Hödl
    • 1
  • Ruth Mateus-Berr
    • 2
  • Martin Pichlmair
    • 3
  1. 1.Vienna University of TechnologyViennaAustria
  2. 2.University of Applied Arts ViennaViennaAustria
  3. 3.IT University of CopenhagenCopenhagenDenmark

Personalised recommendations