Investigating Narrative and Performative Sound Design Strategies for Interactive Commodities

  • Daniel Hug
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5954)


Computing technologies turn everyday artefacts into narrative, procedural objects. This observation suggests that the narrative sound design strategies used in films and many video games could also be applied for the design of interactive commodities. However, it is unknown whether these strategies from immersive media can be applied in physical artefacts of everyday use. In this paper we describe methodological considerations and outline a structure of a revisable, design oriented, participatory research process, which allows to explore narrative sound designs and their possible application in interactive commodities in a systematic yet explorative way. The process, which focused on interpretational aspects, has been applied in two workshops and their results are reported and discussed. The experience of the prototyping and evaluation method, which made use of theatrical strategies, raised important questions about the role of performativity in the emergence of meaning and the possible limitations of a strictly hermeneutic aesthetics, when dealing with sonically enhanced interactive commodities.


Sound Design Interactive Commodities Design Research Hermeneutics 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Franinovic, K., Hug, D., Visell, Y.: Sound embodied: Explorations of sonic interaction design for everyday objects in a workshop setting. In: Proceedings of the 13th international conference on Auditory Display (2007)Google Scholar
  2. 2.
    Barras, S.: Earbenders: Using stories about listening to design auditory interfaces. In: Proceedings of the First Asia-Pacific Conference on Human Computer Interaction APCHI 1996, Information Technology Institute, Singapore (1996)Google Scholar
  3. 3.
    Hug, D.: Towards a hermeneutics and typology of sound for interactive commodities. In: Proceedings of the CHI 2008 Workshop on Sonic Interaction Design, Firenze (2008)Google Scholar
  4. 4.
    Hug, D.: Genie in a bottle: Object-sound reconfigurations for interactive commodities. In: Proceedings of Audiomostly 2008, 3rd Conference on Interaction With Sound (2008)Google Scholar
  5. 5.
    Csikszentmihalyi, M., Rochberg-Halton, E.: The meaning of things - Domestic symbols and the self. Cambridge University Press, Cambridge (1981)Google Scholar
  6. 6.
    Vastokas, J.M.: Are artifacts texts? Lithuanian woven sashes as social and cosmic transactions. In: Riggins, S.H. (ed.) The Socialness of Things - Essays on the Socio-Semiotics of Objects, pp. 337–362. Mouton de Gruyter, Berlin (1994)Google Scholar
  7. 7.
    McCarthy, J., Wright, P., Wallace, J.: The experience of enchantment in human-computer interaction. Personal Ubiquitous Comput. 10, 369–378 (2006)CrossRefGoogle Scholar
  8. 8.
    Chion, M.: Audio-Vision: sound on screen. Columbia University Press, New York (1994)Google Scholar
  9. 9.
    van Leeuwen, T.: Speech, Music, Sound. Palgrave Macmillan, Houndmills and London (1999)Google Scholar
  10. 10.
    Flückiger, B.: Sounddesign: Die virtuelle Klangwelt des Films. Schüren Verlag, Marburg (2001)Google Scholar
  11. 11.
    Sonnenschein, D.: Sound Design - The Expressive Power of Music, Voice, and Sound Effects in Cinema. Michael Wiese Productions, Studio City (2001)Google Scholar
  12. 12.
    LoBrutto, V.: Sound-on-film: Interviews with creators of film sound, Praeger, Westport, CT (1994)Google Scholar
  13. 13.
    Viers, R.: The Sound Effects Bible. Michael Wiese Productions, Studio City (2008)Google Scholar
  14. 14.
    Schafer, R.M.: The Soundscape: Our Sonic Environment and the Tuning of the World, 2nd edn., 1994 edn. Destiny Books, New York (1977)Google Scholar
  15. 15.
    Chion, M.: Le Son, Editions Nathan, Paris (1998)Google Scholar
  16. 16.
    Truax, B.: Acoustic Communication, 2nd edn. Greenwood Press, Westport (2001)Google Scholar
  17. 17.
    Goffman, E.: The Goffman Reader. Blackwell, Malden (1997)Google Scholar
  18. 18.
    Melles, G.: An enlarged pragmatist inquiry paradigm for methodological pluralism in academic design research. Artifact 2(1), 3–11 (2008)CrossRefGoogle Scholar
  19. 19.
    Morse, J.M.: Principles of mixed methods and multimethod research design. In: Tashakkori, A., Teddle, C. (eds.) Handbook of Mixed Methods In Social and Behavioral Research, Sage, Thousand Oaks (2003)Google Scholar
  20. 20.
    Charmaz, K.: Constructing Grounded Theory: A Practical Guide Through Qualitative Analysis, Thousand Oaks (2006)Google Scholar
  21. 21.
    McCarthy, J., Wright, P.: Technology as Experience. MIT Press, Massachusetts (2004)Google Scholar
  22. 22.
    Gray, A.: Research Practice for Cultural Studies. Sage, London (2003)Google Scholar
  23. 23.
    Brix, A.: Solid knowledge: Notes on the nature of knowledge embedded in designed artefacts. Artifact 2(1), 36–40 (2008)CrossRefGoogle Scholar
  24. 24.
    Zimmerman, J., Forlizzi, J.: The role of design artifacts in design theory construction. Artifact 2(1), 41–45 (2008)CrossRefGoogle Scholar
  25. 25.
    Krippendorff, K.: The semantic turn - A new foundation for design. Taylor & Francis, Abington (2006)Google Scholar
  26. 26.
    Zimmerman, J., Forlizzi, J., Evenson, S.: Research through design as a method for interaction design research in hci. In: Proceedings of the Conference on Human Factors in Computing Systems, pp. 493–502. ACM Press, New York (2007)Google Scholar
  27. 27.
    Buchenau, M., Suri, J.F.: Experience prototyping. In: Proceedings of the Conference on Designing Interactive Systems, Brooklyn, New York, pp. 424–433 (2000)Google Scholar
  28. 28.
    Kelley, J.F.: An iterative design methodology for user-friendly natural language office information applications. ACM Transactions on Office Information Systems 2(1), 26–41 (1984)CrossRefMathSciNetGoogle Scholar
  29. 29.
    Droumeva, M., Wakkary, R.: The role of participatory workshops in investigating narrative and sound ecologies in the design of an ambient intelligence auditory display. In: Proceedings of the 12th International Conference on Auditory Display, London, UK (2006)Google Scholar
  30. 30.
    Laurel, B.: Design improvisation - ethnography meets theatre. In: Laurel, B. (ed.) Design Research - Methods and Perspectives. MIT Press, Cambridge (2003)Google Scholar
  31. 31.
    Carroll, J.M.: Making Use - Scenario-Based Design of Human-Computer Interactions. MIT Press, Cambridge (2000)Google Scholar
  32. 32.
    Hornecker, E., Eden, H., Scharff, E.: In my situation, i would dislike thaaat!” - role play as assessment method for tools supporting participatory planning. In: Proceedings of PDC 2002: 7th Biennial Participatory Design Conference, Malmö (2002)Google Scholar
  33. 33.
    Oulasvirta, A., Kurvinen, E., Kankainen, T.: Understanding contexts by being there: case studies in bodystorming. Personal Ubiquitous Comput. 7(2), 125–134 (2003)CrossRefGoogle Scholar
  34. 34.
    Schuler, D., Namioka, A. (eds.): Participatory Design: Principles and Practices. Lawrence Erlbaum Associates, Hillsdale (1993)Google Scholar
  35. 35.
    Franinovic, K., Gaye, L., Behrendt, F.: Exploring sonic interaction with artifacts in everyday contexts. In: Proceedings of the 14th International Conference on Auditory Display (2008)Google Scholar
  36. 36.
    Aarts, E., Marzano, S. (eds.): The New Everyday, Rotterdam, The Netherlands. 010 Publishers (2003)Google Scholar
  37. 37.
    Oleksik, G., Frohlich, D., Brown, L.M., Sellen, A.: Sonic interventions: Understanding and extending the domestic soundscape. In: Proceedings of the 26th Annual CHI Conference on Human Factors in Computing Systems, pp. 1419–1428 (2008)Google Scholar
  38. 38.
    Visell, Y., Franinovic, K., Hug, D.: Sound product design research: Case studies, participatory design, scenarios, and product concepts. nest-closed deliverable 3.1 (June 2007)Google Scholar
  39. 39.
    Böhme, G.: Acoustic atmospheres - a contribution to the study of ecological aesthetics. Soundscape - The Journal of Acoustic Ecology 1(1), 14–18 (2000)Google Scholar
  40. 40.
    Fischer-Lichte, E.: Ästhetische Erfahrung: Das Semiotische und das Performative. A. Francke Verlag, Tübingen und Basel (2001)Google Scholar
  41. 41.
    Austin, J.L.: How to do Things With Words, 2nd edn. Harvard University Press, Cambridge (1975)Google Scholar
  42. 42.
    Meyer, P.M.: Intermedialität des Theaters: Entwurf einer Semiotik der Überraschung, Parerga, Düsseldorf (2001)Google Scholar
  43. 43.
    Pauletto, S., Hug, D., Barras, S., Luckhurst, M.: Integrating theatrical strategies into sonic interaction design. In: Proceedings of Audio Mostly 2009 - 4th Conference on Interaction with Sound (2009)Google Scholar
  44. 44.
    Fischer-Lichte, E.: Ästhetik des Performativen, Suhrkamp (2004)Google Scholar
  45. 45.
    Nöth, W.: Handbuch der Semiotik. 2., vollständig neu bearb. und erw. aufl. edn. J. B. Metzler (2000)Google Scholar
  46. 46.
    Lefebvre, H.: Kritik des Alltagslebens: Grundrisse einer Soziologie der Alltäglichkei. Fischer, Frankfurt am Main (1987)Google Scholar
  47. 47.
    Gibson, J.J.: The ecological approach to visual perception. Houghton Mifflin, Boston (1979)Google Scholar
  48. 48.
    Hermann, T., Ritter, H.: Listen to your data: Model-based sonification for data analysis. In: Advances in intelligent computing and multimedia systems, Baden-Baden, pp. 189–194 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Daniel Hug
    • 1
  1. 1.Universities of the Arts Linz & ZurichLinz, ZurichAustria, Switzerland

Personalised recommendations