Sonically Augmented Artifacts: Design Methodology Through Participatory Workshops

  • Olivier Houix
  • Nicolas Misdariis
  • Patrick Susini
  • Frédéric Bevilacqua
  • Florestan Gutierrez
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8905)


Participatory workshops have been organized within the framework of the ANR project Legos that concerns gesture-sound interactive systems. These workshops addressed both theoretical issues and experimentation with prototypes. The first goal was to stimulate new ideas related to the control of everyday objects using sound feedback, and then, to create and experiment with new sonic augmented objects. The second aim was educational. We investigated how sonic interaction design can be introduced to people without backgrounds in sound and music. We present in this article an overview of three workshops. The first workshop focused on the analysis and the possible sonification of everyday objects. New usage scenarios were obtained and tested. The second workshop focused on sound metaphor, questioning the relationship between sound and gesture. The last one was a workshop organized during a summer school for students. During these workshops, we experimented a cycle of design process: analysis, creation and testing.


Workshop Design Sound synthesis Interaction Rehabilitation 



This work was supported by ANR French National Research Agency, under the ANR-Blanc program 2011 (Legos project ANR-11-BS02-012) and additional support from Cap Digital. Part of this research was performed within Florian Gutierrez’s internship at Ircam as a student of School of Fine Arts TALM Le Mans. We thank the participants of the different workshops.


  1. 1.
    Boyer, E.O., Babayan, B.M., Bevilacqua, F., Noisternig, M., Warusfel, O., Roby-Brami, A., Hanneton, S., Viaud-Delmon, I.: From ear to hand: the role of the auditory-motor loop in pointing to an auditory source. Front. Comput. Neurosci. 7(26) (2013). doi: 10.3389/fncom.2013.00026, ISSN 1662-5188
  2. 2.
    Davidoff, S., Lee, M.K., Dey, A.K., Zimmerman, J.: Rapidly exploring application design through speed dating. In: Krumm, J., Abowd, G.D., Seneviratne, A., Strang, T. (eds.) UbiComp 2007. LNCS, vol. 4717, pp. 429–446. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  3. 3.
    Essl, G., O’Modhrain, S.: Scrubber: an interface for friction-induced sounds. In: Proceedings of the 2005 Conference on New Interfaces for Musical Expression, pp. 70–75. National University of Singapore (2005)Google Scholar
  4. 4.
    Françoise, J., Schnell, N., Bevilacqua, F.: A multimodal probabilistic model for gesture-based control of sound synthesis. In: Proceedings of the 21st ACM International Conference on Multimedia (MM’13), Barcelona, Spain, pp. 705–708 (2013)Google Scholar
  5. 5.
    Françoise, J., Schnell, N., Borghesi, R., Bevilacqua, F.: Probabilistic models for designing motion and sound relationships. In: Proceedings of the 2014 International Conference on New Interfaces for Musical Expression, NIME’14, London, UK (2014)Google Scholar
  6. 6.
    Franinovic, K., Hug, D., Visell, Y.: Sound embodied: explorations of sonic interaction design for everyday objects in a workshop setting. In: Scavone, G.P. (ed.) Proceedings of the 13th International Conference on Auditory Display (ICAD2007), pp. 334–341. Schulich School of Music, McGill University, Montreal, Canada (2007)Google Scholar
  7. 7.
    Franinovic, K., Gaye, L., Behrendt, F.: Exploring sonic interaction with artifacts in everyday contexts. In: Proceedings of the 14th International Conference on Auditory Display, Paris, France (2008)Google Scholar
  8. 8.
    Franinovic, K., Serafin, S.: Sonic Interaction Design. MIT Press, Cambridge (2013)Google Scholar
  9. 9.
    Grosshauser, T., Hermann, T.: Multimodal closed-loop human machine interaction. In: Proceedings of the 3rd International Workshop on Interactive Sonification (2010)Google Scholar
  10. 10.
    Gutierrez, F.: Développement de scénarios d’usage d’objet du quotidien à travers le design sonore interactif. Ecole des Beaux Arts TALM site le Mans (2012)Google Scholar
  11. 11.
    Houix, O., Lemaitre, G., Misdariis, N., Susini, P., Urdapilleta, I.: A lexical analysis of environmental sound categories. J. Exp. Psychol. Appl. 18(1), 52–80 (2012)CrossRefGoogle Scholar
  12. 12.
    Hug, D.: Investigating narrative and performative sound design strategies for interactive commodities. In: Ystad, S., Aramaki, M., Kronland-Martinet, R., Jensen, K. (eds.) CMMR/ICAD 2009. LNCS, vol. 5954, pp. 12–40. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  13. 13.
    Langeveld, L., van Egmond, R., Jansen, R., Özcan, E.: Product sound design: intentional and consequential sounds. In: Coelho, D.A. (ed.) Advances in Industrial Design Engineering, p. 47. InTech, Rijeka (2013)Google Scholar
  14. 14.
    Lemaitre, G., Houix, O., Visell, Y., Franinovic, K., Misdariis, N., Susini, P.: Toward the design and evaluation of continuous sound in tangible interfaces: the spinotron. Int. J. Hum. Comput. Stud. 27, 976–993 (2009)CrossRefGoogle Scholar
  15. 15.
    Lidwell, W., Holden, K., Butler, J.: Universal Principles of Design: 125 Ways to Enhance Usability, Influence Perception, Increase Appeal, Make Better Design Decisions, and Tech Through Design [25 Additional Design Principles]. Rockport Publishers, Beverly (2010)Google Scholar
  16. 16.
    Meyer, A.: Le design. TDC (874) (2004)Google Scholar
  17. 17.
    Misdariis, N., Tardieu, J., Langlois, S., Loiseau, S.: Menu sonification in an automotive media center: design and evaluation. In: Kolski, C. (ed.) Human-Computer Interactions in Transport, pp. 233–281. ISTE Ltd - John Wiley & Sons Inc, Grande-Bretagne (2011)Google Scholar
  18. 18.
    Muller, W., Pasman, G.: Typology and the organization of design knowledge. Des. Stud. 17(2), 111–130 (1996)CrossRefGoogle Scholar
  19. 19.
    Napier, J.R.: The prehensile movements of the human hand. J. Bone Joint Surg. 38(4), 902–913 (1956)Google Scholar
  20. 20.
    O’Modhrain, S., Essl, G.: PebbleBox and CrumbleBag: tactile interfaces for granular synthesis. In: Proceedings of the 2004 Conference on New Interfaces for Musical Expression, pp. 74–79. National University of Singapore (2004)Google Scholar
  21. 21.
    O’Modhrain, S., Essl, G.: 6 perceptual integration of audio and touch: a case study of PebbleBox. In: Franinovic, K., Serafin, S. (eds.) Sonic Interaction Design, pp. 203–2011. MIT Press, Cambridge (2013)Google Scholar
  22. 22.
    Oulasvirta, A., Kurvinen, E., Kankainen, T.: Understanding contexts by being there: case studies in bodystorming. Pers. Ubiquit. Comput. 7(2), 125–134 (2003)CrossRefGoogle Scholar
  23. 23.
    Quarante, D.: Eléments de design industriel, 3rd edn. Polytechnica, Paris (2001)Google Scholar
  24. 24.
    Rasamimanana, N., Bevilacqua, F., Schnell, N., Guedy, F., Flety, E., Maestracci, C., Zamborlin, B., Frechin, J.L., Petrevski, U.: Modular musical objects towards embodied control of digital music. In: Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction, TEI ’11, pp. 9–12. ACM, New York (2011)Google Scholar
  25. 25.
    Rath, M.: Auditory velocity information in a balancing task. In: Scavone, G.P. (ed.) Proceedings of the 13th International Conference on Auditory Displays ICAD, Montreal, Canada, pp. 372–379 (2007)Google Scholar
  26. 26.
    Rath, M., Rocchesso, D.: Continuous sonic feedback from a rollling ball. IEEE Multimedia 12(2), 60–69 (2005)CrossRefGoogle Scholar
  27. 27.
    Rocchesso, D., Polotti, P.: Designing continuous multisensory interaction. In: CHI Workshop - Sonic Interaction Design, Firenze, Italy (2008)Google Scholar
  28. 28.
    Rocchesso, D., Polotti, P.: Designing continuous sonic interaction. Int. J. Des. 3(3), 13–25 (2009)Google Scholar
  29. 29.
    Rocchesso, D., Serafin, S., Rinott, M.: Pedagogical approaches and methods. In: Franinovic, K., Serafin, S. (eds.) Sonic Interaction Design, pp. 125–150. MIT Press, Massachusetts (2013)Google Scholar
  30. 30.
    Soini, K., Pirinen, A.: Workshops-collaborative arena for generative research. In: Proceedings of DPPI (2005)Google Scholar
  31. 31.
    Williamson, J., Murray-Smith, R., Hughes, S.: Shoogle: excitatory multimodal interaction on mobile devices. In: CHI ’07 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 121–124. ACM, New York (2007)Google Scholar
  32. 32.
    Zheng, J.Z., De La Rosa, S., Dollar, A.M.: An investigation of grasp type and frequency in daily household and machine shop tasks. In: 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 4169–4175. IEEE (2011)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Olivier Houix
    • 1
  • Nicolas Misdariis
    • 1
  • Patrick Susini
    • 1
  • Frédéric Bevilacqua
    • 1
  • Florestan Gutierrez
    • 1
  1. 1.STMS IRCAM-CNRS-UPMCParisFrance

Personalised recommendations