Skip to main content

Sonically Augmented Artifacts: Design Methodology Through Participatory Workshops

Part of the Lecture Notes in Computer Science book series (LNISA,volume 8905)


Participatory workshops have been organized within the framework of the ANR project Legos that concerns gesture-sound interactive systems. These workshops addressed both theoretical issues and experimentation with prototypes. The first goal was to stimulate new ideas related to the control of everyday objects using sound feedback, and then, to create and experiment with new sonic augmented objects. The second aim was educational. We investigated how sonic interaction design can be introduced to people without backgrounds in sound and music. We present in this article an overview of three workshops. The first workshop focused on the analysis and the possible sonification of everyday objects. New usage scenarios were obtained and tested. The second workshop focused on sound metaphor, questioning the relationship between sound and gesture. The last one was a workshop organized during a summer school for students. During these workshops, we experimented a cycle of design process: analysis, creation and testing.


  • Workshop
  • Design
  • Sound synthesis
  • Interaction
  • Rehabilitation

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-12976-1_2
  • Chapter length: 21 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
USD   84.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-12976-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   109.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.


  1. 1.

  2. 2.

    A demo S.5.4 Chap. 5 is available at

  3. 3.

  4. 4.

  5. 5.

  6. 6.

  7. 7.

    Participants: Sara Adhitya, Frédéric Bevilacqua, Eric Boyer, Florestan Gutierrez, Sylvain Hanneton, Olivier Houix, Jules Françoise, Nicolas Misdariis, Alexandre Panizzoli, Quentin Pyanet, Nicolas Rasamimanana, Agnès Roby-Brami, Patrick Susini, Isabelle Viaud-Delmon.

  8. 8.

  9. 9.

  10. 10.

  11. 11.

    Participants: Sara Adhitya, Frédéric Bevilacqua, Eric Boyer, Jules Françoise, Sylvain Hanneton, Olivier Houix, Fivos Maniatakos, Nicolas Misdariis, Robert Piechaud, Nicolas Rasamimanana, Agnès Roby-Brami, Norbet Schnell, Patrick Susini, Isabelle Viaud-Delmon.

  12. 12.

  13. 13.

  14. 14.

  15. 15.

  16. 16.

    Organized by the Department of Computing, Goldsmiths, University of London.

  17. 17.

    Participants: Lauren Hayes - PhD student in creative music practice, Emmanouil Giannisakis - Master student in digital media engineering, Jaime Arias Almeida - PhD student in informatics, Alberto Betella - PhD student in communication, information and audiovisual media, David Hofmann - Phd student in theoretical neuroscience.

  18. 18.

  19. 19.

    See the demonstration video:

  20. 20.


  1. Boyer, E.O., Babayan, B.M., Bevilacqua, F., Noisternig, M., Warusfel, O., Roby-Brami, A., Hanneton, S., Viaud-Delmon, I.: From ear to hand: the role of the auditory-motor loop in pointing to an auditory source. Front. Comput. Neurosci. 7(26) (2013). doi:10.3389/fncom.2013.00026, ISSN 1662-5188

  2. Davidoff, S., Lee, M.K., Dey, A.K., Zimmerman, J.: Rapidly exploring application design through speed dating. In: Krumm, J., Abowd, G.D., Seneviratne, A., Strang, T. (eds.) UbiComp 2007. LNCS, vol. 4717, pp. 429–446. Springer, Heidelberg (2007)

    CrossRef  Google Scholar 

  3. Essl, G., O’Modhrain, S.: Scrubber: an interface for friction-induced sounds. In: Proceedings of the 2005 Conference on New Interfaces for Musical Expression, pp. 70–75. National University of Singapore (2005)

    Google Scholar 

  4. Françoise, J., Schnell, N., Bevilacqua, F.: A multimodal probabilistic model for gesture-based control of sound synthesis. In: Proceedings of the 21st ACM International Conference on Multimedia (MM’13), Barcelona, Spain, pp. 705–708 (2013)

    Google Scholar 

  5. Françoise, J., Schnell, N., Borghesi, R., Bevilacqua, F.: Probabilistic models for designing motion and sound relationships. In: Proceedings of the 2014 International Conference on New Interfaces for Musical Expression, NIME’14, London, UK (2014)

    Google Scholar 

  6. Franinovic, K., Hug, D., Visell, Y.: Sound embodied: explorations of sonic interaction design for everyday objects in a workshop setting. In: Scavone, G.P. (ed.) Proceedings of the 13th International Conference on Auditory Display (ICAD2007), pp. 334–341. Schulich School of Music, McGill University, Montreal, Canada (2007)

    Google Scholar 

  7. Franinovic, K., Gaye, L., Behrendt, F.: Exploring sonic interaction with artifacts in everyday contexts. In: Proceedings of the 14th International Conference on Auditory Display, Paris, France (2008)

    Google Scholar 

  8. Franinovic, K., Serafin, S.: Sonic Interaction Design. MIT Press, Cambridge (2013)

    Google Scholar 

  9. Grosshauser, T., Hermann, T.: Multimodal closed-loop human machine interaction. In: Proceedings of the 3rd International Workshop on Interactive Sonification (2010)

    Google Scholar 

  10. Gutierrez, F.: Développement de scénarios d’usage d’objet du quotidien à travers le design sonore interactif. Ecole des Beaux Arts TALM site le Mans (2012)

    Google Scholar 

  11. Houix, O., Lemaitre, G., Misdariis, N., Susini, P., Urdapilleta, I.: A lexical analysis of environmental sound categories. J. Exp. Psychol. Appl. 18(1), 52–80 (2012)

    CrossRef  Google Scholar 

  12. Hug, D.: Investigating narrative and performative sound design strategies for interactive commodities. In: Ystad, S., Aramaki, M., Kronland-Martinet, R., Jensen, K. (eds.) CMMR/ICAD 2009. LNCS, vol. 5954, pp. 12–40. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  13. Langeveld, L., van Egmond, R., Jansen, R., Özcan, E.: Product sound design: intentional and consequential sounds. In: Coelho, D.A. (ed.) Advances in Industrial Design Engineering, p. 47. InTech, Rijeka (2013)

    Google Scholar 

  14. Lemaitre, G., Houix, O., Visell, Y., Franinovic, K., Misdariis, N., Susini, P.: Toward the design and evaluation of continuous sound in tangible interfaces: the spinotron. Int. J. Hum. Comput. Stud. 27, 976–993 (2009)

    CrossRef  Google Scholar 

  15. Lidwell, W., Holden, K., Butler, J.: Universal Principles of Design: 125 Ways to Enhance Usability, Influence Perception, Increase Appeal, Make Better Design Decisions, and Tech Through Design [25 Additional Design Principles]. Rockport Publishers, Beverly (2010)

    Google Scholar 

  16. Meyer, A.: Le design. TDC (874) (2004)

    Google Scholar 

  17. Misdariis, N., Tardieu, J., Langlois, S., Loiseau, S.: Menu sonification in an automotive media center: design and evaluation. In: Kolski, C. (ed.) Human-Computer Interactions in Transport, pp. 233–281. ISTE Ltd - John Wiley & Sons Inc, Grande-Bretagne (2011)

    Google Scholar 

  18. Muller, W., Pasman, G.: Typology and the organization of design knowledge. Des. Stud. 17(2), 111–130 (1996)

    CrossRef  Google Scholar 

  19. Napier, J.R.: The prehensile movements of the human hand. J. Bone Joint Surg. 38(4), 902–913 (1956)

    Google Scholar 

  20. O’Modhrain, S., Essl, G.: PebbleBox and CrumbleBag: tactile interfaces for granular synthesis. In: Proceedings of the 2004 Conference on New Interfaces for Musical Expression, pp. 74–79. National University of Singapore (2004)

    Google Scholar 

  21. O’Modhrain, S., Essl, G.: 6 perceptual integration of audio and touch: a case study of PebbleBox. In: Franinovic, K., Serafin, S. (eds.) Sonic Interaction Design, pp. 203–2011. MIT Press, Cambridge (2013)

    Google Scholar 

  22. Oulasvirta, A., Kurvinen, E., Kankainen, T.: Understanding contexts by being there: case studies in bodystorming. Pers. Ubiquit. Comput. 7(2), 125–134 (2003)

    CrossRef  Google Scholar 

  23. Quarante, D.: Eléments de design industriel, 3rd edn. Polytechnica, Paris (2001)

    Google Scholar 

  24. Rasamimanana, N., Bevilacqua, F., Schnell, N., Guedy, F., Flety, E., Maestracci, C., Zamborlin, B., Frechin, J.L., Petrevski, U.: Modular musical objects towards embodied control of digital music. In: Proceedings of the Fifth International Conference on Tangible, Embedded, and Embodied Interaction, TEI ’11, pp. 9–12. ACM, New York (2011)

    Google Scholar 

  25. Rath, M.: Auditory velocity information in a balancing task. In: Scavone, G.P. (ed.) Proceedings of the 13th International Conference on Auditory Displays ICAD, Montreal, Canada, pp. 372–379 (2007)

    Google Scholar 

  26. Rath, M., Rocchesso, D.: Continuous sonic feedback from a rollling ball. IEEE Multimedia 12(2), 60–69 (2005)

    CrossRef  Google Scholar 

  27. Rocchesso, D., Polotti, P.: Designing continuous multisensory interaction. In: CHI Workshop - Sonic Interaction Design, Firenze, Italy (2008)

    Google Scholar 

  28. Rocchesso, D., Polotti, P.: Designing continuous sonic interaction. Int. J. Des. 3(3), 13–25 (2009)

    Google Scholar 

  29. Rocchesso, D., Serafin, S., Rinott, M.: Pedagogical approaches and methods. In: Franinovic, K., Serafin, S. (eds.) Sonic Interaction Design, pp. 125–150. MIT Press, Massachusetts (2013)

    Google Scholar 

  30. Soini, K., Pirinen, A.: Workshops-collaborative arena for generative research. In: Proceedings of DPPI (2005)

    Google Scholar 

  31. Williamson, J., Murray-Smith, R., Hughes, S.: Shoogle: excitatory multimodal interaction on mobile devices. In: CHI ’07 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 121–124. ACM, New York (2007)

    Google Scholar 

  32. Zheng, J.Z., De La Rosa, S., Dollar, A.M.: An investigation of grasp type and frequency in daily household and machine shop tasks. In: 2011 IEEE International Conference on Robotics and Automation (ICRA), pp. 4169–4175. IEEE (2011)

    Google Scholar 

Download references


This work was supported by ANR French National Research Agency, under the ANR-Blanc program 2011 (Legos project ANR-11-BS02-012) and additional support from Cap Digital. Part of this research was performed within Florian Gutierrez’s internship at Ircam as a student of School of Fine Arts TALM Le Mans. We thank the participants of the different workshops.

Author information

Authors and Affiliations


Corresponding author

Correspondence to Olivier Houix .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Houix, O., Misdariis, N., Susini, P., Bevilacqua, F., Gutierrez, F. (2014). Sonically Augmented Artifacts: Design Methodology Through Participatory Workshops. In: Aramaki, M., Derrien, O., Kronland-Martinet, R., Ystad, S. (eds) Sound, Music, and Motion. CMMR 2013. Lecture Notes in Computer Science(), vol 8905. Springer, Cham.

Download citation

  • DOI:

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-12975-4

  • Online ISBN: 978-3-319-12976-1

  • eBook Packages: Computer ScienceComputer Science (R0)