Gesture Control of Sound Spatialization for Live Musical Performance

  • Mark T. Marshall
  • Joseph Malloch
  • Marcelo M. Wanderley
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5085)


This paper presents the development of methods for gesture control of sound spatialization. It provides a comparison of seven popular software spatialization systems from a control point of view, and examines human-factors issues relevant to gesture control. An effort is made to reconcile these two design- and parameter-spaces, and draw useful conclusions regarding likely successful mapping strategies. Lastly, examples are given using several different gesture-tracking and motion capture systems controlling various parameters of the spatialization system.


Cognitive Load Sound Source Motion Capture System Musical Performance Spatialization System 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Zvonar, R.: A history of spatial music (2006),
  2. 2.
    Chadabe, J.: Electric Sound: The Past and Promise of Electronic Music. Prentice-Hall, Englewood Cliffs (1997)Google Scholar
  3. 3.
    Ramakrishnan, C., Goßmann, J., Brm̈mer, L.: The zkm klangdom. In: Proceedings of the 2006 Conference on New Interfaces for Musical Expression (2006)Google Scholar
  4. 4.
    Valbom, L., Marcos, A.: Wave: Sound and music in an immersive environment. Computers and Graphics 29, 871–881 (2005)CrossRefGoogle Scholar
  5. 5.
    Naef, M., Collicott, D.: A vr interface for collaborative 3d audio performance. In: Proceedings of the 2006 International Conference on New Interfaces for Musical Expression (NIME 2006), pp. 57–60 (2006)Google Scholar
  6. 6.
    Wozniewski, M., Settel, Z., Cooperstock, J.: A system for immersive spatial audio performance. In: Proceedings of the 2006 Conference on New Interfaces for Musical Expression (2006)Google Scholar
  7. 7.
    Schacher, J.: Gesture control of sounds in 3d space. In: Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME 2007), New York, USA, pp. 358–362 (2007)Google Scholar
  8. 8.
    Pulkki, V.: Spatial Sound Generation and Perception by Amplitude Panning Techniques. PhD thesis, Helsinki University of Technology (2001)Google Scholar
  9. 9.
    IRCAM: Spatializateur website,
  10. 10.
    Braasch, J.: A loudspeaker based sound projection using virtual microphone control (vimic). In: 118th Convention of the AES, Barcelona, Spain (2005)Google Scholar
  11. 11.
    Spors, S., Teutsch, H., Rabenstein, R.: High-quality acoustic rendering with wave field synthesis. Vision, Modeling, and Visualization, 101–108 (2002)Google Scholar
  12. 12.
    Malham, D.: Spatial hearing mechanisms and sound reproduction. Technical report, Music Technology Group, University of York (1998)Google Scholar
  13. 13.
    Jacob, R.J.K., Sibert, L.E., McFarlane, D.C., Mullen, M.P.: Integrality and separability of input devices. ACM Transactions on Computer-Human Interaction 1(1), 3–26 (1994)CrossRefGoogle Scholar
  14. 14.
    Cooper, G.: Research into cognitive load theory and instructional design at unsw (December 1998),
  15. 15.
    Cook, P.: Principles for designing computer music controllers. In: ACM CHI 2001 Workshop on New Interfaces for Musical Expression (2001)Google Scholar
  16. 16.
    Marshall, M.T., Peters, N., Jensenius, A.R., Boissinot, J., Wanderley, M.M., Braasch, J.: On the development of a system for the gesture control of spatialization. In: Proceedings of the International Computer Music Conference, pp. 260–266 (2006)Google Scholar
  17. 17.
    Baecker, R., Grudin, J., Buxton, W., Greenberg, S.: Readings in Human-Computer Interaction: Toward the Year 2000., 2nd edn. Morgan Kaufmann, San Francisco (1995)Google Scholar
  18. 18.
    Cadoz, C., Wanderley, M.: Gesture - music. Trends in Gesture Control of Music (2000)Google Scholar
  19. 19.
    Marshall, M., Malloch, J., Wanderley, M.: Using the ’energy’ of performance gestures as a control for a spatialization system. Technical Report MUMT-IDMIL-07-08, Input Devices and Music Interaction Laboratory, McGill University (May 2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Mark T. Marshall
    • 1
  • Joseph Malloch
    • 1
  • Marcelo M. Wanderley
    • 1
  1. 1.Input Devices and Music Interaction Laboratory Centre for Interdisciplinary Research in Music Media and Technology Music Technology AreaMcGill UniversityMontrealCanada

Personalised recommendations