Deep Surrender: Musically Controlled Responsive Video

  • Robyn Taylor
  • Pierre Boulanger
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4073)


In this paper we describe our responsive video performance, Deep Surrender, created using Cycling ’74’s Max/MSP and Jitter packages. Video parameters are manipulated in real-time, using chroma-keying and colour balance modification techniques to visualize the keyboard playing and vocal timbre of a live performer. We present the musical feature extraction process used to create a control system for the production, describe the mapping between audio and visual parameters, and discuss the artistic motivations behind the piece.


Video Stream Musical Piece Video Playback Colour Balance Visual Parameter 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cycling 1974. Max/MSP and JitterGoogle Scholar
  2. 2.
    Krumhansl, C.L.: The Geometry of Musical Structure: A Brief Introduction and History. Computers in Entertainment 3(4), 1–14 (2005)CrossRefGoogle Scholar
  3. 3.
    Oliver, W., Yu, J., Metois, E.: The Singing Tree: Design of an Interactive Musical Interface. In: DIS 1997: Proceedings of the Conference on Designing Interactive Systems: Processes, Practices, Methods and Techniques, pp. 261–264. ACM Press, New York (1997)CrossRefGoogle Scholar
  4. 4.
    Ox, J.: Two Performances in the 21st Century Virtual Color Organ. In: Proceedings of the Fourth Conference on Creativity and Cognition, pp. 20–24. ACM Press, New York (2002)CrossRefGoogle Scholar
  5. 5.
    Puckette, M., Apel, T., Zicarelli, D.: Real-Time Audio Analysis Tools for Pd and MSP. In: Proceedings of the International Computer Music Conference, pp. 109–112. International Computer Music Association (1998)Google Scholar
  6. 6.
    Sundberg, J.: The Science of the Singing Voice. Northern Illinois University Press (1987)Google Scholar
  7. 7.
    Taylor, R., Boulanger, P., Torres, D.: Visualizing Emotion in Musical Performance Using a Virtual Character. In: Butz, A., Fisher, B., Krüger, A., Olivier, P. (eds.) SG 2005. LNCS, vol. 3638, pp. 13–24. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  8. 8.
    Taylor, R., Torres, D., Boulanger, P.: Using Music to Interact with a Virtual Character. In: Proceedings of New Interfaces for Musical Expression, pp. 220–223 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Robyn Taylor
    • 1
  • Pierre Boulanger
    • 1
  1. 1.Advanced Man-Machine Interface Laboratory,Department of Computing ScienceUniversity of AlbertaEdmonton, AlbertaCanada

Personalised recommendations