Collaborative Computer-Aided Parameter Exploration for Music and Animation

  • Daryl H. Hepting
  • David Gerhard
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3310)


Although many artists have worked to create associations between music and animation, this has traditionally be done by developing one to suit the pre-existing other, as in visualization or sonification. The approach we employ in this work is to enable the simultaneous development of both music and sound from a common and rather generic central parameter variation, which may simply indicate a structure for periodic repetitions. This central parameter variation is then simultaneously mapped to appropriate musical and graphical variables by the musician and the animator, thereby contributing their own interpretations. The result of this mapping is then rendered in an intermediate form where music and animation are allowed to iteratively influence each other. The main piece of software in this development is the system which allows exploration of parameter mappings. The software interface allows both musician and animator to meaningfully experiment with the other’s mappings since the interface permits access in a common form, without requiring additional skills to interpret.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Apple Computer. iTunes, On line, Retrieved January 29 (2004)
  2. 2.
    Apple Computer. Soundtrack. On line:, Retrieved January 29 (2004)
  3. 3.
    Baecker, R.M., Grudin, J., Buxton, W.A.S., Greenberg, S.: Readings in Human-Computer Interaction: Toward the Year 2000. Morgan Kaufmann, San Francisco (1995)Google Scholar
  4. 4.
    Boden, M.A.: Creativity. In: Boden, M.A. (ed.) Artificial Intelligence: Handbook of Perception and Cognition, ch. 9, 2nd edn., pp. 267–291. Academic Press, London (1996)Google Scholar
  5. 5.
    Bertin, J.: Graphics and Graphic Information-Processing. de Gruyter, Translated by W. J. Berg and P. Scott (1981)Google Scholar
  6. 6.
    Eno, B., Schmidt, P.: Oblique Strategies: One Hundred Worthwhile Dilemmas, On line:, Retrieved January 29 (2004),
  7. 7.
    Foley, J., Ribarsky, W.: Next-generation data visualization tools. In: Rosenblum, L., et al. (eds.) Scientific Visualization. Academic Press, London (1994)Google Scholar
  8. 8.
    Good, M.: MusicXML for notation and analysis. In: Hewlett, W.B., Selfridge-Field, E. (eds.) The Virtual Score, pp. 113–124. MIT Press, Cambridge (2001)Google Scholar
  9. 9.
    Hahn, J., Geigel, J., Lee, J.W., Gritz, L., Takala, T., Mishra, S.: An integrated approach to motion and sound. Journal of visualization and computer animation 6(2), 109–123 (1995)CrossRefGoogle Scholar
  10. 10.
    Hepting, D.H.: Interactive evolution for systematic exploration of a parameter space. In: Dagli, C.H., et al. (eds.) Intelligent Engineering Systems through Artificial Neural Networks, vol. 13, pp. 125–131. ASME Press (2003)Google Scholar
  11. 11.
    Hepting, D.H., et al.: Cogito: a system for computer-aided visualization. Technical Report CMPT TR 96-02, Simon Fraser University. Unpublished technical sketch presented at SIGGRAPH 1996 (1996)Google Scholar
  12. 12.
    Hepting, D.H., Prusinkiewicz, P., Saupe, D.: Rendering methods for iterated function systems. In: Peitgen, H.-O., Henriques, J.M., Penedo, L.F. (eds.) Fractals in the Fundamental and Applied Sciences, New York, pp. 183–224 (1991), North-Holland. Reprinted in Fractals: from Folk Art to Hyperreality, SIGGRAPH 92 Course #12 Notes., Edited by P. Prusinkiewicz. ACM SIGGRAPHGoogle Scholar
  13. 13.
    Ioannidis, Y.E., Livny, M., Gupta, S., Ponnekanti, N.: Zoo: A desktop experiment management environment. In: Proceedings of the 22nd International VLDB Conference, pp. 274–285 (1996)Google Scholar
  14. 14.
    Wayand, J., Neuhoff, J.G., Kramer, G.: Sonification and the interaction of perceptual dimensions. In: ICAD (2000)Google Scholar
  15. 15.
    Kochhar, S., Marks, J., Friedell, M.: Interaction paradigms for human-computer cooperation in graphical-object modelling. In: MacKay, S., Kidd, E.M. (eds.) Proceedings of Graphics Interface 1991, pp. 180–189 (1991)Google Scholar
  16. 16.
    Lytle, W.: Animusic: a computer animation video album, DVD (2001)Google Scholar
  17. 17.
    Lytle, W.: Computer Animated Music. On line:, Retrieved January 29 (2004)
  18. 18.
    Mandelbrot, B.B.: The Fractal Geometry of Nature. W. H. Freeman, New York (1982)MATHGoogle Scholar
  19. 19.
    Marks, J., et al.: Design Galleries: A general approach to setting parameters for computer graphics and animation. In: SIGGRAPH 1997 Conference Proceedings, pp. 389–400 (1997)Google Scholar
  20. 20.
    Moritz, W.: Mary ellen bute: Seeing sound. Animation World Magazine (May 1996)Google Scholar
  21. 21.
    Norman, D.A.: The Psychology of Everyday Things. Basic Books, New York (1988)Google Scholar
  22. 22.
    Nullsoft. Winamp. On line:, Retrieved January 29 (2004)
  23. 23.
    Perkins, D.N.: Insight in minds and genes. In: Sternberg, R.J., Davidson, J.E. (eds.) The Nature of Insight, pp. 495–533. MIT Press, Cambridge (1995)Google Scholar
  24. 24.
    Schillinger, J.: The Schillinger System of Musical Composition. Carl Fischer (1946)Google Scholar
  25. 25.
    Simon, H.: Models of Discovery. Reidel (1977)Google Scholar
  26. 26.
    Spinello, B.: Notes on “Soundtrack”. Source - Music of the Avant Garde (1970)Google Scholar
  27. 27.
    Stockhausen, K.: Towards a Cosmic Music. Element Books (1989)Google Scholar
  28. 28.
    Storms, R.: Auditory-visual cross-modal perception. In: ICAD (2000)Google Scholar
  29. 29.
    Takala, T., Hahn, J.: Sound rendering. In: Computer Graphics: SIGGRAPH 1992 Conference Proceedings, pp. 211–220 (1992)Google Scholar
  30. 30.
    Whitney, J.: Digital Harmony: On the Complementarity of Music and Visual Art. Magraw-Hill (1980)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Daryl H. Hepting
    • 1
  • David Gerhard
    • 1
  1. 1.Department of Computer ScienceUniversity of ReginaRegina, SaskatchewanCanada

Personalised recommendations