A Real-Time Genetic Algorithm in Human-Robot Musical Improvisation

  • Gil Weinberg
  • Mark Godfrey
  • Alex Rae
  • John Rhoads
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4969)


The paper describes an interactive musical system that utilizes a genetic algorithm in an effort to create inspiring collaborations between human musicians and an improvisatory robotic xylophone player. The robot is designed to respond to human input in an acoustic and visual manner, evolving a human-generated phrase population based on a similarity driven fitness function in real time. The robot listens to MIDI and audio input from human players and generates melodic responses that are informed by the analyzed input as well as by internalized knowledge of contextually relevant material. The paper describes the motivation for the project, the hardware and software design, two performances that were conducted with the system, and a number of directions for future work.


genetic algorithm human-robot interaction robotic musicianship real-time interactive music systems 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Baginsky, N.A.: The Three Sirens: A Self-Learning Robotic Rock Band (Accessed May 2007),
  2. 2.
    Biles, J.A.: GenJam: a genetic algorithm for generation of jazz solos. In: Proceedings of the International Computer Music Conference, Aarhus, Denmark (1994)Google Scholar
  3. 3.
    Brown, C.: Talking Drum: A Local Area Network Music Installation. Leonardo Music Journal 9, 23–28 (1999)CrossRefGoogle Scholar
  4. 4.
    Kapur, A.: A History of Robotic Musical Instruments. In: Proceedings of the International Computer Music Conference, Barcelona, Spain, pp. 21–28 (2005)Google Scholar
  5. 5.
    Lerdahl, F., Jackendoff, R.: A Generative Theory of Tonal Music. MIT Press, Cambridge (1983)Google Scholar
  6. 6.
    Lewis, G.: Too Many Notes: Computers, Complexity and Culture in Voyager. Leonardo Music Journal 10, 33–39 (2000)CrossRefGoogle Scholar
  7. 7.
    Moroni, A., Manzolli, J., Zuben, F., Gudwin, R.: An Interactive Evolutionary System for Algorithmic Music Composition. Leonardo Music Journal 10, 49–55 (2000)CrossRefGoogle Scholar
  8. 8.
    Pachet, F.: The Continuator: Musical Interaction With Style. Journal of New Music Research 32(3), 333–341 (2003)CrossRefGoogle Scholar
  9. 9.
    Rowe, R.: Interactive Music Systems. MIT Press, Cambridge (1992)Google Scholar
  10. 10.
    Rowe, R.: Machine Musicianship. MIT Press, Cambridge (2004)Google Scholar
  11. 11.
    Smith, L., McNab, R., Witten, I.: Sequence-based melodic comparison: A dynamic-programming approach. Melodic Comparison: Concepts, Procedures, and Applications. Computing in Musicology 11, 101–128 (1998)Google Scholar
  12. 12.
    Tokui, N., Iba, H.: Music Composition with Interactive Evolutionary Computation. In: Proceedings of the 3rd International Conference on Generative Art, Milan, Italy (2000)Google Scholar
  13. 13.
    Weinberg, G., Driscoll, D.: Toward Robotic Musicianship. Computer Music Journal 30(4), 28–45 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Gil Weinberg
    • 1
  • Mark Godfrey
    • 1
  • Alex Rae
    • 1
  • John Rhoads
    • 1
  1. 1.Georgia Institute of Technology, Music Technology GroupAtlantaUSA

Personalised recommendations