An Evolutionary Composer for Real-Time Background Music

  • R. De PriscoEmail author
  • D. Malandrino
  • G. Zaccagnino
  • R. Zaccagnino
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9596)


Systems for real-time composition of background music respond to changes of the environment by generating music that matches the current state of the environment and/or of the user.

In this paper we propose one such a system that we call EvoBackMusic. EvoBackMusic is a multi-agent system that exploits a feed-forward neural network and a multi-objective genetic algorithm to produce background music. The neural network is trained to learn the preferences of the user and such preferences are exploited by the genetic algorithm to compose the music. The composition process takes into account a set of controllers that describe several aspects of the environment, like the dynamism of both the user and the context, other physical characteristics, and the emotional state of the user. Previous system mainly focus on the emotional aspect.

EvoBackMusic has been implemented in Java using Encog and JFugue, and it can be integrated in real and virtual environments.

We have performed several tests to evaluate the system and we report the results of such tests. The tests aimed at analyzing the users’ perception about the quality of the produced music compositions.


Background Music Musical State Composer Agent Midi File Predominant Color 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Downie, M.: Behavior animation, music: the music and movement of synthetic characters. MIT (2011)Google Scholar
  2. 2.
    Nakamura, J., Kaku, T., Noma, T., Yoshida, S.: Automating background music generation based on actors’ emotion and motions. In: Proceedings of the Pacific Graphics 1993, Computer Graphics and Applications, pp. 147–161 (1993)Google Scholar
  3. 3.
    Robertson, J., de Quincey, A., Stapleford, T., Wiggins, G.: Real-time music generation for a virtual environment. In: Proceedings of ECAI 1998 Workshop on AI/ALIFE and Entartainment (1998)Google Scholar
  4. 4.
    Chung, J., Vercoe, G.: The affective remixer: personalized music arranging. In: Proceedings of Conference on Human Factors in Computing Systems, pp. 393–398 (2006)Google Scholar
  5. 5.
    Livingstone, S.R., Muhlberger, R., Brown, A.R., Loch, A.: Controlling musical emotionality: an affective computational architecture for influencing musical emotions. Digit. Creativity 18(1), 43–53 (2007)CrossRefGoogle Scholar
  6. 6.
    Winter, R.: Interactive music: compositional techniques for communicating different emotional qualities. Master thesis, University of New York, NY (2005)Google Scholar
  7. 7.
    López, A.R., Oliveira, A.P., Cardoso, A.: Real-time emotion-driven music engine. In: Proceedings of International Conference on Computational Creativity (2010)Google Scholar
  8. 8.
    Kim, S., André, E.: Composing affective music with a generate and sense approach. In: Barr, V., Markov, Z. (eds.) FLAIRS Conference, pp. 38–43. AAAI Press (2004)Google Scholar
  9. 9.
    Casella, P., Paiva, A.C.R.: MAgentA: an architecture for real time automatic composition of background music. In: de Antonio, A., Aylett, R.S., Ballin, D. (eds.) IVA 2001. LNCS (LNAI), vol. 2190, p. 224. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  10. 10.
    Wassermann, K.C., Eng, K., Verschure, P.F.M.J.: Live soundscape composition based on synthetic emotions. IEEE MultiMed. 10(4), 82–90 (2003)CrossRefGoogle Scholar
  11. 11.
    Gabrielsson, A., Lindstrom, E.: The Influence of Musical Structure on Emotional Expression. In: Juslin, P., Sloboda, J.A. (eds.) Music and Emotion: Theory and Research. Oxford University Press, Oxford (2001)Google Scholar
  12. 12.
    Schubert, E.: Measurement and time series analysis of emotion in music. Ph.D. thesis, University of New South Wales, New South Wales (1999)Google Scholar
  13. 13.
    Scherer, K., Zentner, M.R.: Emotional effects of music: production rules. In: Juslin, P., Sloboda, J.A. (eds.) Music and Emotion: Theory and Research. Oxford University Press, Oxford (2001)Google Scholar
  14. 14.
    Meyer, L.: Emotion and Meaning in Music. University of Chicago Press, Chicago (1956)Google Scholar
  15. 15.
    Bilotta, E., Pantano, P.: Artificial life music tells of complexity. In: ALMMA 2001: Proceedings of the Workshop on Artificial Life Models for Musical Applications, pp. 17–28 (2001)Google Scholar
  16. 16.
    Bilotta, E., Pantano, P.: Synthetic harmonies: an approach to musical semiosis by means of cellular automata. Leonardo 35(2), 153–159 (2002)CrossRefGoogle Scholar
  17. 17.
    De Prisco, R., Zaccagnino, G., Zaccagnino, R.: Evobasscomposer: a multi-objective genetic algorithm for 4-voice compositions. In: Genetic and Evolutionary Computation Conference, GECCO 2010, Proceedings, Portland, Oregon, USA, 7–11 July 2010, pp. 817–818 (2010)Google Scholar
  18. 18.
    De Prisco, R., Zaccagnino, R.: An evolutionary music composer algorithm for bass harmonization. In: Giacobini, M., et al. (eds.) EvoWorkshops 2009. LNCS, vol. 5484, pp. 567–572. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  19. 19.
    Russell, J.: A circumplex model of affect. J. Pers. Soc. Psychol. 39(6), 1161–1178 (1980)CrossRefGoogle Scholar
  20. 20.
    Mori, N., Imanishi, S., Kita, H., Nishikawa, Y.: Adaptation to changing environments by means of the memory based thermodynamical genetic algorithm. In: ICGA 1997, East Lansing, MI, pp. 299–306 (1997)Google Scholar
  21. 21.
    Boenn, G., Brain, M., De Vos, M., ffitch, J.: Automatic composition of melodic and harmonic music by answer set programming. In: Garcia de la Banda, M., Pontelli, E. (eds.) ICLP 2008. LNCS, vol. 5366, pp. 160–174. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  22. 22.
    Legaspi, R., Hashimoto, Y., Moriyama, K., Kurihara, S., Numao, M.: Music compositional intelligence with an affective flavor. In: IUI, pp. 216–224 (2007)Google Scholar
  23. 23.
    Unehara, M., Onisawa, T.: Music composition system based on subjective evaluation. In: SMC, pp. 980–986. IEEE (2003)Google Scholar
  24. 24.
    Malandrino, D., Scarano, V., Spinelli, R.: How increased awareness can impact attitudes and behaviors toward online privacy protection. In: SocialCom, pp. 57–62. IEEE (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • R. De Prisco
    • 1
    Email author
  • D. Malandrino
    • 1
  • G. Zaccagnino
    • 1
  • R. Zaccagnino
    • 1
  1. 1.Dipartimento di InformaticaUniversità di SalernoFiscianoItaly

Personalised recommendations