Adaptive Musical Expression from Automatic Realtime Orchestration and Performance

  • Axel Berndt
  • Holger Theisel
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5334)


When scoring an interactive scene or narration music has to follow its events and development organically. Approaches toward musical nonlinearity are needed. Therefore, the means of orchestration and expressive performance provide a big potential that has not been tapped even a little yet. In this paper we will show how to translate them into the interactive context. But to change musical expression it is not feasible to simply switch hard between different instrumentations and performative styles. We introduce and discuss a new style-independent method for organic and musically believable transitions of compositional and performative expression characteristics.


Interactive Media Music Music Adaption Orchestration Expressive Performance 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Wingstedt, J.: Narrative functions of film music in a relational perspective. In: ISME Proceedings—Sound Worlds to Discover, Spain, International Society for Music Education (2004)Google Scholar
  2. 2.
    Berndt, A., Hartmann, K.: The Functions of Music in Interactive Media. In: Spierling, U., Szilas, N. (eds.) ICIDS 2008. LNCS, vol. 5334, pp. 126–131. Springer, Heidelberg (2008)Google Scholar
  3. 3.
    Adorno, T., Eisler, H.: Composing for the Films. Oxford University Press, New York (1947)Google Scholar
  4. 4.
    Lissa, Z.: Ästhetik der Filmmusik. Henschel, Leipzig (1965)Google Scholar
  5. 5.
    Karlin, F., Wright, R.: On the Track; A Guide to Contemporary Film Scoring, 2nd edn. Taylor & Francis, New York (2004)Google Scholar
  6. 6.
    Kirnberger, J.P.: Der allezeit fertige Polonaisen und Menuetten Komponist (1757) trans.: The Ever Ready Composer of Polonaises and MinuetsGoogle Scholar
  7. 7.
    Mozart, W.A.: Musikalisches Würfelspiel: Anleitung so viel Walzer oder Schleifer mit zwei Würfeln zu componieren ohne musikalisch zu seyn noch von der Composition etwas zu verstehen. Köchel Catalog of Mozart’s Work KV1 Appendix 294d or KV6 516f (1787)Google Scholar
  8. 8.
    Joplin, S.: Melody Dicer. Carousel Publications, Sparrowbush (1974)Google Scholar
  9. 9.
    Ratai, J.: Der Jazzwürfel—Ein harmonisches Würfelspiel. Fraunhofer Institut Medienkommunikation (2005),
  10. 10.
    Berndt, A., Hartmann, K., Röber, N., Masuch, M.: Composition and Arrangement Techniques for Music in Interactive Immersive Environments. In: Audio Mostly 2006: A Conf. on Sound in Games, Piteå, Sweden, Interactive Institute, Sonic Studio Piteå, pp. 53–59 (October 2006)Google Scholar
  11. 11.
    Wingstedt, J.: REMUPP—a tool for investigating musical narrative functions. In: Audio Mostly 2006: A Conf. on Sound in Games, Piteå, Sweden, Interactive Institute, Sonic Studio Piteå, pp. 42–47 (October 2006)Google Scholar
  12. 12.
    Chapel, R.H.: Realtime Algorithmic Music Systems From Fractals and Chaotic Functions: Towards an Active Musical Instrument. PhD thesis, University Pompeu Fabra, Department of Technology, Barcelona, Spain (September 2003)Google Scholar
  13. 13.
    Casella, P., Paiva, A.: MAgentA: An Architecture for Real Time Automatic Composition of Background Music. In: de Antonio, A., Aylett, R.S., Ballin, D. (eds.) IVA 2001. LNCS (LNAI), vol. 2190, pp. 224–232. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  14. 14.
    Casella, P., Paiva, A.: Mediating Action and Music with Augmented Grammars. In: 4th International Workshop on Intelligent Agents, pp. 207–211 (2003)Google Scholar
  15. 15.
    Hörnel, D.: Lernen musikalischer Strukturen und Stile mit neuronalen Netzen. Shaker Verlag, Aachen (2000)Google Scholar
  16. 16.
    Ebcioglu, K.: An Expert System for Harmonizing Chorales in the Style of J. S. Bach. In: Balaban, M., Ebcioglu, K., Laske, O. (eds.) Understanding Music with AI: Perspectives on Music Cognition, pp. 294–334. AAAI / MIT Press, Cambridge (1992)Google Scholar
  17. 17.
    Schottstaedt, W.: Automatic Counterpoint. In: Mathews, M., Pierce, J. (eds.) Current Directions in Computer Music Research. MIT Press, Cambridge (1989) (System Developement Foundation Benchmark)Google Scholar
  18. 18.
    Löthe, M.: Ein wissensbasiertes Verfahren zur Komposition von frühklassischen Menuetten. PhD thesis, University of Stuttgart, Intelligent System Group, Stuttgart, Germany (2003)Google Scholar
  19. 19.
    Pachet, F., Roy, P.: Musical Harmonization with Constraints: A Survey. Constraints Journal (2001)Google Scholar
  20. 20.
    Pachet, F.: The Continuator: Musical Interaction with Style. Journal of New Music Research 32(3), 333–341 (2003)CrossRefGoogle Scholar
  21. 21.
    Biles, J.A.: GenJam: Evolutionary Composition Gets a Gig. In: Proceedings of the 2002 Conference for Information Technology Curriculum, Rochester New York, USA (September 2002)Google Scholar
  22. 22.
    Mathews, M.V., Moore, F.R.: GROOVE—A Program to Compose, Store, and Edit Functions of Time. Communications of the ACM 13(2), 715–721 (1970)CrossRefMATHGoogle Scholar
  23. 23.
    Gartland-Jones, A.: MusicBlox: A Real-Time Algorithm Composition System Incorporating a Distributed Interactive Genetic Algorithm. In: Raidl, G.R., Cagnoni, S., Cardalda, J.J.R., Corne, D.W., Gottlieb, J., Guillot, A., Hart, E., Johnson, C.G., Marchiori, E., Meyer, J.-A., Middendorf, M. (eds.) EvoIASP 2003, EvoWorkshops 2003, EvoSTIM 2003, EvoROB/EvoRobot 2003, EvoCOP 2003, EvoBIO 2003, and EvoMUSART 2003. LNCS, vol. 2611, pp. 490–501. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  24. 24.
    Wooller, R.W., Brown, A.R.: Investigating morphing algorithms for generative music. In: Third Iteration: Third International Conference on Generative Systems in the Electronic Arts, Melbourne, Australia (December 2005)Google Scholar
  25. 25.
    Brown, A.R., Wooller, R.W., Kate, T.: The Morphing Table: A collaborative interface for musical interaction. In: Riddel, A., Thorogood, A. (eds.) Proceedings of the Australasian Computer Music Conference, pp. 34–39. Australian National University Canberra, Canberra (2007)Google Scholar
  26. 26.
    Livingstone, S.R., Muhlberger, R., Brown, A.R.: Playing with Affect: Music Performance with Awareness of Score and Audience. In: Australasian Computer Music Conference, Queensland, Australia (2005)Google Scholar
  27. 27.
    Livingstone, S.R., Brown, A.R.: Dynamic Response: Real-Time Adaptation for Music Emotion. In: Australasian Conference on Interactive Entertainment, Sydney, Australia (November 2005)Google Scholar
  28. 28.
    Livingstone, S.R., Muhlberger, R., Brown, A.R., Loch, A.: Controlling Musical Emotionality: An Affective Computational Architecture for Influencing Musical Emotion. Digital Creativity 18(1), 43–53 (2007)CrossRefGoogle Scholar
  29. 29.
    Friberg, A.: pDM: An Expressive Sequencer with Real-Time Control of the KTH Music-Performance Rules. Computer Music Journal 30(1), 37–48 (2006)CrossRefGoogle Scholar
  30. 30.
    Friberg, A., Bresin, R., Sundberg, J.: Overview of the KTH Rule System for Musical Performance. Advances in Cognitive Psychology, Special Issue on Music Performance 2(2–3), 145–161 (2006)CrossRefGoogle Scholar
  31. 31.
    Berndt, A., Hartmann, K.: Strategies for Narrative and Adaptive Game Scoring. In: Audio Mostly 2007: 2nd Conf. on Interaction with Sound, Ilmenau, Germany (September 2007)Google Scholar
  32. 32.
    Sevsay, E.: Handbuch der Instrumentationspraxis, 1st edn. Bärenreiter, Kassel (2005)Google Scholar
  33. 33.
    Berlioz, H., Strauss, R.: Grande Traité d’instrumentation et d’orchestration moderne (Treatise on Instrumentation). Kalmus Edition, New York, USA (1844/1904) translated english publication (1948)Google Scholar
  34. 34.
    Adler, S.: The Study of Orchestration, 3rd edn. Norton & Company, New York (2002)Google Scholar
  35. 35.
    Widmer, G., Goebel, W.: Computational Models of Expressive Music Performance: The State of the Art. Journal of New Music Research 33(3), 203–216 (2004)CrossRefGoogle Scholar
  36. 36.
    GRAME: MidiShare Developer Documentation. Computer Music Research Lab, France. 1.91 edn. (January 2006)Google Scholar
  37. 37.
    Hughes, C.W.: Percy Grainger, Cosmopolitan Composer. The Musical Quarterly 23(2), 127–136 (1937)CrossRefGoogle Scholar
  38. 38.
    Grainger, P.: Grainger on Music. In: Gillies, M., Ross, B.C. (eds.). Oxford University Press, Oxford (1999)Google Scholar
  39. 39.
    Berndt, A.: Liturgie für Bläser, 2nd edn. Musikverlag Bruno Uetz, Halberstadt (2008) (transl.: Liturgy for Brass)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Axel Berndt
    • 1
  • Holger Theisel
    • 1
  1. 1.Department of Simulation and GraphicsOtto-von-Guericke University of MagdeburgMagdeburgGermany

Personalised recommendations