AudioInSpace: Exploring the Creative Fusion of Generative Audio, Visuals and Gameplay

  • Amy K. Hoover
  • William Cachia
  • Antonios Liapis
  • Georgios N. Yannakakis
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9027)


Computer games are unique creativity domains in that they elegantly fuse several facets of creative work including visuals, narrative, music, architecture and design. While the exploration of possibilities across facets of creativity offers a more realistic approach to the game design process, most existing autonomous (or semi-autonomous) game content generators focus on the mere generation of single domains (creativity facets) in games. Motivated by the sparse literature on multifaceted game content generation, this paper introduces a multifaceted procedural content generation (PCG) approach that is based on the interactive evolution of multiple artificial neural networks that orchestrate the generation of visuals, audio and gameplay. The approach is evaluated on a spaceship shooter game. The generated artifacts — a fusion of audiovisual and gameplay elements — showcase the capacity of multifaceted PCG and its evident potential for computational game creativity.


Hide Node Game Design Interactive Evolutionary Computation Natural Language Concept Pentatonic Scale 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.



Special thanks to Luke Aquilina for his contributions to development. This research is supported, in part, by the FP7 ICT project C2Learn (project no: 318480) and by the FP7 Marie Curie CIG project AutoGameDesign (project no: 630665).


  1. 1.
    Liapis, A., Yannakakis, G.N., Togelius, J.: Computational game creativity. In: Proceedings of the Fifth International Conference on Computational Creativity (2014)Google Scholar
  2. 2.
    Nintendo: Super Mario Bros. (1985)Google Scholar
  3. 3.
    Sega: Sonic the Hedgehog (1991)Google Scholar
  4. 4.
    Collins, K.: An introduction to procedural music in video games. Contemp. Music Rev. 28(1), 5–15 (2009)CrossRefGoogle Scholar
  5. 5.
    Yannakakis, G.N.: Game AI revisited. In: Proceedings of the 9th Conference on Computing Frontiers, pp. 285–292 (2012)Google Scholar
  6. 6.
    Scirea, M.: Mood dependent music generator. In: Reidsma, D., Katayose, H., Nijholt, A. (eds.) ACE 2013. LNCS, vol. 8253, pp. 626–629. Springer, Heidelberg (2013) CrossRefGoogle Scholar
  7. 7.
    Cook, M., Colton, S.: A rogue dream: automatically generating meaningful content for games. In: Proceedings of the AIIDE Workshop on Experimental AI and Games (2014)Google Scholar
  8. 8.
    Togelius, J., Shaker, N., Nelson, M.J.: Introduction. In: Shaker, N., Togelius, J., Nelson, M.J. (eds.) Procedural Content Generation in Games: A Textbook and an Overview of Current Research. Springer, Heidelberg (2014)Google Scholar
  9. 9.
    Stanley, K.O.: Compositional pattern producing networks: a novel abstraction of development. Genet. Program. Evolvable Mach. Spec. Issue Dev. Syst. 8(2), 131–162 (2007)CrossRefGoogle Scholar
  10. 10.
    Cachia, W., Aquilina, L., Martinez, H.P., Yannakakis, G.N.: Procedural generation of music-guided weapons. In: Proceedings of the IEEE Conference on Computational Intelligence and Games (CIG) (2014)Google Scholar
  11. 11.
    Togelius, J., Yannakakis, G.N., Stanley, K.O., Browne, C.: Search-based procedural content generation: a taxonomy and survey. IEEE Trans. Comput. Intell. AI Game. 3(3), 172–186 (2011)CrossRefGoogle Scholar
  12. 12.
    Firaxis Games: Civilization v (2010)Google Scholar
  13. 13.
    Blizzard: Diablo (1996)Google Scholar
  14. 14.
    Togelius, J., Nardi, R.D., Lucas, S.M.: Towards automatic personalised content creation for racing games. In: Proceedings of IEEE Symposium on Computational Intelligence and Games, IEEE, pp. 252–259 (2007)Google Scholar
  15. 15.
    Risi, S., Lehman, J., D’Ambrosio, D., Hall, R., Stanley, K.O.: Combining search-based procedural content generation and social gaming in the petalz video game. In: Proceedings of Artificial Intelligence and Interactive Digital Entertainment Conference (2012)Google Scholar
  16. 16.
    Gearbox Software: Borderlands (2009)Google Scholar
  17. 17.
    Audio Surf LLC: Audiosurf (2011)Google Scholar
  18. 18.
    Hastings, E.J., Guha, R.K., Stanley, K.O.: Automatic content generation in the galactic arms race video game. IEEE Trans. Comput. Intell. AI Game. 1(4), 245–263 (2009)CrossRefGoogle Scholar
  19. 19.
    Treanor, M., Blackford, B., Mateas, M., Bogost, I.: Game-o-matic: generating videogames that represent ideas. In: Proceedings of the FDG Workshop on Procedural Content Generation (2012)Google Scholar
  20. 20.
    Key, E., Kanaga, D.: Proteus (2011).
  21. 21.
    Holtar, N.I., Nelson, M.J., Togelius, J.: Audioverdrive: exploring bidirectional communication between music and gameplay. In: Proceedings of the 2013 International Computer Music Conference (2013)Google Scholar
  22. 22.
    Cybenko, G.: Approximation by superpositions of a sigmoidal function. Mathe. Control Signals Syst. 2(4), 303–314 (1989)CrossRefzbMATHMathSciNetGoogle Scholar
  23. 23.
    Stanley, K.O., Miikkulainen, R.: Evolving neural networks through augmenting topologies. Evol. Comput. 10, 99–127 (2002)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Amy K. Hoover
    • 1
  • William Cachia
    • 1
  • Antonios Liapis
    • 1
  • Georgios N. Yannakakis
    • 1
  1. 1.Institute of Digital GamesUniversity of MaltaMsidaMalta

Personalised recommendations