Multimedia Tools and Applications

, Volume 44, Issue 3, pp 449–468

Creating ambient music spaces in real and virtual worlds

  • Jakob Frank
  • Thomas Lidy
  • Ewald Peiszer
  • Ronald Genswaider
  • Andreas Rauber
Article

Abstract

Sound and, specifically, music is a medium that is used for a wide range of purposes in different situations in very different ways. Ways for music selection and consumption range from completely passive, almost unnoticed perception of background sound environments to the very specific selection of a particular recording of a piece of music with a specific orchestra and conductor at a certain event. Different systems and interfaces exist for the broad range of needs in music consumption. Locating a particular recording is well supported by traditional search interfaces via metadata. Other interfaces support the automatic creation of playlists via artist or album selection, up to more artistic installations of sound environments that users can navigate through. In this paper we present a set of systems that support the creation of as well as the navigation in musical spaces, both in the real world as well as in virtual environments. We show common principles and point out further directions for a more direct coupling of the various spaces and interaction methods, creating ambient sound environments and providing organic interaction with music for different purposes.

Keywords

Music information retrieval Virtual worlds Mobile computing User interfaces 

References

  1. 1.
    Baum D, Rauber A (2006) Emotional descriptors for map-based access to music libraries. In: Proceedings of the 9th international conference on Asian digital libraries. Kyoto, JapanGoogle Scholar
  2. 2.
    Downie JS (2003) Music information retrieval. In: Annual review of information science and technology, vol 37. Information Today, Medford, NJ, USA, pp 295–340Google Scholar
  3. 3.
    Feiten B, Günzel S (1994) Automatic indexing of a sound database using self-organizing neural nets. Comp Music J 18(3):53–65CrossRefGoogle Scholar
  4. 4.
    Frank J, Lidy T, Peiszer E, Genswaider R, Rauber A (2008) Ambient music experience in real and virtual worlds using audio similarity. In: SAME 08: Proceeding of the 1st ACM international workshop on semantic ambient media experiences. ACM, New York, NY, USA, pp 9–16CrossRefGoogle Scholar
  5. 5.
    Genswaider R, Berger H, Dittenbach M, Pesenhofer A, Merkl D, Rauber A, Lidy T (2008) Computational intelligence in multimedia processing: recent advances. A synthetic 3D multimedia environment. In: Studies in computational intelligence, vol 96. Springer, Berlin, pp 79–98Google Scholar
  6. 6.
    Ghias A, Logan J, Chamberlin D, Smith BC (1995) Query by humming: musical information retrieval in an audio database. In: Proceedings of the third ACM international conference on multimedia. ACM, New York, NY, USA, pp 231–236CrossRefGoogle Scholar
  7. 7.
    Hitchner S, Murdoch J, Tzanetakis G (2007) Music browsing using a tabletop display. In: Proceedings of the 8th international conference on music information retrieval. Vienna, Austria, pp 175–176 (2007)Google Scholar
  8. 8.
    ISO (2002) Information technology—multimedia content description interface—part 4: audio. ISO/IEC 15938-4:2002. International Organisation for StandardisationGoogle Scholar
  9. 9.
    Knees P, Schedl M, Pohle T, Widmer G (2006) An innovative three-dimensional user interface for exploring music collections enriched. In: Proceedings of the 14th annual ACM international conference on multimedia. ACM, Santa Barbara, CA, USA, pp 17–24CrossRefGoogle Scholar
  10. 10.
    Kohonen T (2001) Self-organizing maps. In: Springer series in information sciences, vol 30, 3rd edn. Springer, BerlinGoogle Scholar
  11. 11.
    Kohonen T, Kaski S, Lagus K, Salojärvi J, Honkela J, Paatero V, Saarela A (2000) Self-organization of a massive document collection. IEEE Trans. Neural Netw. 11(3):574–585CrossRefGoogle Scholar
  12. 12.
    Laaksonen J, Moskela M, Oja E (1999) PicSOM: self-organizing maps for content-based image retrieval. In: Proceedings of the international joint conference on neural networks (IJCNN99). Washington, DCGoogle Scholar
  13. 13.
    Leitich S, Topf M (2007) Globe of music—music library visualisation unsing geosom. In: Proceedings of the 8th international conference on music information retrieval. Vienna, Austria, pp 167–170Google Scholar
  14. 14.
    Leitich S, Toth M (2007) PublicDJ—music selection in public spaces as multiplayer game. In: Proceedings of audio mostly 2007. Ilmenau, GermanyGoogle Scholar
  15. 15.
    Lidy T, Rauber A (2005) Evaluation of feature extractors and psycho-acoustic transformations for music genre classification. In: Proceedings of the international conference on music information retrieval (ISMIR). London, UK, pp 34–41Google Scholar
  16. 16.
    Lidy T, Rauber A (2008) Machine learning techniques for multimedia. Classification and clustering of music for novel music access applications. In: Cognitive technologies. Springer, Berlin, pp 249–285Google Scholar
  17. 17.
    Lidy T, Rauber A, Pertusa A, Inesta JM (2007) Improving genre classification by combination of audio and symbolic descriptors using a transcription system. In: Proceedings of the international conference on music information retrieval (ISMIR). Vienna, Austria, pp 61–66Google Scholar
  18. 18.
    Lübbers D (2005) SoniXplorer: combining visualization and auralization for content-based exploration of music collections. In: Proceedings of the 6th international conference on music information retrieval (ISMIR 2005), pp 590–593Google Scholar
  19. 19.
    Mayer R, Aziz TA, Rauber A (2007) Visualising class distribution on self-organising maps. In: de Sá JM, Alexandre LA, Duch W, Mandic D (eds) Proceedings of the international conference on artificial neural networks (ICANN’07), LNCS, vol 4669. Springer, Porto, Portugal, pp 359–368Google Scholar
  20. 20.
    Mayer R, Lidy T, Rauber A (2006) The map of mozart. In: Proceedings of the international conference on music information retrieval (ISMIR). Victoria, CanadaGoogle Scholar
  21. 21.
    McNab RJ, Smith LA, Witten IH, Henderson CL, Cunningham SJ (1996) Towards the digital music library: tune retrieval from acoustic input. In: Proceedings of the first ACM international conference on digital libraries (DL ’96). ACM, New York, NY, USA, pp 11–18CrossRefGoogle Scholar
  22. 22.
    Neumayer R, Dittenbach M, Rauber A (2005) PlaySOM and PocketSOMPlayer—alternative interfaces to large music collections. In: Proceedings of the international conference on music information retrieval (ISMIR). London, UK, pp 618–623Google Scholar
  23. 23.
    Neumayer R, Frank J, Hlavac P, Lidy T, Rauber A (2007) Bringing mobile based map access to digital audio to the end user. In: Proceedings of the 14th international conference on image analysis and processing (ICIAP 2007) - workshop on video and multimedia digital libraries (VMDL07). IEEE Computer Society, Modena, Italy, pp 9–14CrossRefGoogle Scholar
  24. 24.
    Neumayer R, Mayer R, Pölzlbauer G, Rauber A (2007) The metro visualisation of component planes for self-organising maps. In: Proceedings of the international joint conference on neural networks (IJCNN’07). IEEE Computer Society, Orlando, FL, USAGoogle Scholar
  25. 25.
    Ong TH, Chen H, Sung W, Zhu B (2005) Newsmap: a knowledge map for online news. Decis Support Syst 39(4):583–597CrossRefGoogle Scholar
  26. 26.
    Orio N (2006) Music retrieval: a tutorial and review. Foundations and Trends in Information Retrieval 1(1):1–90CrossRefGoogle Scholar
  27. 27.
    Pampalk E, Rauber A, Merkl D (2002) Content-based organization and visualization of music archives. In: Proceedings of ACM multimedia 2002. Juan-les-Pins, France, pp 570–579CrossRefGoogle Scholar
  28. 28.
    Rauber A, Frühwirth M (2001) Automatically analyzing and organizing music archives. In: Proceedings of the 5th European conference on research and advanced technology for digital libraries (ECDL 2001). Springer lecture notes in computer science. Springer, Darmstadt, GermanyGoogle Scholar
  29. 29.
    Rauber A, Merkl D (1999) SOMLib: a digital library system based on neural networks. In: Fox E, Rowe N (eds) Proceedings of the ACM conference on digital libraries (ACMDL’99). ACM, Berkeley, CA, pp 240–241CrossRefGoogle Scholar
  30. 30.
    Rauber A, Pampalk E, Merkl D (2002) Using psycho-acoustic models and self-organizing maps to create a hierarchical structuring of music by musical styles. In: Proceedings of the international conference on music information retrieval (ISMIR). Paris, France, pp 71–80Google Scholar
  31. 31.
    Rauber A, Pampalk E, Merkl D (2003) The SOM-enhanced jukebox: organization and visualization of music collections based on perceptual models. J New Music Res 32(2):193–210CrossRefGoogle Scholar
  32. 32.
    Torrens M, Hertzog P, Arcos JL (2004) Visualizing and exploring personal music libraries. In: Proceedings of the 5th international conference on music information retrieval (ISMIR 2004)Google Scholar
  33. 33.
    Tzanetakis G, Cook P (2001) Marsyas3D: a prototype audio browser-editor using a large scale immersive visual and audio display. In: Proceedings of the international conference on auditory displayGoogle Scholar
  34. 34.
    Tzanetakis G, Cook P (2004) Music analysis and retrieval systems for audio signals. J Am Soc Inf Sci Technol 55(12):1077–1083CrossRefGoogle Scholar
  35. 35.
    Ultsch A (2003) Pareto density estimation: a density estimation for knowledge discovery. In: Baier D, Wernecke KD (eds) Innovations in classification, data science, and information systems - proceedings 27th annual conference of the German classification society (GfKL), pp. 91–100. Springer, Berlin (2003)Google Scholar
  36. 36.
    Ultsch A (20074) U*-matrix: a tool to visualize clusters in high dimensional data. Tech. rep., Departement of Mathematics and Computer Science, Philipps-University, Marburg, GermanyGoogle Scholar
  37. 37.
    Ultsch A, Siemon HP (1990) Kohonen’s self-organizing feature maps for exploratory data analysis. In: Proceedings of the international neural network conference (INNC’90). Kluwer, Dordrecht, Netherlands, pp 305–308Google Scholar
  38. 38.
    Zwicker E, Fastl H (1999) Psychoacoustics—facts and models. In: Springer series of information sciences, vol 22. Springer, BerlinGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  • Jakob Frank
    • 1
  • Thomas Lidy
    • 1
  • Ewald Peiszer
    • 1
  • Ronald Genswaider
    • 1
  • Andreas Rauber
    • 1
  1. 1.Institute of Software Technology and Interactive SystemsVienna University of TechnologyViennaAustria

Personalised recommendations