Skip to main content
SpringerLink
Log in

Creating ambient music spaces in real and virtual worlds

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Sound and, specifically, music is a medium that is used for a wide range of purposes in different situations in very different ways. Ways for music selection and consumption range from completely passive, almost unnoticed perception of background sound environments to the very specific selection of a particular recording of a piece of music with a specific orchestra and conductor at a certain event. Different systems and interfaces exist for the broad range of needs in music consumption. Locating a particular recording is well supported by traditional search interfaces via metadata. Other interfaces support the automatic creation of playlists via artist or album selection, up to more artistic installations of sound environments that users can navigate through. In this paper we present a set of systems that support the creation of as well as the navigation in musical spaces, both in the real world as well as in virtual environments. We show common principles and point out further directions for a more direct coupling of the various spaces and interaction methods, creating ambient sound environments and providing organic interaction with music for different purposes.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. http://www.midomi.com/

  2. http://www.ifs.tuwien.ac.at/mir/audiofeatureextraction.html

  3. http://www.garagegames.com/products/torque/tge/

  4. http://www.ifs.tuwien.ac.at/mir/mediasquare/

  5. http://ccgvr.ewha.ac.kr/

  6. http://www.ifs.tuwien.ac.at/mir/pocketsom/

  7. http://www.ifs.tuwien.ac.at/mir/pocketsom/isom/

References

  1. Baum D, Rauber A (2006) Emotional descriptors for map-based access to music libraries. In: Proceedings of the 9th international conference on Asian digital libraries. Kyoto, Japan

  2. Downie JS (2003) Music information retrieval. In: Annual review of information science and technology, vol 37. Information Today, Medford, NJ, USA, pp 295–340

    Google Scholar 

  3. Feiten B, Günzel S (1994) Automatic indexing of a sound database using self-organizing neural nets. Comp Music J 18(3):53–65

    Article  Google Scholar 

  4. Frank J, Lidy T, Peiszer E, Genswaider R, Rauber A (2008) Ambient music experience in real and virtual worlds using audio similarity. In: SAME 08: Proceeding of the 1st ACM international workshop on semantic ambient media experiences. ACM, New York, NY, USA, pp 9–16

    Chapter  Google Scholar 

  5. Genswaider R, Berger H, Dittenbach M, Pesenhofer A, Merkl D, Rauber A, Lidy T (2008) Computational intelligence in multimedia processing: recent advances. A synthetic 3D multimedia environment. In: Studies in computational intelligence, vol 96. Springer, Berlin, pp 79–98

    Google Scholar 

  6. Ghias A, Logan J, Chamberlin D, Smith BC (1995) Query by humming: musical information retrieval in an audio database. In: Proceedings of the third ACM international conference on multimedia. ACM, New York, NY, USA, pp 231–236

    Chapter  Google Scholar 

  7. Hitchner S, Murdoch J, Tzanetakis G (2007) Music browsing using a tabletop display. In: Proceedings of the 8th international conference on music information retrieval. Vienna, Austria, pp 175–176 (2007)

  8. ISO (2002) Information technology—multimedia content description interface—part 4: audio. ISO/IEC 15938-4:2002. International Organisation for Standardisation

  9. Knees P, Schedl M, Pohle T, Widmer G (2006) An innovative three-dimensional user interface for exploring music collections enriched. In: Proceedings of the 14th annual ACM international conference on multimedia. ACM, Santa Barbara, CA, USA, pp 17–24

    Chapter  Google Scholar 

  10. Kohonen T (2001) Self-organizing maps. In: Springer series in information sciences, vol 30, 3rd edn. Springer, Berlin

    Google Scholar 

  11. Kohonen T, Kaski S, Lagus K, Salojärvi J, Honkela J, Paatero V, Saarela A (2000) Self-organization of a massive document collection. IEEE Trans. Neural Netw. 11(3):574–585

    Article  Google Scholar 

  12. Laaksonen J, Moskela M, Oja E (1999) PicSOM: self-organizing maps for content-based image retrieval. In: Proceedings of the international joint conference on neural networks (IJCNN99). Washington, DC

  13. Leitich S, Topf M (2007) Globe of music—music library visualisation unsing geosom. In: Proceedings of the 8th international conference on music information retrieval. Vienna, Austria, pp 167–170

  14. Leitich S, Toth M (2007) PublicDJ—music selection in public spaces as multiplayer game. In: Proceedings of audio mostly 2007. Ilmenau, Germany

  15. Lidy T, Rauber A (2005) Evaluation of feature extractors and psycho-acoustic transformations for music genre classification. In: Proceedings of the international conference on music information retrieval (ISMIR). London, UK, pp 34–41

    Google Scholar 

  16. Lidy T, Rauber A (2008) Machine learning techniques for multimedia. Classification and clustering of music for novel music access applications. In: Cognitive technologies. Springer, Berlin, pp 249–285

    Google Scholar 

  17. Lidy T, Rauber A, Pertusa A, Inesta JM (2007) Improving genre classification by combination of audio and symbolic descriptors using a transcription system. In: Proceedings of the international conference on music information retrieval (ISMIR). Vienna, Austria, pp 61–66

  18. Lübbers D (2005) SoniXplorer: combining visualization and auralization for content-based exploration of music collections. In: Proceedings of the 6th international conference on music information retrieval (ISMIR 2005), pp 590–593

  19. Mayer R, Aziz TA, Rauber A (2007) Visualising class distribution on self-organising maps. In: de Sá JM, Alexandre LA, Duch W, Mandic D (eds) Proceedings of the international conference on artificial neural networks (ICANN’07), LNCS, vol 4669. Springer, Porto, Portugal, pp 359–368

    Google Scholar 

  20. Mayer R, Lidy T, Rauber A (2006) The map of mozart. In: Proceedings of the international conference on music information retrieval (ISMIR). Victoria, Canada

    Google Scholar 

  21. McNab RJ, Smith LA, Witten IH, Henderson CL, Cunningham SJ (1996) Towards the digital music library: tune retrieval from acoustic input. In: Proceedings of the first ACM international conference on digital libraries (DL ’96). ACM, New York, NY, USA, pp 11–18

    Chapter  Google Scholar 

  22. Neumayer R, Dittenbach M, Rauber A (2005) PlaySOM and PocketSOMPlayer—alternative interfaces to large music collections. In: Proceedings of the international conference on music information retrieval (ISMIR). London, UK, pp 618–623

    Google Scholar 

  23. Neumayer R, Frank J, Hlavac P, Lidy T, Rauber A (2007) Bringing mobile based map access to digital audio to the end user. In: Proceedings of the 14th international conference on image analysis and processing (ICIAP 2007) - workshop on video and multimedia digital libraries (VMDL07). IEEE Computer Society, Modena, Italy, pp 9–14

    Chapter  Google Scholar 

  24. Neumayer R, Mayer R, Pölzlbauer G, Rauber A (2007) The metro visualisation of component planes for self-organising maps. In: Proceedings of the international joint conference on neural networks (IJCNN’07). IEEE Computer Society, Orlando, FL, USA

    Google Scholar 

  25. Ong TH, Chen H, Sung W, Zhu B (2005) Newsmap: a knowledge map for online news. Decis Support Syst 39(4):583–597

    Article  Google Scholar 

  26. Orio N (2006) Music retrieval: a tutorial and review. Foundations and Trends in Information Retrieval 1(1):1–90

    Article  Google Scholar 

  27. Pampalk E, Rauber A, Merkl D (2002) Content-based organization and visualization of music archives. In: Proceedings of ACM multimedia 2002. Juan-les-Pins, France, pp 570–579

    Chapter  Google Scholar 

  28. Rauber A, Frühwirth M (2001) Automatically analyzing and organizing music archives. In: Proceedings of the 5th European conference on research and advanced technology for digital libraries (ECDL 2001). Springer lecture notes in computer science. Springer, Darmstadt, Germany

    Google Scholar 

  29. Rauber A, Merkl D (1999) SOMLib: a digital library system based on neural networks. In: Fox E, Rowe N (eds) Proceedings of the ACM conference on digital libraries (ACMDL’99). ACM, Berkeley, CA, pp 240–241

    Chapter  Google Scholar 

  30. Rauber A, Pampalk E, Merkl D (2002) Using psycho-acoustic models and self-organizing maps to create a hierarchical structuring of music by musical styles. In: Proceedings of the international conference on music information retrieval (ISMIR). Paris, France, pp 71–80

    Google Scholar 

  31. Rauber A, Pampalk E, Merkl D (2003) The SOM-enhanced jukebox: organization and visualization of music collections based on perceptual models. J New Music Res 32(2):193–210

    Article  Google Scholar 

  32. Torrens M, Hertzog P, Arcos JL (2004) Visualizing and exploring personal music libraries. In: Proceedings of the 5th international conference on music information retrieval (ISMIR 2004)

  33. Tzanetakis G, Cook P (2001) Marsyas3D: a prototype audio browser-editor using a large scale immersive visual and audio display. In: Proceedings of the international conference on auditory display

  34. Tzanetakis G, Cook P (2004) Music analysis and retrieval systems for audio signals. J Am Soc Inf Sci Technol 55(12):1077–1083

    Article  Google Scholar 

  35. Ultsch A (2003) Pareto density estimation: a density estimation for knowledge discovery. In: Baier D, Wernecke KD (eds) Innovations in classification, data science, and information systems - proceedings 27th annual conference of the German classification society (GfKL), pp. 91–100. Springer, Berlin (2003)

    Google Scholar 

  36. Ultsch A (20074) U*-matrix: a tool to visualize clusters in high dimensional data. Tech. rep., Departement of Mathematics and Computer Science, Philipps-University, Marburg, Germany

  37. Ultsch A, Siemon HP (1990) Kohonen’s self-organizing feature maps for exploratory data analysis. In: Proceedings of the international neural network conference (INNC’90). Kluwer, Dordrecht, Netherlands, pp 305–308

    Google Scholar 

  38. Zwicker E, Fastl H (1999) Psychoacoustics—facts and models. In: Springer series of information sciences, vol 22. Springer, Berlin

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Software Technology and Interactive Systems, Vienna University of Technology, Favoritenstraße 9-11/188, 1040, Vienna, Austria

    Jakob Frank, Thomas Lidy, Ewald Peiszer, Ronald Genswaider & Andreas Rauber

Authors
  1. Jakob Frank
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Thomas Lidy
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ewald Peiszer
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ronald Genswaider
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Andreas Rauber
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jakob Frank.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Frank, J., Lidy, T., Peiszer, E. et al. Creating ambient music spaces in real and virtual worlds. Multimed Tools Appl 44, 449–468 (2009). https://doi.org/10.1007/s11042-009-0275-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-009-0275-y

Keywords

Search

Navigation