Abstract
With the development of more and more sophisticated Music Information Retrieval approaches, aspects of adaptivity are becoming an increasingly important research topic. Even though, adaptive techniques have already found their way into Music Information Retrieval systems and contribute to robustness or user satisfaction they are not always identified as such. This paper attempts a structured view on the last decade of Music Information Retrieval research from the perspective of adaptivity in order to increase awareness and promote the application and further development of adaptive techniques. To this end, different approaches from a wide range of application areas that share the common aspect of adaptivity are identified and systematically categorized.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Notes
Most importantly, the definition by Broy et al. [11] is generalized here with respect to the system context (instead treating user and environment separately) and simplified regarding inputs and outputs. Further, the aspect of goal orientation is added and a generic internal structure of the system is proposed that links adaptable and adaptive systems.
In case of multiple inputs or outputs, these can be combined into a single meta-input or -output respectively.
The seed song is initially provided by the user. Later, the system uses positively rated songs as seed.
References
Astrom KJ, Wittenmark B (1994) Adaptive control. Addison-Wesley Longman Publishing Co., Inc., Boston
Bade K, Nürnberger A (2008) Creating a cluster hierarchy under constraints of a partially known hierarchy. In: Proceedings of the 2008 SIAM international conference on data mining, pp 13–24
Bade K, Garbers J, Stober S, Wiering F, Nürnberger A (2009) Supporting folk-song research by automatic metric learning and ranking. In: Hirata K, Tzanetakis G, Yoshii K (eds) ISMIR 2009, 10th international conference on music information retrieval. pp 741–746
Bade K, Nürnberger A, Stober S (2009) Everything in its right place? learning a user’s view of a music collection. In: Proceedings of NAG/DAGA 2009, international conference on acoustics. Rotterdam, German Acoustical Society (DEGA), German Acoustical Society (DEGA), Berlin, pp 344–347
Baumann S, Halloran J (2004) An ecological approach to multimodal subjective music similarityperception. In: Proc. of 1st Conf. on Interdisciplinary Musicology (CIM’04). Graz, Austria
Belew RK (1989) Adaptive information retrieval: using a connectionist representation to retrieve and learn about documents. SIGIR Forum 23(SI):11–20
Bello JP, Pickens J (2005) A robust mid-level representation for harmonic content in music signals. In: Reiss JD, Wiggins GA (eds) ISMIR 2005, 6th international conference on music information retrieval, pp 304–311
Berenzweig A, Logan B, Ellis D, Whitman B (2004) A large-scale evaluation of acoustic and subjective music-similarity measures. Comput Music J 28(2):63–76
Betser M, Collen P, Rault J (2007) Audio identification using sinusoidal modeling and application to jingle detection. In: Dixon S, Bainbridge D, Typke R (eds) ISMIR 2007, 8th international conference on music information retrieval, p 139
Brossier P (2005) Fast onset detection using aubio. In: 2005 Music Information Retrieval Evaluation eXchange (MIREX)
Broy M, Leuxner C, Sitou W, Spanfelner B, Winter S (2009) Formalizing the notion of adaptive system behavior. In: SAC ’09: proceedings of the 2009 ACM symposium on applied computing. ACM, New York, pp 1029–1033
Brusilovsky P (1996) Methods and techniques of adaptive hypermedia. User Model User-Adapt Interact 6(2):87–129
Brusilovsky P (2001) Adaptive hypermedia. User Model User-Adapt Interact 11(1–2):87–110
Casey M, Veltkamp R, Goto M, Leman M, Rhodes C, Slaney M (2008) Content-based music information retrieval: current directions and future challenges. Proc IEEE 96(4):668
Chordia P, Rae A (2007) Raag recognition using pitch-class and pitch-class dyad distributions. In: Dixon S, Bainbridge D, Typke R (eds) ISMIR 2007, 8th international conference on music information retrieval
Chuan CH, Chew E (2005) Fuzzy analysis in pitch-class determination for polyphonic audio key finding. In: Reiss JD, Wiggins GA (eds) ISMIR 2005, 6th international conference on music information retrieval, pp 296–303
Cunningham S, Caulder S, Grout V (2008) Saturday Night or Fever? Context Aware Music Playlists. In: Proceedings of audio mostly 2008: conference on sound in motion (AM 2008), interactive institute sonic studio. Piteå, Sweden, 22nd–23rd October 2008
Dey AK (2001) Understanding and using context. Pers Ubiquit Comput 5(1):4–7
Dey AK, Abowd GD (2000) Towards a better understanding of context and context-awareness. In: Computer Human Interaction (CHI) 2000 workshop on the what, who, where, when, why and how of context-awareness
Diakopoulos D, Vallis O, Hochenbaum J, Murphy J, Kapur A (2009) 21st century electronica: Mir techniques for classification and performance. In: Hirata K, Tzanetakis G, Yoshii K (eds) ISMIR 2009, 10th international conference on music information retrieval
Dopler M, Schedl M, Pohle T, Knees P (2008) Accessing music collections via representative cluster prototypes in a hierarchical organization scheme. In: Bello JP, Chew E, Turnbull D (eds) ISMIR 2008, 9th international conference on music information retrieval, pp 179–184
Elliott GT, Tomlinson B (2006) Personalsoundtrack: context-aware playlists that adapt to user pace. In: CHI ’06: CHI ’06 extended abstracts on Human factors in computing systems. ACM, New York, pp 736–741
Ellis DPW, Whitman B, Berenzweig A, Lawrence S (2002) The quest for ground truth in musical artist similarity. In: Fingerhut (ed) ISMIR 2002, 3rd international conference on music information retrieval
Fujihara H, Kitahara T, Goto M, Komatani K, Ogata T, Okuno H (2006) F0 estimation method for singing voice in polyphonic audio signal based on statistical vocal model and viterbi search. In: Proc. IEEE int. conf. acoustics, speech, and signal processing, vol 5
Gabrys B, Leiviska K, Strackeljan J (2005) Do smart adaptive systems exist?-best practice for selection and combination of intelligent methods. Springer, Berlin/Heidelberg
Goto M (2001) A predominant-F0 estimation method for CD recordings: MAP estimation using EM algorithm for adaptive tone models. In: IEEE international conference on acoustics speech and signal processing, vol 5
Grachten M, Schedl M, Pohle T, Widmer G (2009) The ISMIR cloud: a decade of ISMIR conferences at your fingertips. In: Hirata K, Tzanetakis G, Yoshii K (eds) ISMIR 2009, 10th international conference on music information retrieval
Guan D, Li Q, Lee S, Lee Y (2006) A context-aware music recommendation agent in smart office. Fuzzy systems and knowledge discovery, pp 1201–1204
Harte C, Sandler M (2005) Automatic chord identification using a quantised chromagram. In: Proceedings of the audio engineering society, pp 291–301
Hitchner S, Murdoch J, Tzanetakis G (2007) Music browsing using a tabletop display. In: Dixon S, Bainbridge D, Typke R (eds) ISMIR 2007, 8th international conference on music information retrieval
Hoashi K, Matsumoto K, Inoue N (2003) Personalization of user profiles for content-based music retrieval based on relevance feedback. In: MULTIMEDIA ’03: proceedings of the eleventh ACM international conference on multimedia. ACM, New York, pp 110–119
Hu X, Downie JS, Ehmann AF (2006) Exploiting recommended usage metadata: exploratory analyses. In: Lemström K, Tindale A, Dannenberg R (eds) ISMIR 2006, 7th international conference on music information retrieval, pp 19–22
Jones S, Cunningham SJ, Jones M (2004) Organizing digital music for use: an examination of personal music collections. In: Lomeli Buyoli C, Loureiro R (eds) ISMIR 2004, 5th international conference on music information retrieval
Julia CF, Jorda S (2009) Songexplorer: a tabletop application for exploring large collections of songs. In: Hirata K, Tzanetakis G, Yoshii K (eds) ISMIR 2009, 10th international conference on music information retrieval
Knees P, Pohle T, Schedl M, Widmer G (2007) Exploring music collections in virtual landscapes. IEEE Multimed 14(3):46–54
Lartillot O, Toiviainen P (2007) MIR in Matlab (II): A toolbox for musical feature extraction from audio. In: ISMIR, pp 237–244
Laube V, Moewes C, Stober S (2008) Browsing music by usage context. In: Burred JJ, Nürnberger A, Peeters G, Stober S (eds) Proceedings of the 2nd workshop on Learning the Semantics of Audio Signals (LSAS). IRCAM, Paris, pp 19–29
Law E, von Ahn L (2009) Input-agreement: a new mechanism for collecting data using human computation games. In: CHI ’09: proceedings of the 27th international conference on Human factors in computing systems. ACM, New York, pp 1197–1206
Lee J, Lee J (2006) Music for my mood: A music recommendation system based on context reasoning. Smart sensing and context, pp 190–203
Lee JH, Downie JS (2004) Survey of music information needs, uses, and seeking behaviours: preliminary findings. In: Lomeli Buyoli C, Loureiro R (eds) ISMIR 2004, 5th international conference on music information retrieval
Lee K, Slaney M (2007) A unified system for chord transcription and key extraction using hidden markov models. In: Dixon S, Bainbridge D, Typke R (eds) ISMIR 2007, 8th international conference on music information retrieval
Leitich S, Topf M (2007) Globe of music – music library visualization using geosom. In: Dixon S, Bainbridge D, Typke R (eds) ISMIR 2007, 8th international conference on music information retrieval
Lerch A (2006) On the requirement of automatic tuning frequency estimation. In: Lemström K, Tindale A, Dannenberg R (eds) ISMIR 2006, 7th international conference on music information retrieval, pp 212–215
Little D, Raffensperger D, Pardo B (2007) A query by humming system that learns from experience. In: Dixon S, Bainbridge D, Typke R (eds) ISMIR 2007, 8th international conference on music information retrieval, pp 335–338
Liu TY (2011) Learning to rank for information retrieval. Springer
Loscos A, Wang Y, Boo WJJ (2006) Low level descriptors for automatic violin transcription. In: Lemström K, Tindale A, Dannenberg R (eds) ISMIR 2006, 7th international conference on music information retrieval, pp 164–167
Lübbers D (2005) Sonixplorer: combining visualization and auralization for content-based exploration of music collections. In: Reiss JD, Wiggins GA (eds) ISMIR 2005, 6th international conference on music information retrieval, pp 590–593
Lübbers D, Jarke M (2009) Adaptive multimodal exploration of music collections. In: Hirata K, Tzanetakis G, Yoshii K (eds) ISMIR 2009, 10th international conference on music information retrieval
Maddage NC, Xu C, Kankanhalli MS, Shao X (2004) Content-based music structure analysis with applications to music semantics understanding. In: MULTIMEDIA ’04: proceedings of the 12th annual ACM international conference on multimedia. ACM, New York, pp 112–119
Mandel M, Poliner G, Ellis D (2006) Support vector machine active learning for music retrieval. Multimedia Syst 12(1):3–13
Mandl T, Womser-Hacker C (2002) Learning to cope with diversity in music retrieval. In: Fingerhut (ed) ISMIR 2002, 3rd international conference on music information retrieval
Marolt M (2009) Probabilistic segmentation and labeling of ethnomusicological field recordings. In: Hirata K, Tzanetakis G, Yoshii K (eds) ISMIR 2009, 10th international conference on music information retrieval
Martín H JA, Lope J, Maravall D (2009) Adaptation, anticipation and rationality in natural and artificial systems: computational paradigms mimicking nature. Nat Comput 8(4):757–775
Mauch M, Dixon S (2010) Approximate note transcription for the improved identification of difficult chords. In: Downie JS, Veltkamp RC (eds) ISMIR 2010, 11th international conference on music information retrieval, pp 135–140.
Mauch M, Dixon S (2010) Simultaneous estimation of chords and musical context from audio. IEEE T Audio Speech 18(6):1280–1289
McFee B, Lanckriet G (2009) Heterogeneous embedding for subjective artist similarity. In: Hirata K, Tzanetakis G, Yoshii K (eds) ISMIR 2009, 10th international conference on music information retrieval
McFee B, Barrington L, Lanckriet G (2010) Learning similarity from collaborative filters. In: Downie JS, Veltkamp RC (eds) ISMIR 2010, 11th international conference on music information retrieval, pp 345–350.
Michels K, Klawonn F, Kruse R, Nürnberger A (2006) Fuzzy control: fundamentals, stability and design of fuzzy controllers. Springer
Moh Y, Buhmann JM (2008) Kernel expansion for online preference tracking. In: Bello JP, Chew E, Turnbull D (eds) ISMIR 2008, 9th international conference on music information retrieval, pp 167–172
Montecchio N, Orio N (2009) A discrete filter bank approach to audio to score matching for polyphonic music. In: Hirata K, Tzanetakis G, Yoshii K (eds) ISMIR 2009, 10th international conference on music information retrieval
Mörchen F, Ultsch A, Nöcker M, Stamm C (2005) Databionic visualization of music collections according to perceptual distance. In: Reiss JD, Wiggins GA (eds) ISMIR 2005, 6th international conference on music information retrieval, pp 396–403
Müller M, Konz V, Scharfstein A, Ewert S, Clausen M (2009) Towards automated extraction of tempo parameters from expressive music recordings. In: Hirata K, Tzanetakis G, Yoshii K (eds) ISMIR 2009, 10th international conference on music information retrieval
Neumayer R, Dittenbach M, Rauber A (2005) Playsom and pocketsomplayer, alternative interfaces to large music collections. In: Reiss JD, Wiggins GA (eds) ISMIR 2005, 6th international conference on music information retrieval, pp 618–623
Niitsuma M, Takaesu H, Demachi H, Oono M, Saito H (2008) Development of an automatic music selection system based on runner’s step frequency. In: Bello JP, Chew E, Turnbull D (eds) ISMIR 2008, 9th international conference on music information retrieval, pp 193–198
Noland K, Sandler MB (2006) Key estimation using a hidden markov model. In: Lemström K, Tindale A, Dannenberg R (eds) ISMIR 2006, 7th international conference on music information retrieval, pp 121–126
Nürnberger A, Detyniecki M (2005) Adaptive multimedia retrieval: From data to user interaction. In: Gabrys B, Leiviskä K, Strackeljan J (eds) Do smart adaptive systems exist? Studies in fuzziness and soft computing, vol 173. Springer, Berlin/Heidelberg, pp 341–370
Oliver N, Flores-Mangas F (2006) Mptrain: a mobile, music and physiology-based personal trainer. In: MobileHCI ’06: proceedings of the 8th conference on Human-computer interaction with mobile devices and services. ACM, New York, pp 21–28
Oliver N, Kreger-Stickles L (2006) PAPA: physiology and purpose-aware automatic playlist generation. In: Lemström K, Tindale A, Dannenberg R (eds) ISMIR 2006, 7th international conference on music information retrieval, pp 250–253
Orio N (2006) Music retrieval: a tutorial and review. Inf Retr 1(1):1–90
Pampalk E, Gasser M (2006) An implementation of a simple playlist generator based on audio similarity measures and user feedback. In: Lemström K, Tindale A, Dannenberg R (eds) ISMIR 2006, 7th international conference on music information retrieval, pp 389–390
Pampalk E, Rauber A, Merkl D (2002) Content-based organization and visualization of music archives. In: proceedings of the 10thACMinternational conference on multimedia,ACMPress, New York, pp 570–579
Pampalk E, Dixon S, Widmer G (2003) Exploring music collections by browsing different views. In: Hoos HH, Bainbridge D (eds) ISMIR 2003, 4th international conference on music information retrieval
Pampalk E, Flexer A, Widmer G (2005) Hierarchical organization and description of music collections at the artist level. Lect Notes Comput Sci 3652:37
Pampalk E, Pohle T, Widmer G (2005) Dynamic playlist generation based on skipping behavior. In: Reiss JD, Wiggins GA (eds) ISMIR 2005, 6th international conference on music information retrieval, pp 634–637
Papadopoulos H, Peeters G (2007) Large-scale study of chord estimation algorithms based on chroma representation and hmm. In: Proceedings of the international workshop on Content-Based Multimedia Indexing (CBMI), pp 53–60
Park HS, Yoo JO, Cho SB (2006) A context-aware music recommendation system using fuzzy bayesian networks with utility theory. Fuzzy systems and knowledge discovery, pp 970–979
Pauws S, Eggen B (2002) Pats: realization and user evaluation of an automatic playlist generator. In: Fingerhut (ed) ISMIR 2002, 3rd international conference on music information retrieval
Pauws S, van de Wijdeven S (2005) User evaluation of a new interactive playlist generation concept. In: Reiss JD, Wiggins GA (eds) ISMIR 2005, 6th international conference on music information retrieval, pp 638–643
Pauws S, Verhaegh W, Vossen M (2006) Fast generation of optimal music playlists using local search. In: Lemström K, Tindale A, Dannenberg R (eds) ISMIR 2006, 7th international conference on music information retrieval, pp 138–143
Peeters G (2006) Musical key estimation of audio signal based on hidden Markov modeling of chroma vectors. In: Proc. of the int. conf. on Digital Audio Effects (DAFx-06). Montreal, Quebec, pp 127–131
Pohle T, Seyerlehner K, Widmer G (2008) An approach to automatically tracking music preference on mobile players. In: Proc. of 6th intl. workshop on Adaptive Multimedia Retrieval (AMR’08)
Pugin L, Burgoyne JA, Fujinaga I (2007) MAP adaptation to improve optical music recognition of early music documents using hidden markov models. In: Dixon S, Bainbridge D, Typke R (eds) ISMIR 2007, 8th international conference on music information retrieval
Rauber A, Pampalk E, Merkl D (2002) Using psycho-acoustic models and self-organizing maps to create a hierarchical structuring of music by musical styles. In: Fingerhut (ed) ISMIR 2002, 3rd international conference on music information retrieval
Ravelli E, Richard G, Daudet L (2008) Fast MIR in a sparse transform domain. In: Bello JP, Chew E, Turnbull D (eds) ISMIR 2008, 9th international conference on music information retrieval, pp 527–532
Reinhard J, Stober S, Nürnberger A (2008) Enhancing chord classification through neighbourhood histograms. In: Proceedings of the 6th international workshop on Content-Based Multimedia Indexing (CBMI 2008)
Reynolds G, Barry D, Burke T, Coyle E (2007) Towards a personal automatic music playlist generation algorithm: the need for contextual information. In: Proceedings of 2nd audio mostly conference: interaction with sound, pp 84–89
Rocchio JJ (1971) Relevance feedback in information retrieval. In: Salton G (ed) The SMART retrieval system—experiments in automatic document processing. Prentice Hall, Englewood, pp 313–323
Rolland P (2001) Adaptive user modeling in a content-based music retrieval system. In: ISMIR
Sandvold V, Aussenac T, Celma Ò, Herrera P (2006) Good vibrations:Music discovery through personal musical concepts. In: Lemström K, Tindale A, Dannenberg R (eds) ISMIR 2006, 7th international conference on music information retrieval, pp 322–323
Sheh A, Ellis D (2003) Chord segmentation and recognition using EM-trained hidden Markov models. In: Hoos HH, Bainbridge D (eds) ISMIR 2003, 4th international conference on music information retrieval, pp 185–191
Shenoy A, Wang Y (2005) Key, chord, and rhythm tracking of popular music recordings. Comput Music J 29(3):75–86
Slaney M, Weinberger KQ, White W (2008) Learning a metric for music similarity. In: Bello JP, Chew E, Turnbull D (eds) ISMIR 2008, 9th international conference on music information retrieval, pp 313–318
Sotiropoulos DN, Lampropoulos AS, Tsihrintzis GA (2008) Musiper: a system for modeling music similarity perception based on objective feature subset selection. User Model User-Adapt Interact 18(4):315–348
Stavness I, Gluck J, Vilhan L, Fels S (2005) The musictable: A map-based ubiquitous system for social interaction with a digital music collection. In: Proc. of Int’l Conf. on Entertainment Computing (ICEC 2005), p 291
Stober S, Nürnberger A (2008) Towards user-adaptive structuring and organization of music collections. In: Proc. of 6th intl. workshop on Adaptive Multimedia Retrieval (AMR’08)
Stober S, Nürnberger A (2008) Towards user-adaptive structuring and organization of music collections. In: Adaptive multimedial retrieval: 6th international workshop, AMR 2008. Berlin, Germany, 26–27 June 2008
Stober S, Nürnberger A (2009) User-adaptive music information retrieval. KI 23(2):54–57
Stober S, Nürnberger A (2010) A multi-focus zoomable interface for multi-facet exploration of music collections. In: Proc. of 7th int. symposium on Computer Music Modeling and Retrieval (CMMR’10)
Stober S, Nürnberger A (2010) MusicGalaxy—an adaptive user-interface for exploratory music retrieval. In: Proc. of 7th Sound and Music Computing conference (SMC’10)
Stober S, Nürnberger A (2011) An experimental comparison of similarity adaptation approaches. In: Proceedings of 9th international workshop on Adaptive Multimedia Retrieval (AMR’11). Barcelona, Spain
Stober S, Steinbrecher M, Nürnberger A (2009) A survey on the acceptance of listening context logging for mir applications. In: Baumann S, Burred JJ, Nürnberger A, Stober S (eds) Proceedings of the 3rd workshop on learning the semantics of audio signals (LSAS). Graz, Austria, pp 45–57
Su MY, Yang YH, Lin YC, Chen H (2009) An integrated approach to music boundary detection. In: Hirata K, Tzanetakis G, Yoshii K (eds) ISMIR 2009, 10th international conference on music information retrieval
Sumi K, Itoyama K, Yoshii K, Komatani K, Ogata T, Okuno HG (2008) Automatic chord recognition based on probabilistic integration of chord transition and bass pitch estimation. In: Bello JP, Chew E, Turnbull D (eds) ISMIR 2008, 9th international conference on music information retrieval, pp 39–44
Vignoli F, Pauws S (2005) A music retrieval system based on user driven similarity and its evaluation. In: Reiss JD, Wiggins GA (eds) ISMIR 2005, 6th international conference on music information retrieval, pp 272–279
Wolff D, Weyde T (2011) Combining sources of description for approximating music similarity ratings. In: Proceedings of the 9th international workshop on Adaptive Multimedia Retrieval (AMR’11)
Wolter K, Bastuck C, Gärtner D (2008) Adaptive user modeling for content-based music retrieval. In: Proc. of 6th intl. workshop on Adaptive Multimedia Retrieval (AMR’08)
You W, Dannenberg R (2007) Polyphonic music note onset detection using semi-supervised learning. In: Dixon S, Bainbridge D, Typke R (eds) ISMIR 2007, 8th international conference on music information retrieval
Zhu Y, Kankanhalli M (2006) Precise pitch profile feature extraction from musical audio for key detection. IEEE Trans Multimedia 8(3):575–584
Acknowledgements
This work was supported by the German National Merit Foundation and the German Research Foundation (DFG) under the project AUCOMA. The survey would not have been possible if the referenced publications had not been publicly accessible. Especially, the authors would like to thank the International Society for Music Information Retrieval (ISMIR) for promoting the idea of open access and especially the people maintaining the cumulative proceedings as a valuable resource for everyone interested in Music Information Retrieval. Furthermore, the authors thank Perfecto Herrera, Emilia Gómez, and the anonymous reviewers for their constructive remarks and suggestions that helped to improve the manuscript.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Stober, S., Nürnberger, A. Adaptive music retrieval–a state of the art. Multimed Tools Appl 65, 467–494 (2013). https://doi.org/10.1007/s11042-012-1042-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-012-1042-z