Abstract
A variety of approaches exist to the automatic retrieval of the key part within a musical piece - its thumbnail. Most of these however do not use adequate modeling with respect to either harmony or rhythm. In this work we therefore introduce thumbnailing that aims at adequate musical feature modeling. The rhythmic structure is extracted to obtain a segmentation based on beats and bars by an IIR comb-filter bank. Further, we extract chroma energy distribution normalized statistics features of the segmented song improving performance with dB(A) and pitch correction. Harmonic similarities are determined by construction and analysis of a similarity matrix based on the normalized scalar product of the feature vectors. Last, thumbnails are found lending techniques from image processing. Extensive test runs on roughly 24 h of music reveal the high effectiveness of our approach.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abdallah, S.A., Noland, K., Sandler, M., Casey, M., Rhodes, C.: Theory and Evaluation of a Bayesian Music Structure Extractor. In: Proc. 6th ISMIR, pp. 420–425 (2005)
Aucouturier, J.-J., Pachet, F., Sandler, M.: “The way it Sounds”: Timbre Models for Analysis and Retrieval of Music Signals. IEEE Transactions on Multimedia 7(6), 1028–1035 (2005)
Aucouturier, J.-J., Sandler, M.: Segmentation of Musical Signals Using Hidden Markov Models. In: Proc. of the Audio Engineering Society 110th Convention (2001)
Bartsch, M.A., Wakefield, G.H.: To Catch a Chorus: using Chroma-Based Representations for Audiothumbnailing. In: Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, pp. 15–18 (2001)
Berenzweig, A., Ellis, D.: Locating singing voice segments within musical signals. In: Proc. Int. Workshop on Applications of Signal Processing to Audio and Acoustics (WASPAA), Mohonk, NY, pp. 119–123 (2001)
Burges, C.J.C., Plastina, D., Platt, J.C., Renshaw, E., Malvar, H.S.: Duplicate Detection and Audio Thumbnails with Audio Fingerprinting. Technical Report MSR-TR-2004-19, Microsoft Research, MSR (2004)
Chew, E.: An algorithm for determining key boundaries. In: Proc. 2nd Int. Conf. on Music and Artificial Intelligence (2002)
Cooper, M., Foote, J.: Automatic Music Summarization via Similarity Analysis. In: Proc. 3rd ISMIR, pp. 81–85 (2002)
D’Aguanno, A., Vercellesi, G.: Automatic synchronization between audio and partial music score representation. In: Proc. 6th Workshop on Adaptive Multimedia Retrieval (AMR 2008), Berlin, Germany (2008)
Eyben, F., Schuller, B., Reiter, S., Rigoll, G.: Wearable Assistance for the Ballroom-Dance Hobbyist - Holistic Rhythm Analysis and Dance-Style Classification. In: Proc. ICME, pp. 92–95 (2007)
Foote, J.: Visualizing Music and Audio using Self-Similarity. In: Proc. 7th ACM Int. Conf. on Multimedia (Part 1), pp. 77–80 (1999)
Goto, M.: A Chorus Section Detection Method for Musical Audio Signals and its Application to a Music Listening Station. IEEE Transactions on Audio, Speech and Language Processing 14(5), 1783–1794 (2006)
Jehan, T.: Hierarchical Multi-Class Self Similarities. In: Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, pp. 311–314 (2005)
Lee, K., Slaney, M.: Acoustic chord transcription and key extraction from audio using key-dependent hmms trained on synthesized audio. IEEE Transactions on Audio, Speech and Language Processing 16, 291–301 (2008)
Logan, B., Chu, S.: Music Summarization Using Key Phrases. In: Proc. ICASSP, vol. 2, pp. 749–752 (2000)
Müller, M., Kurth, F.: Enhancing Similarity Matrices for Music Audio Analysis. In: Proc. ICASSP, vol. 5, pp. 9–12 (2006)
Müller, M., Kurth, F., Clausen, M.: Chroma-Based Statistical Audio Features for Audio Matching. In: Proc. IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, pp. 275–278 (2005)
Peeters, G., Burthe, A.L., Rodet, X.: Toward automatic music audio summary generation from signal analysis. In: Proc. 3rd ISMIR, pp. 94–100 (2002)
Scheirer, E.: Tempo and beat analysis of acoustic musical signals. Journal of the Acoustic Society of America 103(1), 588–601 (1998)
Schuller, B., Eyben, F., Rigoll, G.: Fast and Robust Meter and Tempo Recognition for the Automatic Discrimination of Ballroom Dance Styles. In: Proc. ICASSP, vol. 1, pp. 217–220 (2007)
Schuller, B., Eyben, F., Rigoll, G.: Beat-synchronous data-driven automatic chord labeling. In: Proc. DAGA 2008, Dresden, Germany, pp. 555–556. DEGA (2008)
Schuller, B., Zobl, M., Rigoll, G., Lang, M.: A Hybrid Music Retrieval System using Belief Networks to Integrate Queries and Contextual Knowledge. In: Proc. ICME, vol. 1, pp. 57–60 (2003)
Stober, S., Nürnberger, A.: Towards user-adaptive structuring and organization of music collections. In: Proc. 6th Workshop on Adaptive Multimedia Retrieval (AMR 2008), Berlin, Germany (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schuller, B., Dibiasi, F., Eyben, F., Rigoll, G. (2010). Music Thumbnailing Incorporating Harmony- and Rhythm Structure. In: Detyniecki, M., Leiner, U., Nürnberger, A. (eds) Adaptive Multimedia Retrieval. Identifying, Summarizing, and Recommending Image and Music. AMR 2008. Lecture Notes in Computer Science, vol 5811. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-14758-6_7
Download citation
DOI: https://doi.org/10.1007/978-3-642-14758-6_7
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-14757-9
Online ISBN: 978-3-642-14758-6
eBook Packages: Computer ScienceComputer Science (R0)