Unsupervised Analysis and Generation of Audio Percussion Sequences
A system is presented that learns the structure of an audio recording of a rhythmical percussion fragment in an unsupervised manner and that synthesizes musical variations from it. The procedure consists of 1) segmentation, 2) symbolization (feature extraction, clustering, sequence structure analysis, temporal alignment), and 3) synthesis. The symbolization step yields a sequence of event classes. Simultaneously, representations are maintained that cluster the events into few or many classes. Based on the most regular clustering level, a tempo estimation procedure is used to preserve the metrical structure in the generated sequence. Employing variable length Markov chains, the final synthesis is performed, recombining the audio material derived from the sample itself. Representations with different numbers of classes are used to trade off statistical significance (short context sequence, low clustering refinement) versus specificity (long context, high clustering refinement) of the generated sequence. For a broad variety of musical styles the musical characteristics of the original are preserved. At the same time, considerable variability is introduced in the generated sequence.
Keywordsmusic analysis music generation unsupervised clustering Markov chains machine listening
Unable to display preview. Download preview PDF.
- 1.(December 2010), www.youtube.com/user/audiocontinuation
- 3.Cope, D.: Virtual Music: Computer Synthesis of Musical Style. MIT Press, Cambridge (2004)Google Scholar
- 5.Dubnov, S., Assayag, G., Cont, A.: Audio oracle: A new algorithm for fast learning of audio structures. In: Proceedings of International Computer Music Conference (ICMC), pp. 224–228 (2007)Google Scholar
- 7.Gillet, O., Richard, G.: Enst-drums: an extensive audio-visual database for drum signals processing. In: ISMIR, pp. 156–159 (2006)Google Scholar
- 9.Lartillot, O., Toiviainen, P., Eerola, T.: A matlab toolbox for music information retrieval. In: Annual Conference of the German Classification Society (2007)Google Scholar
- 10.Marchini, M.: Unsupervised Generation of Percussion Sequences from a Sound Example. Master’s thesis (2010)Google Scholar
- 11.Marchini, M., Purwins, H.: Unsupervised generation of percussion sound sequences from a sound example. In: Sound and Music Computing Conference (2010)Google Scholar
- 12.Marxer, R., Purwins, H.: Unsupervised incremental learning and prediction of audio signals. In: Proceedings of 20th International Symposium on Music Acoustics (2010)Google Scholar
- 13.Pachet, F.: The continuator: Musical interaction with style. In: Proceedings of ICMC, pp. 211–218. ICMA (2002)Google Scholar
- 14.Purwins, H., Holonowicz, P., Herrera, P.: Polynomial extrapolation for prediction of surprise based on loudness - a preliminary study. In: Sound and Music Computing Conference, Porto (2009)Google Scholar