Evaluation of the Convolutional NMF for Supervised Polyphonic Music Transcription and Note Isolation

  • Stanislaw GorlowEmail author
  • Jordi Janer
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9237)


We evaluate the convolutive nonnegative matrix factorization in the context of automatic music transcription of polyphonic piano recordings and the associated problem of note isolation. Our intention is to find out whether the temporal continuity of piano notes is truthfully captured by the convolutional kernels and how the performance scales with complexity. Systematic studies of this kind are lacking in existing literature. We make use of established measures of accuracy and similarity. NMF dictionaries covering the piano’s pitch range are learned from a given sample bank of isolated notes. The kernel alias patch size is varied. By using a measure of performance advantage, we show up that the improvements due to convolved bases do not justify the extra computational effort as compared to the standard NMF. In particular, this is true for the more realistic case, in which the dictionary does not fully correspond to the mixture signal. Further pertinent conclusions are drawn as well.


Nonnegative matrix factorization Convolution Supervised learning Polyphony Automatic music transcription Note separation 


  1. 1.
    Lee, D.D., Seung, H.S.: Learning the parts of objects by non-negative matrix factorization. Nature 401(6755), 788–791 (1999)CrossRefGoogle Scholar
  2. 2.
    Smaragdis, P., Brown, J.C.: Non-negative matrix factorization for polyphonic music transcription. In: Proceedings of the WASPAA 2003, pp. 177–180, October 2003Google Scholar
  3. 3.
    Abdallah, S.A., Plumbley, M.D.: “Polyphonic music transcription by non-negative sparse coding of power spectra. In: Proceedings of the ISMIR 2004, pp. 318–325, October 2004Google Scholar
  4. 4.
    Smaragdis, P.: Non-negative matrix factor deconvolution; extraction of multiple sound sources from monophonic inputs. In: Puntonet, C.G., Prieto, A.G. (eds.) ICA 2004. LNCS, vol. 3195, pp. 494–499. Springer, Heidelberg (2004) CrossRefGoogle Scholar
  5. 5.
    Smaragdis, P.: Convolutive speech bases and their application to supervised speech separation. IEEE Audio, Speech, Lang. Process. 15(1), 1–12 (2007)CrossRefGoogle Scholar
  6. 6.
    Huber, R., Kollmeier, B.: PEMO-Q – a new method for objective audio quality assessment using a model of auditory perception. IEEE Audio, Speech, Lang. Process. 14(6), 1902–1911 (2006)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Music Technology GroupUniversitat Pompeu FabraBarcelonaSpain

Personalised recommendations