Patch Processing for Relational Learning Vector Quantization

  • Xibin Zhu
  • Frank-Michael Schleif
  • Barbara Hammer
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7367)


Recently, an extension of popular learning vector quantization (LVQ) to general dissimilarity data has been proposed, relational generalized LVQ (RGLVQ) [10,9]. An intuitive prototype based classification scheme results which can divide data characterized by pairwise dissimilarities into priorly given categories. However, the technique relies on the full dissimilarity matrix and, thus, has squared time complexity and linear space complexity. In this contribution, we propose an intuitive linear time and constant space approximation of RGLVQ by means of patch processing. An efficient heuristic which maintains the good classification accuracy and interpretability of RGLVQ results, as demonstrated in three examples from the biomdical domain.


Gaussian Mixture Model Vector Quantization Dissimilarity Matrix Learn Vector Quantization Stochastic Gradient Descent 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alex, N., Hasenfuss, A., Hammer, B.: Patch clustering for massive data sets. Neurocomputing 72(7-9), 1455–1469 (2009)CrossRefGoogle Scholar
  2. 2.
    Arlt, W., et al.: Urine steroid metabolomics as a biomarker tool for detecting malignancy in adrenal tumors. Journal of Clinical Endocrinology and Metabolism 96(12), 3775–3784 (2011)CrossRefGoogle Scholar
  3. 3.
    Barbuddhe, S.B., Maier, T., Schwarz, G., Kostrzewa, M., Hof, H., Domann, E., Chakraborty, T., Hain, T.: Rapid identification and typing of listeria species by matrix-assisted laser desorption ionization-time of flight mass spectrometry. Applied and Environmental Microbiology 74(17), 5402–5407 (2008)CrossRefGoogle Scholar
  4. 4.
    Boeckmann, B., Bairoch, A., Apweiler, R., Blatter, M.-C., Estreicher, A., Gasteiger, E., Martin, M., Michoud, K., O’Donovan, C., Phan, I., Pilbout, S., Schneider, M.: The swiss-prot protein knowledge base and its supplement trembl in 2003. Nucleic Acids Research 31, 365–370 (2003)CrossRefGoogle Scholar
  5. 5.
    Gasteiger, E., Gattiker, A., Hoogland, C., Ivanyi, I., Appel, R., Bairoch, A.: Expasy: the proteomics server for in-depth protein knowledge and analysis. Nucleic Acids Res. 31, 3784–3788 (2003)CrossRefGoogle Scholar
  6. 6.
    Gusfield, D.: Algorithms on Strings, Trees, and Sequences: Computer Science and Computational Biology. Cambridge University Press (1997)Google Scholar
  7. 7.
    Hammer, B.: Learning with Recurrent Neural Networks. LNCIS, vol. 254. Springer (2000)Google Scholar
  8. 8.
    Hammer, B., Hasenfuss, A.: Topographic mapping of large dissimilarity datasets. Neural Computation 22(9), 2229–2284 (2010)MathSciNetzbMATHCrossRefGoogle Scholar
  9. 9.
    Hammer, B., Mokbel, B., Schleif, F.-M., Zhu, X.: Prototype-Based Classification of Dissimilarity Data. In: Gama, J., Bradley, E., Hollmén, J. (eds.) IDA 2011. LNCS, vol. 7014, pp. 185–197. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  10. 10.
    Hammer, B., Mokbel, B., Schleif, F.-M., Zhu, X.: White Box Classification of Dissimilarity Data. In: Corchado, E., Snášel, V., Abraham, A., Woźniak, M., Graña, M., Cho, S.-B. (eds.) HAIS 2012, Part III. LNCS, vol. 7208, pp. 309–321. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  11. 11.
    Kohonen, T. (ed.): Self-Organizing Maps, 3rd edn. Springer-Verlag New York, Inc. (2001)Google Scholar
  12. 12.
    Kohonen, T., Somervuo, P.: How to make large self-organizing maps for nonvectorial data. Neural Networks 15, 945–952 (2002)CrossRefGoogle Scholar
  13. 13.
    Lundsteen, C., Phillip, J., Granum, E.: Quantitative analysis of 6985 digitized trypsin g-banded human metaphase chromosomes. Clinical Genetics 18, 355–370 (1980)CrossRefGoogle Scholar
  14. 14.
    Maier, T., Klebel, S., Renner, U., Kostrzewa, M.: Fast and reliable maldi-tof ms–based microorganism identification. Nature Methods (3) (2006)Google Scholar
  15. 15.
    Neuhaus, M., Bunke, H.: Edit distance based kernel functions for structural pattern classification. Pattern Recognition 39(10), 1852–1863 (2006)zbMATHCrossRefGoogle Scholar
  16. 16.
    Schleif, F.-M., Hammer, B., Kostrzewa, M., Villmann, T.: Exploration of mass-spectrometric data in clinical proteomics using learning vector quantization methods. Briefings in Bioinformatics 9(2), 129–143 (2008)Google Scholar
  17. 17.
    Schneider, P., Biehl, M., Hammer, B.: Adaptive relevance matrices in learning vector quantization. Neural Computation 21(12), 3532–3561 (2009)MathSciNetzbMATHCrossRefGoogle Scholar
  18. 18.
    Seo, S., Obermayer, K.: Soft learning vector quantization. Neural Computation 15, 1589–1604 (2002)CrossRefGoogle Scholar
  19. 19.
    Williams, C., Seeger, M.: Using the Nyström method to speed up kernel machines. In: Advances in Neural Information Processing Systems 13, pp. 682–688. MIT Press (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Xibin Zhu
    • 1
  • Frank-Michael Schleif
    • 1
  • Barbara Hammer
    • 1
  1. 1.CITEC centre of excellenceBielefeld UniversityBielefeldGermany

Personalised recommendations