Biomedical Images Classification by Universal Nearest Neighbours Classifier Using Posterior Probability

  • Roberto D’Ambrosio
  • Wafa Bel Haj Ali
  • Richard Nock
  • Paolo Soda
  • Frank Nielsen
  • Michel Barlaud
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7588)


Universal Nearest Neighbours (unn) is a classifier recently proposed, which can also effectively estimates the posterior probability of each classification act. This algorithm, intrinsically binary, requires the use of a decomposition method to cope with multiclass problems, thus reducing their complexity in less complex binary subtasks. Then, a reconstruction rule provides the final classification. In this paper we show that the application of unn algorithm in conjunction with a reconstruction rule based on the posterior probabilities provides a classification scheme robust among different biomedical image datasets. To this aim, we compare unn performance with those achieved by Support Vector Machine with two different kernels and by a k Nearest Neighbours classifier, and applying two different reconstruction rules for each of the aforementioned classification paradigms. The results on one private and five public biomedical datasets show satisfactory performance.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Piro, P., Nock, R., Nielsen, F., Barlaud, M.: Leveraging k-nn for generic classification boosting. Neurocomputing 80, 3–9 (2012)CrossRefGoogle Scholar
  2. 2.
    Allwein, E.L., et al.: Reducing multiclass to binary: a unifying approach for margin classifiers. Journal of Machine Learning Research 1, 113–141 (2001)MathSciNetMATHGoogle Scholar
  3. 3.
    Dietterich, T.G., Bakiri, G.: Solving multiclass learning problems via error-correcting output codes. Journal of Artificial Intelligence Research 2, 263 (1995)MATHGoogle Scholar
  4. 4.
    Iannelo, G., et al.: On the use of classification reliability for improving performance of the one-per-class decomposition method. DKE 68, 1398–1410 (2009)CrossRefGoogle Scholar
  5. 5.
    D’Ambrosio, R., Nock, R., Bel Haj Ali, W., Nielsen, F., Barlaud, M.: Boosting Nearest Neighbors for the Efficient Estimation of Posteriors (April 2012)Google Scholar
  6. 6.
    Schapire, R.E., Singer, Y.: Improved boosting algorithms using confidence-rated predictions. Machine Learning Journal 37, 297–336 (1999)MATHCrossRefGoogle Scholar
  7. 7.
    Nock, R., Nielsen, F.: On the efficient minimization of classification-calibrated surrogates. In: NIPS*21, pp. 1201–1208 (2008)Google Scholar
  8. 8.
    Nock, R., Nielsen, F.: Bregman divergences and surrogates for learning. IEEE Trans. on Pattern Analysis and Machine Intelligence 31(11), 2048–2059 (2009)CrossRefGoogle Scholar
  9. 9.
    Bartlett, P., Jordan, M., McAuliffe, J.D.: Convexity, classification, and risk bounds. Journal of the Am. Stat. Assoc. 101, 138–156 (2006)MathSciNetMATHCrossRefGoogle Scholar
  10. 10.
    Bel Haj Ali, W., et al.: A bio-inspired learning and classification method for subcellular localization of a plasma membrane protein. In: VISAPP 2012 (2012)Google Scholar
  11. 11.
    Frank, A., Asuncion, A.: UCI machine learning repository (2010)Google Scholar
  12. 12.
    Rigon, A., et al.: Indirect immunofluorescence in autoimmune diseases: Assessment of digital images for diagnostic purpose. Cytometry Part B: Clin. Cytometry 72B(6), 472–477Google Scholar
  13. 13.
    Platt, J.-C.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Advances in Large Margin Classifiers, pp. 61–74. MIT Press (1999)Google Scholar
  14. 14.
    Cordella, L.P., et al.: Reliability parameters to improve combination strategies in multi-expert systems. Pattern Analysis & Applications 2(3), 205–214 (1999)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Roberto D’Ambrosio
    • 1
    • 3
  • Wafa Bel Haj Ali
    • 3
  • Richard Nock
    • 2
  • Paolo Soda
    • 1
  • Frank Nielsen
    • 4
  • Michel Barlaud
    • 3
    • 5
  1. 1.Universita’ Campus Bio-Medico di RomaRomeItaly
  2. 2.CEREGMIA - Université Antilles-GuyaneMartiniqueFrance
  3. 3.CNRS - U.NiceFrance
  4. 4.Sony Computer Science Laboratories, Inc.TokyoJapan
  5. 5.Institut Universitaire deFrance

Personalised recommendations