Classification with Reject Option Using the Self-Organizing Map

  • Ricardo Sousa
  • Ajalmar R. da Rocha Neto
  • Jaime S. Cardoso
  • Guilherme A. Barreto
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8681)


Reject option is a technique used to improve classifier’s reliability in decision support systems. It consists on withholding the automatic classification of an item, if the decision is considered not sufficiently reliable. The rejected item is then handled by a different classifier or by a human expert. The vast majority of the works on this issue have been concerned with implementing a reject option by endowing a supervised learning scheme (e.g., Multilayer Perceptron, Learning Vector Quantization or Support Vector Machines) with a reject mechanism. In this paper we introduce variants of the Self-Organizing Map (SOM), originally an unsupervised learning scheme, to act as supervised classifiers with reject option, and compare their performances with that of the MLP classifier.


Self-Organizing Maps Reject Option Robust Classification Prototype-based Classifiers Neuron Labeling 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Thomas, L.C., Edelman, D.B., Crook, J.N.: Credit Scoring and Its Applications, 1st edn. SIAM (2002)Google Scholar
  2. 2.
    Han, J., Gao, J.: Research challenges for data mining in science and engineering. In: Kargupta, H., Han, J., Yu, P.S., Motwani, R., Kumar, V. (eds.) Next Generation of Data Mining, pp. 1–18. Chapman & Hall / CRC Press (2009)Google Scholar
  3. 3.
    El-Yaniv, R., Wiener, Y.: On the foundations of noise-free selective classification. Journal of Machine Learning Research 11, 1605–1641 (2010)zbMATHMathSciNetGoogle Scholar
  4. 4.
    Chow, C.: On optimum recognition error and reject tradeoff. IEEE Transactions on Information Theory 16(1), 41–46 (1970)CrossRefzbMATHGoogle Scholar
  5. 5.
    Ishibuchi, H., Nii, M.: Neural networks for soft decision making. Fuzzy Sets and Systems 34(115), 121–140 (2000)CrossRefGoogle Scholar
  6. 6.
    Sousa, R., da Rocha Neto, A.R., Barreto, G.A., Cardoso, J.S., Coimbra, M.T.: Reject Option Paradigm for the Reduction of Support Vectors. In: ESANN (accepted 2014)Google Scholar
  7. 7.
    Sousa, R., Cardoso, J.S.: The Data Replication Method for the Classification with Reject Option. AI Communications 26, 281–302 (2013)MathSciNetGoogle Scholar
  8. 8.
    Kohonen, T.: The self-organizing map. Proceedings of the IEEE 78(9), 1464–1480 (1990)CrossRefGoogle Scholar
  9. 9.
    van Hulle, M.: Self-organizing maps. In: Rozenberg, G., Baeck, T., Kok, J. (eds.) Handbook of Natural Computing: Theory, Experiments, and Applications, pp. 1–45. Springer (2010)Google Scholar
  10. 10.
    Yin, H.: The self-organizing maps: Background, theories, extensions and applications. In: Jain, L.C., Fulcher, J. (eds.) Computational Intelligence: A Compendium. SCI, vol. 115, pp. 715–762. Springer, Heidelberg (2008)Google Scholar
  11. 11.
    Mattos, C.L.C., Barreto, G.A.: ARTIE and MUSCLE models: building ensemble classifiers from fuzzy ART and SOM networks. Neural Computing & Applications (2012)Google Scholar
  12. 12.
    Kohonen, T.: The ’neural’ phonetic typewriter. Computer 21(3), 11–22 (1988)CrossRefGoogle Scholar
  13. 13.
    Kohonen, T.: Self-Organizing Maps, 3rd edn. Springer (2001)Google Scholar
  14. 14.
    de Bodt, E., Cottrell, M., Letremy, P., Verleysen, M.: On the use of self-organizing maps to accelerate vector quantization. Neurocomputing 56, 187–203 (2004)CrossRefGoogle Scholar
  15. 15.
    Malone, J., McGarry, K., Wermter, S., Bowerman, C.: Data mining using rule extraction from Kohonen self-organising maps. Neural Computing and Applications 15, 9–17 (2005)CrossRefGoogle Scholar
  16. 16.
    Fritzke, B.: A growing neural gas network learns topologies. In: Advances in Neural Information Processing Systems, vol. 7, pp. 625–632. MIT Press, Cambridge (1995)Google Scholar
  17. 17.
    Berglund, E., Sitte, J.: Parameterless self-organizing map algorithm. IEEE Transactions on Neural Networks 17(2), 305–316 (2006)CrossRefGoogle Scholar
  18. 18.
    Yin, H., Allinson, N.M.: Self-organizing mixture networks for probability density estimation. IEEE Transactions on Neural Networks 12(2), 405–411 (2001)CrossRefGoogle Scholar
  19. 19.
    Alhoniemi, E., Himberg, J., Vesanto, J.: Probabilistic measures for responses of self-organizing map units. In: International ICSC Congress on Computational Intelligence Methods and Applications CIMA, pp. 286–290. ICSC Academic Press (1999)Google Scholar
  20. 20.
    Holmström, L., Hämäläinen, A.: The self-organizing reduced kernel density estimator. In: Proceedings of the 1993 IEEE International Conference on Neural Networks (ICNN 1993), pp. 417–421 (1993)Google Scholar
  21. 21.
    Cardoso, J.S., da Costa, J.F.P.: Learning to classify ordinal data: the data replication method. Journal of Machine Learning Research 8, 1393–1429 (2007)zbMATHGoogle Scholar
  22. 22.
    da Rocha Neto, A.R., Sousa, R., de Barreto, G.A., Cardoso, J.S.: Diagnostic of pathology on the vertebral column with embedded reject option. In: Vitrià, J., Sanches, J.M., Hernández, M. (eds.) IbPRIA 2011. LNCS, vol. 6669, pp. 588–595. Springer, Heidelberg (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Ricardo Sousa
    • 1
  • Ajalmar R. da Rocha Neto
    • 3
  • Jaime S. Cardoso
    • 4
  • Guilherme A. Barreto
    • 2
  1. 1.INEB - Instituto de Engenharia BiomédicaUniversidade PortoPortugal
  2. 2.Departamento Engenharia de TeleinformáticaUniversidade Federal do Ceará (UFC)Brazil
  3. 3.Departamento de TelemáticaInstituto Federal do Ceará (IFCE)Brazil
  4. 4.INESC Porto, FEUPUniversidade PortoPortugal

Personalised recommendations