Pattern Recognition with Rejection

Combining Standard Classification Methods with Geometrical Rejecting
  • Wladyslaw Homenda
  • Agnieszka Jastrzebska
  • Piotr Waszkiewicz
  • Anna Zawadzka
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9842)


The motivation of our study is to provide algorithmic appro-aches to distinguish proper patterns, from garbage and erroneous patterns in a pattern recognition problem. The design assumption is to provide methods based on proper patterns only. In this way the approach that we propose is truly versatile and it can be adapted to any pattern recognition problem in an uncertain environment, where garbage patterns may appear. The proposed attempt to recognition with rejection combines known classifiers with geometric methods used for separating native patterns from foreign ones. Empirical verification has been conducted on datasets of handwritten digits classification (native patterns) and handwritten letters of Latin alphabet (foreign patterns).


Pattern recognition Classification Rejecting option Geometrical methods 



The research is partially supported by the National Science Center, grant No. 2012/07/B/ST6/01501, decision No. DEC-2012/07/B/ST6/01501.


  1. 1.
    Altman, N.S.: An introduction to kernel and nearest-neighbor nonparametric regression. Am. Stat. 46(3), 175–185 (1992)MathSciNetGoogle Scholar
  2. 2.
    Bertolami, R., Zimmermann, M., Bunke, H.: Rejection strategies for offline handwritten text line recognition. Pattern Recogn. Lett. 27(16), 2005–2012 (2006)CrossRefGoogle Scholar
  3. 3.
    Breiman, L.: Random forests. Mach. Learn. 45(1), 5–32 (2001)CrossRefGoogle Scholar
  4. 4.
    Burger, T., Kessentini, Y., Paquet, T.: Dempster-Shafer based rejection strategy for handwritten word recognition. In: Proceedings of the International Conference on Document Analysis and Recognition, pp. 528–532 (2011)Google Scholar
  5. 5.
    Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)zbMATHGoogle Scholar
  6. 6.
    Elad, M., Hel-Or, Y., Keshet, R.: Pattern detection using a maximal rejection classifier. In: Arcelli, C., Cordella, L.P., Sanniti di Baja, G. (eds.) IWVF 2001. LNCS, vol. 2059, pp. 514–524. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  7. 7.
    Hempstalk, K., Frank, E., Witten, I.H.: One-class classification by combining density and class probability estimation. In: Daelemans, W., Goethals, B., Morik, K. (eds.) ECML PKDD 2008, Part I. LNCS (LNAI), vol. 5211, pp. 505–519. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  8. 8.
    Homenda, W., Jastrzebska, A., Pedrycz, W.: Rejecting foreign elements in pattern recognition problem. Reinforced training of rejection level. In: Proceedings of ICAART 2015, pp. 90–99 (2015)Google Scholar
  9. 9.
    LeCun, Y., Cortes, C., Burges, C.: The MNIST database of handwritten digits.
  10. 10.
    Romanski, P., Kotthoff, L.: Package FSelector.
  11. 11.
    Scheme, E.J., Hudgins, B.S., Englehart, K.B.: Confidence-based rejection for improved pattern recognition myoelectric control. IEEE Trans. Biomed. Eng. 60(6), 1563–1570 (2013)CrossRefGoogle Scholar
  12. 12.
    Scholkopf, B., Williamson, R., Smola, A., Shawe-Taylort, J., Platt, J.: Support vector method for novelty detection. Adv. Neural Inf. Process. Syst. 12, 582–588 (1992)Google Scholar
  13. 13.
    Tax, D.M.J., Duin, R.P.W.: Growing a multi-class classifier with a reject option. Pattern Recogn. Lett. 29, 1565–1570 (2008)CrossRefGoogle Scholar
  14. 14.
    Todd, M.J., Yildirim, E.A.: On Khachiyan’s Algorithm for the Computation of Minimum Volume Enclosing Ellipsoids, 30 September 2005.
  15. 15.
    Wang, Y., Casasent, D.: A support vector hierarchical method for multi-class classification and rejection. In: Proceedings of International Joint Conference on Neural Networks, pp. 3281–3288 (2009)Google Scholar
  16. 16.
  17. 17.
  18. 18.

Copyright information

© IFIP International Federation for Information Processing 2016

Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 2.5 International License (, which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.

The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.

Authors and Affiliations

  • Wladyslaw Homenda
    • 1
    • 2
  • Agnieszka Jastrzebska
    • 2
  • Piotr Waszkiewicz
    • 2
  • Anna Zawadzka
    • 2
  1. 1.Faculty of Economics and Informatics in VilniusUniversity of BialystokVilniusLithuania
  2. 2.Faculty of Mathematics and Information ScienceWarsaw University of TechnologyWarsawPoland

Personalised recommendations