Abstract
In this paper a method for the recognition of handwritten Hindi numerals is presented. The paper is reporting the effectiveness of the proposed approach, which is utilizing the feature selection based on the Information theory measures. The Multilayer Perceptron (MLP) based classifier combination is used along with feature selection using two criterion functions: (i) Maximum relevance minimum redundancy and (ii) Conditional mutual information maximization. Conditional mutual information based feature selection when driving the ensemble of classifier produces improved recognition results for most of the benchmarking datasets. The improvement is also observed with maximum relevance minimum redundancy based feature selection when used in combination with ensemble of classifiers. The main contribution of the proposed method is that, the method gives quite efficient results utilizing only 10% patterns of the available dataset.
Similar content being viewed by others
References
Ahmadzadeh M, Petron M and Sasikala K 2000 The Depster-Shafer combination rule as a tool to classifier combination. Geoscience and Remote Sesing, IEEE International Symposium. Proc. IGARSS, (2429–2431)
Bagheri M, Montazar G and Kabir E 2013 A subspace approach to error-correcting output coding. Pattern Recog. Lett. 34: 176–184
Bajaj R, Dey L and Chaudhary S 2002 Devnagari numeral recognition by combining decision of multiple connectionist classifiers. Sadhana 27: 59–72
Bhattacharya U and Choudhary B B 2009 Handwritten numeral databases of Indian scripts and multistage recognition of mixed numerals. IEEE Trans. Pattern Anal. Mach. Intell. 31(3): 444–457
Cordella L, De Stefano C, Fontanella F and Marrocco C 2008 A feature selection algorithm for handwritten character recognition. 19th International Conference on Pattern Recognition, (1–4)
Dash M and Liu H 1997 Feature selection for classification. Intell. Data Anal. 1: 131–156
Dongre V J and Mankar V H 2012 Development of comprehensive devnagari numeral and character database for offline handwritten character recognition. Applied Computational Intelligence and Soft Computing 2012: 1–5
Duch W 2006 Filter Methods, in Feature Extraction: Foundations and Applications. Springer-Verlag New York, Inc. Secaucus, NJ, USA: Studies in Fuzziness & Soft Computing, chapter 3, pp. 89–117
Fleuret F 2004 Fast binary feature selection with conditional mutual information. J. Mach. Learn. Res. 5: 1531–1555
Hanmandlu M and Murthy O 2007 Fuzzy model based recognition of handwritten numerals. Pattern Recog. 40: 1840–1854
Kittler J, Hatef M and Duin R W 1998 On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20 (3): 226–239
Kohavi R and John G H 1997 Wrappers for feature subset selection. Artif. Intell. 97(1–2): 273–324
Kumar R, Kumar A and Ahmed P 2013 A benchmark dataset for devnagari document recognition research. Recent advances in telecommunications, signals and systems, (258–263)
Kuncheva L I, Bezdek J C and Duin R 2001 Decision template for multiple classifier fusion: An experimental comparision. Pattern Recog. 34: 299–314
Pal U, Wakabayashi T, Sharma N and Kimura F 2007 Handwritten Numeral Recognition of Six Popular Indian Scripts. Ninth International Conference on Document Analysis and Recognition, (749–753) Parana
Peng H, Long F and Ding C 2005 Feature selection based on mutual information: Criteria of maxdependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27(8): 1226–1238
Polikar R 2006 Ensemble based systems in decision making. Circuits Syst. Mag. 6(3): 21–45
Shannon C and Weaver W 1949 The mathematical theory of communication. Urbana, IL: University of Illinois Press
Stefano C D, Fontanella F, Marrocco C and Scotto di Freca A 2014 A GA-based feature selection approach with an application to handwritten character recognition. Pattern Recog. Lett. 35: 130–141
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
SINGH, P., VERMA, A. & CHAUDHARI, N.S. Feature selection based classifier combination approach for handwritten Devanagari numeral recognition. Sadhana 40, 1701–1714 (2015). https://doi.org/10.1007/s12046-015-0419-x
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12046-015-0419-x