Skip to main content
SpringerLink
Log in

MJCN: Multi-objective Jaya Convolutional Network for handwritten optical character recognition

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

In recent years, the non-handcrafted feature extraction methods have gained increasing popularity for solving pattern classification tasks due to their inherent ability to extract robust features and handle outliers. However, the design of such features demands a large set of training data. Meta-heuristic optimization schemes can facilitate feature learning even with a small amount of training data. This paper presents a new feature learning mechanism called multi-objective Jaya convolutional network (MJCN) that attempts to learn meaningful features directly from the images. The proposed scheme, unlike the convolutional neural networks, comprises a convolution layer, a multiplication layer, an activation layer and an optimizer known as multi-objective Jaya optimizer (MJO). The convolution layer searches meaningful patterns in an image through the local neighborhood connections and the multiplication layer projects the convolutional response to a more compact feature space. The weights used in these layers are initialized randomly and MJO is then introduced to optimize the weights. The main objective of MJO is to maximize the inter-class distance and minimize the intra-class variance. The feature vectors are finally derived using the optimized weights. The derived features are finally fed to a set of standard classifiers for recognition of characters. The performance of the proposed model is evaluated on various benchmark datasets, namely, NITR Odia handwritten character, ISI Kolkata Odia numeral, ISI Kolkata Bangla numeral, and MNIST as well as a newly developed dataset NITR Bangla numeral. The experimental results show that the proposed scheme outperforms other state-of-the-art approaches in terms of recognition accuracy.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Notes

  1. https://github.com/Dibyasundar/MJCN/blob/master/NITRKL%20Bangla.zip

References

  1. Bag S, Harit G (2013) A survey on optical character recognition for Bangla and Devanagari scripts. Sadhana 38(1):133–168

    Article  Google Scholar 

  2. Basu S, Das N, Sarkar R, Kundu M, Nasipuri M, Basu DK (2010) A novel framework for automatic sorting of postal documents with multi-script address blocks. Pattern Recogn 43(10):3507–3521

    Article  Google Scholar 

  3. Bhalerao M, Bonde S, Nandedkar A, Pilawan S (2018) Combined classifier approach for offline handwritten Devanagari character recognition using multiple features. In: Computational vision and bio inspired computing. Springer, pp 45–54

  4. Bhattacharya U, Chaudhuri B (2005) Databases for research on recognition of handwritten characters of indian scripts. In: Document analysis and recognition, 2005. Proceedings. Eighth International Conference on. IEEE, pp 789–793

  5. Bhattacharya U, Chaudhuri BB (2009) Handwritten numeral databases of indian scripts and multistage recognition of mixed numerals. IEEE Trans Pattern Anal Mach Intell 31(3):444–457

    Article  Google Scholar 

  6. Bhowmik TK, Parui SK, Bhattacharya U, Shaw B (2006) An hmm based recognition scheme for handwritten Oriya numerals. In: International conference on information technology. IEEE, pp 105–110

  7. Cecotti H (2016) Deep random vector functional link network for handwritten character recognition. In: International Joint Conference on Neural Networks (IJCNN). IEEE, pp 3628–3633

  8. Cireşan DC, Meier U, Gambardella LM, Schmidhuber J (2010) Deep, big, simple neural nets for handwritten digit recognition. Neural Comput 22(12):3207–3220

    Article  Google Scholar 

  9. Das D, Nayak DR, Dash R, Majhi B (2019) An empirical evaluation of extreme learning machine: application to handwritten character recognition. Multimedia Tools and Applications, pp 1–29

  10. Das N, Sarkar R, Basu S, Saha PK, Kundu M, Nasipuri M (2015) Handwritten Bangla character recognition using a soft computing paradigm embedded in two pass approach. Pattern Recogn 48(6):2054–2071

    Article  Google Scholar 

  11. Dash KS, Puhan N, Panda G (2014) A hybrid feature and discriminant classifier for high accuracy handwritten Odia numeral recognition. In: IEEE Region 10 Symposium. IEEE, pp 531–535

  12. Dash KS, Puhan N, Panda G (2014) Non-redundant stockwell transform based feature extraction for handwritten digit recognition. In: International Conference on Signal Processing and Communications. IEEE, pp 1–4

  13. Dash KS, Puhan N, Panda G (2016) BESAC: Binary external symmetry axis constellation for unconstrained handwritten character recognition. Pattern RecognLett 83:413–422

    Article  Google Scholar 

  14. Dash KS, Puhan NB, Panda G (2016) Unconstrained handwritten digit recognition using perceptual shape primitives. Pattern Anal Applic, pp 1–24

  15. Dutta A, Chaudhury S (1993) Bengali alpha-numeric character recognition using curvature features. Pattern Recogn 26(12):1757–1770

    Article  Google Scholar 

  16. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on computer vision and pattern recognition, pp 770–778

  17. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708

  18. Kégl B, Busa-Fekete R (2009) Boosting products of base classifiers. In: Proceedings of the 26th Annual international conference on machine learning. ACM, pp 497–504

  19. Keysers D, Deselaers T, Gollan C, Ney H (2007) Deformation models for image recognition. IEEE Trans Pattern Anal Mach Intell 29(8):1422–1435

    Article  Google Scholar 

  20. Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Advances in neural information processing systems, pp 1097–1105

  21. Lecun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324

    Article  Google Scholar 

  22. LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324

    Article  Google Scholar 

  23. Liu CL, Suen CY (2009) A new benchmark on the recognition of handwritten Bangla and farsi numeral characters. Pattern Recogn 42(12):3287–3295

    Article  Google Scholar 

  24. Mahmoud SA, Al-Khatib WG (2011) Recognition of Arabic (Indian) bank check digits using Log-Gabor filters. Appl Intell 35(3):445–456

    Article  Google Scholar 

  25. Mahto MK, Kumari A, Panigrahi S (2011) A system for Oriya handwritten numeral recognition for indian postal automation. International Journal of Applied Science & Technology Research Excellence 1(1):17–23

    Google Scholar 

  26. Mishra S, Ray PK (2016) Power quality improvement using photovoltaic fed dstatcom based on jaya optimization. IEEE Transactions on Sustainable Energy 7(4):1672–1680

    Article  Google Scholar 

  27. Mishra TK, Majhi B, Dash R (2016) Shape descriptors-based generalised scheme for handwritten character recognition. International Journal of Computational Vision and Robotics 6(1-2):168–179

    Article  Google Scholar 

  28. Mishra TK, Majhi B, Panda S (2013) A comparative analysis of image transformations for handwritten Odia numeral recognition. In: International conference on advances in computing, communications and informatics. IEEE, pp 790–793

  29. Mishra TK, Majhi B, Sa PK, Panda S (2014) Model based Odia numeral recognition using fuzzy aggregated features. Frontiers of Computer Science 8(6):916–922

    Article  Google Scholar 

  30. Mohapatra RK, Majhi B, Jena SK (2015) Classification of handwritten Odia basic character using stockwell transform. Int J Appl Pattern Recogn 2 (3):235–254

    Article  Google Scholar 

  31. Mohapatra RK, Majhi B, Jena SK (2015) Classification performance analysis of mnist dataset utilizing a multi-resolution technique. In: International Conference on Computing, Communication and Security (ICCCS), 2015. IEEE, pp 1–5

  32. Mohapatra RK, Majhi B, Jena SK (2017) Two-stage classification approach for the recognition of handwritten atomic Odia character. Int J Appl Pattern Recogn 4(1):44–63

    Article  Google Scholar 

  33. Mohapatra RK, Mishra TK, Panda S, Majhi B (2015) OHCS: A database for handwritten atomic Odia character recognition. In: Fifth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG), 2015. IEEE, pp 1–4

  34. Nayak DR, Dash R, Majhi B (2018) Development of pathological brain detection system using Jaya optimized improved extreme learning machine and orthogonal ripplet-ii transform. Multimed Tools Appl 77(17):22705–22733

    Article  Google Scholar 

  35. Nayak DR, Zhang Y, Das DS, Panda S (2019) MJaya-ELM: A jaya algorithm with mutation and extreme learning machine based approach for sensorineural hearing loss detection. Appl Soft Comput 83:105626

    Article  Google Scholar 

  36. Nebti S, Boukerram A (2013) Handwritten characters recognition based on nature-inspired computing and neuro-evolution. Appl Intell 38(2):146–159

    Article  Google Scholar 

  37. Pal U, Belaïd A, Chaudhuri B (2003) A system for Bangla handwritten numeral recognition. In: International Conference on Knowledge Based Computer Systems-KBCS, pp 11–p

  38. Pal U, Chaudhuri B, Belaid A (2006) A complete system for Bangla handwritten numeral recognition. IETE J Res 52(1):27–34

    Article  Google Scholar 

  39. Pal U, Wakabayashi T, Kimura F (2007) A system for off-line Oriya handwritten character recognition using curvature feature. In: 10th International Conference on Information Technology. IEEE, pp 227–229

  40. Purkait P, Chanda B (2010) Off-line recognition of hand-written bengali numerals using morphological features. In: International Conference on Frontiers in Handwriting Recognition (ICFHR), 2010. IEEE, pp 363–368

  41. Rao R (2016) Jaya: A simple and new optimization algorithm for solving constrained and unconstrained optimization problems. Int J Ind Eng Comput 7(1):19–34

    Google Scholar 

  42. Roy K, Chaudhuri C, Pal U, Kundu M (2005) A study on the effect of varying training set sizes on recognition performance with handwritten Bangla numerals. In: INDICON, 2005 Annual IEEE. IEEE, pp 570–574

  43. Roy K, Pal T, Pal U, Kimura F (2005) Oriya handwritten numeral recognition system. In: Eighth international conference on document analysis and recognition. IEEE, pp 770–774

  44. Sampath A, Gomathi N (2017) Fuzzy-based multi-kernel spherical support vector machine for effective handwritten character recognition. Sādhanā 42 (9):1513–1525

    Article  MathSciNet  Google Scholar 

  45. Sarangi PK, Ahmed P, Ravulakollu KK (2014) Naïve bayes classifier with lu factorization for recognition of handwritten Odia numerals. Indian Journal of Science and Technology 7(1):35–38

    Article  Google Scholar 

  46. Sethy A, Patra PK, Nayak DR (2018) Off-line handwritten Odia character recognition using DWT and PCA. In: Progress in advanced computing and intelligent engineering. Springer, pp 187–195

  47. Sethy A, Patra PK, Nayak DR (2019) Gray-level co-occurrence matrix and random forest based off-line odia handwritten character recognition. Recent Patents on Engineering 13(2):136–141

    Article  Google Scholar 

  48. Tang J, Deng C, Huang GB (2015) Extreme learning machine for multilayer perceptron. IEEE Trans Neural Netw Learning Sys 27(4):809–821

    Article  MathSciNet  Google Scholar 

  49. Wen Y, He L (2012) A classifier for Bangla handwritten numeral recognition. Expert Syst Appl 39(1):948–953

    Article  Google Scholar 

  50. Wen Y, Lu Y, Shi P (2007) Handwritten Bangla numeral recognition system and its application to postal automation. Pattern Recogn 40(1):99–107

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Pattern Recognition Laboratory, Department of Computer Science and Engineering, National Institute of Technology, Rourkela, 769 008, India

    Dibyasundar Das, Deepak Ranjan Nayak, Ratnakar Dash & Banshidhar Majhi

Authors
  1. Dibyasundar Das
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Deepak Ranjan Nayak
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ratnakar Dash
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Banshidhar Majhi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Deepak Ranjan Nayak.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Das, D., Nayak, D.R., Dash, R. et al. MJCN: Multi-objective Jaya Convolutional Network for handwritten optical character recognition. Multimed Tools Appl 79, 33023–33042 (2020). https://doi.org/10.1007/s11042-020-09457-6

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-020-09457-6

Keywords

Search

Navigation