Skip to main content

Advertisement

SpringerLink
Log in

A novel pattern recognition framework based on ensemble of handcrafted features on images

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Nowadays, with the advances and use of technological possibilities and devices, the number of digital images is increasing gradually. Computer-aided classification of image types is widely applied in many applications such as medicine, security, and automation. The feature extraction and selection stages have great importance in terms of improving the classification performance as sub-stages of the pattern recognition process. Researchers apply different feature extraction methods for their works due to the requirements. In this study, a novel pattern recognition framework combining diverse and large-scale handcrafted feature extraction methods (shape-based and texture-based) and the selection stage on images is developed. Genetic algorithms are also used for feature selection. In the experimental studies, Flavia leaf recognition, Caltech101 object classification image datasets, and five supervised classification models (random forest, ECOC-SVM, k-nearest neighbor, AdaBoost, classification tree) with different parameters’ values are used. The experimental results show that the proposed method achieves 98.39% and 82.77% accuracy rates on Flavia and Caltech101 datasets with the ECOC-SVM model, respectively. The proposed framework is also competitive with the existing state-of-the-art methods in the related literature.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Ahonen T, Hadid A, Pietikainen M (2006) Face description with local binary patterns: application to face recognition. IEEE Trans Pattern Anal Mach Intell 28(12):2037–2041

    Article  MATH  Google Scholar 

  2. ali Bagheri M, Montazer GA, Escalera S (2012) Error correcting output codes for multiclass classification: application to two image vision problems. In: Artificial Intelligence and Signal Processing (AISP), 2012 16th CSI International Symposium on. IEEE, pp 508–513

  3. Antipov G, Berrani S-A, Ruchaud N, Dugelay J-L (2015) Learned vs. hand-crafted features for pedestrian gender recognition. In: Proceedings of the 23rd ACM international conference on Multimedia. ACM, pp 1263–1266

  4. Bansal M, Kumar M, Kumar M (2021) 2d object recognition: a comparative analysis of sift, surf and orb feature descriptors. Multimed Tools Appl:1–19

  5. Barczak Andre LC, Gilman A, Reyes NH, Susnjak T (2011) Analysis of feature invariance and discrimination for hand images: Fourier descriptors versus moment invariants. In: International conference image and vision computing New Zealand IVCNZ2011

  6. Bosch A, Zisserman A, Munoz X (2007) Image classification using random forests and ferns. In: 2007 IEEE 11th International Conference on Computer Vision, pp 1–8

  7. Breiman L (2001) Random forests. Mach Learn 45(1):5–32

    Article  MATH  Google Scholar 

  8. Busuttil S, Abela J, Pace GJ (2004) Support vector machines with profile-based kernels for remote protein homology detection. Genome Inform 15(2):191–200

    Google Scholar 

  9. Caltech (2018) Caltech101. http://www.vision.caltech.edu/Image_Datasets/Caltech101. Accessed 5 March 2021

  10. Chang C, Liu W, Zhang H (2001) Image retrieval based on region shape similarity. In: Storage and retrieval for media databases 2001, vol 4315. International Society for Optics and Photonics, pp 31–39

  11. Dalal N, Triggs B (2005) Histograms of oriented gradients for human detection. In: Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, vol 1. IEEE, pp 886–893

  12. Dash M, Liu H (1997) Feature selection for classification. Intell Data Anal 1(1):131–156. https://doi.org/10.1016/S1088-467X(97)00008-5, http://www.sciencedirect.com/science/article/pii/S1088467X97000085

    Article  Google Scholar 

  13. Ehsanirad A (2010) Plant classification based on leaf recognition. Int J Comput Sci Inf Secur 8(4):78–81

    Google Scholar 

  14. Eid HF, Hassanien AE, Kim T-H (2015) Leaf plant identification system based on hidden naïve bays classifier. In: 2015 4th International Conference on Advanced Information Technology and Sensor Application (AITS). IEEE, pp 76–79

  15. Fawcett T (2006) An introduction to roc analysis. Pattern Recogn Lett 27(8):861–874

    Article  MathSciNet  Google Scholar 

  16. Fei-Fei L, Fergus R, Perona P (2006) One-shot learning of object categories. IEEE Trans Pattern Anal Mach Intell 28(4):594–611

    Article  Google Scholar 

  17. Guo G, Wang H, Bell D, Bi Y, Greer K (2003) Knn model-based approach in classification. In: OTM confederated international conferences” On the move to meaningful internet systems”. Springer, pp 986–996

  18. Gupta S, Roy PP, Dogra DP, Kim B-G (2020) Retrieval of colour and texture images using local directional peak valley binary pattern. Pattern Anal Applic 23(4):1569–1585

    Article  Google Scholar 

  19. Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Machine Learn Res 3:1157–1182

    MATH  Google Scholar 

  20. Haralick RM, Shanmugam K, et al. (1973) Textural features for image classification. IEEE Trans Syst Man Cybern (6)610–621

  21. Hossain J, Amin MA (2010) Leaf shape identification based plant biometrics. In: Computer and Information Technology (ICCIT), 2010 13th International Conference on. IEEE, pp 458–463

  22. Hu M-K (1962) Visual pattern recognition by moment invariants. IRE Trans Inf Theory 8(2):179–187

    Article  MATH  Google Scholar 

  23. Hwang W, Kim J (2018) Example image-based feature extraction for face recognition. Multimed Tools Appl 77(18):23429–23447

    Article  Google Scholar 

  24. Jain AK, Duin RPW, Mao J (2000) Statistical pattern recognition: a review. IEEE Trans Pattern Anal Mach Intell 22(1):4–37

    Article  Google Scholar 

  25. Jeong D, Kim B-G, Dong S-Y (2020) Deep joint spatiotemporal network (djstn) for efficient facial expression recognition. Sensors 20(7):1936

    Article  Google Scholar 

  26. Jović A, Brkić K, Bogunović N (2015) A review of feature selection methods with applications. In: 2015 38th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), pp 1200–1205

  27. Kabbai L, Abdellaoui M, Douik A (2018) Image classification by combining local and global features. Vis Comput. https://doi.org/10.1007/s00371-018-1503-0

  28. Kadir A, Nugroho LE, Susanto A, Santosa PI (2013) Leaf classification using shape, color, and texture features. arXiv:1401.4447

  29. Khan R, Barat C, Muselet D, Ducottet C (2015) Spatial histograms of soft pairwise similar patches to improve the bag-of-visual-words model. Comput Vis Image Underst 132:102–112

    Article  Google Scholar 

  30. Kim J-H, Hong G-S, Kim B-G, Dogra DP (2018) deepgesture: Deep learning-based gesture recognition scheme using motion sensors. Displays 55:38–45

    Article  Google Scholar 

  31. Kim J-H, Kim B-G, Roy PP, Jeong D-M (2019) Efficient facial expression recognition algorithm based on hierarchical deep neural network structure. IEEE Access 7:41273–41285

    Article  Google Scholar 

  32. Kumar PSVVSR, Rao KNV, Raju ASN, Kumar DJN (2016) Leaf classification based on shape and edge feature with k-nn classifier. In: Contemporary Computing and Informatics (IC3I), 2016 2nd International Conference on. IEEE, pp 548–552

  33. Lazebnik S, Schmid C, Ponce J (2006) Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories. In: Computer vision and pattern recognition, 2006 IEEE computer society conference on, vol 2. IEEE, pp 2169–2178

  34. Li X, Wang L, Sung E (2008) Adaboost with svm-based component classifiers. Eng Appl Artif Intell 21(5):785–795

    Article  Google Scholar 

  35. Liao SX, Pawlak M (1998) On the accuracy of zernike moments for image analysis. IEEE Trans Pattern Anal Mach Intell 20(12):1358–1364

    Article  Google Scholar 

  36. Liu H, Yu L (2005) Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17(4):491–502. https://doi.org/10.1109/TKDE.2005.66

    Article  MathSciNet  Google Scholar 

  37. Loh W-Y (2011) Classification and regression trees. Wiley Interdiscip Rev Data Min Knowl Discov 1(1):14–23

    Article  Google Scholar 

  38. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  39. Mansourian L, Abdullah MT, Abdullah LN, Azman A, Mustaffa MR (2017) An effective fusion model for image retrieval. Multimed Tools Appl:1–24

  40. Materka A, Strzelecki M, et al (1998) Texture analysis methods–a review. Technical University of Lodz, Institute of Electronics, COST B11 report, Brussels, pp 9–11

  41. Mathworks (2018) Dct2. https://www.mathworks.com/help/images/ref/dct2.html. Accessed 5 March 2021

  42. Mathworks (2018) Measure properties of image regions. https://www.mathworks.com/help/images/ref/regionprops.html. Accessed 5 March 2021

  43. Mingqiang Y, Kidiyo K, Joseph R (2008) A survey of shape feature extraction techniques. INTECH Open Access Publisher. https://books.google.com.tr/books?id=BDDzoAEACAAJ

  44. Mukherjee S, Kumar P, Saini R, Roy PP, Dogra DP, Kim B-G (2017) Plant disease identification using deep neural networks. J Multimed Inf Syst 4(4):233–238

    Google Scholar 

  45. Munisami T, Ramsurn M, Kishnah S, Pudaruth S (2015) Plant leaf recognition using shape features and colour histogram with k-nearest neighbour classifiers. Procedia Comput Sci 58:740–747

    Article  Google Scholar 

  46. Mutch J, Lowe DG (2006) Multiclass object recognition with sparse, localized features. In: Computer vision and pattern recognition, 2006 IEEE computer society conference on, vol 1. IEEE, pp 11–18

  47. Nanni L, Ghidoni S, Brahnam S (2017) Handcrafted vs. non-handcrafted features for computer vision classification. Pattern Recogn 71:158–172

    Article  Google Scholar 

  48. Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66. https://doi.org/10.1109/TSMC.1979.4310076

    Article  Google Scholar 

  49. Pankaja K, Suma V (2020) Plant leaf recognition and classification based on the whale optimization algorithm (woa) and random forest (rf). J Instit Eng (India): Ser B 101(5):597–607

    Google Scholar 

  50. Prasad S, Kumar PS, Ghosh D (2017) An efficient low vision plant leaf shape identification system for smart phones. Multimed Tools Appl 76(5):6915–6939

    Article  Google Scholar 

  51. Pyactlearn (2018) Multi-class performance metrics. http://pyactlearn.readthedocs.io/en/latest/performance/multiclass.html. Accessed 5 March 2021

  52. Rahman MM, Rahman S, Rahman R, Hossain BMM, Shoyaib M (2017) Dtcth: a discriminative local pattern descriptor for image classification. EURASIP J Image Video Process 2017(1):30. https://doi.org/10.1186/s13640-017-0178-1

    Article  Google Scholar 

  53. Raji IK, Thyagharajan KK (2016) Identifying herbal leaves using shape context with ant colony and bipartite matching. Int J Telemed Clin Pract 1(3):265–276

    Article  Google Scholar 

  54. Ramesh B, Xiang C, Lee TH (2017) Multiple object cues for high performance vector quantization. Pattern Recogn 67:380–395. https://doi.org/10.1016/j.patcog.2017.02.024, http://www.sciencedirect.com/science/article/pii/S0031320317300882

    Article  Google Scholar 

  55. Sargano AB, Angelov P, Habib Z (2017) A comprehensive review on handcrafted and learning-based action representation approaches for human activity recognition. Appl Sci 7(1):110

    Article  Google Scholar 

  56. Satpathy A, Jiang X, Eng H-L (2014) Lbp-based edge-texture features for object recognition. IEEE Trans Image Process 23(5):1953–1964

    Article  MathSciNet  MATH  Google Scholar 

  57. Satti V, Satya A, Sharma S (2013) An automatic leaf recognition system for plant identification using machine vision technology. Int J Eng Sci Technol 5(4):874

    Google Scholar 

  58. Singh BK, Verma K, Thoke AS (2015) Investigations on impact of feature normalization techniques on classifier’s performance in breast tumor classification. Int J Comput Appl 116(19)

  59. Soh L-K, Tsatsoulis C (1999) Texture analysis of sar sea ice imagery using gray level co-occurrence matrices. IEEE Trans Geosci Remote Sens 37(2):780–795

    Article  Google Scholar 

  60. Sokolova M, Lapalme G (2009) A systematic analysis of performance measures for classification tasks. Inf Process Manag 45(4):427–437

    Article  Google Scholar 

  61. Srinivas M, Patnaik LM (1994) Genetic algorithms: a survey. Computer 27(6):17–26

    Article  Google Scholar 

  62. Tahmasbi A, Saki F, Shokouhi SB (2011) Classification of benign and malignant masses based on zernike moments. Comput Biol Med 41(8):726–735

    Article  Google Scholar 

  63. Tang J, Alelyani S, Liu H (2014) Feature selection for classification: A review. Data Classif Algorithm Appl:37

  64. Taşcı E, Uğur A (2015) Shape and texture based novel features for automated juxtapleural nodule detection in lung cts. J Med Syst 39(5):46

    Article  Google Scholar 

  65. Teague MR (1980) Image analysis via the general theory of moments. JOSA 70(8):920–930

    Article  MathSciNet  Google Scholar 

  66. Teh C-H, Chin RT (1988) On image analysis by the methods of moments. IEEE Trans Pattern Anal Mach Intell 10(4):496–513

    Article  MATH  Google Scholar 

  67. Uluturk C, Ugur A (2012) Recognition of leaves based on morphological features derived from two half-regions. In: Innovations in intelligent systems and applications (INISTA), 2012 international symposium on. IEEE, pp 1–4

  68. Wang X, Bai X, Liu W, Latecki LJ (2011) Feature context for image classification and object detection. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp 961–968

  69. Watanabe S (1985) Pattern recognition: human and mechanical. Wiley

  70. Wu SG, Bao FS, Xu EY, Wang Y-X, Chang Y-F, Xiang Q-L (2007) Flavia. http://flavia.sourceforge.net

  71. Wu SG, Bao FS, Xu EY, Wang Y-X, Chang Y-F, Xiang Q-L (2007) A leaf recognition algorithm for plant classification using probabilistic neural network. In: Signal processing and information technology, 2007 IEEE international symposium on. IEEE, pp 11–16

  72. Xue B, Zhang M, Browne WN, Yao X (2016) A survey on evolutionary computation approaches to feature selection. IEEE Trans Evol Comput 20(4):606–626. https://doi.org/10.1109/TEVC.2015.2504420

    Article  Google Scholar 

  73. Yousefi E, Baleghi Y, Sakhaei SM (2017) Rotation invariant wavelet descriptors, a new set of features to enhance plant leaves classification. Comput Electron Agric 140:70–76

    Article  Google Scholar 

  74. Zhou J, Liu X, Liu W, Gan J (2019) Image retrieval based on effective feature extraction and diffusion process. Multimed Tools Appl 78(5):6163–6190

    Article  Google Scholar 

Download references

Acknowledgments

The author Erdal TASCI has been supported by the Scientific and Technological Research Council of Turkey (TUBITAK) 2211 National Graduate Scholarship Program.

Author information

Authors and Affiliations

  1. Computer Engineering Department, Ege University, Bornova, Turkey

    Erdal Tasci & Aybars Ugur

Authors
  1. Erdal Tasci
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Aybars Ugur
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Erdal Tasci.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tasci, E., Ugur, A. A novel pattern recognition framework based on ensemble of handcrafted features on images. Multimed Tools Appl 81, 30195–30218 (2022). https://doi.org/10.1007/s11042-022-12909-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12909-w

Keywords

Search

Navigation