Skip to main content
SpringerLink
Log in

Leaf recognition using convolutional neural networks based features

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

There is a warning light for the loss of plant habitats worldwide that entails concerted efforts to conserve plant biodiversity. Thus, plant species classification is crucial to address this environmental challenge. In recent years, there has been a considerable increase in studies related to plant taxonomy. While some researchers try to improve their recognition performance using novel approaches, others concentrate on computational optimization for their framework. In addition, a few studies are diving into feature extraction to gain significantly in terms of accuracy. This paper proposes an effective method for the leaf recognition problem. In our proposed approach, a leaf goes through some pre-processing to extract its refined color image, vein image, xy-projection histogram, handcrafted shape, texture features, and Fourier descriptors. These attributes are then transformed into a better representation by neural network-based encoders before a support vector machine (SVM) model is utilized to classify different leaves. Overall, our approach performs a state-of-the-art result on the Flavia leaf dataset, achieving the accuracy of 99.69% on test sets under random 10-fold cross-validation and bypassing the previous methods. Another important contribution is the trade-offs in classification performance while minimizing the feature categories used. In order to tackle this challenge, we designed several empirical experiments to analyze the performance of different combinations of feature sources and choose the best combination for features for the main problem. We also release our codes (Scripts are available at https://github.com/Tayerquach/flavia_recognition) for contributing to the research community in the leaf classification problem.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. This dataset is downloadable at http://flavia.sourceforge.net/

  2. http://flavia.sourceforge.net/

References

  1. Aakif A, Khan MF (2015) Automatic classification of plants based on their leaves. Biosyst Eng 139:66–75

    Article  Google Scholar 

  2. Ahmed N, Khan UG, Asif S (2016) An automatic leaf based plant identification system. Science International 28(1)

  3. Beghin T, Cope JS, Remagnino P, Barman S (2010) Shape and texture based plant leaf classification. In: International conference on advanced concepts for intelligent vision systems, Springer, pp 345–353

  4. Benčo M, Hudec R (2007) Novel method for color textures features extraction based on glcm. Radioengineering 16(4):65

    Google Scholar 

  5. Caglayan A, Guclu O, Can AB (2013) A plant recognition approach using shape and color features in leaf images. In: International conference on image analysis and processing, Springer, pp 161–170

  6. Eid HF, Hassanien AE, Kim TH (2015) Leaf plant identification system based on hidden naive bays classifier. In: 2015 4Th international conference on advanced information technology and sensor application (AITS), IEEE, pp 76–79

  7. Ghasab MAJ, Khamis S, Mohammad F, Fariman HJ (2015) Feature decision-making ant colony optimization system for an automated recognition of plant species. Expert Syst Appl 42(5):2361–2370

    Article  Google Scholar 

  8. Grinblat GL, Uzal LC, Larese MG, Granitto PM (2016) Deep learning for plant identification using vein morphological patterns. Comput Electron Agric 127:418–424. https://doi.org/10.1016/j.compag.2016.07.003

    Article  Google Scholar 

  9. Haralick RM, Shanmugam K, Dinstein IH (1973) Textural features for image classification. IEEE Trans Syst Man Cybern (6):610–621

  10. Hu J, Chen Z, Yang M, Zhang R, Cui Y (2018) A multiscale fusion convolutional neural network for plant leaf recognition. IEEE Signal Process Lett 25(6):853–857. https://doi.org/10.1109/LSP.2018.2809688

    Article  Google Scholar 

  11. Jeon WS, Rhee SY (2017) Plant leaf recognition using a convolution neural network. The Int J Fuzzy Log Intell Syst 17:26–34. https://doi.org/10.5391/IJFIS.2017.17.1.26

    Article  Google Scholar 

  12. Khmag A, Al-Haddad SR, Kamarudin N (2017) Recognition system for leaf images based on its leaf contour and centroid. In: 2017 IEEE 15Th student conference on research and development (SCOReD), IEEE, pp 467–472

  13. Kumar PSVVSR, Rao KNV, Raju ASN, Kumar D (2016) Leaf classification based on shape and edge feature with k-nn classifier. In: 2016 2nd International conference on contemporary computing and informatics (IC3I), pp 548–552

  14. Lee S H, Chan C S, Mayo S J, Remagnino P (2017) How deep learning extracts and learns leaf features for plant classification. Pattern Recogn 71:1–13. https://doi.org/10.1016/j.patcog.2017.05.015

    Article  Google Scholar 

  15. Liu Z, Zhu L, Zhang XP, Zhou X, Shang L, Huang ZK, Gan Y (2015) . Hybrid deep learning for plant leaves classification 9226:115–123. https://doi.org/10.1007/978-3-319-22186-1_11

    Article  Google Scholar 

  16. Mittal P, Kansal M, Kaur Jhajj H (2018) Combined classifier for plant classification and identification from leaf image based on visual attributes. In: 2018 International conference on intelligent circuits and systems (ICICS), IEEE, pp 184–187

  17. Munisami T, Ramsurn M, Kishnah S, Pudaruth S (2015) Plant leaf recognition using shape features and colour histogram with k-nearest neighbour classifiers. Procedia Computer Science 58:740–747

    Article  Google Scholar 

  18. Priya CA, Balasaravanan T, Thanamani AS (2012) An efficient leaf recognition algorithm for plant classification using support vector machine. In: International Conference on Pattern Recognition, Informatics and Medical Engineering (PRIME-2012), pp 428–432

  19. Salve P, Sardesai M, Manza R, Yannawar P (2016) Identification of the plants based on leaf shape descriptors. In: Proceedings of the Second international conference on computer and communication technologies, Springer, pp 85–101

  20. Salve P, Sardesai M, Yannawar P (2020) Combining multiple classifiers using hybrid votes technique with leaf vein angle, cnn and gabor features for plant recognition. In: International conference on recent trends in image processing and pattern recognition, Springer, pp 313–331

  21. Salve P, Yannawar P, Sardesai M (2022) Multimodal plant recognition through hybrid feature fusion technique using imaging and non-imaging hyper-spectral data. J King Saud Univ - Comput Inf Sci 34(1):1361–1369

    Google Scholar 

  22. Schrader J, Shi P, Royer DL, Peppe DJ, Gallagher RV, Li Y, Wang R, Wright IJ (2021) Leaf size estimation based on leaf length, width and shape. Annals of Botany

  23. Shah MP, Singha S, Awate SP (2017) Leaf classification using marginalized shape context and shape+texture dual-path deep convolutional neural network. In: 2017 IEEE International conference on image processing (ICIP), pp 860–864. https://doi.org/10.1109/ICIP.2017.8296403

  24. Su J, Wang M, Wu Z, Chen Q (2020) Fast plant leaf recognition using improved multiscale triangle representation and knn for optimization. IEEE Access 8:208753–208766

    Article  Google Scholar 

  25. Türkoğlu M, Hanbay D (2019) Combination of deep features and knn algorithm for classification of leaf-based plant species. In: 2019 International artificial intelligence and data processing symposium (IDAP), pp 1–5. https://doi.org/10.1109/IDAP.2019.8875911

  26. Türkoġlu M, Hanbay D (2019) Plant recognition system based on extreme learning machine by using shearlet transform and new geometric features. J Fac Eng Archit Gazi Univ 34(4):2097–2112

    Google Scholar 

  27. Turkoglu M, Hanbay D (2019) Recognition of plant leaves: an approach with hybrid features produced by dividing leaf images into two and four parts. Appl Math Comput 352:1–14

    MathSciNet  MATH  Google Scholar 

  28. Wang Z, Sun X, Ma Y, Zhang H, Ma Y, Xie W, Zhang Y (2014) Plant recognition based on intersecting cortical model. In: 2014 International joint conference on neural networks (IJCNN), IEEE, pp 975–980

  29. Wen CY, Chou CM (2004) Color image models and its applications to document examination. J Forensic Sci 3(1):23–32

    Google Scholar 

  30. Wu SG, Bao FS, Xu EY, Wang YX, Chang YF, Xiang QL (2007) A leaf recognition algorithm for plant classification using probabilistic neural network. In: 2007 IEEE international symposium on signal processing and information technology, IEEE, pp 11–16

  31. Yamashita R, Nishio M, Do R K G, Togashi K (2018) Convolutional neural networks: an overview and application in radiology. Insights Into Imaging 9(4):611–629

    Article  Google Scholar 

  32. Zahn CT, Roskies RZ (1972) Fourier descriptors for plane closed curves. IEEE Trans Comput 100(3):269–281

    Article  MathSciNet  MATH  Google Scholar 

  33. Zhang H, Yanne P, Liang S (2012) Plant species classification using leaf shape and texture. In: 2012 International conference on industrial control and electronics engineering, IEEE, pp 2025–2028

Download references

Acknowledgments

We want to thank the University of Science, Vietnam National University in Ho Chi Minh City, and AISIA Research Lab in Vietnam for supporting us throughout this paper.

Author information

Authors and Affiliations

  1. Dublin City University, Dublin City, Ireland

    Boi M. Quach & V. Cuong Dinh

  2. University of Science, Ho Chi Minh City, Vietnam

    Nhung Pham & Binh T. Nguyen

  3. Vietnam National University in Ho Chi Minh City, Ho Chi Minh City, Vietnam

    Nhung Pham & Binh T. Nguyen

  4. AISIA Research Lab, Ho Chi Minh City, Vietnam

    Dang Huynh & Binh T. Nguyen

  5. Hong Bang International University, Ho Chi Minh City, Vietnam

    Dang Huynh

Authors
  1. Boi M. Quach
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. V. Cuong Dinh
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Nhung Pham
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Dang Huynh
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Binh T. Nguyen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Binh T. Nguyen.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Quach, B.M., Dinh, V.C., Pham, N. et al. Leaf recognition using convolutional neural networks based features. Multimed Tools Appl 82, 777–801 (2023). https://doi.org/10.1007/s11042-022-13199-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-13199-y

Keywords

Search

Navigation