Abstract
In agriculture around 22% of crop yield loss is due to living and non-living organisms such as biotic and abiotic stress/disease. The early-stage diagnosis of these stresses is an important issue for farmers through naked eyes. Using computer vision technologies can detect the pattern and clustering of diseases at an early stage. However, in recent times, deep learning technologies based on computer vision is helpful for the diagnosis of biotic stress (single biotic and multi biotic) in tomato plant leaves. In this work, the PlantVillage dataset is gathered for the segmentation of object detection. The labeled, enhanced and augmented data has been used for training the model. The proposed hybrid Deep Segmentation Convolutional Neural Network (Hybrid-DSCNN) model has been segmenting the diseased objects in the tomato plant. This Hybrid-DSCNN is assembled using U-Net and Seg-Net pre-trained models with instance segmentation for better detection of objects. The semantic segmented data has been recognized for the single and multiple leaf diseases for identification and classification in this work. A comparison of the predicted Hybrid-DSCNN model's output has been made with other modified U-Net, M-SegNet, and modified U-SegNet in terms of Accuracy, Precision, Recall, and Intersection over Union (IoU), and mean Intersection over Union (mIoU). The proposed model processed 1004 images in 30 ns,which is better than other compared models. The accuracy achieved using the proposed model is 98.24%, which is far better than other modified segmentation models.
Similar content being viewed by others
Data availability
Data and source codes are available from the authors upon reasonable request.
References
Abayomi-Alli OO, Damasevicius R, Misra S, Maskeliunas R (2021) Cassava disease recognition from low-quality images using enhanced data augmentation model and deep learning. Expert Syst 38(7):e12746
Agarwal M, Gupta SK, Biswas KK (2020) Development of Efficient CNN model for Tomato crop disease identification. Sustain Comput: Informat Syst 28:100407
Annrose J, Rufus NH, Rex CE (2021) Immanuel DG. Soybean plant disease classification using archimedes optimization algorithm based hybrid deep learning model
Badrinarayanan V, Kendall A, Cipolla R (2017) SegNet: a deep convolutional encoderdecoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39:2481–2495
Barbedo JGA (2016) A review on the main challenges in automatic plant disease identification based on visible range images. Biosyst Eng 144:52–60
Barbedo JGA (2018) Impact of dataset size and variety on the effectiveness of deep learning and transfer learning for plant disease classification. Comput Electron Agric 153:46–53
Boulent J, Foucher S, Theau J, St-Charles P-L (2019) Convolutional neural networks for the automatic identification of plant diseases. Front Plant Sci 10:941
Chen SY, Lin C, Li GJ, Hsu YC, Liu KH (2021) Hybrid deep learning models with sparse enhancement technique for detection of newly grown tree leaves. Sensors 21(6):2077
Chen X, Zhou G, Chen A, Yi J, Zhang W, Hu Y (2020) Identification of tomato leaf diseases based on combination of ABCK-BWTR and B-ARNet. Comput Electron Agric 178:105730
Cheng L, Yi J, Chen A, Zhang Y (2023) Fabric defect detection based on separate convolutional UNet. Multimed Tools Appl 82(2):3101–3122
Dayananda C, Choi JY, Lee B (2021) Multi-Scale Squeeze U-SegNet with Multi Global Attention for Brain MRI Segmentation. Sensors 21(10):3363
Esgario JG, Krohling RA, Ventura JA (2020) Deep learning for classification and severity estimation of coffee leaf biotic stress. Comput Electron Agric 169:105162
Gulhane VA, Gurjar AA (2011) Detection of diseases on cotton leaves and its possible diagnosis. Int J Image Process (IJIP) 5(5):590–598
He K, Gkioxari G, Dollar P, Girshick R (2017) Mask R-CNN. arXiv e-prints, arXiv:1703.06870
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition, in. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
Hughes DP, Salathe M (2015) An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv 2015, arXiv:1511.08060
Jain A, Sarsaiya S, Wu Q, Lu Y, Shi J (2019) A review of plant leaf fungal diseases and its environment speciation. Bioengineered 10(1):409–424
Johannes A, Picon A, Alvarez-Gila A, Echazarra J, Rodriguez-Vaamonde S, Navajas AD, Ortiz-Barredo A (2017) Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case. Comput Electron Agric 138:200–209
Karthik R, Hariharan M, Anand S, Mathikshara P, Johnson A, Menaka R (2020) Attention embedded residual CNN for disease detection in tomato leaves. Appl Soft Comput 86:105933
Kaur P, Gautam V (2021) Plant biotic disease identification and classification based on leaf image: A Review. In Proceedings of 3rd International Conference on Computing Informatics and Networks: ICCIN 2020 (pp 597–610). Springer Singapore
Kaur P, Gautam V (2021) Research patterns and trends in classification of biotic and abiotic stress in plant leaf. Mat Today: Proc 45:4377–4382
Kaur P, Harnal S, Tiwari R, Upadhyay S, Bhatia S, Mashat A, Alabdali AM (2022) Recognition of Leaf Disease Using Hybrid Convolutional Neural Network by Applying Feature Reduction. Sensors 22(2):575
Khan S, Narvekar M (2020) Novel fusion of color balancing and superpixel based approach for detection of tomato plant diseases in natural complex environment. J King Saud University-Comput Inform Sc
Kumar N, Ansari A, Talpur S, Zai S, Memon M (2021) Double Channel CNN Based Tomato Plant Leaf Disease Detection. Quaid-E-Awam Univ Res J Eng, Sci Technol, Nawabshah 19(2):1–7
Kumar D, Kukreja V (2022) Deep learning in wheat diseases classification: A systematic review. Multimed Tools Appl 81(7):10143–10187
Lu J, Hu J, Zhao G, Mei F, Zhang C (2017) An in-field automatic wheat disease diagnosis system. Comput Electron Agric 142:369–379
Ma J, Du K, Zheng F, Zhang L, Gong Z, Sun Z (2018) A recognition method for cucumber diseases using leaf symptom images based on deep convolutional neural network. Comput Electron Agric 154:18–24
Mathulaprangsan S, Lanthong K (2021) Cassava Leaf Disease Recognition Using Convolutional Neural Networks. In: 2021 9th International Conference on Orange Technology (ICOT), IEEE, pp 1–5
Mishra AM, Harnal S, Mohiuddin K, Gautam V, Nasr OA, Goyal N, Singh A (2022) A Deep Learning-Based Novel Approach for Weed Growth Estimation. Intell Autom Soft Comput 31(2):1157–1172
Mukhopadhyay S, Paul M, Pal R, De D (2021) Tea leaf disease detection using multi-objective image segmentation. Multimed Tools Appl 80(1):753–771
Nasiri E, Berahmand K, Li Y (2023) Robust graph regularization nonnegative matrix factorization for link prediction in attributed networks. Multimed Tools Appl 82(3):3745–3768
Nazari K, Ebadi MJ, Berahmand K (2022) Diagnosis of alternaria disease and leafminer pest on tomato leaves using image processing techniques. J Sci Food Agric 102(15):6907–6920
Panigrahi KP, Das H, Sahoo AK, Moharana SC (2020) Maize leaf disease detection and classification using machine learning algorithms. In Progress in Computing, Analytics and Networking (pp 659–669). Springer, Singapore
Rashid J, Khan I, Ali G, Almotiri SH, AlGhamdi MA, Masood K (2021) Multi-level deep learning model for potato leaf disease recognition. Electronics 10(17):2064
Rehman ZU, Khan MA, Ahmed F, Damasevicius R, Naqvi SR, Nisar W, Javed K (2021) Recognizing apple leaf diseases using a novel parallel real-time processing framework based on MASK RCNN and transfer learning: An application for smart agriculture. IET Image Proc 15(10):2157–2168
Revathi P, Hemalatha M (2014) Cotton leaf spot diseases detection utilizing feature selection with skew divergence method. Int J Sci Eng Technol 3(1):22–30
Ronneberger O, Fischer P, Brox T (2015) U-net: Convolutional networks for biomedical image segmentation. arXiv e-prints, arXiv:1505.04597
Rostami M, Berahmand K, Nasiri E, Forouzandeh S (2021) Review of swarm intelligence-based feature selection methods. Eng Appl Artif Intell 1(100):104210
Salih TA (2020) Deep Learning Convolution Neural Network to Detect and Classify Tomato Plant Leaf Diseases. Open Access Library J 7(05):1
Sammany M, Medhat T (2007) Dimensionality reduction using rough set approach for two neural networks-based applications. In International Conference on Rough Sets and Intelligent Systems Paradigms (pp 639–647). Springer, Berlin, Heidelberg
Sasaki Y, Okamoto T, IMOUTORII KT (1999) Automatic diagnosis of plant disease recognition between healthy and diseased leaf. J Japan Soc Agric Mach 61(2):119–126
Sharma P, Berwal YPS, Ghai W (2019) Performance analysis of deep learning CNN models for disease detection in plants using image segmentation. Inf Process Agric 7(4):566–574
Thangaraj R, Anandamurugan S, Kaliappan VK (2021) Automated tomato leaf disease classification using transfer learning-based deep convolution neural network. J Plant Dis Prot 128(1):73–86
Uguz S, Uysal N (2021) Classification of olive leaf diseases using deep convolutional neural networks. Neural Comput Appl 33(9):4133–4149
Vieira J, Abreu E, Florindo JB (2023) Texture image classification based on a pseudo-parabolic diffusion model. Multimed Tools Appl 82(3):3581–3604
Yadav S, Sengar N, Singh A, Singh A, Dutta MK (2021) Identification of disease using deep learning and evaluation of bacteriosis in peach leaf. Eco Inform 61:101247
Yamanakkanavar N, Lee B (2021) A novel M-SegNet with global attention CNN architecture for automatic segmentation of brain MRI. Comput Biol Med 136:104761
Zou K, Chen X, Wang Y, Zhang C, Zhang F (2021) A modified U-Net with a specific data argumentation method for semantic segmentation of weed images in the field. Comput Electron Agric 187:106242
Author information
Authors and Affiliations
Contributions
PK.: Conceptualization, data collection and Methodology, Writing, SH.:Methodology and Supervision, VG: Conceptualization and Supervision, MPS: Validation and supervision, SPS: Validation.
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare no conflict of interest.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Kaur, P., Harnal, S., Gautam, V. et al. Performance analysis of segmentation models to detect leaf diseases in tomato plant. Multimed Tools Appl 83, 16019–16043 (2024). https://doi.org/10.1007/s11042-023-16238-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-023-16238-4