Abstract
Plant-leaf diseases have become a significant threat to food security due to reducing the quantity and quality of agricultural products. Plant disease detection methods are commonly based on experience through manual observations of leaves. Developing fast, accurate, and automated techniques for identifying of crop diseases using computer vision and artificial intelligence (AI) can help overcome human shortcomings. In the current study, the EfficientNet architectures with pre-trained Noisy-Student weights were implemented using the transfer learning approach to classify leaf image-based healthy and diseased plant groups. The deep learning models were performed on the extended and enhanced PlantVillage datasets, consisting of leaf images of 14 different plant species, with background and augmented images. Early stopping and learning rate scheduler techniques were used to speed up learning and improve the efficiency of the training and testing process. The experimental results obtained on the two test sets showed that the EfficientNet-B3 and EfficientNet-B5 architectures achieved the highest performance metrics on the non-augmented and augmented datasets, respectively. The average testing accuracy of both models was up to 99.997% with good precision and sensitivity. The improved networks also revealed an excellent efficacy compared to several popularly convolutional neural networks in the literature, such as AlexNet, GoogleNet, VGGNet, ResNets, DenseNets, and MobileNets. Growingly, the enhanced artificial intelligence models may provide more powerful and practical solutions to the detection of plant-leaf diseases.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Arsenovic M, Karanovic M, Sladojevic S, Anderla A, Stefanovic D (2019) Solving current limitations of deep learning based approaches for plant disease detection. Symmetry (Basel) 11(7):939. https://doi.org/10.3390/sym11070939
Atila Ü, Uçar M, Akyol K, Uçar E (2021) Plant leaf disease classification using EfficientNet deep learning model. Ecol Inform 61:101182. https://doi.org/10.1016/j.ecoinf.2020.101182
Brahimi M, Boukhalfa K, Moussaoui A (2017) Deep learning for tomato diseases: classification and symptoms visualization. Appl Artif Intell 31(4):299–315. https://doi.org/10.1080/08839514.2017.1315516
Chen J, Zhang D, Nanehkaran YA (2020a) Identifying plant diseases using deep transfer learning and enhanced lightweight network. Multimed Tools Appl 79(41–42):31497–31515. https://doi.org/10.1007/s11042-020-09669-w
Chen J, Zhang D, Nanehkaran YA, Li D (2020b) Detection of rice plant diseases based on deep transfer learning. J Sci Food Agric 100(7):3246–3256. https://doi.org/10.1002/jsfa.10365
Chowdhury MEH, Rahman T, Khandakar A, Ayari MA, Khan AU, Khan MS, Al-Emadi N, Reaz MBI, Islam MT, Ali SHM (2021) Automatic and reliable leaf disease detection using deep learning techniques. AgriEngineering 3(2):294–312. https://doi.org/10.3390/agriengineering3020020
Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Comput Electron Agric 145:311–318. https://doi.org/10.1016/j.compag.2018.01.009
Gajjar R, Gajjar N, Thakor VJ, Patel NP, Ruparelia S (2021) Real-time detection and identification of plant leaf diseases using convolutional neural networks on an embedded platform. Vis Comput 178:6. https://doi.org/10.1007/s00371-021-02164-9
Geetharamani G, ArunPandian J (2019) Identification of plant leaf diseases using a nine-layer deep convolutional neural network. Comput Electr Eng 76:323–338. https://doi.org/10.1016/j.compeleceng.2019.04.011
Glauner P (2015) Deep convolutional neural networks for smile recognition. IEEE/ACM Trans Audio Speech Lang Process 22:533–1545
GokulnathUsha Devi BVG (2021) Identifying and classifying plant disease using resilient LF-CNN. Ecol Inform 63:101283. https://doi.org/10.1016/j.ecoinf.2021.101283
Gui P, Dang W, Zhu F, Zhao Q (2021) Towards automatic field plant disease recognition. Comput Electron Agric 191:106523. https://doi.org/10.1016/j.compag.2021.106523
Hassan SM, Maji AK, Jasiński M, Leonowicz Z, Jasińska E (2021) Identification of plant-leaf diseases using cnn and transfer-learning approach. Electron 10(12):1388. https://doi.org/10.3390/electronics10121388
He X, Chen Y, Ghamisi P (2020) Heterogeneous transfer learning for hyperspectral image classification based on convolutional neural network. IEEE Trans Geosci Remote Sens 58(5):3246–3263. https://doi.org/10.1109/TGRS.2019.2951445
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition 2016-Decem, pp 770–778. https://doi.org/10.1109/CVPR.2016.90
Hu G, Wang H, Zhang Y, Wan M (2021) Detection and severity analysis of tea leaf blight based on deep learning. Comput Electr Eng 90:107023. https://doi.org/10.1016/j.compeleceng.2021.107023
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: 2017 Proceedings 30th IEEE conference on computer vision and pattern recognition, pp. 2261–2269. https://doi.org/10.1109/CVPR.2017.243
Hughes DP, Salathe M (2015) An open access repository of images on plant health to enable the development of mobile disease diagnostics. https://doi.org/10.48550/arXiv.1511.08060
Hussain M, Bird JJ, Faria DR (2019) A study on CNN transfer learning for image classification. Adv Intell Syst Comput 840:191–202. https://doi.org/10.1007/978-3-319-97982-3_16
Ioffe S, Szegedy C (2015) Batch normalization: accelerating deep network training by reducing internal covariate shif. In: Proceedings of the 32nd international conference on international conference on machine learning, pp 448–456
Johannes A, Picon A, Alvarez-Gila A, Echazarra J, Rodriguez-Vaamonde S, Navajas AD, Ortiz-Barredo A (2017) Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case. Comput Electron Agric 138:200–209. https://doi.org/10.1016/j.compag.2017.04.013
Kamilaris A, Prenafeta-Boldú FX (2018) A review of the use of convolutional neural networks in agriculture. J Agric Sci 156(3):312–322. https://doi.org/10.1017/S0021859618000436
Kan HX, Jin L, Zhou FL (2017) Classification of medicinal plant leaf image based on multi-feature extraction. Pattern Recognit Image Anal 27(3):581–587. https://doi.org/10.1134/S105466181703018X
Kaur S, Pandey S, Goel S (2019) Plants disease identification and classification through leaf images: a survey. Arch Comput Methods Eng 26(2):507–530. https://doi.org/10.1007/s11831-018-9255-6
Kc K, Yin Z, Wu M, Wu Z (2019) Depthwise separable convolution architectures for plant disease classification. Comput Electron Agric 165:104948. https://doi.org/10.1016/j.compag.2019.104948
Khan RU, Khan K, Albattah W, Qamar AM (2021) Image-based detection of plant diseases: from classical machine learning to deep learning journey. Wirel Commun Mob Comput 2021:5541859. https://doi.org/10.1155/2021/5541859
Klauser D (2018) Challenges in monitoring and managing plant diseases in developing countries. J Plant Dis Prot 125(3):235–237. https://doi.org/10.1007/s41348-018-0145-9
Kokru G, Nadar S, Dhar S, Singh S (2018) A disease prediction and rectification system for banana leaf using CNN. Int J Creat Res Thoughts 3(12):77–81
Krizhevsky BA, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90
Lee SH, Goëau H, Bonnet P, Joly A (2020) New perspectives on plant disease characterization based on deep learning. Comput Electron Agric 170:105220. https://doi.org/10.1016/j.compag.2020.105220
Li M, Zhang T, Chen Y, Smola AJ (2014) Efficient mini-batch training for stochastic optimization. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, pp 661–670
Liu J, Wang X (2021) Plant diseases and pests detection based on deep learning: a review. Plant Methods 17(1):1–18. https://doi.org/10.1186/s13007-021-00722-9
Lu Y, Yi S, Zeng N, Liu Y, Zhang Y (2017) Identification of rice diseases using deep convolutional neural networks. Neurocomputing 267:378–384. https://doi.org/10.1016/j.neucom.2017.06.023
Masud M, Alshehri MD, Alroobaea R, Shorfuzzaman M (2021) Leveraging convolutional neural network for COVID-19 disease detection using CT scan images. Intell Autom Soft Comput 29(1):1–13. https://doi.org/10.32604/iasc.2021.016800
Mishra S, Sachan R, Rajpal D (2020) Deep convolutional neural network based detection system for real-time corn plant disease recognition. Procedia Comput Sci 167:2003–2010. https://doi.org/10.1016/j.procs.2020.03.236
Mohanty SP, Hughes DP, Salathé M (2016) Using deep learning for image-based plant disease detection. Front Plant Sci 7:1–10. https://doi.org/10.3389/fpls.2016.01419
Nanehkaran YA, Zhang D, Chen J, Tian Y, Al-Nabhan N (2020) Recognition of plant leaf diseases based on computer vision. J Ambient Intell Humaniz Comput 9:1–18. https://doi.org/10.1007/s12652-020-02505-x
Pan W (2016) A survey of transfer learning for collaborative recommendation with auxiliary data. Neurocomputing 177:447–453. https://doi.org/10.1016/j.neucom.2015.11.059
Rangarajan AK, Purushothaman R, Ramesh A (2018) Tomato crop disease classification using pre-trained deep learning algorithm. Procedia Comput Sci 133:1040–1047. https://doi.org/10.1016/j.procs.2018.07.070
Rehman ZU, Khan MA, Ahmed F, Damaševičius R, Naqvi SR, Nisar W, Javed K (2021) Recognizing apple leaf diseases using a novel parallel real-time processing framework based on MASK RCNN and transfer learning: an application for smart agriculture. IET Image Process 15(10):2157–2168. https://doi.org/10.1049/ipr2.12183
Revathi P, Hemalatha M (2013) Identification of cotton diseases based on cross information gain_deep forward neural network classifier with PSO feature selection. Int J Eng Technol 5(6):4637–4642
Saleem MH, Potgieter J, Arif KM (2019) Plant disease detection and classification by deep learning. Plants 8:468
Sandler M, Howard A, Zhu M, Zhmoginov A, Chen LC (2018) MobileNetV2: inverted residuals and linear bottlenecks. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, pp 4510–4520
Selvam L, Kavitha P (2020) Classification of ladies finger plant leaf using deep learning. J Ambient Intell Humaniz Comput. https://doi.org/10.1007/s12652-020-02671-y
Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd international conference on learning representations, ICLR 2015-conference track proceedings, pp 1–14
Sinha A, Shekhawat RS (2020) Review of image processing approaches for detecting plant diseases ISSN 1751–9659. IET Image Process 14(8):1427–1439. https://doi.org/10.1049/iet-ipr.2018.6210
Sokolova M, Lapalme G (2009) A systematic analysis of performance measures for classification tasks. Inf Process Manag 45(4):427–437. https://doi.org/10.1016/j.ipm.2009.03.002
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 319–338
Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-ResNet and the impact of residual connections on learning. In: 31st AAAI conference on artificial intelligence, AAAI 2017. pp 4278–4284
Tan M, Le Q V. (2019) EfficientNet: rethinking model scaling for convolutional neural networks. In: 36th international conference on machine learning, ICML 2019, pp 10691–10700
Thangaraj R, Anandamurugan S, Kaliappan VK (2021) Automated tomato leaf disease classification using transfer learning-based deep convolution neural network. J Plant Dis Prot 128(1):73–86. https://doi.org/10.1007/s41348-020-00403-0
Too EC, Yujian L, Njuki S, Yingchun L (2019) A comparative study of fine-tuning deep learning models for plant disease identification. Comput Electron Agric 161:272–279. https://doi.org/10.1016/j.compag.2018.03.032
Vallabhajosyula S, Sistla V, Kolli VKK (2021) Transfer learning-based deep ensemble neural network for plant leaf disease detection. J Plant Dis Prot. https://doi.org/10.1007/s41348-021-00465-8
Vishnoi VK, Kumar K, Kumar B (2021) Plant disease detection using computational intelligence and image processing. J Plant Dis Prot 128(1):19–53. https://doi.org/10.1007/s41348-020-00368-0
Wallelign S, Polceanu M, Buche C (2018) Soybean plant disease identification using convolutional neural network. In: Proceedings of the 31st international Florida artificial intelligence research society conference, FLAIRS 2018. pp 146–151
Wang H, Wang Z, Du M, Yang F, Zhang Z, Ding S, Mardziel P, Hu X (2020) Score-CAM: Score-weighted visual explanations for convolutional neural networks. In: IEEE computer society conference on computer vision and pattern recognition workshops, Seattle, pp 111–119
Xiong Y, Liang L, Wang L, She J, Wu M (2020) Identification of cash crop diseases using automatic image segmentation algorithm and deep learning with expanded dataset. Comput Electron Agric 177:105712. https://doi.org/10.1016/j.compag.2020.105712
Yu D, Xiong W, Droppo J, Stolcke A, Ye G, Li J, Zweig G (2016) Deep convolutional neural networks with layer-wise context expansion and attention. In: Proceedings of the annual conference of the international speech communication association, INTERSPEECH. pp 17–21
Yuan Y, Chen L, Wu H, Li L (2021) Advanced agricultural disease image recognition technologies: a review. Inf Process Agric. https://doi.org/10.1016/j.inpa.2021.01.003
Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: Fleet D, Pajdla T, Schiele B, Tuytelaars T (eds) Computer vision-ECCV 2014. Springer, pp 818–833
Zhao Y, Chen J, Xu X, Lei J, Zhou W (2021) SEV-Net: Residual network embedded with attention mechanism for plant disease severity detection. Concurr Comput Pract Exp 33(10):e6161. https://doi.org/10.1002/cpe.6161
Zhao Y, Sun C, Xu X, Chen J (2022) RIC-Net: a plant disease classification model based on the fusion of Inception and residual structure and embedded attention mechanism. Comput Electron Agric 193:106644. https://doi.org/10.1016/j.compag.2021.106644
Acknowledgements
The authors would like to thank the infrastructure support by the Phenikaa University, and Vietnam National University, Hanoi. In addition, the current work has been partly supported by the VNU University of Engineering and Technology under the Marine and Mechatronics Laboratory.
Funding
None.
Author information
Authors and Affiliations
Contributions
Conceptualization, formal analysis, and investigation were done by BTH; Methodology, Software, Validation, and Writing—original draft preparation were done by HVM; Conceptualization, Visualization, and Writing—review and editing were done by NVN.
Corresponding author
Ethics declarations
Conflicts of interest
All authors declare that they have no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Hanh, B.T., Van Manh, H. & Nguyen, NV. Enhancing the performance of transferred efficientnet models in leaf image-based plant disease classification. J Plant Dis Prot 129, 623–634 (2022). https://doi.org/10.1007/s41348-022-00601-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41348-022-00601-y