Abstract
In recent times use of different technologies for intelligent crop production is growing. To increase the production of crops, diagnosing a plant disease is very important. Plant diseases can be identified using various techniques like image processing, machine learning, deep learning, etc. Among these techniques deep learning, especially deep learning using convolutional neural networks (CNN) has proved to be more efficient in recent years compared to other methods. This manuscript focuses mainly on the diseases affecting on eleven (11) different plants and how the diseases can be identified from plant leaf images using CNN based deep learning models. This review can help the researchers to get a brief overview of how state-of-the-art CNN models can be used for disease diagnosis in plants, and an overview of the state-of-the-art studies that have used visualization techniques to identify the disease spots for better diagnosis. The review also summarises the studies that have used hyperspectral images for plant disease diagnosis and various data sources used by different studies. The challenges that currently exist while developing a plant disease diagnostic system and the shortcomings and open areas for research have also been discussed in this manuscript.
Similar content being viewed by others
References
Adegun A, Viriri S (2021) Deep learning techniques for skin lesion analysis and melanoma cancer detection: a survey of state-of-the-art. Artif Intell Rev 54(2):811–841
Amara J, Bouaziz B, Algergawy A (2017) A deep learning-based approach for banana leaf diseases classification. Datenbanksysteme für Business, Technologie und Web (BTW 2017)-Workshopband
Arivazhagan S, Ligi SV (2018) Mango leaf diseases identification using convolutional neural network. Int J Pure Appl Math 120(6):11067–11079
Arsenovic M, Karanovic M, Sladojevic S, Anderla A, Stefanovic D (2019) Solving current limitations of deep learning based approaches for plant disease detection. Symmetry 11(7):939
Barbedo JGA (2016) A review on the main challenges in automatic plant disease identification based on visible range images. Biosyst Eng 144:52–60
Barbedo JG (2018) Factors influencing the use of deep learning for plant disease recognition. Biosyst Eng 172:84–91
Barbedo JGA (2019) Plant disease identification from individual lesions and spots using deep learning. Biosyst Eng 180:96–107
Barbedo JGA, Koenigkan LV, Halfeld-Vieira BA, Costa RV, Nechet KL, Godoy CV, Junior ML, Patricio FRA, Talamini V, Chitarra LG et al (2018) Annotated plant pathology databases for image-based detection and recognition of diseases. IEEE Lat Am Trans 16(6):1749–1757
Bari BS, Islam MN, Rashid M, Hasan MJ, Razman MAM, Musa RM, Ab Nasir AF, Majeed APA (2021) A real-time approach of diagnosing rice leaf disease using deep learning-based faster r-cnn framework. PeerJ Comput Sci 7:e432
Bi C, Wang J, Duan Y, Fu B, Kang J-R, Shi Y (2020) Mobilenet based apple leaf diseases identification. Mobile Netw Appl 27:172–180
Brahimi M, Arsenovic M, Laraba S, Sladojevic S, Boukhalfa K, Moussaoui A (2018) Deep learning for plant diseases: detection and saliency map visualisation. In: Human and machine learning, Springer, pp 93–117
Brahimi M, Boukhalfa K, Moussaoui A (2017) Deep learning for tomato diseases: classification and symptoms visualization. Appl Artif Intell 31 (4):299–315
Brahimi M, Mahmoudi S, Boukhalfa K, Moussaoui A (2019) Deep interpretable architecture for plant diseases classification. In: 2019 signal processing: algorithms, architectures, arrangements, and applications (SPA), IEEE, pp 111–116
Chen J-W, Lin W-J, Cheng H-J, Hung C-L, Lin C-Y, Chen S-P (2021) A smartphone-based application for scale pest detection using multiple-object detection methods. Electronics 10(4):372
Cristin R, Kumar BS, Priya C, Karthick K (2020) Deep neural network based rider-cuckoo search algorithm for plant disease detection. Artif Intell Rev 53:4993–5018
Cruz AC, Luvisi A, De Bellis L, Ampatzidis Y (2017) Vision-based plant disease detection system using transfer and deep learning. In: 2017 asabe annual international meeting, American Society of Agricultural and Biological Engineers, p 1
DeChant C, Wiesner-Hanks T, Chen S, Stewart EL, Yosinski J, Gore MA, Nelson RJ, Lipson H (2017) Automated identification of northern leaf blight-infected maize plants from field imagery using deep learning. Phytopathology 107 (11):1426–1432
Deepalakshmi P, Lavanya K, Srinivasu PN et al (2021) Plant leaf disease detection using cnn algorithm. Int J Inf Syst Model Des (IJISMD) 12 (1):1–21
Deng J, Dong W, Socher R, Li L-J, Li K, Fei-Fei L (2009) Imagenet: a large-scale hierarchical image database. In: 2009 IEEE conference on computer vision and pattern recognition, IEEE, pp 248–255
Dhingra G, Kumar V, Joshi HD (2018) Study of digital image processing techniques for leaf disease detection and classification. Multimed Tools Appl 77(15):19951–20000
Dung CV et al (2019) Autonomous concrete crack detection using deep fully convolutional neural network. Autom Constr 99:52–58
Fenu G, Malloci FM (2021) Diamos plant: a dataset for diagnosis and monitoring plant disease. Agronomy 11(11):2107
Fuentes A, Yoon S, Kim SC, Park DS (2017) A robust deep-learning-based detector for real-time tomato plant diseases and pests recognition. Sensors 17(9):2022
Ghosal S, Blystone D, Singh AK, Ganapathysubramanian B, Singh A, Sarkar S (2018) An explainable deep machine vision framework for plant stress phenotyping. Proc Natl Acad Sci 115(18):4613–4618
Gobalakrishnan N, Pradeep K, Raman C, Ali LJ, Gopinath M (2020) A systematic review on image processing and machine learning techniques for detecting plant diseases. In: 2020 international conference on communication and signal processing (ICCSP), IEEE, pp 0465–0468
Golhani K, Balasundram SK, Vadamalai G, Pradhan B (2018) A review of neural networks in plant disease detection using hyperspectral data. Inf Process Agric 5(3):354–371
Goluguri NRR, Suganya Devi K, Vadaparthi N (2021) Image classifiers and image deep learning classifiers evolved in detection of oryza sativa diseases: survey. Artif Intell Rev 54:359–396
Ha JG, Moon H, Kwak JT, Hassan SI, Dang M, Lee ON, Park HY (2017) Deep convolutional neural network for classifying fusarium wilt of radish from unmanned aerial vehicles. J Appl Remote Sens 11(4):042621
HamidiSepehr A, Mirnezami SV, Ward JK (2020) Comparison of object detection methods for corn damage assessment using deep learning. Trans ASABE 63(6):1969–1980
Han H, Jain AK, Wang F, Shan S, Chen X (2017) Heterogeneous face attribute estimation: a deep multi-task learning approach. IEEE Trans Pattern Anal Mach Intell 40(11):2597–2609
He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
Hiroki T, Kotani R, Kagiwada S, Hiroyuki U, Iyatomi H (2018) Diagnosis of multiple cucumber infections with convolutional neural networks. In: 2018 IEEE applied imagery pattern recognition workshop (AIPR), IEEE, pp 1–4
Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) Mobilenets: efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708
Hughes D, Salathé M et al (2015) An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv:1511.08060
Iandola FN, Han S, Moskewicz MW, Ashraf K, Dally WJ, Keutzer K (2016) Squeezenet:, alexnet-level accuracy with 50x fewer parameters and< 0.5 mb model size. arXiv:1602.07360
Izay A, Onyejegbu L (2017) Digital image processing for detecting and classifying plant diseases. Circ Comput Sci 2(11):1–7
Jiang P, Chen Y, Liu B, He D, Liang C (2019) Real-time detection of apple leaf diseases using deep learning approach based on improved convolutional neural networks. IEEE Access 7:59069–59080
Jiang F, Lu Y, Chen C, Cai D, Li G (2020) Image recognition of four rice leaf diseases based on deep learning and support vector machine. Comput Electron Agric 179:105824
Johannes A, Picon A, Alvarez-Gila A, Echazarra J, Rodriguez-Vaamonde S, Navajas AD, Ortiz-Barredo A (2017) Automatic plant disease diagnosis using mobile capture devices, applied on a wheat use case. Comput Electron Agric 138:200–209
Joshi BM, Bhavsar H (2020) Plant leaf disease detection and control: a survey. J Inf Optim Sci 41(2):475–487
Kamilaris A, Prenafeta-Boldú FX (2018) Deep learning in agriculture: a survey. Comput Electron Agric 147:70–90
Karlekar A, Seal A (2020) Soynet: soybean leaf diseases classification. Comput Electron Agric 172:105342
Kaur S, Pandey S, Goel S (2019) Plants disease identification and classification through leaf images: a survey. Arch Comput Meth Eng 26(2):507–530
Khan MA, Akram T, Sharif M, Awais M, Javed K, Ali H, Saba T (2018) Ccdf: automatic system for segmentation and recognition of fruit crops diseases based on correlation coefficient and deep cnn features. Comput Electron Agric 155:220–236
Khan MA, Akram T, Sharif M, Javed K, Raza M, Saba T (2020) An automated system for cucumber leaf diseased spot detection and classification using improved saliency method and deep features selection. Multimed Tools Appl 79:18627–18656
Khan A, Sohail A, Zahoora U, Qureshi AS (2020) A survey of the recent architectures of deep convolutional neural networks. Artif Intell Rev 53 (8):5455–5516
Khatoon S, Hasan MM, Asif A, Alshmari M, Yap Y-K (2021) Image-based automatic diagnostic system for tomato plants using deep learning. Cmc-Comput Mater Contin 67:595–612
Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 25:1097–1105
Kumar N, Belhumeur PN, Biswas A, Jacobs DW, Kress WJ, Lopez IC, Soares JV (2012) Leafsnap: a computer vision system for automatic plant species identification. In: European conference on computer vision, Springer, pp 502–516
Lauguico S, Concepcion R, Tobias RR, Bandala A, Vicerra RR, Dadios E (2020) Grape leaf multi-disease detection with confidence value using transfer learning integrated to regions with convolutional neural networks. In: 2020 IEEE REGION 10 CONFERENCE (TENCON), IEEE, pp 767–772
LeCun Y, Bottou L, Bengio Y, Haffner P (1998) Gradient-based learning applied to document recognition. Proc IEEE 86(11):2278–2324
Lee SH, Chan CS, Mayo SJ, Remagnino P (2017) How deep learning extracts and learns leaf features for plant classification. Pattern Recogn 71:1–13
Lee SH, Chan CS, Wilkin P, Remagnino P (2015) Deep-plant: plant identification with convolutional neural networks. In: 2015 IEEE international conference on image processing (ICIP), IEEE, pp 452–456
Li H, Cai J, Nguyen TNA, Zheng J (2013) A benchmark for semantic image segmentation. In: 2013 IEEE international conference on multimedia and expo (ICME), IEEE, pp 1–6
Li J, Liang X, Shen S, Xu T, Feng J, Yan S (2017) Scale-aware fast r-cnn for pedestrian detection. IEEE Trans Multimed 20(4):985–996
Lin T-L, Chang H-Y, Chen K-H (2020) The pest and disease identification in the growth of sweet peppers using faster r-cnn and mask r-cnn. J Internet Technol 21(2):605–614
Liu J, Wang X (2020) Tomato diseases and pests detection based on improved yolo v3 convolutional neural network. Front Plant Sci 11:898
Liu B, Zhang Y, He D, Li Y (2018) Identification of apple leaf diseases based on deep convolutional neural networks. Symmetry 10(1):11
Loey M, ElSawy A, Afify M (2020) Deep learning in plant diseases detection for agricultural crops: a survey. Int J Serv Sci Manag Eng Technol (IJSSMET) 11(2):41–58
Lowe A, Harrison N, French AP (2017) Hyperspectral image analysis techniques for the detection and classification of the early onset of plant disease and stress. Plant Methods 13(1):1–12
Lu J, Hu J, Zhao G, Mei F, Zhang C (2017) An in-field automatic wheat disease diagnosis system. Comput Electron Agric 142:369–379
Lu Y, Yi S, Zeng N, Liu Y, Zhang Y (2017) Identification of rice diseases using deep convolutional neural networks. Neurocomputing 267:378–384
Ma J, Du K, Zheng F, Zhang L, Gong Z, Sun Z (2018) A recognition method for cucumber diseases using leaf symptom images based on deep convolutional neural network. Comput Electron Agric 154:18–24
Mia MR, Roy S, Das SK, Rahman MA (2020) Mango leaf disease recognition using neural network and support vector machine. Iran J Comput Sci 3 (3):185–193
Mishra S, Sachan R, Rajpal D (2020) Deep convolutional neural network based detection system for real-time corn plant disease recognition. Procedia Comput Sci 167:2003–2010
Mohan KJ, Balasubramanian M, Palanivel S (2016) Detection and recognition of diseases from paddy plant leaf images. Int J Comput Appl 144:34–41
Mohanty SP, Hughes DP, Salathé M (2016) Using deep learning for image-based plant disease detection. Front Plant Sci 7:1419
Nagaraju M, Chawla P (2020) Systematic review of deep learning techniques in plant disease detection. Int J Syst Assur Eng Manag 11:547–560
Nagasubramanian K, Jones S, Singh AK, Sarkar S, Singh A, Ganapathysubramanian B (2019) Plant disease identification using explainable 3d deep learning on hyperspectral images. Plant Methods 15(1):1–10
Nagasubramanian K, Jones S, Singh AK, Singh A, Ganapathysubramanian B, Sarkar S (2018) Explaining hyperspectral imaging based plant disease identification: 3d cnn and saliency maps. arXiv:1804.08831
Nandhini S, Ashokkumar K (2021) Improved crossover based monarch butterfly optimization for tomato leaf disease classification using convolutional neural network. Multimed Tools Appl 80(12):18583–18610
Nguyen G, Dlugolinsky S, Bobák M, Tran V, GarcÍa ÁL, Heredia I, Malík P, Hluchỳ L (2019) Machine learning and deep learning frameworks and libraries for large-scale data mining: a survey. Artif Intell Rev 52 (1):77–124
Nguyen HT, Nguyen CT, Ino T, Indurkhya B, Nakagawa M (2019) Text-independent writer identification using convolutional neural network. Pattern Recogn Lett 121:104–112
Nguyen C, Sagan V, Maimaitiyiming M, Maimaitijiang M, Bhadra S, Kwasniewski MT (2021) Early detection of plant viral disease using hyperspectral imaging and deep learning. Sensors 21(3):742
Nie X, Wang L, Ding H, Xu M (2019) Strawberry verticillium wilt detection network based on multi-task learning and attention. IEEE Access 7:170003–170011
Parraga-alava J, Cusme K, Loor A, Santander E (2019) Rocole: a robusta coffee leaf images dataset for evaluation of machine learning based methods in plant diseases recognition. Data Brief 25:104414
Pham TN, Van Tran L, Dao SVT (2020) Early disease classification of mango leaves using feed-forward neural network and hybrid metaheuristic feature selection. IEEE Access 8:189960–189973
Picon A, Alvarez-Gila A, Seitz M, Ortiz-Barredo A, Echazarra J, Johannes A (2019) Deep convolutional neural networks for mobile capture device-based crop disease classification in the wild. Comput Electron Agric 161:280–290
Polder G, Blok PM, de Villiers HA, van der Wolf JM, Kamp J (2019) Potato virus y detection in seed potatoes using deep learning on hyperspectral images. Front Plant Sci 10:209
Priyadharshini RA, Arivazhagan S, Arun M, Mirnalini A (2019) Maize leaf disease classification using deep convolutional neural networks. Neural Comput Appl 31(12):8887–8895
Qiu R, Yang C, Moghimi A, Zhang M, Steffenson BJ, Hirsch CD (2019) Detection of fusarium head blight in wheat using a deep neural network and color imaging. Remote Sens 11(22):2658
Ramcharan A, Baranowski K, McCloskey P, Ahmed B, Legg J, Hughes DP (2017) Deep learning for image-based cassava disease detection. Front Plant Sci 8:1852
Saleem MH, Khanchi S, Potgieter J, Arif KM (2020) Image-based plant disease identification by deep learning meta-architectures. Plants 9 (11):1451
Saleem MH, Potgieter J, Arif KM (2019) Plant disease detection and classification by deep learning. Plants 8(11):468
Saleem MH, Potgieter J, Arif KM (2020) Plant disease classification: a comparative evaluation of convolutional neural networks and deep learning optimizers. Plants 9(10):1319
Sambasivam G, Opiyo GD (2021) A predictive machine learning application in agriculture: cassava disease detection and classification with imbalanced dataset using convolutional neural networks. Egypt Inform J 22(1):27–34
Sermanet P, Eigen D, Zhang X, Mathieu M, Fergus R, LeCun Y (2014) Overfeat: integrated recognition, localization and detection using convolutional networks. CoRR:1312.6229
Sethy PK, Barpanda NK, Rath AK, Behera SK (2020) Image processing techniques for diagnosing rice plant disease: a survey. Procedia Comput Sci 167:516–530
Shuaibu M, Lee WS, Schueller J, Gader P, Hong YK, Kim S (2018) Unsupervised hyperspectral band selection for apple marssonina blotch detection. Comput Electron Agric 148:45–53
Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. CoRR:1409.1556
Singh R, Athisayamani S et al (2020) Banana leaf diseased image classification using novel heap auto encoder (hae) deep learning. Multimed Tools Appl 79(41):30601–30613
Singh UP, Chouhan SS, Jain S, Jain S (2019) Multilayer convolution neural network for the classification of mango leaves infected by anthracnose disease. IEEE Access 7:43721–43729
Singh RK, Tiwari A, Gupta RK (2022) Deep transfer modeling for classification of maize plant leaf disease. Multimed Tools Appl 81:6051–6067
Sladojevic S, Arsenovic M, Anderla A, Culibrk D, Stefanovic D (2016) Deep neural networks based recognition of plant diseases by leaf image classification. Comput Intell Neurosci 2016:1–11. Article ID 3289801, https://doi.org/10.1155/2016/3289801
Sood S, Singh H (2021) Computer vision and machine learning based approaches for food security: a review. Multimed Tools Appl 80:27973–27999
Sun J, Yang Y, He X, Wu X (2020) Northern maize leaf blight detection under complex field environment based on deep learning. IEEE Access 8:33679–33688
Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9
Thomas S, Kuska MT, Bohnenkamp D, Brugger A, Alisaac E, Wahabzada M, Behmann J, Mahlein A-K (2018) Benefits of hyperspectral imaging for plant disease detection and plant protection: a technical perspective. J Plant Dis Prot 125(1):5–20
Tm P, Pranathi A, SaiAshritha K, Chittaragi NB, Koolagudi SG (2018) Tomato leaf disease detection using convolutional neural networks. In: 2018 eleventh international conference on contemporary computing (IC3), IEEE, pp 1–5
Too EC, Yujian L, Njuki S, Yingchun L (2019) A comparative study of fine-tuning deep learning models for plant disease identification. Comput Electron Agric 161:272–279
Vardhana M, Arunkumar N, Lasrado S, Abdulhay E, Ramirez-Gonzalez G (2018) Convolutional neural network for bio-medical image segmentation with hardware acceleration. Cogn Syst Res 50:10–14
Vishnoi VK, Kumar K, Kumar B (2021) A comprehensive study of feature extraction techniques for plant leaf disease detection. Multimed Tools Appl 81:367–419
Wang G, Sun Y, Wang J (2017) Automatic image-based plant disease severity estimation using deep learning. Comput Intell Neurosci 2017:1–9. Article ID 2917536, https://doi.org/10.1155/2017/2917536
Wu SG, Bao FS, Xu EY, Wang Y-X, Chang Y-F, Xiang Q-L (2007) A leaf recognition algorithm for plant classification using probabilistic neural network. In: 2007 IEEE international symposium on signal processing and information technology, IEEE, pp 11–16
Wu Q, Chen Y, Meng J (2020) Dcgan-based data augmentation for tomato leaf disease identification. IEEE Access 8:98716–98728
Wu H, Wiesner-Hanks T, Stewart EL, DeChant C, Kaczmar N, Gore MA, Nelson RJ, Lipson H (2019) Autonomous detection of plant disease symptoms directly from aerial imagery. Plant Phenom J 2(1):1–9
Xing S, Lee M, Lee K-k (2019) Citrus pests and diseases recognition model using weakly dense connected convolution network. Sensors 19(14):3195
Xu Z, Guo X, Zhu A, He X, Zhao X, Han Y, Subedi R (2020) Using deep convolutional neural networks for image-based diagnosis of nutrient deficiencies in rice. Comput Intell Neurosci 2020:1–12. Article ID 7307252, https://doi.org/10.1155/2020/7307252
Yan Q, Yang B, Wang W, Wang B, Chen P, Zhang J (2020) Apple leaf diseases recognition based on an improved convolutional neural network. Sensors 20(12):3535
Zeiler MD, Fergus R (2014) Visualizing and understanding convolutional networks. In: European conference on computer vision, Springer, pp 818–833
Zeng Q, Ma X, Cheng B, Zhou E, Pang W (2020) Gans-based data augmentation for citrus disease severity detection using deep learning. IEEE Access 8:172882–172891
Zhang X, Han L, Dong Y, Shi Y, Huang W, Han L, González-Moreno P, Ma H, Ye H, Sobeih T (2019) A deep learning-based approach for automated yellow rust disease detection from high-resolution hyperspectral uav images. Remote Sens 11(13):1554
Zhang X, Qiao Y, Meng F, Fan C, Zhang M (2018) Identification of maize leaf diseases using improved deep convolutional neural networks. IEEE Access 6:30370–30377
Zhang K, Tan L, Li Z, Qiao Y (2016) Gender and smile classification using deep convolutional neural networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition workshops, pp 34–38
Zhang S, Wang Z (2016) Cucumber disease recognition based on global-local singular value decomposition. Neurocomputing 205:341–348
Zhang K, Wu Q, Liu A, Meng X (2018) Can deep learning identify tomato leaf disease?. Adv Multim 2018:6710865:1–6710865:10
Zhang N, Yang G, Pan Y, Yang X, Chen L, Zhao C (2020) A review of advanced technologies and development for hyperspectral-based plant disease detection in the past three decades. Remote Sens 12(19):3188
Zhang S, Zhang S, Zhang C, Wang X, Shi Y (2019) Cucumber leaf disease identification with global pooling dilated convolutional neural network. Comput Electron Agric 162:422–430
Zhou H, Huang H, Yang X, Zhang L, Qi L (2017) Faster r-cnn for marine organism detection and recognition using data augmentation. In: Proceedings of the international conference on video and image processing, pp 56–62
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Joseph, D.S., Pawar, P.M. & Pramanik, R. Intelligent plant disease diagnosis using convolutional neural network: a review. Multimed Tools Appl 82, 21415–21481 (2023). https://doi.org/10.1007/s11042-022-14004-6
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-022-14004-6