Abstract
Crop diseases can have a detrimental impact on crop growth, resulting in a significant reduction in crop yield. Therefore, accurate detection of these diseases is crucial for enhancing crop productivity. Despite notable advancements in deep learning techniques for disease identification, most experiments have been conducted under simplified laboratory conditions, posing challenges for accurately identifying crop diseases in complex real-world field environments. To bridge this gap, we draw inspiration from the Transformer model’s ability to capture long-range global dependencies and handle occlusion. We propose a novel approach called Dense CNNs and Transformer Network (DCTN) for accurate detection of field crop diseases. Moreover, we introduce a new attention mechanism that utilizes multi-head self-attention via deep separable convolution projection and down-sampling, significantly enhancing computational efficiency. Additionally, we have meticulously curated and cleaned a dataset of 45,547 images depicting healthy and diseased crops in real-field environments. Our proposed method demonstrates superior performance, particularly in terms of its robustness against background interference in crop disease detection. Notably, DCTN achieves accuracies of 93.01% and 99.69% on our dataset and a publicly available dataset, respectively. For those who are interested, the code for our approach will be made available on https://github.com/wh9704/DCTN.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The data are available from authors upon the reasonable request to the corresponding authors.
References
Abade A, Ferreira PA, Vidal F (2021) Plant diseases recognition on images using convolutional neural networks: A systematic review. Computers and Electronics in Agriculture 185:106125
Abdulridha J, Ampatzidis Y, Qureshi J et al (2020) Laboratory and UAV-based identification and classification of tomato yellow leaf curl, bacterial spot, and target spot diseases in tomato utilizing hyperspectral imaging and machine learning. Remote Sensing 12(17):2732
Adeel A, Khan MA, Akram T et al (2020) Entropy-controlled deep features selection framework for grape leaf diseases recognition. Expert Systems 1-17
Ahmad A, Saraswat D, Gamal AE et al (2021) CD &S Dataset: Handheld Imagery Dataset Acquired Under Field Conditions for Corn Disease Identification and Severity Estimation. arXiv preprint arXiv:2110.12084
Altieri MA (2018) Agroecology: the science of sustainable agriculture. CRC Press
Atila U, Ucar M, Akyol K et al (2021) Plant leaf disease classification using EfficientNet deep learning model. Ecological Informatics 61:101182
Bai XD, Cao ZG, Zhao LD et al (2018) Rice heading stage automatic observation by multi-classifier cascade based rice spike detection method. Agricultural and Forest Meteorology 259:260–270
Carion N, Massa F, Synnaeve G et al (2020) End-to-end object detection with transformers. European Conference on Computer Vision. Springer, Cham: 213-229
Chauhan S, Vashishtha G, Kumar A (2022) A symbiosis of arithmetic optimizer with slime mould algorithm for improving global optimization and conventional design problem. The Journal of Supercomputing 78(5):6234–6274
Chauhan S, Vashishtha G, Kumar A (2023) Approximating parameters of photovoltaic models using an amended reptile search algorithm. Journal of Ambient Intelligence and Humanized Computing 14(7):9073–9088
Chen J, Zhang D, Nanehkaran YA, Li D (2020) Detection of rice plant diseases based on deep transfer learning. Journal of the Science of Food and Agriculture 100(7):3246–3256
Chollet F (2017) Xception: Deep learning with depthwise separable convolutions. Proceedings of the IEEE conference on computer vision and pattern recognition:1251-1258
Chu X, Tian Z, Wang Y et al (2021) Twins: Revisiting the design of spatial attention in vision Transformers. arXiv preprint arXiv:2104.13840
Cubuk ED, Zoph et al (2018) Autoaugment: Learning augmentation policies from data. arXiv preprint arXiv:1805.09501
Dai Z, Cai B, Lin Y et al (2021) Up-detr: Unsupervised pre-training for object detection with Transformers. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition:1601-1610
Dai Z, Liu H, Le QV, et al. (2021) CoAtNet: Marrying convolution and attention for all data sizes. arXiv preprint arXiv:2106.04803
d’Ascoli S, Touvron H, Leavitt M et al (2021) Convit: Improving vision Transformers with soft convolutional inductive biases. arXiv preprint arXiv:2103.10697
Dosovitskiy A, Beyer L, Kolesnikov A et al (2020) An image is worth 16x16 words: Transformers for image recognition at scale. arXiv preprint arXiv:2010.11929
Ferentinos KP (2018) Deep learning models for plant disease detection and diagnosis. Computers and Electronics in Agriculture 145:311–318
Gandhi R, Nimbalkar S, Yelamanchili N et al (2018). Plant disease detection using CNNs and GANs as an augmentative approach. In 2018 IEEE International Conference on Innovative Research and Development (ICIRD). IEEE:1-5
Gao R, Wang R, Feng L et al (2021) Dual-branch, efficient, channel attention-based crop disease identification. Computers and Electronics in Agriculture 190:106410
Gui P, Dang W, Zhu F et al (2021) Towards automatic field plant disease recognition. Computers and Electronics in Agriculture 191:106523
He K, Zhang X, Ren S et al (2016) Deep residual learning for image recognition. Proceedings of the IEEE conference on computer vision and pattern recognition:770-778
Hou X, Yan J, Pan W, Liu Y (2021) Diagnosis Method of Tomato Leaf Disease Based on an Improved Deep Convolution Neural Network for Real-life Agriculture Environment. In 2021 IEEE 11th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER)IEEE:855-860
Huang G, Liu Z, Van Der Maaten L et al (2017) Densely connected convolutional networks. In Proceedings of the IEEE conference on computer vision and pattern recognition 2017:4700–4708
Hughes D, Salathe M (2015) An open access repository of images on plant health to enable the development of mobile disease diagnostics. arXiv preprint arXiv:1511.08060
Kamal KC, Yin Z, Wu M et al (2019) Depthwise separable convolution architectures for plant disease classification. Computers and Electronics in Agriculture 165(104948):1–6
Kanade P, Prasad JP (2021) Machine Learning Techniques in Plant Conditions Classification and Observation. 2021 5th International Conference on Computing Methodologies and Communication (ICCMC)IEEE:729-734
Karlekar A, Seal A (2020) SoyNet: Soybean leaf diseases classification. Computers and Electronics in Agriculture 172:105342
Li Y, Gal Y (2017) Dropout inference in Bayesian neural networks with alpha-divergences. Proceedings of the 34th International Conference on Machine Learning, PMLR 70:2052-2061
Lin TY, Dollar P, Girshick R et al (2017) Feature pyramid networks for object detection. Proceedings of the IEEE conference on computer vision and pattern recognition:2117-2125
Liu B, Zhang Y, He D, Li Y (2018) Identification of apple leaf diseases based on deep convolutional neural networks. Symmetry 10(1):1–16
Ma J, Du K, Zheng F et al (2018) A recognition method for cucumber diseases using leaf symptom images based on deep convolutional neural network. Computers and electronics in agriculture 154:18–24
Mohanty SP, Hughes DP, Salathe M (2016) Using deep learning for image-based plant disease detection. Frontiers in Plant Science 7:1–10
Naseer MM, Ranasinghe K, Khan SH et al (2021) Intriguing properties of vision transformers. Advances in Neural Information Processing Systems 34:23296–23308
Radosavovic I, Kosaraju RP, Girshick R et al (2020) Designing network design spaces. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition:10428-10436
Sujatha R, Chatterjee JM, Jhanjhi NZ, Brohi SN (2021) Performance of deep learning vs machine learning in plant leaf disease detection. Microprocessors and Microsystems 80:103615
Taggar GK, Arora R (2017) Insect Biotypes and Host Plant Resistance. In: Arora R, Sandhu S (eds) Breeding Insect Resistant Crops for Sustainable Agriculture. Springer, Singapore
Tan M, Le Q (2019) Efficientnet: Rethinking model scaling for convolutional neural networks. International Conference on Machine Learning PMLR:6105-6114
Thapa R, Zhang K, Snavely N et al (2020) The Plant Pathology Challenge 2020 data set to classify foliar disease of apples. Applications in Plant Sciences 8(9):1–8
Touvron H, Cord M, Douze M, Massa F, Sablayrolles A, Jegou H (2021) Training data-efficient image transformers & distillation through attention. In International Conference on Machine Learning. PMLR:10347-10357
Vashishtha G, Kumar R (2023) Feature selection based on gaussian ant lion optimizer for fault identification in centrifugal Pump. In: Gupta VK, Amarnath C, Tandon P, Ansari MZ (eds) Recent advances in machines and mechanisms. Springer Nature, Singapore, pp 295–310
Vaswani A, Shazeer N, Parmar N et al (2017) Attention is all you need. Advances in neural information processing systems:5998-6008
Wang D, Wang J, Li W et al (2021) T-CNN: Trilinear convolutional neural networks model for visual detection of plant diseases. Computers and Electronics in Agriculture 190:106468
Xie S, Girshick R, Dollar P et al (2017) Aggregated residual transformations for deep neural networks. Proceedings of the IEEE conference on computer vision and pattern recognition: 1492-1500
Yuan L, Chen Y, Wang T et al (2021) Tokens-to-token vit: Training vision Transformers from scratch on imagenet. arXiv preprint arXiv:2101.11986
Zeng Y, Fu J, Chao H (2020) Learning joint spatial-temporal transformations for video inpainting. European Conference on Computer Vision. Springer, Cham:528-543
Zhao Y, Liu L, Xie C et al (2020) An effective automatic system deployed in agricultural Internet of Things using Multi-Context Fusion Network towards crop disease recognition in the wild. Applied Soft Computing 89:106128
Acknowledgements
This work was supported by National Natural Science Foundation of China (Grant Numbers 62273001, 62072002, 61906118, 12301185), Anhui Provincial Major Science and Technology Special Program (Grant Number 202003a06020016).
Author information
Authors and Affiliations
Contributions
DP contributed to methodology, conceptualization, formal analysis, writing—review and editing, supervision. HW contributed to investigation, writing—original draft, conducted the experiments. JM contributed to methodology, writing—review, technical supports. DL contributed to supervision and project administration.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no relevant financial or non-financial interests to disclose.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Pang, D., Wang, H., Ma, J. et al. DCTN: a dense parallel network combining CNN and transformer for identifying plant disease in field. Soft Comput 27, 15549–15561 (2023). https://doi.org/10.1007/s00500-023-09071-2
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-023-09071-2