Skip to main content
SpringerLink
Log in

Low complexity image enhancement GAN-based algorithm for improving low-resolution image crop disease recognition and diagnosis

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Image analysis plays a crucial role in many real-world applications such as smart agriculture. For plant diseases diagnosis, one of the most recent challenges is the improvement of the plant diseases classification on Low-Resolution (LR) images. The farmer is supposed to obtain High-Resolution (HR) images of plant leaves from the field. Because of the small size of plant leaves and other limitations, the obtained HR images can miss some detailed information that results in blurred LR images of leaves with fewer details. In this paper, we introduce a novel Super-Resolution (SR) algorithm named Wider-activation for Attention-mechanism based on a Generative Adversarial Network (WAGAN) to improve the classification of the tomato diseases LR images. The WAGAN consists of three main parts; the generator network, which has the Wider Activation for Residual Channel Attention Block (WARCAB) as the principal block, the discriminator network and the adversarial loss. To evaluate the potential of the proposed method in plant diseases recognition, we first recovered SR plant diseases images from LR images using the WAGAN. Next, we implemented diseases classification using LR, SR, and HR images. The results proved the efficacy of the proposed method (97.63%) with ×3.6 lower complexity than the state-of-the-art method and very close to the reference HR (97.81%) accuracy. Due to the efficient design of WARCAB and the adversarial loss, the WAGAN focuses more on edges, textures, and other valuable information, which are the key information, needed for the classifier to recognize the disease.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Agarwal M, Gupta SK, Biswas KK (2020) Development of efficient CNN model for tomato crop disease identification. Sustain Comput Inform Syst 28:100407. https://doi.org/10.1016/j.suscom.2020.100407

    Article  Google Scholar 

  2. Agarwal M, Singh A, Arjaria S, Sinha A, Gupta S (2020) ToLeD: tomato leaf disease detection using convolution neural network. Proc Comput Sci 167:293–301. https://doi.org/10.1016/j.procs.2020.03.225

    Article  Google Scholar 

  3. Agustsson E, Timofte R (2017) NTIRE 2017 challenge on single image super-resolution: dataset and study. In: 2017 IEEE conference on computer vision and pattern recognition workshops (CVPRW), pp 1122–1131

  4. Arnal Barbedo JG (2019) Plant disease identification from individual lesions and spots using deep learning. Biosyst Eng 180:96–107. https://doi.org/10.1016/j.biosystemseng.2019.02.002

    Article  Google Scholar 

  5. Arsenovic M, Karanovic M, Sladojevic S et al (2019) Solving current limitations of deep learning based approaches for plant disease detection. Symmetry (Basel):11. https://doi.org/10.3390/sym11070939

  6. Atila Ü, Uçar M, Akyol K, Uçar E (2021) Plant leaf disease classification using EfficientNet deep learning model. Ecol Inform 61:101182. https://doi.org/10.1016/j.ecoinf.2020.101182

    Article  Google Scholar 

  7. Bisen D (2021) Deep convolutional neural network based plant species recognition through features of leaf. Multimed Tools Appl 80:6443–6456. https://doi.org/10.1007/s11042-020-10038-w

    Article  Google Scholar 

  8. Cap QH, Tani H, Uga H et al (2019) Super-Resolution for Practical Automated Plant Disease Diagnosis System. In: 2019 53rd Annual Conference on Information Sciences and Systems (CISS). pp 1–6

  9. Chen J, Zhang D, Nanehkaran YA (2020) Identifying plant diseases using deep transfer learning and enhanced lightweight network. Multimed Tools Appl 79:31497–31515. https://doi.org/10.1007/s11042-020-09669-w

    Article  Google Scholar 

  10. Chen X, Zhou G, Chen A, Yi J, Zhang W, Hu Y (2020) Identification of tomato leaf diseases based on combination of ABCK-BWTR and B-ARNet. Comput Electron Agric 178:105730. https://doi.org/10.1016/j.compag.2020.105730

    Article  Google Scholar 

  11. Dai Q, Cheng X, Qiao Y, Zhang Y (2020) Crop leaf disease image super-resolution and identification with dual attention and topology fusion generative adversarial network. IEEE Access 8:55724–55735. https://doi.org/10.1109/ACCESS.2020.2982055

    Article  Google Scholar 

  12. Dong C, Loy CC, He K, Tang X (2014) Learning a deep convolutional network for image super-resolution BT - computer vision – ECCV 2014. In: Pajdla T, Schiele B, Tuytelaars T (eds) Fleet D. Springer International Publishing, Cham, pp 184–199

    Google Scholar 

  13. Emmanuel TO (2018) PlantVillage Dataset. In: Kaggle.com. https://www.kaggle.com/emmarex/plantdisease. Accessed 12 Dec 2020

  14. Espejo-Garcia B, Mylonas N, Athanasakos L, Vali E, Fountas S (2021) Combining generative adversarial networks and agricultural transfer learning for weeds identification. Biosyst Eng 204:79–89. https://doi.org/10.1016/j.biosystemseng.2021.01.014

    Article  Google Scholar 

  15. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

    Google Scholar 

  16. Huang G, Liu Z, Van Der Maaten L, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings - 30th IEEE conference on computer vision and pattern recognition, CVPR 2017

  17. Hughes DP, Salathé M (2015) An open access repository of images on plant health to enable the development of mobile disease diagnostics through machine learning and crowdsourcing. CoRR abs/1511.0:

  18. Hunter MC, Smith RG, Schipanski ME, Atwood LW, Mortensen DA (2017) Agriculture in 2050: recalibrating targets for sustainable intensification. Bioscience 67:386–391. https://doi.org/10.1093/biosci/bix010

    Article  Google Scholar 

  19. Karthik R, Hariharan M, Anand S et al (2020) Attention embedded residual CNN for disease detection in tomato leaves. Appl Soft Comput 86:105933. https://doi.org/10.1016/j.asoc.2019.105933

    Article  Google Scholar 

  20. Khairuzzaman MQ (2016) Tf.data. https://www.tensorflow.org/guide/data. Accessed 12 Dec 2020

  21. Khan MA, Akram T, Sharif M, Javed K, Raza M, Saba T (2020) An automated system for cucumber leaf diseased spot detection and classification using improved saliency method and deep features selection. Multimed Tools Appl 79:18627–18656. https://doi.org/10.1007/s11042-020-08726-8

    Article  Google Scholar 

  22. Kingma DP, Ba JL (2015) Adam: a method for stochastic optimization. In: 3rd international conference on learning representations, ICLR 2015 - conference track proceedings

  23. Krizhevsky A, Sutskever I, Hinton GE (2012) ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems

  24. Ledig C, Theis L, Huszár F et al (2017) Photo-realistic single image super-resolution using a generative adversarial network. In: Proceedings - 30th IEEE conference on computer vision and pattern recognition, CVPR 2017

    Google Scholar 

  25. Li Y, Zou B, Deng S, Zhou G (2020) Using feature fusion strategies in continuous authentication on smartphones. IEEE Internet Comput 24:49–56. https://doi.org/10.1109/MIC.2020.2971447

    Article  Google Scholar 

  26. Liang Q, Xiang S, Hu Y, Coppola G, Zhang D, Sun W (2019) PD2SE-net: computer-assisted plant disease diagnosis and severity estimation network. Comput Electron Agric 157:518–529. https://doi.org/10.1016/j.compag.2019.01.034

    Article  Google Scholar 

  27. Lim B, Son S, Kim H et al (2017) Enhanced deep residual networks for single image super-resolution. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops

    Google Scholar 

  28. Lin M, Chen Q, Yan S (2014) Network in network. CoRR abs/1312.4

  29. Lu J, Ehsani R, Shi Y, de Castro AI, Wang S (2018) Detection of multi-tomato leaf diseases (late blight, target and bacterial spots) in different stages by using a spectral-based sensor. Sci Rep 8:2793. https://doi.org/10.1038/s41598-018-21191-6

    Article  Google Scholar 

  30. Mahmoud MAB, Guo P, Wang K (2020) Pseudoinverse learning autoencoder with DCGAN for plant diseases classification. Multimed Tools Appl 79:26245–26263. https://doi.org/10.1007/s11042-020-09239-0

    Article  Google Scholar 

  31. Nah S, Kim TH, Lee KM (2017) Deep multi-scale convolutional neural network for dynamic scene deblurring. In: Proceedings - 30th IEEE conference on computer vision and pattern recognition, CVPR 2017

  32. Nazki H, Yoon S, Fuentes A, Park DS (2020) Unsupervised image translation using adversarial networks for improved plant disease recognition. Comput Electron Agric 168:105117. https://doi.org/10.1016/j.compag.2019.105117

    Article  Google Scholar 

  33. Ozguven MM, Adem K (2019) Automatic detection and classification of leaf spot disease in sugar beet using deep learning algorithms. Phys A Stat Mech its Appl 535:122537. https://doi.org/10.1016/j.physa.2019.122537

    Article  Google Scholar 

  34. Qin H, El-Yacoubi MA, Li Y, Liu C (2021) Multi-Scale and Multi-Direction GAN for CNN-Based Single Palm-Vein Identification. IEEE Trans Inf Forensics Secur 16: https://doi.org/10.1109/TIFS.2021.3059340

  35. Salimans T, Kingma DP (2016) Weight normalization: a simple reparameterization to accelerate training of deep neural networks. In: Advances in Neural Information Processing Systems

    Google Scholar 

  36. Sardogan M, Tuncer A, Ozen Y (2018) Plant leaf disease detection and classification based on CNN with LVQ algorithm. In: UBMK 2018 - 3rd International Conference on Computer Science and Engineering

    Google Scholar 

  37. Savary S, Ficke A, Aubertot J-N, Hollier C (2012) Crop losses due to diseases and their implications for global food production losses and food security. Food Secur 4:519–537. https://doi.org/10.1007/s12571-012-0200-5

    Article  Google Scholar 

  38. Shi W, Caballero J, Huszar F et al (2016) Real-time single image and video super-resolution using an efficient sub-pixel convolutional neural network. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

    Google Scholar 

  39. Simonyan K, Zisserman A (2015) Very deep convolutional networks for large-scale image recognition. In: 3rd International Conference on Learning Representations, ICLR 2015 - Conference Track Proceedings

  40. Sun R, Zhang M, Yang K, Liu J (2020) Data enhancement for plant disease classification using generated lesions. Appl Sci:10. https://doi.org/10.3390/app10020466

  41. Szegedy C, Ioffe S, Vanhoucke V (2016) Inception-v4, inception-ResNet and the impact of residual connections on learning. CoRR abs/1602.0

  42. Tan M, Le QV (2019) EfficientNet: rethinking model scaling for convolutional neural networks. In: 36th international conference on machine learning. ICML 2019

    Google Scholar 

  43. Tang H, Xu D, Sebe N et al (2019) Multi-channel attention selection Gan with cascaded semantic guidance for cross-view image translation. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition

    Google Scholar 

  44. Tm P, Pranathi A, SaiAshritha K et al (2018) Tomato leaf disease detection using convolutional neural networks. In: 2018 eleventh international conference on contemporary computing (IC3), pp 1–5

    Google Scholar 

  45. Too EC, Yujian L, Njuki S, Yingchun L (2019) A comparative study of fine-tuning deep learning models for plant disease identification. Comput Electron Agric 161:272–279. https://doi.org/10.1016/j.compag.2018.03.032

    Article  Google Scholar 

  46. Torres-Sánchez J, López-Granados F, De Castro AI, Peña-Barragán JM (2013) Configuration and specifications of an unmanned aerial vehicle (UAV) for early site specific Weed Management. PLoS ONE 8, 8. https://doi.org/10.1371/journal.pone.0058210

  47. Trang K, TonThat L, Thao NGM, Thi NTT (2019) Mango diseases identification by a deep residual network with contrast enhancement and transfer learning. In: 2019 IEEE conference on sustainable utilization and development in engineering and technologies (CSUDET). Pp 138–142

  48. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13:600–612. https://doi.org/10.1109/TIP.2003.819861

    Article  Google Scholar 

  49. Wang X, Yu K, Wu S et al (2019) ESRGAN: enhanced super-resolution generative adversarial networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)

    Google Scholar 

  50. Wen J, Shi Y, Zhou X, Xue Y (2020) Crop disease classification on inadequate low-resolution target images. Sensors (Basel) 20. https://doi.org/10.3390/s20164601

  51. Wu H, Wiesner-Hanks T, Stewart EL, DeChant C, Kaczmar N, Gore MA, Nelson RJ, Lipson H (2019) Autonomous detection of plant disease symptoms directly from aerial imagery. Plant Phenome J 2:190006–190009. https://doi.org/10.2135/tppj2019.03.0006

    Article  Google Scholar 

  52. Wu P, Cui Z, Gan Z, Liu F (2020) Residual group channel and space attention network for hyperspectral image classification. Remote Sens 12. https://doi.org/10.3390/rs12122035

  53. Yamamoto K, Togami T, Yamaguchi N (2017) Super-resolution of plant disease images for the acceleration of image-based phenotyping and vigor diagnosis in agriculture. Sensors 17:2557. https://doi.org/10.3390/s17112557

    Article  Google Scholar 

  54. Yilma G, Belay S, Qin Z et al (2020) Plant disease classification using two pathway encoder GAN data generation. In: 2020 17th international computer conference on wavelet active media technology and information processing (ICCWAMTIP), pp 67–72

    Chapter  Google Scholar 

  55. Yu J, Fan Y, Yang J, et al (2018) Wide activation for efficient and accurate image super-resolution. CoRR abs/1808.0

  56. Zhang Y, Li Y, Wen W, Wu Y, Chen JX (2015) Deciphering an image cipher based on 3-cell chaotic map and biological operations. Nonlinear Dyn 82:1831–1837. https://doi.org/10.1007/s11071-015-2280-1

    Article  MathSciNet  MATH  Google Scholar 

  57. Zhang Y, Li K, Li K et al (2018) Image super-resolution using very deep residual channel attention networks. In: Lecture notes in computer science (including subseries lecture notes in artificial intelligence and lecture notes in bioinformatics)

    Google Scholar 

  58. Zhang L, Jia J, Li Y et al (2019) Deep learning based rapid diagnosis system for identifying tomato nutrition disorders KSII Trans Internet Inf Syst:13. https://doi.org/10.3837/tiis.2019.04.015

  59. Zhang Y, Song C, Zhang D (2020) Deep learning-based object detection improvement for tomato disease. IEEE Access 8:56607–56614

    Article  Google Scholar 

  60. Zhao H, Gallo O, Frosio I, Kautz J (2017) Loss functions for image restoration with neural networks. IEEE Trans Comput Imaging 3:47–57. https://doi.org/10.1109/TCI.2016.2644865

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Frères Mentouri University-Constantine 1, Lab SISCOM, Constantine, Algeria

    Abderrahmane Salmi & Mehdi Ghazi

  2. Frères Mentouri University-Constantine 1, SP_Lab, Constantine, Algeria

    Said Benierbah

Authors
  1. Abderrahmane Salmi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Said Benierbah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mehdi Ghazi
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Abderrahmane Salmi.

Ethics declarations

Conflict of interest

The authors declare no conflicts of interest.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Salmi, A., Benierbah, S. & Ghazi, M. Low complexity image enhancement GAN-based algorithm for improving low-resolution image crop disease recognition and diagnosis. Multimed Tools Appl 81, 8519–8538 (2022). https://doi.org/10.1007/s11042-022-12256-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-022-12256-w

Keywords

Search

Navigation