Skip to main content
Log in

Crop protection and disease detection using artificial intelligence and computer vision: a comprehensive review

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The technological advancements in the field of agriculture have increased to a great extent in recent years, and many techniques have evolved from other techniques. Some methods are improved or upgraded from the previous versions by implementing a new model or using better hardware devices. This has been helpful for the farmers in increasing crop productivity, and the life expectancy of crops has also increased as the diseases inside or outside the crops can be detected much earlier, and learning at an early stage helps prevent other crops. In this paper, we have presented a study where many varieties of fruits and vegetables have been taken to determine which method was used for a particular crop. By analyzing the various works carried out by the authors, it was inferred that most of the works revolved around image processing and hyperspectral imaging. Due to this, we had also included most of the papers, particularly as the models and hardware components used were much better than other works. Then, a comparative study was done where different fruits and vegetables highlighted the two main areas: the method used and the accuracy obtained.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data availability

All relevant data and material are presented in the main paper.

References

  1. Dhanabal T (2013) Computerized Spoiled Tomato Detection. Int J Res Eng Technol 02(11):38–41. https://doi.org/10.15623/ijret.2013.0211007

    Article  Google Scholar 

  2. Ali, MAH, Thai, KW (2017) Automated fruit grading system. 2017 IEEE 3rd International Symposium in Robotics and Manufacturing Automation, ROMA 2017, 2017-Decem, 1–6. https://doi.org/10.1109/ROMA.2017.8231734

  3. Altaheri H, Alsulaiman M, Muhammad G (2019) Date Fruit Classification for Robotic Harvesting in a Natural Environment Using Deep Learning. IEEE Access 7:117115–117133. https://doi.org/10.1109/ACCESS.2019.2936536

    Article  Google Scholar 

  4. Álvarez-Bermejo JA, Giagnocavo C, Li M, Morales EC, Santos DPM, Yang XT (2017) Image processing methods to evaluate tomato and zucchini damage in post-harvest stages. Int J Agricultural Biol Eng 10(5):126–133. https://doi.org/10.25165/j.ijabe.20171005.3087

    Article  Google Scholar 

  5. Arboleda, ER, Fajardo, AC, Medina, RP (2018) An image processing technique for coffee black beans identification. 2018 IEEE International Conference on Innovative Research and Development, ICIRD 2018, 1–5. https://doi.org/10.1109/ICIRD.2018.8376325

  6. Ariana D, Guyer DE, Shrestha B (2006) Integrating multispectral reflectance and fluorescence imaging for defect detection on apples. Comput Electron Agric 50(2):148–161. https://doi.org/10.1016/j.compag.2005.10.002

    Article  Google Scholar 

  7. Arjenaki OO, Moghaddam PA, Motlagh AM (2013) Online tomato sorting based on shape, maturity, size, and surface defects using machine vision. Turk J Agric For 37(1):62–68. https://doi.org/10.3906/tar-1201-10

    Article  Google Scholar 

  8. Arzate-Vázquez I, Chanona-Pérez JJ, de Perea-Flores MJ, Calderón-Domínguez G, Moreno-Armendáriz MA, Calvo H, Godoy-Calderón S, Quevedo R, Gutiérrez-López G (2011) Image Processing Applied to Classification of Avocado Variety Hass (Persea americana Mill.) During the Ripening Process. Food Bioprocess Technol 4(7):1307–1313. https://doi.org/10.1007/s11947-011-0595-6

    Article  Google Scholar 

  9. Barnes M, Duckett T, Cielniak G, Stroud G, Harper G (2010) Visual detection of blemishes in potatoes using minimalist boosted classifiers. J Food Eng 98(3):339–346. https://doi.org/10.1016/j.jfoodeng.2010.01.010

    Article  Google Scholar 

  10. Bhargava, A, Bansal, A (2021) Fruits and vegetables quality evaluation using computer vision: A review. In Journal of King Saud University - Computer and Information Sciences (Vol. 33, Issue 3). J King Saud Univ Comput Information Sci https://doi.org/10.1016/j.jksuci.2018.06.002

  11. Blasco J, Aleixos N, Moltó E (2003) Machine vision system for automatic quality grading of fruit. Biosys Eng 85(4):415–423. https://doi.org/10.1016/S1537-5110(03)00088-6

    Article  Google Scholar 

  12. Callejon-Ferre AJ, Manzano-Agugliaro F, Diaz-Perez M, Carreno-Sanchez J (2011) Improving the climate safety of workers in Almeria-type greenhouses in Spain by predicting the periods when they are most likely to suffer thermal stress. Appl Ergon 42:391–396

    Article  Google Scholar 

  13. Cárdenas-Pérez S, Chanona-Pérez J, Méndez-Méndez JV, Calderón-Domínguez G, López-Santiago R, Perea-Flores MJ, Arzate-Vázquez I (2017) Evaluation of the ripening stages of apple (Golden Delicious) by means of computer vision system. Biosys Eng 159:46–58. https://doi.org/10.1016/j.biosystemseng.2017.04.009

    Article  Google Scholar 

  14. Cavallo DP, Cefola M, Pace B, Logrieco AF, Attolico G (2018) Non-destructive automatic quality evaluation of fresh-cut iceberg lettuce through packaging material. J Food Eng 223:46–52. https://doi.org/10.1016/j.jfoodeng.2017.11.042

    Article  Google Scholar 

  15. Chauhan, VK, Shukla, SK, Tirkey, JV, Singh Rathore, PK (2021) A comprehensive review of direct solar desalination techniques and its advancements. J Cleaner Product, 284. https://doi.org/10.1016/j.jclepro.2020.124719

  16. Chong VK, Kondo N, Ninomiya K, Nishi T, Monta M, Namba K, Zhang Q (2008) Features extraction for eggplant fruit grading system using machine vision. Appl Eng Agric 24(5):675–684

    Article  Google Scholar 

  17. Cruz, AC, Luvisi, A, De Bellis, L, Ampatzidis, Y (2017) Vision-based plant disease detection system using transfer and deep learning. 2017 ASABE Annual International Meeting. https://doi.org/10.13031/aim.201700241

  18. Dat, DT, Dao Xuan Hai, N, Thinh, NT (2019) Detection and Classification Defects on Exported Banana Leaves by Computer Vision. Proceedings of 2019 International Conference on System Science and Engineering, ICSSE 2019, 609–613. https://doi.org/10.1109/ICSSE.2019.8823097

  19. Diana Carolina, CP, Deivis David, NT (2014) Classification of oranges by maturity, using image processing techniques. 2014 3rd International Congress of Engineering Mechatronics and Automation, CIIMA 2014 - Conference Proceedings, 2014. https://doi.org/10.1109/CIIMA.2014.6983466

  20. Diaz R, Faus G, Blasco M, Blasco J, Moltó E (2000) The application of a fast algorithm for the classification of olives by machine vision. Food Res Int 33(3–4):305–309. https://doi.org/10.1016/S0963-9969(00)00041-7

    Article  Google Scholar 

  21. Dolaty H (2012) Sorting and grading of cherries on the basis of ripeness, size and defects by using image processing techniques. Int J Agriculture Crop Sci (IJACS) 4(16):1144–1149

    Google Scholar 

  22. Dorj UO, Lee M, Yun SS (2017) An yield estimation in citrus orchards via fruit detection and counting using image processing. Comput Electron Agric 140:103–112. https://doi.org/10.1016/j.compag.2017.05.019

    Article  Google Scholar 

  23. Du, Y, Hu, Y, San, L, Tian, J (2019) Research on Potato Appearance Quality Detection Based on Computer Vision. In 2019 5th International Conference on Control, Automation and Robotics, ICCAR 2019. Automation and Robotics (ICCAR. https://doi.org/10.1109/ICCAR.2019.8813453

  24. Dubey SR, Jalal AS (2015) Application of Image Processing in Fruit and Vegetable Analysis: A Review. J Intell Syst 24(4):405–424. https://doi.org/10.1515/jisys-2014-0079

    Article  Google Scholar 

  25. Esehaghbeygi A, Ardforoushan M, Monajemf SAH, Masoumi AA (2010) Digital image processing for quality ranking of saffron peach. Int Agrophysics 24(2):115–120

    Google Scholar 

  26. Garrido-Novell C, Pérez-Marin D, Amigo JM, Fernández-Novales J, Guerrero JE, Garrido-Varo A (2012) Grading and color evolution of apples using RGB and hyperspectral imaging vision cameras. J Food Eng 113(2):281–288. https://doi.org/10.1016/j.jfoodeng.2012.05.038

    Article  Google Scholar 

  27. Gowen AA, O’Donnell CP, Taghizadeh M, Cullen PJ, Frias JM, Downey G (2008) Hyperspectral imaging combined with principal component analysis for bruise damage detection on white mushrooms [Agaricus bisporus). J Chemom 22(3–4):259–267. https://doi.org/10.1002/cem.1127

    Article  Google Scholar 

  28. Hasankhani R, Navid H (2012) Potato Sorting Based on Size and Color in Machine Vision System. J Agric Sci 4(5):5. https://doi.org/10.5539/jas.v4n5p235

    Article  Google Scholar 

  29. Hazisawa, T, Toda, M, Sakoil, T, Matumural, K, Fukuda, M (2013) Image analysis method for grading raw shiitake mushrooms. FCV 2013 - Proceedings of the 19th Korea-Japan Joint Workshop on Frontiers of Computer Vision, 19, 46–52. https://doi.org/10.1109/FCV.2013.6485458

  30. Howlader, MR, Habiba, U, Faisal, RH, Rahman, MM (2019) Automatic Recognition of Guava Leaf Diseases using Deep Convolution Neural Network. 2nd International Conference on Electrical, Computer and Communication Engineering, ECCE 2019, 1–5. https://doi.org/10.1109/ECACE.2019.8679421

  31. Islam M, Dinh A, Wahid K, Bhowmik P (2017) Detection of potato diseases using image segmentation and multiclass support vector machine. Canadian Conference Electric Comput Eng. https://doi.org/10.1109/CCECE.2017.7946594

    Article  Google Scholar 

  32. Jhawar J (2016) Orange Sorting by Applying Pattern Recognition on Colour Image. Phys Procedia 78:691–697. https://doi.org/10.1016/j.procs.2016.02.118

    Article  Google Scholar 

  33. Kang SP, East AR, Trujillo FJ (2008) Colour vision system evaluation of bicolour fruit: A case study with “B74” mango. Postharvest Biol Technol 49(1):77–85. https://doi.org/10.1016/j.postharvbio.2007.12.011

    Article  Google Scholar 

  34. Kang, T, Ke, R, Leiqing, P, Hongwen, L (2007) A study of Broccoli grading system based on machine vision and neural networks. In A. Study (Ed.), Proceedings of the 2007 IEEE International Conference on Mechatronics and Automation, ICMA 2007 (pp. 2332–2336). 2007 International Conference on Mechatronics and Automation. https://doi.org/10.1109/ICMA.2007.4303917

  35. Khojastehnazhand M, Omid M, Tabatabaeefar A (2010) Development of a lemon sorting system based on color and size. Plant Sci 4(April):122–127

    Google Scholar 

  36. Kini AS, Reddy PKV, Pai SN (2023) Techniques of deep learning and image processing in plant leaf disease detection: a review. Int J Electric Comput Eng 13(3):3029–3040. https://doi.org/10.11591/ijece.v13i3.pp3029-3040

    Article  Google Scholar 

  37. Lamb, N, Chuah, MC (2018) A Strawberry Detection System Using Convolutional Neural Networks. In A. Strawberry (Ed.), Proceedings - 2018 IEEE International Conference on Big Data, Big Data 2018 (pp. 2515–2520). 2018 IEEE International Conference on Big Data (Big Data. https://doi.org/10.1109/BigData.2018.8622466

  38. Li, J, Wang, P, Geng, C (2017) The Disease Assessment of Cucumber Downy Mildew Based on Image Processing. In Proceedings - 2017 International Conference on Computer Network, Electronic and Automation, ICCNEA 2017 (Vols. 2017-Janua). Electronic and Automation (ICCNEA. https://doi.org/10.1109/ICCNEA.2017.65

  39. Liang J, Wang Y, Chen Y, Yang B, Liu D (2022) A Triangulation-Based Visual Localization for Field Robots. IEEE/CAA J Automatica Sinica 9(6):1083–1086. https://doi.org/10.1109/JAS.2022.105632

    Article  Google Scholar 

  40. Liming X, Yanchao Z (2010) Automated strawberry grading system based on image processing. Comput Electron Agric 71(SUPPL. 1):S32–S39. https://doi.org/10.1016/j.compag.2009.09.013

    Article  Google Scholar 

  41. Lino ACL, Sanches J, Dal Fabbro IM (2008) Image processing techniques for lemons and tomatoes classification. Bragantia 67(3):785–789. https://doi.org/10.1590/S0006-87052008000300029

    Article  Google Scholar 

  42. Liu, D, Cui, Y, Yan, L, Mousas, C, Yang, B, Chen, Y (2021) DenserNet: Weakly Supervised Visual Localization Using Multi-Scale Feature Aggregation. 35th AAAI Conference on Artificial Intelligence, AAAI 2021, 7, 6101–6109. https://doi.org/10.1609/aaai.v35i7.16760

  43. Liu Y, Chen YR, Wang CY, Chan DE, Kim MS (2006) Development of hyperspectral imaging technique for the detection of chilling injury in cucumbers; spectral and image analysis. Appl Eng Agric 22(1):101–111

    Article  Google Scholar 

  44. Danti A, Madgi M, Anami BS (2012) Mean and range color features based identification of common indian leafy vegetables artificial neural network view project computer application in paddy improvement view project mean and range color features based identification of common indian leafy ve. Int J Signal Process 5(3):151–160. https://www.researchgate.net/publication/269279174. Accessed 24 Apr 2024

    Google Scholar 

  45. Mehra, T, Kumar, V, Gupta, P (2016) Maturity and disease detection in tomato using computer vision. In 2016 4th International Conference on Parallel, Distributed and Grid Computing, PDGC 2016. Distributed and Grid Computing (PDGC. https://doi.org/10.1109/PDGC.2016.7913228

  46. Mendoza F, Dejmek P, Aguilera JM (2006) Calibrated color measurements of agricultural foods using image analysis. Postharvest Biol Technol 41(3):285–295. https://doi.org/10.1016/j.postharvbio.2006.04.004

    Article  Google Scholar 

  47. Meng, RQ, Cui, SG, Zhang, YL, Wu, XL, He, L (2018) Segmentation of disease image of lettuce leaves based on machine vision. Proceedings of the 30th Chinese Control and Decision Conference, CCDC 2018, 2018, 6590–6594. https://doi.org/10.1109/CCDC.2018.8408289

  48. Monteiro ST, Minekawa Y, Kosugi Y, Akazawa T, Oda K (2007) Prediction of sweetness and amino acid content in soybean crops from hyperspectral imagery. ISPRS J Photogramm Remote Sens 62(1):2–12. https://doi.org/10.1016/j.isprsjprs.2006.12.002

    Article  Google Scholar 

  49. Nandi, CS, Tudu, B, Koley, C (2014) Machine vision based automatic fruit grading system using fuzzy algorithm. In E. Instrumentation (Ed.), International Conference on Control, Instrumentation, Energy and Communication, CIEC 2014 (pp. 26–30). and Communication (CIEC. https://doi.org/10.1109/CIEC.2014.6959043

  50. Nandi CS, Tudu B, Koley C (2016) A machine vision technique for grading of harvested mangoes based on maturity and quality. IEEE Sens J 16(16):6387–6396. https://doi.org/10.1109/JSEN.2016.2580221

    Article  Google Scholar 

  51. Pereira LFS, Barbon S Jr, Valous NA, Barbin DF (2018) Predicting the ripening of papaya fruit with digital imaging and random forests. Comput Electron Agric 145:76–82

    Article  Google Scholar 

  52. Pham VH, Lee BR (2015) An image segmentation approach for fruit defect detection using k-means clustering and graph-based algorithm. Vietnam J Comput Sci 2(1):25–33. https://doi.org/10.1007/s40595-014-0028-3

    Article  Google Scholar 

  53. Pawar PS, Sarkar A (2013) Cost effective grading process for grape raisins based on hsi and fuzzy logic algorithms. Int J Comput Appl 67(22):18–22. https://doi.org/10.5120/11527-7335

    Article  Google Scholar 

  54. Qin J, Lu R (2005) Detection of pits in tart cherries by hyperspectral transmission imaging. Trans Am Soc Agricultural Eng 48(5):1963–1970. https://doi.org/10.13031/2013.19988

    Article  Google Scholar 

  55. Quevedo R, Mendoza F, Aguilera JM, Chanona J, Gutiérrez-López G (2008) Determination of senescent spotting in banana (Musa cavendish) using fractal texture Fourier image. J Food Eng 84(4):509–515. https://doi.org/10.1016/j.jfoodeng.2007.06.013

    Article  Google Scholar 

  56. Rani, KAA, Supriya, P, Sarath, TV (2017) Computer vision based segregation of carrot and curry leaf plants with weed identification in carrot field. Proceedings of the International Conference on Computing Methodologies and Communication, ICCMC 2017, 2018-Janua, 185–188. https://doi.org/10.1109/ICCMC.2017.8282671

  57. Rojas-Moraleda R, Valous NA, Gowen A, Esquerre C, Härtel S, Salinas L, O’Donnell C (2017) A frame-based ANN for classification of hyperspectral images: assessment of mechanical damage in mushrooms. Neural Comput Appl 28:969–981. https://doi.org/10.1007/s00521-016-2376-7

    Article  Google Scholar 

  58. Rokunuzzaman M, Jayasuriya HPW (2013) Development of a low cost machine vision system for sorting of tomatoes. Agric Eng Int CIGR J 15(1):173–180

    Google Scholar 

  59. Rong D, Rao X, Ying Y (2017) Computer vision detection of surface defect on oranges by means of a sliding comparison window local segmentation algorithm. Comput Electron Agric 137:59–68. https://doi.org/10.1016/j.compag.2017.02.027

    Article  Google Scholar 

  60. S, Dr. B., P, S., P, S., S, S., & K, V. K (2017) Advances in Image Processing for Detection of Plant Disease. The SIJ Trans Comput Sci Eng Its Appl (CSEA) 05(02):08–10. https://doi.org/10.9756/sijcsea/v5i2/05010140101

    Article  Google Scholar 

  61. Sendin K, Manley M, Williams PJ (2018) Classification of white maize defects with multispectral imaging. Food Chem 243:311–318. https://doi.org/10.1016/j.foodchem.2017.09.133

    Article  Google Scholar 

  62. Shahin MA, Symons SJ (2001) A machine vision system for grading lentils. Canadian Biosyst Eng/Le Genie Des Biosystems Au Canada 43(7):77–714

    Google Scholar 

  63. Si Y, Sankaran S, Knowles NR, Pavek MJ (2017) Potato Tuber Length-Width Ratio Assessment Using Image Analysis. Am J Potato Res 94(1):88–93. https://doi.org/10.1007/s12230-016-9545-1

    Article  Google Scholar 

  64. Suresha M, Shilpa NA, Soumya B (2012) Apples grading based on SVM classifier. International Journal of Computer Applications on National Conference on Advanced Computing and Communications - NCACC. pp 27–30

    Google Scholar 

  65. Surya Prabha D, Satheesh Kumar J (2015) Assessment of banana fruit maturity by image processing technique. J Food Sci Technol 52(3):1316–1327. https://doi.org/10.1007/s13197-013-1188-3

    Article  Google Scholar 

  66. Tâm T, Và NCỨU, Giao CỂN, Ngh C, Chu ẨNBỤI (2016) 済無No Title No Title No Title. Pattern Recognition System of Jatropha Curcas Fruits Using Back Propagation 01:1–23. https://doi.org/10.1109/icsipa.2009.547871

    Article  Google Scholar 

  67. Vidal A, Talens P, Prats-Montalbán JM, Cubero S, Albert F, Blasco J (2013) In-Line Estimation of the Standard Colour Index of Citrus Fruits Using a Computer Vision System Developed For a Mobile Platform. Food Bioprocess Technol 6(12):3412–3419. https://doi.org/10.1007/s11947-012-1015-2

    Article  Google Scholar 

  68. Weilin Wang, Chi Thai, Changying Li, Ron Gitaitis, E W Tollner, Seung-Chul Yoon (2013) Detection of Sour Skin Diseases in Vidalia Sweet Onions Using Near-infrared Hyperspectral Imaging. 2009. https://doi.org/10.13031/2013.28837

  69. Xiao-bo Z, Jie-wen Z, Yanxiao L, Holmes M (2010) In-line detection of apple defects using three color cameras system. Comput Electron Agric 70(1):129–134. https://doi.org/10.1016/j.compag.2009.09.014

    Article  Google Scholar 

  70. Xu J, Park SH, Zhang X, Hu J (2022) The Improvement of Road Driving Safety Guided by Visual Inattentional Blindness. IEEE Trans Intell Transp Syst 23(6):4972–4981. https://doi.org/10.1109/TITS.2020.3044927

    Article  Google Scholar 

  71. Yahaya, OKM, Matjafri, MZ, Aziz, AA, Omar, AF (2011) Non-destructive quality evaluation of fruit by color based on RGB LEDs system. 2014 2nd International Conference on Electronic Design, ICED 2014, 230–233. https://doi.org/10.1109/ICED.2014.7015804

  72. Technology I, Mongkut K (2005) Physical properties analysis of mango using computer vision Panitnat Yimyam *, Thanarat Chalidabhongse *, Panmanas Sirisomboon **, and Suwanee Boonmung **. ICCAS 2005:746–750. https://www.koreascience.or.kr/article/CFKO200533239340113.page. Accessed 11 Nov 2021

    Google Scholar 

Download references

Acknowledgements

The authors are grateful to Walmart, Atmiya Vidya Mandir, Department of Chemical Engineering, School of Energy Technology, Pandit Deendayal Energy University, Span Inspection Systems Pvt. Ltd, Northeastern University, Hofstra University, and S S Agrawal Institute of Engineering and Technology for the permission to publish this research.

Funding

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

All the authors make substantial contributions to this manuscript. KS, RS, MS, DS, HS, MR and MP participated in drafting the manuscript. KS, MS, and MP wrote the main manuscript, and all the authors discussed the results and implications of the manuscript at all stages.

Corresponding author

Correspondence to Manan Shah.

Ethics declarations

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Shah, K., Sushra, R., Shah, M. et al. Crop protection and disease detection using artificial intelligence and computer vision: a comprehensive review. Multimed Tools Appl (2024). https://doi.org/10.1007/s11042-024-19205-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11042-024-19205-9

Keywords

Navigation