Skip to main content

Advertisement

SpringerLink
Log in

A detection algorithm for cherry fruits based on the improved YOLO-v4 model

  • Special issue on IoT-based Health Monitoring System
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

"Digital" agriculture is rapidly affecting the value of agricultural output. Robotic picking of the ripe agricultural product enables accurate and rapid picking, making agricultural harvesting intelligent. How to increase product output has also become a challenge for digital agriculture. During the cherry growth process, realizing the rapid and accurate detection of cherry fruits is the key to the development of cherry fruits in digital agriculture. Due to the inaccurate detection of cherry fruits, environmental problems such as shading have become the biggest challenge for cherry fruit detection. This paper proposes an improved YOLO-V4 deep learning algorithm to detect cherry fruits. This model is suitable for cherry fruits with a small volume. It is proposed to increase the network based on the YOLO-V4 backbone network CSPDarknet53 network, combined with DenseNet The density between layers, the a priori box in the YOLO-V4 model, is changed to a circular marker box that fits the shape of the cherry fruit. Based on the improved YOLO-V4 model, the feature extraction is enhanced, the network structure is deepened, and the detection speed is improved. To verify the effectiveness of this method, different deep learning algorithms of YOLO-V3, YOLO-V3-dense and YOLO-V4 are compared. The results show that the mAP (average accuracy) value obtained by using the improved YOLO-V4 model (YOLO-V4-dense) network in this paper is 0.15 higher than that of yolov4. In actual orchard applications, cherries with different ripeness of cherries in the same area can be detected, and the fruits with larger ripeness differences can be artificially intervened, and finally, the yield of cherry fruits can be increased.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig.12

Similar content being viewed by others

References

  1. Zhao Y, Gong L, Huang Y, Liu C (2016) A review of key techniques of vision-based control for harvesting robot. Comput Electron Agric 127:311–323. https://doi.org/10.1016/j.compag.2016.06.022

    Article  Google Scholar 

  2. Sparrow R, Howard M (2020) Robots in agriculture: prospects, impacts, ethics, and policy. Precis Agric. https://doi.org/10.1007/s11119-020-09757-9

    Article  Google Scholar 

  3. Li JB, Huang WQ, Zhao CJ (2014) Machine vision technology for detecting the external defects of fruits — a review. J Photogr Sci 63(5):241–251. https://doi.org/10.1179/1743131X14Y.0000000088

    Article  Google Scholar 

  4. Gao F, FuZhang LX, Majeed Y, Li R, Karkee M, Zhang Q (2020) Multi-class fruit-on-plant detection for apple in SNAP system using faster R-CNN. Comput Electron Agric 176:105634. https://doi.org/10.1016/j.compag.2020.105634

    Article  Google Scholar 

  5. Fu L, Gao F, Wu J, Li R, Karkee M, Zhang Q (2020) Application of consumer RGB-D cameras for fruit detection and localization in field: a critical review. Comput Electron Agric 177:105687. https://doi.org/10.1016/j.compag.2020.105687

    Article  Google Scholar 

  6. Linker R, Cohen O, Naor A (2012) Determination of the number of green apples in rgb images recorded in orchards. Comput Electron Agric 81:45–57. https://doi.org/10.1016/j.compag.2011.11.007

    Article  Google Scholar 

  7. Momeny M, Jahanbakhshi A, Jafarnezhad K, Zhang YD (2020) Accurate classification of cherry fruit using deep cnn based on hybrid pooling approach. Postharvest Biol Technol 166:111204. https://doi.org/10.1016/j.postharvbio.2020.111204

    Article  Google Scholar 

  8. Shi R, Li T, Yamaguchi Y (2020) An attribution-based pruning method for real-time mango detection with YOLO network. Comput Electron Agric 169:105214. https://doi.org/10.1016/j.compag.2020.105214

    Article  Google Scholar 

  9. Rodríguez JP, Corrales DC, Aubertot JN, Corrales JC (2020) A computer vision system for automatic cherry beans detection on coffee trees. Pattern Recogn Lett 136:142–153. https://doi.org/10.1016/j.patrec.2020.05.034

    Article  Google Scholar 

  10. Chang X, Yu YL, Yang Y, Xing EP (2016) Semantic pooling for complex event analysis in untrimmed videos. IEEE Trans Pattern Mach Intell 39:1617–1632. https://doi.org/10.1109/TPAMI.2016.2608901

    Article  Google Scholar 

  11. Yan C, Zheng Q, Chang X, Luo M, Yeh CH, Hauptman AG (2020) Semantics-preserving graph propagation for zero-shot object detection. IEEE Trans Image Process 29:8163–8176. https://doi.org/10.1109/TIP.2020.3011807

    Article  MATH  Google Scholar 

  12. Wang H, Li Z, Li Y, Gupta BB, Choi C (2018) Visual saliency guided complex image retrieval. Pattern Recogn Lett 130:64–72. https://doi.org/10.1016/j.patrec.2018.08.010

    Article  Google Scholar 

  13. Majeed Y, Zhang J, Zhang X, Fu L, Karkee M, Zhang Q, Whiting MD (2020) Deep learning based segmentation for automated training of apple trees on trellis wires. Comput Electron Agric 170:105277. https://doi.org/10.1016/j.compag.2020.105277

    Article  Google Scholar 

  14. Liu Z, Wu J, Fu L, Majeed Y, Cui Y (2020) Improved kiwifruit detection using pre-trained vgg16 with rgb and nir information fusion. IEEE Access 8(1):2327–2336. https://doi.org/10.1109/ACCESS.2019.2962513

    Article  Google Scholar 

  15. Sedik A, Hammad M, Abd El-Samie FE et al (2021) Efficient deep learning approach for augmented detection of coronavirus disease. Neural Comput Appli. https://doi.org/10.1007/s00521-020-05410-8

    Article  Google Scholar 

  16. Bargoti S Underwood J (2017) Deep fruit detection in orchards.In: IEEE International Conference on Robotics and Automation (ICRA) pp. 3626–3633. https://doi.org/10.1109/ICRA.2017.798 9417

  17. RedmonJ Divvala S Girshick R Farhadi A (2016) You only look once: unified, real-time object detection.In: IEEE conference on Computer Vision and Pattern Recognition (CVPR) pp. 779–788. https://doi.org/10.1109/CVPR.2016.91

  18. Redmon J , Farhadi A (2018) Yolov3: an incremental improvement. arXiv e-prints.

  19. Liu G, Nouaze JC, Touko PL, Kim JH (2020) Yolo-tomato: a robust algorithm for tomato detection based on yolov. Sensors. https://doi.org/10.3390/s20072145

    Article  Google Scholar 

  20. Kuznetsova A, Maleva T, Soloviev V (2020) Using yolov3 algorithm with pre- and post-processing for apple detection in fruit-harvesting robot. Agronomy 10(7):1016. https://doi.org/10.3390/agronomy10071016

    Article  Google Scholar 

  21. Bochkovskiy A , Wang C Y , Liao H Y M (2020) Yolov4: optimal speed and accuracy of object detection

  22. Wu D, Lv S, Jiang M, Song H (2020) Using channel pruning-based YOLO v4 deep learning algorithm for the real-time and accurate detection of apple flowers in natural environments. Comput Electron Agric 178:105742. https://doi.org/10.1016/j.compag.2020.105742

    Article  Google Scholar 

  23. Alsmirat MA, Al-Alem F, Al-Ayyoub M et al (2019) Impact of digital fingerprint image quality on the fingerprint recognition accuracy. Multimed Tools Appl 78:3649–3688. https://doi.org/10.1007/s11042-017-5537-5

    Article  Google Scholar 

  24. Yu C, Li J, Li X et al (2018) Four-image encryption scheme based on quaternion Fresnel transform, chaos and computer generated hologram. Multimed Tools Appl 77(4):4585–4608. https://doi.org/10.1007/s11042-017-4637-6

    Article  Google Scholar 

  25. Zhang X, Fu L, Karkee M, Whiting MD, Zhang Q (2019) Canopy segmentation using resnet for mechanical harvesting of apples. IFAC-PapersOnLine 52(30):300–305. https://doi.org/10.1016/j.ifacol.2019.12.550

    Article  Google Scholar 

  26. Huang G, Liu Z, Laurens VDM, Weinberger KQ (2016) Densely connected convolutional networks. https://doi.org/10.1109/CVPR.2017.243

  27. Tian Y, Yang G, Wang Z, Wang H, Li E, Liang Z (2019) Apple detection during different growth stages in orchards using the improved YOLO-V3 model. Comput Electron Agric 157:417–426. https://doi.org/10.1016/j.compag.2019.01.012

    Article  Google Scholar 

  28. Zhang J, He L, Karkee M, Zhang Q, Zhang X, Gao Z (2018) Branch detection for apple trees trained in fruiting wall architecture using depth features and Regions-Convolutional Neural Network (R-CNN). Comput Electron Agric 155:386–393. https://doi.org/10.1016/j.compag.2018.10.029

    Article  Google Scholar 

  29. Wan S, Goudos S (2019) Faster R-CNN for multi-class fruit detection using a robotic vision system. Comput Netw 168:107036. https://doi.org/10.1016/j.comnet.2019.107036

    Article  Google Scholar 

  30. Yu Y, Zhang K, Yang L, Zhang D (2019) Fruit detection for strawberry harvesting robot in non-structural environment based on Mask-RCNN. Comput Electron Agric 163:104846. https://doi.org/10.1016/j.compag.2019.06.001

    Article  Google Scholar 

  31. Xu Z, Jia R, Liu Y, Zhao C, Sun H (2020) Fast method of detecting tomatoes in a complex scene for picking robots. IEEE Access 8:55289–55299. https://doi.org/10.1109/ACCESS.2020.2981823

    Article  Google Scholar 

  32. Zhang J, Karkee M, Zhang Q, Zhang X, Yaqoob M, Fu L, Wang S (2020) Multi-class object detection using faster R-CNN and estimation of shaking locations for automated shake-and-catch apple harvesting. Comput Electron Agric 173:105384. https://doi.org/10.1016/j.compag.2020.105384

    Article  Google Scholar 

Download references

Funding

The research was funded by Dalian Science and Technology Bureau in Grant No. 2020JJ26SN058.

Author information

Authors and Affiliations

  1. School of Information Engineering, Dalian University, Dalian, China

    Rongli Gai, Na Chen & Hai Yuan

Authors
  1. Rongli Gai
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Na Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Hai Yuan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors contributed equally.

Corresponding author

Correspondence to Rongli Gai.

Ethics declarations

Conflict of interest

None.

Ethics approval

Confirm.

Consent to participate

Confirm.

Consent for publication

Confirm.

Project

Research on Feature Extraction and Modeling of Growth Dynamics of Sweet Cherries in solar greenhouse based on intelligence of IOT.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gai, R., Chen, N. & Yuan, H. A detection algorithm for cherry fruits based on the improved YOLO-v4 model. Neural Comput & Applic 35, 13895–13906 (2023). https://doi.org/10.1007/s00521-021-06029-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-021-06029-z

Keywords

Search

Navigation