Skip to main content
SpringerLink
Log in

Toward automatic plant phenotyping: starting from leaf counting

  • 1195: Deep Learning for Multimedia Signal Processing and Applications
  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The development of automatic plant phenotyping systems has drawn great attention in the recent years. It can help improve the throughput of phenotyping measurements and reduce the associated human labor cost. Working towards the goal of automatic plant phenotyping, here we begin with developing an automatic method for leaf counting. Most of the previous approaches for leaf counting are based on regression modeling or instance segmentation. In contrast to these approaches, we consider the task of leaf counting as a object detection problem. In particular, we perform object detection and localization for leaves in the input images. The location and size of a leaf is indicated by a bounding box. Thus, we can obtain the number of leaves by counting the number of bounding boxes. We develop our leaf counting network architecture based on YOLOv3. In order to evaluate our proposed method, we utilize the cauliflower images from the ABRC (Agricultural Biotechnology Research Center, Academia Sinica) and the Arabidopsis images from the CVPPP (Computer Vision Problems in Plant Phenotyping) dataset. Our proposed method achieves state of the art results on these datasets.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. Aich S, Stavness I (2017) Leaf counting with deep convolutional and deconvolutional networks. In: Proceedings of the IEEE international conference on computer vision workshops, pp 2080–2089

  2. Badrinarayanan V, Kendall A, Cipolla R (2017) Segnet: A deep convolutional encoder-Decoder architecture for image segmentation. IEEE Trans Pattern Anal Mach Intell 39(12):2481–2495

    Article  Google Scholar 

  3. Bisen D (2021) Deep convolutional neural network based plant species recognition through features of leaf. Multimedia Tools and Applications 80(4):6443–6456

    Article  Google Scholar 

  4. Bochkovskiy A, Wang C-Y, Liao H-YM (2020) Yolov4: Optimal speed and accuracy of object detection. arXiv:2004.10934

  5. Buzzy M, Thesma V, Davoodi M, Mohammadpour Velni J (2020) Real-time plant leaf counting using deep object detection networks. Sensors 20 (23):6896

    Article  Google Scholar 

  6. Cordts M, Omran M, Ramos S, Rehfeld T, Enzweiler M, Benenson R, Franke U, Roth S, Schiele B (2016) The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3213–3223

  7. Dobrescu A, Valerio Giuffrida M, Tsaftaris SA (2017) Leveraging multiple datasets for deep leaf counting. In: Proceedings of the IEEE international conference on computer vision workshops, pp 2072–2079

  8. Du Z, Yin J, Yang J (2019) Expanding receptive field yolo for small object detection. Journal of Physics: Conference Series 1314(1):012202

    Google Scholar 

  9. Farjon G, Itzhaky Y, Khoroshevsky F, Bar-Hillel A (2021) Leaf counting: Fusing network components for improved accuracy. Frontiers in Plant Science 12:1063

    Article  Google Scholar 

  10. Geiger A, Lenz P, Urtasun R (2012) Are we ready for autonomous driving? the kitti vision benchmark suite. In: IEEE Conference on computer vision and pattern recognition, IEEE, pp 3354–3361

  11. Giuffrida MV, Minervini M, Tsaftaris SA (2015) Learning to count leaves in rosette plants. In: Proceedings of the computer vision problems in plant phenotyping (CVPPP)

  12. He K, Gkioxari G, Dollár P, Girshick R (2017) Mask r-CNN. In: Proceedings of the IEEE international conference on computer vision, pp 2961–2969

  13. Hsiao J-K, Kang L-W, Chang C-L, Hsu C-Y, Chen C-Y (2014) Learning sparse representation for leaf image recognition. In: 2014 IEEE international conference on consumer electronics-Taiwan, IEEE, pp 209–210

  14. Hsiao J-K, Kang L-W, Chang C-L, Lin C-Y (2014) Comparative study of leaf image recognition with a novel learning-based approach. In: 2014 Science and information conference, IEEE, pp 389–393

  15. Itzhaky Y, Farjon G, Khoroshevsky F, Shpigler A, Bar-Hillel A (2018) Leaf counting: Multiple scale regression and detection using deep cnns. In: BMVC, pp 328

  16. Jiang H (2020) The analysis of plants image recognition based on deep learning and artificial neural network. IEEE Access 8:68828–68841

    Article  Google Scholar 

  17. Kuznichov D, Zvirin A, Honen Y, Kimmel R (2019) Data augmentation for leaf segmentation and counting tasks in rosette plants. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition workshops

  18. Lin T-Y, Goyal P, Girshick R, He K, Dollár P (2017) Focal loss for dense object detection. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 2980–2988

  19. Liu M, Wang X, Zhou A, Fu X, Ma Y, Piao C (2020) Uav-yolo: small object detection on unmanned aerial vehicle perspective. Sensors 20 (8):2238

    Article  Google Scholar 

  20. Minervini M, Fischbach A, Scharr H, Tsaftaris SA (2016) Finely-grained annotated datasets for image-based plant phenotyping. Pattern Recogn Lett 81:80–89

    Article  Google Scholar 

  21. Minervini M, Giuffrida MV, Perata P, Tsaftaris SA (2017) Phenotiki: An open software and hardware platform for affordable and easy image-based phenotyping of rosette-shaped plants. The Plant Journal 90(1):204–216

    Article  Google Scholar 

  22. Qiu Z, Wang S, Zeng Z, Yu D (2019) Automatic visual defects inspection of wind turbine blades via yolo-based small object detection approach. Journal of Electronic Imaging 28(4):043023

    Article  Google Scholar 

  23. Redmon J, Farhadi A Yolov3: An Incremental Improvement. arXiv:1804.02767

  24. Ren M, Zemel RS (2017) End-to-end instance segmentation with recurrent attention. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 6656–6664

  25. Ren S, He K, Girshick R, Sun J (2015) Faster R-CNN: Towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, pp 91–99

  26. Ubbens J, Cieslak M, Prusinkiewicz P, Stavness I (2018) The use of plant models in deep learning: an application to leaf counting in rosette plants. Plant Methods 14(1):1–10

    Article  Google Scholar 

  27. Ubbens JR, Stavness I (2017) Deep plant phenomics: a deep learning platform for complex plant phenotyping tasks. Frontiers in Plant Science 8:1190

    Article  Google Scholar 

  28. Weyler J, Milioto A, Falck T, Behley J, Stachniss C (2021) Joint plant instance detection and leaf count estimation for in-field plant phenotyping. IEEE Robot Autom Lett 6(2):3599–3606

    Article  Google Scholar 

  29. WIWAM - automated systems for plant phenotyping. https://www.wiwam.be/

  30. Xiao Y, Tian Z, Yu J, Zhang Y, Liu S, Du S, Lan X (2020) A review of object detection based on deep learning. Multimedia Tools and Applications 79(33):23729–23791

    Article  Google Scholar 

  31. Xu L, Li Y, Sun Y, Song L, Jin S (2018) Leaf instance segmentation and counting based on deep object detection and segmentation networks. In: 2018 Joint 10th international conference on soft computing and intelligent systems (SCIS) and 19th international symposium on advanced intelligent systems (ISIS), IEEE, pp 180–185

  32. Yeh C-H, Lin C-H, Kang L-W, Huang C-H, Lin M-H, Chang C-Y, Wang C-C (2021) Lightweight deep neural network for joint learning of underwater object detection and color conversion. IEEE Transactions on Neural Networks and Learning Systems

  33. Yi Z, Yongliang S, Jun Z (2019) An improved tiny-yolov3 pedestrian detection algorithm. Optik 183:17–23

    Article  Google Scholar 

  34. Zhu Y, Aoun M, Krijn M, Vanschoren J, Campus HT (2018) Data augmentation using conditional generative adversarial networks for leaf counting in arabidopsis plants. In: BMVC, pp 324

Download references

Acknowledgements

This work was partially supported by the Ministry of Science and Technology (MOST), Taiwan, under Grant MOST 108-2221-E-194-045.

Author information

Authors and Affiliations

  1. Department of CSIE, National Chung Cheng University, Minhsiung, Chiayi, Taiwan

    Yi-Lin Tu & Wei-Yang Lin

  2. Agricultural Biotechnology Research Center, Academia Sinica, Nangang District, Taiwan

    Yao-Cheng Lin

Authors
  1. Yi-Lin Tu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Wei-Yang Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yao-Cheng Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Wei-Yang Lin.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tu, YL., Lin, WY. & Lin, YC. Toward automatic plant phenotyping: starting from leaf counting. Multimed Tools Appl 81, 11865–11879 (2022). https://doi.org/10.1007/s11042-021-11886-w

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11886-w

Keywords

Search

Navigation