Abstract
One of the most damaging obstacles to crop production is weeds; weeds pose a serious risk to agricultural output. Due to the homogenous morphological properties of weeds, farmers are unable to identify and classify the weed leaves.This study can aid farmers in identifying, categorizing, and quantifying the true extent of crop yield reduction. Computer vision is a sophisticated technique widely used for weed and crop leaf identification and detection in the agricultural field. This work has used three different datasets, such as ‘Deep Weed’, ‘Crop Weed Filed Image Dataset (CWFID), and Multi-view Image Dataset for Weed Detection in Wheat Field (MMIDDWF), and collected 5090 images for training the model. This work uses segmentation techniques for vegetation and semantics for weed object detection. Furthermore, the masked image is distributed as small tiles; often the patches are square tiles, as in 25 × 25 (px), 50 × 50 (px), and 100 × 100 (px). This work has proposed a Deep Learning segmentation model named ‘Pyramid Scene Parsing Network-USegNet’ (PSPUSegNet) for data classification and compared the accuracy of the data from existing segmentation models such as UNet, SegNet, and USegNet. The suggested model, PSPUSegNet, obtained 96.98% precision, 97.98% recall, and 98.96% data accuracy in the Deep Weed dataset. The proposed model has self-supervised in term of deep learning mechanism.Our findings demonstrate that the deep weed dataset has achieved greater data accuracy compared to the CWFID and MMIDDWF datasets. The findings support the effectiveness of the suggested approach for weed species recognition.
Similar content being viewed by others
Data availability
Data and source codes are available from the authors upon reasonable request.
References
Kazmi W, Garcia-Ruiz FJ, Nielsen J, Rasmussen J, Jørgen Andersen H (2015) Detecting creeping thistle in sugar beet fields using vegetation indices. Comput Electron Agric 112:10–19. https://doi.org/10.1016/j.compag.2015.01.008
Lu Y, Young S (2020) A survey of public datasets for computer vision tasks in precision agriculture. Comput Electron Agric 178:105760. https://doi.org/10.1016/j.compag.2020.105760
Yasrab R, Zhang J, Smyth P, Pound MP (2021) Predicting plant growth from time-series data using deep learning. Remote Sens 13(3):331. https://doi.org/10.3390/rs13030331
Kamath R, Balachandra M, Prabhu S (2020) Crop and weed discrimination using laws’ texture masks. Int J Agric Biol Eng 13(1):191–197. https://doi.org/10.25165/j.ijabe.20201301.4920
Sharpe SM, Schumann AW, Boyd NS (2019) Detection of Carolina geranium (Geranium carolinianum) growing in competition with strawberry using convolutional neural networks. Weed Sci 67(2):239–245. https://doi.org/10.1017/wsc.2018.66
Lottes P, Behley J, Milioto A, Stachniss C (2018) Fully convolutional networks with sequential information for robust crop and weed detection in precision farming. IEEE Robot Autom Lett 3(4):2870–2877. https://doi.org/10.1109/LRA.2018.2846289
Qian M, McLaughlin I, Quo W, Dai L (2017) Mismatched training data enhancement for automatic recognition of children’s speech using DNN-HMM. https://doi.org/10.1109/ISCSLP.2016.7918386
Gao J, French AP, Pound MP, He Y, Pridmore TP, Pieters JG (2020) Deep convolutional neural networks for image-based Convolvulus sepium detection in sugar beet fields. Plant Methods 16(1). https://doi.org/10.1186/s13007-020-00570-z
Mishra AM, Gautam V (2021) Weed Species Identification in Different Crops using Precision Weed Management: A Review. Available: https://niti.gov.in/national-strategy. Accessed 17 Apr 2021
Muni Mishra A et al (2022) A Deep Learning-Based Novel Approach for Weed Growth Estimation. Intell Autom Soft Comput 31(2):1157–1173. https://doi.org/10.32604/iasc.2022.020174
Ma X et al (2019) Fully convolutional network for rice seedling and weed image segmentation at the seedling stage in paddy fields. PLoS One 14(4). https://doi.org/10.1371/journal.pone.0215676
Chechliński Ł, Siemiątkowska B, Majewski M (2019) A system for weeds and crops identification—reaching over 10 fps on raspberry pi with the usage of mobilenets, densenet and custom modifications. Sensors 19(17). https://doi.org/10.3390/s19173787 (Switzerland)
Rasti P, Ahmad A, Samiei S, Belin E, Rousseau D (2019) Supervised image classification by scattering transform with application toweed detection in culture crops of high density. Remote Sens 11(3). https://doi.org/10.3390/rs11030249
Teimouri N, Dyrmann M, Nielsen PR, Mathiassen SK, Somerville GJ, Jørgensen RN (2018) Weed growth stage estimator using deep convolutional neural networks. Sensors 18(5):1–13. https://doi.org/10.3390/s18051580. (Switzerland)
Kropff MJ, Lotz LAP, Weaver SE, Bos HJ, Wallinga J, Migo T (1995) A two parameter model for prediction of crop loss by weed competition from early observations of relative leaf area of the weeds. Ann Appl Biol 126(2):329–346. https://doi.org/10.1111/j.1744-7348.1995.tb05370.x
Zhao H, Shi J, Qi X, Wang X, Jia J (2017) Pyramid scene parsing network. Proc - 30th IEEE Conf Comput Vis Pattern Recognition, CVPR 2017, 2017:6230–6239. https://doi.org/10.1109/CVPR.2017.660
Haug S, Ostermann J (2015) A crop/weed field image dataset for the evaluation of computer vision based precision agriculture tasks. Lect Notes Comput Sci (including Subser. Lect Notes Artif Intell Lect Notes Bioinformatics) 8928:105–116. https://doi.org/10.1007/978-3-319-16220-1_8
Xu K, Jiang Z, Liu Q, Xie Q, Zhu Y, Cao W, Ni J (2022) Multi-modal and multi-view image dataset for weeds detection in wheat field. Front Plant Sci 13:936748. https://doi.org/10.3389/fpls.2022.936748
Kamath R, Balachandra M, Prabhu S (2019) Raspberry Pi as Visual Sensor Nodes in Precision Agriculture: A Study. IEEE Access 7:45110–45122. https://doi.org/10.1109/ACCESS.2019.2908846
Ahmad J et al (2018) Visual features based boosted classification of weeds for real-time selective herbicide sprayer systems. Comput Ind 98:23–33. https://doi.org/10.1016/j.compind.2018.02.005
Yasrab R, Zhang J, Smyth P, Pound MP (2021) Predicting plant growth from time-series data using deep learning. Remote Sens 13(3):1–17. https://doi.org/10.3390/rs13030331
Hasan ASMM, Sohel F, Diepeveen D, Laga H, Jones MGK (2021) A survey of deep learning techniques for weed detection from images. Comput Electron Agric 184. https://doi.org/10.1016/j.compag.2021.106067
Kaur P, Gautam V (n.d.) Plant biotic disease identification and classification based on leaf image: A review. https://doi.org/10.1007/978-981-15-9712-1_51
Mahmudul Hasan ASM, Sohel F, Diepeveen D, Laga H, Jones MGK (2022) Weed recognition using deep learning techniques on class-imbalanced imagery. Crop Pasture Sci. https://doi.org/10.1071/CP21626
Marwat SK et al (2013) Weeds of wheat crop and their control strategies in Dera Ismail Khan district, Khyber Pakhtun Khwa, Pakistan. Am J Plant Sci 04(01):66–76. https://doi.org/10.4236/ajps.2013.41011
Potena C, Nardi D, Pretto A (2017) Fast and accurate crop and weed identification with summarized train sets for precision agriculture. Adv Intell Syst Comput 531:105–121. https://doi.org/10.1007/978-3-319-48036-7_9
Shorewala S, Ashfaque A, Sidharth R, Verma U (2021) Weed density and distribution estimation for precision agriculture using semi-supervised learning. IEEE Access 9:27971–27986. https://doi.org/10.1109/ACCESS.2021.3057912
Vayssade JA, Jones G, Gée C, Paoli JN (2022) Pixelwise instance segmentation of leaves in dense foliage. Comput Electron Agric 195:106797. https://doi.org/10.1016/J.COMPAG.2022.106797
Nachiketh RV, Krishnan A, Krishnan KV, Harikrishnan P, Sasinas Alias Haritha ZA (2021) Southern Pea / Weed Field Image Dataset for Semantic Segmentation and Crop / Weed Classification using an Encoder-Decoder Network. SSRN Electron J. https://doi.org/10.2139/ssrn.3781351
Kaur P, Harnal S, Tiwari R, Upadhyay S, Bhatia S, Mashat A (2022) Recognition of Leaf Disease Using Hybrid Convolutional Network by Applying Feature Reduction. Sensors. 22(2):575. https://doi.org/10.3390/s22020575
Mishra AM, Gautam V (2021) Weed species identification in different crops using precision weed management: A review. CEUR Workshop Proc 2786(February):180–194
Sa I et al (2018) WeedNet: Dense semantic weed classification using multispectral images and MAV for smart farming. IEEE Robot Autom Lett 3(1):588–595. https://doi.org/10.1109/LRA.2017.2774979
Funding
None.
Author information
Authors and Affiliations
Contributions
AMM.: Conceptualization, data collection, and Methodology, Writing, PK: Conceptualization and Methodology, MPS: Methodology and Supervision, SPS: Validation and Supervision.
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Mishra, A.M., Kaur, P., Singh, M.P. et al. A self-supervised overlapped multiple weed and crop leaf segmentation approach under complex light condition. Multimed Tools Appl (2024). https://doi.org/10.1007/s11042-024-18272-2
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1007/s11042-024-18272-2