Abstract
Controlling weed infestation through chemicals (herbicides & pesticides) is essential for crop yield. However, excessive use of these chemicals has caused severe agronomic and environmental problems. According to accurate weed detection, an appropriate dose of herbicides is recommended in site-specific weed management (SSWM) applications, which may ultimately promote chemical saving while enhancing its effectiveness. In this context of SSWM, an accurate detection and recognition system needs to be established for recognizing weeds and crops to carry out precise agrochemical treatments in real-time applications. Unmanned aerial vehicles (UAVs) and other robots offer potential in precision agriculture (PA) applications by monitoring farmland on a per-plant basis, as they have the capability of acquiring high-resolution imagery providing detailed information for the distribution of crops and weeds in the field. In this regard, UAVs offer a cost-efficient solution for providing excellent survey capabilities. In this study, a deep learning system is developed for identifying weeds and crops in croplands. The developed system was implemented and evaluated using high-resolution UAV imagery captured over two different target fields: pea and strawberry; the developed system was able to identify weeds with an average accuracy of 95.3%, whereas the overall average accuracy (crops and weeds) was 94.73% for both the fields. The average kappa coefficient of the developed system was 0.89. The developed deep learning system outperformed the existing machine learning and deep learning-based approaches on comparison and can be embedded into a precision sprayer for adopting the SSWM strategy.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ahmad, I., Siddiqi, M. H., Fatima, I., Lee, S., & Lee, Y. K. (2011). Weed classification based on Haar wavelet transform via k-Nearest Neighbor (k-NN) for real-time automatic sprayer control system. Proceedings of the 5th International Conference on Ubiquitous Information Management and Communication, ICUIMC 2011. https://doi.org/10.1145/1968613.1968634
Alexandridis, T. K., Tamouridou, A. A., Pantazi, X. E., Lagopodi, A. L., Kashefi, J., Ovakoglou, G., Polychronos, V., & Moshou, D. (2017). Novelty detection classifiers in weed mapping: Silybum marianum detection on UAV multispectral images. Sensors (Switzerland), 17, 9. https://doi.org/10.3390/s17092007
Ammar, A., Koubaa, A., Ahmed, M., & Saad, A. (2019). Aerial Images Processing for Car Detection using Convolutional Neural Networks: Comparison between Faster R-CNN and YoloV3. ArXiv, 1–28. http://arxiv.org/abs/1910.07234
Bandini, F., Jakobsen, J., Olesen, D., Reyna-Gutierrez, J. A., & Bauer-Gottwein, P. (2017). Measuring water level in rivers and lakes from lightweight Unmanned Aerial Vehicles. Journal of Hydrology, 548, 237–250. https://doi.org/10.1016/j.jhydrol.2017.02.038
Castaldi, F., Pelosi, F., Pascucci, S., & Casa, R. (2017). Assessing the potential of images from unmanned aerial vehicles (UAV) to support herbicide patch spraying in maize. Precision Agriculture, 18(1), 76–94. https://doi.org/10.1007/s11119-016-9468-3
CropLife. (n.d.). Crop Protection Industry Supports FAO on IPM | CropLife International. Retrieved December 29, 2020, from https://croplife.org/case-study/crop-protection-industry-supports-fao-on-ipm/
Dastgheibifard, S., & Asnafi, M. (2018). A review on potential applications of unmanned aerial vehicle for construction industry. Sustainable Structure and Materials, 1(July), 44–53. https://doi.org/10.26392/SSM.2018.01.02.044
de Castro, A. I., Torres-Sánchez, J., Peña, J. M., Jiménez-Brenes, F. M., Csillik, O., & López-Granados, F. (2018). An automatic random forest-OBIA algorithm for early weed mapping between and within crop rows using UAV imagery. Remote Sensing, 10(2), 1–21. https://doi.org/10.3390/rs10020285
Dian Bah, M., Hafiane, A., & Canals, R. (2018). Deep learning with unsupervised data labeling for weed detection in line crops in UAV images. Remote Sensing, 10(11), 1–22. https://doi.org/10.3390/rs10111690
Escalante, H. J., Rodríguez-Sánchez, S., Jiménez-Lizárraga, M., Morales-Reyes, A., De La Calleja, J., & Vazquez, R. (2019). Barley yield and fertilization analysis from UAV imagery: A deep learning approach. International Journal of Remote Sensing, 40(7), 2493–2516. https://doi.org/10.1080/01431161.2019.1577571
Gao, P., Zhang, Y., Zhang, L., Noguchi, R., & Ahamed, T. (2019). Article development of a recognition system for spraying areas from unmanned aerial vehicles using a machine learning approach. Sensors (Switzerland), 19, 2. https://doi.org/10.3390/s19020313
Garcia-Ruiz, F. J., Wulfsohn, D., & Rasmussen, J. (2015). Sugar beet (Beta vulgaris L.) and thistle (Cirsium arvensis L.) discrimination based on field spectral data. Biosystems Engineering, 139, 1–15. https://doi.org/10.1016/j.biosystemseng.2015.07.012
Guerrero, J. M., Pajares, G., Montalvo, M., Romeo, J., & Guijarro, M. (2012). Support Vector Machines for crop/weeds identification in maize fields. Expert Systems with Applications, 39(12), 11149–11155. https://doi.org/10.1016/j.eswa.2012.03.040
Hay, G. J., Castilla, G., Vi, C., & Vi, W. G. (2006). OBJECT-BASED IMAGE ANALYSIS : STRENGTHS, WEAKNESSES, OPPORTUNITIES AND THREATS ( SWOT ). The International Archives of the Photogrammetry.
He, K., Zhang, X., Ren, S., & Sun, J. (2016). Deep residual learning for image recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2016-Decem, 770–778. https://doi.org/10.1109/CVPR.2016.90
Henrique Yano, I. (2017). Weed Identification in Sugarcane Plantation Through Images Taken from Remotely Piloted Aircraft (RPA) and kNN Classifier. Journal of Food and Nutrition Sciences, 5(6), 211. https://doi.org/10.11648/j.jfns.20170506.11
Huang, H., Deng, J., Lan, Y., Yang, A., Deng, X., & Zhang, L. (2018a). A fully convolutional network for weed mapping of unmanned aerial vehicle (UAV) imagery. PLoS ONE. https://doi.org/10.1371/journal.pone.0196302
Huang, H., Lan, Y., Deng, J., Yang, A., Deng, X., Zhang, L., & Wen, S. (2018b). A semantic labeling approach for accurate weed mapping of high resolution UAV imagery. Sensors (Switzerland). https://doi.org/10.3390/s18072113
Huang, Y. B., Thomson, S. J., Hoffmann, W. C., Lan, Y. B., & Fritz, B. K. (2013). Development and prospect of unmanned aerial vehicle technologies for agricultural production management. International Journal of Agricultural and Biological Engineering, 6(3), 1–10. https://doi.org/10.3965/j.ijabe.20130603.001
Hung, C., Xu, Z., & Sukkarieh, S. (2014). Feature learning based approach for weed classification using high resolution aerial images from a digital camera mounted on a UAV. Remote Sensing, 6(12), 12037–12054. https://doi.org/10.3390/rs61212037
Khan, S., Tufail, M., Khan, M. T., Khan, A., Iqbal, J., & Wasim, A. (2021). Real-time recognition of spraying area for UAV sprayers using a deep learning approach. PLoS ONE, 16(4), 1–17. https://doi.org/10.1371/journal.pone.0249436
Khan, S., Tufail, M., Khan, M. T., Khan, Z. A., & Anwar, S. (2021). Deep learning based spraying area recognition system for Unmanned Aerial Vehicle based sprayers. Turkish Journal of Electrical Engineering & Computer Sciences, 29(2021), 241–256. https://doi.org/10.3906/elk-2004-4
López-Granados, F., Torres-Sánchez, J., Serrano-Pérez, A., de Castro, A. I., Mesas-Carrascosa, F. J., & Peña, J. M. (2016). Early season weed mapping in sunflower using UAV technology: Variability of herbicide treatment maps against weed thresholds. Precision Agriculture, 17(2), 183–199. https://doi.org/10.1007/s11119-015-9415-8
Lottes, P., Khanna, R., Pfeifer, J., Siegwart, R., & Stachniss, C. (2017). UAV-based crop and weed classification for smart farming. Proceedings - IEEE International Conference on Robotics and Automation. https://doi.org/10.1109/ICRA.2017.7989347
Manfreda, S., McCabe, M. F., Miller, P. E., Lucas, R., Madrigal, V. P., Mallinis, G., Ben Dor, E., Helman, D., Estes, L., Ciraolo, G., Müllerová, J., Tauro, F., de Lima, M. I., de Lima, J. L. M. P., Maltese, A., Frances, F., Caylor, K., Kohv, M., Perks, M., & Toth, B. (2018). On the use of unmanned aerial systems for environmental monitoring. Remote Sensing, 10, 4. https://doi.org/10.3390/rs10040641
Mogili, U. M. R., & Deepak, B. B. V. L. (2018). ScienceDirect ScienceDirect review on application of drone systems in precision agriculture. Procedia Computer Science, 133, 502–509. https://doi.org/10.1016/j.procs.2018.07.063
Pérez-Ortiz, M., Peña, J. M., Gutiérrez, P. A., Torres-Sánchez, J., Hervás-Martínez, C., & López-Granados, F. (2015). A semi-supervised system for weed mapping in sunflower crops using unmanned aerial vehicles and a crop row detection method. Applied Soft Computing Journal, 37, 533–544. https://doi.org/10.1016/j.asoc.2015.08.027
Pérez-Ortiz, M., Peña, J. M., Gutiérrez, P. A., Torres-Sánchez, J., Hervás-Martínez, C., & López-Granados, F. (2016). Selecting patterns and features for between- and within- crop-row weed mapping using UAV-imagery. Expert Systems with Applications, 47, 85–94. https://doi.org/10.1016/j.eswa.2015.10.043
Redmon, J., & Farhadi, A. (2018). YOLOv3: An Incremental Improvement. CoRR, abs/1804.0. http://arxiv.org/abs/1804.02767
Ren, S., He, K., Girshick, R., & Sun, J. (2015). Faster R-CNN: Towards real-time object detection with region proposal networks. Advances in Neural Information Processing Systems, Montréal, QC, Canada. https://doi.org/10.1109/TPAMI.2016.2577031
Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., & McCool, C. (2016). Deepfruits: A fruit detection system using deep neural networks. Sensors (Switzerland), 16, 8. https://doi.org/10.3390/s16081222
Sa, I., Popović, M., Khanna, R., Chen, Z., Lottes, P., Liebisch, F., Nieto, J., Stachniss, C., Walter, A., & Siegwart, R. (2018). WeedMap: A large-scale semantic weed mapping framework using aerial multispectral imaging and deep neural network for precision farming. Remote Sensing. https://doi.org/10.3390/rs10091423
Shi, L., Duan, Q., Ma, X., & Weng, M. (2012). The Research of Support Vector Machine. International Conference on Computer and Computing Technologies in Agriculture, 370, 265–269. https://doi.org/10.1007/978-3-642-27275-2_29
Su, J., Liu, C., Coombes, M., Hu, X., Wang, C., Xu, X., Li, Q., Guo, L., & Chen, W. H. (2018). Wheat yellow rust monitoring by learning from multispectral UAV aerial imagery. Computers and Electronics in Agriculture, 155(August), 157–166. https://doi.org/10.1016/j.compag.2018.10.017
Tamouridou, A. A., Alexandridis, T. K., Pantazi, X. E., Lagopodi, A. L., Kashefi, J., Kasampalis, D., Kontouris, G., & Moshou, D. (2017). Application of multilayer perceptron with automatic relevance determination on weed mapping using UAV multispectral imagery. Sensors (Switzerland), 17(10). https://doi.org/10.3390/s17102307
Tian, Y., Zhao, C., Lu, S., & Guo, X. (2011). Multiple classifier combination for recognition of wheat leaf diseases. Intelligent Automation and Soft Computing, 17(5), 519–529. https://doi.org/10.1080/10798587.2011.10643166
Tian, Y., Yang, G., Wang, Z., Wang, H., Li, E., & Liang, Z. (2019). Apple detection during different growth stages in orchards using the improved YOLO-V3 model. Computers and Electronics in Agriculture, 157(January), 417–426. https://doi.org/10.1016/j.compag.2019.01.012
Valentini, G., Muselli, M., & Ruffino, F. (2004). Cancer recognition with bagged ensembles of support vector machines. Neurocomputing, 56(1–4), 461–466. https://doi.org/10.1016/j.neucom.2003.09.001
Vapnik, V. N., & Chervonenkis, A. Y. (n.d.). On the uniform convergence of relative frequencies of events to their probabilities. Theory of Probability and Its Applications, 2, 264–280. https://doi.org/10.1007/978-3-319-21852-6_3
Yano, I. H., Santiago, W. E., Alves, J. R., Mota, L. T. M., & Teruel, B. (2017). Choosing classifier for weed identification in sugarcane fields through images taken by UAV. Bulgarian Journal of Agricultural Science, 23(3), 491–497
Zarco-Tejada, P. J., González-Dugo, V., & Berni, J. A. J. (2012). Fluorescence, temperature and narrow-band indices acquired from a UAV platform for water stress detection using a micro-hyperspectral imager and a thermal camera. Remote Sensing of Environment, 117, 322–337. https://doi.org/10.1016/j.rse.2011.10.007
Zhang, S., Li, C., Zhang, S., Zhang, H., Pang, L., Lam, K., & Hui, C. (2012). Using the K-nearest neighbor algorithm for the classification of lymph node metastasis in gastric cancer. Computational and Mathematical Methods in Medicine. https://doi.org/10.1155/2012/876545
Zhang, Y., Chen, D., Wang, S., & Tian, L. (2018). A promising trend for field information collection: An air-ground multi-sensor monitoring system. Information Processing in Agriculture, 5(2), 224–233. https://doi.org/10.1016/j.inpa.2018.02.002
Zheng, Y. Y., Kong, J. L., Jin, X. B., Wang, X. Y., Su, T. L., & Zuo, M. (2019). Cropdeep: The crop vision dataset for deep-learning-based classification and detection in precision agriculture. Sensors (Switzerland). https://doi.org/10.3390/s19051058
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Khan, S., Tufail, M., Khan, M.T. et al. Deep learning-based identification system of weeds and crops in strawberry and pea fields for a precision agriculture sprayer. Precision Agric 22, 1711–1727 (2021). https://doi.org/10.1007/s11119-021-09808-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11119-021-09808-9