Abstract
In recent years, deep convolution neural network has exhibited excellent performance in computer vision and has a far-reaching impact. Traditional plant taxonomic identification requires high expertise, which is time-consuming. Most nature reserves have problems such as incomplete species surveys, inaccurate taxonomic identification, and untimely updating of status data. Simple and accurate recognition of plant images can be achieved by applying convolutional neural network technology to explore the best network model. Taking 24 typical desert plant species that are widely distributed in the nature reserves in Xinjiang Uygur Autonomous Region of China as the research objects, this study established an image database and select the optimal network model for the image recognition of desert plant species to provide decision support for fine management in the nature reserves in Xinjiang, such as species investigation and monitoring, by using deep learning. Since desert plant species were not included in the public dataset, the images used in this study were mainly obtained through field shooting and downloaded from the Plant Photo Bank of China (PPBC). After the sorting process and statistical analysis, a total of 2331 plant images were finally collected (2071 images from field collection and 260 images from the PPBC), including 24 plant species belonging to 14 families and 22 genera. A large number of numerical experiments were also carried out to compare a series of 37 convolutional neural network models with good performance, from different perspectives, to find the optimal network model that is most suitable for the image recognition of desert plant species in Xinjiang. The results revealed 24 models with a recognition Accuracy, of greater than 70.000%. Among which, Residual Network X_8GF (RegNetX_8GF) performs the best, with Accuracy, Precision, Recall, and F1 (which refers to the harmonic mean of the Precision and Recall values) values of 78.33%, 77.65%, 69.55%, and 71.26%, respectively. Considering the demand factors of hardware equipment and inference time, Mobile NetworkV2 achieves the best balance among the Accuracy, the number of parameters and the number of floating-point operations. The number of parameters for Mobile Network V2 (MobileNetV2) is 1/16 of RegNetX_8GF, and the number of floating-point operations is 1/24. Our findings can facilitate efficient decision-making for the management of species survey, cataloging, inspection, and monitoring in the nature reserves in Xinjiang, providing a scientific basis for the protection and utilization of natural plant resources.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abdullahi H S, Sheriff R E, Mahieddine F. 2017. Convolution neural network in precision agriculture for plant image recognition and classification. In: 2017 Seventh International Conference on Innovative Computing Technology (INTECH). New York: IEEE, 10: 256–272.
Barbedo J G. 2016. A review on the main challenges in automatic plant disease identification based on visible range images. Biosystems Engineering, 144: 52–60.
Bargoti S, Underwood J. 2017. Deep fruit detection in orchards. In: 2017 IEEE International Conference on Robotics and Automation (ICRA). New York: IEEE, doi: https://doi.org/10.48550/arXiv.1610.03677.
Bekker A J, Goldberger J. 2016. Training deep neural-networks based on unreliable labels. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). New York: IEEE, 2682–2686.
Cai Z. 2020. Research on deep learning model for Chinese herbal medicine planting process. MSc Thesis. Chengdu: University of Electronic Science and technology. (in Chinese)
Cao X J, Mo Y, Yan Y L. 2020. Convolutional neural network flower image recognition using transfer learning. Computer Applications and Software, 37(8): 142–148. (in Chinese)
Cao X Y, Sun W M, Zhu Y X, et al. 2018. Plant image recognition based on family priority strategy. Journal of Computer Applications, 38(11): 3241–3245. (in Chinese)
Coulibaly S, Kamsu F B, Kamissoko D, et al. 2019. Deep neural networks with transfer learning in millet crop images. Computers in Industry, 108: 115–120.
Gai R L, Cai J R, Wang S Y. 2021. Research review on image recognition based on deep learning. Journal of Chinese Computer Systems, 42(9): 1980–1984. (in Chinese)
Gao H Y, Gao X H, Feng Q S, et al. 2020. Approach to plant species identification in natural grasslands based on deep learning. Pratacultural Science, 37(9): 1931–1939. (in Chinese)
Hall D, McCool C, Dayoub F, et al. 2015. Evaluation of features for leaf classification in challenging conditions. In: 2015 IEEE Winter Conference on Applications of Computer Vision. New York: IEEE, 797–804.
He K M, Zhang X Y, Ren S Q, et al. 2016. Deep residual learning for image recognition. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). New York: IEEE, 770–778.
He M Z, Zhang J G, Wang H. 2006. Analysis of branching architecture factors of desert plants. Journal of Desert Research, (4): 625–630. (in Chinese)
Howard A G, Zhu M L, Chen B, et al. 2017. Efficient convolutional neural networks for mobile vision applications. [2022-09-01]. https://arxiv.org/abs/1704.04861v1.
Jin L T. 2020. Research on plant image recognition with complex background based on convolution neural network. MSc Thesis. Lanzhou: Lanzhou Jiaotong University. (in Chinese)
Krizhevsky A, Sutskever I, Hinton G E. 2012. ImageNet classification with deep convolutional neural networks. Advances In Neural Information Processing Systems, 25: 1097–1105.
Kussul N, Lavreniuk M, Skakun S, et al. 2017. Deep learning classification of land cover and crop types using remote sensing data. In: 2017 IEEE Geoscience and Remote Sensing Letters. New York: IEEE, 14(5): 778–782.
Lecun Y, Bengio Y. 1998. Convolutional Networks for Images, Speech, and Time Series. Cambridge, MA: MIT Press, 255–258.
Li L P, Shi F P, Tian W B, et al. 2021. Wild Plant Image recognition method based on residual network and transfer learning. Radio Engineering, 51(9): 857–863. (in Chinese)
Li M M, Xia W C, Wang M, et al. 2020. Research on monitoring of Chinese nature reserves based on bibliometrics. Journal of Ecology, 40(6): 2158–2165. (in Chinese)
Li X H, Wu Z H, Liu H, et al. 2020. Species recognition of succulent plants based on convolutional neural network model. Journal of Guizhou Normal University, 36(3): 9–15. (in Chinese)
Li Y F. 2022. Research on image classification based on optimize on factors in convolutional neural network. Journal of Jinling Institute of Technology, 38(1): 26–31. (in Chinese)
Liu F Z, Du J H, Zhou Y, et al. 2018. Biodiversity monitoring technology and practice in nature reserves combining UAV and ground. Biodiversity, 26(8): 905–917. (in Chinese)
Liu H S. 2020. Panoramic plant recognition method based on CNN and GLCM fusion discrimination. MSc Thesis. Wuhan: Hubei University of Technology. (in Chinese)
Liu Y. 2018. Research on plant recognition based on deep learning. MSc Thesis. Beijing: Beijing Forestry University. (in Chinese)
Liu Y, Luo Z. 2019. Species recognition of protected area based on AutoML. Computer Systems & Applications, 28(9): 147–153. (in Chinese)
Mikolov T, Deo R A, Povey D, et al. 2011. Strategies for training large scale neural network language models. In: 2011 IEEE Workshop on Automatic Speech Recognition & Understanding. New York: IEEE, 196–201.
Ming Y. 2021. The adjusted “List of National Key Protected Wild Plants” was officially announced. Green China, (19): 74–79. (in Chinese)
Shen T M J. 2021. Video denoising based on prior information and convolutional neural network. MSc Thesis. Chengdu: University of Electronic Science and technology. (in Chinese)
Simonyan K, Zisserman A. 2014. Very deep convolutional networks for large-scale image recognition. [2022-09-01]. https://arxiv.org/pdf/1409.1556.pdf.
Su H M, Niu S M. 2016. Color Atlas of Wild Vascular Bundle Plants in Bogda Biosphere. Beijing: China Forestry Press, 10–95. (in Chinese)
Tang M J. 2020. Research on fast prediction method of ship resistance performance based on convolutional neural network. MSc Thesis. Harbin: Harbin Engineering University. (in Chinese)
Wang Y W, Tang X L, Xu J P, et al. 2019. The use of big data in nature reserves. China Forestry Economy, (4): 16–20, 27. (in Chinese)
Xiao Z S. 2019. Application of infrared camera technology in wildlife inventory and assessment of natural reserves in China. Biodiversity, 27(3): 235–236. (in Chinese)
Xinjiang Flora Editorial Committee. 1992–2004. Xinjiang Flora (Volume I–Volume VI). Urumqi: Xinjiang Science and Technology Press. (in Chinese)
Yang X D, LV G H, Tian Y H, et al. 2009. Ecological grouping of plants in Lake Abby Wetland Nature Reserve in Xinjiang. Journal of Ecology, 28(12): 2489–2494. (in Chinese)
Yin L K, Pan B R, Wang Y, et al. 1991. Introduction and cultivation of rare and endangered plants in temperate desert. Arid Zone Research, (2): 1–8. (in Chinese)
Zhang S, Huai Y J. 2016. Leaf image recognition based on layered convolutions neural network deep learning. Journal of Beijing Forestry University, 38(9): 108–115. (in Chinese)
Acknowledgements
This work was supported by the West Light Foundation of the Chinese Academy of Sciences (2019-XBQNXZ-A-007) and the National Natural Science Foundation of China (12071458, 71731009).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Li, J., Sun, S., Jiang, H. et al. Image recognition and empirical application of desert plant species based on convolutional neural network. J. Arid Land 14, 1440–1455 (2022). https://doi.org/10.1007/s40333-022-0086-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s40333-022-0086-9