Skip to main content
SpringerLink
Log in

Classification of wheat varieties with image-based deep learning

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Wheat is an important grain in the food chain. It is important in terms of efficiency and economy to use wheat in the appropriate area according to its varieties. Breeding studies make varieties of wheat physically similar to each other and make it difficult to classify according to variety. An image-based deep learning approach is proposed to classify wheat accurately and reduce classification difficulties. Twenty-four varieties of wheat were used in the study and these varieties were harvested in five provinces of Turkey. The reflectance values ​​of the wheat varieties were measured with a near-infrared spectrometer device and the measured reflectance values ​​were used to create wheat images with a suggested method. With this method, low-dimensional images were created with reflection data that take up less space instead of a high-resolution image and a high-storage space requirement. With the classification processes, a 96.55% accuracy was obtained for the hard-white wheat class, 98.70% for the hard-red wheat class and 99.52% for all wheat varieties. The results show that the proposed image generation method with reflection data and the deep learning model is sufficient in classification. This method offers a new approach to the classification of wheat-like cereals. The proposed method can be considered an alternative classification method in the wheat production and trading sectors. It can also be used in the industry by integrating it into hardware with low memory/low processing power. This scenario can also be considered as a method for classifying grain groups other than wheat.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Data availability

Raw data were generated at The Center for Intelligent Systems Applications Research's facility (CISAR).

The datasets generated during and/or analysed during the current study are not publicly available due to ongoing works and project support applications but are available from the corresponding author on reasonable request.

To access the data of this article, you can create an access request on GitHub (https://github.com/merveceyhan/wheat-classification) or contact the responsible author via e-mail.

References

  1. Affonso C, Rossi ALD, Vieira FHA et al (2017) Deep learning for biological image classification. Expert Syst Appl 85:114–122. https://doi.org/10.1016/j.eswa.2017.05.039

    Article  Google Scholar 

  2. Ahmad S, Ahmed M (2014) A review on biscuit, a largest consumed processed product in India, its fortification and nutritional improvement. International Journal of Science Inventions Today 3:169–186

    Google Scholar 

  3. Ali A, Zhu Y, Zakarya M (2022) Exploiting dynamic spatio-temporal graph convolutional neural networks for citywide traffic flows prediction. Neural Netw 145:233–247

    Article  Google Scholar 

  4. Amatya S, Karkee M, Gongal A, Zhang Q, Whiting MD (2016) Detection of cherry tree branches with full foliage in planar architecture for automated sweet-cherry harvesting. Biosys Eng 146:3–15. https://doi.org/10.1016/j.biosystemseng.2015.10.003

    Article  Google Scholar 

  5. Ambati LS, El-Gayar O (2021) Human activity recognition: a comparison of machine learning approaches. Journal of the Midwest Association for Information Systems 2021(1) 49. https://doi.org/10.17705/3jmwa.000065

  6. Blanco M, Villarroya I (2002) NIR spectroscopy: a rapid-response analytical tool. TrAC, Trends Anal Chem 21(4):240–250. https://doi.org/10.1016/s0165-9936(02)00404-1

    Article  Google Scholar 

  7. Bushuk W (1997) Wheat breeding for end-product use. In Wheat: Prospects for Global Improvement (pp. 203–211) Springer

  8. Cassells JA, Reuss R, Osborne BG, Wesley IJ (2007) Near infrared spectroscopic studies of changes in stored grain. J Near Infrared Spectrosc 15(3):161–167. https://doi.org/10.1255/jnirs.727

    Article  Google Scholar 

  9. Curtis BC, Rajaram S, Gomez Macpherson H (2002) Bread wheat/wheat in the world. Food and agriculture organization of the united nations

  10. David E, Madec S, Sadeghi-Tehran P, Aasen H et al (2020) Global wheat head detection (GWHD) Dataset: A large and diverse dataset of high-resolution RGB-labelled images to develop and benchmark wheat head detection methods. Plant Phenomics. https://doi.org/10.34133/2020/3521852

  11. Deleglise H, Interdonato R, Begue A, d’Hotel EM et al (2022) Food security prediction from heterogeneous data combining machine and deep learning methods. Expert Systems with Applications 190:116189. https://doi.org/10.1016/j.eswa.2021.116189

    Article  Google Scholar 

  12. DLP NIRscan Nano [Online] (2017) DLP NIRscan Nano EVM user's guide Available: https://www.ti.com/lit/pdf/dlpu030 Accessed 15 May 2023

  13. Druzhkov PN, Kustikova VD (2016) A survey of deep learning methods and software tools for image classification and object detection. Pattern Recognit Image Anal 26(1):9–15. https://doi.org/10.1134/s1054661816010065

    Article  Google Scholar 

  14. Dziki D, Laskowski J (2005) Wheat kernel physical properties and milling process. Acta Agrophys 6(1):59–71

    Google Scholar 

  15. Ebrahimi MA, Khoshtaghaza MH, Minaei S, Jamshidi B (2017) Vision-based pest detection based on SVM classification method. Comput Electron Agric 137:52–58. https://doi.org/10.1016/j.compag.2017.03.016

    Article  Google Scholar 

  16. Elmasry G, Kamruzzaman M, Sun DW, Allen P (2012) Principles and applications of hyperspectral imaging in quality evaluation of agro-food products: a review. Crit Rev Food Sci Nutr 52(11):999–1023. https://doi.org/10.1080/10408398.2010.543495

    Article  Google Scholar 

  17. Feng Z, Tang T, Wu T, Yu X, Zhang Y, Wang M et al (2021) Perfecting and extending the near-infrared imaging window. Light: Science Applications 10(1) 1–18

  18. Ferentinos K (2018) Deep learning models for plant disease detection and diagnosis. Comput Electron Agric 145:311–318. https://doi.org/10.1016/j.compag.2018.01.009

    Article  Google Scholar 

  19. Helguera M, Abugalieva A, Battenfield S, Bekes F et al (2020) Grain quality in breeding. Wheat quality for improving processing and human health, 308

  20. Ichwana I, Nasution Z, Munawar AA (2020) Near-infrared spectroscopy as a rapid and simultaneous assessment of agricultural groundwater quality parameters. Inmateh-Agricultural Engineering 60(1). https://doi.org/10.35633/inmateh-60-26

  21. Isik S, Ozkan K, Demirez DZ, Seke E (2020) Consensus rule for wheat cultivar classification on VL, VNIR and SWIR imaging. IET Image Processing. https://doi.org/10.1049/ipr2.12206

  22. Islam N, Rashid MM, Wibowo S, Xu CY et al (2021) Early weed detection using image processing and machine learning techniques in an australian chilli farm. Agriculture 11(5):387. https://doi.org/10.3390/agriculture11050387

    Article  Google Scholar 

  23. Jin X, Sun Y, Che J, Bagavathiannan M et al (2022) A novel deep learning based method for detection of weeds in vegetables. Pest Manag Sci. https://doi.org/10.1002/ps.6804

    Article  Google Scholar 

  24. Karaduman Y, Belen S, Olgun M, Ceyhan M et al (2020) Ulkesel ekmeklı̇k bugday alim baremı̇nde ekmeklı̇k bugday cesitlerı̇nı̇n ayrimi: yapay zeka desteklı̇ oruntu tanima uygulamalarinin kullanılabı̇lı̇rlı̇ğı̇. Research Journal of Biology Sciences 13(2)

  25. Krizhevsky A, Sutskever I, Hinton GE (2017) ImageNet classification with deep convolutional neural networks. Commun ACM 60(6):84–90

    Article  Google Scholar 

  26. Kujawa S, Niedbala G (2021) Artificial neural networks in agriculture. Multidisciplinary Digital Publishing Institute 11:497

    Google Scholar 

  27. Lingwal S, Bhatia KK, Tomer MS (2021) Image-based wheat grain classification using convolutional neural network. Multimedia Tools and Applications. https://doi.org/10.1007/s11042-020-10174-3

    Article  Google Scholar 

  28. Liu J, Li J (2022) Risk analysis of textile industry foreign investment based on deep learning. Comput Intell Neurosci. https://doi.org/10.1155/2022/3769670

    Article  Google Scholar 

  29. Madhavan J, Salim M, Durairaj U, Kotteeswaran R et al (2021) Wheat seed classification using neural network pattern recognizer. Materials Today: Proceedings. https://doi.org/10.1016/j.matpr.2021.03.226

  30. Mang Xu X, Wei Y, Huang Z, Schwing A et al (2020) Agriculture-vision: a large aerial image database for agricultural pattern analysis. Computer Vision and Pattern Recognition. https://doi.org/10.48550/arXiv.2001.01306

  31. Nematzadeh S, Kiani F, Torkamanian-Afshar M, Aydin N (2022) Tuning hyperparameters of machine learning algorithms and deep neural networks using metaheuristics: A bioinformatics study on biomedical and biological cases. Computational Biology and Chemistry 97:107619. https://doi.org/10.1016/j.compbiolchem.2021.107619

    Article  Google Scholar 

  32. Optics E [Online] (2022) What is SWIR? Available: https://www.edmundoptics.com/knowledge-center/application-notes/imaging/what-is-swir/ Accessed 15 May 2023

  33. Ozkan K, Isik S, Topsakal YB (2019) Identification of wheat kernels by fusion of RGB, SWIR, and VNIR samples. Science of Food and Agriculture. https://doi.org/10.1002/jsfa.9732

    Article  Google Scholar 

  34. Pantazi XE, Moshou D, Oberti R, West J et al (2017) Detection of biotic and abiotic stresses in crops by using hierarchical self organizing classifiers. Precision Agric 18(3):383–393. https://doi.org/10.1007/s11119-017-9507-8

    Article  Google Scholar 

  35. Rahman A, Bayram I, Khanum S, Ullah S (2015) Use and calibration of near infrared reflectance spectroscopy in feed analysis: a mini review. Pakistan Journal of Life and Social Sciences 13(1):1–7

    Google Scholar 

  36. Ramlakhan S, Saatchi R, Sabir L, Singh Y, Hughes R, Shobayo O, Ventour D (2022) Understanding and interpreting artificial intelligence. Machine Learning and Deep Learning in Emergency Medicine 39(5):380–385. https://doi.org/10.1136/emermed-2021-212068

    Article  Google Scholar 

  37. Ramos PJ, Prieto FA, Montoya EC, Oliveros CE (2017) Automatic fruit count on coffee branches using computer vision. Comput Electron Agric 137:9–22. https://doi.org/10.1016/j.compag.2017.03.010

    Article  Google Scholar 

  38. Ridgway C, Chambers J, Cowe IA (1999) Detection of grain weevils inside single wheat kernels by a very near infrared two-wavelength model. J Near Infrared Spectrosc 7(4):213–221. https://doi.org/10.1255/jnirs.251

    Article  Google Scholar 

  39. Rubinger L, Gazendam A, Ekhtiari S, Bhandari M (2022) Machine learning and artificial intelligence in research and healthcare. Injury. https://doi.org/10.1016/j.injury.2022.01.046

    Article  Google Scholar 

  40. Sabanci K, Kayabasi A, Toktas A (2017) Computer vision-based method for classification of wheat grains using artificial neural network. J Sci Food Agric 97(8):2588–2593. https://doi.org/10.1002/jsfa.8080

    Article  Google Scholar 

  41. Sabanci K, Toktas A, Kayabasi A (2017) Grain classifier with computer vision using adaptive neuro-fuzzy inference system. J Sci Food Agric 97(12):3994–4000. https://doi.org/10.1002/jsfa.8264

    Article  Google Scholar 

  42. Saleem MH, Potgieter J, Arif KM (2021) Automation in agriculture by machine and deep learning techniques: a review of recent developments. Precision Agric. https://doi.org/10.1007/s11119-021-09806-x

    Article  Google Scholar 

  43. Selvi MS, Deepa K, Saranya N, Rani SJ (2022) Deep learning in agriculture as a computer vision system. Cyber-Physical Systems and Industry 4.0: Practical Applications Security Management pp. 225–236

  44. Sengupta S, Lee WSJBE (2014) Identification and determination of the number of immature green citrus fruit in a canopy under different ambient light conditions. Biosys Eng 117:51–61

    Article  Google Scholar 

  45. Senthilnath J, Dokania A, Kandukuri M, Ramesh KN, Anand G, Omkar SN (2016) Detection of tomatoes using spectral-spatial methods in remotely sensed RGB images captured by UAV. Biosys Eng 146:16–32. https://doi.org/10.1016/j.biosystemseng.2015.12.003

    Article  Google Scholar 

  46. Sethy PK (2022) Identification of wheat tiller based on AlexNet-feature fusion. Multimedia Tools and Applications 81(6):8309–8316. https://doi.org/10.1007/s11042-022-12286-4

    Article  Google Scholar 

  47. Shamtsyan M, Pasetti M, Beskopylny A (2022) Robotics, machinery and engineering technology for precision agriculture

  48. Shewry PR (2009) Wheat. J Exp Bot 60(6):1537–1553. https://doi.org/10.1093/jxb/erp058

    Article  Google Scholar 

  49. Singh M, Kumar B, Chattopadhyay R, Amarjyothi K et al (2022) Artificial intelligence and machine learning in earth system sciences with special reference to climate science and meteorology in South Asia. Current Science 122(9) 1019. https://doi.org/10.18520/cs/v122/i9/1019-1030

  50. Skovmand B, Rajaram S, Ribaut JM, Hede AR (2002) Bread wheat: improvement and production (9251048096) Rome, Italy

  51. Suprapto PK, Ardiansyah R, Chaidir DM, Baiq B, Meylani V (2022) Deep learning in biology: 3D representation of online and reality. International Journal of Multidisciplinary: Applied Business Education Research 3(4) 571–578–571–578. https://doi.org/10.11594/ijmaber

  52. UCI Machine Learning Repository [Online] (2023) Available: https://archive.ics.uci.edu/ml/datasets.php Accessed 15 May 2023

  53. Urva P (2021) Detection and classification of grain crops and legumes disease: a survey. Sparklinglight Transactions on Artificial Intelligence and Quantum Computing 1(1):41–55. https://doi.org/10.55011/staiqc.2021.11

    Article  Google Scholar 

  54. Texas Instruments DLP® NIRscan™ Nano Evaluation Module (EVM) Optical Design Considerations [Online] (2016) Available: https://www.ti.com/lit/DLPA062 Accessed 15 May 2023

  55. Vincent B, Dardenne P (2021) Application of NIR in agriculture. In Near-Infrared Spectroscopy pp. 331–345

  56. Vinogradov AN, Egorov VV, Kalinin AP, Rodionov AI, Rodionov ID (2017) Hyperspectrometer for the 900–1700 nm near-infrared region. J Opt Technol 84(10):683–687. https://doi.org/10.1364/JOT.84.000683

    Article  Google Scholar 

  57. Visual Geometry Group, University of Oxford [Online] (2023) Available: https://www.robots.ox.ac.uk/~vgg/ Accessed 15 May 2023

  58. Wang C, Liu B, Liu L, Zhu Y, Hou J, Liu P, Li X (2021) A review of deep learning used in the hyperspectral image analysis for agriculture. Artif Intell Rev 54(7):5205–5253. https://doi.org/10.1007/s10462-021-10018-y

    Article  Google Scholar 

  59. Xia Y, Tian X, Li J, Fan S, Huang W (2019) Prediction and comparison of models for soluble solids content determination in ‘Ya’ pears using optical properties and diffuse reflectance in 900–1700 nm spectral region. IEEE Access 7:179199–179211. https://doi.org/10.1109/access.2019.2959028

    Article  Google Scholar 

  60. Yang X, Guo M, Lyu Q, Ma M (2021) Detection and classification of damaged wheat kernels based on progressive neural architecture search. Biosys Eng 208:176–185. https://doi.org/10.1016/j.biosystemseng.2021.05.016

    Article  Google Scholar 

  61. Zhang D, Chen G, Zhang H, Jin N, Gu C, Weng S et al (2020) Integration of spectroscopy and image for identifying fusarium damage in wheat kernels. Spectrochimica Acta Part A: Molecular Biomolecular Spectroscopy 236:118344. https://doi.org/10.1016/j.saa.2020.118344

    Article  Google Scholar 

  62. Zhang J, Rao Y, Man C, Jiang Z, Li S (2021) Identification of cucumber leaf diseases using deep learning and small sample size for agricultural internet of things. Int J Distrib Sens Netw 17(4):155014772110074. https://doi.org/10.1177/15501477211007407

    Article  Google Scholar 

Download references

Acknowledgements

This project was financially supported by TUBITAK: Number 1200226.

Author information

Authors and Affiliations

  1. Department of Computer Engineering, Eskişehir Osmangazi University, Eskişehir, Turkey

    Merve Ceyhan, Yusuf Kartal & Kemal Özkan

  2. Department of Electrical and Electronics Engineering, Eskişehir Osmangazi University, Eskişehir, Turkey

    Erol Seke

Authors
  1. Merve Ceyhan
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Yusuf Kartal
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kemal Özkan
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Erol Seke
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Merve Ceyhan.

Ethics declarations

Conflict of interest

The authors declare that they have no known competing financial interests or personal relationships that could have influenced the work reported in this paper.

Additional information

Publisher's note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ceyhan, M., Kartal, Y., Özkan, K. et al. Classification of wheat varieties with image-based deep learning. Multimed Tools Appl 83, 9597–9619 (2024). https://doi.org/10.1007/s11042-023-16075-5

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-023-16075-5

Keywords

Search

Navigation