Skip to main content
SpringerLink
Log in

Autonomous lemon grading system by using machine learning and traditional image processing

  • Original Paper
  • Published:
International Journal on Interactive Design and Manufacturing (IJIDeM) Aims and scope Submit manuscript

Abstract

Fruits like lemons are always harvested in huge quantities. However, currently, the assessment of lemon quality as best, good and bad, which based on the color change in the surface of the lemon, is still being used manually by humans. This leads to low productivity as well as uneven grading quality. This study will present an effective method that can help the classifying has high accuracy and fast grading time that could meet industrial needs by using a conveyor belt which makes lemons move and rotate at the same time and machine learning, traditional image processing. By moving and rotating continuously on the conveyor belt, the machine learning algorithm using Yolov4 network and traditional image processing will examine the whole surface of the lemon to classify the current state of the lemon. This methodology has the advantage of being able to check the entire lemon surface and the number of lemons to be classified at the same time is not affected too much by the image processing time. Beside the number of image collection for YoloV4 also reduced significantly. These advantage are very important in real implement at the factory. The efficiency of the system will be proven through series of experiments on real machine by comparing the performance of the current machine learning, traditional method with the proposed method.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Similar content being viewed by others

Data availability

Not applicable.

References

  1. Karis, M.S., Mohd Saad, W.H., Mohd Ali, N., Chin We, K., Abdul Razif, N.R., Selamat, A., Zainal Abidin, A.F., Ahmad, M.K.A.: Fruit sorting based on machine vision technique. J. Telecommun. Electron. Comput. Eng. (JTEC) 8(4), 31–35 (2016)

    Google Scholar 

  2. Angel, L., Lizcano, S., Viola, J.: Assessing the state of maturation of the pineapple in its perolera variety using computer vision techniques. In: 2015 20th Symposium on Signal Processing, Images and Computer Vision (STSIVA), pp. 1–6 (2015). https://doi.org/10.1109/STSIVA.2015.7330446

  3. Jana, S., Basak, S., Parekh, R.: Automatic fruit recognition from natural images using color and texture features. Devices Integr. Circuit (DevIC) 2017, 620–624 (2017). https://doi.org/10.1109/DEVIC.2017.8074025

    Article  Google Scholar 

  4. Dorj, U.O., Lee, M., Yum, S.: An yield estimation in citrus orchards via fruit detection and counting using image processing. Comput. Electron. Agric. 140, 103–112 (2017)

    Article  Google Scholar 

  5. Abbood, W.T., Abdullah, O.I., Khalid, E.A.: A real-time automated sorting of robotic vision system based on the interactive design approach. Int. J. Interact. Des. Manuf. 14, 201–209 (2020). https://doi.org/10.1007/s12008-019-00628-w

    Article  Google Scholar 

  6. Gan, H., Lee, W.S., Alchanatis, V., Ehsani, R., Schueller, J.K.: Immature green citrus fruit detection using color and thermal images. Comput. Electron. Agric. 152, 117–125 (2018)

    Article  Google Scholar 

  7. Feng, J., Zeng, L., He, L.: Apple fruit recognition algorithm based on multi-spectral dynamic image analysis. Sensors 19(4), 949 (2019). https://doi.org/10.3390/s19040949

    Article  Google Scholar 

  8. Nturambirwe, J.F.I., Perold, W.J., Opara, U.L.: Classification learning of latent bruise damage to apples using shortwave infrared hyperspectral imaging. Sensors 21(15), 4990 (2021). https://doi.org/10.3390/s21154990

    Article  Google Scholar 

  9. Jawale, D., Deshmukh, M.: Real time automatic bruise detection in (Apple) fruits using thermal camera. In: 2017 International Conference on Communication and Signal Processing (ICCSP), pp. 1080–1085 (2017). https://doi.org/10.1109/ICCSP.2017.8286542

  10. Moallem, P., Serajoddin, A., Pourghassem, H.: Computer vision-based apple grading for golden delicious apples based on surface features. Inf. Process. Agric. 4(1), 33–40 (2017)

    Google Scholar 

  11. Raj, T., Hashim, F.H., Huddin, A.B., et al.: Classification of oil palm fresh fruit maturity based on carotene content from Raman spectra. Sci. Rep. 11, 18315 (2021). https://doi.org/10.1038/s41598-021-97857-5

    Article  Google Scholar 

  12. Nyarko, E.K., Vidovic, I., Radocaj, K., Cupec, R.: A nearest neighbor approach for fruit recognition in RGB-D images based on detection of convex surfaces. Expert Syst. Appl. 114, 454–466 (2018)

    Article  Google Scholar 

  13. Mulyono, I.U.W.: Parijoto fruits classification using K-nearest neighbor based on gray level co-occurrence matrix texture extraction. J. Phys. Conf. Ser. 1501(1), 012017 (2020). https://doi.org/10.1088/1742-6596/1501/1/012017

    Article  Google Scholar 

  14. Astuti, W., Dewanto, S., Soebandrija, K.E.N., Tan, S.: Automatic fruit classification using support vector machines: a comparison with artificial neural network. IOP Conf. Ser. Earth Environ. Sci. 195(1), 012047 (2018)

    Article  Google Scholar 

  15. Wang, L., Li, A., Tian, X.: Detection of fruit skin defects using machine vision system. In: 2013 Sixth International Conference on Business Intelligence and Financial Engineering, pp. 44–48 (2013). https://doi.org/10.1109/BIFE.2013.11

  16. Ansari, M.A., Dixit, M., Kurchaniya, D., Johari, P.K.: An effective approach to an image retrieval using SVM classifier. Int. J. Comput. Sci. Eng. 5, 62–72 (2017)

    Google Scholar 

  17. Naik, S., Patel, B.: Thermal imaging with fuzzy classifier for maturity and size based non-destructive mango (Mangifera Indica L.) grading. In: 2017 International Conference on Emerging Trends & Innovation in ICT (ICEI), pp. 15–20 (2017). https://doi.org/10.1109/ETIICT.2017.7977003

  18. Kumar, A., Verma, A., Shinde, G., Sukhdeve, Y., Lal, N.: Crime prediction using K-nearest neighboring algorithm. In: 2020 International Conference on Emerging Trends in Information Technology and Engineering (ic-ETITE), pp. 1–4 (2020). https://doi.org/10.1109/ic-ETITE47903.2020.155

  19. Erwin, E., Fachrurrozi, M., Fiqih, A., Saputra, B.R., Algani, R., Primanita, A.: Content based image retrieval for multi-objects fruits recognition using k-means and k-nearest neighbor. In: 2017 International Conference on Data and Software Engineering (ICoDSE), pp. 1–6 (2017)

  20. Chen, Y., An, X., Gao, S., Li, S., Kang, H.: A deep learning-based vision system combining detection and tracking for fast on-line citrus sorting. Front. Plant Sci. 11(12), 622062 (2021). https://doi.org/10.3389/fpls.2021.622062

    Article  Google Scholar 

  21. Wu, L., Zhang, H., Chen, R., Yi, J.: Fruit classification using convolutional neural network via adjust parameter and data enhancement. In: 2020 12th International Conference on Advanced Computational Intelligence (ICACI), pp. 294–301 (2020). https://doi.org/10.1109/ICACI49185.2020.9177518

  22. Kumari Behera, S., Rath, A.K., Sethy, P.K.: Fruit recognition using support vector machine based on deep features Karbala. Int. J. Mod. Sci. 6(2), 16 (2020). https://doi.org/10.33640/2405-609X.1675

    Article  Google Scholar 

  23. Jiang, H.: The analysis of plants image recognition based on deep learning and artificial neural network. IEEE Access 8, 68828–68841 (2020). https://doi.org/10.1109/ACCESS.2020.2986946

    Article  Google Scholar 

Download references

Acknowledgements

We acknowledgment the support of time and facilities from Ho Chi Minh City University of Technology (HCMUT), VNU-HCM for this study.

Funding

Not applicable.

Author information

Authors and Affiliations

  1. Department of Mechatronics, Faculty of Mechanical Engineering, Ho Chi Minh City University of Technology (HCMUT), 268 Ly Thuong Kiet Street, District 10, Ho Chi Minh City, Vietnam

    Le Duc Hanh & Danh Nguyen The Bao

  2. Vietnam National University, Ho Chi Minh City, Linh Trung Ward, Thu Duc District, Ho Chi Minh City, Vietnam

    Le Duc Hanh & Danh Nguyen The Bao

Authors
  1. Le Duc Hanh
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Danh Nguyen The Bao
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

LDH: Writing and review. DNTB: Coding.

Corresponding author

Correspondence to Le Duc Hanh.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Consent to participate

The authors consent to participate.

Consent for publication

The authors consent for publication.

Ethics approval

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hanh, L.D., Bao, D.N.T. Autonomous lemon grading system by using machine learning and traditional image processing. Int J Interact Des Manuf 17, 445–452 (2023). https://doi.org/10.1007/s12008-022-00926-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12008-022-00926-w

Keywords

Search

Navigation