Skip to main content
SpringerLink
Log in

Machine-vision based handheld embedded system to extract quality parameters of citrus cultivars

  • Original Paper
  • Published:
Journal of Food Measurement and Characterization Aims and scope Submit manuscript

Abstract

This manuscript introduces a handheld machine vision based system design that is capable of standalone operation using touch screen based user interface and also can operate through smartphone based android app. System uses 8.0 Megapixel, 1080p CMOS camera interfaced with quad-core ARM Cortex-A53 processor based computing platform (Raspberry Pi computing platform) for real time image acquisition and processing. Multi-spectral led array has been used to compensate the effect of external illumination and also to increase the accuracy of measurement. System stores acquired images on interfaced 16.0 G.B. external memory card with date and time information. Various segmentation methods have been explored to extract region of interest in acquired images and compared based on the capability of segmentation in real-time. Segmented images have been used to extract different features such as color, shape, size and texture using various image processing algorithms. Extracted features have been fused together and undergone through different statistical and neural network based modelling methods to correlate features dataset generated using handheld system with standard quality parameters of collected citrus samples. Performance of the established correlation models for various quality parameters such as chlorophyll, sugar content, TSS, weight, pH and volume have been evaluated and best performed models for each quality parameter has been used to train the developed handheld machine vision based system. Overall system is battery operated and also enables cloud connectivity using on-board Wi-Fi facility or smartphone based android app. Overall device has dimensions of 12.0 × 6.0 × 4.0 (in cm), weighs 139.07 g and runs with 5-V rechargeable battery.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. L. Sharon-Asa et al., Citrus fruit flavor and aroma biosynthesis: isolation, functional characterization, and developmental regulation of Cstps1, a key gene in the production of the sesquiterpene aroma compound valencene. Plant J. 36(5), 664–674 (2003)

    CAS  PubMed  Google Scholar 

  2. Y. Jiang, J. Song, Fruits and Fruit Flavor: Classification and Biological Characterization. Handbook of Fruit and Vegetable Flavors (Wiley, New York, 2010)

    Google Scholar 

  3. F. Tadesse, Post-harvest losses of fruits and vegetables in horticultural state farms. I. International Symposium on Horticultural Economics in Developing Countries 270 (1989).

  4. K.K. Patel et al., Machine vision system: a tool for quality inspection of food and agricultural products. J. Food Sci. Technol. 49(2), 123–141 (2012)

    PubMed  Google Scholar 

  5. H. Huang, Li Liu, M. Ngadi, Recent developments in hyperspectral imaging for assessment of food quality and safety. Sensors 14(4), 7248–7276 (2014)

    CAS  PubMed  Google Scholar 

  6. S. Laykin et al., Image–processing algorithms for tomato classification. Trans. ASAE 45(3), 851 (2002)

    Google Scholar 

  7. M.A. Shahin et al., Apple classification based on surface bruises using image processing and neural networks. Trans. ASAE 45(5), 1619 (2002)

    Google Scholar 

  8. N.V. Rivera et al., Early detection of mechanical damage in mango using NIR hyperspectral images and machine learning. Biosyst. Eng. 122, 91–98 (2014)

    Google Scholar 

  9. B. Zhang et al., Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: a review. Food Res. Int. 62, 326–343 (2014)

    Google Scholar 

  10. S. Naik, B. Patel, Machine vision based fruit classification and grading-a review. Int. J. Comput. Appl. 170(9), 22–34 (2017)

    Google Scholar 

  11. J. Blasco, N. Aleixos, E. Moltó, Machine vision system for automatic quality grading of fruit. Biosyst. Eng. 85(4), 415–423 (2003)

    Google Scholar 

  12. Y. Alhali, Computer vision based date fruit grading system: design and implementation. J. King Saud Univ. Comput. Inf. Sci. 23(1), 29–36 (2011)

    Google Scholar 

  13. G. Feng, Q. Qixin. Study on color image processing based intelligent fruit sorting system. Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No. 04EX788). Vol. 6. IEEE (2004).

  14. K. Kapach et al., Computer vision for fruit harvesting robots–state of the art and challenges ahead. Int. J. Comput. Vis. Robot. 3, 4–34 (2012)

    Google Scholar 

  15. X. Rao, Y. Ying, Color model for fruit quality inspection with machine vision. Opt. Sens. Sens. Syst. Nat. Resour. Food Saf. Qual. (2005). https://doi.org/10.1117/12.630504

    Article  Google Scholar 

  16. M. Rashidi, M. Gholami, Determination of kiwifruit volume using ellipsoid approximation and image-processing methods. Int. J. Agric. Biol 10(4), 375–380 (2008)

    Google Scholar 

  17. V.G. Narendra, K.S. Hareesha, Quality inspection and grading of agricultural and food products by computer vision: a review. Int. J. Comput. Appl. 2(1), 43–65 (2010)

    Google Scholar 

  18. N. Aleixos, Multispectral inspection of citrus in real-time using machine vision and digital signal processors. Comput. Electron. Agric. 33(2), 121–137 (2002)

    Google Scholar 

  19. C.-J. Du, D.-W. Sun, Learning techniques used in computer vision for food quality evaluation: a review. J. Food Eng. 72(1), 39–55 (2006)

    Google Scholar 

  20. T. Brosnan, D.-W. Sun, Inspection and grading of agricultural and food products by computer vision systems—a review. Comput. Electron. Agric. 36(2-3), 193–213 (2002)

    Google Scholar 

  21. D.M. Barrett, J.C. Beaulieu, R. Shewfelt, Color, flavor, texture, and nutritional quality of fresh-cut fruits and vegetables: desirable levels, instrumental and sensory measurement, and the effects of processing. Crit. Rev. Food Sci. Nutr. 50(5), 369–389 (2010)

    PubMed  Google Scholar 

  22. B. Dobrzanski et al., Some physical and nutritional quality parameters of storage apple. Int. Agrophys. 15(1), 13–18 (2001)

    Google Scholar 

  23. D. Seal, ARM Architecture Reference Manual (Prentice Hall, New Jersey, 1996)

    Google Scholar 

  24. Raspberry Pi Foundation. Raspberry Pi Camera Ver 2.1 Datasheet (2015)

  25. G. Rossum. Python reference manual (1995)

  26. G. Bradski, A. Kaehler, OpenCV. Dr. Dobb’s J. Softw. Tools 25, 120–125 (2000)

    Google Scholar 

  27. D.M. Beckles, Factors affecting the postharvest soluble solids and sugar content of tomato (Solanum lycopersicum L.) fruit. Postharvest Biol. Technol. 63(1), 129–140 (2012)

    CAS  Google Scholar 

  28. E. Lanza, B.W. Li, Application for near infrared spectroscopy for predicting the sugar content of fruit juices. J. Food Sci. 49(4), 995–998 (1984)

    CAS  Google Scholar 

  29. E.W. Yemm, A.J. Willis, The estimation of carbohydrates in plant extracts by anthrone. Biochem. J. 57(3), 508 (1954)

    CAS  PubMed  PubMed Central  Google Scholar 

  30. R.K. Prange et al., Oxygen concentration affects chlorophyll fluorescence in chlorophyll-containing fruit. Postharvest Biol. Technol. 24(2), 201–205 (2002)

    CAS  Google Scholar 

  31. J.P. Palta, Leaf chlorophyll content. Remote Sens. Rev. 5(1), 207–213 (1990)

    Google Scholar 

  32. N. Otsu, A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)

    Google Scholar 

  33. J. Blasco et al., Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features. Biosyst. Eng. 103(2), 137–145 (2009)

    Google Scholar 

  34. P. Deepa, S.N. Geethalakshmi. Improved watershed segmentation for apple fruit grading. 2011 International Conference on Process Automation, Control and Computing. IEEE (2011).

  35. K.L. Yam, S.E. Papadakis, A simple digital imaging method for measuring and analyzing color of food surfaces. J. Food Eng. 61(1), 137–142 (2004)

    Google Scholar 

  36. H. Zheng, Lu Hongfei, A least-squares support vector machine (LS-SVM) based on fractal analysis and CIELab parameters for the detection of browning degree on mango (Mangifera indica L.). Comput. Electron. Agric. 83, 47–51 (2012)

    Google Scholar 

  37. Xu Liming, Z. Yanchao, Automated strawberry grading system based on image processing. Comput. Electron. Agric. 71, S32–S39 (2010)

    Google Scholar 

  38. U. Bairam, P.J. Green, Melon crack identification and classification using k-means clustering for quality inspection. 2018 Colour and Visual Computing Symposium (CVCS). IEEE (2018).

  39. J. Blasco et al., Citrus sorting by identification of the most common defects using multispectral computer vision. J. Food Eng. 83(3), 384–393 (2007)

    Google Scholar 

  40. J. Blasco, N. Aleixos, E. Moltó, Computer vision detection of peel defects in citrus by means of a region oriented segmentation algorithm. J. Food Eng. 81(3), 535–543 (2007)

    Google Scholar 

  41. F. López-García et al., Automatic detection of skin defects in citrus fruits using a multivariate image analysis approach. Comput. Electron. Agric 71(2), 189–197 (2010)

    Google Scholar 

  42. V. Leemans, M.-F. Destain, A real-time grading method of apples based on features extracted from defects. J. Food Eng. 61(1), 83–89 (2004)

    Google Scholar 

  43. M.T. Habib et al., Machine vision based papaya disease recognition. J. King Saud Univ. Comput. Inf. Sci. 32, 300–309 (2018)

    Google Scholar 

Download references

Acknowledgements

Authors want to acknowledge Director CSIR-CEERI, Pilani for allowing us to carry this research forward. Acknowledgments are also due to control and automation group members for helping in data collection, system testing and demonstration.

Author information

Authors and Affiliations

  1. Academy of Scientific & Innovative Research (AcSiR), CSIR-CEERI, Pilani, India

    Satyam Srivastava

  2. BITS, Pilani, India

    B. Vani

  3. CSIR-CEERI, Pilani, India

    Satyam Srivastava & Shashikant Sadistap

Authors
  1. Satyam Srivastava
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. B. Vani
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shashikant Sadistap
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Satyam Srivastava.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Srivastava, S., Vani, B. & Sadistap, S. Machine-vision based handheld embedded system to extract quality parameters of citrus cultivars. Food Measure 14, 2746–2759 (2020). https://doi.org/10.1007/s11694-020-00520-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11694-020-00520-2

Keywords

Search

Navigation