Abstract
This manuscript introduces a handheld machine vision based system design that is capable of standalone operation using touch screen based user interface and also can operate through smartphone based android app. System uses 8.0 Megapixel, 1080p CMOS camera interfaced with quad-core ARM Cortex-A53 processor based computing platform (Raspberry Pi computing platform) for real time image acquisition and processing. Multi-spectral led array has been used to compensate the effect of external illumination and also to increase the accuracy of measurement. System stores acquired images on interfaced 16.0 G.B. external memory card with date and time information. Various segmentation methods have been explored to extract region of interest in acquired images and compared based on the capability of segmentation in real-time. Segmented images have been used to extract different features such as color, shape, size and texture using various image processing algorithms. Extracted features have been fused together and undergone through different statistical and neural network based modelling methods to correlate features dataset generated using handheld system with standard quality parameters of collected citrus samples. Performance of the established correlation models for various quality parameters such as chlorophyll, sugar content, TSS, weight, pH and volume have been evaluated and best performed models for each quality parameter has been used to train the developed handheld machine vision based system. Overall system is battery operated and also enables cloud connectivity using on-board Wi-Fi facility or smartphone based android app. Overall device has dimensions of 12.0 × 6.0 × 4.0 (in cm), weighs 139.07 g and runs with 5-V rechargeable battery.
Similar content being viewed by others
References
L. Sharon-Asa et al., Citrus fruit flavor and aroma biosynthesis: isolation, functional characterization, and developmental regulation of Cstps1, a key gene in the production of the sesquiterpene aroma compound valencene. Plant J. 36(5), 664–674 (2003)
Y. Jiang, J. Song, Fruits and Fruit Flavor: Classification and Biological Characterization. Handbook of Fruit and Vegetable Flavors (Wiley, New York, 2010)
F. Tadesse, Post-harvest losses of fruits and vegetables in horticultural state farms. I. International Symposium on Horticultural Economics in Developing Countries 270 (1989).
K.K. Patel et al., Machine vision system: a tool for quality inspection of food and agricultural products. J. Food Sci. Technol. 49(2), 123–141 (2012)
H. Huang, Li Liu, M. Ngadi, Recent developments in hyperspectral imaging for assessment of food quality and safety. Sensors 14(4), 7248–7276 (2014)
S. Laykin et al., Image–processing algorithms for tomato classification. Trans. ASAE 45(3), 851 (2002)
M.A. Shahin et al., Apple classification based on surface bruises using image processing and neural networks. Trans. ASAE 45(5), 1619 (2002)
N.V. Rivera et al., Early detection of mechanical damage in mango using NIR hyperspectral images and machine learning. Biosyst. Eng. 122, 91–98 (2014)
B. Zhang et al., Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: a review. Food Res. Int. 62, 326–343 (2014)
S. Naik, B. Patel, Machine vision based fruit classification and grading-a review. Int. J. Comput. Appl. 170(9), 22–34 (2017)
J. Blasco, N. Aleixos, E. Moltó, Machine vision system for automatic quality grading of fruit. Biosyst. Eng. 85(4), 415–423 (2003)
Y. Alhali, Computer vision based date fruit grading system: design and implementation. J. King Saud Univ. Comput. Inf. Sci. 23(1), 29–36 (2011)
G. Feng, Q. Qixin. Study on color image processing based intelligent fruit sorting system. Fifth World Congress on Intelligent Control and Automation (IEEE Cat. No. 04EX788). Vol. 6. IEEE (2004).
K. Kapach et al., Computer vision for fruit harvesting robots–state of the art and challenges ahead. Int. J. Comput. Vis. Robot. 3, 4–34 (2012)
X. Rao, Y. Ying, Color model for fruit quality inspection with machine vision. Opt. Sens. Sens. Syst. Nat. Resour. Food Saf. Qual. (2005). https://doi.org/10.1117/12.630504
M. Rashidi, M. Gholami, Determination of kiwifruit volume using ellipsoid approximation and image-processing methods. Int. J. Agric. Biol 10(4), 375–380 (2008)
V.G. Narendra, K.S. Hareesha, Quality inspection and grading of agricultural and food products by computer vision: a review. Int. J. Comput. Appl. 2(1), 43–65 (2010)
N. Aleixos, Multispectral inspection of citrus in real-time using machine vision and digital signal processors. Comput. Electron. Agric. 33(2), 121–137 (2002)
C.-J. Du, D.-W. Sun, Learning techniques used in computer vision for food quality evaluation: a review. J. Food Eng. 72(1), 39–55 (2006)
T. Brosnan, D.-W. Sun, Inspection and grading of agricultural and food products by computer vision systems—a review. Comput. Electron. Agric. 36(2-3), 193–213 (2002)
D.M. Barrett, J.C. Beaulieu, R. Shewfelt, Color, flavor, texture, and nutritional quality of fresh-cut fruits and vegetables: desirable levels, instrumental and sensory measurement, and the effects of processing. Crit. Rev. Food Sci. Nutr. 50(5), 369–389 (2010)
B. Dobrzanski et al., Some physical and nutritional quality parameters of storage apple. Int. Agrophys. 15(1), 13–18 (2001)
D. Seal, ARM Architecture Reference Manual (Prentice Hall, New Jersey, 1996)
Raspberry Pi Foundation. Raspberry Pi Camera Ver 2.1 Datasheet (2015)
G. Rossum. Python reference manual (1995)
G. Bradski, A. Kaehler, OpenCV. Dr. Dobb’s J. Softw. Tools 25, 120–125 (2000)
D.M. Beckles, Factors affecting the postharvest soluble solids and sugar content of tomato (Solanum lycopersicum L.) fruit. Postharvest Biol. Technol. 63(1), 129–140 (2012)
E. Lanza, B.W. Li, Application for near infrared spectroscopy for predicting the sugar content of fruit juices. J. Food Sci. 49(4), 995–998 (1984)
E.W. Yemm, A.J. Willis, The estimation of carbohydrates in plant extracts by anthrone. Biochem. J. 57(3), 508 (1954)
R.K. Prange et al., Oxygen concentration affects chlorophyll fluorescence in chlorophyll-containing fruit. Postharvest Biol. Technol. 24(2), 201–205 (2002)
J.P. Palta, Leaf chlorophyll content. Remote Sens. Rev. 5(1), 207–213 (1990)
N. Otsu, A threshold selection method from gray-level histograms. IEEE Trans. Syst. Man Cybern. 9(1), 62–66 (1979)
J. Blasco et al., Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features. Biosyst. Eng. 103(2), 137–145 (2009)
P. Deepa, S.N. Geethalakshmi. Improved watershed segmentation for apple fruit grading. 2011 International Conference on Process Automation, Control and Computing. IEEE (2011).
K.L. Yam, S.E. Papadakis, A simple digital imaging method for measuring and analyzing color of food surfaces. J. Food Eng. 61(1), 137–142 (2004)
H. Zheng, Lu Hongfei, A least-squares support vector machine (LS-SVM) based on fractal analysis and CIELab parameters for the detection of browning degree on mango (Mangifera indica L.). Comput. Electron. Agric. 83, 47–51 (2012)
Xu Liming, Z. Yanchao, Automated strawberry grading system based on image processing. Comput. Electron. Agric. 71, S32–S39 (2010)
U. Bairam, P.J. Green, Melon crack identification and classification using k-means clustering for quality inspection. 2018 Colour and Visual Computing Symposium (CVCS). IEEE (2018).
J. Blasco et al., Citrus sorting by identification of the most common defects using multispectral computer vision. J. Food Eng. 83(3), 384–393 (2007)
J. Blasco, N. Aleixos, E. Moltó, Computer vision detection of peel defects in citrus by means of a region oriented segmentation algorithm. J. Food Eng. 81(3), 535–543 (2007)
F. López-García et al., Automatic detection of skin defects in citrus fruits using a multivariate image analysis approach. Comput. Electron. Agric 71(2), 189–197 (2010)
V. Leemans, M.-F. Destain, A real-time grading method of apples based on features extracted from defects. J. Food Eng. 61(1), 83–89 (2004)
M.T. Habib et al., Machine vision based papaya disease recognition. J. King Saud Univ. Comput. Inf. Sci. 32, 300–309 (2018)
Acknowledgements
Authors want to acknowledge Director CSIR-CEERI, Pilani for allowing us to carry this research forward. Acknowledgments are also due to control and automation group members for helping in data collection, system testing and demonstration.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Srivastava, S., Vani, B. & Sadistap, S. Machine-vision based handheld embedded system to extract quality parameters of citrus cultivars. Food Measure 14, 2746–2759 (2020). https://doi.org/10.1007/s11694-020-00520-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11694-020-00520-2