Abstract
Grading of the fruits is one of the important post harvest tasks that the fruit processing agro-industries do. Although the internal quality of the fruit is important, the external quality of the fruit influences the consumers and the market price significantly. External quality of the fruit is based on the features such as color, maturity, shape, texture and size of the fruit. Apart from being expensive and time consuming, the manual grading process may face challenges such as subjectivity in grading, inconsistency and non-availability of the experts during peak seasons. On the other hand, computer vision based fruit grading systems using 2D techniques do not consider self occluding surface of the fruit and fail to determine the percentage of the matured region accurately. The grading systems which approximate the shape of the fruit to a known geometrical shape fail to compute the volume of the fruits with arbitrary shapes accurately. This paper presents a nondestructive and accurate fruit grading system based on the volume and maturity feature implemented using Fuzzy Rule Based Classifier (FRBC). The system estimates the volume of the fruit using volumetric 3D reconstruction method in multiple-camera environment and computes the percentage of the matured region of the fruit with high accuracy. The experimental results show that the accuracy of the proposed grading system in volume estimation and fruit grading is 98.5%. The ability of the proposed 3D reconstruction method to reconstruct the fruits with arbitrary shapes makes the grading system more robust and dynamic.
Similar content being viewed by others
References
Abdullah MZ, Guan LC, Mohamed A, Noor MA (2002) Color vision system for ripeness inspection of oil palm elaeis guineensis. J Food Process Preserv 26(3):213–235
Abdullah MZ, Mohamad-Saleh J et al (2006) Discrimination and classification of fresh-cut starfruits (averrhoa carambola L.) using automated machine vision system. J Food Eng 76(4):506–523
Bao Y et al (2013) Dense object reconstruction with semantic priors. Proc. of IEEE Conf on computer vision and. Pattern Recogn:1264–1271
Blasco J, Aleixos N, Gómez-Sanchis J, Moltó E (2009) Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features. Biosyst Eng 103(2):137–145
Bouguet JY (2006) Camera Calibration Toolbox for Matlab. http://www.vision.caltech.edu/bouguetj/calib_doc. Accessed 21 Feb 2013
Chen Y et al (2008) Nonlocal prior Bayesian tomographic reconstruction. J Math Imaging Vis 30(2):133–146
Forbes KA, Tattersfield GM (1999) Volumetric determination of apples using machine vision techniques. Elektron J South African Inst Elect Eng 16(3):14–17
Gallo A, Muzzupappa M, Bruno F (2014) 3D reconstruction of small sized objects from a sequence of multi-focused images. J Cult Herit 2:173–182
Garrido-Novell C, Pérez-Marin D, Amigo JM et al (2012) Grading and color evolution of apples using RGB and hyper spectral imaging vision cameras. J Food Eng 113(2):281–288
Gejima Y, Zhang H, Nagata M (2003) Judgment on level of maturity for tomato quality using L* a* b* color image processing. Proc IEEE/ASME Int Conf Advanced Intell Mechatron 2:1355–1359
Goel N, Sehgal P (2015) Fuzzy classification of pre-harvest tomatoes for ripeness estimation–an approach based on automatic rule learning using decision tree. Appl Soft Comput 36:45–56
Hartley R et al (2003) Multiple-view geometry in computer vision, 2nd edn. Cambridge University Press, Cambridge
Imou K, Kaizu Y, Morita M, Yokoyama S (2006) Three-dimensional shape measurement of strawberries by volume intersection method. Trans ASABE 49(2):449–456
Iqbal SM, Gopal A, Sarma AS (2005) Volume estimation of apple fruits using image processing. Proc of IEEE Int Conf on Image Inf Process, India, p 1–6
Jadhav T, Singh K, Abhyankar A (2017) A review and comparison of multi-view 3D reconstruction methods. J Eng Res 5(3):50–72
Jadhav T et al (2018) Volumetric 3D reconstruction of real objects using voxel mapping approach in multiple-camera environment. Turk J Elec Eng Comp Sci 26:755–767
Jiménez AR, Ceres R, Pons JL (2000) A vision system based on a laser range-finder applied to robotic fruit harvesting. Mach Vis Appl 11(6):321–329
Jin L et al (2016) 3D feature constrained reconstruction for low dose CT imaging. IEEE Trans Circuits Syst Video Technol 99:1–1
Kamila NK (2015) Handbook of Research on Emerging Perspectives in Intelligent Pattern Recognition, Analysis, and Image Processing. IGI Global, p 367–382
Kandi SG (2010) Automatic defect detection and grading of single-color fruits using HSV (hue, saturation, value) color space. J Life Sci 4(7):39–45
Lee DJ, Lane RM, Chang GH (2001) Three-dimensional reconstruction for high-speed volume measurement. SPIE Machine Vision and Three-Dimensional Imaging Systems for Inspection and Metrology 4189:258–267
Lee DJ, Archibald JK, Xiong G (2011) Rapid color grading for fruit quality evaluation using direct color mapping. IEEE Trans Autom Sci Eng 8(2):292–302
Mamdani E, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7(1):1–13
May Z, Amaran MH (2011) Automated oil palm fruit grading system using artificial intelligence. Int J Eng Sci 11:30–35
Mendoza F, Dejmek P, Aguilera JM (2006) Calibrated color measurements of agricultural foods using image analysis. Postharvest Biol Technol 41(3):285–295
Milella A et al (2006) Computer vision technology for agricultural robotics. Sens Rev 26(4):290–230
Mizushima A, Lu R (2013) An image segmentation method for apple sorting and grading using support vector machine and Otsu’s method. Comput Electron Agric 94:29–37
Moreda GP, Ortiz-Cañavate J, García-Ramos FJ, Ruiz-Altisent M (2009) Non-destructive technologies for fruit and vegetable size determination–a review. J Food Eng 92(2):119–136
Nandi CS, Tudu B, Koley C (2014) A machine vision-based maturity prediction system for sorting of harvested mangoes. IEEE Trans Instrum Meas 63(7):1722–1730
Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66
Radojević RL, Petrović DV, Pavlović VB, Nikolić ZM, Uroscaron MP (2011) Digital parameterization of apple fruit size, shape and surface spottiness. Afr J Agric Res 6(13):3131–3142
Semary NA, Tharwat A, Elhariri E, Hassanien AE (2015) Fruit-based tomato grading system using features fusion and support vector machine. Proc IEEE Int Conf Intell Systems:401–410
Siswantoro J et al (2016) A new framework for measuring volume of axisymmetric food products using computer vision based on cubic spline interpolation. Proc of Int Conf on Sci and Inf Technol Indonesia p 74–78
Sun C, Berman M, Coward D, Osborne B (2007) Thickness measurement and crease detection of wheat grains using stereo vision. Pattern Recogn Lett 28(12):1501–1508
Tsai RY (1981) A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lens. IEEE J of Robot Autom 24(6):381–395
Xu L, Feng Y, Fan Z, Yun D (2014) Research into the grading method of kiwi fruit based on volume estimation and surface defect. INMATEH-Agric Eng 44(3):93–102
Yang C et al (2016) Curve like structure extraction using minimal path propagation with backtracking. IEEE Trans Image Process 25(2):988–1003
Yang C et al (2016) Structure-adaptive fuzzy estimation for random-valued impulse noise suppression. IEEE Trans Circuits Syst Video Technol 99:1–1
Yang W et al (2017) Improving low-dose CT image using residual convolutional network. IEEE Access 5:24698–24705
Yimyam P et al (2005) Physical properties analysis of mango using computer vision. Proc of ICCAS, Korea
Zhang B, Huang W, Li J, Zhao C, Fan S, Wu J, Liu C (2014) Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: a review. Food Res Int 62:326–343
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Jadhav, T., Singh, K. & Abhyankar, A. Volumetric estimation using 3D reconstruction method for grading of fruits. Multimed Tools Appl 78, 1613–1634 (2019). https://doi.org/10.1007/s11042-018-6271-3
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-018-6271-3