Advertisement

Volumetric estimation using 3D reconstruction method for grading of fruits

  • Tushar Jadhav
  • Kulbir Singh
  • Aditya Abhyankar
Article

Abstract

Grading of the fruits is one of the important post harvest tasks that the fruit processing agro-industries do. Although the internal quality of the fruit is important, the external quality of the fruit influences the consumers and the market price significantly. External quality of the fruit is based on the features such as color, maturity, shape, texture and size of the fruit. Apart from being expensive and time consuming, the manual grading process may face challenges such as subjectivity in grading, inconsistency and non-availability of the experts during peak seasons. On the other hand, computer vision based fruit grading systems using 2D techniques do not consider self occluding surface of the fruit and fail to determine the percentage of the matured region accurately. The grading systems which approximate the shape of the fruit to a known geometrical shape fail to compute the volume of the fruits with arbitrary shapes accurately. This paper presents a nondestructive and accurate fruit grading system based on the volume and maturity feature implemented using Fuzzy Rule Based Classifier (FRBC). The system estimates the volume of the fruit using volumetric 3D reconstruction method in multiple-camera environment and computes the percentage of the matured region of the fruit with high accuracy. The experimental results show that the accuracy of the proposed grading system in volume estimation and fruit grading is 98.5%. The ability of the proposed 3D reconstruction method to reconstruct the fruits with arbitrary shapes makes the grading system more robust and dynamic.

Keywords

Volumetric reconstruction Silhouette Camera calibration Fuzzy rule based classification Fruit maturity 

Notes

References

  1. 1.
    Abdullah MZ, Guan LC, Mohamed A, Noor MA (2002) Color vision system for ripeness inspection of oil palm elaeis guineensis. J Food Process Preserv 26(3):213–235CrossRefGoogle Scholar
  2. 2.
    Abdullah MZ, Mohamad-Saleh J et al (2006) Discrimination and classification of fresh-cut starfruits (averrhoa carambola L.) using automated machine vision system. J Food Eng 76(4):506–523CrossRefGoogle Scholar
  3. 3.
    Bao Y et al (2013) Dense object reconstruction with semantic priors. Proc. of IEEE Conf on computer vision and. Pattern Recogn:1264–1271Google Scholar
  4. 4.
    Blasco J, Aleixos N, Gómez-Sanchis J, Moltó E (2009) Recognition and classification of external skin damage in citrus fruits using multispectral data and morphological features. Biosyst Eng 103(2):137–145CrossRefGoogle Scholar
  5. 5.
    Bouguet JY (2006) Camera Calibration Toolbox for Matlab. http://www.vision.caltech.edu/bouguetj/calib_doc. Accessed 21 Feb 2013
  6. 6.
    Chen Y et al (2008) Nonlocal prior Bayesian tomographic reconstruction. J Math Imaging Vis 30(2):133–146CrossRefGoogle Scholar
  7. 7.
    Forbes KA, Tattersfield GM (1999) Volumetric determination of apples using machine vision techniques. Elektron J South African Inst Elect Eng 16(3):14–17Google Scholar
  8. 8.
    Gallo A, Muzzupappa M, Bruno F (2014) 3D reconstruction of small sized objects from a sequence of multi-focused images. J Cult Herit 2:173–182CrossRefGoogle Scholar
  9. 9.
    Garrido-Novell C, Pérez-Marin D, Amigo JM et al (2012) Grading and color evolution of apples using RGB and hyper spectral imaging vision cameras. J Food Eng 113(2):281–288CrossRefGoogle Scholar
  10. 10.
    Gejima Y, Zhang H, Nagata M (2003) Judgment on level of maturity for tomato quality using L* a* b* color image processing. Proc IEEE/ASME Int Conf Advanced Intell Mechatron 2:1355–1359Google Scholar
  11. 11.
    Goel N, Sehgal P (2015) Fuzzy classification of pre-harvest tomatoes for ripeness estimation–an approach based on automatic rule learning using decision tree. Appl Soft Comput 36:45–56CrossRefGoogle Scholar
  12. 12.
    Hartley R et al (2003) Multiple-view geometry in computer vision, 2nd edn. Cambridge University Press, CambridgezbMATHGoogle Scholar
  13. 13.
    Imou K, Kaizu Y, Morita M, Yokoyama S (2006) Three-dimensional shape measurement of strawberries by volume intersection method. Trans ASABE 49(2):449–456CrossRefGoogle Scholar
  14. 14.
    Iqbal SM, Gopal A, Sarma AS (2005) Volume estimation of apple fruits using image processing. Proc of IEEE Int Conf on Image Inf Process, India, p 1–6Google Scholar
  15. 15.
    Jadhav T, Singh K, Abhyankar A (2017) A review and comparison of multi-view 3D reconstruction methods. J Eng Res 5(3):50–72Google Scholar
  16. 16.
    Jadhav T et al (2018) Volumetric 3D reconstruction of real objects using voxel mapping approach in multiple-camera environment. Turk J Elec Eng Comp Sci 26:755–767CrossRefGoogle Scholar
  17. 17.
    Jiménez AR, Ceres R, Pons JL (2000) A vision system based on a laser range-finder applied to robotic fruit harvesting. Mach Vis Appl 11(6):321–329CrossRefGoogle Scholar
  18. 18.
    Jin L et al (2016) 3D feature constrained reconstruction for low dose CT imaging. IEEE Trans Circuits Syst Video Technol 99:1–1CrossRefGoogle Scholar
  19. 19.
    Kamila NK (2015) Handbook of Research on Emerging Perspectives in Intelligent Pattern Recognition, Analysis, and Image Processing. IGI Global, p 367–382Google Scholar
  20. 20.
    Kandi SG (2010) Automatic defect detection and grading of single-color fruits using HSV (hue, saturation, value) color space. J Life Sci 4(7):39–45Google Scholar
  21. 21.
    Lee DJ, Lane RM, Chang GH (2001) Three-dimensional reconstruction for high-speed volume measurement. SPIE Machine Vision and Three-Dimensional Imaging Systems for Inspection and Metrology 4189:258–267CrossRefGoogle Scholar
  22. 22.
    Lee DJ, Archibald JK, Xiong G (2011) Rapid color grading for fruit quality evaluation using direct color mapping. IEEE Trans Autom Sci Eng 8(2):292–302CrossRefGoogle Scholar
  23. 23.
    Mamdani E, Assilian S (1975) An experiment in linguistic synthesis with a fuzzy logic controller. Int J Man Mach Stud 7(1):1–13CrossRefzbMATHGoogle Scholar
  24. 24.
    May Z, Amaran MH (2011) Automated oil palm fruit grading system using artificial intelligence. Int J Eng Sci 11:30–35Google Scholar
  25. 25.
    Mendoza F, Dejmek P, Aguilera JM (2006) Calibrated color measurements of agricultural foods using image analysis. Postharvest Biol Technol 41(3):285–295CrossRefGoogle Scholar
  26. 26.
    Milella A et al (2006) Computer vision technology for agricultural robotics. Sens Rev 26(4):290–230CrossRefGoogle Scholar
  27. 27.
    Mizushima A, Lu R (2013) An image segmentation method for apple sorting and grading using support vector machine and Otsu’s method. Comput Electron Agric 94:29–37CrossRefGoogle Scholar
  28. 28.
    Moreda GP, Ortiz-Cañavate J, García-Ramos FJ, Ruiz-Altisent M (2009) Non-destructive technologies for fruit and vegetable size determination–a review. J Food Eng 92(2):119–136CrossRefGoogle Scholar
  29. 29.
    Nandi CS, Tudu B, Koley C (2014) A machine vision-based maturity prediction system for sorting of harvested mangoes. IEEE Trans Instrum Meas 63(7):1722–1730CrossRefGoogle Scholar
  30. 30.
    Otsu N (1979) A threshold selection method from gray-level histograms. IEEE Trans Syst Man Cybern 9(1):62–66MathSciNetCrossRefGoogle Scholar
  31. 31.
    Radojević RL, Petrović DV, Pavlović VB, Nikolić ZM, Uroscaron MP (2011) Digital parameterization of apple fruit size, shape and surface spottiness. Afr J Agric Res 6(13):3131–3142Google Scholar
  32. 32.
    Semary NA, Tharwat A, Elhariri E, Hassanien AE (2015) Fruit-based tomato grading system using features fusion and support vector machine. Proc IEEE Int Conf Intell Systems:401–410Google Scholar
  33. 33.
    Siswantoro J et al (2016) A new framework for measuring volume of axisymmetric food products using computer vision based on cubic spline interpolation. Proc of Int Conf on Sci and Inf Technol Indonesia p 74–78Google Scholar
  34. 34.
    Sun C, Berman M, Coward D, Osborne B (2007) Thickness measurement and crease detection of wheat grains using stereo vision. Pattern Recogn Lett 28(12):1501–1508CrossRefGoogle Scholar
  35. 35.
    Tsai RY (1981) A versatile camera calibration technique for high accuracy 3D machine vision metrology using off-the-shelf TV cameras and lens. IEEE J of Robot Autom 24(6):381–395Google Scholar
  36. 36.
    Xu L, Feng Y, Fan Z, Yun D (2014) Research into the grading method of kiwi fruit based on volume estimation and surface defect. INMATEH-Agric Eng 44(3):93–102Google Scholar
  37. 37.
    Yang C et al (2016) Curve like structure extraction using minimal path propagation with backtracking. IEEE Trans Image Process 25(2):988–1003MathSciNetCrossRefGoogle Scholar
  38. 38.
    Yang C et al (2016) Structure-adaptive fuzzy estimation for random-valued impulse noise suppression. IEEE Trans Circuits Syst Video Technol 99:1–1Google Scholar
  39. 39.
    Yang W et al (2017) Improving low-dose CT image using residual convolutional network. IEEE Access 5:24698–24705CrossRefGoogle Scholar
  40. 40.
    Yimyam P et al (2005) Physical properties analysis of mango using computer vision. Proc of ICCAS, KoreaGoogle Scholar
  41. 41.
    Zhang B, Huang W, Li J, Zhao C, Fan S, Wu J, Liu C (2014) Principles, developments and applications of computer vision for external quality inspection of fruits and vegetables: a review. Food Res Int 62:326–343CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  1. 1.Department of Electronics & Communication EngineeringThapar Institute of Engineering and Technology, Patiala and Vishwakarma Institute of Information TechnologyPuneIndia
  2. 2.Department of Electronics & Communication EngineeringThapar Institute of Engineering and Technology (Thapar University)PatialaIndia
  3. 3.Department of TechnologySavitribai Phule Pune UniversityPuneIndia

Personalised recommendations