Abstract
A procedure for estimating the number of mature apples in orchard images captured at night-time with artificial illumination was developed and its potential for estimating yield was investigated. The procedure was tested using four datasets totaling more than 800 images taken with cameras positioned at three heights. The procedure for detecting apples was based on the observation that the light distribution on apples follows a simple pattern in which the perceived light intensity decreases with the distance from a local maximum due to specular reflection. Accordingly, apple detection was achieved by detecting concentric circles (or parts of circles) in binary images obtained via threshold operations. For each dataset, after calibration of the procedure using 12 images, the estimates of the number of apples were within a few percent of the number of apples counted by visual inspection. Yield estimations were obtained via multi-linear models that used between two and six images per tree. The results obtained using all three cameras were only slightly better than those obtained using only two cameras. Using images from only one side of the tree did not worsen the results significantly. Overall, the yield estimated by the best models was within \(\pm\)10 % of the actual yield. However, the standard deviation of the yield estimation errors corresponded to ~26–37 % of the average tree yield, indicating that improvements are still needed in order to achieve accurate yield estimation at the single-tree level.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Atherton, T. J., & Kerbyson, D. J. (1999). Size invariant circle detection. Image and Vision Computing, 17, 795–803.
Cohen, O., Linker, R., Payne, A. & Walsh, K. (2014). Detection of fruit in canopy night-time images: Two case studies with apple and mango. In: Proceedings of the 12th International Conference on Precision Agriculture. ISPA, Monticello, IL, USA, Paper 1420. https://www.ispag.org/icpa/Proceedings
Gongal, A., Amatya, S., Karkee, M., Zhang, Q., & Lewis, K. (2015). Sensors and systems for fruit detection and localization: a review. Computers and Electronics in Agriculture, 116, 8–19.
Jiménez, A. R., Ceres, R., & Pons, J. L. (2000). A survey of computer vision methods for locating fruit on trees. Transactions of the ASAE, 43, 1911–1920.
Kapach, K., Barnea, E., Mairon, R., Edan, Y., & Ben Shahar, O. (2012). Computer vision for fruit harvesting robots—state of the art and challenges ahead. International Journal of Computer Vision and Robotics, 3, 4–34.
Kurtulmus, F., Lee, W. S., & Vardar, A. (2011). Green citrus detection using ‘eigenfruit’, color and circular gabor texture features under natural outdoor conditions. Computer and Electronics in Agriculture, 78, 140–149.
Linker, R., Cohen, O., & Naor, A. (2012). Determination of the number of green apples in RGB images recorded in orchards. Computers and Electronics in Agriculture, 81, 45–57.
Linker, R., & Kelman, E. (2015). Apple detection in nighttime tree images using the geometry of light patches around highlights. Computers and Electronics in Agriculture, 114, 154–162.
Linker, R., Kelman, E., & Cohen, O. (2015). Estimation of apple orchard yield using night time imaging. In Proceedings of the 10th European Conference on Precision Agriculture, 12–16 July 2015, Beit Dagan, Israel.
Payne, A., Walsh, K. B., Subedi, P., & Jarvis, D. (2013). Estimation of mango crop yield using image analysis–segmentation method. Computers and Electronics in Agriculture, 91, 57–64.
Payne, A., Walsh, K. B., Subedi, P., & Jarvis, D. (2014). Estimating mango crop yield using image analysis using fruit at ‘stone hardening’ stage and night time imaging. Computers and Electronics in Agriculture, 100, 160–167.
Pla, F., Juste, F., & Ferri, F. (1993). Feature extraction of spherical objects in image analysis: an application to robotic citrus harvesting. Computers and Electronics in Agriculture, 8, 57–72.
Silwal, A., Gongal, A., & Karkee, M. (2014). Apple identification in field environment with over-the- row machine vision system. Agriculture Engineering International: CIGR Journal, 6, 66–75.
Sites, A. & Delwiche, M.J. (1988). Computer vision to locate fruit on a tree. Paper No. 85-3039, ASAE, St Joseph, MI, USA.
Stajnko, D., Lakota, K., & Hocevar, M. (2004). Estimation of number and diameter of apple fruits in an orchard during the growing season by thermal imaging. Computers and Electronics in Agriculture, 42, 31–42.
Wang, Q., Nuske, S., Bergerman, M. & Singh, S. (2012). Automated crop yield estimation for apple orchards. In: Proceedings of the 13th International Symposium on Experimental Robotics. Quebec City, Canada.In: Desai, J.P., Dudek, G., Khatib, O., Kumar, V(Eds). pp: 745–758
Zhao, J., Tow, J. & Katupitiya, J. (2005). On-tree fruit recognition using texture properties and color data. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, (pp. 263–268).
Zhou, R., Damerow, L., Sun, Y., & Blanke, M. M. (2012). Using colour features of cv. ‘Gala’ apple fruits in an orchard in image processing to predict yield. Precision Agriculture, 13, 568–580.
Acknowledgments
This work was supported by the Israel Plants Production & Marketing Board—Apple Division. The author wishes to thank the team at the Matityahu Research Station.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Linker, R. A procedure for estimating the number of green mature apples in night-time orchard images using light distribution and its application to yield estimation. Precision Agric 18, 59–75 (2017). https://doi.org/10.1007/s11119-016-9467-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11119-016-9467-4