Abstract
This paper presents a comprehensive review of ground agricultural robotic systems and applications with special focus on harvesting that span research and commercial products and results, as well as their enabling technologies. The majority of literature concerns the development of crop detection, field navigation via vision and their related challenges. Health monitoring, yield estimation, water status inspection, seed planting and weed removal are frequently encountered tasks. Regarding robotic harvesting, apples, strawberries, tomatoes and sweet peppers are mainly the crops considered in publications, research projects and commercial products. The reported harvesting agricultural robotic solutions, typically consist of a mobile platform, a single robotic arm/manipulator and various navigation/vision systems. This paper reviews reported development of specific functionalities and hardware, typically required by an operating agricultural robot harvester; they include (a) vision systems, (b) motion planning/navigation methodologies (for the robotic platform and/or arm), (c) Human-Robot-Interaction (HRI) strategies with 3D visualization, (d) system operation planning & grasping strategies and (e) robotic end-effector/gripper design. Clearly, automated agriculture and specifically autonomous harvesting via robotic systems is a research area that remains wide open, offering several challenges where new contributions can be made.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Eberhardt, M., Vollrath, D.: The effect of agricultural technology on the speed of development. World Dev. 109, 483–496 (2018). https://doi.org/10.1016/j.worlddev.2016.03.017
Fathallah, F.A.: Musculoskeletal disorders in labor-intensive agriculture. Appl. Ergon. 41(6), 738–743 (2010). https://doi.org/10.1016/j.apergo.2010.03.003
Proto, A.R., Zimbalatti, G.: Risk assessment of repetitive movements in the citrus fruit industry. J. Agric. Saf. Health 16(4), 219–228 (2010). https://doi.org/10.13031/2013.34834
Zhang, Z., Wang, Y., Zhang, Z., Li, D., Wu, Z., Bai, R., Meng, G.: Ergonomic and efficiency analysis of conventional apple harvest process. Int. J. Agric. Biol. Eng. 12(2), 210–217 (2019). https://doi.org/10.25165/j.ijabe.20191202.4567
Zhang, Z., Zhang, Z., Wang, X., Liu, H., Wang, Y., Wang, W.: Models for economic evaluation of multi-purpose apple harvest platform and software development. Int. J. Agric. Biol. Eng. 12(1), 74–83 (2019). https://doi.org/10.25165/j.ijabe.20191201.4360
Marinoudi, V., Sørensen, C.G., Pearson, S., Bochtis, D.: Robotics and labour in agriculture. a context consideration. Biosyst. Eng. 184, 111–121 (2019). https://doi.org/10.1016/j.biosystemseng.2019.06.013
Fountas, S., Mylonas, N., Malounas, I., Rodias, E., Santos, C.H., Pekkeriet, E.: Agricultural robotics for field operations. Sensors 20(9), 2672 (2020). https://doi.org/10.3390/s20092672
Shamshiri, R.R., Weltzien, C., Hameed, I.A., Yule, I.J., Grift, T.E., Balasundram, S.K., Pitonakova, L., Ahmad, D., Chowdhary, G.: Research and development in agricultural robotics: a perspective of digital farming. Int. J. Agric. Biol. Eng. 11(4), 1–11 (2018). https://doi.org/10.25165/j.ijabe.20181104.4278
Bac, C.W., van Henten, E.J., Hemming, J., Edan, Y.: Harvesting robots for high-value crops: State-of-the-art review and challenges ahead. J. Field Robot. 31(6), 888–911 (2014). https://doi.org/10.1002/rob.21525
Oliveira, L.F.P., Moreira, A.P., Silva, M.F.: Advances in agriculture robotics: A state-of-the-art review and challenges ahead. Robotics 10(2). https://doi.org/10.3390/robotics10020052 (2021)
Slaughter, D.C., Giles, D.K., Downey, D.: Autonomous robotic weed control systems: a review. Comput. Electron. Agric. 61(1), 63–78 (2008). https://doi.org/10.1016/j.compag.2007.05.008
Zhang, Q., Karkee, M., Tabb, A.: The use of agricultural robots in orchard management. Burleigh Dodds Series in Agricultural Science, 187–214. https://doi.org/10.19103/as.2019.0056.14 (2019)
Bechar, A., Vigneault, C.: Agricultural robots for field operations. Part 2: Operat. Syst. Biosyst. Eng., 110–128. https://doi.org/10.1016/j.biosystemseng.2016.11.004 (2017)
Saiz-Rubio, V., Rovira-Más, F.: From smart farming towards agriculture 5.0: a review on crop data management. Agronomy (2)207. https://doi.org/10.3390/agronomy10020207 (2020)
Baillie, C.P., Thomasson, J.A., Lobsey, C.R., McCarthy, C.L., Antille, D.L.: A review of the state of the art in agricultural automation part i: Sensing technologies for optimization of machine operation and farm inputs. https://doi.org/10.13031/aim.201801589 (2018)
Fue, K.G., Porter, W.M., Barnes, E.M., Rains, G.C.: An extensive review of mobile agricultural robotics for field operations: Focus on cotton harvesting. AgriEngineering (1)150–174. https://doi.org/10.3390/agriengineering2010010 (2020)
Defterli, S.G., Shi, Y., Xu, Y., Ehsani, R.: Review of robotic technology for strawberry production. Appl. Eng. Agric. (3)301–318. https://doi.org/10.13031/aea.32.11318 (2016)
Aravind, K.R., Raja, P., Pérez-Ruiz, M.: Task-based agricultural mobile robots in arable farming: a review. Spanish Journal of Agricultural Research (1)16. https://doi.org/10.5424/sjar/2017151-9573 (2017)
Tsolakis, N., Bechtsis, D., Bochtis, D.: Agros: a robot operating system based emulation tool for agricultural robotics. Agronomy (7)403. https://doi.org/10.3390/agronomy9070403 (2019)
del Cerro, J., Cruz Ulloa, C., Barrientos, A., de León Rivas, J.: Unmanned aerial vehicles in agriculture: A survey. Agronomy 11(2). https://doi.org/10.3390/agronomy11020203 (2021)
Mogili, U.R., Deepak, B.B.V.L.: Review on application of drone systems in precision agriculture. Procedia Comput. Sci. 133, 502–509 (2018). https://doi.org/10.1016/j.procs.2018.07.063. International Conference on Robotics and Smart Manufacturing (RoSMa2018)
Kim, J., Kim, S., Ju, C., Son, H.I.: Unmanned aerial vehicles in agriculture: A review of perspective of platform, control, and applications. IEEE Access 7, 105100–105115 (2019). https://doi.org/10.1109/ACCESS.2019.2932119
Feng, L., Chen, S., Zhang, C., Zhang, Y., He, Y.: A comprehensive review on recent applications of unmanned aerial vehicle remote sensing with various sensors for high-throughput plant phenotyping. Comput. Electron. Agric. 182, 106033 (2021). https://doi.org/10.1016/j.compag.2021.106033
Ju, C., Kim, J., Seol, J., Son, H.I.: A review on multirobot systems in agriculture. Comput. Electron. Agric. 202, 107336 (2022). https://doi.org/10.1016/j.compag.2022.107336
Ribeiro, A., Conesa-Muñoz, J.: Multi-robot Systems for Precision Agriculture, pp 151–175. Springer, Berlin (2021). https://doi.org/10.1007/978-3-030-77036-5_7
Bhandari, S., Raheja, A., Green, R.L., Do, D.: Towards collaboration between unmanned aerial and ground vehicles for precision agriculture. In: Proc. SPIE, Autonomous Air and Ground Sensing Systems for Agricultural Optimization and Phenotyping II, vol. 10218, p. 1021806. https://doi.org/10.1117/12.2262049 (2017)
Pretto, A., Aravecchia, S., Burgard, W., Chebrolu, N., Dornhege, C., Falck, T., Fleckenstein, F., Fontenla, A., Imperoli, M., Khanna, R., Liebisch, F., Lottes, P., Milioto, A., Nardi, D., Nardi, S., Pfeifer, J., Popović, M., Potena, C., Pradalier, C., Rothacker-Feder, E., Sa, I., Schaefer, A., Siegwart, R., Stachniss, C., Walter, A., Winterhalter, W., Wu, X., Nieto, J.: Building an aerial–ground robotics system for precision farming: an adaptable solution. IEEE Robot Autom Mag 28(3), 29–49 (2021). https://doi.org/10.1109/MRA.2020.3012492
Deusdado, P., Pinto, E., Guedes, M., Marques, F., Rodrigues, P., Lourenço, A., Mendonça, R., Silva, A., Santana, P., Corisco, J., Almeida, M., Portugal, L., Caldeira, R., Barata, J., Flores, L.: An aerial-ground robotic team for systematic soil and biota sampling in estuarine mudflats. In: Robot 2015: Second Iberian robotics conference, pp. 15–26. Springer. https://doi.org/10.1007/978-3-319-27149-1_2 (2016)
Edmonds, M., Yigit, T., Yi, J.: Resolution-optimal, energy-constrained mission planning for unmanned aerial/ground crop inspections. In: 2021 IEEE 17Th International conference on automation science and engineering (CASE), pp. 2235–2240. https://doi.org/10.1109/CASE49439.2021.9551394 (2021)
Li, P., Lee, S., Hsu, H.-Y.: Review on fruit harvesting method for potential use of automatic fruit harvesting systems. Procedia Eng, 351–366. https://doi.org/10.1016/j.proeng.2011.11.2514 (2011)
Coppock, G.E., Hedden, S.L.: Design and development of a tree-shaker harvest system for citrus fruit. Transactions of the ASAE (3)339–342. https://doi.org/10.13031/2013.39404 (1968)
Sumner, H.R., Hedden, S.L., Alfred, L.: Harvesting oranges with a full-powered positiong limb shaker. Floriad State Horticultural Society, 117–120 (1975)
Torregrosa, A., Ortí, E., Martín, B., Gil, J., Ortiz, C.: Mechanical harvesting of oranges and mandarins in spain. Biosyst. Eng. 104(1), 18–24 (2009). https://doi.org/10.1016/j.biosystemseng.2009.06.005
Silwal, A., Davidson, J.R., Karkee, M., Mo, C., Zhang, Q., Lewis, K.: Design, integration, and field evaluation of a robotic apple harvester. J Field Robot 34(6), 1140–1159 (2017). https://doi.org/10.1002/rob.21715
Baeten, J., Donné, K., Boedrij, S., Beckers, W., Claesen, E.: Autonomous fruit picking machine: a robotic apple harvester. Field and Service Robotics 42, 531–539 (2008). https://doi.org/10.1007/978-3-540-75404-6_51
Bulanon, D.M., Kataoka, T.: A fruit detection system and an end effector for robotic harvesting of fuji apples. Agric. Eng. Int.: CIGR J. 12, 203–210 (2010)
Onishi, Y., Yoshida, T., Kurita, H., Fukao, T., Arihara, H., Iwai, A.: An automated fruit harvesting robot by using deep learning. ROBOMECH J. 6(13), 2–9 (2019). https://doi.org/10.1186/s40648-019-0141-2
De-An, Z., Jidong, L., Wei, J., Ying, Z., Yu, C.: Design and control of an apple harvesting robot. Biosyst. Eng. 110(2), 112–122 (2011). https://doi.org/10.1016/j.biosystemseng.2011.07.005
Davidson, J.R., Hohimer, C.J., Mo, C., Karkee, M.: Dual robot coordination for apple harvesting. 110(2)112–122. https://doi.org/10.13031/aim.201700567 (2017)
Muscato, G., Prestifilippo, M., Abbate, N., Rizzuto, I.: A prototype of an orange picking robot: past history, the new robot and experimental results. Ind. Robot. 32(2), 128–138 (2005). https://doi.org/10.1108/01439910510582255
Klaoudatos, D.S., Moulianitis, V.C., Aspragathos, N.A.: Development of an experimental strawberry harvesting robotic system. 2,437–445. https://doi.org/10.5220/0007934004370445 (2019)
Xiong, Y., Peng, C., Grimstad, L., From, P.J., Isler, V.: Development and field evaluation of a strawberry harvesting robot with a cable-driven gripper. Comput. Electron. Agric. 157, 392–402 (2019). https://doi.org/10.1016/j.compag.2019.01.009
Xiong, Y., Ge, Y., Grimstad, L., From, P.J.: An autonomous strawberry-harvesting robot: design, development, integration, and field evaluation. J. Field Robot. 37(2), 202–224 (2020). https://doi.org/10.1002/rob.21889
Hayashi, S., Yamamoto, S., Tsubota, S., Ochiai, Y., Kobayashi, K., Kamata, J., Kurita, M., Kurita, M., Inazumi, H., Rajendra, P.: Automation technologies for strawberry harvesting and packing operations in japan. J. Berry Res. 4(1), 19–27 (2014). https://doi.org/10.3233/JBR-140065
Hayashi, S., Shigematsu, K., Yamamoto, S., Kobayashi, K., Kohno, Y., Kamata, J., Kurita, M.: Evaluation of a strawberry-harvesting robot in a field test. Biosyst. Eng. 105(2), 160–171 (2010). https://doi.org/10.1016/j.biosystemseng.2009.09.011
Tanigaki, K., Fujiura, T., Akase, A., Imagawa, J.: Cherry-harvesting robot. Comput. Electron. Agric. 63(1), 65–72 (2008). https://doi.org/10.1016/j.compag.2008.01.018
Edan, Y., Rogozin, D., Flash, T., Miles, G.E.: Robotic melon harvesting. IEEE Trans. Robot. Autom. 16(6), 831–835 (2000). https://doi.org/10.1109/70.897793
Bechar, A., Edan, Y.: Human-robot collaboration for improved target recognition of agricultural robots. Ind. Robot. 30(5), 432–436 (2003). https://doi.org/10.1108/01439910310492194
Umeda, M., Kubota, S., Iida, M.: Development of ’stork’, a watermelon-harvesting robot. Artif. Life Robot. 3, 143–147 (1999). https://doi.org/10.1007/BF02481130
Zion, B., Mann, M., Levin, D., Shilo, A., Rubinstein, D., Shmulevich, I.: Harvest-order planning for a multiarm robotic harvester. Comput. Electron. Agric. 103, 75–81 (2014). https://doi.org/10.1016/j.compag.2014.02.008
Ceres, R., Pons, J.L., Jimenez, A.R., Martin, J.M., Calderon, L.: Design and implementation of an aided fruit-harvesting robot(agribot). Ind. Robot. 25(5), 337–346 (1998). https://doi.org/10.1108/01439919810232440
Yaguchi, H., Nagahama, K., Hasegawa, T., Inaba, M.: Development of an autonomous tomato harvesting robot with rotational plucking gripper. 3, 652–657. https://doi.org/10.1109/IROS.2016.7759122 (2016)
Wang, L.L., Bo, Z., Jinwei, F., Xiaoan, H., Shu, W., Yashuo, L., Zhou, Q., Chongfeng, W.: Development of a tomato harvesting robot used in greenhouse. Int. J. Agric. Biol. Eng. 10(4), 140–149 (2017). https://doi.org/10.25165/j.ijabe.20171004.3204
Feng, Q., Zou, W., Fan, P., Zhang, C., Wang, X.: Design and test of robotic harvesting system for cherry tomato. Int. J. Agric. Biol. Eng. 11(1), 96–100 (2018). https://doi.org/10.25165/j.ijabe.20181101.2853
Zhao, Y., Gong, L., Liu, C., Huang, Y.: Dual-arm robot design and testing for harvesting tomato in greenhouse. IFAC-PapersOnLine 49(16), 161–165 (2016). https://doi.org/10.1016/j.ifacol.2016.10.030
Ling, X., Zhao, Y., Gong, L., Liu, C., Wang, T.: Dual-arm cooperation and implementing for robotic harvesting tomato using binocular vision. Robot. Auton. Syst. 114, 134–143 (2019). https://doi.org/10.1016/j.robot.2019.01.019
Henten, E.J.V., Hemming, J., van Tuijl, B.A.J., Kornet, J.G., Meuleman, J., Bontsema, J., van Os, E.A.: An autonomous robot for harvesting cucumbers in greenhouses. Auton. Robot. 13, 241–258 (2002). https://doi.org/10.1023/A:1020568125418
Herck, L.V., Kurtser, P., Wittemans, L., Edan, Y.: Crop design for improved robotic harvesting: a case study of sweet pepper harvesting. Biosyst. Eng. 192, 294–308. https://doi.org/10.1016/j.biosystemseng.2020.01.021 (2020)
Bloch, V., Degani, A., Bechar, A.: A methodology of orchard architecture design for an optimal harvesting robot. Biosyst. Eng. 166, 126–137 (2018). https://doi.org/10.1016/j.biosystemseng.2017.11.006
Hayashi, S., Ganno, K., Ishii, Y., Tanaka, I.: Robotic harvesting system for eggplants. Japan Agricultural Research Quarterly: JARQ 36(3), 163–168 (2002). https://doi.org/10.6090/jarq.36.163
Foglia, M.M., Reina, G.: Agricultural robot for radicchio harvesting. J. Field Robot. 23(6-7), 363–377 (2006). https://doi.org/10.1002/rob.20131
Irie, N., Taguchi, N., Horie, T., Ishimatsu, T.: Asparagus harvesting robot coordinated with 3-d vision sensor, 1–6. https://doi.org/10.1109/ICIT.2009.4939556 (2009)
Zhang, T., Huang, Z., You, W., Lin, J., Tang, X., Huang, H.: An autonomous fruit and vegetable harvester with a low-cost gripper using a 3d sensor. Sensors 20(1), 93 (2020). https://doi.org/10.3390/s20010093
Kitamura, S., Oka, K.: Recognition and cutting system of sweet pepper for picking robot in greenhouse horticulture 1807–1812. https://doi.org/10.1109/icma.2005.1626834 (2005)
Lehnert, C., English, A., McCool, C., Tow, A.W., Perez, T.: Autonomous sweet pepper harvesting for protected cropping systems. IEEE Robotics and Automation Letters 2(2), 872–879 (2017). https://doi.org/10.1109/LRA.2017.2655622
Arad, B., Balendonck, J., Barth, R., Ben-Shahar, O., Edan, Y., Hellström, T., Hemming, J., Kurtser, P., Ringdahl, O., Tielen, T., van Tuijl, B.: Development of a sweet pepper harvesting robot. Journal of Field Robotics 37(6), 1027–1039 (2020). https://doi.org/10.1002/rob.21937
Quaglia, G., Visconte, C., Scimmi, L.S., Melchiorre, M., Cavallone, P., Pastorelli, S.: Design of a ugv powered by solar energy for precision agriculture. Robotics 9(1), 13 (2020). https://doi.org/10.3390/robotics9010013
Quaglia, G., Cavallone, P., Visconte, C.: Agri-q: Agriculture ugv for monitoring and drone landing. IFToMM Symposium on Mechanism Design for Robotics 66, 413–423 (2019). https://doi.org/10.1007/978-3-030-00365-4_49
Quaglia, G., Visconte, C., Scimmi, L.S., Melchiorre, M., Cavallone, P., Pastorelli, S.: Design of the positioning mechanism of an unmanned ground vehicle for precision agriculture. IFToMM World Congress on Mechanism and Machine Science 73, 3531–3540 (2019). https://doi.org/10.1007/978-3-030-20131-9_348
Monta, M., Kondo, N., Shibano, Y.: Agricultural robot in grape production system. 3, 2504–2509. https://doi.org/10.1109/ROBOT.1995.525635 (1995)
Ogawa, Y., Kondo, N.A., Monta, M.I., Sakaeshibusawa, N.: Spraying robot for grape production. Field and Service Robotics 24, 539–548 (2006). https://doi.org/10.1007/10991459_52
Oberti, R., Marchi, M., Tirelli, P., Calcante, A., Iriti, M., Hočevar, M., Baur, J., Pfaff, J., Schütz, C., Ulbrich, H.: Selective spraying of grapevine’s diseases by a modular agricultural robot. J. Agric. Eng. 44(s2), 149–153 (2013). https://doi.org/10.4081/jae.2013.271
Bontsema, J., Hemming, J., Pekkeriet, E., Saeys, W., Edan, Y., Shapiro, A., Hocevar, M., Oberti, R., Armada, M., Ulbrich, H., Baur, J., Debilde, B., Best, S., Evain, S., Gauchel, W., Hellström, T., Ringdahl, O.: Crops: Clever robots for crops. Engineering & Technology Reference, 1–11. https://doi.org/10.1049/etr.2015.0015 (2015)
Roure, F., Moreno, G., Soler, M., Faconti, D., Serrano, D., Astolfi, P., Bardaro, G., Gabrielli, A., Bascetta, L., Matteucci, M.: Grape: Ground robot for vineyard monitoring and protection. 249–260, https://doi.org/10.1007/978-3-319-70833-1_21 (2017)
Reiser, D., Sehsah, E.S., Bumann, O., Morhard, J., Griepentrog, H.W.: Development of an autonomous electric robot implement for intra-row weeding in vineyards. Agriculture 9(1), 1–12 (2019). https://doi.org/10.3390/agriculture9010018
Santos, F.N.D., Sobreira, H.M., Campos, D.F., Morais, R., Moreira, A.P., Contente, O.: Towards a reliable monitoring robot for mountain vineyards. 37–43, https://doi.org/10.11009/2015.21 (2015)
Botterill, T., Paulin, S., Green, R., Williams, S., Lin, J., Saxton, V., Mills, S., Chen, X., Corbett-Davies, S.: A robot system for pruning grape vines. J. Field Robot. 34(6), 1100–1122 (2017). https://doi.org/10.1002/rob.21680
Tang, Y., Chen, M., Wang, C., Luo, L., Li, J., Lian, G., Zou, X.: Recognition and localization methods for vision-based fruit picking robots: A review. Frontiers in Plant Science 11. https://doi.org/10.3389/fpls.2020.00510(2020)
Saleem, M.H., Potgieter, J., Arif, K.M.: Automation in agriculture by machine and deep learning techniques: a review of recent developments. Precision Agric. 22, 2053–2091 (2021). https://doi.org/10.1007/s11119-021-09806-x
Vitzrabin, E., Edan, Y.: Adaptive thresholding with fusion using a rgbd sensor for red sweet-pepper detection. Biosys. Eng. 146, 45–56 (2016). https://doi.org/10.1016/j.biosystemseng.2015.12.002
Blok, P.M., Barth, R., Van den Berg, W.: Machine vision for a selective broccoli harvesting robot. IFAC-PapersOnLine 49(16), 66–71 (2016). https://doi.org/10.1016/j.ifacol.2016.10.013
Kurtser, P., Ringdahl, O., Rotstein, N., Berenstein, R., Edan, Y.: In-field grape cluster size assessment for vine yield estimation using a mobile robot and a consumer level rgb-d camera. IEEE Robot. Automation Lett. 5(2), 2031–2038 (2020). https://doi.org/10.1109/LRA.2020.2970654
Nuske, S., Wilshusen, K., Achar, S., Yoder, L., Narasimhan, S., Singh, S.: Automated visual yield estimation in vineyards. J. Field Robot. 31(5), 837–860 (2014). https://doi.org/10.1002/rob.21541
Luo, L., Tang, Y., Lu, Q., Chen, X., Zhang, P., Zou, X.: A vision methodology for harvesting robot to detect cutting points on peduncles of double overlapping grape clusters in a vineyard. Comput. Industry 99, 130–139 (2018). https://doi.org/10.1016/j.compind.2018.03.017
Ostovar, A., Ringdahl, O., Hellstrom, T.: Adaptive image thresholding of yellow peppers for a harvesting robot. Robotics 7(1), 1–16 (2018). https://doi.org/10.3390/robotics7010011
Altaheri, H., Alsulaiman, M., Muhammad, G.: Date fruit classification for robotic harvesting in a natural environment using deep learning. IEEE Access 7, 117115–117133 (2019). https://doi.org/10.1109/access.2019.2936536
Ge, Y., Xiong, Y., Tenorio, G.L., From, P.J.: Fruit localization and environment perception for strawberry harvesting robots. IEEE Access 7, 147642–147652 (2019). https://doi.org/10.1109/ACCESS.2019.2946369
Lehnert, C., Sa, I., McCool, C., Upcroft, B., Perez, T.: Sweet pepper pose detection and grasping for automated crop harvesting, 2428–2434. https://doi.org/10.1109/ICRA.2016.7487394 (2016)
Kang, H., Zhou, H., Chen, C.: Visual perception and modeling for autonomous apple harvesting. IEEE Access, 62151–62163. https://doi.org/10.1109/ACCESS.2020.2984556 (2020)
Zapotezny-Anderson, P.M., Lehnert, C.: Towards active robotic vision in agriculture: a deep learning approach to visual servoing in occluded and unstructured protected cropping environments. IFAC-PapersOnLine 52(30), 120–125 (2019). https://doi.org/10.1016/j.ifacol.2019.12.508
Arad, B., Kurtser, P., Barnea, E., Harel, B., Edan, Y., Ben-Shahar, O.: Controlled lighting and illumination-independent target detection for real-time cost-efficient applications. the case study of sweet pepper robotic harvesting. Sensors 19(6), 1390 (2019). https://doi.org/10.3390/s19061390
Tian, Y., Duan, H., Luo, R., Zhang, Y., Jia, W., Lian, J., Zheng, Y., Ruan, C., Li, C.: Fast recognition and location of target fruit based on depth information. IEEE Access 7, 170553–170563 (2019). https://doi.org/10.1109/ACCESS.2019.2955566
Kurtser, P., Ringdahl, O., Rotstein, N., Andreasson, H.: Pointnet and geometric reasoning for detection of grape vines from single frame rgb-d data in outdoor conditions. Proceedings of the Northern Lights Deep Learning Workshop 2020 1, 6 (2020). https://doi.org/10.7557/18.5155
McCool, C., Sa, I., Dayoub, F., Lehnert, C., Perez, T., Upcroft, B.: Visual detection of occluded crop: For automated harvesting. 2506–2512. https://doi.org/10.1109/ICRA.2016.7487405 (2016)
Liu, Y.P., Yang, C.H., Ling, H., Mabu, S., Kuremoto, T.: A visual system of citrus picking robot using convolutional neural networks. 344–349. https://doi.org/10.1109/ICSAI.2018.8599325 (2018)
Lehnert, C., Tsai, D., Eriksson, A., McCool, C.: 3d move to see: Multiperspective visual servoing towards the next best view within unstructured and occluded environments. 3890–3897. https://doi.org/10.1109/IROS40897.2019.8967918 (2019)
Zemmour, E., Kurtser, P., Edan, Y.: Automatic parameter tuning for adaptive thresholding in fruit detection. Sensors 19(9), 2130 (2019). https://doi.org/10.3390/s19092130
Vitzrabin, E., Edan, Y.: Changing task objectives for improved sweet pepper detection for robotic harvesting. IEEE Robot. Automat. Lett. 1(1), 578–584 (2016). https://doi.org/10.1109/LRA.2016.2523553
Pothen, Z.S., Nuske, S.: Texture-based fruit detection via images using the smooth patterns on the fruit. 5171–5176. https://doi.org/10.1109/ICRA.2016.7487722 (2016)
Bargoti, S., Underwood, J.P.: Image segmentation for fruit detection and yield estimation in apple orchards. Journal of Field Robotics 34(6) (2016). https://doi.org/10.1002/rob.21699
Lin, G., Tang, Y. -C., Zou, X., Xiong, J., Li, J.: Guava detection and pose estimation using a low-cost rgb-d sensor in the field. Sensors 19(2), 428 (2019). https://doi.org/10.3390/s19020428
Fawakherji, M., Youssef, A., Bloisi, D., Pretto, A., Nardi, D.: Crop and weeds classification for precision agriculture using context-independent pixel-wise segmentation, 146–152. https://doi.org/10.1109/IRC.2019.00029(2019)
Häni, N., Roy, P., Isler, V.: A comparative study of fruit detection and counting methods for yield mapping in apple orchards. J. Field Robot. 37(2), 263–282 (2020). https://doi.org/10.1002/rob.21902
Liu, X., Chen, S., Aditya, S., Sivakumar, N., Dcunha, S., Qu, C., Taylor, C.J., Das, J., Kumar, V.: Robust fruit counting: Combining deep learning, tracking, and structure from motion, 1045–1052. https://doi.org/10.1109/IROS.2018.8594239 (2018)
Lin, G., Tang, Y., Zou, X., Xiong, J., Fang, Y.: Color-, depth-, and shape-based 3d fruit detection. Precis. Agric. 21, 1–17 (2019). https://doi.org/10.1007/s11119-019-09654-w
McCool, C., Perez, T., Upcroft, B.: Mixtures of lightweight deep convolutional neural networks: Applied to agricultural robotics. IEEE Robot. Autom. Lett. 2(3), 1344–1351 (2017). https://doi.org/10.1109/LRA.2017.2667039
Santos, T.T., Souza, L., dos Santos, A.A., Avila, S.: Grape detection, segmentation and tracking using deep neural networks and three dimensional association. Comput. Electron. Agric., 170. https://doi.org/10.1016/j.compag.2020.105247 (2020)
Koirala, A., Walsh, K., Wang, Z., McCarthy, C.: Deep learning for realtime fruit detection and orchard fruit load estimation: benchmarking of mangoyolo. Precis. Agric. 20, 1107–1135 (2019). https://doi.org/10.1007/s11119-019-09642-0
Tian, Y., Yang, G., Wang, Z., Li, E., Liang, Z.: Detection of apple lesions in orchards based on deep learning methods of cyclegan and yolov3-dense. Journal of Sensors 20, 7630926–1763092613 (2019). https://doi.org/10.1155/2019/7630926
Gonzalez, S., Arellano, C., Tapia, J.E.: Deepblueberry: Quantification of blueberries in the wild using instance segmentation. IEEE Access 7, 105776–105788 (2019). https://doi.org/10.1109/ACCESS.2019.2933062
Ganesh, P., Volle, K., Burks, T., Mehta, S.: Deep orange: Mask r-cnn based orange detection and segmentation. IFAC-PapersOnLine 52(30), 70–75 (2019). https://doi.org/10.1016/j.ifacol.2019.12.499
Sa, I., Ge, Z., Dayoub, F., Upcroft, B., Perez, T., McCool, C.: Deepfruits: A fruit detection system using deep neural networks. Sensors (Basel Switzerland) 16(8). https://doi.org/10.3390/s16081222 (2016)
Gene-Mola, J., Vilaplana, V., Rosell-Polo, J.R., Morros, J.R., Ruiz-Hidalgo, J., Gregorio, E.: Multi-modal deep learning for fuji apple detection using rgb-d cameras and their radiometric capabilities. Comput. Electron. Agric. 162, 689–698 (2019). https://doi.org/10.1016/j.compag.2019.05.016
Hasan, M.M., Chopin, J.P., Laga, H., Miklavcic, S.J.: Detection and analysis of wheat spikes using convolutional neural networks. Plant Methods 14(100). https://doi.org/10.1186/s13007-018-0366-8 (2018)
Kang, H., Chen, C.: Fast implementation of real-time fruit detection in apple orchards using deep learning. Comput. Electron. Agric., 168. https://doi.org/10.1016/j.compag.2019.105108 (2020)
Kang, H., Chen, C.: Fruit detection and segmentation for apple harvesting using visual sensor in orchards. Sensors (Basel Switzerland) 19(20). https://doi.org/10.3390/s19204599 (2019)
Kirk, R., Cielniak, G., Mangan, M.: L*a*b*fruits: a rapid and robust outdoor fruit detection system combining bio-inspired features with one-stage deep learning networks. Sensors 20(1), 275 (2020). https://doi.org/10.3390/s20010275
Dias, P.A., Tabb, A., Medeiros, H.: Apple flower detection using deep convolutional networks. Comput. Ind. 99, 17–28 (2018). https://doi.org/10.1016/j.compind.2018.03.010
Bayati, M., Fotouhi, R.: A mobile robotic platform for crop monitoring. Advances in Robotics and Automation 7(1). https://doi.org/10.4172/2168-9695.1000186 (2018)
Virlet, N., Sabermanesh, K., Sadeghi-Tehran, P., Hawkesford, M.J.: Field scanalyzer: an automated robotic field phenotyping platform for detailed crop monitoring. Funct. Plant Biol. 44(1), 143–153 (2017). https://doi.org/10.1071/FP16163
Shafiekhani, A., Kadam, S., Fritschi, F.B., DeSouza, G.N.: Vinobot and vinoculer: Two robotic platforms for high-throughput field phenotyping. Sensors 17(1), 214 (2017). https://doi.org/10.3390/s17010214
Gutiérrez, S., Fernández-Novales, J., Diago, M.P., Tardaguila, J.: On-the-go hyperspectral imaging under field conditions and machine learning for the classification of grapevine varieties. Frontiers in Plant Sci. 9, 1102 (2018). https://doi.org/10.3389/fpls.2018.01102
Hu, K., Coleman, G.R.Y., Zeng, S., Wang, Z., Walsh, M.: Graph weeds net: a graph-based deep learning method for weed recognition. Comput. Electron. Agric. 174, 105520 (2020). https://doi.org/10.1016/j.compag.2020.105520
Christiansen, P., Nielsen, L., Steen, K., Jorgensen, R., Karstoft, H.: Deepanomaly: Combining background subtraction and deep learning for detecting obstacles and anomalies in an agricultural field. Sensors 16(11), 1904 (2016). https://doi.org/10.3390/s16111904
Isokane, T., Okura, F., Ide, A., Matsushita, Y., Yagi, Y.: Probabilistic plant modeling via multi-view image-to-image translation. 2906–2915, https://doi.org/10.1109/CVPR.2018.00307 (2018)
Bietresato, M., Carabin, G., Vidoni, R., Gasparetto, A., Mazzetto, F.: Evaluation of a lidar-based 3d-stereoscopic vision system for crop-monitoring applications. Comput. Electron. Agric. 124, 1–13 (2016). https://doi.org/10.1016/j.compag.2016.03.017
Williams, D., Britten, A., McCallum, S., Jones, H., Aitkenhead, M., Karley, A., Loades, K., Prashar, A., Graham, J.: A method for automatic segmentation and splitting of hyperspectral images of raspberry plants collected in field conditions. Plant methods 13(74), 1–12 (2017). https://doi.org/10.1186/s13007-017-0226-y
Daniels, A.J., Poblete-Echeverría, C., Opara, U.L., Nieuwoudt, H.H.: Measuring internal maturity parameters contactless on intact table grape bunches using nir spectroscopy. Front. Plant Sci. 10, 1517 (2019). https://doi.org/10.3389/fpls.2019.01517
Costa, D.D.S., Mesa, N.F.O., Freire, M.S., Ramos, R.P., Mederos, B.J.T.: Development of predictive models for quality and maturation stage attributes of wine grapes using vis-nir reflectance spectroscopy. Postharvest Biology and Technol. 150, 166–178 (2019). https://doi.org/10.1016/j.postharvbio.2018.12.010
Porep, J.U., Mattes, A., Nikfardjam, M.S., Kammerer, D.R., Carle, R.: Implementation of an on-line near infrared/visible (nir/vis) spectrometer for rapid quality assessment of grapes upon receival at wineries. Australian Journal of Grape and Wine Research 21(1). https://doi.org/10.1111/ajgw.12120 (2015)
Giovenzana, V., Beghi, R., Malegori, C., Civelli, R., Guidetti, R.: Wavelength selection with a view to a simplified handheld optical system to estimate grape ripeness. Am. J. Enol. Vitic. 65, 117–123 (2013). https://doi.org/10.5344/ajev.2013.13024
Wendel, A., Underwood, J., Walsh, K.: Maturity estimation of mangoes using hyperspectral imaging from a ground based mobile platform. Comput. Electron. Agric. 155, 298–313 (2018). https://doi.org/10.1016/j.compag.2018.10.021
Gutiérrez, S., Wendel, A., Underwood, J.: Ground based hyperspectral imaging for extensive mango yield estimation. Comput. Electron. Agric. 157, 126–135 (2019). https://doi.org/10.1016/j.compag.2018.12.041
Gutiérrez, S., Wendel, A., Underwood, J.: Spectral filter design based on in-field hyperspectral imaging and machine learning for mango ripeness estimation. Comput. Electron. Agric. 164(1), 104890 (2019). https://doi.org/10.1016/j.compag.2019.104890
Nasirahmadi, A., Wilczek, U., Hensel, O.: Sugar beet detection during harvesting using different convolutional neural networok models. Agriculture 11(11). https://doi.org/10.3390/agriculture11111111 (2021)
Tian, S., Wang, S., Xu, H.: Early detection of freezing damage in oranges by online vis/nir transmission coupled with diameter method and deep 1d-cnn. Comput. Electron. Agric., 193. https://doi.org/10.1016/j.compag.2021.106638 (2022)
Jin, X., Jie, L., Wang, S., Qi, H.J., Li, S.W.: Classifying wheat hyperspectral pixels of healthy heads and fusarium head blight disease using a deep neural network in the wild field. Remote Sens. 10(3), 395 (2018). https://doi.org/10.3390/rs10030395
Mack, J., Lenz, C., Teutrine, J., Steinhage, V.: High-precision 3d detection and reconstruction of grapes from laser range data for efficient phenotyping based on supervised learning. Comput. Electron. Agric. 135, 300–311 (2017). https://doi.org/10.1016/j.compag.2017.02.017
Hafeez, A., Aslam Husain, M., Singh, S.P., Chauhan, A., Khan, M.T., Kumar, N., Chauhan, A., Soni, S.K.: Implementation of drone technology for farm monitoring and pesticide spraying: A review. Information Processing in Agriculture. https://doi.org/10.1016/j.inpa.2022.02.002 (2022)
Esposito, M., Crimaldi, V.M., et al.: Cirillo Drone and sensor technology for sustainable weed management: a review. Chem. Biol. Technol Agric 8(18). https://doi.org/10.1186/s40538-021-00217-8 (2022)
Su, J., et al.: Aerial visual perception in smart farming: Field study of wheat yellow rust monitoring. IEEE Trans Industr Inform 17(3), 2242–2249 (2021). https://doi.org/10.1109/TII.2020.2979237
Crimaldi, M., Cristiano, V., De Vivo, A., Isernia, M., Ivanov, P., Sarghini, F.: Neural network algorithms for real time plant diseases detection using uavs. Innovative Biosystems Engineering for Sustainable Agriculture, 67. https://doi.org/10.1007/978-3-030-39299-4_89 (2020)
Pflanz, M., Schirrmann, M., Nordmeyer, H.: Drone based weed monitoring with an image feature classifier. Julius-Kühn-Archiv, 84 (2018)
Liao, J., Babiker, I., Xie, W.-F., Li, W., Cao, L.: Dandelion segmentation with background transfer learning and rgb-attention module. Comput. Electron. Agric., 202. https://doi.org/10.1016/j.compag.2022.107355(2022)
Sa, I., Popović, M., Khanna, R., Chen, Z., Lottes, P., Liebisch, F., Nieto, J., Stachniss, C., Walter, A., Siegwart, R.: Weedmap: a large-scale semantic weed mapping framework using aerial multispectral imaging and deep neural network for precision farming. Remote Sensing 10(9). https://doi.org/10.3390/rs10091423(2018)
Mazzia, V., Comba, L., Khaliq, A., Chiaberge, M., Gay, P.: Uav and machine learning based refinement of a satellite-driven vegetation index for precision agriculture. Sensors 20(9). https://doi.org/10.3390/s20092530 (2020)
Candiago, S., Remondino, F., De Giglio, M., Dubbini, M., Gattelli, M.: Evaluating multispectral images and vegetation indices for precision farming applications from uav images. Remote Sens. 7(4), 4026–4047 (2015). https://doi.org/10.3390/rs70404026
Che’Ya, N.N., Dunwoody, E., Gupta, M.: Assessment of weed classification using hyperspectral reflectance and optimal multispectral uav imagery. Agronomy 11(7). https://doi.org/10.3390/agronomy11071435 (2021)
Mink, R., Linn, A.I., Santel, H.-J., Gerhards, R.: Sensor-based evaluation of maize (zea mays) and weed response to post-emergence herbicide applications of isoxaflutole and cyprosulfamide applied as crop seed treatment or herbicide mixing partner. Pest Manag. Sci. 76(5), 1856–1865 (2019). https://doi.org/10.1002/ps.5715
Zaidner, G., Shapiro, A.: A novel data fusion algorithm for low-cost localisation and navigation of autonomous vineyard sprayer robots. Biosyst. Eng. 146, 133–148 (2016). https://doi.org/10.1016/j.biosystemseng.2016.05.002
Gan, H., Lee, W.S.: Development of a navigation system for a smart farm. IFAC-PapersOnLine 51(17), 1–4 (2018). https://doi.org/10.1016/j.ifacol.2018.08.051
Biber, P., Weiss, U., Dorna, M., Albert, A: Navigation system of the autonomous agricultural robot ‘bonirob,’. Workshop on Agricultural Robotics: Enabling Safe, Efficient, and Affordable Robots for Food Production (collocated with IROS 2012) Portugal (2012)
Gu, Y., Li, Z., Zhang, Z., Li, J., Chen, L.: Path tracking control of field information- collecting robot based on improved convolutional neural network algorithm. Sensors 20(3), 797 (2020). https://doi.org/10.3390/s20030797
Ouellette, R., Hirasawa, K.: Mayfly: a small mapping robot for japanese office environments. In: IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM), 880–885. https://doi.org/10.1109/AIM.2008.4601777 (2008)
Zhang, J., Maeta, S., Bergerman, M., Singh, S.: Mapping orchards for autonomous navigation. ASABE and CSBE/SCGAB Annual International Meeting, St. Joseph, Michigan, American Society of Agricultural and Biological Engineers. https://doi.org/10.13031/aim.20141838567 (2014)
Libby, J., Kantor, G.: Deployment of a point and line feature localization system for an outdoor agriculture vehicle, pp 1565–1570. https://doi.org/10.1109/ICRA.2011.5980430 (2011)
Jin, J., Tang, L.: Corn plant sensing using real-time stereo vision. J. Field Robot. 26(6), 591–608 (2009). https://doi.org/10.1002/rob.20293
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I., Leonard, J.J.: Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Trans. Robot. 32(6), 1309–1332 (2016). https://doi.org/10.1109/TRO.2016.2624754
Cheein, F.A., Steiner, G., Paina, G.P., Carelli, R.: Optimized eif-slam algorithm for precision agriculture mapping based on stems detection. Comput. Electron. Agric. 78(2), 195–207 (2011). https://doi.org/10.1016/j.compag.2011.07.007
Pierzchała, M., Giguère, P., Astrup, R.: Mapping forests using an unmanned ground vehicle with 3d lidar and graph-slam. Comput. Electron. Agric. 145, 217–225 (2018). https://doi.org/10.1016/j.compag.2017.12.034
Nguyen, T.T., Kayacan, E., Baedemaeker, J.D., Saeys, W.: Task and motion planning for apple harvesting robot*. IFAC Proc. 46(18), 247–252 (2013). https://doi.org/10.3182/20130828-2-SF-3019.00063
Hornung, A., Wurm, K.M., Bennewitz, M., Stachniss, C., Burgard, W.: Octomap: an efficient probabilistic 3d mapping framework based on octrees. Auton. Robot. 34(3), 189–206 (2013). https://doi.org/10.1007/s10514-012-9321-0
Mehta, S.S., Burks, T.F.: Vision-based control of robotic manipulator for citrus harvesting. Comput. Electron. Agric. 102, 146–158 (2014). https://doi.org/10.1016/j.compag.2014.01.003
Barth, R., Hemming, J., van Henten, E.J.: Design of an eye-in-hand sensing and servo control framework for harvesting robotics in dense vegetation. Biosyst. Eng. 146, 71–84 (2016). https://doi.org/10.1016/j.biosystemseng.2015.12.001
Ringdahl, O., Kurtser, P., Edan, Y.: Evaluation of approach strategies for harvesting robots: Case study of sweet pepper harvesting: Category: (5). J. Intell. Robot. Syst. 95(1), 149–164 (2019). https://doi.org/10.1007/s10846-018-0892-7
Ringdahl, O., Kurtser, P., Edan, Y.: Strategies for selecting best approach direction for a sweet-pepper harvesting robot. 10454, 516–525. https://doi.org/10.1007/978-3-319-64107-2_41 (2017)
Camacho, J.D.G., From, P.J., Leite, A.C.: A Visual Servoing Approach for Robotic Fruit Harvesting in the Presence of Parametric Uncertainties XXII Congresso Brasileiro De Automatica. 1. Campinas/SP Brasil: SBA. https://doi.org/10.20906/cps/cba2018-0541 (2018)
Bu, L., Hu, G., Chen, C., Sugirbay, A., Chen, J.: Experimental and simulation analysis of optimum picking patterns for robotic apple harvesting. Sci. Hortic. 261, 108937 (2020). https://doi.org/10.1016/j.scienta.2019.108937
Wei, J., Yi, D., Bo, X., Guangyu, C., Dean, Z.: Adaptive variable parameter impedance control for apple harvesting robot compliant picking. Complexity, 1–15. https://doi.org/10.1155/2020/4812657 (2020)
Roshanianfard, A., Noguchi, N.: Characterization of pumpkin for a harvesting robot. IFAC-PapersOnLine 51(17), 23–30 (2018). https://doi.org/10.1016/j.ifacol.2018.08.056
Mehta, S.S., MacKunis, W., Burks, T.F.: Nonlinear robust visual servo control for robotic citrus harvesting. IFAC Proceedings 47(3), 8110–8115 (2014). https://doi.org/10.3182/20140824-6-ZA-1003.02729
Vasconez, J.P., Kantor, G.A., Cheein, F.A.A.: Human–robot interaction in agriculture: a survey and current challenges. Biosyst. Eng. 179, 35–48 (2019). https://doi.org/10.1016/j.biosystemseng.2018.12.005
Bechar, A., Vigneault, C.: Agricultural robots for field operations: Concepts and components. Biosyst. Eng. 149, 94–111 (2016). https://doi.org/10.1016/j.biosystemseng.2016.06.014
Adamides, G.: Doctoral dissertation: user interfaces for human-robot interaction: Application on a semi-autonomous agricultural robot sprayer. Ph.D dissertation (2016)
Bergerman, M., Maeta, S.M., Zhang, J., Freitas, G.M., Hamner, B., Singh, S., Kantor, G.: Robot farmers: Autonomous orchard vehicles help tree fruit production. IEEE Robotics Automation Magazine 22(1), 54–63 (2015). https://doi.org/10.1109/MRA.2014.2369292
Cullen, R.H., Smarr, C. -A., Serrano-Baquero, D., McBride, S.E., Beer, J.M., Rogers, W.A.: The smooth (tractor) operator: Insights of knowledge engineering. Appl. Ergon. 43(6), 1122–30 (2012). https://doi.org/10.1016/j.apergo.2012.04.002
Jin, X., Zheng, B., Pei, Y., Li, H.: A method to estimate operator’s mental workload in multiple information presentation environment of agricultural vehicles. Engineering Psychology and Cognitive Ergonomics: Performance Emotion and Situation Awareness 10275, 3–20 (2017). https://doi.org/10.1007/978-3-319-58472-0_1
Gomez-Gil, J., San-Jose-Gonzalez, I., Nicolas-Alonso, L.F., Alonso-Garcia, S.: Steering a tractor by means of an emg-based human-machine interface. Sensors 11(7), 7110–26 (2011). https://doi.org/10.3390/s110707110
Szczepaniak, J., Tanas, W., Pawlowski, T., Kromulski, J.: Modelling of agricultural combination driver behaviour from the aspect of safety of movement. Annals of Agricultural and Environmental Medicine: AAEM 21(2), 403–6 (2014). https://doi.org/10.5604/1232-1966.1108613
Mohan, J., Lanka, K., Rao, N.A.: A review of dynamic job shop scheduling techniques. Procedia Manuf. 30, 34–39 (2019). https://doi.org/10.1016/j.promfg.2019.02.006
Petrovic, M., Miljkovic, Z., Jokic, A.: A novel methodology for optimal single mobile robot scheduling using whale optimization algorithm. Applied Soft Computing Journal, 81. https://doi.org/10.1016/j.asoc.2019.105520(2019)
Turkyilmaz, A., Senvar, O., Unal, I., Bulkan, S.: A research survey: heuristic approaches for solving multi objective flexible job shop problems. Journal of Intelligent Manufacturing 31(4). https://doi.org/10.1007/s10845-020-01547-4 (2020)
Xu, L., Jiawei, D., Ming, H.: Research on hybrid cloud particle swarm optimization for multi-objective flexible job shop scheduling problem (2017)
Li, J.Q., Pan, Q.K., Tasgetiren, M.F.: A discrete artificial bee colony algorithm for the multi-objective flexible job-shop scheduling problem with maintenance activities. Appl. Math. Model. 38(3), 1111–1132 (2014). https://doi.org/10.1016/j.apm.2013.07.038
Zheng, Y., Li, Y.X., Lei, D.M.: Multi-objective swarm based neighborhood search of fuzzy flexible job shop scheduling. The international Journal of Advanced Manufacturing Technologies 60(9-12), 1063–1069 (2012). https://doi.org/10.1007/s00170-011-3646-2
Li, J.Q., Duan, P., Cao, J., Li, X.P., Pan, Y.Y.: A hybrid pareto based tabu search for the distributed flexible job shop scheduling problem with e/t criteria. IEEE Access 6, 5883–5897 (2018). https://doi.org/10.1109/ACCESS.2018.2873401
Huang, R.H., Yang, C.L., Cheng, W.C.: Flexible job shop scheduling with due window- a two-pheromone ant colony approach. Int. J. Prod. Econ. 141(2), 685–697 (2013). https://doi.org/10.1016/j.ijpe.2012.10.011
Reddy, M.B., Ratnam, C., Rajyalakshmi, G., Manupati, V.K.: An effective hybrid multi objective evolutionary algorithm for solving real time event in flexible job shop scheduling problem. Measurement 114, 78–90 (2019). https://doi.org/10.1016/j.measurement.2017.09.022
Huang, X., Yang, L.: A hybrid genetic algorithm for multi objective flexible job shop scheduling problem considering transportation time. International Journal of Intelligent Computing and Cybernetics 12 (2), 154–174 (2019). https://doi.org/10.1108/IJICC-10-2018-0136
Ojstersek, R., Zhang, H., Liu, S., Buchmeister, B.: Improved heuristic kalman algorithm for solving multi-objective flexible job-shop scheduling problem. Procedia Manufacturing 17, 895–902 (2018). https://doi.org/10.1016/j.promfg.2018.10.142
Zhou, Y., Yang, J., Zheng, L.: Multi-agent based hyper-heuristics for multi-objective flexible job-shopscheduling: a case study in an aero-engine blade manufacturing plant. IEEE Access 7, 21147–21176 (2019). https://doi.org/10.1109/ACCESS.2019.2897603
Seyyedhasani, H., Peng, C., Jang, W. -J., Vougioukas, S.G.: Collaboration of human pickers and crop-transporting robots during harvesting – part i: Model and simulator development Computers and Electronics in Agriculture 172. https://doi.org/10.1016/j.compag.2020.105324 (2020)
Conesa-Muñoz, J., Bengochea-Guevara, J.M., Andujar, D., Ribeiro, A.: Route planning for agricultural tasks: a general approach for fleets of autonomous vehicles in site-specific herbicide applications. Comput Electron Agric. 127, 204–220 (2016). https://doi.org/10.1016/j.compag.2016.06.012
Edwards, G., Sorensen, C.G., Bochtis, D., Munkholm, L.J.: Optimized schedules for sequential agricultural operations using a tabu search method. Comput. Electron. Agric. 117, 102–113 (2015). https://doi.org/10.1016/j.compag.2015.07.007
Ahsan, Z., Dankowicz, H.: Optimal scheduling and sequencing for large-scale seeding operations. Comput. Electron. Agric. 104728, x163 (2019). https://doi.org/10.1016/j.compag.2019.01.052
Jensen, M.F., Bochtis, D., Sorensen, C.G.: Coverage planning for capacitated field operations, part ii: Optimisation. Biosyst. Eng. 139, 149–164 (2015). https://doi.org/10.1016/j.biosystemseng.2015.07.002
Santoro, E., Soler, E.M., Cherri, A.C.: Route optimization in mechanized sugarcane harvesting. Comput. Electron. Agric. 141, 140–146 (2017). https://doi.org/10.1016/j.compag.2017.07.013
Cheein, F.A., Torres-Torriti, M., Hopfenblatt, N.B., Prado, A.J., Calabi, D.: Agricultural service unit motion planning under harvesting scheduling and terrain constraints. Journal of Field Robotics 34, 1531–1542 (2017). https://doi.org/10.1002/rob.21738
Richards, D., Patten, T., Fitch, R.C., Ball, D., Sukkarieh, S.: User interface and coverage planner for agricultural robotics. Australasian Conference on Robotics and Automation (2015)
Mann, M.P., Zion, B., Shmulevich, I., Rubinstein, D., Linker, R.: Combinatorial optimization and performance analysis of a multi-arm cartesian robotic fruit harvester–extensions of graph coloring. J. Intell. Robot. Syst. 82(2-4), 399–411 (2016). https://doi.org/10.1007/s10846-015-0211-5
Barnett, J., Duke, M., Au, C.K., Lim, S.H.: Work distribution of multiple cartesian robot arms for kiwifruit harvesting. Comput. Electron. Agric. 105202, 169 (2020). https://doi.org/10.1016/j.compag.2019.105202
Kurtser, P., Edan, Y.: Planning the sequence of tasks for harvesting robots. Robot. Auton. Syst., 131. https://doi.org/10.1016/j.robot.2020.103591 (2020)
Miller, A.T., Allen, P.K.: Examples of 3d grasp quality computations. 2, 1240–1246. https://doi.org/10.1109/ROBOT.1999.772531 (1999)
Rodríguez, F., Moreno, J.C., Sánchez, J. A., Berenguel, M.: Grasping in agriculture: State-of-the-art and main characteristics. Mechanisms and Machine Science 10, 385–409 (2012). https://doi.org/10.1007/978-1-4471-4664-3_15
Mu, L., Cui, G., Liu, Y., Cui, Y., Fu, L., Gejima, Y.: Design and simulation of an integrated end-effector for picking kiwifruit by robot. Information Processing in Agriculture 7(1), 58–71 (2020). https://doi.org/10.1016/j.inpa.2019.05.004
Liu, J., Li, P., Li, Z.: A multi-sensory end-effector for spherical fruit harvesting robot, 258–262. https://doi.org/10.1109/ICAL.2007.4338567 (2007)
Jia, B., Zhu, A., Yang, S.X., Mittal, G.S.: Integrated gripper and cutter in a mobile robotic system for harvesting greenhouse products, 1778–1783. https://doi.org/10.1109/ROBIO.2009.5420430 (2009)
Dimeas, F., Sako, D.V., Moulianitis, V., Aspragathos, N.: Design and fuzzy control of a robotic gripper for efficient strawberry harvesting. Robotica 33(5), 1085–1098 (2014). https://doi.org/10.1017/S0263574714001155
Zhong, H., Nof, S.Y., Berman, S.: Asynchronous cooperation requirement planning with reconfigurable end-effectors. Robotics and Computer Integrated Manufacturing 34, 95–104 (2015). https://doi.org/10.1016/j.rcim.2014.11.004
Pedrazzoli, P., Rinaldi, R., Boer, C.R.: A rule based approach to the gripper selection issue for the assembly process. 202–207. https://doi.org/10.1109/ISATP.2001.928990 (2001)
Pham, D.T., Gourashi, N.S., Eldukhri, E.E.: Automated configuration of gripper systems for assembly tasks. Proc. Ins. Mech. Eng. Part B: J. Eng. Manuf. 221, 1643–1649 (2007). https://doi.org/10.1243/09544054JEM878SC
Sanfilippo, F., Salvietti, G., Zhang, H.X., Hildre, H.P., Prattichizzo, D.: Efficient modular grasping: An iterative approach, 1281–1286. https://doi.org/10.1109/BioRob.2012.6290693 (2012)
Brown, R.G., Brost, R.C.: A 3d modular gripper design tool. 3, 2332–2339. https://doi.org/10.1109/ROBOT.1997.619310 (1997)
Balan, L., Bone, G.M.: Automated gripper jaw design and grasp planning for sets of 3d objects. Journal of Field Robotics 20, 147–162 (2003). https://doi.org/10.1002/rob.10076
Velasco, V.B., Newman, W.S.: An approach to automated gripper customization using rapid prototyping technology (1996)
Velasco, V.B., Newman, W.S.: Computer-assisted gripper and fixture customization using rapid-prototyping technology, 4, 3658–3664. https://doi.org/10.1109/ROBOT.1998.681393 (1998)
Honarpardaz, M., Tarkian, M., Feng, X., Sirkett, D., Ölvander, J.: Generic automated finger design. 5,1–9. https://doi.org/10.1115/DETC2016-60514 (2016)
Sahbani, A., El-Khoury, S., Bidaud, P.: An overview of 3d object grasp synthesis algorithms. Robot. Auton. Syst. 60(3), 326–336 (2012). https://doi.org/10.1016/j.robot.2011.07.016
Bicchi, A., Kumar, V.: Robotic grasping and contact: a review. 1, 348–353. https://doi.org/10.1109/ROBOT.2000.844081 (2000)
Li, J.-W., Liu, H., Cai, H.-G.: On computing three-finger force-closure grasps of 2-d and 3-d objects. IEEE Trans. Robot. Autom. 19(1), 155–161 (2003). https://doi.org/10.1109/TRA.2002.806774
Han, L., Trinkle, J.C., Li, Z.: Grasp analysis as linear matrix inequality problems. 1261–1268. https://doi.org/10.1109/ROBOT.1999.772534 (1999)
Mishra, B., Schwartz, J.T., Sharir, M.: On the existence and synthesis of multifinger positive grips. Algorithmica 2(1), 541–558 (1987). https://doi.org/10.1007/BF01840373
Liu, Y-H.: Qualitative test and force optimization of 3-d frictional form-closure grasps using linear programming. IEEE Trans. Robot. Autom. 15(1), 163–173 (1999). https://doi.org/10.1109/70.744611
Borst, C., Fischer, M., Hirzinger, G.: Grasping the dice by dicing the grasp. 3, 3692–3697. https://doi.org/10.1109/IROS.2003.1249729 (2003)
Miller, A.T., Knoop, S., Christensen, H.I., Allen, P.K.: Automatic grasp planning using shape primitives. 2:1824–1829. https://doi.org/10.1109/ROBOT.2003.1241860 (2003)
Ding, D., Liu, Y.-H., Wang, S.: Computing 3-d optimal form-closure grasps. 4, 3573–3578. https://doi.org/10.1109/ROBOT.2000.845288 (2000)
Ding, D., Liu, Y.-H., Wang, M.Y.: On computing immobilizing grasps of 3-d curved objects. In: Proceedings 2001 IEEE International Symposium on Computational Intelligence in Robotics and Automation, pp. 11–16. https://doi.org/10.1109/CIRA.2001.1013165 (2001)
Liu, Y.-H., Lam, M.-L., Ding, D.: A complete and efficient algorithm for searching 3-d form-closure grasps in the discrete domain. IEEE Trans. Robot. 20(5), 805–816 (2004). https://doi.org/10.1109/TRO.2004.829500
Eizicovits, D., Berman, S.: Efficient sensory-grounded grasp pose quality mapping for gripper design and online grasp planning. Robot. Auton. Syst. 62(8), 1208–1219 (2014). https://doi.org/10.1016/j.robot.2014.03.011
Liu, S., Carpin, S.: Global grasp planning using triangular meshes, 4904–4910. https://doi.org/10.1109/ICRA.2015.7139880 (2015)
Hemming, J., Bac, C.W., Tuijl, B., Barth, R., Bontsema, J., Pekkeriet, E., Henten, E.V.: A robot for harvesting sweet-pepper in greenhouses (2014)
Bohg, J., Morales, A., Asfour, T., Kragic, D.: Data-driven grasp synthesis - a survey. IEEE Trans. Robot. 30(2), 289–309 (2014). https://doi.org/10.1109/TRO.2013.2289018
Kim, J., Iwamoto, K., Kuffner, J.J., Ota, Y., Pollard, N.S.: Physically based grasp quality evaluation under pose uncertainty. IEEE Trans. Rob. 29(6), 1424–1439 (2013). https://doi.org/10.1109/TRO.2013.2273846
Wolniakowski, A., Miatliuk, K., Kruger, N., Rytz, J.A.: Automatic evaluation of task-focused parallel jaw gripper design. International Conference on Simulation, Modeling, and Programming for Autonomous Robots, 450–461. https://doi.org/10.1007/978-3-319-11900-7_38 (2014)
Fernández, R., Salinas, C., Montes, H., Sarria, J.: Multisensory system for fruit harvesting robots. experimental testing in natural scenarios and with different kinds of crops. Sensors 14(12), 23885–23904 (2014). https://doi.org/10.3390/s141223885
Bac, C.W., Hemming, J., van Tuijl, B.A.J., Barth, R., Wais, E., van Henten, E.J.: Performance evaluation of a harvesting robot for sweet pepper. Journal of Field Robotics 34(6), 1123–1139 (2017). https://doi.org/10.1002/rob.21709
Tardáguila, J., Blasco, J., Diago, M.P.: Vinerobot: A new robot for vineyard monitoring using non-invasive sensing technologies. In: 9th International Cool Climate Wine Symposium. Retrieved from https://digital.csic.es/handle/10261/148399 - Last accessed: 19-05-2022 (2016)
Fernández-Novales, J., Garde-Cerdán, T., Tardáguila, J., Gutiérrez-Gamboa, G., Pérez-Álvarez, E.P., Diago, M.P.: Assessment of amino acids and total soluble solids in intact grape berries using contactless vis and nir spectroscopy during ripening. Talanta 199, 244–253 (2019). https://doi.org/10.1016/j.talanta.2019.02.037
Aquino, A., Millan, B., Diago, M.P., Tardaguila, J.: Automated early yield prediction in vineyards from on-the-go image acquisition. Comput. Electron. Agric. 144, 26–36 (2018). https://doi.org/10.1016/j.compag.2017.11.026
Fernández-Novales, J., Tardaguila, J., Gutiérrez, S., Marañón, M., Diago, M.P.: In field quantification and discrimination of different vineyard water regimes by on-the-go nir spectroscopy. Biosyst. Eng. 165, 47–58 (2018). https://doi.org/10.1016/j.biosystemseng.2017.08.018
Lopes, C.M., Graça, J.D., Sastre, J., Reyes, M., Guzman, R., Braga, R., Monteiro, A., Pinto, P.A.: Vineyard yield estimation by vinbot robot - preliminary results with the white variety viosinho. https://doi.org/10.13140/RG.2.1.3912.0886 (2016)
Lopes, C.M., Torres, A., Guzman, R., Graça, J. D., Monteiro, A., Braga, R.P., Barriguinha, A., Victorino, G., Reys, M.: Using an unmanned ground vehicle to scout vineyards for non-intrusive estimation of canopy features and grape yield. 20th giESCO International Meeting (2017)
Astolfi, P., Gabrielli, A., Bascetta, L., Matteucci, M.: Vineyard autonomous navigation in the echord++ grape experiment. IFAC-PapersOnLine 51(11), 704–709 (2018). https://doi.org/10.1016/j.ifacol.2018.08.401
Leu, A., Razavi, M., Langstädtler, L., Ristić-Durrant, D., Raffel, H., Schenck, C., Gräser, A., Kuhfuss, B.: Robotic green asparagus selective harvesting. IEEE/ASME Trans. Mechatron. 22(6), 2401–2410 (2017). https://doi.org/10.1109/TMECH.2017.2735861
Fernández-Novales, J., Tardáguila, J., Gutiérrez, S., Diago, M.P.: On-the-go vis + sw − nir spectroscopy as a reliable monitoring tool for grape composition within the vineyard. Molecules 24 (15), 2795 (2019). https://doi.org/10.3390/molecules24152795
Gutiérrez, S., Tardaguila, J., Fernández-Novales, J., Diago, M.P.: On-the-go hyperspectral imaging for the in-field estimation of grape berry soluble solids and anthocyanin concentration. Aust. J. Grape Wine Res. 25(1), 127–133 (2019). https://doi.org/10.1111/ajgw.12376
Gutiérrez, S., Diago, M.P., Fernández-Novales, J., Tardaguila, J.: On-the-go thermal imaging for water status assessment in commercial vineyards. Adv. Anim. Biosci. 8(2), 520–524 (2017). https://doi.org/10.1017/S204047001700108X
Grimstad, L., Pham, C.D., Phan, H.T., From, P.J.: On the design of a low-cost, light-weight, and highly versatile agricultural robot. IEEE Workshop on Advanced Robotics and its Social Impacts ARSO. https://doi.org/10.1109/ARSO.2015.7428210 (2016)
Harvest Croo Robotics. https://harvestcroo.com/ - Last accessed: 22-11-2022
Dogtooth. https://dogtooth.tech/ - Last accessed: 22-11-2022
Agrobot E-Series. http://agrobot.com - Last Accessed: 22-11-2022
OCTINION. http://octinion.com/products/agricultural-robotics/rubion - Last Accessed: 22-11-2022
SAGA Robotics. https://sagarobotics.com - Last Accessed: 22-11-2022
Grimstad, L., From, P.J.: The thorvald ii agricultural robotic system. Robotics 6(4). https://doi.org/10.3390/robotics6040024 (2017)
MetoMotion. https://metomotion.com- Last accessed: 22-11-2022
Root-AI. https://www.appharvest.com/press_release/appharvest-acquires-agricultural-robotics-and-artificial-intelligence-company-root-ai-to-increase-efficiency/ - Last accessed: 22-11-2022
AppHarvest. https://www.appharvest.com/ - Last accessed: 22-11-2022
ENERGID. https://www.energid.com/industries/agricultural-robotics - Last accessed: 22-11-2022
VISION ROBOTICS. https://www.visionrobotics.com/vr-grapevine-pruner - Last accessed: 22-11-2022
naio Technologies. https://www.naio-technologies.com/en/ted/ - Last accessed: 22-11-2022
ViTiBOT. https://vitibot.fr/en - Last Accessed: 22-11-2022
Funding
Open access funding provided by HEAL-Link Greece. This research received funding from the European Community’s Framework Programme Horizon 2020 under grant agreement No 871704, project BACCHUS.
Author information
Authors and Affiliations
Contributions
Conceptualization - Leonidas Droukas, Zoe Doulgeri; Literature search - Leonidas Droukas, Nikolaos L. Tsakiridis, Dimitra Triantafyllou, Ioannis Kleitsiotis and Dimitrios Kateris; Writing/original draft preparation - Leonidas Droukas, Nikolaos L. Tsakiridis, Dimitra Triantafyllou, Ioannis Kleitsiotis and Dimitrios Kateris; Writing/review and editing/critical revision - Zoe Doulgeri, Ioannis Mariolis, Dimitrios Giakoumis, Dimitrios Tzovaras and Dionysis Bochtis.
Corresponding author
Ethics declarations
Conflict of Interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Droukas, L., Doulgeri, Z., Tsakiridis, N.L. et al. A Survey of Robotic Harvesting Systems and Enabling Technologies. J Intell Robot Syst 107, 21 (2023). https://doi.org/10.1007/s10846-022-01793-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10846-022-01793-z