Current Research Trends in Robot Grasping and Bin Picking

  • Marcos Alonso
  • Alberto Izaguirre
  • Manuel GrañaEmail author
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 771)


We provide a view of current research issues in Robotic Grasping and Bin Picking focused on the perception aspects of the problem, mainly related to computer vision algorithms. After recalling the evolution of the topics in the last decades, we focus on the modern use of Deep Learning Algorithms. Two main trends are followed in the approaches to innovative grasping techniques. First, Convolutional Neural Networks are used for grasping perceptual aspects. We discuss the different degrees of success of several published approaches. Second, Deep Reinforcement Learning is being extensively tested in order to develop integrated eye-hand coordination systems not requiring delicate calibration. We provide also a discussion of possible future lines of research.


Robot grasping Bin Picking Deep Learning Convolutional Neural Networks Robot gripper Robot planning 


  1. 1.
    Amodei, D., Anubhai, R., Battenberg, E., Case, C., Casper, J., Catanzaro, B., Chen, J., Chrzanowski, M., Coates, A., Diamos, G., Elsen, E., Engel, J., Fan, L., Fougner, C., Han, T., Hannun, A.Y., Jun, B., LeGresley, P., Lin, L., Narang, S., Ng, A.Y., Ozair, S., Prenger, R., Raiman, J., Satheesh, S., Seetapun, D., Sengupta, S., Wang, Y., Wang, Z., Wang, C., Xiao, B., Yogatama, D., Zhan, J., Zhu, Z.: Deep speech 2: end-to-end speech recognition in English and Mandarin. CoRR abs/1512.02595 (2015)Google Scholar
  2. 2.
    Asada, H.: Studies on prehension and handling by robot hands with elastic fingers. Ph.D. thesis, Kyoto University (1979)Google Scholar
  3. 3.
    Barnard, S.T., Thompson, W.B.: Disparity analysis of images. IEEE Trans. Pattern Anal. Mach. Intell. PAMI 2(4), 333–340 (1980)CrossRefGoogle Scholar
  4. 4.
    Bicchi, A.: Hands for dexterous manipulation and robust grasping: a difficult road toward simplicity. IEEE Trans. Robot. Autom. 16(6), 652–662 (2000)CrossRefGoogle Scholar
  5. 5.
    Bicchi, A., Kumar, V.: Robotic grasping and contact: a review. In: Proceedings of the IEEE International Conference on Robotics and Automation, vol. 1, pp. 348–353 (2000)Google Scholar
  6. 6.
    Deriche, R., Zhang, Z., Luong, Q.T., Faugeras, O.: Robust recovery of the epipolar geometry from an uncalibrated stereo rig. In: Proceedings of the European Conference on Computer Vision, vol. 800, pp. 567–576 (1994)CrossRefGoogle Scholar
  7. 7.
    Drost, B., Ulrich, M., Navab, N., Ilic, S.: Model globally, match locally: efficient and robust 3D object recognition. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 998–1005 (2010)Google Scholar
  8. 8.
    Faugeras, O.D., Hebert, M.: The representation, recognition, and locating of 3-D objects. Int. J. Robot. Res. 5(3), 27–52 (1986)CrossRefGoogle Scholar
  9. 9.
    Ghalamzan, A.M., Mavrakis, N., Kopicki, M., Stolkin, R., Leonardis, A., E., A.M.G., Mavrakis, N., Kopicki, M., Stolkin, R., Leonardis, A.: Task-relevant grasp selection: a joint solution to planning grasps and manipulative motion trajectories. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 907–914, October 2016Google Scholar
  10. 10.
    Ghita, O., Whelan, P.: A systems engineering approach to robotic bin picking, November 2008Google Scholar
  11. 11.
    Graña, M., Torrealdea, F.: Hierarchically structured systems. Eur. J. Oper. Res. 25(1), 20–26 (1986). Scholar
  12. 12.
    Gualtieri, M., ten Pas, A., Saenko, K., Platt, R.: High precision grasp pose detection in dense clutter. In: 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 598–605, October 2016Google Scholar
  13. 13.
    Horn, B., Ikeuchi, K.: The mechanical manipulation of randomly oriented parts. Sci. Am. 251(2), 100–111 (1984)CrossRefGoogle Scholar
  14. 14.
    Khatib, O., Yokoi, K., Chang, K., Ruspini, D., Holmberg, R., Casal, A., Baader, A.: Force strategies for cooperative tasks in multiple mobile manipulation systems. In: International Symposium on Robotics Research (1995).
  15. 15.
    Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, NIPS 2012, vol. 25, pp. 1–9 (2012)Google Scholar
  16. 16.
    Laskey, M., Lee, J., Chuck, C., Gealy, D., Hsieh, W., Pokorny, F.T., Dragan, A.D., Goldberg, K.: Robot grasping in clutter: using a hierarchy of supervisors for learning from demonstrations. In: 2016 IEEE International Conference on Automation Science and Engineering (CASE), pp. 827–834 (2016)Google Scholar
  17. 17.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86(11), 2278–2323 (1998)CrossRefGoogle Scholar
  18. 18.
    LeCun, Y.A., Bengio, Y., Hinton, G.E.: Deep learning. Nature 521(7553), 436–444 (2015)CrossRefGoogle Scholar
  19. 19.
    Lenz, I., Lee, H., Saxena, A.: Deep learning for detecting robotic grasps. Int. J. Robot. Res. 34(4–5), 705–724 (2015)CrossRefGoogle Scholar
  20. 20.
    Levine, S., Pastor, P., Krizhevsky, A., Quillen, D.: Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection (2016)Google Scholar
  21. 21.
    Mahler, J., Liang, J., Niyaz, S., Laskey, M., Doan, R., Liu, X., Ojea, J.A., Goldberg, K.: Dex-Net 2.0: deep learning to plan robust grasps with synthetic point clouds and analytic grasp metrics (2017)Google Scholar
  22. 22.
    Mason, M., Salisbury, J.J.: Robot Hands and the Mechanics of Manipulation. The MIT Press, Cambridge (1985)Google Scholar
  23. 23.
    Miller, A.T., Allen, P.K.: Examples of 3d grasp quality computations. In: Proceedings of the 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C), vol. 2, pp. 1240–1246 (1999)Google Scholar
  24. 24.
    Miller, A.T., Allen, P.K.: Graspit: a versatile simulator for robotic grasping. IEEE Robot. Autom. Mag. 11(4), 110–122 (2004)CrossRefGoogle Scholar
  25. 25.
    Pinto, L., Gupta, A.: Supersizing self-supervision: learning to grasp from 50K tries and 700 robot hours. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 3406–3413, June 2016Google Scholar
  26. 26.
    Rioux, M., Bechthold, G., Taylor, D., Duggan, M.: Design of a large depth of view 3-dimensional camera for robot vision. Opt. Eng. 26(12), 1245–1250 (1987)CrossRefGoogle Scholar
  27. 27.
    Roberts, L.G.: Machine perception of three-dimensional solids. Ph.D. thesis (1965)Google Scholar
  28. 28.
    Silver, D., Schrittwieser, J., Simonyan, K., Antonoglou, I., Huang, A., Guez, A., Hubert, T., Baker, L., Lai, M., Bolton, A., Chen, Y., Lillicrap, T., Hui, F., Sifre, L., Van Den Driessche, G., Graepel, T., Hassabis, D.: Mastering the game of Go without human knowledge. Nature 550(7676), 354–359 (2017)CrossRefGoogle Scholar
  29. 29.
    Trinkle, J.C., Abel, J.M., Paul, R.P.: An investigation of frictionless enveloping grasping in the plane. Int. J. Robot. Res. 7(3), 33–51 (1988)CrossRefGoogle Scholar
  30. 30.
    Varley, J., Weisz, J., Weiss, J., Allen, P.: Generating multi-fingered robotic grasps via deep learning. In: IEEE International Conference on Intelligent Robots and Systems, pp. 4415–4420, December 2015Google Scholar
  31. 31.
    Wohlkinger, W., Aldoma, A., Rusu, R.B., Vincze, M.: 3DNet: large-scale object class recognition from CAD models. In: Proceedings of the IEEE International Conference on Robotics and Automation, pp. 5384–5391 (2012)Google Scholar
  32. 32.
    Yang, C., Medioni, G.: Object modelling by registration of multiple range images. Image Vis. Comput. 10(3), 145–155 (1992)CrossRefGoogle Scholar
  33. 33.
    Yoshikawa, T.: Multifingered robot hands: control for grasping and manipulation. Ann. Rev. Control 34(2), 199–208 (2010)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2019

Authors and Affiliations

  • Marcos Alonso
    • 1
  • Alberto Izaguirre
    • 2
  • Manuel Graña
    • 1
    Email author
  1. 1.Computational Intelligence Group, CCIA DepartmentUPV/EHUSan SebastianSpain
  2. 2.CIS and Electronics DepartmentUniversity of MondragonMondragonSpain

Personalised recommendations