Skip to main content

Flexible robotic grasping strategy with constrained region in environment

Abstract

Grasping is a significant yet challenging task for the robots. In this paper, the grasping problem for a class of dexterous robotic hands is investigated based on the novel concept of constrained region in environment, which is inspired by the grasping operations of the human beings. More precisely, constrained region in environment is formed by the environment, which integrates a bio-inspired co-sensing framework. By utilizing the concept of constrained region in environment, the grasping by robots can be effectively accomplished with relatively low-precision sensors. For the grasping of dexterous robotic hands, the attractive region in environment is first established by model primitives in the configuration space to generate offline grasping planning. Then, online dynamic adjustment is implemented by integrating the visual sensory and force sensory information, such that the uncertainty can be further eliminated and certain compliance can be obtained. In the end, an experimental example of BarrettHand is provided to show the effectiveness of our proposed grasping strategy based on constrained region in environment.

References

  1. Z. Pan, J. Polden, N. Larkin, S. Van Duin, J. Norrish. Recent progress on programming methods for industrial robots. Robotics and Computer-integrated Manufacturing, vol. 28, no. 2, pp. 87–94, 2012.

    Article  Google Scholar 

  2. E. Broadbent, R. Stafford, B. MacDonald. Acceptance of healthcare robots for the older population: Review and future directions. International Journal of Social Robotics, vol. 1, no. 4, pp. 319–330, 2009.

    Article  Google Scholar 

  3. T. Fong, I. Nourbakhsh, K. Dautenhahn. A survey of socially interactive robots. Robotics and Autonomous Systems, vol. 42, no. 3, pp. 143–166, 2003.

    Article  MATH  Google Scholar 

  4. I. A. Hameed. Intelligent coverage path planning for agricultural robots and autonomous machines on threedimensional terrain. Journal of Intelligent & Robotic Systems, vol. 74, no. 3–4, pp. 965–983, 2014.

    Article  Google Scholar 

  5. Z. G. Liu, J. M. Huang, A new adaptive tracking control approach for uncertain flexible joint robot system. International Journal of Automation and Computing, vol. 12, no. 5, pp. 559–566, 2015.

    Article  Google Scholar 

  6. T. J. Li, G. Q. Chen, G. F. Shao. Action control of soccer robots based on simulated human intelligence. International Journal of Automation and Computing, vol. 7, no. 1, pp. 55–63, 2010.

    Article  Google Scholar 

  7. B. Moore, E. Oztop. Robotic grasping and manipulation through human visuomotor learning. Robotics and Autonomous Systems, vol. 60, no. 3, pp. 441–451, 2012.

    Article  Google Scholar 

  8. I. Lenz, H. Lee, A. Saxena. Deep learning for detecting robotic grasps. The International Journal of Robotics Research, vol. 34, no. 4–5, pp. 705–724, 2015.

    Article  Google Scholar 

  9. H. Dang, P. K. Allen. Semantic grasping: Planning taskspecific stable robotic grasps. Autonomous Robots, vol. 37, no. 3, pp. 301–316, 2014.

    Article  Google Scholar 

  10. R. Paolini, A. Rodriguez, S. S. Srinivasa, M. T. Mason. A data-driven statistical framework for post-grasp manipulation. The International Journal of Robotics Research, vol. 33, no. 4, pp. 600–615, 2014.

    Article  Google Scholar 

  11. K. B. Shimoga. Robot grasp synthesis algorithms: A survey. The International Journal of Robotics Research, vol. 15, no. 3, pp. 230–266, 1996.

    Article  Google Scholar 

  12. R. Dillmann. Teaching and learning of robot tasks via observation of human performance. Robotics and Autonomous Systems, vol. 47, no. 2, pp. 109–116, 2004.

    MathSciNet  Article  Google Scholar 

  13. M. A. Goodrich, A. C. Schultz, A. C. Human-robot interaction: A survey. Foundations and trends in human-computer interaction, vol. 1, no. 3, pp. 203–275, 2007.

    Article  MATH  Google Scholar 

  14. J. Heinzmann, A. Zelinsky, A. Quantitative safety guarantees for physical human-robot interaction. The International Journal of Robotics Research, vol. 22, no. 7–8, pp. 479–504, 2003.

    Article  Google Scholar 

  15. B. Shen, S. X. Ding, Z. Wang. Finite-horizon H∞ fault estimation for linear discrete time-varying systems with delayed measurements. Automatica, vol. 49, no. 1, pp. 293–296, 2013.

    MathSciNet  Article  MATH  Google Scholar 

  16. F. Wang, B. Shen, S. Sun, Z. Wang. Improved GA and Pareto optimization-based facial expression recognition. Assembly Automation, vol. 36, no. 2, pp. 192–199, 2016.

    Article  Google Scholar 

  17. P. I. Corke. Visual control of robot manipulators–A review. Visual servoing, vol. 7, pp. 1–31, 1993.

    Article  Google Scholar 

  18. K. Hashimoto. A review on vision-based control of robot manipulators. Advanced Robotics, vol. 17, no. 10, pp. 969–991, 2003.

    Article  Google Scholar 

  19. H. Yousef, M. Boukallel, K. Althoefer. Tactile sensing for dexterous in-hand manipulation in robotics–A review. Sensors and Actuators A: physical, vol. 167, no. 2, pp. 171–187, 2011.

    Article  Google Scholar 

  20. M. I. Tiwana, S. J. Redmond, N. H. Lovell. A review of tactile sensing technologies with applications in biomedical engineering. Sensors and Actuators A: physical, vol. 179, pp. 17–31, 2012.

    Article  Google Scholar 

  21. S. El-Khoury, A. Sahbani. A new strategy combining empirical and analytical approaches for grasping unknown 3D objects. Robotics and Autonomous Systems, vol. 58, no. 5, pp. 497–507, 2010.

    Article  Google Scholar 

  22. A. A. Rizzi, D. E. Koditschek. An active visual estimator for dexterous manipulation. IEEE Transactions on Robotics and Automation, vol. 12, no. 5, pp. 697–713, 1996.

    Article  Google Scholar 

  23. V. D. Nguyen. Constructing force-closure grasps. The International Journal of Robotics Research, vol. 7, no. 3, pp. 3–16, 1988.

    Article  Google Scholar 

  24. J. Ponce, B. Faverjon. On computing three-finger forceclosure grasps of polygonal objects. IEEE Transactions on robotics and automation, vol. 11, no. 6, pp. 868–881, 1995.

    Article  Google Scholar 

  25. Y. H. Liu. Computing n-finger form-closure grasps on polygonal objects. The International Journal of Robotics Research, vol. 19, no. 2, pp. 149–158, 2000.

    MathSciNet  Article  Google Scholar 

  26. D. Ding, Y. H. Lee, S. Wang. Computation of 3-D formclosure grasps. IEEE Transactions on Robotics and Automation, vol. 17, no. 4, pp. 515–522, 2001.

    Article  Google Scholar 

  27. A. Bicchi. On the closure properties of robotic grasping. The International Journal of Robotics Research, vol. 14, no. 4, pp. 319–334, 1995.

    Article  Google Scholar 

  28. A. Rodriguez, M. T. Mason, S. Ferry. From caging to grasping. The International Journal of Robotics Research, vol. 31, no. 7, pp. 886–900, 2011.

    Article  Google Scholar 

  29. N. S. Pollard. Closure and quality equivalence for efficient synthesis of grasps from examples. The International Journal of Robotics Research, vol. 23, no. 6, pp. 595–613, 2004.

    Article  Google Scholar 

  30. M. A. Roa, R. Suárez. Grasp quality measures: Review and performance. Autonomous robots, vol. 38, no. 1, pp. 65–88, 2015.

    Article  Google Scholar 

  31. J. Aleotti, S. Casell. Interactive teaching of task-oriented robot grasps. Robotics and Autonomous Systems, vol. 58, no. 5, pp. 539–550, 2010.

    Article  Google Scholar 

  32. D. R. Faria, P. Trindade, J. Lobo, J. Dias. Knowledge-based reasoning from human grasp demonstrations for robot grasp synthesis. Robotics and Autonomous Systems, vol. 62, no. 6, pp. 794–817, 2014.

    Article  Google Scholar 

  33. M. R. Cutkosky. On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Transactions on robotics and automation, vol. 5, no. 3, pp. 269–279, 1989.

    Article  Google Scholar 

  34. A. Bicchi. Hands for dexterous manipulation and robust grasping: A difficult road toward simplicity. IEEE Transactions on robotics and automation, vol. 16, no. 6, pp. 652–662, 2000.

    Article  Google Scholar 

  35. J. L. Pons, R. Ceres, F. Pfeiffer. Multifingered dextrous robotics hand design and control: A review. Robotica, vol. 17, no. 6, pp. 661–674, 1999.

    Article  Google Scholar 

  36. T. Iberall. Human prehension and dexterous robot hands. The International Journal of Robotics Research, vol. 16, no. 3, pp. 285–299, 1997.

    Article  Google Scholar 

  37. Y. Matsuoka, P. Afshar, M. Oh. On the design of robotic hands for brain-machine interface. Neurosurgical Focus, vol. 20, no. 5, pp. 1–9, 2006.

    Article  Google Scholar 

  38. Y. Lin, Y. Sun. Grasp planning to maximize task coverage. The International Journal of Robotics Research, vol. 34, no. 9, pp. 1195–1210, 2015.

    Article  Google Scholar 

  39. M. Li, K. Hang, D. Kragic, A. Billard. Dexterous grasping under shape uncertainty. Robotics and Autonomous Systems, vol. 75, pp. 352–364, 2016.

    Article  Google Scholar 

  40. B. B. Edin, L. Ascari, L. Beccai, S. Roccella, J. J. Cabibihan, M. C. Carrozza. Bio-inspired sensorization of a biomechatronic robot hand for the grasp-and-lift task. Brain Research Bulletin, vol. 75, no. 6, pp. 785–795, 2008.

    Article  Google Scholar 

  41. L. Zollo, S. Roccella, E. Guglielmelli, M. C. Carrozza, P. Dario. Biomechatronic design and control of an anthropomorphic artificial hand for prosthetic and robotic applications. IEEE/ASME Transactions On Mechatronics, vol. 12, no. 4, pp. 418–429, 2007.

    Article  Google Scholar 

  42. M. T. Ciocarlie, P. K. Allen. Hand posture subspaces for dexterous robotic grasping. The International Journal of Robotics Research, vol. 28, no. 7, pp. 851–867, 2009.

    Article  Google Scholar 

  43. M. Buss, H. Hashimoto, J. B. Moore. Dextrous hand grasping force optimization. IEEE Transactions on Robotics and Automation, vol. 12, no. 3, pp. 406–418, 1996.

    Article  Google Scholar 

  44. J. Rosell, R. Suárez, C. Rosales, A. Pérez. Autonomous motion planning of a hand-arm robotic system based on captured human-like hand postures. Autonomous Robots, vol. 31, no. 1, pp. 87–102, 2011.

    Article  Google Scholar 

  45. Y. Xia, J. Wang, L. M. Fok. Grasping-force optimization for multifingered robotic hands using a recurrent neural network. IEEE Transactions on Robotics and Automation, vol. 20, no. 3, pp. 549–554, 2004.

    Article  Google Scholar 

  46. H. Qiao, M. Wang, J. Su, S. Jia, R. Li. The concept of attractive region in environment and its application in highprecision tasks with low-precision systems. IEEE/ASME Transactions on Mechatronics, vol. 20, no. 5, pp. 2311–2327, 2015.

    Article  Google Scholar 

  47. R. D. Howe. Tactile sensing and control of robotic manipulation. Advanced Robotics, vol. 8, no. 3, pp. 245–261, 1993.

    Article  Google Scholar 

  48. R. S. Dahiya, G. Metta, M. Valle, G. Sandini. Tactile sensing–from humans to humanoids. IEEE Transactions on Robotics, vol. 26, no. 1, pp. 1–20, 2010.

    Article  Google Scholar 

  49. M. A. Erdmann. Understanding action and sensing by designing action based sensors. International Journal of Robotics Research, vol. 14, no. 5, pp. 483–509, 1995.

    Article  Google Scholar 

  50. A. Marigo, M. Ceccarelli, S. Piccinocchi, A. Bicchi. Planning motions of polyhedral parts by rolling. Algorithmica, vol. 26, no. 3–4, pp. 560–576, 2000.

    MathSciNet  MATH  Google Scholar 

  51. W. Zhang, D. Che, H. Liu, X. Ma, Q. Chen, D. Du, Z. Sun. Super under-actuated multi-fingered mechanical hand with modular self-adaptive gear-rack mechanism. Industrial Robot: An International Journal, vol. 36, no. 3, pp. 255–262, 2009.

    Article  Google Scholar 

  52. S. Montambault, C. M. Gosselin. Analysis of underactuated mechanical grippers. Journal of Mechanical Design, vol. 123, no. 3, pp. 367–374, 2001.

    Article  Google Scholar 

  53. C. Eppner, R. Deimel, J. Álvarez-Ruiz, M. Maertens, O. Brock. Exploitation of environmental constraints in human and robotic grasping. Robotics Research, Berlin, Germany: Springer, pp. 1021–1038, 2015.

    Google Scholar 

  54. C. Eppner, O. Brock. Planning grasp strategies that exploit environmental constraints. In Proceedings of the IEEE International Conference on Robotics and Automation, pp. 4947–4952, 2015.

    Google Scholar 

  55. D. Elliott, S. Hansen, L. E. Grierson, J. Lyons, S. J. Bennett,. J. Hayes, S. Goal-directed aiming: two components but multiple processes. Psychological Bulletin, vol. 136, no. 6, pp. 1023–1044, 2010.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Chao Ma.

Additional information

This work was supported by National Natural Science Foundation of China (No. 61210009), Beijing Municipal Science and Technology (Nos.D16110400140000 and D161100001416001), Fundamental Research Funds for the Central Universities (No. FRF-TP-15-115A1), and the Strategic Priority Research Program of the CAS (No.XDB02080003).

Recommended by Associate Editor Veljko Potkonjak

Chao Ma received the B. Sc. degree in automation from Central South University, China in 2007, the M. Sc. degree and the Ph.D. degree in control science and engineering from the Harbin Institute of Technology, China in 2010 and 2015. He is a member of IEEE.

His research interests include intelligent robot systems, intelligent agents and robot control.

Hong Qiao received the B. Eng. degree in hydraulics and control and the M.Eng. degree in robotics from Xi’an Jiaotong University, China in 1986 and 1989, received the M.Phil. degree in robotics control from the Industrial Control Center, University of Strathclyde, UK in 1992, and received the Ph.D. degree in robotics and artificial intelligence from De Montfort University, UK in 1995. She is currently a “100-Talents Project” Professor with the State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China. She is currently a member of the Administrative Committee of the IEEE Robotics and Automation Society (RAS), the Long Range Planning Committee, the Early Career Award Nomination Committee, Most Active Technical Committee Award Nomination Committee, and Industrial Activities Board for RAS. She received the Second Prize of 2014 National Natural Science Awards, First Prize of 2012 Beijing Science and Technology Award (for Fundamental Research) and the Second Prize of 2015 Beijing Science and Technology Award (for Technology Inventions). She is on the Editorial Boards of five IEEE Transactions and the Editor-in-Chief of Assembly Automation (SCI indexed).

Her research interests include pattern recognition, machine learning, bio-inspired intelligent robot, brain-like intelligence, robotics and intelligent agents.

Rui Li received the B.Eng. degree in automation engineering from the University of Electronic Science and Technology of China, China in 2013. Currently he is a Ph.D. degree candidate in intelligent robot with The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences (CASIA), China and University of Chinese Academy of Sciences (UCAS), China. He is a student member of IEEE.

His research interests include intelligent robot system, highprecision assembly, compliant manipulation for robotic systems.

Xiao-Qing Li received the B.Eng. degree from School of Automation and Electrical Engineering University of Science and Technology Beijing, China, in 2015. Currently, she is a Ph. D. degree candidate in Robotics with the Intelligent robotics Center at the University of Science and Technology Beijing, China. She is a student member of IEEE.

Her research interests include robotics intelligence, robot grasp and high-precision assembly.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ma, C., Qiao, H., Li, R. et al. Flexible robotic grasping strategy with constrained region in environment. Int. J. Autom. Comput. 14, 552–563 (2017). https://doi.org/10.1007/s11633-017-1096-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11633-017-1096-5

Keywords

  • Grasping strategy
  • compliant grasping
  • dexterous robotic hands
  • attractive region in environment
  • constrained region in environment