Adaptive tactile control for in-hand manipulation tasks of deformable objects

  • Angel DelgadoEmail author
  • Carlos A. Jara
  • Fernando Torres


Tactile sensors are key components for a robot hand system, which are usually used to obtain the object’s features. The use of tactile sensors to obtain information from the objects is an open topic of research. In this paper, a new strategy for in-hand extraction of object’s properties and for control of the interaction forces with robot fingers, mainly based on tactile data, is presented. The scope of this strategy is to grasp and manipulate solid objects, including rigid and soft bodies. Assuming that the hand is in an initial configuration in which the object is grasped, the properties’ extraction approach is executed. After the extraction of properties is finished, the object can be classified in regard to a general body listing: rigid body, soft elastic body, or soft plastic object. Once the object is classified, for in-hand manipulation tasks, the contact points between the object grasped and the fingers are maintained using the information given by the tactile sensors in order to perform manipulation tasks. Each task is defined by a sequence of basic actions, in which the contact points and applied forces are adapted depending on the action to be performed and the estimated features for the object. The presented approach tries to imitate the behavior of human beings, in which the applied forces by the fingers are changed when the human estimates the rigidity of a body and when the fingers react to unexpected movements of the object to keep the contact points.


Tactile sensing In-hand learning In-hand manipulation Contact maintenance 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Yoshikawa T (2010) Multifingered robot hands: control for grasping and manipulation. Annu Rev Control 34(2):199–208CrossRefGoogle Scholar
  2. 2.
    Huang JL, Clement R, Sun ZH, Wang J, Zhang WJ (2012) Global stiffness and natural frequency analysis of compliant mechanisms with embedded actuators with a general-purpose finite element system. Int J Adv Manuf Technol. doi: 10.1007/s00170-012-4243-8 Google Scholar
  3. 3.
    Khalil FF, Payeur P (2010) Dexterous robotic manipulation of deformable objects with multi-sensory feedback—a review. Robot Manipulators Trends and Development, Agustin Jimenez and Basil M Al Hadithi (Ed.), ISBN: 978–953–307-073-5, InTech, DOI:  10.5772/9183
  4. 4.
    Luo Y, Nelson BJ (2001) Fusing force and vision feedback for manipulating deformable objects. J Robot Syst 18(3):103–117CrossRefzbMATHGoogle Scholar
  5. 5.
    Bimbo J, Seneviratne L, Althoefer K, Liu H (2013) Combining touch and vision for the estimation of an object’s pose during manipulation. In Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), Tokyo, 2013, pp. 4021–4026Google Scholar
  6. 6.
    Khalil FF, Payeur P, Cretu AM (2010) Integrated multisensory robotic hand system for deformable object manipulation. Proc. Int. Conf. Robotics and Applications, pp. 159–166, Cambridge, Massachusetts, US, Nov. 2010Google Scholar
  7. 7.
    Li Q, Elbrechter C, Haschke R, Ritter H (2013) Integrating vision, haptics and proprioception into a feedback controller for in-hand manipulation of unknown objects. Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS), Tokyo, 2013, pp. 2466–2471Google Scholar
  8. 8.
    Khalil FF, Curtis P, Payeur P (2010) Visual monitoring of surface deformations on objects manipulated with a robotic hand. Robotic and Sensors Environments (ROSE). In Proc. 2010 I.E. International Workshop, on vol., no., pp.1, 6, 15–16 Oct. 2010 doi:  10.1109/ROSE.2010.5675327
  9. 9.
    Corrales JA, Torres F, Perdereau V (2013) Finger readjustment algorithm for object manipulation based on tactile information. Int J Adv Robot Syst 10(9). doi: 10.5772/53561. 2013
  10. 10.
    Kien-Cuong N, Perdereau V (2013) Fingertip force control based on max torque adjustment for dexterous manipulation of an anthropomorphic hand. Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference on vol., no., pp. 3557–3563, 3–7 Nov. 2013Google Scholar
  11. 11.
    Han L, Trinkle J (1998) Dexterous manipulation by rolling and finger gaiting. In IEEE International Conference on Robotics and Automation, Leuven, Belgium, 1998; pp. 730–735Google Scholar
  12. 12.
    Romano JM, Hsiao K, Niemeyer G, Chitta S, Kuchenbecker KJ (2011) Human-inspired robotic grasp control with tactile sensing. IEEE Trans Robot. doi: 10.1109/TRO.2011.2162271 Google Scholar
  13. 13.
    Cutkosky MR, Hyde JM (1993) Manipulation control with dynamic tactile sensing. In International Symposium on Robotics ResearchGoogle Scholar
  14. 14.
    Dang H, Weisz J, Allen PK (2011) Blind grasping: stable robotic grasping using tactile feedback and hand kinematics. In Proceedings-IEEE International Conference on Robotics and Automation. doi: 10.1109/ICRA.2011.5979679 Google Scholar
  15. 15.
    Howe RD (1994) Tactile sensing and control of robotic manipulation. J Adv Robot 8(3):245–261CrossRefGoogle Scholar
  16. 16.
    Yousef H, Boukallel M, Althoefer K (2011) Tactile sensing for dexterous in-hand manipulation in robotics—a review. Sensors Actuators A: Physical 167(2):171–187CrossRefGoogle Scholar
  17. 17.
    Wettels N, Loeb GE (2011) Haptic feature extraction from a biomimetic tactile sensor: force, contact location and curvature. In 2011 I.E. International Conference on Robotics and Biomimetics, ROBIO 2011. doi: 10.1109/ROBIO.2011.6181676
  18. 18.
    Liu H, Song X, Nanayakkara T, Seneviratne LD, Althoefer K (2012) A computationally fast algorithm for local contact shape and pose classification using a tactile array sensor. In Proceedings-IEEE International Conference on Robotics and Automation (pp. 1410–1415)Google Scholar
  19. 19.
    Chitta S, Sturm J, Piccoli M, Burgard W Tactile sensing for mobile manipulation. IEEE Trans Robot 27(3):558–568Google Scholar
  20. 20.
    Li Q, Schürmann C, Haschke R, Ritter H (2013) A control framework for tactile servoing. Proceedings of Robotics: Science and SystemsGoogle Scholar
  21. 21.
    Shadow Robot, “Dexterous Hand”. [Online]. Available:
  22. 22.
    Tactile Sensor Tekscan. [Online]. Available:

Copyright information

© Springer-Verlag London 2017

Authors and Affiliations

  • Angel Delgado
    • 1
    Email author
  • Carlos A. Jara
    • 2
  • Fernando Torres
    • 2
  1. 1.University Institute of Computer Research, University of AlicanteAlicanteSpain
  2. 2.Physics, Systems Engineering and Signal Theory DepartmentUniversity of AlicanteAlicanteSpain

Personalised recommendations