Skip to main content

Dexterous Manipulation: From High-Level Representation to Low-Level Coordination of Digit Forces and Positions

  • Chapter
  • First Online:
Human and Robot Hands

Part of the book series: Springer Series on Touch and Haptic Systems ((SSTHS))

  • 1624 Accesses

Abstract

The ability to perform fine object and tool manipulation, a hallmark of human dexterity, is not well understood. We have been studying how humans learn anticipatory control of manipulation tasks to characterize the mechanisms underlying the transformation from multiple sources of sensory feedback to the coordination of multiple degrees of freedom of the hand. In our approach, we have removed constraints on digit placement to study how subjects explore and choose relations between digit forces and positions. It was found that the digit positions were characterized by high trial-to-trial variability, thus challenging the extent to which the Central Nervous System (CNS) could have relied on sensorimotor memories built through previous manipulations for anticipatory control of digit forces. Importantly, subjects could adjust digit forces prior to the onset of manipulation to compensate for digit placement variability, thus leading to consistent outcome at the task level. Furthermore, we found that manipulation learned with a set of digits can be transferred to grips involving a different number of digits, despite the significant change in digit placement distribution. These results have led us to propose a theoretical framework based on high-level representation of manipulation tasks can be learned in an effector-independent fashion and transferred to some, but not all that contexts. We discuss these findings in relation to the concept of motor equivalence and sensorimotor integration of grasp kinematics and kinetics.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Bernstein NA (1967) The co-ordination and regulation of movement. Pergamon Press, Oxford

    Google Scholar 

  2. Cohen RG, Rosenbaum DA (2004) Where grasps are made reveals how grasps are planned: generation and recall of motor plans. Exp Brain Res 157(4):486–495

    Article  Google Scholar 

  3. Ansuini C, Santello M, Massaccesi S, Castiello U (2006) Effects of end-goal on hand shaping. J Neurophysiol 95(4):2456–2465

    Article  Google Scholar 

  4. Lukos JR, Ansuini C, Santello M (2007) Choice of contact points during multidigit grasping: effect of predictability of object center of mass location. J Neurosci 27(14):3894–3903

    Article  Google Scholar 

  5. Lukos JR, Ansuini C, Santello M (2008) Anticipatory control of grasping: independence of sensorimotor memories for kinematics and kinetics. J Neurosci 28(48):12765–12774

    Article  Google Scholar 

  6. Johansson RS, Westling G (1984) Roles of glabrous skin receptors and sensorimotor memory in automatic control of precision grip when lifting rougher or more slippery objects. Exp Brain Res 56(3):550–564

    Article  Google Scholar 

  7. Johansson RS, Westling G (1988) Coordinated isometric muscle commands adequately and erroneously programmed for the weight during lifting task with precision grip. Exp Brain Res 71:59–71

    Google Scholar 

  8. Jenmalm P, Johansson RS (1997) Visual and somatosensory information about object shape control manipulative fingertip forces. J Neurosci 17(11):4486–4499

    Google Scholar 

  9. Santello M, Soechting JF (2000) Force synergies for multifingered grasping. Exp Brain Res. 133(4):457–467

    Article  Google Scholar 

  10. Zatsiorsky VM, Latash ML (2004) Prehension synergies. Exerc Sport Sci Rev 32(2):75–80

    Article  Google Scholar 

  11. Faisal A, Selen LPJ, Wolpert DM (2008) Noise in the nervous system. Nat Rev Neurosci 9(4):292–303

    Article  Google Scholar 

  12. Johansson RS, Flanagan JR (2009) Coding and use of tactile signals from the fingertips in object manipulation tasks. Nat Rev Neurosci 10(5):345–359

    Article  Google Scholar 

  13. Fu Q, Zhang W, Santello M (2010) Anticipatory planning and control of grasp positions and forces for dexterous two-digit manipulation. J Neurosci 30(27):9117–9126

    Article  Google Scholar 

  14. Fu Q, Hasan Z, Santello M (2011) Transfer of learned manipulation following changes in degrees of freedom. J Neurosci 31(38):13527–13534

    Article  Google Scholar 

  15. Zhang W, Gordon AM, Fu Q, Santello M (2010) Manipulation after object rotation reveals independent sensorimotor memory representations of digit positions and forces. J Neurophysiol 2953–2964

    Google Scholar 

  16. Santello M, Flanders M, Soechting JF (1998) Postural hand synergies for tool use. J Neurosci 18(23):10105–10115

    Google Scholar 

  17. Santello M, Flanders M, Soechting JF (2002) Patterns of hand motion during grasping and the influence of sensory guidance. J Neurosci 22(4):1426–1435

    Google Scholar 

  18. Santello M, Baud-Bovy G, Jörntell H (2013) Neural bases of hand synergies. Front Comput Neurosci 7:23

    Google Scholar 

  19. Fu Q, Santello M (2014) Coordination between digit forces and positions: interactions between anticipatory and feedback control. J Neurophysiol 111(7):1519–1528

    Article  Google Scholar 

  20. Shibata D, Choi JY, Laitano JC, Santello M (2013) Haptic-motor transformations for the control of finger position. PLoS One 8(6):e66140

    Article  Google Scholar 

  21. Mojtahedi K, Fu Q, Santello M (2015) Extraction of time and frequency features from grip force rates during dexterous manipulation. IEEE Trans Biomed Eng 62(5):1363–1375

    Article  Google Scholar 

  22. Lashley KS (1930) Basic neural mechanisms in behavior. Psychol Rev 37:1–24

    Article  Google Scholar 

  23. Cole KJ, Abbs JH (1986) Coordination of three-joint digit movements for rapid finger-thumb grasp. J Neurophysiol 55(6):1407–1423

    Google Scholar 

  24. Rijntjes M, Dettmers C, Büchel C, Kiebel S, Frackowiak RSJ, Weiller C (1999) A blueprint for movement: functional and anatomical representations in the human motor system. J Neurosci 19(18):8043–8048

    Google Scholar 

  25. Wing AM (2000) Motor control: Mechanisms of motor equivalence in handwriting. Curr Biol 10(6):245–248

    Article  Google Scholar 

  26. Bursztyn LLCD, Flanagan JR (2008) Sensorimotor memory of weight asymmetry in object manipulation. Exp Brain Res 184(1):127–133

    Article  Google Scholar 

  27. Fu Q, Santello M (2012) Context-dependent learning interferes with visuomotor transformations for manipulation planning. J Neurosci 32(43):15086–15092

    Article  Google Scholar 

  28. Fu Q, Santello M (2015) Retention and interference of learned dexterous manipulation: interaction between multiple sensorimotor processes. J Neurophysiol 113(1):144–155

    Article  Google Scholar 

  29. Ingram JN, Howard IS, Flanagan JR, Wolpert DM (2011) A single-rate context-dependent learning process underlies rapid adaptation to familiar object dynamics. PLOS Comput Biol 7(9):e1002196

    Article  MathSciNet  Google Scholar 

  30. Davare M, Kraskov A, Rothwell JC, Lemon RN (2011) Interactions between areas of the cortical grasping network. Curr Opin Neurobiol 21(4):565–570

    Article  Google Scholar 

Download references

Acknowledgments

This work was made possible by a National Science Foundation grant BCS-1153034 “Collaborative Research: Sensory Integration and Sensorimotor Transformations for Dexterous Manipulation”.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marco Santello .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2016 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Fu, Q., Santello, M. (2016). Dexterous Manipulation: From High-Level Representation to Low-Level Coordination of Digit Forces and Positions. In: Bianchi, M., Moscatelli, A. (eds) Human and Robot Hands. Springer Series on Touch and Haptic Systems. Springer, Cham. https://doi.org/10.1007/978-3-319-26706-7_2

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-26706-7_2

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-26705-0

  • Online ISBN: 978-3-319-26706-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics