Towards Grasping with Spiking Neural Networks for Anthropomorphic Robot Hands

  • J. Camilo Vasquez TieckEmail author
  • Heiko Donat
  • Jacques Kaiser
  • Igor Peric
  • Stefan Ulbrich
  • Arne Roennau
  • Marius Zöllner
  • Rüdiger Dillmann
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10613)


Representation and execution of movement in biology is an active field of research relevant to neurorobotics. Humans can remember grasp motions and modify them during execution based on the shape and the intended interaction with objects. We present a hierarchical spiking neural network with a biologically inspired architecture for representing different grasp motions. We demonstrate the ability of our network to learn from human demonstration using synaptic plasticity on two different exemplary grasp types (pinch and cylinder). We evaluate the performance of the network in simulation and on a real anthropomorphic robotic hand. The network exposes the ability of learning finger coordination and synergies between joints that can be used for grasping.


Grasp motion representation Spiking networks Neurorobotics Motor primitives 



The research leading to these results has received funding from the European Union Horizon 2020 Programme under grant agreement n.720270 (Human Brain Project SGA1).


  1. 1.
    Bernstein, N.A.: The co-ordination and regulation of movements (1967)Google Scholar
  2. 2.
    Bizzi, E., Cheung, V., d’Avella, A., Saltiel, P., Tresch, M.: Combining modules for movement. Brain Res. Rev. 57(1), 125–133 (2008)CrossRefGoogle Scholar
  3. 3.
    Bouganis, A., Shanahan, M.: Training a spiking neural network to control a 4-DoF robotic arm based on spike timing-dependent plasticity. In: IJCNN, pp. 18–23 (2010)Google Scholar
  4. 4.
    Chinellato, E., et al.: The Visual Neuroscience of Robotic Grasping, vol. 28 (2016)Google Scholar
  5. 5.
    Ciocarlie, M.T.: Low-dimensional robotic grasping: Eigengrasp subspaces and optimized underactuation. ProQuest Dissertations and Theses (2010)Google Scholar
  6. 6.
    Cutkosky, M.R.: On grasp choice, grasp models, and the design of hands for manufacturing tasks. IEEE Trans. Robot. Autom. 5(3), 269–279 (1989)CrossRefGoogle Scholar
  7. 7.
    d’Avella, A., Saltiel, P., Bizzi, E.: Combinations of muscle synergies in the construction of a natural motor behavior. Nat. Neurosci. 6(3), 300–308 (2003)CrossRefGoogle Scholar
  8. 8.
    Davison, A.P., Fragnac, Y.: Learning cross-modal spatial transformations through spike timing-dependent plasticity. J. Neurosci. 26(21), 5604–5615 (2006)CrossRefGoogle Scholar
  9. 9.
    Gütig, R., et al.: Learning input correlations through nonlinear temporally asymmetric Hebbian plasticity. J. Neurosci. 23(9), 3697–3714 (2003)Google Scholar
  10. 10.
    Heppner, G.: schunk_svh_driver.
  11. 11.
    Ijspeert, A.J., et al.: Dynamical movement primitives: learning attractor models for motor behaviors. Neural Comput. 25(2), 328–373 (2013)CrossRefzbMATHMathSciNetGoogle Scholar
  12. 12.
    Kaiser, J., et al.: Spiking convolutional deep belief networks. In: ICANN (2017)Google Scholar
  13. 13.
    Kleberg, F., et al.: Excitatory and inhibitory STDP jointly tune feedforward neural circuits to selectively propagate correlated spiking activity. Front Comput. Neurosci. (2014)Google Scholar
  14. 14.
    Maass, W.: Networks of spiking neurons: The third generation of neural network models. Neural Netw. 10(9), 1659–1671 (1997)CrossRefGoogle Scholar
  15. 15.
    Santello, M., Flanders, M., Soechting, J.F.: Postural hand synergies for tool use. J. Neurosci. 18(23), 10105–10115 (1998)Google Scholar
  16. 16.
    Song, S., Miller, K.D., Abbott, L.F.: Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nat. Neurosci. 3(9), 919–926 (2000)CrossRefGoogle Scholar
  17. 17.
    Sridharan, D., et al.: Selective disinhibition: a unified neural mechanism for predictive and post hoc attentional selection. Vision. Res. 116, 194–209 (2015)CrossRefGoogle Scholar
  18. 18.
    Srinivasa, N., et al.: Self-organizing spiking neural model for learning fault-tolerant spatio-motor transformations. IEEE Trans. Neural Netw. Learn. Syst. (2012)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • J. Camilo Vasquez Tieck
    • 1
    Email author
  • Heiko Donat
    • 1
  • Jacques Kaiser
    • 1
  • Igor Peric
    • 1
  • Stefan Ulbrich
    • 1
  • Arne Roennau
    • 1
  • Marius Zöllner
    • 1
  • Rüdiger Dillmann
    • 1
  1. 1.FZI Research Center for Information TechnologyKarlsruheGermany

Personalised recommendations