Unsupervised Learning of Spatio-temporal Primitives of Emotional Gait

  • Lars Omlor
  • Martin A. Giese
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4021)


Experimental and computational studies suggest that complex motor behavior is based on simpler spatio-temporal primitives. This has been demonstrated by application of dimensionality reduction techniques to signals from electrophysiological and EMG recordings during execution of limb movements. However, the existence of such primitives on the level of kinematics, i.e. the joint trajectories of complex human full-body movements remains less explored. Known blind source separation techniques, e.g. PCA and ICA, tend to extract relatively large numbers of components or source signals from such trajectories that are typically difficult to interpret. For the analysis of emotional human gait patterns, we present a new method for blind source separation that is based on a nonlinear generative model with additional time delays. The resulting model is able to approximate high-dimensional movement trajectories very accurately with very few source components. Combining this method with sparse regression, we identified spatio-temporal primitives for the encoding of individual emotions in gait. We verified that these primitives match features that are important for the perception of emotions from gait in psychophysical studies. This suggests the existence of emotion-specific movement primitives that might be useful for the simulation of emotional behavior in technical applications.


Blind Source Separation Movement Primitive Joint Trajectory Blind Source Separation Algorithm Sparse Regression 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Flash, T., Hochner, B.: Motor primitives in vertebrates and invertebrates. Curr. Opin. Neurobiol. 15(6), 660–666 (2005)CrossRefGoogle Scholar
  2. 2.
    Cichocki, A., Amari, S.: Adaptive blind signal and image processing. John Wiley, Chichester (2002)CrossRefGoogle Scholar
  3. 3.
    Ivanenko, Y., Poppele, R., Lacquaniti, F.: Five basic muscle activation patterns account for muscle activity during human locomotion. J. Physiol. 556(Pt 1), 267–282 (2004)Google Scholar
  4. 4.
    d’Avella, A., Bizzi, E.: Shared and specific muscle synergies in natural motor behaviors. Proc. Natl. Acad. Sci. USA 102(8), 3076–3081 (2005)CrossRefGoogle Scholar
  5. 5.
    Safonova, A., Hodgins, J., Pollard, N.: Synthesizing physically realistic human motion in low-dimensional, behavior-specifc spaces. ACM Trans. Graph. 23(3), 514–521 (2004)CrossRefGoogle Scholar
  6. 6.
    Bofill, P.: Underdetermined blind separation of delayed sound sources in the frequency domain. Neurocomputing 55, 627–641 (2003)CrossRefGoogle Scholar
  7. 7.
    Yeredor, A.: Time-delay estimation in mixtures. Acoustics, Speech, and Signal Processing 5, 237–240 (2003)Google Scholar
  8. 8.
    Højen-Sørensen, P., Winther, O., Hansen, L.: Mean field approaches to independent component analysis. Neural Computation 14, 889–918 (2002)CrossRefGoogle Scholar
  9. 9.
    Torkkola, K.: Blind separation of delayed sources based on information maximization. In: ICASSP 1996, pp. 3509–3512 (1996)Google Scholar
  10. 10.
    Swindelhurst, A.: Time delay and spatial signature estimation using known asynchronous signals. IEEE Trans. on Sig. Proc. ASSP-33(6), 1461–1470 (1998)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Lars Omlor
    • 1
  • Martin A. Giese
    • 1
  1. 1.Laboratory for Action Representation and Learning/Department of Cognitive Neurology, Hertie Institute for Clinical Brain ResearchUniversity of TübingenGermany

Personalised recommendations