Advertisement

Experimental Brain Research

, Volume 225, Issue 2, pp 159–176 | Cite as

Expression of emotion in the kinematics of locomotion

  • Avi BarliyaEmail author
  • Lars Omlor
  • Martin A. Giese
  • Alain Berthoz
  • Tamar Flash
Research Article

Abstract

Here, we examine how different emotions—happiness, fear, sadness and anger—affect the kinematics of locomotion. We focus on a compact representation of locomotion properties using the intersegmental law of coordination (Borghese et al. in J Physiol 494(3):863–879, 1996), which states that, during the gait cycle of human locomotion, the elevation angles of the thigh, shank and foot do not evolve independently of each other but form a planar pattern of co-variation. This phenomenon is highly robust and has been extensively studied. The orientation of the plane has been correlated with changes in the speed of locomotion and with reduction in energy expenditure as speed increases. An analytical model explaining the conditions underlying the emergence of this plane and predicting its orientation reveals that it suffices to examine the amplitudes of the elevation angles of the different segments along with the phase shifts between them (Barliya et al. in Exp Brain Res 193:371–385, 2009). We thus investigated the influence of different emotions on the parameters directly determining the orientation of the intersegmental plane and on the angular rotation profiles of the leg segments, examining both the effect of changes in walking speed and effects independent of speed. Subjects were professional actors and naïve subjects with no training in acting. As expected, emotions were found to strongly affect the kinematics of locomotion, particularly walking speed. The intersegmental coordination patterns revealed that emotional expression caused additional modifications to the locomotion patterns that could not be explained solely by a change in speed. For all emotions except sadness, the amplitude of thigh elevation angles changed from those in neutral locomotion. The intersegmental plane was also differently oriented, especially during anger. We suggest that, while speed is the dominant variable allowing discrimination between different emotional gaits, emotion can be reliably recognized in locomotion only when speed is considered together with these kinematic changes.

Keywords

Emotion Locomotion Intersegmental coordination 

Notes

Acknowledgments

This study was partly supported by the grant EU FP6-NEST to Tamar Flash, Martin Giese and Alain Berthoz, by FP7 TANGO to Martin Giese and Tamar Flash, by the EC FP7 project AMARSI and the DFG for Martin Giese and the French NEUROPACT project support given to laboratoire de Physiologie de la Perception et de l’Action UMR7152 CNRS/Collge de France. We thank Claire Roether and Halim Hicheur for data acquisition and Winfried Ilg for help with the motion capture. We thank Dr. Jenny Kien for editorial assistance. Tamar Flash is an incumbent of the Dr. Hymie Morros professorial chair.

References

  1. Amaya K, Bruderlin A, Calvert T (1996) Emotion from motion. In: Graphics interface 96, pp 222–229Google Scholar
  2. Atkinson AP, Dittrich WH, Gemmell AJ, Young AW (2004) Emotion perception from dynamic and static body expressions in point-light and full-light displays. Perception 33:717–746PubMedCrossRefGoogle Scholar
  3. Barliya A, Omlor L, Giese MA, Flash T (2009) An analytical formulation to the law of intersegmental coordination. Exp Brain Res 193(3):371–385PubMedCrossRefGoogle Scholar
  4. Bianchi L, Angelini D, Orani G, Lacquaniti F (1998) Kinematic coordination in human gait: relation to mechanical energy cost. J Neurophysiol 79:2155–2170PubMedGoogle Scholar
  5. Borghese N, Bianchi L, Lacquaniti F (1996) Kinematic determinants of human locomotion. J Physiol 494(3):863–879PubMedGoogle Scholar
  6. Bruderlin A, Williams L (1995) Motion signal processing. In: SIGGRAPH’95, pp 97–104Google Scholar
  7. Burke RE, Degtyarenko AM, Simon ES (2001) Patterns of locomotor drive to motoneurons and last-order interneurons: clues to the structure of the CPG. J Neurophysiol 86:447–462PubMedGoogle Scholar
  8. Cheron G, Bouillot E, Dan B, Bengoetxea A, Draye JP, Lacquaniti F (2001) Development of a kinetic coordination pattern in toddler locomotion: planar covariation. Exp Brain Res 137:455–466PubMedCrossRefGoogle Scholar
  9. Cluss M (2006) Effect of emotion on the kinematics of gait. American Society of Biomechanics, Blacksburg, VAGoogle Scholar
  10. Courtine G, Schiepati M (2004) Tuning of basic coordination pattern constructs straight-ahead and curved walking in humans. J Neurophysiol 91:1524–1535PubMedCrossRefGoogle Scholar
  11. Crane E, Gross M (2007) Motion capture and emotion: affect detection in whole body movement. In: Affective computing and intelligent interaction, vol 4738/2007. Springer, Berlin, pp 95–101Google Scholar
  12. Degtyarenko M, McCrea DA (2005) Deletions of rhythmic motoneurons activity during fictive locomotion and scratch provide clues to the organization of the mammalian central pattern generator. J Neurophysiol 94:1120–1132CrossRefGoogle Scholar
  13. Descrates R (1649) Les Passions de l’âme. A series for the classics of philosophy. Resling Publishing, 2007, Hebrew translation. Translated from French by Ido BassokGoogle Scholar
  14. Dittrich WH, Troscianko T, Lea S, Morgan D (1996) Perception of emotion from dynamic point-light displays represented in dance. Perception 25(6):727–738PubMedCrossRefGoogle Scholar
  15. Donker SF, Beek PJ, Wagenaar RC, Mulder T (2001) Coordination between arm and leg movements during locomotion. J Mot Behav 33(1):86–102PubMedCrossRefGoogle Scholar
  16. Donker SF, Mulder T, Nienhuis B, Duysens J (2002) Adaptations in arm movements for added mass to wrist or ankle during walking. Exp Brain Res 146(1):26–31PubMedCrossRefGoogle Scholar
  17. Fisher RA (1921) On the probable error of a coefficient of correlation deduced from a small sample. Metron 1:3–32Google Scholar
  18. Giese MA, Poggio T (2000) Morphable models for the analysis and synthesis of complex motion patterns. Int J Comput Vis 38(1):59–73CrossRefGoogle Scholar
  19. Grillner S (1981) Control of locomotion in bipeds, tetrapods, and fish. In: Brooks VB (ed) Handbook of physiology: the nervous system, vol 2, motor control. American Physiology Society, Bethesda, pp 1176–1263Google Scholar
  20. Grillner S (1996) Neural networks for vertebrate locomotion. Scientific American, pp 64–69Google Scholar
  21. Grillner S, Georgopoulos AP, Jordan LM (1997) Selection and initiation of motor behavior. MIT Press, BostonGoogle Scholar
  22. Gross M, Crane E, Fredrickson B (2007) Effect of felt and recognized emotions on gait kinematics. In: American Society of Biomechanics conference, ASB, Palo Alto, CAGoogle Scholar
  23. Gross MM, Crane EA, Fredrickson BL (2011) Effort-shape and kinematic assessment of bodily expression of emotion during gait. Hum Mov Sci. doi: 10.1016/j.humov.2011.05.001
  24. Hicheur H, Kadone H, Grèzes J, Berthoz A (unpublished) The combined role of motion-related cues and upper body posture for both the expression and the perception of emotions during human walkingGoogle Scholar
  25. Hill H, Pollick FE (2000) Exaggerating temporal differences enhances recognition of individuals from point-light displays. Psychol Sci 11:223–228PubMedCrossRefGoogle Scholar
  26. Hreljac A (1995) Determinants of the gait transition speed during human locomotion: kinematic factors. J Biomech 28(6):669–677PubMedCrossRefGoogle Scholar
  27. Ivanenko Y, Grasso R, Macellari V, Lacquaniti F (2002) Control of foot trajectory in human locomotion: role of ground contact forces in simultaed reduced gravity. J Neurophysiol 87:3070–3089PubMedGoogle Scholar
  28. Ivanenko YP, Cappelini G, Dominici N, Poppele RE, Lacquaniti F (2005a) Coordination of locomotion with voluntary movements in humans. J Neurosci 25(31):7238–7253PubMedCrossRefGoogle Scholar
  29. Ivanenko YP, Dominici N, Cappellini G, Lacquaniti F (2005b) Kinematics in newly walking toddlers does not depend upon postural stability. J Neurophysiol 94:754–763PubMedCrossRefGoogle Scholar
  30. Ivanenko YP, d’Avella A, Poppele RE, Lacquaniti F (2008) On the origin of planar covariation of elevation angles during human locomotion. J Neurophysiol 99(4):1890–1898PubMedCrossRefGoogle Scholar
  31. Kiehn O (2006) Locomotor circuits in the mammalian spinal cord. Annu Rev Neurosci 29:279–306PubMedCrossRefGoogle Scholar
  32. Kirtley C (2006) Clinical gait analysis: theory and practice, Chap 3. Churchill Livingstone, p 60Google Scholar
  33. Kriellaars DJ, Brownstone RM, Noga BR, Jordan LM (1994) Mechanical entrainment of fictive locomotion in the decerebrate cat. J Neurophysiol 71:2074–2086PubMedGoogle Scholar
  34. Lacquaniti F, Grasso R, Zago M (1999) Motor patterns in walking. News Physiol Sci 14:168–174PubMedGoogle Scholar
  35. Michalak J, Troje NF, Fischer J, Vollmar P, Heidenreich T, Schulte D (2009) Embodiment of sadness and depression—gait patterns associated with dysphoric mood. Pyschosom Med 71:580–587CrossRefGoogle Scholar
  36. Montepare JM, Goldstein SB, Clausen A (1987) The identification of emotions from gain information. J Nonverbal Behav 11(1):33–42CrossRefGoogle Scholar
  37. Naugle KM, Joyner J, Hass CJ, Janelle CM (2010) Emotional influences on locomotor behavior. J Biomech 43:3099–3103PubMedCrossRefGoogle Scholar
  38. Omlor L, Giese MA (2007) Extraction of spatio-temporal primitives of emotional body expressions. Neurocomputing 70(10–12):1938–1942CrossRefGoogle Scholar
  39. Paterson HM, Pollick FE, Sanford AJ (2001) The role of velocity in affect discrimination. In: Proceedings of the 23rd annual conference of the Cognitive Science Society, Edinburgh, pp 756–761Google Scholar
  40. Pollick FE, Fidopiastis C, Braden V (2001a) Recognising the style of spatially exaggerated tennis serves. Perception 30:323–338PubMedCrossRefGoogle Scholar
  41. Pollick FE, Paterson HM, Bruderlin A, Sanford AJ (2001b) Perceiving affect from arm movement. Cognition 82:B51–B56PubMedCrossRefGoogle Scholar
  42. Pollick FE, Hill H, Calder A (2003) Recognising facial expression from spatially and temporally modified movements. Perception 32:813–826PubMedCrossRefGoogle Scholar
  43. Posner J, Russel JA, Peterson B (2005) The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev Psychopathol 17(3):715–734PubMedCrossRefGoogle Scholar
  44. Roether CL, Omlor L, Christensen A, Giese MA (2009) Critical features for the perception of emotion from gait. J Vis 9(6)(15):1–32PubMedGoogle Scholar
  45. Roether CL, Omlor L, Giese MA (2010) Features in the recognition of emotions from dynamic bodily expression. In: Ilg UJ, Masson GS (eds) Dynamics of visual motion processing. Springer, Berlin, pp 313–340Google Scholar
  46. Russell JA (1980) A circumplex model of affect. J Pers Soc Psychol 39:1161–1178CrossRefGoogle Scholar
  47. Russell JA, Carroll JM (1999) On the bipolarity of positive and negative affect. Psychol Bull 125:3–30CrossRefGoogle Scholar
  48. Russell JA, Fehr B (1994) Fuzzy concepts in a fuzzy hierarchy: varieties of anger. J Pers Soc Psychol 67:186–205PubMedCrossRefGoogle Scholar
  49. Sawada M, Suda K, Ishii M (2003) Expression of emotions in dance: relation between arm movement characteristics and emotion. Percept Motor Skills 97(1 Pt. 3):697–708PubMedGoogle Scholar
  50. Scherer KR (2000) Psychological models of emotion, Chap 6. Oxford University Press, Oxford, pp 137–162Google Scholar
  51. Takakusaki K, Saitoh K, Harad H, Kashiwayanagi M (2004) Role of basal ganglia-brainstem pathways in the control of motor behaviors. Neurosci Res 50:137–151PubMedCrossRefGoogle Scholar
  52. Troje NF (2002) Decomposing biological motion: a framework for analysis and synthesis of human gait patterns. J Vis 2:371–387PubMedCrossRefGoogle Scholar
  53. Unuma M, Anjyo K, Takeuchi R (1995) Fourier principles for emotion-based human figure animation. In: Proceedings of the 22nd annual conference on computer graphics and interactive techniques, SIGGRAPH’95, ACM, pp 91–96Google Scholar
  54. Vaughan CL, Davis BL, O’Connor JC (1999) Dynamics of human gait, 2nd edn. Kiboho Publishers, Cape TownGoogle Scholar
  55. Walk R, Homan C (1984) Emotion and dance in dynamic light displays. Bull Psychon Soc 22(5):437–440Google Scholar
  56. Wallbott HG (1998) Bodily expression of emotion. Eur J Soc Psychol 28(6):879–896CrossRefGoogle Scholar
  57. Westermann R, Spies K, Stahl G, Hesse FW (1996) Relative effectiveness and validity of mood induction procedures: a meta-analysis. Eur J Soc Psychol 26:557–580CrossRefGoogle Scholar
  58. Yacoob Y, Black MJ (1999) Parameterized modelling and recognition of activities. Comput Vis Image Underst 73(2):232–247CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Avi Barliya
    • 1
    Email author
  • Lars Omlor
    • 2
  • Martin A. Giese
    • 2
  • Alain Berthoz
    • 3
  • Tamar Flash
    • 1
  1. 1.Department of Applied Mathematics and Computer ScienceWeizmann Institute of ScienceRehovotIsrael
  2. 2.Section for Computational Sensomotorics, Department of Cognitive Neurology, Centre for Integrative Neuroscience, Hertie Institute for Clinical Brain Research University Clinic TübingenTübingenGermany
  3. 3.Laboratoire de Physiologie de la Perception et de l’ActionCollege de FranceParis France

Personalised recommendations