The Influence of Social Interaction on the Perception of Emotional Expression: A Case Study with a Robot Head

  • John C. Murray
  • Lola Cañamero
  • Kim A. Bard
  • Marina Davila Ross
  • Kate Thorsteinsson
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5744)


In this paper we focus primarily on the influence that socio-emotional interaction has on the perception of emotional expression by a robot. We also investigate and discuss the importance of emotion expression in socially interactive situations involving human robot interaction (HRI), and show the importance of utilising emotion expression when dealing with interactive robots, that are to learn and develop in socially situated environments. We discuss early expressional development and the function of emotion in communication in humans and how this can improve HRI communications. Finally we provide experimental results showing how emotion-rich interaction via emotion expression can affect the HRI process by providing additional information.


Robotics HRI Emotion Expression Social Interaction 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bard, K.A.: Emotions in chimpanzee infants: the value of a comparative developmental approach to understand the evolutionary bases of emotion. In: In. J. Nadel and E. Muir. Emotional Development: Recent Research Advances, pp. 31–60. Oxford University press, Oxford (2005)Google Scholar
  2. 2.
    Cañamero, L.D., Fredslund, J.: I show You How I like You-Can You Read it in My Face? IEEE Transactions on Systems, Man and Cybernetics, Part A 31(5), 454–459 (2001)CrossRefGoogle Scholar
  3. 3.
    Ekman, P., Friesen, W.V.: Facial action coding system: Investigator’s guide. Consulting Psychologists Press, Palo Atto (1978)Google Scholar
  4. 4.
    Fogel, A.: Infancy: Infant, Family, and Society, 4th edn. Wadsworth, Belmont (2001)Google Scholar
  5. 5.
    Greenfield, P.M.: Playing Peekaboo with a 4-Month-Old - Study of Role of Speech and Nonspeech Sounds in Formation of a Visual Schema. Journal of Psychology 82(2), 287–292 (1972)CrossRefGoogle Scholar
  6. 6.
    Hatfield, E., Cacioppo, J.T., Rapson, R.L.: Emotional Contagion. Cambridge University Press, Cambridge (1994)Google Scholar
  7. 7.
    Johnson-Laird, P.N.: A computational analysis of consciousness. Cognition and Brain Theory 6, 499–508 (1983)Google Scholar
  8. 8.
    Keller, H.: Cultures of Infancy. Erlbaum, Mahwah (2007)Google Scholar
  9. 9.
    Lewis, M., Alessandri, S., Sullivan, M.W.: Violation of expectancy, loss of control, and anger in young infants. Developmental Psychology 26, 745–751 (1990)CrossRefGoogle Scholar
  10. 10.
    Mizuno, Y., Takeshita, H., Matsuzawa, T.: Behavior of Infant Chimpanzees during the night in the first 4 months of life: Smiling and suckling in relation to behavioural state. Infancy 9(2), 221–240 (2006)CrossRefGoogle Scholar
  11. 11.
    Murray, J.C., Wermter, S., Knowles, M.: MIRA: A Learning Interactive Robot Agent. In: Proceedings of the IEEE Conference on Hybrid Intelligent Systems, HIS 2008, Barcelona, Spain (2008)Google Scholar
  12. 12.
    Oatley, K., Manstead, A.S.R.: Best Laid Schemes: The Psychology of the Emotions - Studies in Emotion and Social Interaction, pp. 44–60. Cambridge University Press, Cambridge (1992)Google Scholar
  13. 13.
    Ogino, M., Ooide, T., Watanabe, A., Asada, M.: Acquiring Peekaboo Communication: Early Communication Model Based on Reward Prediction. In: IEEE 6th International Conference on Development and Learning, pp. 116–121 (2007)Google Scholar
  14. 14.
    Oster, H.: The repertoire of infant facial expressions: An ontogenetic perspective. In: Nadel, J., Muir, D. (eds.) Emotional Development. Oxford University Press, OxfordGoogle Scholar
  15. 15.
    Oster, H.: Emotion in the Infant’s face. In: Annals of the New York Academy of Sciences, vol. 1000, Issue Emotions inside out: 130 Years after Darwin’s The Expression of the Emotions in Man and Animals, pp. 197–204 (2006)Google Scholar
  16. 16.
    Otero, N.R., Nehaniv, C.L., Syrdal, D.S., Dautenhahn, K.: Naturally Occurring Gestures in a Human-Robot Teaching Scenario, Interaction Studies (In Press) (2008)Google Scholar
  17. 17.
    Owens, R.E.: Language Development: An introduction, 3rd edn. Merrill, New York (2001)Google Scholar
  18. 18.
    Pannabecker, B.J., Emde, R.N., Johnson, W., Stenberg, C., David, M.: Maternal Perceptions of infant emotions from birth to 18 months: A preliminary report. In: Paper presented at the International Conference of Infant Studies, New Haven, CT (1980)Google Scholar
  19. 19.
    Rochat, P., Querido, J.G., Striano, T.: Emerging Sensitivity to the Timing and Structure of Protoconversation in Early Infancy. Developmental Psychology 35(4), 950–957 (1999)CrossRefGoogle Scholar
  20. 20.
    Steiner, J.E., Glaser, D., Hawilo, M.E., Berridge, K.: Comparative Expression of Hedonic Impact: Affective Reactions to Taste by Human Infants and Other Primates. Neuroscience and Biobehavioral Reviews 25, 53–74 (2001)CrossRefGoogle Scholar
  21. 21.
    Trevarthen, C., Aitken, K.J.: Infant intersubjectivity: Research, theory, and clinical applications. Journal of Child Psychology and Psychiatry and Allied Disciplines 42(1), 3–48 (2001)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • John C. Murray
    • 1
  • Lola Cañamero
    • 1
  • Kim A. Bard
    • 2
  • Marina Davila Ross
    • 2
  • Kate Thorsteinsson
    • 2
  1. 1.Adaptive Systems Research GroupUniversity of HertfordshireHatfieldUK
  2. 2.Centre for the Study of Emotion, Department of PsychologyUniversity of PortsmouthUK

Personalised recommendations