Regulating Emotion by Facial Feedback from Teleoperated Android Robot

  • Shuichi Nishio
  • Koichi Taura
  • Hiroshi Ishiguro
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7621)


In this paper, we experimentally examined whether facial expression changes in teleoperated androids can affect and regulate operators’ emotion, based on the facial feedback theory of emotion and the body ownership transfer phenomena to teleoperated android robot. We created a conversational situation where participants felt anger and, during the conversation, the android’s facial expressions were automatically changed. We examined whether such changes affected the operator emotions. As a result, we found that when one can well operate the robot, the operator’s emotional states are affected by the android’s facial expression changes.


Facial Expression Emotion Regulation Service Representative Rubber Hand Illusion Summary Sheet 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Botherel, V., Maffiolo, V.: Regulation of emotional attitudes for a better interaction: field study in call centres. In: Proc. 20th International Symposium of Human Factors in Telecommunication (March 2006)Google Scholar
  2. 2.
    Botvinick, M.: Rubber hands ’feel’ touch that eyes see. Nature 391(6669), 756 (1998)CrossRefGoogle Scholar
  3. 3.
    Gross, J.J.: Emotion regulation: Affective, cognitive, and social consequences. Psychophysiology 39, 281–291 (2002)CrossRefGoogle Scholar
  4. 4.
    Hatfield, E., Cacioppo, J.T., Rapson, R.L.: Emotional contagion. Current Directions in Psychological Science 2(3), 96–99 (1993)CrossRefGoogle Scholar
  5. 5.
    Kleinke, C., Peterson, T., Rutledge, T.: Effects of self-generated facial expressions on mood. Journal of Personality and Social Psychology 74, 272–279 (1998)CrossRefGoogle Scholar
  6. 6.
    MacIntosh, D.: Facial feedbck hypotheses: Evidence, implications, and directions. Motivation and Emotion 20, 121–147 (1996)CrossRefGoogle Scholar
  7. 7.
    Nakanishi, H.: Freewalk: A social interaction platform for group behaviour in a virtual space. International Journal of Human-Computer Studies 60(4), 421–454 (2004)CrossRefGoogle Scholar
  8. 8.
    Nishio, S., Ishiguro, H., Hagita, N.: Geminoid: Teleoperated android of an existing person. In: de Pina Filho, A.C. (ed.) Humanoid Robots: New Developments, pp. 343–352. I-Tech Education and Publishing, Vienna (2007)Google Scholar
  9. 9.
    Nishio, S., Watanabe, T., Ogawa, K., Ishiguro, H.: Body Ownership Transfer to Teleoperated Android Robot. In: Ge, S.S., Khatib, O., Cabibihan, J.-J., Simmons, R., Williams, M.-A. (eds.) ICSR 2012. LNCS (LNAI), vol. 7621, pp. 398–407. Springer, Heidelberg (2012)Google Scholar
  10. 10.
    Ogawa, T., Monchi, R., Kikuya, M., Suzuki, N.: Development of the general affect scales. The Japanese Journal of Psychology 71(3), 241–246 (2000) (in Japanese)CrossRefGoogle Scholar
  11. 11.
    Soussignan, R.: Duchenne smile, emotional experience, and autonomic reactivity: A test of the facial feedback hypothesis. Emotion 2, 52–74 (2002)CrossRefGoogle Scholar
  12. 12.
    Strack, F., Martin, L., Stepper, S.: Inhibiting and facilitating conditions of the human smile: a nonobtrusive test of the facial feedback hypothesis. Journal of personality and social psychology 54, 768–777 (1988)CrossRefGoogle Scholar
  13. 13.
    Zeng, Z., Pantic, M., Roisman, G.I., Huang, T.S.: A survey of affect recognition methods: audio, visual and spontaneous expressions. In: Proc. 9th International Conference on Multimodal Interfaces, pp. 126–133 (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Shuichi Nishio
    • 1
  • Koichi Taura
    • 1
    • 2
  • Hiroshi Ishiguro
    • 1
    • 2
  1. 1.Hiroshi Ishiguro Laboratory, Advanced Telecommunications Research Institute InternationalKeihanna Science CityJapan
  2. 2.Graduate School of Engineering ScienceOsaka UniversityToyonakaJapan

Personalised recommendations