Innovative Real-Time Communication System with Rich Emotional and Haptic Channels

  • Dzmitry Tsetserukou
  • Alena Neviarouskaya
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6191)


The paper focuses on a novel system iFeel_IM! that integrates 3D virtual world Second Life, intelligent component for automatic emotion recognition from text messages, and innovative affective haptic interfaces providing additional nonverbal communication channels through simulation of emotional feedback and social touch (physical co-presence). The core component, Affect Analysis Model, automatically recognizes nine emotions from text. The detected emotion is stimulated by innovative haptic devices integrated into iFeel_IM!. Users can not only exchange messages but also emotionally and physically feel the presence of the communication partner (e.g., family member, friend, or beloved person).


Affective Haptics haptic display tactile display haptic communication online communication Instant Messaging 3D world 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Chang, A., O’Modhrain, S., Jacob, R., Gunther, E., Ishii, H.: ComTouch: Design of a Vibrotactile Communication Device. In: Conference on Designing of Interactive Systems, pp. 312–320. ACM Press, New York (2002)Google Scholar
  2. 2.
    Rovers, A.F., Van Essen, H.A.: HIM: a Framework for Haptic Instant Messaging. In: ACM Conference on Human factors in Computing Systems, pp. 1313–1316. ACM Press, New York (2004)Google Scholar
  3. 3.
    Shin, H., Lee, J., Park, J., Kim, Y., Oh, H., Lee, T.: A Tactile Emotional Interface for Instant Messenger Chat. In: Smith, M.J., Salvendy, G. (eds.) HCII 2007. LNCS, vol. 4558, pp. 166–175. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  4. 4.
    Neviarouskaya, A., Prendinger, H., Ishizuka, M.: EmoHeart: Conveying Emotions in Second Life Based on Affect Sensing from Text. Advances in Human-Computer Interaction, Special Issue on Emotion-Aware Natural Interaction, 1–13 (2010)Google Scholar
  5. 5.
    Wallbott, H.G., Scherer, K.R.: How Universal and Specific is Emotional Experience? Evidence from 27 Countries on Five Continents. In: Scherer, K.R. (ed.) Facets of Emotion: Recent Research, pp. 31–56. Lawrence Erlbaum Inc., Hillsdale (1988)Google Scholar
  6. 6.
    Decaria, M.D., Proctor, S., Malloy, T.E.: The Effect of False Heart Rate Feedback on Self Reports of Anxiety and on Actual Heart Rate. Behavior research & Therapy 12, 251–253 (1974)CrossRefGoogle Scholar
  7. 7.
    Anderson, C.A.: Temperature and Aggression: Ubiquitous Effects of Heat on Occurrence of Human Violence. Psychological Bulletin 106(1), 74–96 (1989)CrossRefGoogle Scholar
  8. 8.
    Harris, C.R., Christenfeld, N.: Can a Machine Tickle? Psychonomic Bulletin & Review 6(3), 504–510 (1999)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Dzmitry Tsetserukou
    • 1
  • Alena Neviarouskaya
    • 2
  1. 1.Toyohashi University of TechnologyToyohashi, AichiJapan
  2. 2.University of TokyoTokyoJapan

Personalised recommendations