Expressing Emotions Using Animated Text Captions

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4061)


Due to limitations of conventional text-based closed captions, expressions of paralinguistic and emotive information contained in the dialogue of television and film content are often missing. We present a framework for enhancing captions that uses animation and a set of standard properties to express five basic emotions. Using an action research method, the framework was developed from a designer’s interpretation and rendering of animated text captions for two content examples.


Video Content Basic Emotion Text Size Creative Team Onset Speed 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Acton, G.S.: Basic Emotions (April 1998) (Retrieved February 25, 2005) from
  2. 2.
    Ekman, P. (ed.): Basic Emotions Ch. 3. John Wiley & Sons, Sussex (1999)Google Scholar
  3. 3.
    Fels, D.I., Lee, D.G., Branji, C., Hornburg, M.: Emotive captioning and access to television. In: The ACMIS 2005, Omaha (2005)Google Scholar
  4. 4.
    Field, G.: Implementing DTV Closed Captions and Video Description (2000) (Retrieved February 28, 2005) from
  5. 5.
    Forlizzi, J., Lee, J., Hudson, S.: The kinedit system: Affective messages using dynamis texts. Chi 2003: New Horizons 5(1), 377–384 (2003)Google Scholar
  6. 6.
    Jordan, A.B., Albright, A., Branner, A., Sullivan, J.: The state of closed captioning services in the United States.: National Captioning Institute Foundation (2003)Google Scholar
  7. 7.
    Juslin, P.N., Laukka, P.: Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin 129(5), 770–814 (2003)CrossRefGoogle Scholar
  8. 8.
    Mehrabian, A.: Communication without words. Psychology Today 2(4), 53–56 (1968)Google Scholar
  9. 9.
    Plutchik, R.: Emotion, a psychoevolutionary synthesis. Harper & Row, New York (1980)Google Scholar
  10. 10.
    Plutchik, R., Kelleman, H.: The measurement of emotions. Academic Press, New York (1989)Google Scholar
  11. 11.
    Stone, B., Alenquer, D., Borisch, J.: Type, motion and emotion: A visual amplification of meaning. In: McDonagh, D., Hekkert, P., van Erp, J., Gyi, D. (eds.) Design and emotion the experience of everyday things, Taylor & Francis, New York (2004)Google Scholar
  12. 12.
    VITAC: History of DTV Captioning (April 2003) (Retrieved February 28, 2005) from
  13. 13.
    Wang, H., Prendinger, H., Igarashi, T.: Communicating emotions in online chat using physiological sensors and animated text. In: The 2004 conference on Human factors and computing systems Late breaking result papers, pp. 1171–1174 (2004) (Extended abstracts)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  1. 1.Ryerson UniversityTorontoCanada

Personalised recommendations