Expressing Emotions Using Animated Text Captions

  • Raisa Rashid
  • Jonathan Aitken
  • Deborah I. Fels
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4061)


Due to limitations of conventional text-based closed captions, expressions of paralinguistic and emotive information contained in the dialogue of television and film content are often missing. We present a framework for enhancing captions that uses animation and a set of standard properties to express five basic emotions. Using an action research method, the framework was developed from a designer’s interpretation and rendering of animated text captions for two content examples.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Acton, G.S.: Basic Emotions (April 1998) (Retrieved February 25, 2005) from
  2. 2.
    Ekman, P. (ed.): Basic Emotions Ch. 3. John Wiley & Sons, Sussex (1999)Google Scholar
  3. 3.
    Fels, D.I., Lee, D.G., Branji, C., Hornburg, M.: Emotive captioning and access to television. In: The ACMIS 2005, Omaha (2005)Google Scholar
  4. 4.
    Field, G.: Implementing DTV Closed Captions and Video Description (2000) (Retrieved February 28, 2005) from
  5. 5.
    Forlizzi, J., Lee, J., Hudson, S.: The kinedit system: Affective messages using dynamis texts. Chi 2003: New Horizons 5(1), 377–384 (2003)Google Scholar
  6. 6.
    Jordan, A.B., Albright, A., Branner, A., Sullivan, J.: The state of closed captioning services in the United States.: National Captioning Institute Foundation (2003)Google Scholar
  7. 7.
    Juslin, P.N., Laukka, P.: Communication of emotions in vocal expression and music performance: Different channels, same code? Psychological Bulletin 129(5), 770–814 (2003)CrossRefGoogle Scholar
  8. 8.
    Mehrabian, A.: Communication without words. Psychology Today 2(4), 53–56 (1968)Google Scholar
  9. 9.
    Plutchik, R.: Emotion, a psychoevolutionary synthesis. Harper & Row, New York (1980)Google Scholar
  10. 10.
    Plutchik, R., Kelleman, H.: The measurement of emotions. Academic Press, New York (1989)Google Scholar
  11. 11.
    Stone, B., Alenquer, D., Borisch, J.: Type, motion and emotion: A visual amplification of meaning. In: McDonagh, D., Hekkert, P., van Erp, J., Gyi, D. (eds.) Design and emotion the experience of everyday things, Taylor & Francis, New York (2004)Google Scholar
  12. 12.
    VITAC: History of DTV Captioning (April 2003) (Retrieved February 28, 2005) from
  13. 13.
    Wang, H., Prendinger, H., Igarashi, T.: Communicating emotions in online chat using physiological sensors and animated text. In: The 2004 conference on Human factors and computing systems Late breaking result papers, pp. 1171–1174 (2004) (Extended abstracts)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Raisa Rashid
    • 1
  • Jonathan Aitken
    • 1
  • Deborah I. Fels
    • 1
  1. 1.Ryerson UniversityTorontoCanada

Personalised recommendations