Using Avatars for Improving Speaker Identification in Captioning

  • Quoc V. Vy
  • Deborah I. Fels
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5727)


Captioning is the main method for accessing television and film content by people who are deaf or hard-of-hearing. One major difficulty consistently identified by the community is that of knowing who is speaking particularly for an off screen narrator. A captioning system was created using a participatory design method to improve speaker identification. The final prototype contained avatars and a coloured border for identifying specific speakers. Evaluation results were very positive; however participants also wanted to customize various components such as caption and avatar location.


inclusive design speaker identification avatars captioning 


  1. 1.
    Harkins, J.E., Korres, E., Singer, B.R., Virvan, B.M.: Non-speech information in captioned video: A consumer opinion study with guidelines for the captioning industry. Gallaudet Research Institute, Washington (1995)Google Scholar
  2. 2.
    King, C., Lasasso, C., Short, D.: Digital Captioning: Effects of Color-Coding and Placement in Synchronized Text-Audio Presentations. In: ED-MEDIA 1994, pp. 329–334 (1994)Google Scholar
  3. 3.
    Keld Bødker, F.K.: Participatory IT design: Designing for business and workplace realities. MIT Press, Cambridge (2004)Google Scholar
  4. 4.
    Baskinger, M.: Pencils before pixels: a primer in hand-generated sketching. Interactions 15(2), 28–36 (2008)CrossRefGoogle Scholar
  5. 5.
    Quinlan, P.T., Wilton, R.N.: Grouping by proximity or similarity? Competition between the Gestalt principles in vision. Perception 27(4), 417–430 (1998)CrossRefGoogle Scholar
  6. 6.
    Spielberg, S. (Producer), Bay, M. (Director): Transformers [Motion Picture]. United States of America: DreamWorks (2007)Google Scholar
  7. 7.
    Rashid, R., Vy, Q., Hunt, R., Fels, D.I.: Dancing with words. International Journal of Human-Computer Interaction 24(5), 505–519 (2008)CrossRefGoogle Scholar

Copyright information

© IFIP International Federation for Information Processing 2009

Authors and Affiliations

  • Quoc V. Vy
    • 1
  • Deborah I. Fels
    • 1
  1. 1.Ryerson UniversityTorontoCanada

Personalised recommendations