Using Placement and Name for Speaker Identification in Captioning

  • Quoc V. Vy
  • Deborah I. Fels
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6179)


The current method for speaker identification in closed captioning on television is ineffective and difficult in situations with multiple speakers, off-screen speakers, or narration. An enhanced captioning system that uses graphical elements (e.g., avatar and colour), speaker names and caption placement techniques for speaker identification was developed. A comparison between this system and conventional closed captions was carried out deaf and hard-of-hearing participants. Results indicate that viewers are distracted when the caption follows the character on-screen regardless of whether this should assist in identifying who is speaking. Using the speaker’s name for speaker identification is useful for viewers who are hard of hearing but not for deaf viewers. There was no significant difference in understanding, distraction, or preference for the avatar with the coloured border component.


speaker identification captioning subtitles universal design 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Canadian Association of Broadcasters (CAB): Closed captioning standards and protocol for Canadian English language television programming services (2008),
  2. 2.
    Canadian Radio-television and Telecommunications Commission (CRTC): A new policy with respect to closed captioning (2007),
  3. 3.
    Harkins, J.E., Korres, E., Virvan, B., Singer, B.: Caption Features for Indicating Non-Speech Information: Guidelines for the Captioning Industry. Gallaudet Research Institute (1996)Google Scholar
  4. 4.
    ICT: ITC Guidance on Standards for Subtitling. Independent Television Commission, London (1999)Google Scholar
  5. 5.
    Jacoby, J., Mattel, M.S.: Three-Point Likert Scales Are Good Enough. Journal of Marketing Research (JMR) 11(8), 495–500 (1971)CrossRefGoogle Scholar
  6. 6.
    King, C., Lasasso, C., Short, D.: Digital Captioning: Effects of Color-Coding and Placement in Synchronized Text-Audio Presentations. In: ED-MEDIA, vol. 94, pp. 329–334 (1994)Google Scholar
  7. 7.
    Quinlan, P.T., Wilton, R.N.: Grouping by proximity or similarity? Competition between the Gestalt principles in vision. Perception 27(4), 417–30 (1998)Google Scholar
  8. 8.
    Spielberg, S.(Producer), Bay, M.(Director): Transformers [Motion Picture]. DreamWorks, United States of America (2007)Google Scholar
  9. 9.
    Vy, Q.V., Fels, D.I.: Using Avatars for Improving Speaker Identification in Captioning. In: Gross, T., Gulliksen, J., Kotzé, P., Oestreicher, L., Palanque, P., Prates, R.O., Winckler, M. (eds.) INTERACT 2009. LNCS, vol. 5727, pp. 916–919. Springer, Heidelberg (2009)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Quoc V. Vy
    • 1
  • Deborah I. Fels
    • 1
  1. 1.Ryerson UniversityTorontoCanada

Personalised recommendations