Sign Language Interpreter Module: Accessible Video Retrieval with Subtitles

  • Primož Kosec
  • Matjaž Debevc
  • Andreas Holzinger
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6180)


In this paper, we introduce a new approach to the integration of sign language on the Web. Written information is presented by a Sign Language Interpreter Module (SLI Module). The improvement in comparison to state-of-the-art solutions on the Web is that our sign language video has a transparent background and is shown over the existing web page. The end user can activate the video playback by clicking on an interactive icon. The mechanism also provides a simplified approach to enable accessibility requirements of existing web pages. In addition, the subtitles are stored externally in the Timed Text Authoring Format (TTAF), which is a candidate for recommendation by the W3C community. Empirical results from our evaluation study showed that the prototype was well accepted and was pleasant to use.


Web Multimedia Video Sign Language Subtitles Deaf Hard of hearing Human–Computer Interaction (HCI) Usability Engineering 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Debevc, M., Kosec, P., Holzinger, A.: Improving Multimodal Web Accessibility for Deaf People: Sign Language Interpreter Module (SLIM). Multimedia Tools and Applications (2010) (in print)Google Scholar
  2. 2.
    Kronreif, G., Dotter, F., Bergmeister, E., Krammer, K., Hilzensauer, M., Okorn, I., Skant, A., Orter, R., Rezzonico, S., Barreto, B.: SMILE: demonstration of a cognitively oriented solution to the improvement of written language competence of deaf people. In: 7th International Conference on Computers Helping People with Special Needs (ICCHP), Vienna, pp. 17–21 (2000)Google Scholar
  3. 3.
    Vanderheiden, G.C.: Full Visual Annotation of Auditorially Presented Information for Users Who Are Deaf: ShowSounds. In: Proce. of the RESNA International Conference, Toronto (1992)Google Scholar
  4. 4.
    Fels, D.I., Richards, J., Hardman, J.L., Daniel, G.: Sign Language Web Pages. American Annals of the Deaf 151, 423–433 (2006)CrossRefGoogle Scholar
  5. 5.
    Straetz, K., Kaibel, A., Raithel, V., Specht, M., Grote, K., Kramer, F.: An e-Learning Environment for Deaf Adults. In: Proc. of the 8th ERCIM Workshop: User Interfaces for All, Vienna (2004)Google Scholar
  6. 6.
    Hilzensauer, M.: Information Technology for Deaf People. LNCS, vol. 19, pp. 183–206. Springer, Heidelberg (2006)Google Scholar
  7. 7.
    Debevc, M., Peljhan, Z.: The role of video technology in on-line lectures for the deaf. Disability and Rehabilitation 26, 10548–10598 (2004)Google Scholar
  8. 8.
    Signing Savvy for American Sign Language,
  9. 9.
    Web Content Accesssibility Guidelines 2.0,
  10. 10.
    Fajardo, I., Cañas, J.J., Salmerón, L., Abascal, J.: Improving deaf users’ accessibility in hypertext information retrieval: are graphical interfaces useful for them? Behaviour & Information Technology 25, 455–467 (2006)CrossRefGoogle Scholar
  11. 11.
    Sign Language Interpreter Module,
  12. 12.
  13. 13.
  14. 14.
  15. 15.
  16. 16.
  17. 17.
  18. 18.
  19. 19.
  20. 20.
  21. 21.
  22. 22.
    Timed-Text Authoring Format (TTAF),

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Primož Kosec
    • 1
  • Matjaž Debevc
    • 1
  • Andreas Holzinger
    • 2
  1. 1.Faculty of Electrical Engineering and Computer ScienceUniversity of MariborMariborSlovenia
  2. 2.Institute for Medical Informatics, Statistics & Documentation, Research Unit HCI4MEDMedical University GrazGrazAustria

Personalised recommendations