I See Your Voice: The Development of Image Caption Generating Software and On-Line User Community for the Auditory Disabled

  • Kyungho Lim
  • Joonsung Yoon
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4554)


This study is on developing methodology of accessibility and usability for the auditory disabled by producing the interface of converting auditory elements into visual elements that are extracted from elements of the artistic representational method of contemporary media art, and by building on-line community for the auditory disabled to enhance and to reflect the accessibility and the usability through the group’s own development and design. At the first stage, analyses on current web animations and their accessibility of auditory disabled persons. At the second stage, analyses on contemporary media artworks are followed to extract usable elements from the artwork. At this stage, actual image captions are created. At the third stage, the image caption generating software is developed, and adjusted image captions are produced as the content. At the last stage, the linkage of web and on-line user community is set up. The development can improve accessibility of the auditory disabled using a various digital content, and it magnifies the territory for the application and the production of creative interfaces. It can also expand the area of content technology.


auditory disabled digital content accessibility usability 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Yonggun, J.: A Study on Authoring Tool and Player of Mathematic Education Content for the Hearinig Impaired. J.Ind. Sci. Cheongju Univ. 23(1), 163–170 (2005)Google Scholar
  2. 2.
    Mueller, John.: Accessibility for Everybody: Understanding the Section 508 Accessibility Requirments (2003)Google Scholar
  3. 3.
    Jung, M.: A Study on the Solution to Digital Divide of the Persons with Disability, Master’s thesis, Department of Social Welfare, Graduate School of Policy, Chosun Univ. (2005) Google Scholar
  4. 4.
    Gulliver, S.R., Ghinea, G.: Impact of Captions on Deaf and Hearing Perception of Multimedia Video Clips. In: IEEE Int. Conf. on Multimedia and Expo, pp. 753–756 (2002)Google Scholar
  5. 5.
    Synchronized Accessible Media Interchange Captioning & Audio Description, Microsoft Corporation (1998)Google Scholar
  6. 6.
    Synchronized multimedia,
  7. 7.
    Ogawa, H., Goto, Y.: Web 2.0 Book. Impress Japan Corporation (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Kyungho Lim
    • 1
  • Joonsung Yoon
    • 1
  1. 1.Department of Digital Media, Graduate School of Soongsil University, 511 Sangdo-dong, Dongjak-gu, Seoul, 156-743Korea

Personalised recommendations