Making Multimedia Internet Content Accessible and Usable

  • Hisashi Miyashita
  • Hironobu Takagi
  • Daisuke Sato
  • Chieko Asakawa
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4556)


Although multimedia content containing streaming media is now widely used on the World Wide Web, there exist considerable difficulties for blind users to access such content, due to its dynamic changes, keyboard inoperability, and audio interference with the speech from assistive software. In particular, the third problem of audio interference is serious for blind users, since multimedia content often contains streaming media such as video and music which continuously play sounds, and thus they cannot hear the speech, which is masked by the loud media.

In this paper, we propose a new accessible browser that can directly manipulate such multimedia content. In order to control Flash contents, our browser relies on a transcoding HTTP proxy to inject special scripts into the Flash content and then manipulates the embedded streaming media and sound objects via the injected scripts. By using our browser, users can easily turn the volume up or down, play, stop, or pause the streaming media with shortcut keys. Since the users do not need to focus on buttons or sliders for these operations, they can immediately stop or fade out the intrusive media when listening to speech from assistive software.


Multimedia Content User Agent Stream Medium Screen Reader Blind User 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
    Synchronized multimedia integration language (SMIL 2.0) - [2nd edn]. W3C Recommendation (January 07, 2005)
  3. 3.
    Asakawa, C., Itoh, T.: User interface of a home page reader. In: Assets 1998: Proceedings of the third international ACM conference on Assistive technologies, pp. 149–156. ACM Press, New York (1998)CrossRefGoogle Scholar
  4. 4.
    Asakawa, C., Itoh, T., Takagi, H., Miyashita, H. Accessibility evaluation for multimedia content. In: UAHCI (2007)Google Scholar
  5. 5.
    Asakawa, C., Takagi, H., Ino, S., Ifukube, T.: Maximum listening speeds for the blind. In: International Community for Auditory Display 2003, pp. 276–279 (2003)Google Scholar
  6. 6.
    DeMeglio, M., Häkkinen, M. T., Kawamura, H.: Accessible interface design: Adaptive multimedia information system (amis). In: ICCHP 2002, pp. 406–412 (2002)Google Scholar
  7. 7.
    Goose, S., Kodlahalli, S., Pechter, W., Hjelsvold, R.: Streaming speech3: a framework for generating and streaming 3D text-to-speech and audio presentations to wireless PDAs as specified using extensions to SMIL. In: WWW, pp. 37–44 (2002)Google Scholar
  8. 8.
    Huang, A.W., Sundaresan, N.: Aurora: a conceptual model for web-content adaptation to support the universal usability of web-based services. In: CUU ’00: Proceedings on the 2000 conference on Universal Usability, pp. 124–131. ACM Press, New York, USA (2000)CrossRefGoogle Scholar
  9. 9.
    Jacobs, I., Gunderson, J., Hansen, E.: User agent accessibility guidelines 1.0. W3C Recommendation (December 17, 2002)
  10. 10.
    King, A., Evans, G., Webbie B.P: a web browser for visually impaired people. In: Proceedings of the 2nd Cambridge Workshop on Universal Access and Assistive Technology, pp. 35–44 (2004)Google Scholar
  11. 11.
    Ramakrishnan, I.V., Stent, A., Yang, G.: HearSay: enabling audio browsing on hypertext content. In: WWW ’04: Proceedings of the 13th international conference on World Wide Web, pp. 80–89. ACM Press, New York, USA (2004)CrossRefGoogle Scholar
  12. 12.
    Rousseau, F., García-Macías, J.A., de Lima, J.V., Duda, A.: User adaptable multimedia presentations for the world wide web. Computer Networks 31, 11–16, 1273–1290 (1999)CrossRefGoogle Scholar
  13. 13.
    Saito, S., Takagi, H., Asakawa, C.: Transforming flash to xml for accessibility evaluations. In: ASSETS, pp. 157–164 (2006)Google Scholar
  14. 14.
    Schwerdtfeger, R.: Roadmap for accessible rich internet applications (WAI-ARIA roadmap). W3C Working Draft (December 20, 2006)
  15. 15.
    Takagi, H., Asakawa, C., Fukuda, K., Maeda, J.: Site-wide annotation: reconstructing existing pages to be accessible. In: ASSETS, pp. 81–88 (2002)Google Scholar
  16. 16.
    Weimann, K., Langer, I., Weber, G.: Adaptation of multimedia browsing techniques. In: ICCHP, pp. 135–142 (2004)Google Scholar
  17. 17.
    Zajicek, M., Powell, C., Reeves, C.: A web navigation tool for the blind. In: Assets ’98: Proceedings of the third international ACM conference on Assistive technologies, pp. 204–206. ACM Press, New York, USA (1998)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Hisashi Miyashita
    • 1
  • Hironobu Takagi
    • 1
  • Daisuke Sato
    • 1
  • Chieko Asakawa
    • 1
  1. 1.IBM Research, Tokyo Research LaboratoryJapan

Personalised recommendations