A Robust Vision-Based Framework for Screen Readers

  • Michael CormierEmail author
  • Robin Cohen
  • Richard Mann
  • Kamal Rahim
  • Donglin Wang
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8927)


With the increasingly rich display of media on the Internet, screen reading technology that mainly considers website source code can become ineffective. We aim to present a solution that remains robust in the face of dynamically displayed web content, regardless of the underlying web framework. To do this, we consider techniques used in computer vision to determine semantic information about the web pages. We consider existing screen reading technologies to see where such techniques can help, and discuss our analytical model to show how this approach can benefit low vision users.


Computer vision Screen reader Visually impaired Sensory substitution 


  1. 1.
    Apple: Apple - accessibility - OS x - VoiceOver. (accessed March 16, 2014)
  2. 2.
    Castleman, K.R.: Digital Image Processing, chap. 18. Prentice Hall (1996)Google Scholar
  3. 3.
    Cesarini, F., Gori, M., Marinai, S., Soda, G.: Structured document segmentation and representation by the modified x-y tree. In: Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR 1999, pp. 563–566, September 1999Google Scholar
  4. 4.
    Chen, J., Zhong, P., Cook, T.: Detecting web content function using generalized hidden markov model. In: 5th International Conference on Machine Learning and Applications. ICMLA 2006, pp. 279–284, December 2006Google Scholar
  5. 5.
    Crouse, M., Baraniuk, R., Nowak, R.: Hidden markov models for wavelet-based signal processing. In: Conference Record of the Thirtieth Asilomar Conference on Signals, Systems and Computers, pp. 1029–1035, vol. 2, November 1996Google Scholar
  6. 6.
    Fayzrahmanov, R.R., Göbel, M.C., Holzinger, W., Krüpl, B., Baumgartner, R.: A unified ontology-based web page model for improving accessibility. In: Proceedings of the 19th International Conference on World Wide Web. WWW 2010, pp. 1087–1088. ACM, New York (2010).
  7. 7.
    Forsyth, D.A., Ponce, J.: Computer vision: a modern approach. Prentice Hall Professional Technical ReferenceGoogle Scholar
  8. 8.
    Google: ChromeVox. (accessed March 16, 2014)
  9. 9.
    Krüpl-Sypien, B., Fayzrakhmanov, R.R., Holzinger, W., Panzenböck, M., Baumgartner, R.: A versatile model for web page representation, information extraction and content re-packaging. In: Proceedings of the 11th ACM Symposium on Document Engineering. DocEng 2011, pp. 129–138. ACM, New York (2011).
  10. 10.
    “kwhawell”: introducing a screen reader what it is how it works (2010). (accessed June 16, 2014)
  11. 11.
    Raman, T.V., Chen, C.L., Mazzoni, D., Shearer, R., Gharpure, C., DeBoer, J., Tseng, D.: Chromevox a screen reader built using web technology. Google technical report (2012).
  12. 12.
    TUWIEN Database and Artificial Intelligence Group: TUWIEN Project ABBA: Web Accessibility. (accessed June 4, 2014)

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Michael Cormier
    • 1
    Email author
  • Robin Cohen
    • 1
  • Richard Mann
    • 1
  • Kamal Rahim
    • 1
  • Donglin Wang
    • 1
  1. 1.Cheriton School of Computer ScienceUniversity of WaterlooWaterlooCanada

Personalised recommendations