Non-visual Access to GUIs: Leveraging Abstract User Interfaces

  • Kris Van Hees
  • Jan Engelen
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4061)


Various approaches to providing blind users with access to graphical user interfaces have been researched extensively in the past 15 years, and yet accessibility is still facing many obstacles. Graphical environments such as X Windows offer a high degree of freedom to both the developer and the user, complicating the accessibility problem even more. Existing technology is largely based on either a combination of graphical toolkit hooks, queries to the application and scripting, or model-driven user interface development. Both approaches have limitations that the proposed research addresses. This paper builds upon past and current research into accessibility, and promotes the use of abstract user interfaces to providing non-visual access to GUIs.


User Interface Assistive Technology Accessibility Problem Blind User Graphical Environment 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Boyd, L.H., Boyd, W.L., Vanderheiden, G.C.: The graphical user interface: Crisis, danger and opportunity. Journal of Visual Impairment and Blindness, 496–502 (1990)Google Scholar
  2. 2.
    Weber, G., Mager, R.: Non-visual user interfaces for X Windows. In: Interdisciplinary aspects on computers helping people with special needs, 5th International Conference, ICCHP 1996, pp. 459–468 (1996)Google Scholar
  3. 3.
    Mynatt, E.D., Weber, G.: Nonvisual presentation of graphical user interfaces: Contrasting two approaches. In: Human Factors in Computing Systems, CHI 1994 – Celebrating Interdependence, pp. 166–172 (1994)Google Scholar
  4. 4.
    Gunzenhäuser, R., Weber, G.: Graphical user interfaces for blind people. In: Brunnstein, K., Raubold, E. (eds.) 13th World Computer Congress 1994, vol. 2, pp. 450–457. Elsevier Science, Amsterdam (1994)Google Scholar
  5. 5.
    Kawai, S., Aida, H., Saito, T.: Designing interface toolkit with dynamic selectable modality. In: Proceedings of the second annual ACM conference on Assistive Technologies, pp. 72–79. ACM Press, New York (1996)CrossRefGoogle Scholar
  6. 6.
    Savidis, A., Stephanidis, C.: Building non-visual interaction through the development of the Rooms metaphor. In: Companion of the CHI 1995 conference in Human Factors in Computing Systems, pp. 244–245 (1995)Google Scholar
  7. 7.
    Savidis, A., Stergiou, A., Stephanidis, C.: Generic Containers for Metaphor Fusion in Non-Visual Interaction: the HAWK Interface Toolkit. In: Proceedings of the Interfaces 1997 Conference, pp. 194–196 (1997)Google Scholar
  8. 8.
    Stephanidis, C., Savidis, A.: Universal Access in the Information Society: Methods, Tools, and Interaction Technologies. In: Oppermann, R. (ed.) Universal Access in the Information Society, vol. 1(1), pp. 40–55 (2001)Google Scholar
  9. 9.
    Limbourg, Q., Vanderdonckt, J., Michotte, B., Bouillon, L., Florins, M.: Usixml: A user interface description language supporting multiple levels of independence. In: Lauff, M. (ed.) Proceedings of Workshop on Device Independent Web Engineering DIWE 2004, Munich, July 26-27 (2004)Google Scholar
  10. 10.
    Donker, H., Klante, P., Gorny, P.: The design of auditory user interfaces for blind users. In: Proceedings of the second Nordic conference on Human- Computer Interaction, pp. 149–156. ACM Press, New York (2002)CrossRefGoogle Scholar
  11. 11.
    Vitense, H.S., Jacko, J.A., Kathlene Emery, V.: Multimodal feedback: establishing a performance baseline for improved access by individuals with visual impairments. In: Proceedings of the fifth international ACM conference on Assistive Technologies, pp. 49–56. ACM Press, New York (2002)CrossRefGoogle Scholar
  12. 12.
    Barnicle, K.: Usability testing with screen reading technology in a windows environment. In: Proceedings on the 200 conference on Universal Usability, pp. 102–109. ACM Press, New York (2000)CrossRefGoogle Scholar
  13. 13.
    Pontelli, E., Gillan, D., Xiong, W., Saad, E., Gupta, G., Karshmer, A.I.: Navigation of html tables, frames, and xml fragments. In: Proceedings of the fifth international ACM conference on Assistive Technologies, pp. 25–32. ACM Press, New York (2002)CrossRefGoogle Scholar
  14. 14.
    Theofanos, M.F., Redish, J.: Bridging the gap: between accessibility and usability. Interactions 10(6), 36–51 (2003)CrossRefGoogle Scholar
  15. 15.
    Van Hees, K., Engelen, J.: Abstract UIs as a long-term solution for non-visual access to GUIs. In: Proceedings of the 11th International Conference on Human-Computer Interaction (CD-ROM) (2005)Google Scholar
  16. 16.
    Van Hees, K., Engelen, J.: Abstracting the Graphical User Interface for Non-Visual Access. In: Pruski, A., Knops, H. (eds.) Assistive Technology: From Virtuality to Reality (AAATE 2005), IOS Press, Amsterdam (2005)Google Scholar
  17. 17.
    Trewin, S., Zimmermann, G., Vanderheiden, G.: Abstract user interface representations: How well do they support universal access? In: CUU 2003: Proceedings of the 2003 conference on Universal usability, pp. 77–84. ACM Press, New York (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Kris Van Hees
    • 1
  • Jan Engelen
    • 1
  1. 1.Department of Electrical Engineering, ESAT – SCDKatholieke Universiteit LeuvenHeverleeBelgium

Personalised recommendations