Making Gestural Interaction Accessible to Visually Impaired People

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8619)


As touch screens become widely spread, making them more accessible to visually impaired people is an important task. Touch displays possess a poor accessibility for visually impaired people. One possibility to make them more accessible without sight is through gestural interaction. Yet, there are still few studies on using gestural interaction for visually impaired people. In this paper we present a comprehensive summary of existing projects investigating accessible gestural interaction. We also highlight the limits of current approaches and propose future working directions. Then, we present the design of an interactive map prototype that includes both a raised-line map overlay and gestural interaction for accessing different types of information (e.g., opening hours, distances). Preliminary results of our project show that basic gestural interaction techniques can be successfully used in interactive maps for visually impaired people.


Gestural interaction Accessibility Visual impairment Interactive maps Non-visual interaction 



We thank Alexis Paoleschi who developed the prototype presented in this paper and our blind participants.


  1. 1.
    Schöning, J.: Touch the future: the recent rise of multi-touch interaction. J. Eur. Comm. Futur. Emerg. Technol. Proactive Initiat. Pervasive Adapt. 5531, 1–2 (2010)Google Scholar
  2. 2.
    Buxton, W.: Multi-touch systems that i have known and loved (2007)Google Scholar
  3. 3.
    Kane, S.K., Bigham, J.P., Wobbrock, J.O.: Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In: ASSETS’08, New York, NY, USA, pp. 73–80. ACM Press (2008)Google Scholar
  4. 4.
    Kane, S.K., Morris, M.R., Wobbrock, J.O.: Touchplates: low-cost tactile overlays for visually impaired touch screen users. In: ASSETS’13, Bellevue, Washington, USA. ACM (2013)Google Scholar
  5. 5.
    Xu, S., Bailey, K.: Design touch feedback for blind users. In: Stephanidis, C. (ed.) HCII 2013, Part I. CCIS, vol. 373, pp. 281–285. Springer, Heidelberg (2013)CrossRefGoogle Scholar
  6. 6.
    Brock, A., Truillet, P., Oriola, B., Picard, D., Jouffrais, C.: Design and user satisfaction of interactive maps for visually impaired people. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds.) ICCHP 2012, Part II. LNCS, vol. 7383, pp. 544–551. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  7. 7.
    Pavlovic, V.I., Sharma, R., Huang, T.S.: Visual interpretation of hand gestures for human-computer interaction: a review. IEEE Trans. Pattern Anal. Mach. Intell. 19, 677–695 (1997)CrossRefGoogle Scholar
  8. 8.
    Kamber, Y.: Empirical investigation of the memorability of gesture sets (2011)Google Scholar
  9. 9.
    Wolf, K., Dicke, C., Grasset, R.: Touching the void: gestures for auditory interfaces. In: TEI’11, New York, NY, USA, pp. 305–308. ACM Press (2011)Google Scholar
  10. 10.
    Guerreiro, T., Lagoá, P., Nicolau, H., Gonçalves, D., Jorge, J.A.: From tapping to touching: making touch screens accessible to blind users. IEEE Multimed. 15, 48–50 (2008)CrossRefGoogle Scholar
  11. 11.
    Zeng, L., Weber, G.: Audio-haptic browser for a geographical information system. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 466–473. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  12. 12.
    Yatani, K., Banovic, N., Truong, K.: SpaceSense: representing geographical information to visually impaired people using spatial tactile feedback. In: CHI’12, New York, NY, USA, pp. 415–424. ACM Press (2012)Google Scholar
  13. 13.
    Carroll, D., Chakraborty, S., Lazar, J.: Designing accessible visualizations: the case of designing a weather map for blind users. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013, Part I. LNCS, vol. 8009, pp. 436–445. Springer, Heidelberg (2013)Google Scholar
  14. 14.
    Apple: Apple - Accessibility - OS X - VoiceOver.
  15. 15.
    McGookin, D., Brewster, S.A., Jiang, W.W.: Investigating touchscreen accessibility for people with visual impairments. In: NordiCHI, pp. 298–307. ACM (2008)Google Scholar
  16. 16.
    Kane, S.K., Wobbrock, J.O., Ladner, R.E.: Usable gestures for blind people. In: CHI’11, Vancouver, BC, Canada, pp. 413–422. ACM Press (2011)Google Scholar
  17. 17.
    El-Glaly, Y., Quek, F., Smith-Jackson, T., Dhillon, G.: Audible rendering of text documents controlled by multi-touch interaction. In: ICMI’12, New York, NY, USA, pp. 401–408. ACM Press (2012)Google Scholar
  18. 18.
    Brock, A.M., Oriola, B., Truillet, P., Jouffrais, C., Picard, D.: Map design for visually impaired people: past, present, and future research. Médiation Inf. - Handicap Commun. 36, 117–129 (2013)Google Scholar
  19. 19.
    Miele, J., Landau, S., Gilden, D.: Talking TMAP: automated generation of audio-tactile maps using Smith-Kettlewell’s TMAP software. Br. J. Vis. Impair. 24, 93–100 (2006)CrossRefGoogle Scholar
  20. 20.
    Lévesque, V., Petit, G., Dufresne, A., Hayward, V.: Adaptive level of detail in dynamic, refreshable tactile graphics. In: IEEE Haptics Symposium, pp. 1–5 (2012)Google Scholar
  21. 21.
    Brock, A.M., Vinot, J.-L., Oriola, B., Kammoun, S., Truillet, P., Jouffrais, C.: Méthodes et outils de conception participative avec des utilisateurs non-voyants. In: IHM’10, Luxembourg, NY, USA, pp. 65–72. ACM Press (2010)Google Scholar
  22. 22.
    Laufs, U., Ruff, C., Weisbecker, A.: MT4j - an open source platform for multi-touch software development. VIMation J. 1, 58–64 (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2014

Authors and Affiliations

  1. 1.IRIT-UMR5505CNRS and Université de ToulouseToulouseFrance

Personalised recommendations