Skip to main content

Making Gestural Interaction Accessible to Visually Impaired People

Part of the Lecture Notes in Computer Science book series (LNISA,volume 8619)

Abstract

As touch screens become widely spread, making them more accessible to visually impaired people is an important task. Touch displays possess a poor accessibility for visually impaired people. One possibility to make them more accessible without sight is through gestural interaction. Yet, there are still few studies on using gestural interaction for visually impaired people. In this paper we present a comprehensive summary of existing projects investigating accessible gestural interaction. We also highlight the limits of current approaches and propose future working directions. Then, we present the design of an interactive map prototype that includes both a raised-line map overlay and gestural interaction for accessing different types of information (e.g., opening hours, distances). Preliminary results of our project show that basic gestural interaction techniques can be successfully used in interactive maps for visually impaired people.

Keywords

  • Gestural interaction
  • Accessibility
  • Visual impairment
  • Interactive maps
  • Non-visual interaction

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-662-44196-1_6
  • Chapter length: 8 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   69.99
Price excludes VAT (USA)
  • ISBN: 978-3-662-44196-1
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   89.99
Price excludes VAT (USA)
Fig. 1.
Fig. 2.

Notes

  1. 1.

    http://inkscape.org/en [last accessed April 30th 2014].

  2. 2.

    http://users.polytech.unice.fr/~helen/SERVER_SI_VOX/pages/index.php?page=Accueil [last accessed April 30th 2014].

References

  1. Schöning, J.: Touch the future: the recent rise of multi-touch interaction. J. Eur. Comm. Futur. Emerg. Technol. Proactive Initiat. Pervasive Adapt. 5531, 1–2 (2010)

    Google Scholar 

  2. Buxton, W.: Multi-touch systems that i have known and loved (2007)

    Google Scholar 

  3. Kane, S.K., Bigham, J.P., Wobbrock, J.O.: Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In: ASSETS’08, New York, NY, USA, pp. 73–80. ACM Press (2008)

    Google Scholar 

  4. Kane, S.K., Morris, M.R., Wobbrock, J.O.: Touchplates: low-cost tactile overlays for visually impaired touch screen users. In: ASSETS’13, Bellevue, Washington, USA. ACM (2013)

    Google Scholar 

  5. Xu, S., Bailey, K.: Design touch feedback for blind users. In: Stephanidis, C. (ed.) HCII 2013, Part I. CCIS, vol. 373, pp. 281–285. Springer, Heidelberg (2013)

    CrossRef  Google Scholar 

  6. Brock, A., Truillet, P., Oriola, B., Picard, D., Jouffrais, C.: Design and user satisfaction of interactive maps for visually impaired people. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds.) ICCHP 2012, Part II. LNCS, vol. 7383, pp. 544–551. Springer, Heidelberg (2012)

    CrossRef  Google Scholar 

  7. Pavlovic, V.I., Sharma, R., Huang, T.S.: Visual interpretation of hand gestures for human-computer interaction: a review. IEEE Trans. Pattern Anal. Mach. Intell. 19, 677–695 (1997)

    CrossRef  Google Scholar 

  8. Kamber, Y.: Empirical investigation of the memorability of gesture sets (2011)

    Google Scholar 

  9. Wolf, K., Dicke, C., Grasset, R.: Touching the void: gestures for auditory interfaces. In: TEI’11, New York, NY, USA, pp. 305–308. ACM Press (2011)

    Google Scholar 

  10. Guerreiro, T., Lagoá, P., Nicolau, H., Gonçalves, D., Jorge, J.A.: From tapping to touching: making touch screens accessible to blind users. IEEE Multimed. 15, 48–50 (2008)

    CrossRef  Google Scholar 

  11. Zeng, L., Weber, G.: Audio-haptic browser for a geographical information system. In: Miesenberger, K., Klaus, J., Zagler, W., Karshmer, A. (eds.) ICCHP 2010, Part II. LNCS, vol. 6180, pp. 466–473. Springer, Heidelberg (2010)

    CrossRef  Google Scholar 

  12. Yatani, K., Banovic, N., Truong, K.: SpaceSense: representing geographical information to visually impaired people using spatial tactile feedback. In: CHI’12, New York, NY, USA, pp. 415–424. ACM Press (2012)

    Google Scholar 

  13. Carroll, D., Chakraborty, S., Lazar, J.: Designing accessible visualizations: the case of designing a weather map for blind users. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013, Part I. LNCS, vol. 8009, pp. 436–445. Springer, Heidelberg (2013)

    Google Scholar 

  14. Apple: Apple - Accessibility - OS X - VoiceOver. http://www.apple.com/accessibility/osx/voiceover/

  15. McGookin, D., Brewster, S.A., Jiang, W.W.: Investigating touchscreen accessibility for people with visual impairments. In: NordiCHI, pp. 298–307. ACM (2008)

    Google Scholar 

  16. Kane, S.K., Wobbrock, J.O., Ladner, R.E.: Usable gestures for blind people. In: CHI’11, Vancouver, BC, Canada, pp. 413–422. ACM Press (2011)

    Google Scholar 

  17. El-Glaly, Y., Quek, F., Smith-Jackson, T., Dhillon, G.: Audible rendering of text documents controlled by multi-touch interaction. In: ICMI’12, New York, NY, USA, pp. 401–408. ACM Press (2012)

    Google Scholar 

  18. Brock, A.M., Oriola, B., Truillet, P., Jouffrais, C., Picard, D.: Map design for visually impaired people: past, present, and future research. Médiation Inf. - Handicap Commun. 36, 117–129 (2013)

    Google Scholar 

  19. Miele, J., Landau, S., Gilden, D.: Talking TMAP: automated generation of audio-tactile maps using Smith-Kettlewell’s TMAP software. Br. J. Vis. Impair. 24, 93–100 (2006)

    CrossRef  Google Scholar 

  20. Lévesque, V., Petit, G., Dufresne, A., Hayward, V.: Adaptive level of detail in dynamic, refreshable tactile graphics. In: IEEE Haptics Symposium, pp. 1–5 (2012)

    Google Scholar 

  21. Brock, A.M., Vinot, J.-L., Oriola, B., Kammoun, S., Truillet, P., Jouffrais, C.: Méthodes et outils de conception participative avec des utilisateurs non-voyants. In: IHM’10, Luxembourg, NY, USA, pp. 65–72. ACM Press (2010)

    Google Scholar 

  22. Laufs, U., Ruff, C., Weisbecker, A.: MT4j - an open source platform for multi-touch software development. VIMation J. 1, 58–64 (2010)

    Google Scholar 

Download references

Acknowledgments

We thank Alexis Paoleschi who developed the prototype presented in this paper and our blind participants.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Anke Brock .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2014 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Brock, A., Truillet, P., Oriola, B., Jouffrais, C. (2014). Making Gestural Interaction Accessible to Visually Impaired People. In: Auvray, M., Duriez, C. (eds) Haptics: Neuroscience, Devices, Modeling, and Applications. EuroHaptics 2014. Lecture Notes in Computer Science(), vol 8619. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-44196-1_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-662-44196-1_6

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-662-44195-4

  • Online ISBN: 978-3-662-44196-1

  • eBook Packages: Computer ScienceComputer Science (R0)