Gestural user interfaces designed for planar touch-sensitive tactile displays require an appropriate concept for teaching gestures and other haptic interaction to blind users. We consider proportions of hands and demonstrate gestures by tactile only methods without the need for Braille skills or verbalization. A user test was performed to confirm blind users may learn gestures autonomously.


haptic interaction assistive technology gestures 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Rotard, M., Bosse, K., Schweikhardt, W., Ertl, T.: Access to Mathematical Expressions in MathML for the Blind. In: Proc. of the HCI International Conference, pp. 1325–1329 (2004)Google Scholar
  2. 2.
    Völkel, T., Weber, G., Baumann, U.: Tactile Graphics Revised: The Novel BrailleDis 9000 Pin-Matrix Device with Multitouch Input. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 835–842. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  3. 3.
    Kraus, M., Völkel, T., Weber, G.: An Off-Screen Model for Tactile Graphical User Interfaces. In: Miesenberger, K., Klaus, J., Zagler, W.L., Karshmer, A.I. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 865–872. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  4. 4.
    Kipke, S.: Sensitive Braille Displays with ATC Technology (Active Tactile Control) as a Tool for Learning Braille. In: Miesenberger, K., et al. (eds.) ICCHP 2008. LNCS, vol. 5105, pp. 843–850. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  5. 5.
    Parkes, D.: Nomad, an audio tactile tool for the acquisition, use and management of spatially distributed information by visually impaired people. In: Proceedings of the Second International Symposium on Maps and Graphics for Visually Handicapped People, pp. 24–29. A.F.&Dodds, London (1988)Google Scholar
  6. 6.
    Schiewe, M., Köhlmann, W., Nadig, O., Gerhard Weber, G.: What You Feel is What You Get: Mapping GUIs on Planar Tactile Displays. In: Stephanidis, C. (ed.) Universal Access in HCI, Part II, HCII 2009. LNCS, vol. 5615, pp. 564–573. Springer, Heidelberg (2009)Google Scholar
  7. 7.
    Hill, D.R., Grieb, C.: Substitution for a restricted visual channel in multimodal computer-human dialogue. IEEE Transactions on Systems, Man and Cybernetics 18(2), 285–304 (1988)CrossRefGoogle Scholar
  8. 8.
    Weber, G.: Adapting direct manipulation for blind users. In: Ashlund, S., et al. (eds.) Adjunct Proceedings of INTERCHI 1993, pp. 21–22. Addison Wesley, Reading (1993)Google Scholar
  9. 9.
    Sánchez, J., Maureira, E.: Subway Mobility Assistance Tools for Blind Users. In: Stephanidis, C., Pieper, M. (eds.) ERCIM Ws UI4ALL 2006. LNCS, vol. 4397, pp. 386–404. Springer, Heidelberg (2007)CrossRefGoogle Scholar
  10. 10.
    Kane, S.K., Bigham, J.P., Jacob, O., Wobbrock, J.O.: Slide Rule: Making Mobile Touch Screens Accessible to Blind People Using Multi-Touch Interaction Techniques. In: Proceedings of the 10th international ACM SIGACCESS Conference on Computers and Accessibility, Halifax, Nova Scotia, Canada, October 13 - 15, 2008, pp. 73–80. ASSETS. ACM, New York (2008)Google Scholar
  11. 11.
    Wolf, C.G., Morrel-Samuels, P.: The Use of Hand-Drawn Gestures for Text Editing. International Journal of Man-Machine Studies 27(1), 91–102 (1987)CrossRefGoogle Scholar
  12. 12.
    Wobbrock, J.O., Wilson, A.D., Li, Y.: Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes. In: Proceedings of the 20th Annual ACM Symposium on User interface Software and Technology, UIST 2007, Newport, Rhode Island, USA, October 07-10, 2007, pp. 159–168. ACM, New York (2007)Google Scholar
  13. 13.
    Rubine, D.: Specifying gestures by example. SIGGRAPH Comput. 25(4), 329–337 (1991)CrossRefGoogle Scholar
  14. 14.
    Bau, O., Mackay, W.E.: OctoPocus: a dynamic guide for learning gesture-based command sets. In: Proceedings of the 21st Annual ACM Symposium on User interface Software and Technology, UIST 2008, Monterey, CA, USA, October 19 - 22, 2008, pp. 37–46. ACM, New York (2008)Google Scholar
  15. 15.
    Brewster, S., Brown, L.M.: Tactons: structured tactile messages for non-visual information display. In: Cockburn, A. (ed.) Proceedings of the Fifth Conference on Australasian User interface - Volume 28, Dunedin, New Zealand. ACM International Conference Proceeding Series, vol. 53. Australian Computer Society, DarlinghurstGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Michael Schmidt
    • 1
  • Gerhard Weber
    • 1
  1. 1.Institut für Angewandte InformatikTechnische Universität DresdenDresdenGermany

Personalised recommendations