Design of Web-Based Tools to Study Blind People’s Touch-Based Interaction with Smartphones

  • Maria Claudia BuzziEmail author
  • Marina Buzzi
  • Barbara Leporini
  • Amaury Trujillo
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 528)


Nowadays touchscreen smartphones are the most common kind of mobile devices. However, gesture-based interaction is a difficult task for most visually impaired people, and even more so for blind people. This difficulty is compounded by the lack of standard gestures and the differences between the main screen reader platforms available on the market. Therefore, our goal is to investigate the differences and preferences in touch gesture performance on smartphones among visually impaired people. During our study, we implemented a web-based wireless system to facilitate the capture of participants’ gestures. In this paper we present an overview of both the study and the system used.


Mobile Device Blind People Screen Reader Impaired People Finger Count 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Rivera, J., van der Meulen, R.: Gartner Says Sales of Smartphones Grew 20 Percent in Third Quarter of 2014 Gartner. Egham, UK (2014)Google Scholar
  2. 2.
    Kane, S.K., Bigham, J.P., Wobbrock, J.O.: Slide rule: making mobile touch screens accessible to blind people using multi-touch interaction techniques. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 73–80. ACM (2008)Google Scholar
  3. 3.
    Leporini, B., Buzzi, M.C., Buzzi, M.: Interacting with mobile devices via voiceover: usability and accessibility issues. In: Proceedings of 24th Australian Computer-Human Interaction Conference, pp. 339–348 (2012)Google Scholar
  4. 4.
    Kane, S.K., Jayant, C., Wobbrock, J.O., Ladner, R.E.: Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In: Proceedings of 11th International ACM SIGACCESS (2009)Google Scholar
  5. 5.
    Buzzi, M.C., et al.: Designing a text entry multimodal keypad for blind users of touchscreen mobile phones. In: Proceedings of the 16th international ACM SIGACCESS conference on Computers and accessibility, pp. 131–136. ACM, New York (2014)Google Scholar
  6. 6.
    Rubine, D.: Specifying gestures by example. In: Proceedings of the 18th annual conference on Computer graphics and interactive techniques, pp. 329–337. ACM (1991)Google Scholar
  7. 7.
    Ruiz, J., Y. Li, Lank, E.: User-defined motion gestures for mobile interaction. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, Vancouver (2011)Google Scholar
  8. 8.
    Rekik, Y., Vatavu, R.-D., Grisoni, L.: Understanding users’ perceived difficulty of multi-touch gesture articulation. In: Proceedings of the 16th International Conference on Multimodal Interaction. ACM (2014)Google Scholar
  9. 9.
    Cerf, V.G.: Why is accessibility so hard? Commun. ACM 55(11), 7 (2012)CrossRefGoogle Scholar
  10. 10.
    Sears, A., Hanson, V.: Representing users in accessibility research. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2235–2238. ACM, Vancouver (2011)Google Scholar
  11. 11.
    Oh, U., Kane, S.K., Findlater,L.: Follow that sound: using sonification and corrective verbal feedback to teach touchscreen gestures. In: 15th International ACM SIGACCESS, pp. 13:1–13:8. ACM, New York (2013)Google Scholar
  12. 12.
    Sandnes, F., et al.: Making touch-based kiosks accessible to blind users through simple gestures. Univ. Access Inf. Soc. 11(4), 421–431 (2012)CrossRefGoogle Scholar
  13. 13.
    Schmidt, M., Weber, G.: Multitouch haptic interaction. In: Stephanidis, C. (ed.) UAHCI 2009, Part II. LNCS, vol. 5615, pp. 574–582. Springer, Heidelberg (2009)Google Scholar
  14. 14.
    Kane, S.K., Wobbrock, J.O., Ladner, R.E.: Usable gestures for blind people: understanding preference and performance. In: SIGCHI Conference, pp. 413–422 (2011)Google Scholar
  15. 15.
    Bose, A., Foh, C.H.: A practical path loss model for indoor WiFi positioning enhancement. In: 6th International Conference on Information, Communications and Signal Processing, 2007. IEEE (2007)Google Scholar
  16. 16.
    Charland, A., Leroux, B.: Mobile application development: web vs. native. Commun. ACM 54(5), 49–53 (2011)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Maria Claudia Buzzi
    • 1
    Email author
  • Marina Buzzi
    • 1
  • Barbara Leporini
    • 2
  • Amaury Trujillo
    • 1
  1. 1.IIT-CNRPisaItaly
  2. 2.ISTI-CNRPisaItaly

Personalised recommendations