Potential Limitations of Multi-touch Gesture Vocabulary: Differentiation, Adoption, Fatigue

  • Wendy Yee
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5611)


The majority of gestural interactions in consumer electronics currently represent “direct” gestures related to the direct manipulation of onscreen objects. As gestural interactions extend beyond consumer electronics and become more prevalent in productivity applications, these gestures will need to address more abstract or “indirect” actions. This paper addresses some of the usability concerns associated with indirect gestures and their potential limitations for the typical end-user. In addition, it outlines a number of considerations for the integration of abstract gestures with productivity workspaces.


Interaction design multi-touch software design gestures 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Green, K.: Touch screens for many fingers. Technology Review, January 18 (2007),
  2. 2.
    Goldin-Meadow, S.: The resilience of language: What gesture creation in deaf children can tell us about how all children learn language, p. 262. Psychology Press, New York (2003)Google Scholar
  3. 3.
    Buxton, B.: Multi-touch systems I have known and loved,
  4. 4.
  5. 5.
  6. 6.
    Apple: MacBook Air and MacBook Pro (early 2008): Useful keyboard and trackpad tips and shortcuts. Support article HT1115,
  7. 7.
    Apple: MacBook: Using the trackpad Support article HT3211. kb/HT3211,
  8. 8.
    Fingerworks iGesture Keypad,
  9. 9.
  10. 10.
    Keates, S., Robinson, P.: The use of gestures in multimodal input. In: FACM SIGACCESS Conference on Assistive Technologies archive. Proceedings of the third international ACM conference on Assistive Technologies, pp. 35–42 (1998)Google Scholar
  11. 11.
    Hummels, C., Staplers, P.J.: Meaningful gestures for human computer interaction: Beyond Hand Posters. In: Proceedings of the 3rd International Conference on Automatic Face & Gestures Recognition (FG 1998), pp. 591–596. IEEE Computer Society Press, Los Alamitos (1998)CrossRefGoogle Scholar
  12. 12.
    Nielsen, M., Storring, M., Moeslund, T.B., Granum, E.: Procedure for developing intuitive and ergonomic gesture interfaces. Technical Report CVMT 03-01 (2003)Google Scholar
  13. 13.
    Karam, M., Schraefel, M.C.: Investigating user tolerance for errors in vision-enabled gestural interactions. In: Proceedings of the working conference on Advanced Visual interfaces table of contents, 225–232 (2006)Google Scholar
  14. 14.
    Pavlovic, V., Sharman, R., Huang, T.: Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review. IEEE Transactions on Pattern Analysis and Machine Intelligence 19(7), 677–695 (1997)CrossRefGoogle Scholar
  15. 15.
    Saffer, D.: Designing Gestural Interfaces, 1st edn. O’Reilly Media, Sebastopol (2008)Google Scholar
  16. 16.
    Elias, J.G., Westerman, W.C., Haggerty, M.M.: Multi-Touch Gesture Dictionary. US Patent Application 20070177803 (2007)Google Scholar
  17. 17.
  18. 18.
    Tse, E., Shen, C., Greenberg, S., and Forlines, C.: Enabling Interaction with Single User Applications through Speech and Gestures on a Multi-User Tabletop. Advanced Visual Interfaces (AVI) (2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Wendy Yee
    • 1
  1. 1.User Centric, Inc.Oakbrook TerraceUSA

Personalised recommendations