AirMouse: Finger Gesture for 2D and 3D Interaction

  • Michael Ortega
  • Laurence Nigay
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5727)


This paper presents AirMouse, a new interaction technique based on finger gestures above the laptop’s keyboard. At a reasonably low cost, the technique can replace the traditional methods for pointing in two or three dimensions. Moreover, the device-switching time is reduced and no additional surface than the one for the laptop is needed. In a 2D pointing evaluation, a vision-based implementation of the technique is compared with commonly used devices. The same implementation is also compared with the two most commonly used 3D pointing devices. The two user experiments show the benefits of the polyvalent technique: it is easy to learn, intuitive and efficient by providing good performance. In particular, our conducted experiment shows that performance with AirMouse is promising in comparison with a touchpad and with dedicated 3D pointing devices. It shows that AirMouse offers better performance as compared to FlowMouse, a previous solution using fingers above the keyboard.


AirMouse interaction 2D/3D pointing computer vision Fitts’ law 


  1. 1.
    Smith, R.B.: Put-that-here: Voice and gesture at the graphics interface. Computer Graphics 14, 262–270 (1980)CrossRefGoogle Scholar
  2. 2.
    Bowman, D.A., Kruijff, E., LaViola, J.J., Poupyrev, I.: 3D User Interfaces: Theory and Practice. Addison-Wesley Professional, Reading (2005)Google Scholar
  3. 3.
    Card, S.K., English, W.K., Burr, B.J.: Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a crt. In: Human-Computer Interaction, pp. 386–392. Morgan Kaufmann Publishers Inc, San Francisco (1978)Google Scholar
  4. 4.
    Card, S.K., Morans, T.P., Newell, A.: The Psychology of Human Computer Interaction. Lawrence Erlbaum Associates, Inc, Mahwah (1983)Google Scholar
  5. 5.
    3D Connexion. Space navigator,
  6. 6.
    Dementhon, D., Davis, L.S.: Model-based object pose in 25 lines of code. International Journal on Computer Vision (1995)Google Scholar
  7. 7.
    Douglas, S.A., Mithal, A.K.: The effect of reducing homing time on the speed of a finger-controlled isometric pointing device. In: Computer-Human Interaction, pp. 411–416. ACM Press, New York (1994)Google Scholar
  8. 8.
    Fitts, P.M.: The information capacity of the human motor system in controlling the amplitude of movement. Journal of Experimental Psychology 47(6), 381–391 (1954)CrossRefGoogle Scholar
  9. 9.
    Grossman, T., Widgor, D., Balakrishnan, R.: Multi-finger gestural interaction with 3d volumetric displays. In: User Interface Software and Technology. ACM Press, New York (2004)Google Scholar
  10. 10.
    Han, J.Y.: Low-cost multi-touch sensing through frustrated total internal reflection. In: Symposium on User Interface Software and Technology. ACM Press, New York (2005)Google Scholar
  11. 11.
    Hancock, M., Carpendale, S., Cockburn, A.: Shallow-depth 3d interaction: Design and evaluation of one-, two- and three-touch techniques. In: Computer-Human Interaction (2007)Google Scholar
  12. 12.
  13. 13.
    Iddan, G.J., Yahav, G.: 3d imaging in the studio. SPIE (2001),
  14. 14.
    Jacob, R.J.K., Sibert, L.E.: The perceptual structure of multidimensional input device selection. In: SIGCHI conference on Human factors in computing systems (1992)Google Scholar
  15. 15.
    Kabbash, P., Buxton, W.: The “prince” technique: Fitts’ law and selection using area cursors. In: Computer-Human Interaction, pp. 273–279 (1995)Google Scholar
  16. 16.
    MacKenzie, I.S., Sellen, A., Buxton, W.: A comparison of input devices in elemental pointing and dragging tasks. In: Computer-Human Interaction, pp. 161–166 (1991)Google Scholar
  17. 17.
    Malik, S., Laszlo, J.: Visual touchpad: A two-handed gestural input device. In: ICMI (2004)Google Scholar
  18. 18.
    Massie, T.H., Salisbury, J.K.: The phantom haptic interface: A device for probing virtual objects. In: Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. ASME winter Meeting (1994)Google Scholar
  19. 19.
    Mysliwiec, T.A.: Fingermouse: A freehand computer pointing interface. Technical report for the degree of Masters of Science (October 1994)Google Scholar
  20. 20.
    Paljic, A., Burkhardt, J., Coquillart, S.: A study of distance of manipulation on the responsive workbench (2002)Google Scholar
  21. 21.
    Pierce, J.S., Stearns, B.C., Pausch, R.: Voodoo dolls: Seamless interaction at multiple scales in virtual environments. In: Symposium on Interactive 3D graphics (1999)Google Scholar
  22. 22.
    Qhueck, F.K.H.: Unencumbered gestural interaction. In: IEEE Multimedia (Winter 996)Google Scholar
  23. 23.
    Schneiderman, B.: Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley Longman Publishing Co., Inc, Amsterdam (1986)Google Scholar
  24. 24.
    Shneiderman, B.: The future of interactive systems and the emergence of direct manipulation. Human Factors in Interactive Computer Systems (1983)Google Scholar
  25. 25.
    Soukoreff, R.W., MacKenzie, I.S.: Towards a standard for pointing device evaluation, perspectives on 27 years of fitts’ law research in hci. International Journal of Human-Computer Studies 61, 751–789 (2004)CrossRefGoogle Scholar
  26. 26.
    Tory, M., Moller, T., Atkins, M.S., Kirkpatrick, A.E.: Combining 2d and 3d views for orientation and relative position tasks. In: CHI 2004: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 73–80. ACM Press, New York (2004)CrossRefGoogle Scholar
  27. 27.
    Vogel, D., Balakrishnan, R.: Distant freehand pointing and clicking on very large, high resolution displays. In: User Interface Software and Technology (2005)Google Scholar
  28. 28.
    Wilson, A.D.: Robust computer vision-based detection of pinching for one and twohanded gesture input. In: User Interface Software and Technology. ACM Press, New York (2006)Google Scholar
  29. 29.
    Wilson, A.D., Cutrell, E.: Flowmouse: A computer vision-based pointing and gesture input device. In: INTERACT: human-computer interaction (2005)Google Scholar
  30. 30.
    Zhai, S.: Human Performance in 6dof Input Control. PhD Thesis (1995)Google Scholar
  31. 31.
    Zhai, S., Milgram, P.: Quantifying coordination in multiple dof movement and its application to evaluating 6 dof input devices. In: Computer-Human Interaction, pp. 320–327. ACM Press, New York (1998)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2009

Authors and Affiliations

  • Michael Ortega
    • 1
  • Laurence Nigay
    • 2
  1. 1.PRIMA - INRIA Rhône-AlpesFrance
  2. 2.IIHM - University of Grenoble, CNRS, LIGFrance

Personalised recommendations