Exploring the Throughput Potential of In-Air Pointing

  • Michelle A. BrownEmail author
  • Wolfgang Stuerzlinger
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9732)


We present an analysis of how pointing performance in in-air un-instrumented pointing can be improved, towards throughput equal to the mouse. Pointing using a chopstick is found to achieve the highest average throughput, with 3.89 bps. This is a substantial improvement over using the finger to point at the screen. Two potential reasons for the throughput gap between chopstick and finger operation were explored: the natural curvature of human fingers and tracking issues that occurs when fingers bend toward the device. Yet, neither one of these factors seems to significantly affect throughput. Thus other, yet unexplored factors must be the cause. Lastly, the effect of unreliable click detection was also explored, as this also affects un-instrumented performance, and was found to have a linear effect.


Human-computer interaction Fitts’ law Pointing tasks Leap motion 


  1. 1.
    Arif, A.S., Stuerzlinger, W.: Predicting the cost of error correction in character-based text entry technologies. In: ACM CHI 2010, pp. 5–14 (2010)Google Scholar
  2. 2.
    Arif, A.S., Stuerzlinger, W.: User adaptation to a faulty unistroke-based text entry technique by switching to an alternative gesture set. Graphics Interface 2014, pp. 183–192 (2014)Google Scholar
  3. 3.
    Balakrishnan, R., Baude, T., Kurtenbach, G., Fitzmaurice, G.: The Rockin’Mouse: integral 3D manipulation on a plane. In: ACM CHI 1997, pp. 311–318 (1997)Google Scholar
  4. 4.
    Balakrishnan, R., MacKenzie, I.S.: Performance differences in the fingers, wrist, and forearm in computer input control. In: ACM CHI 1997, pp. 303–310 (1997)Google Scholar
  5. 5.
    Banerjee, A., Burstyn, J.: Pointable: an in-air pointing technique to manipulate out-of-reach targets on tabletops. In: ACM ITS 2011, pp. 11–20 (2011)Google Scholar
  6. 6.
    Bedikian, R.: “Understanding Latency,” Leap Motion Developer Labs (2013).
  7. 7.
    Brown, M.A., Stuerzlinger, W., Mendonça Filho, E.J.: The performance of un-instrumented in-air pointing. In: Graphics Interface 2014, pp. 59–66 (2014)Google Scholar
  8. 8.
    Das, K., Borst, C.W.: An evaluation of menu properties and pointing techniques in a projection-based VR environment. In: IEEE 3DUI 2010, pp. 47–50 (2010)Google Scholar
  9. 9.
    Gallo, L., Placitelli, A., Ciampi, M.: Controller-free exploration of medical image data: experiencing the kinect. In: Computer-Based Medical Systems 2011, pp. 1–6 (2011)Google Scholar
  10. 10.
    Gokturk, M., Sibert, J.L.: An analysis of the index finger as a pointing device. In: Extended Abstracts ACM CHI 1999, p. 286 (1999)Google Scholar
  11. 11.
    Grossman, T., Balakrishnan, R.: Pointing at trivariate targets in 3D environments. In: ACM CHI 2004, pp. 447–454 (2004)Google Scholar
  12. 12.
    Von Hardenberg, C., Bérard, F.: Bare-hand human-computer interaction. In: Workshop on Perceptive User Interfaces 2001 (2001)Google Scholar
  13. 13.
    Jota, R., Nacenta, M., Jorge, J.: A comparison of ray pointing techniques for very large displays. In: Graphics Interface 2010, pp. 269–276 (2010)Google Scholar
  14. 14.
    Kolaric, S., Raposo, A., Gattass, M.: Direct 3D manipulation using vision-based recognition of uninstrumented hands. In: Symposium on Virtual and Augmented Reality 2008, pp. 212–220 (2008)Google Scholar
  15. 15.
    Kunert, A., Kulik, A., Lux, C., Fröhlich, B.: Facilitating system control in ray-based interaction tasks. In: ACM Symposium VRST 2009, pp. 183–186 (2009)Google Scholar
  16. 16.
    ISO 9241-9 Ergonomic requirements for office work with visual display terminals (VDTs)-Part 9: Requirements for non-keyboard input devices, ISO (2000)Google Scholar
  17. 17.
    MacKenzie, I.S.: Fitts’ law as a research and design tool in human-computer interaction. Hum. Comput. Interact. 7(1), 91–139 (1992)MathSciNetCrossRefGoogle Scholar
  18. 18.
    MacKenzie, I., Jusoh, S.: An evaluation of two input devices for remote pointing. In: Nigay, L., Little, M. (eds.) EHCI 2001. LNCS, vol. 2254, pp. 235–250. Springer, Heidelberg (2001)CrossRefGoogle Scholar
  19. 19.
    Matikainen, P., Pillai, P., Mummert, L., Sukthankar, R., Hebert, M.: Prop-free pointing detection in dynamic cluttered environments. In: Face and Gesture 2011, pp. 374–381 (2011)Google Scholar
  20. 20.
    Oakley, I., Sunwoo, J., Cho, I.-Y.: Pointing with fingers, hands and arms for wearable computing. In: Extended Abstracts ACM CHI 2008, pp. 3255–3260 (2008)Google Scholar
  21. 21.
    Oh, J., Stuerzlinger, W.: Laser pointers as collaborative pointing devices. In: Graphics Interface 2002, pp. 141–149 (2002)Google Scholar
  22. 22.
    Pavlovych, A., Stuerzlinger, W.: The tradeoff between spatial jitter and latency in pointing tasks. In: ACM EICS 2009, pp. 187–196 (2009)Google Scholar
  23. 23.
    Sharp, T., Keskin, C., Robertson, D., Taylor, J., Shotton, J., Kim, D., Rhemann, C., Leichter, I., Vinnikov, A., Wei, Y., Freedman, D., Kohli, P., Krupka, E., Fitzgibbon, A., and Izadi, S.: Accurate, robust, and flexible real-time hand tracking. In: ACM CHI 2015, pp. 3633–3642 (2015)Google Scholar
  24. 24.
    Song, P., Yu, H., Winkler, S.: Vision-based 3D finger interactions for mixed reality games with physics simulation. In: ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry 2008, article no. 7 (2008)Google Scholar
  25. 25.
    Soukoreff, R.W., MacKenzie, I.S.: Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts’ law research in HCI. IJHCS 61(6), 751–789 (2004)Google Scholar
  26. 26.
    Teather, R.J., Pavlovych, A., Stuerzlinger, W. MacKenzie, I.S.: Effects of tracking technology, latency, and spatial jitter on object movement. In: IEEE Symposium 3DUI 2009, pp. 43–50 (2009)Google Scholar
  27. 27.
    Teather, R.J., Stuerzlinger, W.: Pointing at 3D targets in a stereo head-tracked virtual environment. In: IEEE Symposium 3DUI 2011, pp. 87–94 (2011)Google Scholar
  28. 28.
    Teather, R.J., Stuerzlinger, W.: Pointing at 3D target projections with one-eyed and stereo cursors. In: ACM CHI 2013, pp. 159–168 (2013)Google Scholar
  29. 29.
    Vogel, D., Balakrishnan, R.: Distant freehand pointing and clicking on very large, high resolution displays. In: ACM UIST 2005, pp. 33–42 (2005)Google Scholar
  30. 30.
    Wingrave, C., Bowman, D.: Baseline factors for raycasting selection. In: HCI International 2005 (2005)Google Scholar
  31. 31.
    Wobbrock, J.O., Findlater, L., Gergle, D., Higgins, J.J.: The aligned rank transform for nonparametric factorial analyses using only ANOVA procedures. In: ACM CHI 2011, pp. 143–146 (2011)Google Scholar
  32. 32.
    Wobbrock, J.O., Shinohara, K., Jansen, A.: The effects of task dimensionality, endpoint deviation, throughput calculation, and experiment design on pointing measures and models. In: ACM CHI 2011, pp. 1639–1648 (2011)Google Scholar
  33. 33.
    Zigelbaum, J., Browning, A., Leithinger, D., Bau, O., Ishii, H.: G-stalt: a chirocentric, spatiotemporal, and telekinetic gestural interface. In: ACM TEI 2010, pp. 261–264 (2010)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  1. 1.AkendiTorontoCanada
  2. 2.Simon Fraser UniversityBurnabyCanada

Personalised recommendations