Haptic and Touchless User Input Methods for Simple 3D Interaction Tasks: Interaction Performance and User Experience for People with and Without Impairments

  • Mirjam AugsteinEmail author
  • Thomas Neumayr
  • Thomas Burger
  • Josef Altmann
  • Werner Kurschl
  • Stephan Vrecer
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 997)


The sense of touch is of crucial importance for humans, especially those with impairments. Traditionally, most input devices (e.g., mice, joysticks or touchpads) accounted for this by involving at least a certain amount of a haptic experience during human-computer interaction processes. However, during the past years, also touchless input devices that enable user input without physical contact between human and device, became popular and available for mass markets. While these input devices such as Microsoft Kinect or the Leap motion controller bear high potential for certain settings (e.g., therapeutic ones) and usually support more than two degrees of freedom, they also involve new challenges like missing borders and thus physical restrictions of the interaction space. This chapter summarizes two investigations around the actual relevance of a haptic experience in user input for people with and without known impairments. Both studies focused on simple input tasks in a 3D interaction space and involve an analysis of interaction performance and User Experience, comparing three input devices with varying amount of haptics.


Haptic interaction Touchless interaction Comparative study 


  1. 1.
    Atkins, M.S., Fernquist, J., Kirkpatrick, A.E., Forster, B.B.: Evaluating interaction techniques for stack mode viewing. J. Digit. Imaging 22(4), 369–382 (2009)CrossRefGoogle Scholar
  2. 2.
    Augstein, M., Kern, D., Neumayr, T., Kurschl, W., Altmann, J.: Measuring physical pressure in smart phone interaction for people with impairments. In: Mensch und Computer 2015, Workshopband. Oldenbourg Wissenschaftsverlag, Stuttgart (2015)Google Scholar
  3. 3.
    Augstein, M., Neumayr, T., Burger, T.: The role of haptics in user input for people with motor and cognitive impairments. In: Harnessing the Power of Technology to Improve Lives. Studies in Health Technology and Informatics, vol. 242, pp. 183–194 (2017). Reprinted with permission from IOS PressGoogle Scholar
  4. 4.
    Augstein, M., Neumayr, T., Kern, D., Kurschl, W., Altmann, J., Burger, T.: An analysis and modeling framework for personalized interaction. In: IUI 2017 Companion: Proceedings of the 22nd International Conference on Intelligent User Interfaces, Limassol, Cyprus (2017)Google Scholar
  5. 5.
    Augstein, M., Neumayr, T., Vrecer, S., Kurschl, W., Altmann, J.: The role of haptics in user input for simple 3D interaction tasks. An analysis of interaction performance and user experience. In: Proceedings of the 2nd International Conference on Human Computer Interaction Theory and Applications, Funchal, Madeira, Portugal (2018)Google Scholar
  6. 6.
    de la Barré, R., Chojecki, P., Leiner, U., Mühlbach, L., Ruschin, D.: Touchless interaction-novel chances and challenges. In: Jacko, J.A. (ed.) HCI 2009. LNCS, vol. 5611, pp. 161–169. Springer, Heidelberg (2009). Scholar
  7. 7.
    Bowman, D., et al.: 3D user interfaces: new directions and perspectives. IEEE Comput. Graph. Appl. 28(6), 20–36 (2008)CrossRefGoogle Scholar
  8. 8.
    Carter, T., Seah, S.A., Long, B., Drinkwater, B., Subramania, S.: Urtra haptics: multi-point mid-air haptic feedback for touch surfacces. In: Proceedings of the 26th Annual ACM UIST Symposium. ACM (2013)Google Scholar
  9. 9.
    Coelho, J.C., Verbeek, F.: Pointing task evaluation of leap motion controller in 3D virtual environment. In: Proceedings of the ChiSparks 2014 Conference, The Hague, Netherlands (2014)Google Scholar
  10. 10.
    Dangeti, S., Chen, Y.V., Zheng, C.: Comparing bare-hand-in-air gesture and object-in-hand tangible user interaction for navigation of 3D objects in modeling. In: Proceedings of the TEI 2016. ACM (2016)Google Scholar
  11. 11.
    Fröhlich, B., Hochstrate, J., Kulik, A., Huckauf, A.: On 3D input devices. IEEE Comput. Graph. Appl. 26(2), 15–19 (2006)CrossRefGoogle Scholar
  12. 12.
    Hürst, W., Helder, M.: Mobile 3D graphics and virtual reality interaction. In: Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology, p. 28. ACM (2011)Google Scholar
  13. 13.
    Hwang, S., Bianchi, A., Ahn, M., Wohn, K.: MagPen: magnetically driven pen interaction on and around conventional smartphones. In: Proceedings of the 15th International Conference on Human-Computer Interaction with Mobile Devices and Services, Munich, Germany (2013)Google Scholar
  14. 14.
    Laugwitz, B., Held, T., Schrepp, M.: Construction and evaluation of a user experience questionnaire. In: Holzinger, A. (ed.) USAB 2008. LNCS, vol. 5298, pp. 63–76. Springer, Heidelberg (2008). Scholar
  15. 15.
    Rehg, J.M., Kanade, T.: Visual tracking of high DOF articulated structures: an application to human hand tracking. In: Eklundh, J.-O. (ed.) ECCV 1994. LNCS, vol. 801, pp. 35–46. Springer, Heidelberg (1994). Scholar
  16. 16.
    Salminen, K., et al.: Emotional and behavioral responses to haptic stimulation. In: Proceedings of CHI 2008. ACM (2008)Google Scholar
  17. 17.
    Stannus, S., Rolf, D., Lucieer, A., Chinthammit, W.: Gestural navigation in Google earth. In: Proceedings of the 23rd Australian Computer-Human Interaction Conference (2011)Google Scholar
  18. 18.
    Tscharn, R., et al.: User experience of 3D map navigation - bare-hand interaction or touchable device? In: Mensch und Computer 2016. GI (2016)Google Scholar
  19. 19.
    Zhai, S.: Human performance in six degree of freedom input control. Ph.D. thesis, University of Toronto (2008)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Mirjam Augstein
    • 1
    Email author
  • Thomas Neumayr
    • 1
  • Thomas Burger
    • 2
  • Josef Altmann
    • 1
  • Werner Kurschl
    • 1
  • Stephan Vrecer
    • 1
  1. 1.University of Applied Sciences Upper AustriaHagenbergAustria
  2. 2.LIFEtoolLinzAustria

Personalised recommendations