Design and Evaluation of Freehand Gesture Interaction for Light Field Display

  • Vamsi Kiran Adhikarla
  • Grega JakusEmail author
  • Jaka Sodnik
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9170)


The paper reports on a user study of freehand gesture interaction with a prototype of autostereoscopic 3D light field display. The interaction was based on a direct touch selection of simple objects rendered at different positions in space. The main goal of our experiment was to evaluate the overall user experience and perceived cognitive workload of such freehand interaction in 3D environment and compare it to the simplified touch-based interaction in 2D environment. The results of the experiment confirmed the hypothesis that significantly more time is required for the interaction in 3D than the interaction in 2D. Surprisingly, no significant difference was found in the results of the assessment of cognitive workload when comparing 3D and 2D. We believe the interaction scenario proposed and evaluated in this study could represent an efficient and intuitive future interaction technique for the selection and manipulation of content rendered on autostereoscopic 3D displays


3D display Light field display Free-hand interaction Direct touch Leap Motion Controller Human-machine interface (HMI) Human-computer interface (HCI) 



The research leading to these results has received funding from the DIVA Marie Curie Action of the People programme of the European Union’s Seventh Framework Programme FP7/2007–2013/ under REA grant agreement 290227.


  1. 1.
    Agocs, T., Balogh, T., Forgacs, T., Bettio, F., Gobbetti, E., Zanetti, G., Bouvier, E.: A large scale interactive holographic display. In: IEEE Virtual Reality Conference (VR 2006), p. 57. Washington, DC, USA (2006)Google Scholar
  2. 2.
    Balogh, T., Kovács, P.T., Megyesi, Z., Barsi, A.: HoloVizio – true 3D display system. In: 3DTV Conference, pp. 1–4 (2007)Google Scholar
  3. 3.
    Guna, J., Jakus, G., Pogačnik, M., Tomažič, S., Sodnik, J.: An analysis of the precision and reliability of the leap motion sensor and its suitability for static and dynamic tracking. Sensors 14, 3702–3720 (2014)CrossRefGoogle Scholar
  4. 4.
    Bruder, G., Steinicke, F., Sturzlinger, W.: To touch or not to touch?: Comparing 2D touch and 3D mid-air interaction on stereoscopic tabletop surfaces. In: Proceedings of the 1st Symposium on Spatial User Interaction, pp. 9–16. ACM (2013)Google Scholar
  5. 5.
    Grossman, T., Wigdor, D., Balakrishnan, R.: Multi-finger gestural interaction with 3D volumetric displays. In: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology, pp. 61 – 70. ACM, New York (2004)Google Scholar
  6. 6.
    Wang, R., Paris, S., Popović, J.: 6D hands: markerless hand-tracking for computer aided design. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 549–558. ACM (2011)Google Scholar
  7. 7.
    Butler, A., Hilliges, O., Izadi, S., Hodges, S., Molyneaux, D., Kim, D., Kong, D.: Vermeer: direct interaction with a 360 viewable 3D display. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, pp. 569–576. ACM (2011)Google Scholar
  8. 8.
    Chan, L.W., Kao, H.S., Chen, M.Y., Lee, M.S., Hsu, J., Hung, Y.P.: Touching the void: direct-touch interaction for intangible displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2625–2634. ACM (2010)Google Scholar
  9. 9.
    Vogel, D., Balakrishnan, R.: Distant free hand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, UIST 2005, pp. 33–42. ACM, New York (2005)Google Scholar
  10. 10.
    Hilliges, O., Kim, D., Izadi, S., Weiss, M., Wilson, A.: HoloDesk: direct 3D interactions with a situated see-through display. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 2421–2430. ACM (2012)Google Scholar
  11. 11.
    Ren, Z., Yuan, J., Meng, J., Zhang, Z.: Robust part-based hand gesture recognition using kinect sensor. IEEE Trans. Multimedia 15, 1110–1120 (2013)CrossRefGoogle Scholar
  12. 12.
    Leap Motion Controller.
  13. 13.
    Fanini, B.: A 3D interface to explore and manipulate multi-scale virtual scenes using the leap motion controller. In: Proceedings of ACHI 2014, the Seventh International Conference on Advances in Computer-Human Interactions, pp. 258–263 (2014)Google Scholar
  14. 14.
    Apostolellis, P., Bortz, B., Peng, M., Polys, N., Hoegh, A.: Poster: exploring the integrality and separability of the leap motion controller for direct manipulation 3D interaction. In: IEEE Symposium on 3D User Interfaces (3DUI), pp. 153–154. IEEE (2014)Google Scholar
  15. 15.
    Coelho, J. C., Verbeek, F. J.: Pointing task evaluation of leap motion controller in 3d virtual environment. In: Creating the Difference: Proceedings of the Chisparks 2014 Conference, pp. 78–85. The Hague, The Netherlands (2014)Google Scholar
  16. 16.
    Hart, S.G., Staveland, L.E.: Development of a multi-dimensional workload rating scale: results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload, pp. 139–183. Elsevier, Amsterdam (1988)CrossRefGoogle Scholar
  17. 17.
    Laugwitz, B., Held, T., Schrepp, M.: Construction and Evaluation of a User Experience Questionnaire. Springer, Heidelberg (2008)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Vamsi Kiran Adhikarla
    • 1
    • 2
  • Grega Jakus
    • 3
    Email author
  • Jaka Sodnik
    • 3
  1. 1.HolografikaBudapestHungary
  2. 2.Pazmany Peter Catholic UniversityBudapestHungary
  3. 3.University of LjubljanaLjubljanaSlovenia

Personalised recommendations