Gesture Interactions for Virtual Immersive Environments: Navigation, Selection and Manipulation

  • Paulo DiasEmail author
  • João Pinto
  • Sérgio Eliseu
  • Beatriz Sousa Santos
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9740)


This paper presents an extension to a Platform for Setting-Up Virtual environments with the purpose of allowing gesture interaction. The proposed solution maintains the flexibility of the original framework as well as content association (PDF, Video, Text), but allows new interactions based on gestures. An important feature is the one to one navigational input based on Kinect skeleton tracking. The framework was used to configure a virtual museum art installation using a real museum room where the user can move freely and interact with virtual contents by adding and manipulating 3D models. Two user studies were performed to compare gestures against button-controlled interactions for navigation and 3D manipulation. Most users preferred the Kinect-based navigation and gesture-based interaction despite some learning difficulties and tracking problems. Regarding manipulation, the gesture-based method was significantly faster with similar accuracy when compared to the controller. On the other hand, when dealing with rotations, the controller-based method was faster.


Virtual Reality Navigation and manipulation in virtual environments Gestural interaction Kinect 3duis User study 



The authors are grateful to all volunteer participants. This work was partially funded by National Funds through FCT - Foundation for Science and Technology, in the context of the projects UID/CEC/00127/2013 and Incentivo/EEI/UI0127/2014.


  1. 1.
    Souza, D., Dias, P., Sousa Santos, B.: Choosing a selection technique for a virtual environment. In: Shumaker, R., Lackey, S. (eds.) VAMR 2014, Part I. LNCS, vol. 8525, pp. 215–225. Springer, Heidelberg (2014)Google Scholar
  2. 2.
    Hernandez, L., Taibo, J., Seoane, A., López, R., López, R.: The empty museum. Multi-user interaction in an immersive and physically walkable VR space. In: Proceedings of International Conference on Cyberworlds, pp. 446–452. IEEE Computer Society (2003)Google Scholar
  3. 3.
    DCNS Training School - A virtual environment interfaced with an e-learning platform (2013).
  4. 4.
    Bobick, A.B., Intille, S.S., Davis, J.W., Baird, F., Pinhanez, C.S., Lee, W., Campbell, L.W., Ivanov, Y.A., Schütte, A., Wilson, A.: The KidsRoom: a perceptually-based interactive and immersive story environment. Teleoperators Virtual Environ. 8(4), 367–391 (1999)Google Scholar
  5. 5.
    Wang, R., Qian, X.: OpenSceneGraph 3.0: Beginner’s Guide. Packt Publishing, New York (2010)Google Scholar
  6. 6.
    Bierbaum, A., Just, C., Hartling, P., Meinert, K., Baker, A., Carolina Cruz-Neira., C.: Vr juggler: A virtual platform for virtual reality application development. In: Proceedings of the Virtual Reality 2001 Conference (VR 2001), VR 2001, p. 89, Washington, DC, USA. IEEE Computer Society (2001)Google Scholar
  7. 7.
    Taylor, R.M.II, Hudson, T.C., Seeger, A., Weber, H., Juliano, J., Helser, A.T.: Vrpn: A device-independent, network-transparent vr peripheral system. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, VRST 2001, pp. 55–61. ACM, New York, NY, USA (2001)Google Scholar
  8. 8.
    Schroeder, W., Kenneth, M.M., Lorensen, W.E.: The Visualization Toolkit: An Object-oriented Approach to 3D Graphics, 2nd edn. Prentice-Hall, Upper Saddle River, NJ, USA (1998)Google Scholar
  9. 9.
    Cardoso, J.: 3D manipulation and navigation methods with gestures for large displays. Master thesis. Universidade de Aveiro, Portugal (2015)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Paulo Dias
    • 1
    • 2
    Email author
  • João Pinto
    • 1
  • Sérgio Eliseu
    • 3
  • Beatriz Sousa Santos
    • 1
    • 2
  1. 1.DETI/UA- Department of ElectronicsTelecommunications and InformaticsAveiroPortugal
  2. 2.IEETA- Institute of Electronics and Informatics Engineering of AveiroUniversity of AveiroAveiroPortugal
  3. 3.3iD+ / I2ADS - Faculty of Fine ArtsUniversity of PortoPortoPortugal

Personalised recommendations