Skip to main content
SpringerLink
Log in

VEN-3DVE: vision based egocentric navigation for 3D virtual environments

  • Original Paper
  • Published:
International Journal on Interactive Design and Manufacturing (IJIDeM) Aims and scope Submit manuscript

Abstract

Navigation is moving inside a virtual environment to reach to a desired object or location. This paper presents a new egocentric navigation technique for exploring a virtual scene by tracking the 3DOF moves of index finger along x, y and z axis. With image processing at backend, the finger’s position in 2D image frame is traced dynamically to travel inside the designed frontend 3D scene. Mimicking a camera in hand, the system can also support Panning. Dynamic mapping is performed to interactively follow the trajectory of index finger. For either of the interactions, movement of index finger controls orientation and position of virtual camera. Linking the libraries of OpenCV and OpenGL, the technique is implemented in a visual studio project navigation by index tracing (NBIT). With NBIT, parallel processing is performed for backend index tracking and front-end rendering of virtual scene. The system was evaluated by fourteen participants for a total of 336 trails whereas applicability of the approach in virtual reality based computer aided design was assessed by five professional designers. Un-biased statistical evaluation of the system reveals that the approach suits well for interactive virtual and augmented reality applications.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19

Similar content being viewed by others

References

  1. Gabbard, J.L.: A taxonomy of usability characteristics in virtual environments. Doctoral dissertation, Virginia Tech (1997)

  2. Tan, D.S., Robertson, G.G., Czerwinski, M.: Exploring 3D navigation: combining speed-coupled flying with orbiting. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 418–425 (2001)

  3. Di, G.G., Rocco, M., Andrea, T.: From virtual reality to web-based multimedia maintenance manuals. Int. J. Interact. Des. Manuf. (IJIDeM) 7(3), 183–190 (2013)

    Article  Google Scholar 

  4. Schlmer, T., Benjamin, P., Niels, H., Susanne, B.: Gesture recognition with a Wii controller. In: Proceedings of the 2nd International Conference on Tangible and Embedded Interaction, pp. 11–14 (2008)

  5. Konig, W.A., Jens, G., Stefan, D., Harald, R.: Adaptive pointing design and evaluation of a precision enhancing technique for absolute pointing devices. In: IFIP Conference on Human-Computer Interaction, pp. 658–671 (2009)

  6. Terziman, L., Maud, M., Mathieu, E., Franck, M., Bruno, A., Anatole, L.: Shake-your-head: revisiting walking-in-place for desktop virtual reality. In: Proceedings of the 17th ACM Symposium on Virtual Reality Software and Technology, pp. 27–34 (2010)

  7. Fiorentino, M., Rafael, R., Christian, S., Antonio, E.U., Giuseppe, M.: Design review of CAD assemblies using bimanual natural interface. Int. J. Interact. Des. Manuf. (IJIDeM) 7(4), 249–260 (2013)

    Article  Google Scholar 

  8. Malik, S., Abhishek, R., Ravin, B.: Interacting with large displays from a distance with vision-tracked multinger gestural input . In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology, pp. 43–52 (2005)

  9. Papadopoulos, C., Daniel, S., Arie, K.: Nunav3d: a touch-less, body-driven interface for 3d navigation. In: Virtual reality short papers and posters (VRW), pp. 67–68 (2012)

  10. Lee, D., Seung, Gwan L.: Vision based finger action recognition by angle detection and contour analysis. ETRI J 33(3), 415–422 (2011)

    Article  Google Scholar 

  11. Moerman, C., Damien, M., Laurent. G.: Drag’n Go: simple and fast navigation in virtual environment. In: 3D user interfaces (3DUI). In: 2012 IEEE symposium on, pp. 15–18 (2012)

  12. Tan, D.S., Robertson, G.G., Mary, C.: Exploring 3D navigation: combining speed-coupled flying with orbiting. In: Proceedings of the SIGCHI conference on Human factors in computing systems, pp. 418–425 (2001)

  13. Ajaj, R., Frdric, V., Christian, J.: Follow my Finger navigation. In: IFIP conference on human-computer interaction, pp. 228–231 (2009)

  14. Mine, M.R., Frederick P.J., Carlo H.S.: Moving objects in space: exploiting proprioception in virtual environment interaction. In: Proceedings of the 24th Annual Conference on Computer Graphics and Interactive Techniques, pp. 19–26 (1997)

  15. Pierce, J.S., Forsberg, A.S., Conway, M.J., Seung, H., Zeleznik, R.C., Mark R.M.: Image plane interaction techniques in 3D immersive environments. In: Proceedings of the Symposium on Interactive 3D Graphics, pp. 39-ff (1997)

  16. Fuhrmann, A., Dieter, S., Michael, G.: Strolling through cyberspace with your hands in your pockets: head directed navigation in virtual environments. In: Virtual Environments, pp. 216–225 (1998)

  17. Furness, T., Configuring virtual space for the super cock-pit, Human Interface Technology (HIT) Laboratory Technical Report (1989)

  18. LaViola J., Joseph J., Daniel A. F., Daniel F., and Robert Z.: Hands-free multi-scale navigation in virtual environments. In: Proceedings of the Symposium on Interactive 3D Graphics, pp. 9–15 (2001)

  19. Glueck, M., Sean A., Azam, K.: DeskCube: using physical zones to select and control combinations of 3D navigation operations. In Proceedings of the Spring Simulation Multiconference Society for Computer Simulation International, p. 200 (2010)

  20. Caputo, Fabio M., Irina M.C., Davide C., Marco D.S., Andrea, G.: Gestural interaction and navigation techniques for virtual museum experiences. In: AVI CH, pp. 32–35 (2016)

  21. Kim, J.-S., Denis, G., Kreimir, M., Francis, Q.: Finger Walking in Place (FWIP): a traveling technique in virtual environments. In: International Symposium on Smart Graphics, pp. 58–69 (2008)

  22. Radkowski, R., Christian, S.: Interactive hand gesture-based assembly for augmented reality applications. In: ACHI: The Fifth International Conference on Advances in Computer Human Interactions, IARIA, pp. 303–308 (2012)

  23. Bowman, D., Ernst, K., Joseph, J., LaViola, J., Ivan, P.: 3D User Interfaces: Theory and Practice, Course Smart eTextbook. Addison-Wesley, Boston (2004)

    Google Scholar 

  24. Reisman, Jason L., Davidson, Philip L., and Je erson Y. H.: A screen-space formulation for 2D and 3D direct manipulation. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 69–78 (2009)

  25. Phung, S.L., Abdesselam, B., Douglas, C.: A novel skin color model in YCbCr color space and its application to human face detection. In: Proceedings of International Conference on In Image Processing, vol. 1, pp. I–I (2002)

  26. Muhammad, R., Sehat, U., Sami, U.R., Ihsan, R.: Image based recognition of Pakistan sign language. J. Eng. Res. 4(1), 21–41 (2016)

    Google Scholar 

  27. Konig, W.A., Roman, R., Harald, R.: Interactive design of multimodal user interfaces. J. Multimodal User Interf. 3(3), 197–213 (2010)

    Article  Google Scholar 

  28. Marcus, A., in Jacko, J., and Spears, A.: The Human Computer Interaction Handbook; Fundamentals, evolving Technologies and Emerging Applications (Chapter 18), Taylor and Francis Group, Madison Ave, NY. (2008)

  29. Toma, M.I., Florin, G., Csaba, A.: A comparative evaluation of human interaction for design and assembly of 3D CAD models in desktop and immersive environments. Int. J. Interact. Des. Manuf. (IJIDeM) 6(3), 179–193 (2012)

    Article  Google Scholar 

  30. Seth, A., Judy, M.V., James, H.O.: Virtual reality for assembly methods prototyping: a review. Virtual Real. 15(1), 5–20 (2011)

    Article  Google Scholar 

  31. Chen, C.J., Ong, S.K., Nee, A.Y., Zhou, Y.Q.: Haptic based interactive path planning for a virtual robot arm. Int. J. Interact. Des. Manuf. (IJIDeM) 4(2), 113–123 (2010)

    Article  Google Scholar 

  32. Valentini, Pier P., Eugenio, P.: Accuracy in fingertip tracking using leap motion controller for interactive virtual applications. Int. J. Interact. Des. Manuf. (IJIDeM) 11(3), 641–650 (2017)

    Article  Google Scholar 

  33. De Luca, Livio, Tudor, D., Emilie, P., Dominique, L., Michel, B.: A complete methodology for the virtual assem-bling of dismounted historic buildings. Int. J. Interact. Des. Manuf. (IJIDeM) 8(4), 265–276 (2014)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Computer Science and IT, University of Malakand, Chakdara, Pakistan

    Muhammad Raees, Sehat Ullah & Sami Ur Rahman

Authors
  1. Muhammad Raees
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sehat Ullah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sami Ur Rahman
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Muhammad Raees.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Raees, M., Ullah, S. & Rahman, S.U. VEN-3DVE: vision based egocentric navigation for 3D virtual environments. Int J Interact Des Manuf 13, 35–45 (2019). https://doi.org/10.1007/s12008-018-0481-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12008-018-0481-9

Keywords

Search

Navigation