Journal on Multimodal User Interfaces

, Volume 8, Issue 2, pp 187–197 | Cite as

Improving awareness for 3D virtual collaboration by embedding the features of users’ physical environments and by augmenting interaction tools with cognitive feedback cues

  • Thierry Duval
  • Thi Thuong Huyen Nguyen
  • Cédric Fleury
  • Alain Chauffaut
  • Georges Dumont
  • Valérie Gouranton
Original Paper


The feeling of presence is essential for efficient interaction within Virtual Environments (VEs). When a user is fully immersed within a VE through a large immersive display system, his/her feeling of presence can be altered because of disturbing interactions with his/her physical environment, such as collision with hardware parts of the system or loss of tracking. This alteration can be avoided by taking into account the physical features of the user as well as those of the system hardware and embedding them in the VE. Moreover, the 3D abstract representation of these physical features can also be useful for collaboration between distant users because they can make a user aware of the physical limitations of the others he/she is collaborating with. In this paper we present how we use the Immersive Interactive Virtual Cabin (IIVC) model to obtain this virtual representation of the user’s physical environment and we illustrate how this representation can be used in a collaborative navigation task in a VE. We also present how we can add 3D representations of 2D interaction tools in order to cope with asymmetrical collaborative configurations, providing 3D cues for a user to understand the actions of the others even if he/she is not fully immersed in the shared VE. Last, we briefly explain how we plan to enhance 3D interaction and collaboration by embedding a symbolic 3D user representation that will give 3D information about his/her posture.


3D Collaborative virtual environments Awareness of collaboration Perception of the physical workspaces of the users 



We thank Foundation Rennes 1 “Progress, Innovation, Entrepreneurship” and the European Project VISIONAIR (grant agreement 262044) for their support.


  1. 1.
    Aguerreche L, Duval T, Lécuyer A (2009) 3-hand manipulation of virtual objects. In: Proceedings of JVRC (Joint virtual reality conference of EGVE - ICAT - EuroVR), pp 153–156Google Scholar
  2. 2.
    Bacim F, Ragan ED, Stinson C, Scerbo S, Bowman DA (2012) Collaborative navigation in virtual search and rescue. In: Proceedings of IEEE symposium on 3D user interfaces. IEEE Computer Society, pp 187–188Google Scholar
  3. 3.
    Baranyi P, Csapo A (2012) Definition and synergies of cognitive infocommunications. Acta Polytechnica Hungarica 9(1):67–83Google Scholar
  4. 4.
    Benford S, Bowers J, Fahlén LE, Greenhalgh C (1994) Managing mutual awareness in collaborative virtual environments. In: Proceedings of VRST, pp 223–236Google Scholar
  5. 5.
    Benford S., Greenhalgh C, Rodden T, Pycock J (2001) Collaborative virtual environments. Commu ACM 44(7):79–85. doi: 10.1145/379300.379322 Google Scholar
  6. 6.
    Bowman D, Coquillart S, Froehlich B, Hirose M, Kitamura Y, Kiyokawa K, Stuerzlinger W (2008) 3D user interfaces: new directions and perspectives. Comput Graphics Appl IEEE 28(6):20–36CrossRefGoogle Scholar
  7. 7.
    Bowman DA, Johnson DB, Hodges LF (1999) Testbed evaluation of virtual environment interaction techniques. In: Proceedings of the ACM symposium on Virtual reality software and technology, VRST ’99. ACM, New York, pp 26–33Google Scholar
  8. 8.
    Bowman DA, Kruijff E, LaViola JJ, Poupyrev I (2004) 3D User interfaces: theory and practice. Addison Wesley, RedwoodGoogle Scholar
  9. 9.
    Butterworth J, Davidson A, Hench S, Olano MT (1992) 3DM: a three dimensional modeler using a head-mounted display. In: Proceedings of the symposium on interactive 3D graphics, pp 135–138Google Scholar
  10. 10.
    Cabral M, Roque G, Santos D, Paulucci L, Zuffo M (2012) Point and go: exploring 3d virtual environments. In: Proceedings of IEEE symposium on 3D user interfaces. IEEE Computer Society, pp 183–184Google Scholar
  11. 11.
    Churchill EF, Snowdon DN, Munro AJ (2001) Collaborative virtual environments: digital places and spaces for interaction. Springer, LondonCrossRefGoogle Scholar
  12. 12.
    Cirio G, Marchal M, Regia-Corte T, Lécuyer A (2009) The magic barrier tape: a novel metaphor for infinite navigation in virtual worlds with a restricted walking workspace. In: Proceedings of VRST, pp 155–162Google Scholar
  13. 13.
    Cruz-Neira C, Sandin DJ, DeFanti TA (1993) Surround-screen projection-based virtual reality: the design and implementation of the cave. In: Proceedings of SIGGRAPH’93. ACM, New York, pp 135–142Google Scholar
  14. 14.
    Dumas C, Degrande S, Saugis G, Chaillou C, Viaud ML, Plenacoste P (1999) Spin: a 3d interface for cooperative work. Virtual Reality Soc JGoogle Scholar
  15. 15.
    Dupont F, Duval T, Fleury C, Forest J, Gouranton V, Lando P, Laurent T, Lavoué G, Schmutz A (2010) Collaborative scientific visualization: The COLLAVIZ framework. In: JVRC DemosGoogle Scholar
  16. 16.
    Duval T, Fleury C (2009) An asymmetric 2d pointer/3d ray for 3d interaction within collaborative virtual environments. In: Web3D’09: Proceedings of the 14th international conference on 3D web technology. ACM, New York, pp 33–41Google Scholar
  17. 17.
    Duval T, Fleury C (2011) Collaboration between networked heterogeneous 3d viewers through a pac-c3d modeling of the shared virtual environment. In: Proceedings of ICATGoogle Scholar
  18. 18.
    Duval T, Nguyen TTH, Fleury C, Chauffaut A, Dumont G, Gouranton V (2012) Embedding the features of the users’ physical environments to improve the feeling of presence in collaborative virtual environments. In: CogInfoCom 2012 (3rd IEEE international conference on cognitive infocommunications). Kosice, Slovakia, pp 243–248Google Scholar
  19. 19.
    Fleury C, Chauffaut A, Duval T, Gouranton V, Arnaldi B (2011) A generic model for embedding users’ physical workspaces into multi-scale collaborative virtual environments. In: Proceedings of ICAT, pp 1–8Google Scholar
  20. 20.
    Fleury C, Duval T, Gouranton V, Arnaldi B (2010) A new adaptive data distribution model for consistency maintenance in collaborative virtual environments. In: Proceedings of JVRC, pp 29–36Google Scholar
  21. 21.
    Fleury C, Duval T, Gouranton V, Steed A (2012) Evaluation of remote collaborative manipulation for scientific data analysis. In: Proceedings of VRST. ACM, TorontoGoogle Scholar
  22. 22.
    Forsberg A, Herndon K, Zeleznik R (1996) Aperture based selection for immersive virtual environments. In: UIST ’96: Proceedings of the 9th annual ACM symposium on User interface software and technology. ACM, New York, pp 95–96. doi: 10.1145/237091.237105
  23. 23.
    Fraser M, Benford S, Hindmarsh J, Heathq C (1999) Supporting awareness and interaction through collaborative virtual interfaces. In: Proceedings of UIST, pp 27–36Google Scholar
  24. 24.
    Frécon E, Nöu AA (1998) Building distributed virtual environments to support collaborative work. In: Proceedings of the ACM symposium on virtual reality software and technology, VRST ’98, pp 105–113. ACM, New YorkGoogle Scholar
  25. 25.
    Galambos P, Baranyi P (2011) Virca as virtual intelligent space for rt-middleware. In: 2011 IEEE/ASME international conference on advanced intelligent mechatronics (AIM), pp 140–145Google Scholar
  26. 26.
    Hand C (1997) A survey of 3D interaction techniques. Computer Graphics Forum 16(5):269–281CrossRefGoogle Scholar
  27. 27.
    Jézéquel JM, Barais O, Fleurey F (2010) Model driven language engineering with kermeta. In: 3rd summer school on generative and transformational techniques in software engineering. LNCS 6491, Springer, BragaGoogle Scholar
  28. 28.
    Lalioti V, Garcia C, Hasenbrink F (1998) Virtual meeting in cyberstage. In: Proceedings of the ACM VRST. ACM, New York, pp 205–212Google Scholar
  29. 29.
    Leigh J, Johnson A, Vasilakis C, DeFanti T (1996) Multi-perspective collaborative design in persistent networked virtual environments. In: Proceedings of VRAIS’96, pp 253–260Google Scholar
  30. 30.
    Macedonia M, Zyda MJ, Pratt D, Barham P, Zeswitz S (1994) Npsnet: A network software architecture for large scale virtual environments. Presence 3(4):265–287Google Scholar
  31. 31.
    Margery D, Arnaldi B, Plouzeau N (1999) A general framework for cooperative manipulation in virtual environments. In: Virtual environments’99, pp 169–178Google Scholar
  32. 32.
    Mulder JD, Boschker BR (2004) A modular system for collaborative desktop VR/AR with a shared workspace. In: Proceedings of the IEEE virtual reality conference 75Google Scholar
  33. 33.
    Nguyen TTH, Duval T, Fleury C (2013) Guiding techniques for collaborative exploration in multi-scale shared virtual environments. In: GRAPP international conference on computer graphics theory and applications. Barcelone, Spain, pp 327–336.
  34. 34.
    Nguyen, TTH, Fleury C, Duval T (2012) Collaborative wxploration in a multi-scale shared virtual environment. In: Proceedings of IEEE symposium on 3D user interfaces. IEEE Computer Society, pp 181–182Google Scholar
  35. 35.
    Notelaers S, Weyer TD, Goorts P, Maesen S (2012) Heatmeup: a 3dui serious game to explore collaborative wayfinding. In: Proceedings of IEEE symposium on 3D user interfaces. IEEE Computer Society pp 177–178Google Scholar
  36. 36.
    Pontonnier C, Dumont G (2010) From motion capture to muscle forces in the human elbow aimed at improving the ergonomics of workstations. Virtual Phys Prototyp 5:113–122CrossRefGoogle Scholar
  37. 37.
    Pontonnier C, Dumont, G, Samani A, Madeleine P, Badawi M (2012) Designing and evaluating a workstation in real and virtual environment: from digital mock-up to realization. In: 3rd IEEE International conference on cognitive infocommunications (CogInfoCom 2012)Google Scholar
  38. 38.
    Poupyrev I, Weghorst S, Billinghurst M, Ichikawa T (1998) Egocentric object manipulation in Vvirtual environments: empirical evaluation of interaction techniques. Comput Graphics Forum 17(3). URL:
  39. 39.
    Razzaque S (2005) Redirected walking. Ph.D. thesis, University of North Carolina at Chapel HillGoogle Scholar
  40. 40.
    Ruddle RA, Savage JCD, Jones DM (2002) Symmetric and asymmetric action integration during cooperative object manipulation in virtual environments. ACM Trans Comput Human Interact 9(4):285–308. doi: 10.1145/586081.586084
  41. 41.
    Smets GJF, Stappers PJ, Overbeeke K (1994) Designing in virtual reality: implementing perception-action coupling with affordances. In: Proceedings of ACM VRST, pp. 97–110. World Scientific Publishing Co. Inc, River Edge Google Scholar
  42. 42.
    Stoakley R, Conway MJ, Pausch R (1995) Virtual reality on a wim: interactive worlds in miniature. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM Press/Addison-Wesley Publishing Co. New York, pp 265–272Google Scholar
  43. 43.
    Wang J, Budhiraja R, Leach O, Clifford R, Matsua D (2012) Escape from meadwyn 4: a cross-platform environment for collaborative navigation tasks. In: Proceedings of IEEE symposium on 3D user interfaces. IEEE Computer Society, pp 179–180Google Scholar
  44. 44.
    Ware C, Lowther K (1997) Selection using a one-eyed cursor in a fish tank VR environment. ACM Trans Comput Hum Interact 4(4):309–322. doi: 10.1145/267135.267136 Google Scholar
  45. 45.
    Williams B, Narasimham G, Rump B, McNamara TP, Carr TH, Rieser J, Bodenheimer B (2007) Exploring large virtual environments with an HMD when physical space is limited. In: Proceedings of the 4th symposium on applied perception in graphics and visualization, pp 41–48Google Scholar
  46. 46.
    Zahorik P, Jenison RL (1998) Presence as being-in-the-world. Presence: Teleoperator Virtual Environ 7(1):78–89CrossRefGoogle Scholar

Copyright information

© OpenInterface Association 2013

Authors and Affiliations

  • Thierry Duval
    • 1
  • Thi Thuong Huyen Nguyen
    • 2
  • Cédric Fleury
    • 3
  • Alain Chauffaut
    • 2
  • Georges Dumont
    • 4
  • Valérie Gouranton
    • 5
  1. 1.Université de Rennes 1 UEB, IRISA, UMR CNRS 6074RennesFrance
  2. 2.INRIA Rennes Bretagne-Atlantique, IRISA, UMR CNRS 6074RennesFrance
  3. 3.LRI, Université Paris-Sud, UMR CNRS 8623OrsayFrance
  4. 4.ENS Rennes, UEB, IRISA, UMR CNRS 6074RennesFrance
  5. 5.INSA de Rennes, UEB, IRISA, UMR CNRS 6074RennesFrance

Personalised recommendations