Development of Direct Manipulation Interface for Collaborative VR/MR Workspace

  • Hiroshi Sasaki
  • Tadayuki Takeda
  • Masataka Imura
  • Yoshihiro Yasumuro
  • Yoshitsugu Manabe
  • Kunihiro Chihara
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3540)


Our research projects aim to connect various VR/MR platforms and to realize the seamless collaborative works with the intuitive operations whenever and wherever users like. In order to realize an ideal collaborative workspace, an effective handling scheme for both interactive virtual objects and system operation of VR/MR platform is needed. In this paper, we describe the three components, which are the direct manipulation interfaces for potable MR space and for fixed shared VR/MR space, and Interactive 3D Marker for displaying and manipulating virtual objects reflected lighting and geometry conditions of the real world. These components can give users seamless manipulation workspace by the natural operations such as they behave in their daily life. We also introduce Interactive Interior Design System using these components. This system realizes to coordinate the suitable interiors in the real space, by the free manipulation of virtual interior objects reflected the geometry and the lighting condition of the real space.


Real Space Virtual Object Head Mount Display Menu Item Spherical Mirror 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Fukumoto, M., Tonomura, Y.: Body Coupled FingeRing: Wireless Wearable Keyboard. In: Proceeding of the ACM Conference on Human Factors in Computing Systems, CHI 1997, pp. 147–154 (1997)Google Scholar
  2. 2.
    Rekimoto, J.: GestureWrist and Gesture Pad: UnobtrusiveWearable Interaction Devices. In: Proceeding of the 5th International Symposium on Wearable Computers, pp. 21–27 (2001)Google Scholar
  3. 3.
    Tsukada, K., Yasumura, M.: Ubi-Finger: Gesture Input Device for Mobile Use. In: Proceedings of APCHI 2002, vol. 1, pp. 388–400 (2002)Google Scholar
  4. 4.
    Virtual Technologies, CyberGloveGoogle Scholar
  5. 5.
    Hanrahan, P., Culter, L.D., Frolich, B.: Two-handed Direct Manipulation on the Responsive Workbench. In: Symposium on Interactive 3D Graphics, pp. 107–114 (1997)Google Scholar
  6. 6.
    Ilmonen, T.: Immersive 3D User Interface for Computer Animation Control. In: International Conference of Computer Vision and Graphics (2002)Google Scholar
  7. 7.
    Cohen, I., Lee, M.W.: 3D Body Reconstruction for Immersive Interaction. In: 2nd International Workshop on Articulated Motion and Deformable Objects, pp. 119–130 (2002)Google Scholar
  8. 8.
    Rougeaux, S., O’Hagan, R.G., Zelinsky, A.: Visual Gesture Interface for Virtual Environments. In: User Interface Conference, pp. 73–80 (2002)Google Scholar
  9. 9.
    Minnen, D., Westyn, T., Hurst, A., Starner, T., Leibe, B., Weeks, J.: The Perceptive Workbench: Computer-vision-based Gesture Tracking, Object Tracking, and 3D Reconstruction for Augmented Desks. Machine Vision and Application 14, 59–71 (2003)CrossRefGoogle Scholar
  10. 10.
    Wesche, G.: The toolfinger: Supporting Complex Direct Manipulation in Virtual Environments. In: Proceedings of the workshop on Virtual Environments 2003 (EGVE 2003), pp. 39–45 (2003)Google Scholar
  11. 11.
    Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video based augmented reality conferencing system. In: IEEE International Workshop on Augmented Reality, pp. 125–133 (1999)Google Scholar
  12. 12.
    Lopez de Ipiña, D., Mendonca, P., Hopper, A.: a low-cost visionbased location system for ubiquitous computing. Personal and Ubiquitous Computing 6(3), 206–219 (2002)CrossRefGoogle Scholar
  13. 13.
    Debevec, P.: Rendering synthetic objects into real scenes: Bridging traditional and image-based graphics with global illumination and high dynamic range photography. In: Proceedings of SIGGRAPH 1998, pp. 189–198 (1998)Google Scholar
  14. 14.
    Sato, I., Sato, Y., Ikeuchi, I.: Acquiring a radiance distribution to superimpose virtual objects onto a real scene. IEEE Transactions on Visualization and Computer Graphics 5(1), 1–12 (1999)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Hiroshi Sasaki
    • 1
  • Tadayuki Takeda
    • 2
  • Masataka Imura
    • 2
  • Yoshihiro Yasumuro
    • 2
  • Yoshitsugu Manabe
    • 2
  • Kunihiro Chihara
    • 2
  1. 1.Information Science and Technology CenterKobe UniversityKobe, HyogoJapan
  2. 2.Graduate School of Information ScienceNara Institute of Science and TechnologyNaraJapan

Personalised recommendations