Blending Real and Virtual Worlds Using Self-reflection and Fiducials

  • Martin Fischbach
  • Dennis Wiebusch
  • Marc Erich Latoschik
  • Gerd Bruder
  • Frank Steinicke
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7522)


This paper presents an enhanced version of a portable out-of-the-box platform for semi-immersive interactive applications. The enhanced version combines stereoscopic visualization, marker-less user tracking, and multi-touch with self-reflection of users and tangible object interaction. A virtual fish tank simulation demonstrates how real and virtual worlds are seamlessly blended by providing a multi-modal interaction experience that utilizes a user-centric projection, body, and object tracking, as well as a consistent integration of physical and virtual properties like appearance and causality into a mixed real/virtual world.


Mixed Reality Self-Reflection Fiducials Fish Tank Virtual Reality Interactive Virtual Art Multi-Touch 


  1. 1.
    Milgram, P., Kishino, F.: A taxonomy of mixed reality visual displays. IEICE Transactions on Information Systems E77-D(12) (1994)Google Scholar
  2. 2.
    Naemura, T., Nitta, T., Mimura, A., Harashima, H.: Virtual Shadows in Mixed Reality Environment Using Flashlight-like Devices. Transactions of Virtual Reality Society of Japan 7(2), 227–237 (2002)Google Scholar
  3. 3.
    Jacobs, K., Loscos, C.: Classification of illumination methods for mixed reality. Comput. Graph. Forum 25(1), 29–51 (2006)CrossRefGoogle Scholar
  4. 4.
    Fischbach, M., Latoschik, M., Bruder, G., Steinicke, F.: smARTbox: Out-of-the-Box Technologies for Interactive Art and Exhibition. In: Virtual Reality International Conference (VRIC). ACM (2012)Google Scholar
  5. 5.
    Fischbach, M., Wiebusch, D., Latoschik, M.E., Bruder, G., Steinicke, F.: Smartbox: A portable setup for intelligent interactive applications. In: Mensch und Computer Demo Papers (2012)Google Scholar
  6. 6.
    Latoschik, M.E., Tramberend, H.: Simulator X: A Scalable and Concurrent Software Platform for Intelligent Realtime Interactive Systems. In: Proceedings of the IEEE VR 2011 (2011)Google Scholar
  7. 7.
    Steinicke, F., Benko, H., Daiber, F., Keefe, D., de la Rivière, J.B.: Touching the 3rd dimension (T3D). In: Proceedings of the Conference extended Abstracts on Human Factors in Computing Systems, pp. 161–164. ACM (2011)Google Scholar
  8. 8.
    Valkov, D., Steinicke, F., Bruder, G., Hinrichs, K., Schöning, J., Daiber, F., Krüger, A.: Touching floating objects in projection-based virtual reality environments. In: Proceedings of Joint Virtual Reality Conference, pp. 17–24 (2010)Google Scholar
  9. 9.
    Valkov, D., Steinicke, F., Bruder, G., Hinrichs, K.: 2D touching of 3D stereoscopic objects. In: Proceedings of the Conference on Human Factors in Computing Systems, pp. 1353–1362. ACM (2011)Google Scholar
  10. 10.
    Schöning, J., Hook, J., Bartindale, T., Schmidt, D., Oliver, P., Echtler, F., Motamedi, N., Brandl, P., Zadow, U.: Building interactive multi-touch surfaces. Tabletops-Horizontal Interactive Displays, 27–49 (2010)Google Scholar
  11. 11.
    Cetin, G., Bedi, R., Sandler, S.: Multi-touch technologies. Natural User Interface (NUI) Group (2009)Google Scholar
  12. 12.
    Steinicke, F., Hinrichs, K.H., Ropinski, T.: Virtual Reflections and Virtual Shadows in Mixed Reality Environments. In: Costabile, M.F., Paternó, F. (eds.) INTERACT 2005. LNCS, vol. 3585, pp. 1018–1021. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  13. 13.
    Burrus, N.: NESTK Library (2012), (last accessed: May 30, 2012)

Copyright information

© IFIP International Federation for Information Processing 2012

Authors and Affiliations

  • Martin Fischbach
    • 1
  • Dennis Wiebusch
    • 1
  • Marc Erich Latoschik
    • 1
  • Gerd Bruder
    • 2
  • Frank Steinicke
    • 2
  1. 1.Human-Computer InteractionUniversity of WürzburgGermany
  2. 2.Immersive Media GroupUniversity of WürzburgGermany

Personalised recommendations