Immersive Interaction Paradigms for Controlling Virtual Worlds by Customer Devices Exemplified in a Virtual Planetarium

  • Andreas Schaller
  • Tim Biedenkapp
  • Jens Keil
  • Dieter W. Fellner
  • Arjan KuijperEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9178)


This work provides an insight into the basics of 3D applications in conjunction with various customer devices. In this case, the application is a 3D planetarium of our solar system for a museum. The aim is to create a concept for intuitive and immersive navigation through the virtual planetarium using inexpensive Customer Devices. Visitors should be able to move freely and easily in the solar system. Here, the visitor should be able to focus on the simulation and not quickly lose interest in the complex control application. For this similar approaches and previous research are examined and a new approach is described. As low-cost customer devices, the controller of the Nintendo Wii (Wiimote) and current smartphones are considered in this work. A detailed analysis of these devices is an integral part of this work. Based on the selected devices, there are various possibilities for interaction and resulting interaction concepts. For each device, a concept will be developed to meet the identified needs.


Visualization Immersive environments Virtual worlds Interaction devices 


  1. 1.
    Majewski, M., Braun, A., Marinc, A., Kuijper, A.: Providing visual support for selecting reactive elements in intelligent environments. Trans. Comput. Sci. 18, 248–263 (2013). doi: 10.1007/978-3-642-38803-314 Google Scholar
  2. 2.
    Braun, A., Wichert, R., Kuijper, A., Fellner, D.W.: A benchmarking model for sensors in smart environments. In: Aarts, E., de Ruyter, B., Markopoulos, P., van Loenen, E., Wichert, R., Schouten, B., Terken, J., Van Kranenburg, R., Ouden, E.D., O’Hare, G. (eds.) AmI 2014. LNCS, vol. 8850, pp. 242–257. Springer, Heidelberg (2014) Google Scholar
  3. 3.
    Engelke, T., Keil, J., Rojtberg, P., Wientapper, F., Webel, S., Bockholt, U.: Content first - A concept for industrial augmented reality maintenance applications using mobile devices. In: IEEE International Symposium on Mixed and Augmented Reality, ISMAR 2013, Adelaide, Australia, 1–4 October 2013, pp. 251–252 (2013)Google Scholar
  4. 4.
    Vayanou, M., Katifori, A., Karvounis, M., Kourtis, V., Kyriakidi, M., Roussou, M., Tsangaris, M., Ioannidis, Y., Balet, O., Prados, T., Keil, J., Engelke, T., Pujol, L.: Authoring personalized interactive museum stories. In: Mitchell, A., Fernández-Vara, C., Thue, D. (eds.) ICIDS 2014. LNCS, vol. 8832, pp. 37–48. Springer, Heidelberg (2014) Google Scholar
  5. 5.
    Grosse-Puppendahl, T., Braun, A., Kamieth, F., Kuijper, A.: Swiss-cheese extended: An object recognition method for ubiquitous interfaces based on capacitive proximity sensing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. CHI 2013, pp. 1401–1410. ACM (2013)Google Scholar
  6. 6.
    Ardito, C., Buono, P., Costabile, M.F., Lanzilotti, R., Simeone, A.L.: Comparing low cost input devices for interacting with 3d virtual environments. In: Proceedings of the 2nd Conference on Human System Interactions. HSI 2009, pp. 289–294. IEEE Press (2009)Google Scholar
  7. 7.
    Marinc, A., Stocklöw, C., Braun, A., Limberger, C., Hofmann, C., Kuijper, A.: Interactive personalization of ambient assisted living environments. In: Smith, M.J., Salvendy, G. (eds.) HCII 2011, Part I. LNCS, vol. 6771, pp. 567–576. Springer, Heidelberg (2011) CrossRefGoogle Scholar
  8. 8.
    Bowman, D.A., Coquillart, S., Fröhlich, B., Hirose, M., Kitamura, Y., Kiyokawa, K., Stürzlinger, W.: 3D user interfaces: new directions and perspectives. IEEE Comput. Graph. Appl. 28(6), 20–36 (2008)CrossRefGoogle Scholar
  9. 9.
    Engelke, T., Becker, M., Wuest, H., Keil, J., Kuijper, A.: MobileAR browser - a generic architecture for rapid AR-multi-level development. Expert Syst. Appl. 40(7), 2704–2714 (2013). doi: 10.1016/j.eswa.2012.11.003 CrossRefGoogle Scholar
  10. 10.
    Limper, M., Jung, Y., Behr, J., Sturm, T., Franke, T., Schwenk, K., Kuijper, A.: Fast and progressive loading of binary encoded declarative 3D web content. IEEE Comput. Graph. Appl. 33(5), 26–36 (2013). doi: 10.1109/MCG.2013.52 CrossRefGoogle Scholar
  11. 11.
    Stein, C., Limper, M., Kuijper, A.: Spatial data structures to accelerate the visibility determination for large model visualization on the web. In: the 19th International Conference on Web3D Technology, Web3D 2014, Vancouver, Canada, 8–10 August 2014, pp. 53–61 (2014)Google Scholar
  12. 12.
    Eicke, T.N., Jung, Y., Kuijper, A.: Stable dynamic webshadows in the X3DOM framework. Expert Syst. Appl. 42(7), 3585–3609 (2015). doi: 10.1016/j.eswa.2014.11.059 CrossRefGoogle Scholar
  13. 13.
    Aderhold, A., Wilkosinska, K., Corsini, M., Jung, Y., Graf, H., Kuijper, A.: The common implementation framework as service – towards novel applications for streamlined presentation of 3D content on the web. In: Marcus, A. (ed.) DUXU 2014, Part II. LNCS, vol. 8518, pp. 3–14. Springer, Heidelberg (2014) Google Scholar
  14. 14.
    Grosse-Puppendahl, T., Herber, S., Wimmer, R., Englert, F., Beck, S., von Wilmsdorff, J., Wichert, R., Kuijper, A.: Capacitive near-field communication for ubiquitous interaction and perception. In: Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing. UbiComp 2014 Adjunct, pp. 231–242. ACM (2014) (Best Paper Nomination (best 4%))Google Scholar
  15. 15.
    Grosse-Puppendahl, T., Berghoefer, Y., Braun, A., Wimmer, R., Kuijper, A.: OpenCapSense: a rapid prototyping toolkit for pervasive interaction using capacitive sensing. In: 2013 IEEE International Conference on Pervasive Computing and Communications (PerCom 2013), San Diego, USA, pp. 151–158 (March 2013)Google Scholar
  16. 16.
    Gross, R., Bockholt, U., Biersack, E.W., Kuijper, A.: Multimodal kinect-supported interaction for visually impaired users. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013, Part I. LNCS, vol. 8009, pp. 500–509. Springer, Heidelberg (2013) Google Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Andreas Schaller
    • 1
  • Tim Biedenkapp
    • 1
  • Jens Keil
    • 2
  • Dieter W. Fellner
    • 1
    • 2
  • Arjan Kuijper
    • 1
    • 2
    Email author
  1. 1.Technische Universität DarmstadtDarmstadtGermany
  2. 2.Fraunhofer IGDDarmstadtGermany

Personalised recommendations