An Architecture for Distributed Explorable HMD-Based Virtual Reality Environments

  • Jakub FlotyńskiEmail author
  • Anna Englert
  • Adrian Nowak
  • Krzysztof Walczak
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1050)


Interaction is one of the critical elements of VR environments. The use of VR in different domains by domain experts and average users, who are not IT-specialists, requires new approaches to represent interaction in either a domain-specific or a generic way, which is neither directly related to 3D graphics nor animation. In this paper, we propose an architecture for distributed VR environments with an explorable representation of interaction based on the semantic web. The architecture enables creation of logs of interactions between users and objects. Exploration of such logs can be especially useful in VR environments intended to gain knowledge about users’ and 3D objects’ behavior, e.g., in training and education. The architecture is suitable for lightweight VR devices with limited computational power, such as headsets and smartphones. We present an implementation of the architecture for an immersive service guide for household appliances, which is based on Unity and Samsung Gear VR.


Distributed VR HMD Semantic web Ontology 



We would like to thank Amica S.A. for supporting the project and providing 3D content models.


  1. 1.
    Chmielewski, J.: Describing interactivity of 3D content. In: Cellary, W., Walczak, K. (eds.) Interactive 3D Multimedia Content, pp. 195–221. Springer, London (2012)CrossRefGoogle Scholar
  2. 2.
    Chu, Y., Li, T.: Realizing semantic virtual environments with ontology and pluggable procedures. In: Applications of Virtual Reality (2012)Google Scholar
  3. 3.
    De Troyer, O., Kleinermann, F., Pellens, B., Bille, W.: Conceptual modeling for virtual reality. In: Grundy, J., Hartmann, S., Laender, A.H.F., Maciaszek, L., Roddick, J.F. (eds.) Tutorials, Posters, Panels and Industrial Contributions at the 26th International Conference on Conceptual Modeling - ER 2007, CRPIT, Auckland, New Zealand, vol. 83, pp. 3–18 (2007)Google Scholar
  4. 4.
    Drap, P., Papini, O., Sourisseau, J.C., Gambin, T.: Ontology-based photogrammetric survey in underwater archaeology. In: European Semantic Web Conference, pp. 3–6. Springer (2017)Google Scholar
  5. 5.
    Flotyński, J., Krzyszkowski, M., Walczak, K.: Semantic composition of 3D content behavior for explorable virtual reality applications. In: Proceedings of EuroVR 2017, Lecture Notes in Computer Science, pp. 3–23. Springer (2017)Google Scholar
  6. 6.
    Flotyński, J., Nowak, A., Walczak, K.: Explorable representation of interaction in VR/AR environments. In: Proceedings of AVR 2018, Lecture Notes in Computer Science, pp. 589–609. Springer (2018)Google Scholar
  7. 7.
    Flotyński, J., Sobociński, P.: Logging Interactions in explorable immersive VR/AR applications. In: 2018 International Conference on 3D Immersion (IC3D), Brussels, 5–6 December 2018, pp. 1–8. IEEE (2018)Google Scholar
  8. 8.
    Flotyński, J., Walczak, K.: Multi-platform semantic representation of interactive 3D content. In: Proceedings of the 5th Doctoral Conference on Computing, Electrical and Industrial Systems, 7–9 April, Lisbon, Portugal, 7–9 April 2014Google Scholar
  9. 9.
    Flotyński, J., Walczak, K.: Ontology-based representation and modelling of synthetic 3D content: a state-of-the-art review. Comput. Graph. Forum, 1–25 (2017)Google Scholar
  10. 10.
    Gutiérrez, M., García-Rojas, A., Thalmann, D., Vexo, F., Moccozet, L., Magnenat-Thalmann, N., Mortara, M., Spagnuolo, M.: An ontology of virtual humans: incorporating semantics into human shapes. Vis. Comput. 23(3), 207–218 (2007)CrossRefGoogle Scholar
  11. 11.
    Lugrin, J.L.: Alternative reality and causality in virtual environments. Ph.D. thesis, University of Teesside, Middlesbrough, United Kingdom (2009)Google Scholar
  12. 12.
    Pellens, B., Kleinermann, F., De Troyer, O.: A development environment using behavior patterns to facilitate building 3D/VR applications. In: Proceedings of the 6th Australasian Conference on International Entertainment, IE 2009, pp. 8:1–8:8, ACM (2009)Google Scholar
  13. 13.
    Perez-Gallardo, Y., Cuadrado, J.L.L., Crespo, Á.G., de Jesús, C.G.: GEODIM: a semantic model-based system for 3D recognition of industrial scenes. In: Current Trends on Knowledge-Based Systems, pp. 137–159. Springer (2017)Google Scholar
  14. 14.
    Rabattu, P.Y., Massé, B., Ulliana, F., Rousset, M.C., Rohmer, D., Léon, J.C., Palombi, O.: My corporis fabrica embryo: an ontology-based 3D spatio-temporal modeling of human embryo development. J. Biomed. Semant. 6(1), 36 (2015). Scholar
  15. 15.
    Sikos, L.F.: Description Logics in Multimedia Reasoning. Springer, Cham (2017)CrossRefGoogle Scholar
  16. 16.
    Trellet, M., Férey, N., Flotyński, J., Baaden, M., Bourdot, P.: Semantics for an integrative and immersive pipeline combining visualization and analysis of molecular data. J. Integr. Bioinf. 15(2), 1–19 (2018)CrossRefGoogle Scholar
  17. 17.
    Trellet, M., Ferey, N., Baaden, M., Bourdot, P.: Interactive visual analytics of molecular data in immersive environments via a semantic definition of the content and the context. In: Immersive Analytics, 2016 Workshop, pp. 48–53. IEEE (2016)Google Scholar
  18. 18.
    Vasilakis, G., García-Rojas, A., Papaleo, L., Catalano, C.E., Robbiano, F., Spagnuolo, M., Vavalis, M., Pitikakis, M.: Knowledge-based representation of 3D Media. Int. J. Softw. Eng. Knowl. Eng. 20(5), 739–760 (2010)CrossRefGoogle Scholar
  19. 19.
  20. 20.
  21. 21.
  22. 22.
    Walczak, K., Flotyński, J.: On-demand generation of 3D content based on semantic meta-scenes. In: Lecture Notes in Computer Science; Augmented and Virtual Reality; First International Conference, AVR 2014, Lecce, Italy, 17–20 September 2014, pp. 313–332. Springer (2014)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Jakub Flotyński
    • 1
    Email author
  • Anna Englert
    • 1
  • Adrian Nowak
    • 1
  • Krzysztof Walczak
    • 1
  1. 1.Poznań University of Economics and BusinessPoznańPoland

Personalised recommendations