Skip to main content
SpringerLink
Log in

360-Degree Video Based on Regular Dodecahedron: Technology and Methods of Implementation in Virtual Environment Systems

  • Published:
Programming and Computer Software Aims and scope Submit manuscript

Abstract

This paper proposes new technology and methods to implement panoramic 360-degree video based on virtual environment projection onto a regular dodecahedron. The idea is to construct a virtual panorama observed by the viewer by means of rectangular snapshots of a virtual environment that simulate the inner surface of the dodecahedron. Based on the geometry of golden rectangles, a method to compute the projection and orientation parameters for 12 identical virtual dodecahedron cameras is developed; based on an original pentagon packing scheme, a method and algorithms to synthesize frames of 360-degree video are proposed; and a method and algorithm for rectangular snapshot visualization that enable the synthesis of a continuous 360-panorama are developed. The proposed solutions are implemented in a software complex and tested by visualizing an ISS orbital flight around the Earth. The research results can be applied in virtual environment systems, simulators, scientific visualization, virtual laboratories, educational applications, video guides, etc.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1.
Fig. 2.
Fig. 3.
Fig. 4.
Fig. 5.
Fig. 6.
Fig. 7.
Fig. 8.
Fig. 9.

Similar content being viewed by others

REFERENCES

  1. Mikhailyuk, M.V., Maltsev, A.V., Timokhin, P.Yu., Strashnov, E.V., Kryuchkov, B.I., and Usov, V.M., The VirSim virtual environment system for the simulation complexes of cosmonaut training, Pilotiruemye Polety v Kosmos, 2020, vol. 37, no. 4, pp. 72–95.

    Google Scholar 

  2. Barladian, B.K., Shapiro, L.Z., Mallachiev, K.A., Khoroshilov, A.V., Solodelov, Yu.A., Voloboy, A.G., Galaktionov, V.A., and Koverninskii, I.V., Visualization component for the aircraft real-time operating system JetOS, Program. Comput. Software, 2020, vol. 46, no. 3, pp. 167–175.

    Article  Google Scholar 

  3. Lubimov, M., Vidiger, D., and Shergin, D., Limitless dynamic landscapes of 1 mm per pixel density, zooming included, Proc. SIGGRAPH, 2020. https://doi.org/10.1145/3407662.3407753

  4. Piedra, J.A., Ojeda-Castelo, J.J., Quero-Valenzuela, F., and Piedra-Fdez, I., Virtual environment for the training of the hands in minimally invasive thoracic surgery, Proc. IEEE 8th Int. Conf. Games and Virtual Worlds for Serious Applications (VS-GAMES), 2016, pp. 1–4.

  5. Strashnov, E.V., Mironenko, I.N., and Finagin, L.A., Simulation of quadcopter flight modes in virtual environment systems, Inf. Tekhnol. Vychisl. Sist., 2020, no. 1, pp. 85–94.

  6. Timokhin, P.Yu., Mikhaylyuk, M.V., Vozhegov, E.M., and Panteley, K.D., Technology and methods for deferred synthesis of 4K stereo clips for complex dynamic virtual scenes, Program. Comput. Software, 2021, vol. 47, no. 1, pp. 67–75.

    Article  Google Scholar 

  7. Andreev, S., Bondarev, A., Bondarenko, A., Galaktionov, V., and Bondareva, N., Constructing stereo images of error surfaces in problems of numerical methods verification, Proc. 30th Int. Conf. Computer Graphics and Vision, 2020, vol. 2744.

  8. Andreev, S.V., Bondarev, A.E., Galaktionov, V.A., and Bondareva, N.A., The problems of stereo animations construction on modern stereo devices, Sci. Visualization, 2018, vol. 4, no. 10, pp. 40–52.

    Article  Google Scholar 

  9. Corbillon, X., Simon, G., Devlic, A., and Chakareski, J., Viewport-adaptive navigable 360-degree video delivery, Proc. IEEE Int. Conf. Communications (ICC), 2017, pp. 1–7.

  10. Jiang, H., He, G., Yu, W., Wang, Z., and Li, Y., Scalable video coding based on the user’s view for real-time virtual reality applications, Adv. Multimedia Inf. Process., Zeng, B., , Eds., Springer, 2017, pp. 766–775.

    Google Scholar 

  11. Yu, M., Lakshman, H., and Girod, B., A framework to evaluate omnidirectional video coding schemes, Proc. IEEE Int. Symp. Mixed and Augmented Reality, 2015, pp. 31–36.

  12. Ray, B., Jung, J., and Larabi, M.-C., A low-complexity video encoder for equirectangular projected 360 video content, Proc. IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP), 2018, pp. 1723–1727.

  13. Li, J., Wen, Z., Li, S., Zhao, Y., Guo, B., and Wen, J., Novel tile segmentation scheme for omnidirectional video, Proc. IEEE Int. Conf. Image Processing (ICIP), 2016, pp. 370–374.

  14. Timokhin, P.Yu., Mikhaylyuk, M.V., Vozhegov, E.M., Efficient methods and algorithms to synthesize 360-degree video based on cubemap projection of virtual environment, rudy ISP RAN, 2020, vol. 32, no. 4, pp. 73–88.

    Google Scholar 

  15. Brown, C., Bringing pixels front and center in VR video, 2017. https://www.blog.google/products/google-ar-vr/bringing-pixels-front-and-center-vr-video.

  16. Kuzyakov, E., Liu, S., and Pio, D., Optimizing 360 video for Oculus, 2016. https://developers.facebook.com/videos/f8-2016/optimizing-360-video-for-oculus.

  17. Chen, Z., Wang, X., Zhou, Y., Zou, L., and Jiang, J., Content-aware cubemap projection for panoramic image via deep q-learning, Lect. Notes Comput. Sci., 2020, vol. 11962, pp. 304–315.

    Article  Google Scholar 

  18. Fu, C.-W., Wan, L., Wong, T.-T., and Leung, C.-S., The rhombic dodecahedron map: An efficient scheme for encoding panoramic video, IEEE Trans. Multimedia, 2009, vol. 11, no. 4, pp. 634–644.

    Article  Google Scholar 

  19. Kuzyakov, E. and Pio, D., Next-generation video encoding techniques for 360 video and VR. https://engineering.fb.com/2016/01/21/virtual-reality/next-generation-video-encoding-techniques-for-360-video-and-vr.

  20. McCutchen, D., A dodecahedral approach to immersive imaging and display, Comput. Graphics, 1997, pp. 35–37.

  21. McCutchen, D., Immersive dodecaherdral video viewing system, US Patent 5703604, 1997.

  22. Timokhin, P., Mikhaylyuk, M., and Panteley, K., A technology to synthesize 360-degree video based on regular dodecahedron in virtual environment systems, Proc. 30th Int. Conf. Computer Graphics and Vision, 2020, vol. 2744. https://doi.org/10.51130/graphicon-2020-2-3-1

  23. Hill, F.S., Computer Graphics: Using OpenGL, Prentice Hall, 2001, 2nd ed.

    Google Scholar 

  24. Zwillinger, D., CRC Standard Mathematical Tables and Formulas, CRC Press, 2018, 33rd ed.

    MATH  Google Scholar 

  25. Vasilieva, V.N., Golden section and golden rectangles when building icosahedron, dodecahedron and archimedean solids based on them, Geom. Graphics, 2019, vol. 7, no. 2, pp. 47–55.

    Article  Google Scholar 

  26. Akhtaruzzaman, M. and Shafie, A.A., Geometrical substantiation of Phi, the golden ratio and the baroque of nature, architecture, design and engineering, Int. J. Arts, 2011, vol. 1, no. 1, pp. 1–22.

    Article  Google Scholar 

  27. Segal, M. and Akeley, K., The OpenGL Graphics System: A Specification, Khronos Group Inc., 2019. https://www.khronos.org/registry/OpenGL/specs/gl/glspec46.core.pdf.

  28. Mikhaylyuk, M.V., Timokhin, P.Y., and Maltsev, A.V., A method of Earth terrain tessellation on the GPU for space simulators, Program. Comput. Software, 2017, vol. 43, pp. 243–249.

    Article  MathSciNet  Google Scholar 

Download references

Funding

The publication is made within the state task on carrying out basic scientific researches (GP 14) on topic (project) “34.9. Virtual environment systems: technologies, methods and algorithms of mathematical modeling and visualization” (0580-2021-0012).

Author information

Authors and Affiliations

  1. Federal State Institution “Scientific Research Institute for System Analysis of the Russian Academy of Sciences”, Nakhimovskii pr. 36/1, 117218, Moscow, Russia

    P. Yu. Timokhin, M. V. Mikhaylyuk & K. D. Panteley

Authors
  1. P. Yu. Timokhin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. M. V. Mikhaylyuk
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. K. D. Panteley
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to P. Yu. Timokhin, M. V. Mikhaylyuk or K. D. Panteley.

Additional information

Translated by Yu. Kornienko

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Timokhin, P.Y., Mikhaylyuk, M.V. & Panteley, K.D. 360-Degree Video Based on Regular Dodecahedron: Technology and Methods of Implementation in Virtual Environment Systems. Program Comput Soft 47, 167–176 (2021). https://doi.org/10.1134/S0361768821030105

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0361768821030105

Search

Navigation