A Virtual Reality Interface for Interactions with Spatiotemporal 3D Data

  • Hunter Quant
  • Sean Banerjee
  • Natasha Kholgade BanerjeeEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10705)


Traditional interfaces for interacting with 3D models in virtual environments lack support for spatiotemporal 3D models such as point clouds and meshes generated by markerless capture systems. We present a virtual reality (VR) interface that enables the user to perform spatial and temporal interactions with spatiotemporal 3D models. To accommodate the high volume of spatiotemporal data, we provide a data format for spatiotemporal 3D models which has an average speedup of 3.84 and a space reduction of 43.9% over traditional model file formats. We enable the user to manipulate spatiotemporal 3D data using gestures intuitive from real-world experience or by using a VR user interface similar to traditional 2D visual interactions.


Virtual reality Spatiotemporal 3D models User interface 



This work was partially supported by the National Science Foundation (NSF) grant #1730183.

Supplementary material

Supplementary material 1 (mp4 36968 KB)


  1. 1.
    Akhter, I., Simon, T., Khan, S., Matthews, I., Sheikh, Y.: Bilinear spatiotemporal basis models. ACM Trans. Graph. 31(2) (2012)Google Scholar
  2. 2.
    Alexiadis, D., Zarpalas, D., Daras, P.: Fast and smooth 3D reconstruction using multiple RGB-depth sensors. In: 2014 IEEE VCIP, pp. 173–176, December 2014Google Scholar
  3. 3.
    Collet, A., Chuang, M., Sweeney, P., Gillett, D., Evseev, D., Calabrese, D., Hoppe, H., Kirk, A., Sullivan, S.: High-quality streamable free-viewpoint video. ACM Trans. Graph. 34(4) (2015)Google Scholar
  4. 4.
    Dong, S., Behzadan, A.H., Chen, F., Kamat, V.R.: Collaborative visualization of engineering processes using tabletop augmented reality. Adv. Eng. Softw. 55, 45–55 (2013). CrossRefGoogle Scholar
  5. 5.
  6. 6.
    Han, S., Lee, H., Park, J., Chang, W., Kim, C.: Remote interaction for 3D manipulation. In: Proceedings CHI (Extended Abstracts) (2010)Google Scholar
  7. 7.
    Kowalski, M., Naruniec, J., Daniluk, M.: Live scan3D: a fast and inexpensive 3D data acquisition system for multiple kinect v2 sensors. In: IEEE 3DV (2015)Google Scholar
  8. 8.
    Nguyen, C., DiVerdi, S., Hertzmann, A., Liu, F.: Vremiere: in-headset virtual reality video editing. In: Proceedings of the CHI (2017)Google Scholar
  9. 9.
  10. 10.
    Unity: Unity 3D.

Copyright information

© Springer International Publishing AG 2018

Authors and Affiliations

  • Hunter Quant
    • 1
  • Sean Banerjee
    • 1
  • Natasha Kholgade Banerjee
    • 1
    Email author
  1. 1.Clarkson UniversityPotsdamUSA

Personalised recommendations