VR system for spatio-temporal visualization of tweet data and support of map exploration

  • Kaya OkadaEmail author
  • Mitsuo Yoshida
  • Takayuki Itoh
  • Tobias Czauderna
  • Kingsley Stephens


Social media analysis is helpful to understand the behavior of people. Human behavior in social media is related to time and location, which is often difficult to find the characteristics appropriately and quickly. We chose to apply virtual reality (VR) technologies to present the spatio-temporal social media data. This makes us easier to develop interactive and intuitive user interfaces and explore the data as we want. This paper proposes a VR system featuring two visualization techniques. One of the techniques is a three-dimensional temporal visualization of tweets of microblogs with location information. It consists of the two-dimensional map and a time axis. In particular, we aggregate the number of tweets of each coordinate and time step and depict them as piled cubes. We highlight only specific cubes so that users can understand the overall tendency of datasets. The other technique provides a route recommendation based on tweets of microblogs. Our technique supports users to explore attractive events and places by selecting effective tweets and suggesting routes. We also developed user interfaces for operating these objects in a VR space which indicate details of tweets.


Temporal visualization Virtual reality Social media Tweet data Immersive visualization Route recommendation 



This work has been partially supported by Japan Society of the Promotion of Science under Grant-in-Aid for Scientific Research.


  1. 1.
    Bach B, Dragicevic P, Archambault D, Hurter C, Carpendale S (2014) A review of temporal data visualizations based on space-time cube operations. In: Eurographics conference on visualizationGoogle Scholar
  2. 2.
    Borland D, Ii RMT (2007) Rainbow color map (still) considered harmful. IEEE Comput Graph Appl 27(2):14–17CrossRefGoogle Scholar
  3. 3.
    Chandler T, Cordeil M, Czauderna T, Dwyer T, Glowacki J, Goncu C, Klapperstueck M, Klein K, Marriott K, Schreiber F et al (2015) Immersive analytics. In: IEEE international symposium on big data visual analytics (BDVA)Google Scholar
  4. 4.
    Cordeil M, Cunningham A, Dwyer T, Thomas BH, Marriott K (2017) ImAxes: immersive axes as embodied affordances for interactive multivariate data visualisation. In: Proceedings of the 30th annual ACM symposium on user interface software and technology, pp 71–83Google Scholar
  5. 5.
    Febretti A, Nishimoto A, Thigpen T, Talandis J, Long L, Pirtle J, Peterka T, Verlo A, Brown M, Plepys D et al (2013) Cave2: a hybrid reality environment for immersive simulation and information analysis. The Engineering Reality of Virtual Reality 2013 8649:864,903CrossRefGoogle Scholar
  6. 6.
    Fu K, Lu YC, Lu CT (2014) Treads: a safe route recommender using social media mining and text summarization. In: Proceedings of the 22nd ACM SIGSPATIAL international conference on advances in geographic information systems. ACM, pp 557–560Google Scholar
  7. 7.
    Fukada H, Okuno Y, Ohtsu S, Hashimoto Y (2013) Proposal of technique for 3D visualization of behavioral data on scenic walk using geographic information system. Society for Tourism Informatics 8(1):51–66. (in Japanese)Google Scholar
  8. 8.
    Gil-Gómez JA, Gil-Gómez H, Lozano-Quilis JA, Manzano-Hernández P, Albiol-Pérez S, Aula-Valero C (2013) Seq: suitability evaluation questionnaire for virtual rehabilitation systems. application in a virtual rehabilitation system for balance rehabilitation. In: Proceedings of the 7th international conference on pervasive computing technologies for healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering), pp 335–338Google Scholar
  9. 9.
    Guttentag DA (2010) Virtual reality: applications and implications for tourism. Tour Manag 31(5):637–651CrossRefGoogle Scholar
  10. 10.
  11. 11.
    Lam H, Bertini E, Isenberg P, Plaisant C, Carpendale S (2012) Empirical studies in information visualization: seven scenarios. IEEE Trans Vis Comput Graph 18(9):1520–1536CrossRefGoogle Scholar
  12. 12.
    Moran A, Gadepally V, Hubbell M, Kepner J (2015) Improving big data visual analytics with interactive virtual reality. In: IEEE high performance extreme computing conference (HPEC), pp 1–6Google Scholar
  13. 13.
  14. 14.
    Okada K, Yoshida M, Itoh T, Czauderna T, Stephens K (2018) Vr system for spatio-temporal visualization of tweet data. In: 22nd international conference on information visualization (IV2018)Google Scholar
  15. 15.
    Schneider T, Tymchuk Y, Salgado R, Bergel A (2016) Cuboidmatrix: exploring dynamic structural connections in software components using space-time cube. In: IEEE Working conference on software visualization (VISSOFT), pp 116–125Google Scholar
  16. 16.
  17. 17.
  18. 18.
    Wakamiya S, Kawasaki H, Kawai Y, Jatowt A, Aramaki E, Akiyama T (2016) Lets not stare at smartphones while walking: memorable route recommendation by detecting effective landmarks. In: Proceedings of the 2016 ACM international joint conference on pervasive and ubiquitous computing. ACM, pp 1136–1146Google Scholar
  19. 19.
    Watanave H (2014) Vr/ar interface of pluralistic digital archives. The Journal of The Institute of Image Information and Television Engineers 68(5):380–383. (in Japanese)CrossRefGoogle Scholar
  20. 20.
    Young MK, Gaylor GB, Andrus SM, Bodenheimer B (2014) A comparison of two cost-differentiated virtual reality systems for perception and action tasks. In: Proceedings of the ACM symposium on applied perception. ACM, pp 83–90Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2019

Authors and Affiliations

  1. 1.Ochanomizu UniversityTokyoJapan
  2. 2.Toyohashi University of TechnologyAichiJapan
  3. 3.Monash UniversityClaytonAustralia

Personalised recommendations