Immersive Visual Data Stories

  • Petra Isenberg
  • Bongshin LeeEmail author
  • Huamin Qu
  • Maxime Cordeil
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11190)


We discuss opportunities and challenges for making people experience immersion when interacting with visual data stories. Even though visual data stories are an important means for communicating information, the extent to which viewers feel immersed in such stories has so far been hardly explored. In this chapter, we explore the concept of immersion in visual data stories from the viewpoint of related disciplines in which narratives play an important role. We pay special attention to games research, which shares a focus on graphics and interactivity with our context of visual data stories. From this exploration we derive research opportunities and challenges for immersion in visual data stories.


Storytelling Immersion Data-driven narratives Narrative visualization Visualization 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Amini, F., Henry Riche, N., Lee, B., Hurter, C., Irani, P.: Understanding data videos: looking at narrative visualization through the cinematography lens. In: Proceedings of Conference on Human Factors in Computing Systems (CHI), pp. 1459–1468. ACM, New York (2015).
  2. 2.
    Amini, F., Henry Riche, N., Lee, B., Monroy-Hernandez, A., Irani, P.: Authoring data-driven videos with dataclips. IEEE Trans. Vis. Comput. Graph. 23(1), 501–510 (2017). Scholar
  3. 3.
    Bach, B., Kerracher, N., Hall, K.W., Carpendale, S., Kennedy, J., Henry Riche, N.: Telling stories about dynamic networks with graph comics. In: Proceedings of the Conference on Human Factors in Information Systems (CHI), pp. 3670–3682. ACM, New York (2016).
  4. 4.
    Bartram, L., Patra, A., Stone, M.: Affective color in visualization. In: Proceedings of the Conference on Human Factors in Computing Systems (CHI), pp. 1364–1374. ACM, New York (2017).
  5. 5.
    Bastiras, J., Thomas, B.H.: Combining virtual reality and narrative visualisation to persuade. In: Proceedings of the Symposium on Big Data Visual Analytics (BDVA). IEEE, Los Alamitos (2017).
  6. 6.
    Becker, A.A.: Designing virtual reality data visualizations. Talk at the OpenVis Conference 2016, May 2016. Accessed May 2018
  7. 7.
    Bigelow, A., Drucker, S., Fisher, D., Meyer, M.: Iterating between tools to create and edit visualizations. IEEE Trans. Vis. Comput. Graph. 23(1), 481–490 (2017). Scholar
  8. 8.
    Borkin, M.A., Vo, A.A., Bylinskii, Z., Isola, P., Sunkavalli, S., Oliva, A., Pfister, H.: What makes a visualization memorable? IEEE Trans. Vis. Comput. Graph. 19(12), 2306–2315 (2013). Scholar
  9. 9.
    Brehmer, M., Lee, B., Bach, B., Henry Riche, N., Munzner, T.: Timelines revisited: a design space and considerations for expressive storytelling. IEEE Trans. Vis. Comput. Graph. 23(9), 2151–2164 (2017). Scholar
  10. 10.
    Brehmer, M., Lee, B., Henry Riche, N.: Microsoft timeline storyteller. Open Source Software (2017). Accessed May 2018
  11. 11.
    Brown, E., Cairns, P.: A grounded investigation of game immersion. In: Extended Abstracts on Human Factors in Computing Systems (CHI), pp. 1297–1300. ACM, New York (2004).
  12. 12.
    Bryan, C., Ma, K.L., Woodring, J.: Temporal summary images: an approach to narrative visualization via interactive annotation generation and placement. IEEE Trans. Vis. Comput. Graph. 23(1), 511–520 (2017). Scholar
  13. 13.
    Cairns, P., Cox, A., Nordin, A.I.: Immersion in digital games: review of gaming experience research. In: Handbook of Digital Games, pp. 337–361. Wiley (2014). Scholar
  14. 14.
    Calleja, G.: In-Game: From Immersion to Incorporation. MIT Press, Cambridge (2011)Google Scholar
  15. 15.
    Chevalier, F., Tory, M., Lee, B., van Wijk, J., Santucci, G., Dörk, M., Hullman, J.: From analysis to communication: supporting the lifecycle of a story. In: Data-Driven Storytelling, pp. 151–184. A K Peters/CRC Press (2018)Google Scholar
  16. 16.
    Crowley, K., Sliney, A., Pitt, I., Murphy, D.: Evaluating a brain-computer interface to categorise human emotional response. In: Proceedings of the Conference on Advanced Learning Technologies (ICALT), pp. 276–278. IEEE, Los Alamitos (2010).
  17. 17.
    Donalek, C., et al.: Immersive and collaborative data visualization using virtual reality platforms. In: Proceedings of the Conference on Big Data (Big Data), pp. 609–614. IEEE, Los Alamitos (2014).
  18. 18.
    Fulda, J., Brehmel, M., Munzner, T.: Timelinecurator: interactive authoring of visual timelines from unstructured text. IEEE Trans. Vis. Comput. Graph. 22(1), 300–309 (2016). Scholar
  19. 19.
    Gratzl, S., Lex, A., Gehlenborg, N., Cosgrove, N., Streit, M.: From visual exploration to storytelling and back again. Comput. Graph. Forum 35(3), 491–500 (2016). Scholar
  20. 20.
    Halloran, N.: The Fallen of World War II. Website. Accessed May 2018
  21. 21.
    Hullman, J., Diakopoulos, N., Adar, E.: Contextifier: automatic generation of annotated stock visualizations. In: Proceedings of the Conference on Human Factors in Computing Systems (CHI), pp. 2707–2716. ACM, New York (2013).
  22. 22.
    Hullman, J., Diakopoulos, N.: Visualization rhetoric: framing effects in narrative visualization. IEEE Trans. Vis. Comput. Graph. 17(12), 2231–2240 (2011). Scholar
  23. 23.
    Hullman, J., Drucker, S., Henry Riche, N., Lee, B., Fisher, D., Adar, E.: A deeper understanding of sequence in narrative visualization. IEEE Trans. Vis. Comput. Graph. 19(12), 2406–2415 (2013). Scholar
  24. 24.
    Iser, W.: The Act of Reading: A Theory of Aesthetic Response. Johns Hopkins University Press, Baltimore (1991)Google Scholar
  25. 25.
    Kenny, R., Becker, A.A.: Is the Nasdaq in Another Bubble? Website (2015). Accessed May 2018
  26. 26.
    Kim, N.W., et al.: Data-driven guides: supporting expressive design for information graphics. IEEE Trans. Vis. Comput. Graph. 23(1), 491–500 (2017). Scholar
  27. 27.
    Kosara, R., Mackinlay, J.: Storytelling: the next step for visualization. Computer 46(5), 44–50 (2013). Scholar
  28. 28.
    Kreylos, O., Bawden, G.W., Kellogg, L.H.: Immersive visualization and analysis of LiDAR data. In: Bebis, G., et al. (eds.) ISVC 2008. LNCS, vol. 5358, pp. 846–855. Springer, Heidelberg (2008). Scholar
  29. 29.
    Lee, B., Henry Riche, N., Isenberg, P., Carpendale, S.: More than telling a story: transforming data into visually shared stories. IEEE Comput. Graph. Appl. 35(5), 84–90 (2015). Scholar
  30. 30.
    Lee, B., Kazi, R.H., Smith, G.: Sketchstory: telling more engaging stories with data through freeform sketching. IEEE Trans. Vis. Comput. Graph. 19(12), 2416–2425 (2013). Scholar
  31. 31.
    Lombard, M., Ditton, T.: At the heart of it all: the concept of presence. J. Comput. Mediat. Commun. 3(2) (2006). Scholar
  32. 32.
    McKenna, S., Henry Riche, N., Lee, B., Boy, J., Meyer, M.: Visual narrative flow: exploring factors shaping data visualization story reading experiences. Comput. Graph. Forum 36(3), 377–387 (2017). Scholar
  33. 33.
    Pandey, A.V., Manivannan, A., Nov, O., Satterthwaite, M., Bertini, E.: The persuasive power of data visualization. IEEE Trans. Vis. Comput. Graph. 20(12), 2211–2220 (2014). Scholar
  34. 34.
    Qin, H., Rau, P.L.P., Salvendy, G.: Measuring player immersion in the computer game narrative. Int. J. Hum. Comput. Interact. 25(2), 107–133 (2009). Scholar
  35. 35.
    Ren, D., Brehmer, M., Lee, B., Höllerer, T., Choe, E.K.: Chartaccent: annotation for data-driven storytelling. In: Proceedings of the Pacific Visualization Symposium (PacificVis), pp. 230–239. IEEE, Los Alamitos (2017).
  36. 36.
    Rose, F.: The Art of Immersion: How the Digital Generation is Remaking Hollywood, Madison Avenue, and The Way We Tell Stories. W. W. Norton & Company, New York (2011)Google Scholar
  37. 37.
    Rosling, H.: Hans Rosling’s 200 Countries, 200 Years, 4 Minutes. Video Presentation, November 2010. Accessed Dec 2017
  38. 38.
    Ryan, M.L.: Narrative as Virtual Reality: Immersion and Interactivity in Literature and Electronic Media. The Johns Hopkins University Press, Baltimore (2003)Google Scholar
  39. 39.
    Satyanarayan, A., Heer, J.: Authoring narrative visualizations with ellipsis. Comput. Graph. Forum 33(3), 361–370 (2014). Scholar
  40. 40.
    Segel, E., Heer, J.: Narrative visualization: telling stories with data. Trans. Vis. Comput. Graph. 16(6), 1139–1148 (2010). Scholar
  41. 41.
    Sanchez-Vives, M.V., Slater, M.: From presence to consciousness through virtual reality. Nat. Rev. Neurosci. 6, 332–339 (2005). Scholar
  42. 42.
    Slater, M.: A note on the presence terminology (2017). Accessed Dec 2017
  43. 43.
    Stolper, C.D., Lee, B., Henry Riche, N., Stasko, J.: Emerging and recurring data-driven storytelling techniques: analysis of a curated collection of recent stories. In: Data-Driven Storytelling, pp. 85–105. CRC Press (2018)Google Scholar
  44. 44.
    Tufo, H.M., Fischer, P.F., Papka, M.E., Blom, K.: Numerical simulation and immersive visualization of hairpin vortices. In: Proceedings of the Conference on Supercomputing (SC). ACM, New York (1999).
  45. 45.
    Waldner, M., Le Muzic, M., Bernhard, M., Purgathofer, W., Viola, I.: Attractive flicker-guiding attention in dynamic narrative visualizations. IEEE Trans. Vis. Comput. Graph. 20(12), 2456–2465 (2014). Scholar
  46. 46.
    Wang, Y., Chen, Z., Ma, X., Luo, Q., Qu, H.: Animated narrative visualization for video clickstream data. In: SIGGRAPH ASIA Symposium on Visualization. ACM, New York (2016).
  47. 47.
    Wang, Y., Liu, D., Qu, H., Luo, Q., Ma, X.: A guided tour of literature review: Facilitating academic paper reading with narrative visualization. In: Proceedings of the Symposium on Visual Information Communication and Interaction (VINCI), pp. 17–24. ACM, New York (2016).
  48. 48.
    Zeltzer, D.: Autonomy, interaction, and presence. Presence Teleoperators Virtual Environ. 1(1), 127–132 (1992). Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Petra Isenberg
    • 1
  • Bongshin Lee
    • 2
    Email author
  • Huamin Qu
    • 3
  • Maxime Cordeil
    • 4
  1. 1.InriaParisFrance
  2. 2.Microsoft ResearchRedmondUSA
  3. 3.Hong Kong University of Science and TechnologyKowloonHong Kong
  4. 4.Monash UniversityMelbourneAustralia

Personalised recommendations