Advertisement

Immersive Visual Data Stories

  • Petra Isenberg
  • Bongshin Lee
  • Huamin Qu
  • Maxime Cordeil
Chapter
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11190)

Abstract

We discuss opportunities and challenges for making people experience immersion when interacting with visual data stories. Even though visual data stories are an important means for communicating information, the extent to which viewers feel immersed in such stories has so far been hardly explored. In this chapter, we explore the concept of immersion in visual data stories from the viewpoint of related disciplines in which narratives play an important role. We pay special attention to games research, which shares a focus on graphics and interactivity with our context of visual data stories. From this exploration we derive research opportunities and challenges for immersion in visual data stories.

Keywords

Storytelling Immersion Data-driven narratives Narrative visualization Visualization 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Amini, F., Henry Riche, N., Lee, B., Hurter, C., Irani, P.: Understanding data videos: looking at narrative visualization through the cinematography lens. In: Proceedings of Conference on Human Factors in Computing Systems (CHI), pp. 1459–1468. ACM, New York (2015).  https://doi.org/10.1145/2702123.2702431
  2. 2.
    Amini, F., Henry Riche, N., Lee, B., Monroy-Hernandez, A., Irani, P.: Authoring data-driven videos with dataclips. IEEE Trans. Vis. Comput. Graph. 23(1), 501–510 (2017).  https://doi.org/10.1109/TVCG.2016.2598647CrossRefGoogle Scholar
  3. 3.
    Bach, B., Kerracher, N., Hall, K.W., Carpendale, S., Kennedy, J., Henry Riche, N.: Telling stories about dynamic networks with graph comics. In: Proceedings of the Conference on Human Factors in Information Systems (CHI), pp. 3670–3682. ACM, New York (2016).  https://doi.org/10.1145/2858036.2858387
  4. 4.
    Bartram, L., Patra, A., Stone, M.: Affective color in visualization. In: Proceedings of the Conference on Human Factors in Computing Systems (CHI), pp. 1364–1374. ACM, New York (2017).  https://doi.org/10.1145/3025453.3026041
  5. 5.
    Bastiras, J., Thomas, B.H.: Combining virtual reality and narrative visualisation to persuade. In: Proceedings of the Symposium on Big Data Visual Analytics (BDVA). IEEE, Los Alamitos (2017).  https://doi.org/10.1109/bdva.2017.8114623
  6. 6.
    Becker, A.A.: Designing virtual reality data visualizations. Talk at the OpenVis Conference 2016, May 2016. https://www.youtube.com/watch?v=EEN_sNXMyko. Accessed May 2018
  7. 7.
    Bigelow, A., Drucker, S., Fisher, D., Meyer, M.: Iterating between tools to create and edit visualizations. IEEE Trans. Vis. Comput. Graph. 23(1), 481–490 (2017).  https://doi.org/10.1109/TVCG.2016.2598609CrossRefGoogle Scholar
  8. 8.
    Borkin, M.A., Vo, A.A., Bylinskii, Z., Isola, P., Sunkavalli, S., Oliva, A., Pfister, H.: What makes a visualization memorable? IEEE Trans. Vis. Comput. Graph. 19(12), 2306–2315 (2013).  https://doi.org/10.1109/TVCG.2013.234CrossRefGoogle Scholar
  9. 9.
    Brehmer, M., Lee, B., Bach, B., Henry Riche, N., Munzner, T.: Timelines revisited: a design space and considerations for expressive storytelling. IEEE Trans. Vis. Comput. Graph. 23(9), 2151–2164 (2017).  https://doi.org/10.1109/TVCG.2016.2614803CrossRefGoogle Scholar
  10. 10.
    Brehmer, M., Lee, B., Henry Riche, N.: Microsoft timeline storyteller. Open Source Software (2017). https://timelinestoryteller.com. Accessed May 2018
  11. 11.
    Brown, E., Cairns, P.: A grounded investigation of game immersion. In: Extended Abstracts on Human Factors in Computing Systems (CHI), pp. 1297–1300. ACM, New York (2004).  https://doi.org/10.1145/985921.986048
  12. 12.
    Bryan, C., Ma, K.L., Woodring, J.: Temporal summary images: an approach to narrative visualization via interactive annotation generation and placement. IEEE Trans. Vis. Comput. Graph. 23(1), 511–520 (2017).  https://doi.org/10.1109/TVCG.2016.2598876CrossRefGoogle Scholar
  13. 13.
    Cairns, P., Cox, A., Nordin, A.I.: Immersion in digital games: review of gaming experience research. In: Handbook of Digital Games, pp. 337–361. Wiley (2014).  https://doi.org/10.1002/9781118796443.ch12CrossRefGoogle Scholar
  14. 14.
    Calleja, G.: In-Game: From Immersion to Incorporation. MIT Press, Cambridge (2011)Google Scholar
  15. 15.
    Chevalier, F., Tory, M., Lee, B., van Wijk, J., Santucci, G., Dörk, M., Hullman, J.: From analysis to communication: supporting the lifecycle of a story. In: Data-Driven Storytelling, pp. 151–184. A K Peters/CRC Press (2018)Google Scholar
  16. 16.
    Crowley, K., Sliney, A., Pitt, I., Murphy, D.: Evaluating a brain-computer interface to categorise human emotional response. In: Proceedings of the Conference on Advanced Learning Technologies (ICALT), pp. 276–278. IEEE, Los Alamitos (2010).  https://doi.org/10.1109/ICALT.2010.81
  17. 17.
    Donalek, C., et al.: Immersive and collaborative data visualization using virtual reality platforms. In: Proceedings of the Conference on Big Data (Big Data), pp. 609–614. IEEE, Los Alamitos (2014).  https://doi.org/10.1109/BigData.2014.7004282
  18. 18.
    Fulda, J., Brehmel, M., Munzner, T.: Timelinecurator: interactive authoring of visual timelines from unstructured text. IEEE Trans. Vis. Comput. Graph. 22(1), 300–309 (2016).  https://doi.org/10.1109/TVCG.2015.2467531CrossRefGoogle Scholar
  19. 19.
    Gratzl, S., Lex, A., Gehlenborg, N., Cosgrove, N., Streit, M.: From visual exploration to storytelling and back again. Comput. Graph. Forum 35(3), 491–500 (2016).  https://doi.org/10.1111/cgf.12925CrossRefGoogle Scholar
  20. 20.
    Halloran, N.: The Fallen of World War II. Website. http://www.fallen.io/ww2. Accessed May 2018
  21. 21.
    Hullman, J., Diakopoulos, N., Adar, E.: Contextifier: automatic generation of annotated stock visualizations. In: Proceedings of the Conference on Human Factors in Computing Systems (CHI), pp. 2707–2716. ACM, New York (2013).  https://doi.org/10.1145/2470654.2481374
  22. 22.
    Hullman, J., Diakopoulos, N.: Visualization rhetoric: framing effects in narrative visualization. IEEE Trans. Vis. Comput. Graph. 17(12), 2231–2240 (2011).  https://doi.org/10.1109/TVCG.2011.255CrossRefGoogle Scholar
  23. 23.
    Hullman, J., Drucker, S., Henry Riche, N., Lee, B., Fisher, D., Adar, E.: A deeper understanding of sequence in narrative visualization. IEEE Trans. Vis. Comput. Graph. 19(12), 2406–2415 (2013).  https://doi.org/10.1109/TVCG.2013.119CrossRefGoogle Scholar
  24. 24.
    Iser, W.: The Act of Reading: A Theory of Aesthetic Response. Johns Hopkins University Press, Baltimore (1991)Google Scholar
  25. 25.
    Kenny, R., Becker, A.A.: Is the Nasdaq in Another Bubble? Website (2015). http://graphics.wsj.com/3d-nasdaq. Accessed May 2018
  26. 26.
    Kim, N.W., et al.: Data-driven guides: supporting expressive design for information graphics. IEEE Trans. Vis. Comput. Graph. 23(1), 491–500 (2017).  https://doi.org/10.1109/TVCG.2016.2598620MathSciNetCrossRefGoogle Scholar
  27. 27.
    Kosara, R., Mackinlay, J.: Storytelling: the next step for visualization. Computer 46(5), 44–50 (2013).  https://doi.org/10.1109/MC.2013.36CrossRefGoogle Scholar
  28. 28.
    Kreylos, O., Bawden, G.W., Kellogg, L.H.: Immersive visualization and analysis of LiDAR data. In: Bebis, G., et al. (eds.) ISVC 2008. LNCS, vol. 5358, pp. 846–855. Springer, Heidelberg (2008).  https://doi.org/10.1007/978-3-540-89639-5_81CrossRefGoogle Scholar
  29. 29.
    Lee, B., Henry Riche, N., Isenberg, P., Carpendale, S.: More than telling a story: transforming data into visually shared stories. IEEE Comput. Graph. Appl. 35(5), 84–90 (2015).  https://doi.org/10.1109/MCG.2015.99CrossRefGoogle Scholar
  30. 30.
    Lee, B., Kazi, R.H., Smith, G.: Sketchstory: telling more engaging stories with data through freeform sketching. IEEE Trans. Vis. Comput. Graph. 19(12), 2416–2425 (2013).  https://doi.org/10.1109/TVCG.2013.191CrossRefGoogle Scholar
  31. 31.
    Lombard, M., Ditton, T.: At the heart of it all: the concept of presence. J. Comput. Mediat. Commun. 3(2) (2006).  https://doi.org/10.1111/j.1083-6101.1997.tb00072.xCrossRefGoogle Scholar
  32. 32.
    McKenna, S., Henry Riche, N., Lee, B., Boy, J., Meyer, M.: Visual narrative flow: exploring factors shaping data visualization story reading experiences. Comput. Graph. Forum 36(3), 377–387 (2017).  https://doi.org/10.1111/cgf.13195CrossRefGoogle Scholar
  33. 33.
    Pandey, A.V., Manivannan, A., Nov, O., Satterthwaite, M., Bertini, E.: The persuasive power of data visualization. IEEE Trans. Vis. Comput. Graph. 20(12), 2211–2220 (2014).  https://doi.org/10.1109/TVCG.2014.2346419CrossRefGoogle Scholar
  34. 34.
    Qin, H., Rau, P.L.P., Salvendy, G.: Measuring player immersion in the computer game narrative. Int. J. Hum. Comput. Interact. 25(2), 107–133 (2009).  https://doi.org/10.1080/10447310802546732CrossRefGoogle Scholar
  35. 35.
    Ren, D., Brehmer, M., Lee, B., Höllerer, T., Choe, E.K.: Chartaccent: annotation for data-driven storytelling. In: Proceedings of the Pacific Visualization Symposium (PacificVis), pp. 230–239. IEEE, Los Alamitos (2017).  https://doi.org/10.1109/PACIFICVIS.2017.8031599
  36. 36.
    Rose, F.: The Art of Immersion: How the Digital Generation is Remaking Hollywood, Madison Avenue, and The Way We Tell Stories. W. W. Norton & Company, New York (2011)Google Scholar
  37. 37.
    Rosling, H.: Hans Rosling’s 200 Countries, 200 Years, 4 Minutes. Video Presentation, November 2010. https://www.youtube.com/watch?v=jbkSRLYSojo. Accessed Dec 2017
  38. 38.
    Ryan, M.L.: Narrative as Virtual Reality: Immersion and Interactivity in Literature and Electronic Media. The Johns Hopkins University Press, Baltimore (2003)Google Scholar
  39. 39.
    Satyanarayan, A., Heer, J.: Authoring narrative visualizations with ellipsis. Comput. Graph. Forum 33(3), 361–370 (2014).  https://doi.org/10.1111/cgf.12392CrossRefGoogle Scholar
  40. 40.
    Segel, E., Heer, J.: Narrative visualization: telling stories with data. Trans. Vis. Comput. Graph. 16(6), 1139–1148 (2010).  https://doi.org/10.1109/TVCG.2010.179CrossRefGoogle Scholar
  41. 41.
    Sanchez-Vives, M.V., Slater, M.: From presence to consciousness through virtual reality. Nat. Rev. Neurosci. 6, 332–339 (2005).  https://doi.org/10.1038/nrn1651CrossRefGoogle Scholar
  42. 42.
    Slater, M.: A note on the presence terminology (2017). https://www.researchgate.net/publication/242608507_A_Note_on_Presence_Terminology. Accessed Dec 2017
  43. 43.
    Stolper, C.D., Lee, B., Henry Riche, N., Stasko, J.: Emerging and recurring data-driven storytelling techniques: analysis of a curated collection of recent stories. In: Data-Driven Storytelling, pp. 85–105. CRC Press (2018)Google Scholar
  44. 44.
    Tufo, H.M., Fischer, P.F., Papka, M.E., Blom, K.: Numerical simulation and immersive visualization of hairpin vortices. In: Proceedings of the Conference on Supercomputing (SC). ACM, New York (1999).  https://doi.org/10.1145/331532.331594
  45. 45.
    Waldner, M., Le Muzic, M., Bernhard, M., Purgathofer, W., Viola, I.: Attractive flicker-guiding attention in dynamic narrative visualizations. IEEE Trans. Vis. Comput. Graph. 20(12), 2456–2465 (2014).  https://doi.org/10.1109/TVCG.2014.2346352CrossRefGoogle Scholar
  46. 46.
    Wang, Y., Chen, Z., Ma, X., Luo, Q., Qu, H.: Animated narrative visualization for video clickstream data. In: SIGGRAPH ASIA Symposium on Visualization. ACM, New York (2016).  https://doi.org/10.1145/3002151.3002155
  47. 47.
    Wang, Y., Liu, D., Qu, H., Luo, Q., Ma, X.: A guided tour of literature review: Facilitating academic paper reading with narrative visualization. In: Proceedings of the Symposium on Visual Information Communication and Interaction (VINCI), pp. 17–24. ACM, New York (2016).  https://doi.org/10.1145/2968220.2968242
  48. 48.
    Zeltzer, D.: Autonomy, interaction, and presence. Presence Teleoperators Virtual Environ. 1(1), 127–132 (1992).  https://doi.org/10.1162/pres.1992.1.1.127CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  • Petra Isenberg
    • 1
  • Bongshin Lee
    • 2
  • Huamin Qu
    • 3
  • Maxime Cordeil
    • 4
  1. 1.InriaParisFrance
  2. 2.Microsoft ResearchRedmondUSA
  3. 3.Hong Kong University of Science and TechnologyKowloonHong Kong
  4. 4.Monash UniversityMelbourneAustralia

Personalised recommendations