Skip to main content
SpringerLink
Log in

Design guidelines for augmenting short-form videos using animated data visualizations

  • Regular Paper
  • Published:
Journal of Visualization Aims and scope Submit manuscript

Abstract

Short-form videos are an increasingly prevalent medium for storytelling in journalism and marketing, of which information can be greatly enhanced by animated data visualizations. However, there is no prior research that systematically investigates how to augment such short videos with data visualizations in an effective way. We conducted a design workshop with experienced video, animation designers and visualization experts to discuss principles and practices for augmenting short-form videos with data visualizations. After the workshop, we summarized the participants’ design considerations and proposed 20 design guidelines. We further collected design purposes of the participants and associated these purposes with the guidelines. Finally, we conducted a crowd-sourcing study and a task-based evaluation to validate the effectiveness and usability of the guidelines. Results indicate that our guidelines can significantly improve the videos accompanied with data visualizations and help novices easily obtain desired knowledge when augmenting videos.

Graphic abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Notes

  1. https://www.taobao.com/

References

  • Amazon (2005) Amazon mechanical turk. https://www.mturk.com/. Accessed 1 Aug 2018

  • Amini F, Henry Riche N, Lee B, Hurter C, Irani P (2015) Understanding data videos: Looking at narrative visualization through the cinematography lens. In: Proceedings of the ACM conference on human factors in computing systems, pp 1459–1468

  • Amini F, Riche NH, Lee B, Monroy-Hernandez A, Irani P (2017) Authoring data-driven videos with dataclips. IEEE Trans Vis Comput Graph 23(1):501–510

    Article  Google Scholar 

  • Amini F, Riche NH, Lee B, Leboe-McGowan J, Irani P (2018) Hooked on data videos: assessing the effect of animation and pictographs on viewer engagement. In: Proceedings of the international conference on advanced visual interfaces, pp 1–9

  • Bach B, Pietriga E, Fekete J, Bach B, Pietriga E, Fekete J, Member S (2014) Navigation for dynamic networks graphdiaries: animated transitions and temporal navigation for dynamic networks. IEEE Trans Vis Comput Graph 20(5):740–754

    Article  Google Scholar 

  • Bach B, Kerracher N, Hall KW, Carpendale S, Kennedy J, Henry Riche N (2016) Telling stories about dynamic networks with graph comics. In: Proceedings of the ACM conference on human factors in computing systems, pp 3670–3682

  • Bach B, Riche NH, Carpendale S, Pfister H (2017) The emerging genre of data comics. IEEE Comput Graph Appl 38(3):6–13

    Article  Google Scholar 

  • Bach B, Wang Z, Farinella M, Murray-Rust D, Henry Riche N (2018) Design patterns for data comics. In: Proceedings of the ACM conference on human factors in computing systems, pp 1–12

  • Borgo R, Kehrer J, Chung DHS, Maguire E, Laramee RS, Hauser H, Ward M, Chen M (2013) Glyph-based visualization: foundations, design guidelines, techniques and applications. Eurographics State of the Art Reports, pp 39–63

  • Chevalier F, Riche N, Plaisant C (2016) Animations 25 Years Later: New Roles and Opportunities. In: Proceedings of the international working conference on advanced visual interfaces, pp 280–287

  • Felberbaum Y, Lanir J (2018) Better understanding of foot gestures: an elicitation study. ACM, New York, p 334

    Google Scholar 

  • Fisher D (2010) Animation for visualization: opportunities and drawbacks. In: Beautiful visualization. O'Reilly Media, pp 329–352

  • Foundation ID (2018) Design guidelines. https://www.interaction-design.org/literature/topics/design-guidelines. Accessed 1 Aug 2018

  • Hanington B, Martin B (2012) Affinity diagramming. In: Universal methods of design, pp 12–14. Rockport Publishers

  • Heer J, Bostock M (2010) Crowdsourcing graphical perception: using mechanical turk to assess visualization design. In: Proceedings of the ACM conference on human factors in computing systems, ACM, pp 203–212

  • Heer J, Robertson GG (2007) Animated transitions in statistical data graphics. IEEE Trans Vis Comput Graph 13(6):1240–1247

    Article  Google Scholar 

  • Heiser J, Phan D, Agrawala M, Tversky B, Hanrahan P (2004) Identification and validation of cognitive design principles for automated generation of assembly instructions. In: Proceedings of the working conference on advanced visual interfaces, ACM, pp 311–319

  • Hoffswell J, Satyanarayan A, Heer J (2018) Augmenting code with in situ visualizations to aid program understanding. In: Proceedings of the 2018 CHI conference on human factors in computing systems, ACM, p 532

  • Hullman J, Diakopoulos N (2011) Visualization rhetoric: framing effects in narrative visualization. IEEE Trans Vis Comput Graph 17(12):2231–2240

    Article  Google Scholar 

  • Hullman J, Drucker S, Henry Riche N, Lee B, Fisher D, Adar E (2013) A deeper understanding of sequence in narrative visualization. IEEE Trans Vis Comput Graph 19(12):2406–2415

    Article  Google Scholar 

  • Huron S, Vuillemot R, Fekete JD (2013) Visual sedimentation. IEEE Trans Vis Comput Graph 19(12):2446–2455

    Article  Google Scholar 

  • Inc A (1993) Adobe after effects. https://www.adobe.com/products/aftereffects.html. Accessed 1 Aug 2018

  • Inc A (2003) Adobe premiere. https://www.adobe.com/products/premiere.html. Accessed 1 Aug 2018

  • Kosara R, Mackinlay J (2013) Storytelling: the next step for visualization. IEEE Comput 46(5):44–50

    Article  Google Scholar 

  • Lee B, Riche NH, Isenberg P, Carpendale S (2015) More than telling a story: transforming data into visually shared stories. IEEE Comput Graph Appl 35(5):84–90

    Article  Google Scholar 

  • Li C, Lv P, Manocha D, Wang H, Li Y, Zhou B, Xu M (2019) ACSEE: antagonistic crowd simulation model with emotional contagion and evolutionary game. In: IEEE transactions on affective computing (to appear)

  • Lidwell W, Holden K, Butler J (2010a) Readability. In: Universal principles of design, pp 198–199. Rockport Publishers

  • Lidwell W, Holden K, Butler J (2010b) Priming. In: Universal principles of design, pp 186–187. Rockport Publishers

  • Lidwell W, Holden K, Butler J (2010c) Fitts’ Law. In: Universal principles of design, pp 98–99. Rockport Publishers

  • Lidwell W, Holden K, Butler J (2010d) Proximity. In: Universal principles of design, pp 196–197. Rockport Publishers

  • Lidwell W, Holden K, Butler J (2010e) Inference effects. In: Universal principles of design, pp 138–139. Rockport Publishers

  • Lidwell W, Holden K, Butler J (2010f) Serial position effect. In: Universal principles of design, pp 220–221. Rockport Publishers

  • Lidwell W, Holden K, Butler J (2010g) Consistency. In: Universal principles of design, pp 56–57. Rockport Publishers

  • Liu S, Yin J, Wang X, Cui W, Cao K, Pei J (2016) Online visual analytics of text streams. IEEE Trans Vis Comput Graph 22(11):2451–2466

    Article  Google Scholar 

  • Robertson G, Fernandez R, Fisher D, Lee B, Stasko J (2008) Effectiveness of animation in trend visualization. IEEE Trans Vis Comput Graph 14(6):1325–1332

    Article  Google Scholar 

  • Rufiange S, McGuffin MJ (2013) DiffAni: visualizing dynamic graphs with a hybrid of difference maps and animation. IEEE Trans Vis Comput Graph 19(12):2556–2565

    Article  Google Scholar 

  • Seckler M, Heinz S, Bargas-Avila JA, Opwis K, Tuch AN (2014) Designing usable web forms—empirical evaluation of web form improvement guidelines. In: Proceedings of the ACM conference on human factors in computing systems, pp 1275–1284

  • Segel E, Heer J (2010) Narrative visualization: telling stories with data. IEEE Trans Vis Comput Graph 16(6):1139–1148

    Article  Google Scholar 

  • Singh DP, Lisle L, Murali T, Luther K (2018) Crowdlayout: crowdsourced design and evaluation of biological network visualizations. In: Proceedings of the ACM conference on human factors in computing systems, ACM, pp 1–14

  • Tang T, Rubab S, Lai J, Cui W, Yu L, Wu Y (2019) iStoryline: effective convergence to hand-drawn storylines. IEEE Trans Vis Comput Graph 25(1):769–778

    Article  Google Scholar 

  • Tversky B, Morrison JB, Betrancourt M (2002) Animation: Can it facilitate? Int J Hum Comput Stud Schnotz Kulhavy 57:247–262

    Article  Google Scholar 

  • Van Welie M, Van Der Veer GC, Eliëns A (2001) Patterns as tools for user interface design. In: Tools for Working with Guidelines, pp 313–324

  • Wang Y, Chen Z, Ma X, Luo Q, Qu H (2016) Animated Narrative Visualization for Video Clickstream Data. In: Proceedings of Siggraph Asia symposium on visualization, pp 1–8

  • Weng D, Chen R, Deng Z, Wu F, Chen J, Wu Y (2019) SRVis: towards better spatial integration in ranking visualization. IEEE Trans Vis Comput Graph 25(1):459–469

    Article  Google Scholar 

  • Wu Y, Cao N, Gotz D, Tan YP, Keim DA (2016) A survey on visual analytics of social media data. IEEE Trans Multimed 18(11):2135–2148

    Article  Google Scholar 

  • Wu Y, Chen Z, Sun G, Xie X, Cao N, Liu S, Cui W (2018) StreamExplorer: a multi-stage system for visually exploring events in social streams. IEEE Trans Vis Comput Graph 24(10):2758–2772

    Article  Google Scholar 

  • Xie X, Cai X, Zhou J, Cao N, Wu Y (2019) A semantic-based method for visualizing large image collections. IEEE Trans Vis Comput Graph 25(7):2362–2377

    Article  Google Scholar 

  • Xu M, Li C, Lv P, Lin N, Hou R, Zhou B (2017) An efficient method of crowd aggregation computation in public areas. IEEE Trans Circuits Syst Video Technol 28(10):2814–2825

    Article  Google Scholar 

  • Xu M, Su H, Li Y, Li X, Liao J, Niu J, Lv P, Zhou B (2019a) Stylized aesthetic QR code. IEEE Trans Multimed 21(8):1960–1970

    Article  Google Scholar 

  • Xu M, Xie X, Lv P, Niu J, Wang H, Li C, Zhu R, Deng Z, Zhou B (2019b) Crowd behavior simulation with emotional contagion in unexpected multihazard situations. In: IEEE transactions on systems, man, and cybernetics: systems (to appear)

  • Xue J, Yin H, Lv P, Xu M, Li Y (2019) Crowd queuing simulation with an improved emotional contagion model. Sci China Inf Sci 62(4):44101

    Article  Google Scholar 

  • Zhou Z (2019) Abductive learning: towards bridging machine learning and logical reasoning. Sci China Inf Sci 62(7):76101

    Article  MathSciNet  Google Scholar 

Download references

Acknowledgements

The work was supported by NSFC (61761136020), NSFC-Zhejiang Joint Fund for the Integration of Industrialization and Informatization (U1609217), Zhejiang Provincial Natural Science Foundation (LR18F020001) and the 100 Talents Program of Zhejiang University. This Project was also supported by Alibaba Group.

Author information

Authors and Affiliations

  1. State Key Lab of CAD&CG, Zhejiang University and Alibaba-Zhejiang University Joint Institute of Frontier Technologies, Hangzhou, China

    Tan Tang, Junxiu Tang, Jiayi Hong & Yingcai Wu

  2. Department of Computer Science and Software Engineering, Xi’an Jiaotong-Liverpool University, Suzhou, China

    Lingyun Yu

  3. The Alibaba Group, Hangzhou, China

    Peiran Ren

Authors
  1. Tan Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Junxiu Tang
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jiayi Hong
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Lingyun Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Peiran Ren
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Yingcai Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yingcai Wu.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Tang, T., Tang, J., Hong, J. et al. Design guidelines for augmenting short-form videos using animated data visualizations. J Vis 23, 707–720 (2020). https://doi.org/10.1007/s12650-020-00644-z

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12650-020-00644-z

Keywords

Search

Navigation