The Landscape of Time-Based Visual Presentation Primitives for Richer Video Experience

  • Yasuhiro Yamamoto
  • Kumiyo Nakakoji
  • Takashima Akio
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3585)


As technology advances, we have increasingly more opportunities to use video for our knowledge work, such as monitoring events, reflecting on physical performances, learning subject matter, or analyzing scientific experimental phenomena. Existing video-related software tools are either for as-is viewing or editing and do not support such knowledge-intensive processes. We argue for a variety of interactive presentation tools for richer video experiences in active watching. Based on the Time-based Visual Presentation (TbVP) framework, which separates presentation from content and views interaction methods as transformations between temporal and visual media data properties and user experience properties, this paper presents twenty-seven TbVP primitives and provides the landscape of rich interaction methods for videos. The primitives are illustrated with five scenarios that use videos for knowledge work.


Video Data Video Viewing Rapid Serial Visual Presentation Knowledge Work Visual Property 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Adler, M.J., Doren, C.V.: How to Read a Book. Simon and Schuster, New York (1972)Google Scholar
  2. 2.
    Chiu, P., Girgensohn, A., Liu, Q.: Stained-Glass Visualization for Highly Condensed Video Summaries. In: Proceedings of 2004 IEEE International Conference on Multimedia and Expo, ICME 2004 (June 2004)Google Scholar
  3. 3.
    Cockburn, A., Savage, J., Wallace, A.: Tuning and Testing Scrolling Interfaces that Automatically Zoom, Portland, OR, pp. 71–80. ACM Press, New York (2005)Google Scholar
  4. 4.
    Correia, N., Chambel, T.: Active video watching using annotation. In: Multimedia 1999 Proceedings (Part 2), pp. 151–154. ACM Press, New York (1999)Google Scholar
  5. 5.
    Fels, S., Lee, E., Mase, K.: Techniques for Interactive Video Cubism. In: Proceedings of the Multimedia 2000, Marina del Rey, CA, pp. 368–370 (2000)Google Scholar
  6. 6.
    Fukuchi, K., Mertens, S., Tannenbaum, E.: EffecTV: A Real-time Software Video Effect Processor for Entertainment. In: Rauterberg, M. (ed.) ICEC 2004. LNCS, vol. 3166, pp. 602–605. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  7. 7.
    Girgensohn, A., Wilcox, L., Shipman, F., Bly, S.: Designing Affordances for the Navigation of Detail-on-Demand Hypervideo. In: Proceedings of the Working Conference on Advanced Visual Interfaces, AVI 2004, May 2004, pp. 290–297 (2004)Google Scholar
  8. 8.
    Hornbaek, K., Fraekjaer, E.: Reading Patterns and Usability in Visualizations of Electronic Documents. In: ACM Transactions on Computer-Human Interaction (TOCHI), vol. 10(2), pp. 119–149 (2003)Google Scholar
  9. 9.
    Igarashi, T., Hinckley, K.: Speed-dependent Automatic Zooming for Browsing Large Documents. In: Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology, pp. 139–148. ACM Press, New York (2000)CrossRefGoogle Scholar
  10. 10.
    Li, F.C., Gupta, A., Sanocki, E., He, L.-W., Rui, Y.: Browsing Digital Video. In: Proceedings of the CHI 2000, pp. 169–176. ACM Press, New York (2000)Google Scholar
  11. 11.
    Marshall, C.C., Shipman, F.M.: Spatial Hypertext: Designing for Change. Communications of the ACM 38(8), 88–97 (1995)CrossRefGoogle Scholar
  12. 12.
    Nakakoji, K., Takashima, A., Yamamoto, Y.: Cognitive Effects of Animated Visualization in Exploratory Visual Data Analysis. In: IEEE Proceedings of Information Visualisation, pp. 77–84 (2001)Google Scholar
  13. 13.
    Nakakoji, K., Yamamoto, Y., Reeves, B.N., Takada, S.: Two-Dimensional Positioning as a Means for Reflection in Design of Interactive Systems (DIS 2000), pp. 145–154. ACM Press, New York (2000)Google Scholar
  14. 14.
    Nakakoji, K., Yamamoto, Y., Aoki, A.: Third Annual Special Issue on Interface Design, Interactions, vol. IX.2, pp. 99–102. ACM Press, New York (2002)Google Scholar
  15. 15.
    Nam, J., Tewfik, A.H.: Dynamic Video Summarization and Visualization. In: Proceedings of the Seventh ACM International Conference on Multimedia (Part 2), pp. 53–56 (1999)Google Scholar
  16. 16.
    Schilit, B.N., Golovchinsky, G., Price, M.N.: Beyond Paper: Supporting Active Reading with Free Form Digital Ink Annotations. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256. ACM Press / Addison-Wesley Publishing Co. (1998)Google Scholar
  17. 17.
    Spence, R.: Rapid, Serial and Visual: A Presentation Technique with Potential. Information Visualization 1(1), 13–19 (2002)CrossRefGoogle Scholar
  18. 18.
    Takashima, A., Yamamoto, Y., Nakakoji, K.: A Model and a Tool for Active Watching: Knowledge Construction through Interacting with Video. In: Proceedings of INTERACTION: Systems, Practice and Theory, Sydney, Australia, November 2004, pp. 331–358 (2004)Google Scholar
  19. 19.
    Uchihashi, S., Foote, J., Girgensohn, A., Boreczky, J.: Video Manga: Generating Semantically Meaningful Video Summaries. In: Proceedings of the ACM Multimedia 1999, pp. 383–392 (1999)Google Scholar
  20. 20.
    Wittenburg, K.B., Forlines, C., Lanning, T., Esenther, A.W., Harada, S., Miyachi, T.: Rapid Serial Visual Presentation Techniques for Consumer Digital Video Devices. In: ACM Symposium on User Interface Software and Technology (UIST), November 2003, pp. 115–124 (2003)Google Scholar
  21. 21.
    Yamamoto, Y., Nakakoji, K.: Interaction Design of Tools for Fostering Creativity in the Early Stages of Information Design. In: Edmonds, E.A., Candy, L. (eds.) International Journal of Human Computer Studies (IJHCS), Special issue on Creativity (2005) (in print)Google Scholar
  22. 22.
    Yamamoto, Y., Nakakoji, K., Aoki, A.: Spatial Hypertext for Linear-Information Authoring: Interaction Design and System Development Based on the ART Design Principle. In: Proceedings of Hypertext 2002, June 2002, pp. 35–44. ACM Press, New York (2002)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2005

Authors and Affiliations

  • Yasuhiro Yamamoto
    • 1
  • Kumiyo Nakakoji
    • 1
  • Takashima Akio
    • 2
  1. 1.KID Laboratory, RCASTUniversity of TokyoTokyoJapan
  2. 2.Meme Media LaboratoryHokkaido UniversityHokkaidoJapan

Personalised recommendations