Advertisement

A User Study of Visual Search Performance with Interactive 2D and 3D Storyboards

  • Klaus Schoeffmann
  • David Ahlström
  • Laszlo Böszörmenyi
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7836)

Abstract

A storyboard is a grid-like arrangement of images, or key-frames of videos, that is commonly used to browse image or video collections or to present results of a query in an image or video retrieval tool. We investigate alternatives to the commonly used scroll-based 2D storyboard for the task of browsing a large set of images. Through a user study with 28 participants we evaluate three different kinds of storyboards in terms of visual search performance and user satisfaction. Our results show that a 3D cylindrical visualization of a storyboard is a promising alternative to the conventional scroll-based storyboard.

Keywords

Visual Search User Study Trial Time Search Display Video Retrieval 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Arman, F., Depommier, R., Hsu, A., Chiu, M.: Content-based browsing of video sequences. In: Proceedings of the Second ACM International Conference on Multimedia, pp. 97–103. ACM Press (1994)Google Scholar
  2. 2.
    Chiu, P., Girgensohn, A., Lertsithichai, S., Polak, W., Shipman, F.: Mediametro: browsing multimedia document collections with a 3d city metaphor. In: Proceedings of the 13th Annual ACM International Conference on Multimedia, MULTIMEDIA 2005, pp. 213–214. ACM, New York (2005)CrossRefGoogle Scholar
  3. 3.
    Chiu, P., Huang, J., Back, M., Diakopoulos, N., Doherty, J., Polak, W., Sun, X.: Mtable: browsing photos and videos on a tabletop system. In: Proceeding of the 16th ACM International Conference on Multimedia, MM 2008, pp. 1107–1108. ACM, New York (2008)CrossRefGoogle Scholar
  4. 4.
    Christmann, O., Carbonell, N., Richir, S.: Visual search in dynamic 3d visualisations of unstructured picture collections. Interacting with Computers 22(5), 399–416 (2010); Modelling user experienceCrossRefGoogle Scholar
  5. 5.
    Cockburn, A., Gutwin, C., Alexander, J.: Faster document navigation with space-filling thumbnails. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2006, pp. 1–10. ACM, New York (2006)Google Scholar
  6. 6.
    de Rooij, O., Snoek, C.G.M., Worring, M.: Mediamill: semantic video search using the rotorbrowser. In: Proceedings of the 6th ACM International Conference on Image and Video Retrieval, CIVR 2007, p. 649. ACM, New York (2007)Google Scholar
  7. 7.
    de Rooij, O., Snoek, C.G.M., Worring, M.: Query on demand video browsing. In: Proceedings of the 15th International Conference on Multimedia, MULTIMEDIA 2007, pp. 811–814. ACM, New York (2007)Google Scholar
  8. 8.
    Delest, M., Don, A., Benois-Pineau, J.: Dag-based visual interfaces for navigation in indexed video content. Multimedia Tools and Applications 31, 51–72 (2006), 10.1007/s11042-006-0032-4CrossRefGoogle Scholar
  9. 9.
    Divakaran, A., Forlines, C., Lanning, T., Shipman, S., Wittenburg, K.: Augmenting fast-forward and rewind for personal digital video recorders. In: Proceedings of the IEEE International Conference on Consumer Electronics, ICCE, pp. 43–44. IEEE (2005)Google Scholar
  10. 10.
    Förster, J., Higgins, E., Bianco, A.: Speed/accuracy decisions in task performance: Built-in trade-off or separate strategic concerns? Organizational Behavior and Human Decision Processes 90(1), 148–164 (2003)CrossRefGoogle Scholar
  11. 11.
    Hart, S., Staveland, L.: Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research. Elsevier B.V. (1988)Google Scholar
  12. 12.
    Komlodi, A., Marchionini, G.: Key frame preview techniques for video browsing. In: Proceedings of the 3rd ACM Conference on Digital Libraries, pp. 118–125. ACM Press (1998)Google Scholar
  13. 13.
    Manske, K.: Video browsing using 3D video content trees. In: Proceedings of the 1998 Workshop on New Paradigms in Information Visualization and Manipulation, pp. 20–24. ACM Press (1998)Google Scholar
  14. 14.
    Nguyen, G., Worring, M.: Interactive access to large image collections using similarity-based visualization. Journal of Visual Languages & Computing 19(2), 203–224 (2008)CrossRefGoogle Scholar
  15. 15.
    Plant, W., Schaefer, G.: Visualising image databases. In: Proceedings of the IEEE International Workshop on Multimedia Signal Processing, MMSP 2009, pp. 1–6. IEEE (2009)Google Scholar
  16. 16.
    Quadrianto, N., Kersting, K., Tuytelaars, T., Buntine, W.: Beyond 2D-grids: a dependence maximization view on image browsing. In: Proceedings of the International Conference on Multimedia Information Retrieval, pp. 339–348. ACM Press (2010)Google Scholar
  17. 17.
    Rodden, K., Basalaj, W., Sinclair, D., Wood, K.: Does organisation by similarity assist image browsing? In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 190–197. ACM Press (2001)Google Scholar
  18. 18.
    Schaefer, G.: A next generation browsing environment for large image repositories. Multimedia Tools and Applications 47(1), 105–120 (2010)CrossRefGoogle Scholar
  19. 19.
    Schoeffmann, K., Ahlström, D., Beecks, C.: 3d Image browsing on mobile devices. In: Proceedings of the Seventh IEEE International Symposium on Multimedia, ISM 2011, Dana Point, California, USA (December 2011)Google Scholar
  20. 20.
    Schoeffmann, K., Boeszoermenyi, L.: Image and Video Browsing with a Cylindrical 3D Storyboard. In: Proceedings of the 2011 ACM International Conference on Multimedia Retrieval, ICMR 2011. ACM (2011)Google Scholar
  21. 21.
    Schoeffmann, K., del Fabro, M.: Hierarchical video browsing with a 3d carousel. In: Proceedings of the ACM International Conference on Multimedia, Scottsdale, AZ, USA (December 2011)Google Scholar
  22. 22.
    Smeaton, A.F., Over, P., Kraaij, W.: Evaluation campaigns and trecvid. In: MIR 2006: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval, pp. 321–330. ACM Press (2006)Google Scholar
  23. 23.
    Zheng, Y., Neo, S., Chen, X., Chua, T.: Visiongo: towards true interactivity. In: Proceeding of the ACM International Conference on Image and Video Retrieval, CIVR 2009, pp. 51:1–51:1. ACM, New York (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Klaus Schoeffmann
    • 1
  • David Ahlström
    • 1
  • Laszlo Böszörmenyi
    • 1
  1. 1.Klagenfurt UniversityKlagenfurtAustria

Personalised recommendations