Size Matters! How Thumbnail Number, Size, and Motion Influence Mobile Video Retrieval

  • Wolfgang Hürst
  • Cees G. M. Snoek
  • Willem-Jan Spoel
  • Mate Tomin
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6524)


Various interfaces for video browsing and retrieval have been proposed that provide improved usability, better retrieval performance, and richer user experience compared to simple result lists that are just sorted by relevance. These browsing interfaces take advantage of the rather large screen estate on desktop and laptop PCs to visualize advanced configurations of thumbnails summarizing the video content. Naturally, the usefulness of such screen-intensive visual browsers can be called into question when applied on small mobile handheld devices, such as smart phones. In this paper, we address the usefulness of thumbnail images for mobile video retrieval interfaces. In particular, we investigate how thumbnail number, size, and motion influence the performance of humans in common recognition tasks. Contrary to widespread believe that screens of handheld devices are unsuited for visualizing multiple (small) thumbnails simultaneously, our study shows that users are quite able to handle and assess multiple small thumbnails at the same time, especially when they show moving images. Our results give suggestions for appropriate video retrieval interface designs on handheld devices.


Mobile video video retrieval interfaces visual assessment tasks 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Adcock, J., Cooper, M., Girgensohn, A., Wilcox, L.: Interactive Video Search Using Multilevel Indexing. In: Proc. CIVR (2005)Google Scholar
  2. 2.
    Ames, M., Eckles, D., Naaman, M., Spasojevic, M., Van House, N.: Requirements for Mobile Photoware. Personal and Ubiquitous Computing 14(2), 95–109 (2010)CrossRefGoogle Scholar
  3. 3.
    Björk, S., Holmquist, L.E., Redström, J., Bretan, I., Danielsson, R., Karlgren, J., Franzén, K.: WEST: a Web Browser for Small Terminals. In: Proc. ACM UIST (1999)Google Scholar
  4. 4.
    Boreczky, J., Girgensohn, A., Golovchinsky, G., Uchihashi, S.: An Interactive Comic Book Presentation for Exploring Video. In: Proc. ACM CHI, The Hague, Netherlands, pp. 185–192 (2000)Google Scholar
  5. 5.
    Brachmann, C., Malaka, R.: Keyframe-less Integration of Semantic Information in a Video Player Interface. In: Proc. EITC, Leuven, Belgium (2009)Google Scholar
  6. 6.
    Christel, M.G., Warmack, A., Hauptmann, A.G., Crosby, S.: Adjustable Filmstrips and Skims as Abstractions for a Digital Video Library. In: Proc. IEEE Advances in Digital Libraries Conference 1999, Baltimore, MD, pp. 98–104 (1999)Google Scholar
  7. 7.
    Christel, M.G., Hauptmann, A.G., Wactlar, H.D., Ng, T.D.: Collages as Dynamic Summaries for News Video. In: Proc. ACM Multimedia (2002)Google Scholar
  8. 8.
    Dachselt, R., Frisch, M.: Mambo: A Facet-Based Zoomable Music Browser. In: Proc. ACM Mobile and Ubiquitous Multimedia (2007)Google Scholar
  9. 9.
    Gurrin, C., Brenna, L., Zagorodnov, D., Lee, H., Smeaton, A.F., Johansen, D.: Supporting Mobile Access to Digital Video Archives Without User Queries. In: Proc. MobileHCI (2006)Google Scholar
  10. 10.
    Heesch, D., Rüger, S.: Image Browsing: A semantic analysis of NNk networks. In: Proc. CIVR (2005)Google Scholar
  11. 11.
    Hürst, W., Götz, G., Welte, M.: Interactive Video Browsing on Mobile Devices. In: Proc ACM Multimedia (2007)Google Scholar
  12. 12.
    Hürst, W.: Video Browsing on Handheld Devices—Interface Designs for the Next Generation of Mobile Video Players. IEEE MultiMedia 15(3), 76–83 (2008)CrossRefGoogle Scholar
  13. 13.
    Hürst, W., Götz, G.: Interface Designs for Pen-Based Mobile Video Browsing. In: Proc. Designing Interactive Systems, DIS (2008)Google Scholar
  14. 14.
    Hürst, W., Merkle, P.: One-Handed Mobile Video Browsing. In: Proc. uxTV (2008)Google Scholar
  15. 15.
    Hürst, W., Meier, K.: Interfaces for Timeline-based Mobile Video Browsing. In: Proc. ACM Multimedia (2008)Google Scholar
  16. 16.
    Hürst, W., Snoek, C.G.M., Spoel, W.-J., Tomin, M.: Keep Moving! Revisiting Thumbnails for Mobile Video Retrieval. In: Proc. ACM Multimedia (2010)Google Scholar
  17. 17.
    Huurnink, B., Snoek, C.G.M., de Rijke, M., Smeulders, A.W.M.: Today’s and Tomorrow’s Retrieval Practice in the Audiovisual Archive. In: Proc. ACM CIVR (2010)Google Scholar
  18. 18.
    Lee, H., Smeaton, A.F., Murphy, N., O’Connor, N., Marlow, S.: Fischlar on a PDA: Handheld User Interface Design to a Video Indexing, Browsing, and Playback System. In: Proc. UAHCI (2001)Google Scholar
  19. 19.
    Luan, H., Neo, S., Goh, H., Zhang, Y., Lin, S., Chua, T.: Segregated Feedback with Performance-based Adaptive Sampling for Interactive News Video Retrieval. In: Proc. ACM Multimedia (2007)Google Scholar
  20. 20.
    O’Hara, K., Slayden, A., Michell, A.S., Vorbau, A.: Consuming Video on Mobile Devices. In: Proc. CHI (2007)Google Scholar
  21. 21.
    de Rooij, O., Snoek, C.G.M., Worring, M.: Balancing Thread Based Navigation for Targeted Video Search. In: Proc. CIVR (2008)Google Scholar
  22. 22.
    Smeaton, A.F., Over, P., Kraaij, W.: Evaluation Campaigns and TRECVid. In: Proc. ACM Multimedia Information Retrieval, Santa Barbara, USA, pp. 321–330 (2006)Google Scholar
  23. 23.
    Smeaton, A.F., Foley, C., Byrne, D., Jones, G.J.F.: iBingo Mobile Collaborative Search. In: Proc. CIVR (2008)Google Scholar
  24. 24.
    Snoek, C.G.M., Worring, M., Koelma, D.C., Smeulders, A.W.M.: A Learned Lexicon- Driven Paradigm for Interactive Video Retrieval. IEEE Transactions on Multimedia 9(2), 280–292 (2007)CrossRefGoogle Scholar
  25. 25.
    Torralba, A., Fergus, R., Freeman, W.T.: 80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(11), 1958–1970 (2008)CrossRefGoogle Scholar
  26. 26.
    Vaughan-Nichols, S.J.: The Mobile Web Comes of Age. IEEE Computer 41(11), 15–17 (2008)CrossRefGoogle Scholar
  27. 27.
    Wactlar, H.D., Christel, M.G., Gong, Y., Hauptmann, A.G.: Lessons Learned from Building a Terabyte Digital Video Library. IEEE Computer 32(2), 66–73 (1999)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Wolfgang Hürst
    • 1
  • Cees G. M. Snoek
    • 2
  • Willem-Jan Spoel
    • 1
  • Mate Tomin
    • 1
  1. 1.Utrecht UniversityUtrechtThe Netherlands
  2. 2.University of AmsterdamAmsterdamThe Netherlands

Personalised recommendations