Storyboard-Based Video Browsing Using Color and Concept Indices

  • Wolfgang HürstEmail author
  • Algernon Ip Vai Ching
  • Klaus Schoeffmann
  • Manfred J. Primus
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10133)


We present an interface for interactive video browsing where users visually skim storyboard representations of the files in search for known items (known-item search tasks) and textually described subjects, objects, or events (ad-hoc search tasks). Individual segments of the video are represented as a color-sorted storyboard that can be addressed via a color-index. Our storyboard representation is optimized for quick visual inspections considering results from our ongoing research. In addition, a concept based-search is used to filter out parts of the storyboard containing the related concept(s), thus complementing the human-based visual inspection with a semantic, content-based annotation.


Video browsing Visual inspection Concept-based indexing 


  1. 1.
    Hudelist, M.A., Cobârzan, C., Beecks, C., Werken, R., Kletz, S., Hürst, W., Schoeffmann, K.: Collaborative video search combining video retrieval with human-based visual inspection. In: Tian, Q., Sebe, N., Qi, G.-J., Huet, B., Hong, R., Liu, X. (eds.) MMM 2016. LNCS, vol. 9517, pp. 400–405. Springer, Heidelberg (2016). doi: 10.1007/978-3-319-27674-8_40 CrossRefGoogle Scholar
  2. 2.
    Hürst, W., van de Werken, R.: Human-based video browsing-investigating interface design for fast video browsing. In: 2015 IEEE International Symposium on Multimedia (ISM), pp. 363–368. IEEE, December 2015Google Scholar
  3. 3.
    Hürst, W., Darzentas, D.: Quantity versus quality: the role of layout and interaction complexity in thumbnail-based video retrieval interfaces. In: Proceedings of the 2nd ACM International Conference on Multimedia Retrieval (ICMR 2012), Article 45, p. 8. ACM, New York (2012)Google Scholar
  4. 4.
    Hürst, W., Snoek, C.G.M., Spoel, W.-J., Tomin, M.: Keep moving! Revisiting thumbnails for mobile video retrieval. In: Proceedings of the International Conference on Multimedia (MM 2010), pp. 963–966. ACM, New York (2010)Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Wolfgang Hürst
    • 1
    Email author
  • Algernon Ip Vai Ching
    • 1
  • Klaus Schoeffmann
    • 2
  • Manfred J. Primus
    • 2
  1. 1.Utrecht UniversityUtrechtNetherlands
  2. 2.Klagenfurt UniversityKlagenfurtAustria

Personalised recommendations