International Conference on Multimedia Modeling

MultiMedia Modeling pp 406-411 | Cite as

Multi-sketch Semantic Video Browser

  • David Kuboň
  • Adam Blažek
  • Jakub Lokoč
  • Tomáš Skopal
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9517)

Abstract

This paper presents a tool for interactive filtering and browsing of up to hundreds of hours of video content. In particular, we address the known-item search, i.e., searching for a short video clip known visually or by textual description. Video content is filtered with simple user-defined sketches of the searched scenes consisting of its distinct color regions and significant edges. Furthermore, the filtered content might be browsed with the query-by-example paradigm utilizing either visual or semantic similarity.

References

  1. 1.
    Barthel, K.U., Hezel, N., Mackowiak, R.: Graph-based browsing for large video collections. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015, Part II. LNCS, vol. 8936, pp. 237–242. Springer, Heidelberg (2015) Google Scholar
  2. 2.
    Blažek, A., Lokoč, J., Matzner, F., Skopal, T.: Enhanced signature-based video browser. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015, Part II. LNCS, vol. 8936, pp. 243–248. Springer, Heidelberg (2015) Google Scholar
  3. 3.
    Hürst, W., van de Werken, R., Hoet, M.: A storyboard-based interface for mobile video browsing. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015, Part II. LNCS, vol. 8936, pp. 261–265. Springer, Heidelberg (2015) Google Scholar
  4. 4.
    Jia, Y., Shelhamer, E., Donahue, J., et al.: Caffe: convolutional architecture for fast feature embedding. arXiv preprint arXiv:1408.5093 (2014)
  5. 5.
    Karayev, S., Hertzmann, A., Winnemoeller, H., et al.: Recognizing image style. CoRR, abs/1311.3715 (2013)
  6. 6.
    Kruliš, M., Lokoč, J., Skopal, T.: Efficient extraction of clustering-based feature signatures using gpu architectures. Multimedia Tools Appl. 74, 1–33 (2015)Google Scholar
  7. 7.
    Lokoč, J., Blažek, A., Skopal, T.: On effective known item video search using feature signatures. In: ICMR, p. 524 (2014)Google Scholar
  8. 8.
    Ngo, T.D., Nguyen, V.-T., Nguyen, V.H., Le, D.-D., Duong, D.A., Satoh, S.: NII-UIT browser: a multimodal video search system. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015, Part II. LNCS, vol. 8936, pp. 278–281. Springer, Heidelberg (2015) Google Scholar
  9. 9.
    Novak, D., Batko, M., Zezula, P.: Large-scale image retrieval using neural net descriptors. In: Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2015, pp. 1039–1040. ACM, New York (2015)Google Scholar
  10. 10.
    Park, D.K., Jeon, Y.S., Won, C.S.: Efficient use of local edge histogram descriptor. In: Proceedings of the 2000 ACM Workshops on Multimedia, MULTIMEDIA 2000, pp. 51–54. ACM, New York (2000)Google Scholar
  11. 11.
    Rossetto, L., Giangreco, I., Schuldt, H., Dupont, S., Seddati, O., Sezgin, M., Sahillioğlu, Y.: IMOTION — a content-based video retrieval engine. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015, Part II. LNCS, vol. 8936, pp. 255–260. Springer, Heidelberg (2015) Google Scholar
  12. 12.
    Schoeffmann, K., Boeszoermenyi, L.: Video browsing using interactive navigation summaries. In: Seventh International Workshop on Content-Based Multimedia Indexing. CBMI 2009, pp. 243–248, June 2009Google Scholar
  13. 13.
    Schoeffmann, K., Ahlström, D., Bailer, W., et al.: The video browser showdown: a live evaluation of interactive video search tools. Int. J. Multimedia Inf. Retrieval 3(2), 113–127 (2014)Google Scholar
  14. 14.
    Szegedy, C., Liu, W., Jia, Y., et al.: Going deeper with convolutions. CoRR, abs/1409.4842 (2014)
  15. 15.
    Zhang, Z., Albatal, R., Gurrin, C., Smeaton, A.F.: Interactive known-item search using semantic textual and colour modalities. In: He, X., Luo, S., Tao, D., Xu, C., Yang, J., Hasan, M.A. (eds.) MMM 2015, Part II. LNCS, vol. 8936, pp. 282–286. Springer, Heidelberg (2015) Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • David Kuboň
    • 1
  • Adam Blažek
    • 1
  • Jakub Lokoč
    • 1
  • Tomáš Skopal
    • 1
  1. 1.SIRET Research Group, Department of Software Engineering, Faculthy of Mathematics and PhysicsCharles University in PraguePragueCzech Republic

Personalised recommendations