Advertisement

diveXplore 4.0: The ITEC Deep Interactive Video Exploration System at VBS2020

  • Andreas LeibetsederEmail author
  • Bernd Münzer
  • Jürgen Primus
  • Sabrina Kletz
  • Klaus Schoeffmann
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11962)

Abstract

Having participated in the three most recent iterations of the annual Video Browser Showdown (VBS2017–VBS2019) as well as in both newly established Lifelog Search Challenges (LSC2018–LSC2019), the actively developed Deep Interactive Video Exploration (diveXplore) system combines a variety of content-based video analysis and processing strategies for interactively exploring large video archives. The system provides a user with browseable self-organizing feature maps, color filtering, semantic concept search utilizing deep neural networks as well as hand-drawn sketch search. The most recent version improves upon its predecessors by unifying deep concepts for facilitating and speeding up search, while significantly refactoring the user interface for increasing the overall system performance.

Keywords

Video retrieval Interactive video search Video analysis 

Notes

Acknowledgements

This work was funded by the FWF Austrian Science Fund under grant P 32010-N38.

References

  1. 1.
    Berns, F., Rossetto, L., Schoeffmann, K., Beecks, C., Awad, G.: V3C1 dataset: an evaluation of content characteristics. In: Proceedings of the 2019 on International Conference on Multimedia Retrieval, pp. 334–338. ACM (2019)Google Scholar
  2. 2.
    Gurrin, C., et al.: [Invited papers] Comparing approaches to interactive lifelog search at the lifelog search challenge (LSC2018). ITE Trans. Media Technol. Appl. 7(2), 46–59 (2019)CrossRefGoogle Scholar
  3. 3.
    Leibetseder, A., Kletz, S., Schoeffmann, K.: Sketch-based similarity search for collaborative feature maps. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10705, pp. 425–430. Springer, Cham (2018).  https://doi.org/10.1007/978-3-319-73600-6_45CrossRefGoogle Scholar
  4. 4.
    Leibetseder, A., et al.: lifeXplore at the lifelog search challenge 2019. In: Proceedings of the ACM Workshop on Lifelog Search Challenge, pp. 13–17. ACM (2019)Google Scholar
  5. 5.
    Lokoc, J., Bailer, W., Schoeffmann, K., Muenzer, B., Awad, G.: On influential trends in interactive video retrieval: video browser showdown 2015–2017. IEEE Trans. Multimed. 20, 3361–3376 (2018) CrossRefGoogle Scholar
  6. 6.
    Lokoč, J., et al.: Interactive search or sequential browsing? A detailed analysis of the video browser showdown 2018. ACM Trans. Multimed. Comput. Commun. Appl. 15(1), 29:1–29:18 (2019)CrossRefGoogle Scholar
  7. 7.
    Münzer, B., Leibetseder, A., Kletz, S., Primus, M.J., Schoeffmann, K.: lifeXplore at the lifelog search challenge 2018. In: Proceedings of the 2018 ACM Workshop on the Lifelog Search Challenge, LSC 2018, pp. 3–8, New York, NY, USA. ACM (2018)Google Scholar
  8. 8.
    Primus, M.J., Münzer, B., Leibetseder, A., Schoeffmann, K.: The ITEC collaborative video search system at the video browser showdown 2018. In: Schoeffmann, K., Chalidabhongse, T.H., Ngo, C.W., Aramvith, S., O’Connor, N.E., Ho, Y.-S., Gabbouj, M., Elgammal, A. (eds.) MMM 2018. LNCS, vol. 10705, pp. 438–443. Springer, Cham (2018).  https://doi.org/10.1007/978-3-319-73600-6_47CrossRefGoogle Scholar
  9. 9.
    Rossetto, L., Schuldt, H., Awad, G., Butt, A.A.: V3C - a research video collection. In: Kompatsiaris, I., Huet, B., Mezaris, V., Gurrin, C., Cheng, W.-H., Vrochidis, S. (eds.) MMM 2019. LNCS, vol. 11295, pp. 349–360. Springer, Cham (2019).  https://doi.org/10.1007/978-3-030-05710-7_29CrossRefGoogle Scholar
  10. 10.
    Schoeffmann, K.: A user-centric media retrieval competition: the video browser showdown 2012–2014. IEEE MultiMed. 21(4), 8–13 (2014)CrossRefGoogle Scholar
  11. 11.
    Schoeffmann, K., Münzer, B., Leibetseder, A., Primus, J., Kletz, S.: Autopiloting feature maps: the deep interactive video exploration (diveXplore) system at VBS2019. In: Kompatsiaris, I., Huet, B., Mezaris, V., Gurrin, C., Cheng, W.-H., Vrochidis, S. (eds.) MMM 2019. LNCS, vol. 11296, pp. 585–590. Springer, Cham (2019).  https://doi.org/10.1007/978-3-030-05716-9_50CrossRefGoogle Scholar
  12. 12.
    Schoeffmann, K., Münzer, B., Primus, M.J., Kletz, S., Leibetseder, A.: How experts search different than novices-an evaluation of the divexplore video retrieval system at video browser showdown 2018. In: 2018 IEEE International Conference on Multimedia & Expo Workshops (ICMEW). IEEE (2018)Google Scholar
  13. 13.
    Schoeffmann, K., et al.: Collaborative feature maps for interactive video search. In: Amsaleg, L., Guðmundsson, G., Gurrin, C., Jónsson, B., Satoh, S. (eds.) MMM 2017. LNCS, vol. 10133, pp. 457–462. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-51814-5_41CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Andreas Leibetseder
    • 1
    Email author
  • Bernd Münzer
    • 1
  • Jürgen Primus
    • 1
  • Sabrina Kletz
    • 1
  • Klaus Schoeffmann
    • 1
  1. 1.Klagenfurt University, Institute of Information Technology (ITEC)KlagenfurtAustria

Personalised recommendations