Advertisement

Autopiloting Feature Maps: The Deep Interactive Video Exploration (diveXplore) System at VBS2019

  • Klaus SchoeffmannEmail author
  • Bernd Münzer
  • Andreas Leibetseder
  • Jürgen Primus
  • Sabrina Kletz
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11296)

Abstract

We present the most recent version of our Deep Interactive Video Exploration (diveXplore) system, which has been successfully used for the latest two Video Browser Showdown competitions (VBS2017 and VBS2018) as well as for the first Lifelog Search Challenge (LSC2018). diveXplore is based on a plethora of video content analysis and processing methods, such as simple color, texture, and motion analysis, self-organizing feature maps, and semantic concept extraction with different deep convolutional neural networks. The biggest strength of the system, however, is that it provides a variety of video search and rich interaction features. One of the novelties in the most recent version is a Feature Map Autopilot, which ensures time-efficient inspection of feature maps without gaps and unnecessary visits.

Keywords

Video retrieval Interactive video search Video analysis 

References

  1. 1.
    Dang-Nguyen, D.-T., Schoeffmann, K., Hurst, W.: LSE 2018 panel - challenges of lifelog search and access. In: Proceedings of the 2018 ACM Workshop on the Lifelog Search Challenge, LSC 2018, pp. 1–2. ACM, New York (2018)Google Scholar
  2. 2.
    Leibetseder, A., Kletz, S., Schoeffmann, K.: Sketch-based similarity search for collaborative feature maps. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10705, pp. 425–430. Springer, Cham (2018).  https://doi.org/10.1007/978-3-319-73600-6_45CrossRefGoogle Scholar
  3. 3.
    Lokoc, J., Bailer, W., Schoeffmann, K., Muenzer, B., Awad, G.: On influential trends in interactive video retrieval: video browser showdown 2015–2017. IEEE Trans. Multimedia 20(12), 3361–3376 (2018). https://ieeexplore.ieee.org/abstract/document/8352047CrossRefGoogle Scholar
  4. 4.
    Münzer, B., Leibetseder, A., Kletz, S., Primus, M.J., Schoeffmann, K.: lifeXplore at the lifelong search challenge 2018. In: Proceedings of the 2018 ACM Workshop on the Lifelong Search Challenge, LSC 2018, pp. 3–8. ACM, New York (2018)Google Scholar
  5. 5.
    Primus, M.J., Münzer, B., Leibetseder, A., Schoeffmann, K.: The ITEC collaborative video search system at the video browser showdown 2018. In: Schoeffmann, K., et al. (eds.) MMM 2018. LNCS, vol. 10705, pp. 438–443. Springer, Cham (2018).  https://doi.org/10.1007/978-3-319-73600-6_47CrossRefGoogle Scholar
  6. 6.
    Schoeffmann, K., et al.: Collaborative feature maps for interactive video search. In: Amsaleg, L., Guðmundsson, G.Þ., Gurrin, C., Jónsson, B.Þ., Satoh, S. (eds.) MMM 2017. LNCS, vol. 10133, pp. 457–462. Springer, Cham (2017).  https://doi.org/10.1007/978-3-319-51814-5_41CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Klaus Schoeffmann
    • 1
    Email author
  • Bernd Münzer
    • 1
  • Andreas Leibetseder
    • 1
  • Jürgen Primus
    • 1
  • Sabrina Kletz
    • 1
  1. 1.Institute of Information TechnologyKlagenfurt UniversityKlagenfurtAustria

Personalised recommendations