Using Self-similarity Matrices for Structure Mining on News Video

  • Arne Jacobs
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3955)


Video broadcast series like news or magazine broadcasts usually expose a strong temporal structure, along with a characteristic audio-visual appearance. This results in frequent patterns occurring in the video signal. We propose an algorithm for the automatic detection of such patterns that exploits the video’s self-similarity induced by the patterns. The approach is applied to the problem of anchor shot detection, but can also be used for other related purposes. Tests on real-world video data show that it is possible with our method to detect anchor shots fully automatically with high reliability.


Similarity Matrix Presentation Type News Video Story Boundary Anchor Shot 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Swanberg, D., Shu, C.F., Jain, R.: Knowledge guided parsing in video databases. In: Proceedings of the IS-T/SPIE Conference on Storage and Retrieval for Image and Video Databases, San Jose, CA, USA, vol. 1908, pp. 13–24 (1993)Google Scholar
  2. 2.
    Hauptmann, A., Baron, R., Chen, M.Y., Christel, M., Duygulu, P., Huang, C., Jin, R., Lin, W.-H., Ng, T., Moraveji, N., Papernick, N., Snoek, C., Tzanetakis, G., Yang, J., Yang, R., Wactlar, H.: Informedia at TRECVID 2003: Analyzing and searching broadcast news video. In: Proceedings of the 12th Text Retrieval Conference (TREC) (2003)Google Scholar
  3. 3.
    Wang, W., Gao, W.: A fast anchor shot detection algorithm on compressed video. In: IEEE Pacific Rim Conference on Multimedia, pp. 873–878 (2001)Google Scholar
  4. 4.
    Kobla, V., Doermann, D.S., Faloutsos, C.: Videotrails: Representing and visualizing structure in video sequences. In: ACM Multimedia, pp. 335–346 (1997)Google Scholar
  5. 5.
    Huang, J., Zabih, R.: Combining color and spatial information for content-based image retrieval. In: Proceedings of ECDL 1998 (1998)Google Scholar
  6. 6.
    Lienhart, R., Maydt, J.: An extended set of haar-like features for rapid object detection. In: Proceedings of ICIP 2002, vol. 1, pp. 900–903 (2002)Google Scholar
  7. 7.
    Miene, A., Herzog, O.: AVAnTA - Automatische Video Analyse und textuelle Annotation. it + ti Informationstechnik und Technische Informatik 42, 24–27 (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Arne Jacobs
    • 1
  1. 1.Center for Computing TechnologiesUniversity of BremenGermany

Personalised recommendations