Skip to main content
SpringerLink
Log in

Detecting repeats for video structuring

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Television daily produces massive amounts of videos. Digital video is unfortunately an unstructured document in which it is very difficult to find any information. Television streams have however a strong and stable but hidden structure that we want to discover by detecting repeating objects in the video stream. This paper shows that television streams are actually highly redundant and that detecting repeats can be an effective way to detect the underlying structure of the video. A method for detecting these repetitions is presented here with an emphasis on the efficiency of the search in a large video corpus. Very good results are obtained both in terms of effectiveness (98% in recall and precision) as well as efficiency since one day of video is queried against a 3 weeks dataset in only 1 s.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Adjeroh DA, Lee MC, King I (1999) A distance measure for video sequences. Comput Vis Image Underst 75(1–2):25–45

    Article  Google Scholar 

  2. Barr J, Bradley B, Hannigan B (2003) Using digital watermarks with image signatures to mitigate the threat of the copy attack. In: ICASSP. IEEE, Piscataway

    Google Scholar 

  3. Conseil supérieur de l’audiovisuel C (2002) Publicité, parrainage et téléachat à la télévision et à la radio. http://www.csa.fr/

  4. Coskun B, Sankur B (2004) Robust video hash extraction. In: EUSIPCO: European conference on signal processing, Vienna

  5. Duygulu P, yu Chen M, Hauptmann A (2004) Comparison and combination of two novel commercial detection methods. ICME, ACM, New York

    Google Scholar 

  6. Freedman D, Diaconis P (1981) On the histogram as a density estimator: L2 theory. Z Wahrscheinlichkeitstheor Verw Geb 57:453–476

    Article  MathSciNet  MATH  Google Scholar 

  7. Harman D, Fox E, Baeza-Yates R, Lee W (1992) Data structures and algorithms: inverted files. Prentice Hall, Englewood Cliffs

    Google Scholar 

  8. Jain AK (1989) Fundamentals of digital image processing. Prentice hall information and system sciences series. Prentice Hall, Englewood Cliffs

    Google Scholar 

  9. Joly A (2005) Recherche par similarité statistique dans une grande base de signatures locales pour l’identification rapide d’extraits vidéos. PhD thesis, Université de la Rochelle

  10. Joly A, Buisson O, Frélicot C (2003) Robust content-based video copy identification in a large reference database. Lect Notes Comput Sci 2728:398–407

    Google Scholar 

  11. Kashino K, Kurozumi T, Murase H (2003) A quick search method for audio and video signals based on histogram pruning. IEEE Trans Multimedia 5:348–357

    Article  Google Scholar 

  12. Kim Y-T, Chua T-S (2005) Retrieval of news video using video sequence matching. In: International multimedia modelling conference. IEEE, Piscataway

    Google Scholar 

  13. Lee A (2007) Virtualdub.org. http://www.virtualdub.org/

  14. Lienhart R, Kuhmunch C, Effelsberg W (1997) On the detection and recognition of television commercials. In: International conference on multimedia computing and systems. IEEE, Piscataway, pp 509–516

    Chapter  Google Scholar 

  15. Marzal A, Vidal E (1993) Computation of normalized edit distance and applications. IEEE Trans Pattern Anal Mach Intell 15(9):926–932

    Article  Google Scholar 

  16. Naturel X, Gravier G, Gros P (2006) Fast structuring of large television streams using program guides. In: 4th international workshop on adaptive multimedia retrieval (AMR), Geneva, 27–28 July 2006

  17. Oostveen J, Kalker T, Haitsma J (2002) Feature extraction and a database strategy for video fingerprinting. In: VISUAL ’02 proceedings of the 5th international conference on recent advances in visual information systems. Springer, Berlin Heidelberg New York, pp 117–128

    Chapter  Google Scholar 

  18. Pua KM, Gauch JM, Gauch SE, Miadowicz JZ (2004) Real time repeated video sequence identification. Comput Vis Image Underst 93(3):310–327

    Article  Google Scholar 

  19. Sánchez JM, Binefa X, Vitrià J (2002) Shot partitioning based recognition of tv commercials. Multimedia Tools Appl 18(3):233–247

    Article  Google Scholar 

  20. Truong BT, Dorai C, Venkatesh S (2000) New enhancements to cut, fade, and dissolve detection processes in video segmentation. In: MULTIMEDIA’00, New York, pp 219–227

  21. Wang Z, Bovik A, Sheikh H, Simoncelli E (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13:600–612

    Article  Google Scholar 

  22. Yuan J, Duan L-Y, Tian Q, Xu C (2004) Fast and robust short video clip search using an index structure. In: MIR’04, pp 61–68

Download references

Author information

Authors and Affiliations

  1. Campus de Beaulieu, IRISA - INRIA Rennes, 35042, Rennes, France

    Xavier Naturel & Patrick Gros

Authors
  1. Xavier Naturel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Patrick Gros
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Xavier Naturel.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Naturel, X., Gros, P. Detecting repeats for video structuring. Multimed Tools Appl 38, 233–252 (2008). https://doi.org/10.1007/s11042-007-0180-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-007-0180-1

Keywords

Search

Navigation