Cinematography sequences tracking by means of fingerprinting techniques

Article

Abstract

Video fingerprints are short features extracted from a video sequence in order to uniquely identify its visual content and its replicas. By advancing a new robust fingerprinting method, the present paper takes the challenge of designing an enabler for the use of Internet as a distribution tool in cinematography. In this respect, a 2D-DWT-based robust video fingerprinting method is designed so as to address two use cases, namely the retrieval of video content from a database and the tracking of in-theater camcorder recorded video content. A set of largest absolute value wavelet coefficients is considered as the fingerprint and a repeated statistical test is used as the matching procedure. The video dataset consists of two corpora, one for each use case. The first corpus regroups 3 h of heterogeneous original content (organized under the framework of the HD3D-IIO French national project) and of its attacked versions (a total of 21 h of video content). The second corpus consists of 3 h of heterogeneous content (i.e., HD3D-IIO corpus) and of 1 h of live camcorder recorded video content (a total of 4 h of video content). The inner 2D-DWT properties with respect to content-preserving attacks (such as linear filtering, sharpening, geometric, conversion to grayscale, small rotations, contrast changes, brightness changes, and live camcorder recording) ensure the following results: in the first use case, the probability of false alarm and missed detection are lower than 0.0005, precision and recall are higher than 0.97; in the second use case, the probability of false alarm is 0.00009, the probability of missed detection is lower than 0.0036, precision and recall are equal to 0.72.

Keywords

Robust video fingerprinting DWT Robustness Uniqueness Live camcorder recording 

References

  1. 1.
    Oostveen J, Kalker T, Haitsma J (2002) Feature extraction and a database strategy for video fingerprinting, Lecture Notes In Computer Science, vol. 2314 archive, Proceedings of the 5th International Conference on Recent Advances in Visual Information Systems, pp 117–128Google Scholar
  2. 2.
    Mitrea M, Dumitru O, Prêteux F, Vlad A (2007) Zero-memory information sources approximating to video watermarking attacks. Proceedings of the International Conference on Computational Science and Its Applications, Kuala Lumpur, Malaysia—Lecture Notes in Computer Science 4707, vol. 3, pp 445–459Google Scholar
  3. 3.
    Gao W, Huang T, Tian Y, Wang Y, Li Y, Mou L, Su C, Jiang M, Fang X, Qian M (2010) PKU-IDM@TRECVID-CCD 2010: copy detection with visual-audio feature fusion and sequential pyramid matching. Proceedings of TRECVID Google Scholar
  4. 4.
    Wong WK, Yuen CWM, Fan DD, Chan LK, Fung EHK (2009) Stitching defect detection and classification using wavelet transform and BP neural network. J Expert Syst Appl Int J 36(2):3845–3856CrossRefGoogle Scholar
  5. 5.
    Dumitru O, Mitrea M, Prêteux F (2008) Video modelling in the DWT domain. Proceedings SPIE, vol. 7000, Strasbourg, pp 7000 OP: 1–12Google Scholar
  6. 6.
    Walpole RE, Myers RH, Myers S-L, Ye K (2002) Probability and statistics for engineers and scientists. Pearson Educational InternationalGoogle Scholar
  7. 7.
    Buccigrossi R, Simoncelli E (1999) Image compression via joint statistical characterization in the wavelet domain. IEEE Trans Image Process 8(12):1688–1700CrossRefGoogle Scholar
  8. 8.
    Chupeau B, Massoudi A, Lefèbvre F (2008) In-theater piracy: finding where the pirate was. SPIE’08, Security, Forensics, Steganography, and Watermarking of Multimedia Contents XGoogle Scholar
  9. 9.
    Coskun B, Sankur B, Memon N (2006) Spatio-temporal transform based video hashing. IEEE Trans Multimedia 8(6)Google Scholar
  10. 10.
    Yeh M-C, Hsu C-Y, Lu C-S (2010) NTNU-Academia Sinica at TRECVID 2010 content based copy detection. In: Proceedings of TRECVIDGoogle Scholar
  11. 11.
    Barrios JM, Bustos B (2010) Content-based video copy detection: PRISMA at TRECVID 2010. In: Proceedings of TRECVIDGoogle Scholar
  12. 12.
    Su X, Huang T, Gao W (2009) Robust video fingerprinting based on visual attention regions. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing. pp. 1525–1528Google Scholar
  13. 13.
    Hampapur A, Hyun K-H, Bolle R (2002) Comparison of sequence matching techniques for video copy detection. In: Proceedings of Storage and Retrieval for Media Databases (San Jose, USA, Jan. 20–25), pp. 194–201Google Scholar
  14. 14.
    Kim J, Nam J (2009) Content-based video copy detection using spatio-temporal compact feature. Proceedings of the 11th international conference on Advanced Communication Technology (ICACT), vol. 3Google Scholar
  15. 15.
    Hu MK (1962) Visual pattern recognition by moment invariants. Trans Inf Theory IT-8:179–187Google Scholar
  16. 16.
    Lee S, Yoo CD (2008) Robust video fingerprinting for content-based video identification. IEEE Trans Circ Syst Video Technol 18(7)Google Scholar
  17. 17.
    Hampapur A, Bolle RM (2001) Comparison of distance measures for video copy detection. IBM TJ Watson Research Center, IEEE International Conference on Multimedia and Expo, pp 737–740Google Scholar
  18. 18.
    Law-To J, Buisson O, Gouet-Brunet, Boujemaa N (2006) Robust voting algorithm based on labels of behavior for video copy detection. 14th ACM International Conference on Multimedia, Santa Barbara, USA, pp 835–844Google Scholar
  19. 19.
    Law-To J, Buisson O, Gouet-Brunet, Boujemaa N (2007) Video copy detection on the internet: The challenges of copyright and multiplicity. IEEE International Conference on Multimedia & Expo, Beijing pp 2082–2085Google Scholar
  20. 20.
    Joly A, Frélicot C, Buisson O (2005) Content-based video copy detection in large databases: a local fingerprints statistical similarity search approach. In: Proceedings of the International Conference on Image ProcessingGoogle Scholar
  21. 21.
    Sarkar A, Ghosh P, Moxley E, Manjunath BS (2008) Video fingerprinting: features for duplicate and similar video detection and query-based video retrieval. Proceedings of SPIE—Multimedia Content Access: Algorithms and Systems IIGoogle Scholar
  22. 22.
    Massoudi A, Lefebvre F, Demarty CH, Oisel L, Chupeau B (2006) A video fingerprint based on visual digest and local fingerprints, 2006 IEEE International Conference on Image Processing, Issue 8–11, pp 2297–2300Google Scholar
  23. 23.
    Chen L, Stentiford FWM (2008) Video sequence matching based on temporal ordinal measurement. Pattern Recognit Lett 29(13):1824–1831CrossRefGoogle Scholar
  24. 24.
    Hua X-S, Chen X, Zhang H-J (2004) Robust video signature based on ordinal measure. In: Proceedings of the IEEE International Conference on Image Processing (ICIP), 2004, vol. 1, 24–27, 2004, pp 685–688Google Scholar
  25. 25.
    Kim C, Vasudev B (2005) Spatio-temporal sequence matching for efficient video copy detection. In: Proceedings of the IEEE Transactions on Circuit Systems Video Technology, 15(1):127–132Google Scholar
  26. 26.
    Yuan J, Duan LY, Tian Q, Ranganath S, Xu C (2004) Fast and robust short video clip search for copy detection. In: Springer: Lecture Notes in Computer Science—3332, pp 479–488Google Scholar
  27. 27.
    Indyk P, Iyengar G, Shivakumar N (1999) Finding pirated video sequences on the internet. Stanford InfolabGoogle Scholar
  28. 28.
    Radhakrishnan R, Bauer C (2008) Robust video fingerprints based on subspace embedding. IEEE International Conference on Acoustics, Speech, and Signal Processing, Las Vegas, pp 2245–2248Google Scholar
  29. 29.
    Roover CD, Vleeschouwer CD, Lefebvre F, Macq B (2005) Robust video hashing based on radial projections of key frames. IEEE Trans Signal Process 53(10):4020–4030MathSciNetCrossRefGoogle Scholar
  30. 30.
    Garboan A, Mitrea M, Prêteux F (2011) DWT-based robust video fingerprinting. Proceedings for the 3rd European Workshop on Visual Information Processing (EUVIP), Paris, pp 216–221Google Scholar
  31. 31.
    Garboan A, Mitrea M, Prêteux F (2011) Video retrieval by means of robust fingerprinting. Proceedings for the 15th IEEE Symposium on Consumer Electronics (ISCE), Singapore, pp 299–303Google Scholar
  32. 32.
    Dutta D, Saha SK, Chanda B (2010) A hypothesis test based robust technique for video sequence matching. Int J Futur Gener Commun Netw 3(3)Google Scholar
  33. 33.
    Naphade MR, Yeung MM, Yeo BL (2000) Novel scheme for fast and efficent video sequence matching using compact signatures. In: Proc. SPIE, Storage and Retrieval for Media Databases 2000, vol. 3972, pp 564–572Google Scholar
  34. 34.
    Gauch JM Real-time feature-based video stream validation and distortion analysis system using color moments. United States Patent 6246803Google Scholar
  35. 35.
    Sánchez JM, Binefa X, Vitrià J, Radeva P (1999) Local color analysis for scene break detection applied to TV commercials recognition. Proceedings of the Third International Conference on Visual Information and Information, pp 237–244Google Scholar
  36. 36.
    Hill M, Hua G, Natsev A, Smith JR, Xie L, Huang B, Merler M, Ouyang H, Zhou M (2010) IBM research TRECVID-2010 video copy detection and multimedia event detection system. Proceedings of TRECVIDGoogle Scholar
  37. 37.
    Jégou H, Gros P, Douze M, Schmid C, Gravier G (2010) INRIA LEAR-TEXMEX: video copy detection task. Proceedings of TRECVIDGoogle Scholar
  38. 38.
    Mukai R, Kurozumi T, Kawanishi T, Nagano H, Kashino H (2011) NTT communication science laboratories at TRECVID 2011 content based copy detection. Proceedings of TRECVIDGoogle Scholar
  39. 39.
    Foucher S, Lalonde M, Gupta V, Darvish P, Gagnon L, Boulianne G (2011) CRIM at TRECVID 2011 content-based copy detection using nearest-neighbor mapping. Proceedings of TRECVIDGoogle Scholar
  40. 40.
    Jiang M, Shu F, Tian Y, Huang T (2011) Cascade of multimodal features and temporal pyramid matching. Proceedings of TRECVIDGoogle Scholar
  41. 41.
    Bhat DN, Nayar SK (1996) Ordinal measures for visual correspondence. In: Proceedings of the Conference on Computer Vision and Pattern RecognitionGoogle Scholar

Copyright information

© Institut Mines-Télécom and Springer-Verlag France 2012

Authors and Affiliations

  1. 1.Institut Mines-Télécom; Télécom SudParisEvryFrance
  2. 2.Institut Mines-Télécom; MINES ParisTechPARIS cedex 06France
  3. 3.UMR CNRS 8145 MAP5Paris Cedex 06France

Personalised recommendations