Multimedia Tools and Applications

, Volume 71, Issue 3, pp 1749–1770 | Cite as

To accelerate shot boundary detection by reducing detection region and scope

Article

Abstract

Video Shot Boundary Detection (SBD) is the fundamental process towards video summarization and retrieval. A fast and efficient SBD algorithm is necessary for real-time video processing applications. Extensive work has focused on accurate shot boundary detection at the expense of demanding computational costs. In this paper, we propose a fast SBD approach that reduces the computation pixel-wise and frame-wise while still giving satisfactory accuracy. The proposed approach substantially speeds up the computation through reducing both detection region and scope. Color histogram and mutual information are used together to measure the difference between frames. Corner distribution of frames is utilized to exclude most of false boundaries. We conduct extensive experiments to evaluate the proposed approach, and the results show that our approach can not only speed up SBD, but also detect shot boundaries with high accuracy in both Cut (CUT) and Gradual Transition (GT) boundaries.

Keywords

Shot boundary detection Skipping interval Mutual information Camera motion Corner distribution 

Notes

Acknowledgements

The work reported in this paper is supported by the National Science Foundation for Distinguished Young Scholars of China under Grant No.60925010, the Foundation for Innovative Research Groups of the National Natural Science Foundation of China under Grant No. 61121001, the Program for Changjiang Scholars and Innovative Research Team in University under Grant No. IRT1049, the Co-sponsored Project of Beijing Committee of Education.

References

  1. 1.
    Adjeroh D, Lee MC, Banda N, Kandaswamy1 U (2009) Adaptive edge-oriented shot boundary detection. EURASIP J Image Video Process (USA) 2009:1–14CrossRefGoogle Scholar
  2. 2.
    Cabedo XU, Bhattacharjee SK (1998) Shot detection tools in digital video. In: Proceedings of non-liner model based image analysis. Springer, Glasgow, pp 121–126Google Scholar
  3. 3.
    Chiu S-T, Lin G-S, Chang M-K (2008) An effective shot boundary detection algorithm for movies and sports. In: Proceedings of the 2008 3rd international conference on innovative computer information and control. Dalian, China, pp 173–176CrossRefGoogle Scholar
  4. 4.
    Cotsaces C, Gavrielides MA, Pitas I (2005) A survey of recent work in video shot boundary detections. In: Proceedings of 2005 workshop on audio-visual content and information visualization in digital libraries (AVIVDiLib ’05), 4–6 June 2005Google Scholar
  5. 5.
    Cover TM, Thomas JA (1991) Elements of information theory. Wiley, New YorkCrossRefMATHGoogle Scholar
  6. 6.
    Danisman T, Alpkocak A (2006) Dokuz Eyl’́ul University video shot boundary detection at trecvid 2006. In: Proceedings of the TREC video retrieval evaluation (TRECVID)Google Scholar
  7. 7.
    Danisman T, Alpkocak A (2007) Bupt at trecvid 2007: shot boundary detection. In: Proceedings of the 2007 TREC video retrieval evaluation (TRECVID)Google Scholar
  8. 8.
    Derpanis KG (2004) The harris corner detector, New YorkGoogle Scholar
  9. 9.
    Han SH, Yoon KJ, Kweon IS (2000) A new technique for shot detection and key frames selection in histogram space. In: 12th workshop on image proceeding and image understanding, 2000Google Scholar
  10. 10.
    Hanjalic, A (2002) Shot-boundary detection: unraveled and resolved? IEEE Trans Circuits Syst Video Technol 12(2):90–105CrossRefGoogle Scholar
  11. 11.
    Henga WJ, Ngan KN (2001) An object-based shot boundary detection using edge tracing and tracking. Vis Commun Image Represent 12(3):217–239CrossRefGoogle Scholar
  12. 12.
    Hu W, Xie N, Li L, Zeng X, Maybank S (2011) A survey on visual content-based video indexing and retrieval. IEEE Trans Syst Man Cybern, Part C Appl Rev 41(6):797–819CrossRefGoogle Scholar
  13. 13.
    Huang C-L, Liao B-Y (2001) A robust scene-change detection method for video segmentation. IEEE Trans Circuits Syst Video Technol 11(12):1281–1288CrossRefGoogle Scholar
  14. 14.
    Huang C-R, Lee H-P, Chen C-S (2008) Shot change detection via local keypoint matching. IEEE Trans Multimedia 10(6):1097–1108CrossRefGoogle Scholar
  15. 15.
    Huang X, Ma H, Yuan H (2008) A hidden markov model approach to parsing mtv video shot. In: Proceedings of the 2008 congress on image and signal processing, vol 2, pp 276–280Google Scholar
  16. 16.
    Lefévre S, Holler J, Vincent N (2003) A review of real-time segmentation of uncompressed video sequences for content-based search and retrieval. Real-Time Imaging 9(1):73–98CrossRefGoogle Scholar
  17. 17.
    Li Y, Lu Z, Niu X (2009) Fast video shot boundary detection framework employing pre-processing techniques. Image Process, IET 3(3):121–134CrossRefMATHGoogle Scholar
  18. 18.
    Lienhart RW (2001) Reliable dissolve detection. Storage Retr Media Databases. In: Proceedings of the SPIE Conference on storage and retrieval for media databases, vol 4315, pp 219–230Google Scholar
  19. 19.
    Ling X, Yuanxin O, Huan L, Zhang X (2008) A method for fast shot boundary detection based on svm. In: Proceedings of the 2008 congress on image and signal processing, vol 2. Sanya, China, pp 445–449Google Scholar
  20. 20.
    Mas J, Fernandez G (2003) Video shot boundary detection based on color histogram. In: Proceedings of the TREC video retrieval evaluation conference (TRECVID2003)Google Scholar
  21. 21.
    Pei S-C, Chou Y-Z (1999) Efficient mpeg compressed video analysis using macroblock type information. IEEE Trans Multimedia 1(4):321–333CrossRefGoogle Scholar
  22. 22.
    Pei SC, Chou Y-Z (2002) Effective wipe detection in mpeg compressed video using macro block type information. IEEE Trans Multimedia 4(3):309–319CrossRefGoogle Scholar
  23. 23.
    Qin T, Gu J, Chen H, Tang Z (2010) A fast shot-boundary detection based on k-step slipped window. In: Proceedings of 2010 IEEE international conference on network infrastructure and digital content, pp 190–195Google Scholar
  24. 24.
    Ren W, Sharma M, Singh S (2001) Automated video segmentation. In: International conference on information, communication, and signal processing, SingaporeGoogle Scholar
  25. 25.
    Su C-W, Liao H-Y, Tyan H-R, Fan K-C, Chen L (2005) A motion-tolerant dissolve detection algorithm. IEEE Trans Multimedia 7(6):1106–1113CrossRefGoogle Scholar
  26. 26.
    Tapu R, Zaharia T (2011) A complete framework for temporal video segmentation. In: Proceedings of 2011 IEEE international conference on consumer electronics. Berlin, pp 156–160Google Scholar
  27. 27.
    Wolf MWW, Liu B (1998) An algorithm for wipe detection. In: Proceedings of international conference on image processing, vol 1, pp 893–897Google Scholar
  28. 28.
    Xia D, Deng X, Zeng Q (2007) Shot boundary detection based on difference sequences of mutual information. In: Proceedings of the fourth international conference on image and graphics. Chengdu, China, pp 389–394CrossRefGoogle Scholar
  29. 29.
    Xiong W, Lee JC-M (1998) Efficient scene change detection and camera motion annotation for video classification. Comput Vis Image Underst 71(2):166–181CrossRefGoogle Scholar
  30. 30.
    Yeo B-L, Liu B (1995) Rapid scene analysis on compressed video. IEEE Trans Circuits Syst Video Technol 5(6):533–544CrossRefGoogle Scholar
  31. 31.
    Yuan J, Li J, Lin F, Zhang B (2005) A unified shot boundary detection framework based on graph partition model. In: Proceedings of the 13th annual ACM international conference on multimedia. Hilton, Singapore, pp 539–542Google Scholar
  32. 32.
    Zhu S, Liu Y (2009) Automatic scene detection for advanced story retrieval. Expert Syst Appl 36(3, Part 2):5976–5986CrossRefGoogle Scholar
  33. 33.
    Zuzana C, Ioannis P, Nikou C (2006) Information theory-based shot cut or fade detection and video summarization. IEEE Trans Circuits Syst Video Technol 16(1):82–91CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2012

Authors and Affiliations

  1. 1.Beijing Key Laboratory of Intelligent Telecommunications Software and MultimediaBeijing University of Posts and TelecommunicationsBeijingChina

Personalised recommendations