Compressed-Domain Shot Boundary Detection for H.264/AVC Using Intra Partitioning Maps

  • Sarah De Bruyne
  • Jan De Cock
  • Chris Poppe
  • Charles-Frederik Hollemeersch
  • Peter Lambert
  • Rik Van de Walle
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6523)

Abstract

In this paper, a novel technique for shot boundary detection operating on H.264/AVC-compressed sequences is presented. Due to new and improved coding tools in H.264/AVC, the characteristics of the obtained sequences differ from former video coding standards. Although several algorithms working on this new standard are already proposed, the presence of IDR frames can still lead to a low accuracy for abrupt transitions. To solve this issue, we present the motion-compensated intra partitioning map which relies on the intra partitioning modes and the motion vectors present in the compressed video stream. Experimental results show that this motion-compensated map achieves a high accuracy and exceeds related work.

Keywords

Shot boundary detection video analysis compressed domain H.264/AVC 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Arman, F., Depommier, R., Hsu, A., Chiu, M.Y.: Content-based browsing of video sequences. In: Proceedings of ACM Multimedia, pp. 97–103 (1994)Google Scholar
  2. 2.
    Bescós, J.: Real-time shot change detection over online MPEG-2 video. IEEE Transactions on Circuits and Systems for Video Technology 14(4), 475–484 (2004)CrossRefGoogle Scholar
  3. 3.
    De Bruyne, S., Van Deursen, D., De Cock, J., De Neve, W., Lambert, P., Van de Walle, R.: A compressed-domain approach for shot boundary detection on H.264/AVC bit streams. Signal Processing: Image Communication - Semantic Analysis for Interactive Multimedia Services 23(7), 473–498 (2008)Google Scholar
  4. 4.
    Fernando, W.A.C.: Sudden scene change detection in compressed video using interpolated macroblocks in B-frames. Multimedia Tools and Applications 28(3), 301–320 (2006)CrossRefGoogle Scholar
  5. 5.
    Hanjalic, A.: Towards theoretical performance limits of video parsing. IEEE Transactions on Circuits and Systems for Video Technology 17(3), 261–272 (2007)CrossRefGoogle Scholar
  6. 6.
    ISO/IEC: Description of MPEG-7 content set. ISO/IEC JTC1/SC29/WGll/N2467 (October 1998)Google Scholar
  7. 7.
    Jacobs, A., Miene, A., Ioannidis, G.T., Herzog, O.: Automatic shot boundary detection combining color, edge, and motion features of adjacent frames. In: TRECVID 2004 Workshop Notebook Papers, pp. 197–206 (2004)Google Scholar
  8. 8.
    Kim, S.-M., Byun, J.W., Won, C.S.: A scene change detection in H.264/AVC compression domain. In: Ho, Y.-S., Kim, H.-J. (eds.) PCM 2005. LNCS, vol. 3768, pp. 1072–1082. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  9. 9.
    Kuo, T.Y., Lo, Y.C.: Detection of H.264 shot change using intra predicted direction. In: Proceedings of the International Conference on Intelligent Information Hiding and Multimedia Signal Processing, pp. 204–207 (2008)Google Scholar
  10. 10.
    Liu, Y., Wang, W., Gao, W., Zeng, W.: A novel compressed domain shot segmentation algorithm on H.264/AVC. In: Proceedings of the IEEE International Conference on Image Processing, vol. 4, pp. 2235–2238 (2004)Google Scholar
  11. 11.
    Pei, S.C., Chou, Y.Z.: Efficient MPEG compressed video analysis using macroblock type information. IEEE Transactions on Multimedia 1(4), 321–333 (1999)CrossRefGoogle Scholar
  12. 12.
    Wiegand, T., Sullivan, G.J., Bjøntegaard, G., Luthra, A.: Overview of the H.264/AVC video coding standard. IEEE Transactions on Circuits and Systems for Video Technology 13(7), 560–576 (2003)CrossRefGoogle Scholar
  13. 13.
    Yeo, B.L., Liu, B.: Rapid scene analysis on compressed video. IEEE Transactions on Circuits and Systems for Video Technology 5(6), 533–544 (1995)CrossRefGoogle Scholar
  14. 14.
    Zeng, W., Gao, W.: Shot change detection on H.264/AVC compressed video. In: Proceedings of the IEEE International Symposium on Circuits and Systems, vol. 4, pp. 3459–3462 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Sarah De Bruyne
    • 1
  • Jan De Cock
    • 1
  • Chris Poppe
    • 1
  • Charles-Frederik Hollemeersch
    • 1
  • Peter Lambert
    • 1
  • Rik Van de Walle
    • 1
  1. 1.Department of Electronics and Information Systems - Multimedia LabGhent University - IBBTLedeberg-GhentBelgium

Personalised recommendations