Fast Segmentation of H.264/AVC Bitstreams for On-Demand Video Summarization

  • Klaus Schöffmann
  • Laszlo Böszörmenyi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4903)


Video summarization methods need fast segmentation of a video into smaller units as a first step, especially if used in an on-demand fashion. We propose an efficient segmentation algorithm for H.264/AVC bitstreams that is able to segment a video in appr. 10% of the time required to decode the video. This is possible because our approach uses features available after entropy-decoding (which is the very first stage of the decoding process) only. More precisely, we use a combination of two features, especially appropriate to H.264/AVC, with different characteristics in order to decide if a new segment starts or not: (1) L1-Distance based partition histograms and (2) ratio of intra-coded macroblocks on a per-frame basis. Our results show that this approach performs well and works for several different encoders used in practice today.


video segmentation video analysis shot detection shot boundary detection cut detection H.264 AVC compressed domain 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Dimou, A., Nemethova, O., Rupp, M.: Scene Change Detection for H.264 using Dynamic Threshold Techniques. In: Proceedings of 5th EURASIP Conference on Speech and Image Processing, Multimedia Communications and Service (July 2005)Google Scholar
  2. 2.
    Inc., A.: Quicktime 7 pro, Online (last accessed on: 04/01/07) (2007),
  3. 3.
    ISO/IEC JTC 1/SC 29/WG 11. ISO/IEC FDIS 14496-10: Information Technology - Coding of audio-visual objects - Part 10: Advanced Video Coding (March 2003)Google Scholar
  4. 4.
    Aimar, L., Merritt, L., Petit, E., Chen, M., Clay, J., Rullgard, M., Czyz, R., Heine, C., Izvorski, A., Wright, A.: x264 - a free h264/avc encoder. Online (last accessed on: 04/01/07),
  5. 5.
    Liu, Y., Wang, W., Gao, W., Zeng, W.: A Novel Compressed Domain Shot Segmentation Algorithm on H.264/AVC. In: ICIP 2004. 2004 International Conference on Image Processing, vol. 4, pp. 2235–2238 (October 2004)Google Scholar
  6. 6.
    Nero Inc., G.: Nero recode 7, Online (last accessed on: 04/01/07) (2007),
  7. 7.
    Neuveglise, J.: PocketMovies.netGoogle Scholar
  8. 8.
    N.N.I. of Standards and Technology. Trec video retrieval evaluation. Online (last accessed on: 04/01/07)
  9. 9.
    Richardson, I.: H.264 and MPEG-4 Video Compression: Video Coding for Next Generation Multimedia. John Wiley & Sons Ltd. The Atrium. Southern Gate, Chichester, West Sussex PO19 8SQ, England (2003)Google Scholar
  10. 10.
    Early Stage Shot Detection for H.264/AVC Bitstreams. Technical Report TR/ITEC/07/2.04, Department of Information Technology, University of Klagenfurt, Austria, Jul, Online (2007),
  11. 11.
    Wiegand, T., Sullvian, G.J., Bjontegaard, G., Luthra, A.: Overview of the H.264/AVC Video Coding Standard. In: IEEE Transactions on Circuits and Systems for Video Technology (July 2003)Google Scholar
  12. 12.
    Zeng, W., Gao, W.: Shot change detection on H.264/AVC compressed video. In: ISCAS 2005. IEEE International Symposium on Circuits and Systems, vol. 4, pp. 3459–3462 (May 2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Klaus Schöffmann
    • 1
  • Laszlo Böszörmenyi
    • 1
  1. 1.Department of Information Technology (ITEC), University of Klagenfurt, Universitätsstr. 65-67, 9020 KlagenfurtAustria

Personalised recommendations