Abstract
Video summarization methods need fast segmentation of a video into smaller units as a first step, especially if used in an on-demand fashion. We propose an efficient segmentation algorithm for H.264/AVC bitstreams that is able to segment a video in appr. 10% of the time required to decode the video. This is possible because our approach uses features available after entropy-decoding (which is the very first stage of the decoding process) only. More precisely, we use a combination of two features, especially appropriate to H.264/AVC, with different characteristics in order to decide if a new segment starts or not: (1) L1-Distance based partition histograms and (2) ratio of intra-coded macroblocks on a per-frame basis. Our results show that this approach performs well and works for several different encoders used in practice today.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Dimou, A., Nemethova, O., Rupp, M.: Scene Change Detection for H.264 using Dynamic Threshold Techniques. In: Proceedings of 5th EURASIP Conference on Speech and Image Processing, Multimedia Communications and Service (July 2005)
Inc., A.: Quicktime 7 pro, Online (last accessed on: 04/01/07) (2007), http://www.apple.com/quicktime/pro/
ISO/IEC JTC 1/SC 29/WG 11. ISO/IEC FDIS 14496-10: Information Technology - Coding of audio-visual objects - Part 10: Advanced Video Coding (March 2003)
Aimar, L., Merritt, L., Petit, E., Chen, M., Clay, J., Rullgard, M., Czyz, R., Heine, C., Izvorski, A., Wright, A.: x264 - a free h264/avc encoder. Online (last accessed on: 04/01/07), http://www.videolan.org/developers/x264.html
Liu, Y., Wang, W., Gao, W., Zeng, W.: A Novel Compressed Domain Shot Segmentation Algorithm on H.264/AVC. In: ICIP 2004. 2004 International Conference on Image Processing, vol. 4, pp. 2235–2238 (October 2004)
Nero Inc., G.: Nero recode 7, Online (last accessed on: 04/01/07) (2007), http://www.nero.com/eng/index.html
Neuveglise, J.: PocketMovies.net
N.N.I. of Standards and Technology. Trec video retrieval evaluation. Online (last accessed on: 04/01/07) http://www-nlpir.nist.gov/projects/trecvid/
Richardson, I.: H.264 and MPEG-4 Video Compression: Video Coding for Next Generation Multimedia. John Wiley & Sons Ltd. The Atrium. Southern Gate, Chichester, West Sussex PO19 8SQ, England (2003)
Early Stage Shot Detection for H.264/AVC Bitstreams. Technical Report TR/ITEC/07/2.04, Department of Information Technology, University of Klagenfurt, Austria, Jul, Online (2007), http://www-itec.uni-klu.ac.at/~klschoef/papers/shotdetection.pdf
Wiegand, T., Sullvian, G.J., Bjontegaard, G., Luthra, A.: Overview of the H.264/AVC Video Coding Standard. In: IEEE Transactions on Circuits and Systems for Video Technology (July 2003)
Zeng, W., Gao, W.: Shot change detection on H.264/AVC compressed video. In: ISCAS 2005. IEEE International Symposium on Circuits and Systems, vol. 4, pp. 3459–3462 (May 2005)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2008 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Schöffmann, K., Böszörmenyi, L. (2008). Fast Segmentation of H.264/AVC Bitstreams for On-Demand Video Summarization. In: Satoh, S., Nack, F., Etoh, M. (eds) Advances in Multimedia Modeling. MMM 2008. Lecture Notes in Computer Science, vol 4903. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-77409-9_25
Download citation
DOI: https://doi.org/10.1007/978-3-540-77409-9_25
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-77407-5
Online ISBN: 978-3-540-77409-9
eBook Packages: Computer ScienceComputer Science (R0)