Integrating semantic analysis and scalable video coding for efficient content-based adaptation
Scalable video coding has become a key technology to deploy systems where the adaptation of content to diverse constrained usage environments (such as PDAs, mobile phones and networks) is carried out in a simple and efficient way. Content-based adaptation and summarization are fields that aim for providing improved adaptation to the user, trying to optimize the semantic coverage in the adapted/summarized version. This paper proposes the integration of content analysis with scalable video adaptation paradigm. They must be fitted in such a way that the efficiency of scalable adaptation is not damaged. An integrated framework is proposed for semantic video adaptation, as well as an adaptive skimming scheme that can use the results of semantic analysis. They are described using the MPEG-21 DIA tools to provide the adaptation in a standard framework. Particularly, the case of activity analysis is described to illustrate the integration of semantic analysis in the framework, and its use for online content summarization and adaptation. Overall efficiency is achieved by means of computing activity using compressed domain analysis with several metrics evaluated as measures of activity.
KeywordsMPEG-21 Digital item adaptation Scalable video Video summarization Semantic video adaptation
Unable to display preview. Download preview PDF.
- 5.Schwarz, H., Marpe, D., Wiegand, T.: Overview of the scalable H.264/MPEG4-AVC extension. In: Proceedings of International Conference on Image Processing, (2006)Google Scholar
- 8.Furini, M., Ghini, V.: A video frame dropping mechanism based on audio perception. IEEE Global Telecommunications Conference Workshops, pp. 211–216 (2004)Google Scholar
- 13.Peker, K.A., Divakaran, A., Sun, H.: Constant pace skimming and temporal sub-sampling of video using motion activity. In: Proceedings of International Conference on. Image Processing, pp. 414–417 (2001)Google Scholar
- 16.Ngo, C.-W., Ma, Y.-F., Zhang, H.-J.: Automatic video summarization by graph modeling. In: Proceedings of Ninth IEEE International Conference on Computer Vision, pp. 104–109 (2003)Google Scholar
- 17.Smith, M.A., Kanade, T.: Video skimming and characterization through the combination of image and language understanding. In: Proceedings of IEEE International Workshop on Content-Based Access of Image and Video Database, pp. 61–70 (1998)Google Scholar
- 18.Gang, Z., Chia, L.T., Zongkai, Y.: MPEG-21 digital item adaptation by applying perceived motion energy to H.264 video. In: International Conference on Image Processing, pp. 2777–2780 (2004)Google Scholar
- 19.Lai, W., Gu, X.D., Wang, R.H., Dai, L.R., Zhang, H.J.: Perceptual video streaming by adaptive spatial-temporal scalability. Advances in Multimedia Information Processing—PCM 2004. Lecture Notes in Computer Science (3332), pp. 431–438. Springer, Berlin, (2004)Google Scholar
- 22.Sprljan, N., Mrak, M., Abhayaratne, G.C.K., Izquierdo, E.: A scalable coding framework for efficient video adaptation. In: Proceedings of International Workshop on Image Analysis for Multimedia Interactive Services (WIAMIS) (2005)Google Scholar
- 26.Shen, K., Delp, E.J.: A fast algorithm for video parsing using MPEG compressed sequences. In: Proceedings of the International Conference on Image Processing, pp. 252–255 (1995)Google Scholar
- 33.Chan, M.H., Yu, Y.B., Constantinides, A.G.: Variable size block matching motion compensation with applications to video coding. Communications, Speech and Vision, IEE Proceedings I, pp. 205–212 (1990)Google Scholar
- 34.Herranz, L., Tiburzi, F., Bescós, J.: Extraction of motion activity from scalable-coded video sequences. Semantic Multimedia, Lecture Notes in Computer Science (4306), pp. 148–158. Springer, Berlin, (2006)Google Scholar