Abstract
An increasing number of applications such as content-based multimedia retrieval in a distributed system and low-bitrate video communications, require the efficient processing and transmission of video information. In content-based video retrieval, video segmentation produces video shots characterized by a certain degree of visual cohesiveness. The number of relevant video shots returned by the system can be very large, thereby requiring significant transmission bandwidth. In this paper, we present a new algorithm for the representation of visual information contained in video segments. The approach is based on Principal Component Analysis and takes advantage of the characteristics of the data in video shots, and the optimal energy compaction properties of the transform. The algorithm can use additional information about video sequences provided by a video analysis and retrieval system, such as a visual change estimator, and a video object tracking module.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Wactlar H., “Informedia-Search and Summarization in the Video Medium,” Proceedings of Imagina 2000 Conference, Monaco, 2000.
Smith J.R., Chang S.F., “VisualSEEk: A Fully Automated Content-Based Image Query System,” Proceedings of ACM Multimedia’ 96, ACM Press, Boston, November 1996.
Schonfeld D., and Lelescu D., “VORTEX: Video Retrieval and Tracking from Compressed Multimedia Databases-Multiple Object Tracking from MPEG-2 Bitstream,” Journal of Visual Communications and Image Representation( JVCIR’2000), 2000 Vol.11, No.2
Lelescu D., and Schonfeld D., “Real-Time Scene Change Detection on Compressed Multimedia Bitstream Using Statistical Sequential Analysis,” IEEE International Conference on Multimedia and Exposition (ICME2000), 2000 New York.
Vetterli M., “Multi-Dimensional Subbband Coding:Some Theory and Algorithms,” Signal Processing, 1984, Vol.6, No.2, pp.97–112.
Woods J.W., “Subband Image Coding,” Kluwer Academic Publishers, Boston, 1991.
Salembier P., Marques F., and Gasull A., “Coding of Partition Sequences,” Video Coding: The Second Generation Approach (Torres L. and Kunt M., eds.) Kluwer Academic Publishers Boston, 1996.
Katsaggelos A. K., Kondi L.P., Meier F.W., Ostermann J., Schuster G.M., “MPEG-4 and Rate Distortion Based Shape-Coding Techniques,” IEEE Proceedings Special Issue on Multimedia Signal Processing 1998, Vol.86, No.6, pp.1126–1154.
Archer C., Leen T.K., “Optimal Dimension Reduction and Transform Coding with Mixture Principal Components,” Proceedings of the IEEE International Joint Conference on Neural Networks, Washington, 1999.
Meinicke P., Ritter H., “Local PCA Learning with Resolution-Dependent Mixture of Gaussians,” Proceedings of 9th International Conference on Artificial Neural Networks (ICANN’99) 1999, Edinburgh, UK, pp 497–502.
Murakami H. and Kumar V., “Efficient Calculation of Primary Images from a Set of Images,” IEEE Transactions on Pattern Analysis and Machine Intelligence, 1982, Vol. PAMI-4, No. 5, pp. 511–515.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2001 IFIP International Federation for Information Processing
About this paper
Cite this paper
Lelescu, D., Schonfeld, D. (2001). Video Skimming and Summarization Based on Principal Component Analysis. In: Al-Shaer, E.S., Pacifici, G. (eds) Management of Multimedia on the Internet. MMNS 2001. Lecture Notes in Computer Science, vol 2216. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45508-6_10
Download citation
DOI: https://doi.org/10.1007/3-540-45508-6_10
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-42786-5
Online ISBN: 978-3-540-45508-0
eBook Packages: Springer Book Archive