Abstract
With the increase in media streaming content and consumer-level video creation, there is a high demand for automatic video summarization systems. This paper proposes a bottom-up approach for the automatic generation of dynamic video summaries. Our approach integrates motion and saliency analysis with temporal slicing to extract features from the video, and to further find candidate shots. A shot similarity measure is proposed for constructing the dynamic summaries for candidate shots. From a practical perspective, our main contribution is the design of a video summarization system that is independent on the video domain. We show that the system performs equally well for domains at the extreme opposites of the domain spectrum, namely professionally edited videos and egocentric videos, without any prior information on the video contents.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Birchfield, S.T., Rangarajan, S.: Spatiograms versus histograms for region-based tracking. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 2, pp. 1158–1163. IEEE (2005)
Bobick, A.F., Davis, J.W.: The recognition of human movement using temporal templates. IEEE Trans. Pattern Anal. Mach. Intell. 23(3), 257–267 (2001)
Conaire, C.O., O’Connor, N.E., Smeaton, A.F.: An improved spatiogram similarity measure for robust object localisation. In: IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP 2007, vol. 1, pp. I-1069. IEEE (2007)
Ejaz, N., Tariq, T.B., Baik, S.W.: Adaptive key frame extraction for video summarization using an aggregation mechanism. J. Vis. Commun. Image Represent. 23(7), 1031–1040 (2012)
Ghosh, J., Lee, Y.J., Grauman, K.: Discovering important people and objects for egocentric video summarization. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1346–1353. IEEE (2012)
Hou, X., Zhang, L.: Saliency detection: a spectral residual approach. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2007, pp. 1–8. IEEE (2007)
Lin, C.Y.: Rouge: a package for automatic evaluation of summaries. In: Text Summarization Branches Out: Proceedings of the ACL-04 Workshop, vol. 8 (2004)
Lu, Z., Grauman, K.: Story-driven summarization for egocentric video. In: 2013 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2714–2721. IEEE (2013)
Ngo, C.W., Pong, T.C., Chin, R.T.: Detection of gradual transitions through temporal slice analysis. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1. IEEE (1999)
Over, P., Smeaton, A.F., Awad, G.: The trecvid 2008 BBC rushes summarization evaluation. In: Proceedings of the 2nd ACM TRECVid Video Summarization Workshop, pp. 1–20. ACM (2008)
Petersohn, C.: Sub-shots-basic units of video. In: 14th International Workshop on Systems, Signals and Image Processing, 2007 and 6th EURASIP Conference Focused on Speech and Image Processing, Multimedia Communications and Services, pp. 323–326. IEEE (2007)
Xiang, T., Gong, S., Parkinson, D.: Autonomous visual events detection and classification without explicit object-centred segmentation and tracking. In: BMVC, pp. 1–10. Citeseer (2002)
Yeung, S., Fathi, A., Fei-Fei, L.: Videoset: video summary evaluation through text. arXiv preprint arXiv:1406.5824 (2014)
Zivkovic, Z.: Improved adaptive Gaussian mixture model for background subtraction. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, vol. 2, pp. 28–31. IEEE (2004)
Zivkovic, Z., van der Heijden, F.: Efficient adaptive density estimation per image pixel for the task of background subtraction. Pattern Recogn. Lett. 27(7), 773–780 (2006)
Acknowledgments
The authors thank Dr. Cote for her useful comments on the paper, and Dr. Jean for his open source implementation of spatiograms.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Dash, A., Albu, A.B. (2017). A Domain Independent Approach to Video Summarization. In: Blanc-Talon, J., Penne, R., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2017. Lecture Notes in Computer Science(), vol 10617. Springer, Cham. https://doi.org/10.1007/978-3-319-70353-4_37
Download citation
DOI: https://doi.org/10.1007/978-3-319-70353-4_37
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-70352-7
Online ISBN: 978-3-319-70353-4
eBook Packages: Computer ScienceComputer Science (R0)