Abstract
In this paper we present a user-centric summarisation system that combines automatic visual-content analysis with user-interface design features as a practical method for home movie summarisation. The proposed summarisation system is designed in such a manner that the video segmentation results generated by the automatic content analysis tools are further subject to refinement through the use of an intuitive user-interface so that the automatically created summaries can be effectively tailored to each individual’s personal need. To this end, we study a number of content analysis techniques to facilitate the efficient computation of video summaries, and more specifically emphasise the need for employing an efficient and robust optical flow field computation method for sub-shot segmentation in home movies. Due to the subjectivity of video summarisation and the inherent challenges associated with automatic content analysis, we propose novel user-interface design features as a means to enable the creation of meaningful home movie summaries in a simple manner. The main features of the proposed summarisation system include the ability to automatically create summaries of different visual comprehension, interactively defining the target length of the desired summary, easy and interactive viewing of the content in terms of a storyboard, and manual refinement of the boundaries of the automatically selected video segments in the summary.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Lienhart, R.: Abstracting Home Video Automatically. In: ACM Multimedia, Orlando, FL, USA, pp. 37–40 (1999)
Kender, J.R., Yeo, B.-L.: On the Structure and Analysis of Home Videos. In: Proc. of ACCV, Taipei (January 2000)
Gatica-Perez, D., Loui, A., Sun, M.-T.: Finding Structure in Home Video by Probabilistic Hierarchical Clustering. IEEE Tran. on Circuits and Systems for Video Tech. 13(6), 539–548 (2003)
Huang, S.-H., Wu, Q.-J.: Intelligent home video management system. In: Intl. Conf. on Information Technology: Research and Education, pp. 176–180 (2005)
Mei, T., Hua, X.-S., Zhou, H.-Q., Li, S.: Modeling and Mining of Users’ Capture Intention for Home Videos. IEEE Tran. on Multimedia 9, 66–77 (2007)
Takeuchi, Y., Sugimoto, M.: User-Adaptive Home Video Summarization using Personal Photo Libraries. In: Proc. of CIVR, pp. 472–479 (2007)
Wang, P.P., Wang, T., et al.: Information Theoritic Content Selection for Automated Home Video Editing. In: Proc. of ICIP, Texas, USA, pp. 537–540 (2007)
Cooray, S.H., Bredin, H., Xu, L.-Q., O’Connor, N.E.: An Interactive and Multi-level Framework for Summarising User Generated Videos. In: ACM MM, Beijing, China, pp. 685–688 (2009)
Peng, W.-T., Huang, W.-J., et al.: A User Experience Model for Home Video Summarization. In: Proc. of MMM, Chongqing, China, pp. 484–495 (2009)
Girgensohn, A., Boreczky, J., et al.: A Semi-automatic Approach to Home Video Editing. In: Proc. of ACM Symp. on User Interface Software and Technology, San Diego, CA, USA, pp. 81–89 (November 2000)
Campanella, M., Weda, J., Barbieri, M.: Edit while watching: home video editing made easy. In: Proc. of SPIE, vol. 6506 (2007)
Wu, P., Obrador, P.: Personal Video Manager: Managing and Mining Home Video Collections. In: Proc. of SPIE, Bellingham, vol. 5960, pp. 775–785 (2005)
Salton, G., Singhal, A., et al.: Automatic Text Struturing and Summarization. Information Processing and Management 22(2), 193–207 (1997)
Cooray, S.H., O’Connor, N.E.: Identifying an Efficient and Robust Sub-shot Segmentation Method for Home Movie Summarisation. Accepted for publication in 10th IEEE Intl. Conf. on Intelligent Systems Design and Applications (ISDA), Cairo, Egypt, November 29 - December 1 (2010)
Tang, L.-X., Meo, T., Hua, X.-S.: Near-Lossless Video Summarisation. In: ACM MM, Beijing, China, pp. 1049–1052 (2009)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Intl. Journal of Computer Vision, 91–110 (2004)
Bay, H., Ess, A., et al.: SURF: Speeded Up Robust Features. In: Computer Vision and Image Understanding (CVIU), vol. 99(3), pp. 346–359 (2008)
Bouguet, J.-Y.: Pyramidal Implementation of the Lucas Kanade Feature Tracker Description of the algorithm, Part of OpenCV library
Ghanbari, M.: The Cross-Search Algorithm for Motion Estimation. IEEE Tran. on Communications 38(7), 950–953 (1990)
Koga, T., Linuma, K.: Motion Compensated Interframe Coding for Video Conferencing. In: Proc. Nat. Telecomuunication Conf., pp. G5.3.1–G5.3.5 (1981)
Jing, X., Chau, L.-P.: An Efficient Three-Step Search Algorithm for Block Motion Estimation. IEEE Tran. on Multilmedia 6(3), 435–438 (2004)
Liu, S.-W., Wei, S.-D., Lai, S.-H.: Fast Optimal Motion Estimation Based on Gradient-Based Adaptive Multilevel Successive Elimination. IEEE Tran. on Circuits and Systems for Video Technology 18(2), 263–267 (2008)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cooray, S.H., Lee, H., O’Connor, N.E. (2011). A User-Centric System for Home Movie Summarisation. In: Lee, KT., Tsai, WH., Liao, HY.M., Chen, T., Hsieh, JW., Tseng, CC. (eds) Advances in Multimedia Modeling. MMM 2011. Lecture Notes in Computer Science, vol 6523. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-17832-0_40
Download citation
DOI: https://doi.org/10.1007/978-3-642-17832-0_40
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-17831-3
Online ISBN: 978-3-642-17832-0
eBook Packages: Computer ScienceComputer Science (R0)