Abstract
In this paper, we propose an adaptive fast playback framework where multi-features are used to support arbitrary frame-rate video playback. We introduce a Jenson noise-based difference (JSND) as a distance measure between adjacent frames for video key frame extraction, and then present an interest learning model to control the playback rate according to the user preference. The proposed “smart-skip” frame schema not only helps users navigate the video content non-uniformly for any variable playback rate, but also preserves video semantic information to avoid the omission of important events. An overview+detail video player offering users an immersive experience is implemented to browse and comprehend the video content. Experimental results show that users can quickly skim the video, understand the content, and navigate into the content of interest.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Al-Hajri, A., Miller, G., Fong, M., Fels, S.S.: Visualization of personal history for video navigation. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1187–1196. ACM (2014)
Chen, C.Y., Hsu, C.T., Yeh, C.H., Chen, M.J.: Arbitrary frame skipping transcoding through spatial-temporal complexity analysis. In: TENCON 2007–2007 IEEE Region 10 Conference, pp. 1–4. IEEE (2007)
Cheng, K.Y., Luo, S.J., Chen, B.Y., Chu, H.H.: Smartplayer: user-centric video fast-forwarding. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 789–798. ACM (2009)
Christmann, O., Carbonell, N., Richir, S.: Visual search in dynamic 3d visualisations of unstructured picture collections. Interact. Comput. 22(5), 399–416 (2010)
Glance, N.S.: Recommender system and method for generating implicit ratings based on user interactions with handheld devices, US Patent 6,947,922, 20 September 2005
Guo, Y., Xu, Q., Sun, S., Luo, X., Sbert, M.: Selecting video key frames based on relative entropy and the extreme studentized deviate test. Entropy 18(3), 73 (2016)
Höferlin, B., Höferlin, M., Weiskopf, D., Heidemann, G.: Information-based adaptive fast-forward for visual surveillance. Multimedia Tools Appl. 55(1), 127–150 (2011)
Hu, Y., Koren, Y., Volinsky, C.: Collaborative filtering for implicit feedback datasets. In: Eighth IEEE International Conference on Data Mining, ICDM 2008, pp. 263–272. IEEE (2008)
Jiang, J., Zhang, X.P.: A new player-enabled rapid video navigation method using temporal quantization and repeated weighted boosting search. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 64–71. IEEE (2010)
Jiang, J., Zhang, X.P.: A smart video player with content-based fast-forward playback. In: Proceedings of the 19th ACM International Conference on Multimedia, pp. 1061–1064. ACM (2011)
Peker, K.A.: Method and system for playing back videos at speeds adapted to content, US Patent 7,796,860, 14 September 2010
Petrovic, N., Jojic, N., Huang, T.S.: Adaptive video fast forward. Multimedia Tools Appl. 26(3), 327–344 (2005)
Ramos, G., Balakrishnan, R.: Fluid interaction techniques for the control and annotation of digital video. In: Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology, pp. 105–114. ACM (2003)
Schoeffmann, K., Hudelist, M.A., Huber, J.: Video interaction tools: a survey of recent work. ACM Comput. Surv. (CSUR) 48(1), 14 (2015)
Shu, H., Chau, L.P.: Variable frame rate transcoding considering motion information [video transcoding]. In: IEEE International Symposium on Circuits and Systems, ISCAS 2005, pp. 2144–2147. IEEE (2005)
Vetro, A., Christopoulos, C., Sun, H.: Video transcoding architectures and techniques: an overview. IEEE Sig. Process. Mag. 20(2), 18–29 (2003)
Xu, Q., Liu, Y., Li, X., Yang, Z., Wang, J., Sbert, M., Scopigno, R.: Browsing and exploration of video sequences: a new scheme for key frame extraction and 3d visualization using entropy based jensen divergence. Inf. Sci. 278, 736–756 (2014)
Acknowledgment
This work has been funded by Natural Science Foundation of China (61471261, 61179067, U1333110), and by grants TIN2013-47276-C6-1-R from Spanish Government and 2014-SGR-1232 from Catalan Government (Spain).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing AG
About this paper
Cite this paper
Dong, L., Xu, Q., Wu, S., Song, X., Schoeffmann, K., Sbert, M. (2016). An Overview+Detail Surveillance Video Player: Information-Based Adaptive Fast-Forward. In: Chen, E., Gong, Y., Tie, Y. (eds) Advances in Multimedia Information Processing - PCM 2016. PCM 2016. Lecture Notes in Computer Science(), vol 9917. Springer, Cham. https://doi.org/10.1007/978-3-319-48896-7_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-48896-7_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-48895-0
Online ISBN: 978-3-319-48896-7
eBook Packages: Computer ScienceComputer Science (R0)