Skip to main content
SpringerLink
Log in

Fast content-aware video length reduction

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Video length reduction has become a very important research issue in recent years. Numerous approaches have been developed, but each has its limitations, such as fragmented results, lengthy computation time, and huge memory consumption. The main contribution of this paper is to propose a new approach that addresses all three mentioned limitations in one shot. First, by modifying the dynamic programming approach originally adopted in Avidan et al.’s work, the proposed approach extracts smooth 2D sheets and thus avoids fragmentations. Second, unlike Chen et al.’s graph-cut algorithm, this approach is much simpler and could achieve similar results but with a speed that is about two orders of magnitude faster. Third, the memory consumption is also greatly reduced to be one order of magnitude smaller. Finally and most importantly, an out-of-core scheme is also proposed, which generalizes this approach to be able to cope with videos of any lengths. Results are shown and compared with existing approaches to demonstrate the effectiveness of the proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. In: SIGGRAPH ’2007 (2007)

  2. Bennett, E.P., McMillan, L.: Computational time-lapse video. In: SIGGRAPH ’2007 (2007)

  3. Boykov, Y., Jolly, M.P.: Interactive graph cuts for optimal boundary & region segmentation of objects in N–D images. In: ICCV ’2001 (2001)

  4. Boykov Y., Kolmogorov V.: An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision. In: IEEE Trans. Pattern Anal. Mach. Intell. 26(9), 1124–1137 (2004)

    Google Scholar 

  5. Chen, B., Sen, P.: Video carving. In: Eurographics ’2008 (2008)

  6. Divakaran, A., Peker, K.A., Radhakrishnan, R., Xiong, Z., Cabasson, R.: Video summarization using Mpeg-7 motion activity and audio descriptors. Tech. Rep. TR2003-34, MERL—Mitsubishi Electric Research Laboratories (2003)

  7. Dong, W., Jean-Claude, P.: Adaptive content-aware image resizing. In: Eurographics ’2009 (2009)

  8. Farin, D., Effelsberg, W., de With, P.H.N.: Robust clustering-based video summarization with integration of domain-knowledge. In: ICME ’2002, pp. 89–92 (2002)

  9. Gupta, S.K., Kececioglu, J., Schaffer, A.A.: Making the shortest-paths approach to sum-of-pairs multiple sequence alignment more space efficient in practice (1995)

  10. Hua, X., Lu, L., Zhang, H.: Ave: automated home video editing. In: ACM Multimedia ’2003, pp. 490–497 (2003)

  11. Jojic, N., Petrovic, N., Huang, T.S.: Scene generative models for adaptive video fast forward. In: ICIP ’2003, pp. 619–622 (2003)

  12. Kang, H., Matsushita, Y., Tang, X., Chen, X.: Space-time video montage. In: CVPR ’2006, pp. 1331–1338 (2006)

  13. Kim, C., Hwang, J.: An integrated scheme for object-based video abstraction. In: ACM Multimedia ’2000, pp. 303–311 (2000)

  14. Liu, F., Gleicher, M.: Video retargeting: automating pan and scan. In: ACM Multimedia ’2006, pp. 241–250 (2006)

  15. Ltti L., Koch C., Niebur E.: A model of saliency-based visual attention for rapid scene analysis. In: IEEE Trans. Pattern Anal. Mach. Intell. 20(11), 1254–1259 (1998)

    Google Scholar 

  16. Ma Y., Hua X., Lu L., Zhang H.: A generic framework of user attention model and its application in video summarization. In: IEEE Trans. Multimed. 7(5), 907–919 (2005)

    Google Scholar 

  17. Nam, J., Tewfik, A.H.: Video abstract of video. In: The 3rd IEEE Workshop on Multimedia Signal Processing, pp. 117–122 (1999)

  18. Ngo, C.W., Zhang, H.J., Chin, R.T., Pong, T.C.: Motion-based video representation for scene change detection. In: ICPR ’2000 (2000)

  19. Pal, C., Jojic, N.: Interactive montages of sprites for indexing and summarizing security video. In: CVPR ’2005, pp. 1192–1192 (2005)

  20. Pan, C., Chuang, Y., Hsu, W.H.: Ntu TRECVID-2007 fast rushes summarization system. In: Proceedings of the International Workshop on TRECVID Video Summarization, pp. 74–78 (2007)

  21. Petrovic N., Jojic N., Huang T.S.: Adaptive video fast forward. Multimed. Tools Appl. 26(3), 327–344 (2005)

    Article  Google Scholar 

  22. Pritch, Y., Rav-Acha, A., Peleg, S.: Non-chronological video synopsis and indexing. In: IEEE Trans. Pattern Anal. Mach. Intell. 30(11), 1971–1984 (2008)

  23. Rodriguez, M.: Cram: Compact representation of actions in movies. In: CVPR ’2010 (2010)

  24. Rubinstein, M., Shamir, A., Avidan, S.: Improved seam carving for video retargeting. In: SIGGRAPH ’2008 (2008)

  25. Rubinstein, M., Shamir, A., Avidan, S.: Multi-operator media retargeting. In: SIGGRAPH ’2009 (2009)

  26. Schonfeld, E.: Cisco: by 2013 video will be 90 percent of all consumer IP traffic and 64 percent of mobile. http://techcrunch.com/2009/06/09/cisco-by-2013-video-will-be-90-percent-of-all-consumer-ip-traffic-and-64-percent-of-mobile/

  27. Shamir, A., Sorkine, O.: Visual media retargeting. In: ACM SIGGRAPH ASIA 2009 Courses, pp. 1–13 (2009)

  28. Slot, K., Truelsen, R., Sporring, J.: Content-aware video editing in the temporal domain. In: SCIA ’09: Proceedings of the 16th Scandinavian Conference on Image Analysis, pp. 490–499 (2009)

  29. Smith, M., Kanade, T.: Video skimming and characterization through the combination of image and language understanding techniques. In: CVPR ’1997, pp. 775–781 (1997)

  30. Stefanidis, A., Partsinevelos, P., Agouris, P., Doucette, P.: Summarizing video datasets in the spatiotemporal domain. In: International Workshop on Database and Expert Systems Applications ’2000, pp. 906–912 (2000)

  31. Sukmarg, O., Rao, K.: Fast object detection and segmentation in Mpeg compressed domain. In: IEEE TENCON ’2000 (2000)

  32. Wang, Y., Fu, H., Sorkine, O., Lee, T., Seidel, H.: Motion-aware temporal coherence for video resizing. In: Pacific Graphics ’2009 (2009)

  33. Wang, Y., Lin, H., Sorkine, O., Lee, T.: Motion-based video retargeting with optimized crop-and-warp. In: SIGGRAPH ’2010, pp. 1–9 (2010)

  34. Wang, Y., Tai, C., Sorkine, O., Lee, T.: Optimized scale-and-stretch for image resizing. In: SIGGRAPH Asia ’2008 (2008)

  35. Wolf, L., Guttmann, M., Cohen-Or, D.: Non-homogeneous content-driven video-retargeting. In: ICCV ’2007, pp. 1–6 (2007)

  36. Zhu Z., Wu X., Fan J., Elmagarmid A.K., Aref W.G.: Exploring video content structure for hierarchical summarization. Multimed. Syst. 10(2), 98–115 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Information Management, Chungyu Institute of Technology, 40, Yi 7th Rd., Keelung, Taiwan

    Hsing-Ching Chang

  2. Department of Information Management, National Taiwan University of Science and Technology, 43, Section 4, Keelung Road, Taipei, Taiwan

    Chuan-Kai Yang

Authors
  1. Hsing-Ching Chang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chuan-Kai Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chuan-Kai Yang.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chang, HC., Yang, CK. Fast content-aware video length reduction. SIViP 8, 1383–1397 (2014). https://doi.org/10.1007/s11760-012-0367-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-012-0367-4

Keywords

Search

Navigation