Content-Aware Video Editing in the Temporal Domain

  • Kristine Slot
  • René Truelsen
  • Jon Sporring
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5575)

Abstract

An extension of 2D Seam Carving [Avidan and Shamir, 2007] is presented, which allows for automatic resizing the duration of video from stationary cameras without interfering with the velocities of the objects in the scenes. We are not interested in cutting out entire frames, but instead in removing spatial information across different frames. Thus we identify a set of pixels across different video frames to be either removed or duplicated in a seamless manner by analyzing 3D space-time sheets in the videos. Results are presented on several challenging video sequences.

Keywords

Seam carving video editing temporal reduction 

References

  1. [Adelson and Bergen, 1985]
    Adelson, E.H., Bergen, J.R.: Spatiotemporal energy models for the perception of motion. J. of the Optical Society of America A 2(2), 284–299 (1985)CrossRefGoogle Scholar
  2. [Avidan and Shamir, 2007]
    Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graph. 26(3) (2007)Google Scholar
  3. [Bennett and McMillan, 2003]
    Bennett, E.P., McMillan, L.: Proscenium: a framework for spatio-temporal video editing. In: MULTIMEDIA 2003: Proceedings of the eleventh ACM international conference on Multimedia, pp. 177–184. ACM, New York (2003)CrossRefGoogle Scholar
  4. [Chen and Sen, 2008]
    Chen, B., Sen, P.: Video carving. In: Short Papers Proceedings of Eurographics (2008)Google Scholar
  5. [Gupta et al., 1995]
    Gupta, S.K., Kececioglu, J.D., Schffer, A.A.: Making the shortest-paths approach to sum-of-pairs multiple sequence alignment more space efficient in practice. In: Combinatorial Pattern Matching, pp. 128–143. Springer, Heidelberg (1995)CrossRefGoogle Scholar
  6. [Kim and Hwang, 2000]
    Kim, C., Hwang, J.: An integrated sceme for object-based video abstraction. ACM Multimedia, 303–311 (2000)Google Scholar
  7. [Kvatra et al., 2003]
    Kvatra, V., Schödl, A., Essa, I., Turk, G., Bobick, A.: Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22(3), 277–286 (2003)CrossRefGoogle Scholar
  8. [Rav-Acha et al., 2007]
    Rav-Acha, A., Pritch, Y., Peleg, S.: Video synopsis and indexing. Proceedings of the IEEE (2007)Google Scholar
  9. [Rubenstein et al., 2008]
    Rubenstein, M., Shamir, A., Avidan, S.: Improved seam carving for video editing. ACM Transactions on Graphics (SIGGRAPH) 27(3) (2008) (to appear)Google Scholar
  10. [Slot and Truelsen, 2008]
    Slot, K., Truelsen, R.: Content-aware video editing in the temporal domain. Master’s thesis, Dept. of Computer Science, Copenhagen University (2008), www.rtr.dk/thesis
  11. [Uchihashi and Foote, 1999]
    Uchihashi, S., Foote, J.: Summarizing video using a shot importance measure and a frame-packing algorithm. In: the International Conference on Acoustics, Speech, and Signal Processing (Phoenix, AZ), vol. 6, pp. 3041–3044. FX Palo Alto Laboratory, Palo Alto (1999)Google Scholar
  12. [Velho and Marín, 2007]
    Velho, L., Marín, R.D.C.: Seam carving implementation: Part 2, carving in the timeline (2007), http://w3.impa.br/~rdcastan/SeamWeb/Seam%20Carving%20Part%202.pdf
  13. [Wang et al., 2005]
    Wang, H., Xu, N., Raskar, R., Ahuja, N.: Videoshop: A new framework for spatio-temporal video editing in gradient domain. In: CVPR 2005: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), Washington, DC, USA, vol. 2, p. 1201. IEEE Computer Society, Los Alamitos (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Kristine Slot
    • 1
  • René Truelsen
    • 1
  • Jon Sporring
    • 1
  1. 1.Dept. of Computer ScienceCopenhagen UniversityCopenhagenDenmark

Personalised recommendations