Advertisement

Video Segmentation and Keyframe Extraction

Chapter
Part of the Advanced Information and Knowledge Processing book series (AI&KP)

Abstract

What the reader should know to understand this chapter \(\bullet \) Basic notions of image processing (Chap.  3). \(\bullet \) Clustering techniques (Chap.  6).

References

  1. 1.
    M. Abdel-Mottaleb, N. Dimitrova, R. Desai, and J. Martino. CONIVAS: content based image and video access system. In Proceedings of ACM International Conference on Multimedia, pages 427–428, 1996.Google Scholar
  2. 2.
    A. Aner-Wolf and J. Kender. Video-summaries and cross-referencing through mosaic based representation. Computer Vision and Image Understanding, 95(2):201–237, 2004.Google Scholar
  3. 3.
    H. Aoki, S. Shmotsuji, and O. Hori. A shot classification method of selecting effective key-frames for video browsing. In Proceedings of ACM International Conference on Multimedia, pages 1–10, 1996.Google Scholar
  4. 4.
    R. Castagno, T. Ebrahimi, and M. Kunt. Video segmentation based on multiple features for interactive multimedia applications. IEEE Transactions on Circuits and Systems for Video Technology, 8(5):562–571, 1998.Google Scholar
  5. 5.
    Z. Cernekova, I. Pitas, and Nikou. Information theory-based shot cut/fade detection and video summarization. IEEE Transactions on Circuits and Systems for Video Technology, 16(1):82–91, 2006.Google Scholar
  6. 6.
    H.S. Chang, S. Sull, and S.U. Lee. Efficient video indexing scheme for content-based retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 9(8):1269–1279, 1999.Google Scholar
  7. 7.
    R. Collobert, S. Bengio, and J. Mariéthoz. Torch: a modular machine learning software library. Technical Report 02-46, IDIAP, 2002.Google Scholar
  8. 8.
    P.L. Correia and F. Pereira. Classification of video segmentation application scenarios. IEEE Transactions on Circuits and Systems for Video Technology, 14(5):735–741, 2004.Google Scholar
  9. 9.
    J.M. Corridoni and A. Del Bimbo. Structured representation and automatic indexing of movie information content. Pattern Recognition, 31(12):2027–2045, 1998.Google Scholar
  10. 10.
    N. Dimitrova, H.J. Zhang, B. Shahraray, I. Sezan, T. Huang, and A. Zakhor. Application of video-content analysis and retrieval. IEEE Multimedia, 9(3):42–55, 2002.Google Scholar
  11. 11.
    A.D. Doulamis and N.D. Doulamis. Optimal content-based video decomposition for interactive video navigation. IEEE Transactions on Circuits and Systems for Video Technology, 14(6):757–775, 2004.Google Scholar
  12. 12.
    X. Du and G. Fan. Joint key-frame extraction and object segmentation for content-based video analysis. IEEE Transactions on Circuits and Systems for Video Technology, 16(7):904–914, 2006.Google Scholar
  13. 13.
    X. Gao and X. Tang. Unsupervised video-shot segmentation and model-free anchorperson detection for news video story parsing. IEEE Transactions on Circuits and Systems for Video Technology, 12(9):765–776, 2002.Google Scholar
  14. 14.
    D. Gatica-Perez, A. Loui, and M.T. Sun. Finding structure in home videos by probabilistic hierarchical clustering. IEEE Transactions on Circuits and Systems for Video Technology, 13(6):539–548, 2003.Google Scholar
  15. 15.
    J.M. Gauch and A. Shivadas. Finding and identifying unknown commercials using repeated video sequence detection. Computer Vision and Image Understanding, 103(1):80–88, 2006.Google Scholar
  16. 16.
    A. Hamampur, T. Weymouth, and R. Jain. Digital video segmentation. In Proceedings of ACM International Conference on Multimedia, pages 357–364, 1994.Google Scholar
  17. 17.
    A. Hanjalic. Shot boundary detection: unraveled and resolved? IEEE Transactions on Circuits and Systems for Video Technology, 12(2):90–105, 2002.Google Scholar
  18. 18.
    A. Hanjalic. Content Based Analysis of Digital Video. Springer-Verlag, 2004.Google Scholar
  19. 19.
    A. Hanjalic and H.J. Zhang. An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis. IEEE Transactions on Circuits and Systems for Video Technology, 9(8):1280–1289, 1999.Google Scholar
  20. 20.
    A. Hanjalic, R.L. Lagendijk, and J. Biemond. Automated high-level movie segmentation for advanced video-retrieval systems. IEEE Transactions on Circuits and Systems for Video Technology, 9(4):580–588, 1999.Google Scholar
  21. 21.
    V. Kobla, D. Doermann, and C. Faloutsos. VideoTrails: representing and visualizing structure. In Proceedings of ACM International Conference on Multimedia, pages 335–346, 1997.Google Scholar
  22. 22.
    I. Koprinska and S. Carrato. Temporal video segmentation: a survey. Signal Processing: Image Communication, 16:477–500, 2001.Google Scholar
  23. 23.
    J. Lee and B.W. Dickinson. Hierarchical video indexing and retrieval for subband-coded video. IEEE Transactions on Circuits and Systems for Video Technology, 10(5):824–829, 2000.Google Scholar
  24. 24.
    M.S. Lee, Y.M. Yang, and S.W. Lee. Automatic video parsing using shot boundary detection and camera operation analysis. Pattern Recognition, 34(3):711–719, 2001.Google Scholar
  25. 25.
    R. Leonardi, P. Migliorati, and M. Prandini. Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains. IEEE Transactions on Circuits and Systems for Video Technology, 14(5):634–643, 2004.Google Scholar
  26. 26.
    Y. Li and J. Kuo. Video Content Analysis Using Multimodal Information. Springer-Verlag, 2003.Google Scholar
  27. 27.
    L. Lije and G. Fan. Combined key-frame extraction and object-based video segmentation. IEEE Transactions on Circuits and Systems for Video Technology, 15(7):869–884, 2005.Google Scholar
  28. 28.
    S.D. MacArthur, C.E. Brodley, A.C. Kak, and L.S. Broderick. Interactive content-based image retrieval using relevance feedback. Computer Vision and Image Understanding, 88(2):55–75, 2002.Google Scholar
  29. 29.
    T. Meier and K.N. Ngan. Video segmentation for content-based coding. IEEE Transactions on Circuits and Systems for Video Technology, 9(8):1190–1203, 1999.Google Scholar
  30. 30.
    G.A. Miller. The magic number seven plus or minus two: some limits on capacity for processing information. Psychology Review, 63:81–97, 1956.Google Scholar
  31. 31.
    C.W. Ngo, T.C. Pong, and R.T. Chin. Video partitioning by temporal slice coherency. IEEE Transactions on Circuits and Systems for Video Technology, 11(8):941–953, 2001.Google Scholar
  32. 32.
    N.V. Patel and I.K. Sethi. Video shot detection and characterization for video databases. Pattern Recognition, 30(4):583–592, 1997.Google Scholar
  33. 33.
    M.J. Pickering and S. Rüger. Evaluation of key-frame based retrieval techniques for video. Computer Vision and Image Understanding, 92(2–3):217–235, 2003.Google Scholar
  34. 34.
    S. Porter, M. Mirmehdi, and B. Thoams. Temporal video segmentation and classification of edit effects. Image and Vision Computing, 21(13–14):1097–1106, 2003.Google Scholar
  35. 35.
    K.M. Pua, Gauch J.M., S.E. Gauch, and J.Z. Miadowicz. Real-time repeated video sequence identification. Computer Vision and Image Understanding, 93(3):310–327, 2004.Google Scholar
  36. 36.
    E. Sahouria and A. Zakhor. Content analysis of video using principal component analysis. IEEE Transactions on Circuits and Systems for Video Technology, 9(8):1290–1298, 1999.Google Scholar
  37. 37.
    F. Schaffalitzky and A. Zisserman. Automated location matching in movies. Computer Vision and Image Understanding, 92(2–3):217–235, 2003.Google Scholar
  38. 38.
    M.A. Smith and M.G. Christel. Automating the creation of a digital video library. In Proceedings of ACM International Conference on Multimedia, pages 357–358, 1995.Google Scholar
  39. 39.
    M.A. Smith and T. Kanade. Multimodal Video Characterization and Summarization. Springer-Verlag, 2004.Google Scholar
  40. 40.
    C.G.M. Snoek and M. Worring. Multimodal video indexing: a review of the state-of-the-art. Multimedia Tools and Applications, 25(1):5–35, 2005.Google Scholar
  41. 41.
    K.W. Sze, K.M. Lam, and G. Qiu. A new key frame representation for video segment retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 15(9):1148–1155, 2005.Google Scholar
  42. 42.
    Y. Taniguchi, A. Akutsu, Y. Tonomura, and H. Hamada. An intuitive and efficient access interface to real-time incoming video based on automatic indexing. In Proceedings of ACM International Conference on Multimedia, pages 25–33, 1995.Google Scholar
  43. 43.
    B.T. Truong, S. Venkatesh, and C. Dorai. Scene extraction in motion pictures. IEEE Transactions on Circuits and Systems for Video Technology, 13(1):5–15, 2003.Google Scholar
  44. 44.
    S. Tsekeridou and I. Pitas. Content-based video parsing and indexing based on audio-visual interaction. IEEE Transactions on Circuits and Systems for Video Technology, 11(4):522–535, 2001.Google Scholar
  45. 45.
    D. Wang. Unsupervised video segmentation based on watersheds and temporal tracking. IEEE Transactions on Circuits and Systems for Video Technology, 8(5):539–546, 1998.Google Scholar
  46. 46.
    B.L. Yeo and B. Liu. Rapid scene analysis on compressed video. IEEE Transactions on Circuits and Systems for Video Technology, 5(6):533–544, 1995.Google Scholar
  47. 47.
    M.M. Yeung and B.L. Yeo. Video visualization for compact presentation and fast browsing of pictorial content. IEEE Transactions on Circuits and Systems for Video Technology, 7(5):771–785, 1997.Google Scholar
  48. 48.
    M. Yeung, B.L. Yeo, and B. Liu. Segmentation of video by clustering and graph analysis. computer Vision and Image Understanding, 71(1):94–109, 1998.Google Scholar
  49. 49.
    H. Yi, D. Rajan, and L.T. Chia. A motion-based scene tree for compressed video content management. Image and Vision Computing, 24(2):131–142, 2006.Google Scholar
  50. 50.
    H.H. Yu and W. Wolf. A hierarchical multiresolution video shot transition detection scheme. Computer Vision and Image Understanding, 75(1–2):196–213, 1999.Google Scholar
  51. 51.
    H.J. Zhang, C.Y. Low, S.W. Smoliar, and J.H. Wu. Video parsing, retrieval and browsing: an integrated and content-based solution. In Proceedings of ACM International Conference on Multimedia, pages 15–24, 1995.Google Scholar
  52. 52.
    H.J. Zhang, J.H. Wu, C.Y. Low, and S.W. Smoliar. A video parsing, indexing and retrieval system. In Proceedings of ACM International Conference on Multimedia, pages 359–360, 1995.Google Scholar
  53. 53.
    H.J. Zhang, J. Wu, D. Zhong, and S.W. Smoliar. An integrated system for content-based video retrieval and browsing. Pattern Recognition, 30(4):643–658, 1997.Google Scholar
  54. 54.
    Y.J. Zhang and H.B. Lu. A hierarchical organization scheme for video data. Pattern Recognition, 35(11):2381–2387, 2002.Google Scholar

Copyright information

© Springer-Verlag London 2015

Authors and Affiliations

  1. 1.Department of Science and TechnologyParthenope University of NaplesNaplesItaly
  2. 2.School of Computing Science and the Institute of Neuroscience and PsychologyUniversity of GlasgowGlasgowUK

Personalised recommendations