Shot Boundary Detection and Key Frame Extraction for Sports Video Summarization Based on Spectral Entropy and Mutual Information

Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 221)

Abstract

Video Summarization methods attempt to abstract the main occurrences, scenes, or objects in a clip in order to provide an easily interpreted synopsis of the video. This is an essential task in video analysis and indexing applications. New methods for detecting shot boundaries in video sequences and extracting key frames using metrics based on information theory are proposed in this work. The method for shot cut detection relies on the mutual information between the frames. The method for key frame extraction uses the difference of entropy value computed from eigen value matrix of consecutive frames to decide which frames to choose as key frame. The proposed method captures satisfactorily the visual content of the shot. The information theory measure provides the better results because it exploits the inter-frame information in a more compact way. It can also be successfully compared to other methods published in literature. The method for key frame extraction employs entropy measure computed on eigen values of frames to reduce complexity of computation. The proposed algorithm can capture the important yet salient content as the key frame. Its robustness and adaptability are validated by experiments with various kinds of video sequences.

Keywords

Video summarization Dynamic key frames extraction Mutual information Entropy difference measure Information theory 

References

  1. 1.
    Yang S, Lin X (2005) Frame extraction using unsupervised clustering based on a statistical model. Tsinghai Sci Technol J 10(2):169–173MathSciNetCrossRefGoogle Scholar
  2. 2.
    Zhuang Y, Rui Y, Huang TS, Metrotra S (2002) Adaptive key frame extraction using unsupervised clustering. In: Proceeding of IEEE international conference on image processing (ICIP’02), Chicago IL, pp 886–890Google Scholar
  3. 3.
    Lai J-L, Yi Y (2012) Key frame extraction based on visual attention model. J Vis Commun Image Process Elsevier 23(2012):114–125Google Scholar
  4. 4.
    Hanjalic A (2002) Shot-boundary detection: unraveled and resolved? IEEE Trans Circ Syst Video Technol 12(2):90–105CrossRefGoogle Scholar
  5. 5.
    Girgensohn A, Boreczky J (2000) Time-constrained key frame selection technique. J Multimedia Tools Appl 11:347–358MATHCrossRefGoogle Scholar
  6. 6.
    Ju SX, Black MJ, Minneman S, Kimber D (1998) Summarization of videotaped presentations: automatic analysis of motion and gestures. IEEE Trans Circ Syst Video Technol 8(5):686–696CrossRefGoogle Scholar
  7. 7.
    Turaga P, Veeraraghavan A (2009) Unsupervised view and rate invariant clustering of video sequences. Comput Vis Image Underst 3:353–371CrossRefGoogle Scholar
  8. 8.
    Liu L, Fan G (2005) Combined key-frame extraction and object based video segmentation. IEEE Trans Circ Syst Video Technol 15(7):869–884CrossRefGoogle Scholar
  9. 9.
    Setnes M, Babuska R (2001) Rule base reduction: some comments on the use of orthogonal transforms. IEEE Trans Syst Man Cybern Part C Appl Rev 31(2):199–206CrossRefGoogle Scholar
  10. 10.
    Nagasaka A, Tanaka Y (1992) Automatic video indexing and full-video search for object appearances, in second working conference on visual database systemsGoogle Scholar
  11. 11.
    Zhuangy Y, Rui Y, Huang TS, Mehrotra C (2007) An adaptive key frame extraction using unsupervised clustering. IEEE Trans Circ Syst Video Technol pp 168–186Google Scholar
  12. 12.
    Hanjalic A, Langendijk RL (2006) A new key-frame allocation method for representing stored video stream, 1st international workshop on image databases and multimedia searchGoogle Scholar
  13. 13.
    Girgensohn A, Boreczky J (2001) Time-constrained key-frame selection technique. Multimedia Tools ApplGoogle Scholar
  14. 14.
    Chitra A, Dhawale and Sanjeev, Jain. SI (2008) Summarization a novel approach towards keyframe selection for video. Asian J Inf TechnolGoogle Scholar
  15. 15.
    Tonomura Y, Akutsu A, Otsugi K, Sadakata T (1993) VideoMAP and videospaceicon: Tools for automatizing video content. In: Proceedings of ACM INTERCHI’93 conference, pp 131–141Google Scholar
  16. 16.
    Ueda H, Miyatake T, Yoshizawa S (1991) Impact: An interactive natural-motion-picture dedicated multimedia authoring system. In: Proceedings of ACM CHI’91 conference, pp 343–350Google Scholar
  17. 17.
    Rui Y, Huang TS, Mehrotra S (1998) Exploring video structure beyond the shots. In: Proceedings of IEEE international conference on multimedia computing and systems (ICMCS), Texas USA, pp 237–240Google Scholar
  18. 18.
    Pentland A, Picard R, Davenport G, Haase K (2003) Video and image semantics: advanced tools for telecommunications. IEEE Multimedia 1(2):73–75Google Scholar
  19. 19.
    Sun Z, Ping F (2004) Combination of color and object outline based method in video segmentation. In: Proceedings of SPIE storage and retrieval methods and applications for multimedia, 5307:61–69Google Scholar
  20. 20.
    Arman F, Hsu A, Chiu MY (1993) Image processing on compressed data for large video databases. In: Proceedings of ACM multimedia ‘93, Annaheim, CA, 1993:267–272Google Scholar
  21. 21.
    Savakis A, Rao RM (2003) Key frame extraction using in MPEG7 motion descriptors. In: Proceedings of 37th Asilomar conference on signals, systems and computersGoogle Scholar
  22. 22.
    Girgensohn A, Boreczky J (2000) Time-constrained keyframe selection technique. Multimedia Tools Appl 11:347–358MATHCrossRefGoogle Scholar
  23. 23.
    Gong Y, Liu X (2000) Generating optimal video summaries. In: Proceedings of IEEE international conference on multimedia and expo, 3:1559–1562Google Scholar
  24. 24.
    Zhao L, Qi W, Li SZ, Yang SQ, Zhang HJ (2000) Key-frame extraction and shot retrieval using nearest feature line (NFL). In: Proceedings of ACM international workshops on multimedia information retrieval, pp 217–220Google Scholar
  25. 25.
    Hanjalic A, Lagendijk RL, Biemond J (1998) A new method for key frame based video content representation. In: Image databases and multimedia search, World Scientific SingaporeGoogle Scholar
  26. 26.
    Hoon SH, Yoon K, Kweon I (2000) A new technique for shot detection and key frames selection in histogram space. In: Proceedings of the 12th workshop on image processing and image understanding pp 475–479Google Scholar
  27. 27.
    Narasimha R, Savakis A, Rao RM, De Queiroz R (2004) A neural network approach to key frame extraction. In: Proceedings of SPIE-IS&T electronic imaging storage and retrieval methods and applications for multimedia, 5307:439–447Google Scholar
  28. 28.
    Calic J, Izquierdo E (2002) Efficient key–frame extraction and video analysis. In: Proceedings of IEEE ITCC’2002 multimedia web retrieval section, pp 28–33Google Scholar
  29. 29.
    Liu TM, Zhang HJ, Qi FH (2003) A novel video key-frame-extraction algorithm based on perceived motion energy model. IEEE Trans Circ Syst Video Technol 13(10):1006–1013CrossRefGoogle Scholar
  30. 30.
    Cover TM, Thomas JA (2003) Elements of information theory, John Wiley & Sons Publications. ISBN 0-471-06259-6Google Scholar
  31. 31.
    Ciocca G, Schettini R (2004) An innovative algorithm for key frame extraction in video summarization. Int J Pattern Recogn Artif Intell 18(5):819–846CrossRefGoogle Scholar
  32. 32.
    Truong BT, Venkatesh S (2007) Video abstraction: A systematic review and classification. ACM transactions on multimedia computing, communications and applications, vol 3, No. 1, Article 3Google Scholar
  33. 33.
    Ciocca G, Schettini R (2004) An innovative algorithm for key frame extraction in video summarization. J Real-Time Image Process 1(1):69–88Google Scholar

Copyright information

© Springer India 2013

Authors and Affiliations

  1. 1.Department of CSEBasaveshwar Engineering CollegeBagalkotIndia

Personalised recommendations