Skip to main content
SpringerLink
Log in

Affection arousal based highlight extraction for soccer video

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Highlight extraction, as one of the key technologies in soccer video retrieval and summarization, has great academic and application value. According to the principle that the observer’s affection state would fluctuate with the evolution of game process when watching soccer match video, a novel highlight extraction approach based on the improved affection arousal model is proposed. Compared with the existing works, our main contributions include the following. A novel feature – shot intensity is exploited to replace the motion activity, which greatly improves the computational performance of affection arousal model. Another helpful feature – replay factor is designed and successfully fused into the affection arousal model. This makes the affection arousal model reflect the variation of the true match process more accurately. In addition, event temporal transition pattern (ETTP) in soccer video is utilized to detect highlights boundaries effectively combined with the affection arousal curve. Experiments conducted on real-world soccer game videos have demonstrated the efficiency and effectiveness of the proposed approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10

Similar content being viewed by others

Notes

  1. http://media.hust.edu.cn/soccervideoset.html

References

  1. Assfalg J, Bertini M, Del Bimbo A, Nunziati W, Pala P (2002) Soccer highlights detection and recognition using HMMs. In Proceedings of IEEE International Conference and Multimedia Expo (ICME), Lausanne, 1:825–828

  2. Boyar M, Alan Q, Akpinar S, Sabuncu O, Cicekli NK, Alpaslan FN (2010) Event boundary detection using audio-visual features and web-casting texts with imprecise time information. In Proceedings of IEEE International Conference on Multimedia and Expo (ICME), 578–583

  3. Chen S-C, Chen M, Zhang C, Shyu ML (2006) Exciting event detection using multi-level multimodal descriptors and data classification. In Proceedings of 8-th IEEE International Symposium on Multimedia (ISM), 193–200

  4. Dietz R, Lang A (1999) Affective agents: effects of agent affect on arousal, attention, liking and learning. In Proceedings of the Third International Cognitive Technology Conference, San Francisco, CA, 151–156

  5. Ekin, Tekalp AM (2003) Generic play-break event detection for summarization and hierarchical sports video analysis. In Proceedings of IEEE International Conference on Multimedia and Expo (ICME), Vol I, 169–172

  6. Gong Y, Sin LT, Chuan CH, Zhang H, Sakauchi MS (1995) Automatic parsing of TV soccer programs. In Proceedings of Multimedia Computing and System, 167–174

  7. Halin AA, Rajeswari M, Abbasnejad ME (2013) Soccer event detection via collaborative multimodal feature analysis and candidate ranking. Int Arab J Inf Technol 10(5):1–9

    Google Scholar 

  8. Hanjalic (2005) Adaptive extraction of highlights from a sport video based on excitement modeling. IEEE Trans Multimed 7(6):1114–1122

    Article  Google Scholar 

  9. Hanjalic, Xu LQ (2005) Affective video content representation and modeling. IEEE Trans Multimed 7(1):143–154

    Article  Google Scholar 

  10. Huang Q, Hu J, Hu W, Wang T, Bai H, Zhang Y (2007) A reliable logo and replay detector for sports video. In Proceedings of IEEE International Conference on Multimedia and Expo (ICME), Beijing, 1695–1698

  11. Huang CL, Shih HC, Chao CY (2006) Semantic analysis of soccer video using dynamic Bayesian network. IEEE Trans Multimed 8(4):749–760

    Article  Google Scholar 

  12. Jain N, Chaudhury S, Roy SD, Mukherjee P, Seal K, Talluri K (2008) A novel learning-based framework for detecting interesting events in soccer videos. In Proceedings of sixth Indian Conference on Computer Vision, Graphics & Image Processing, 119–125

  13. Kolekar MH (2011) Bayesian belief network based broadcast sports video indexing. Multimed Tools Appli 54:27–54

    Article  Google Scholar 

  14. Kolekar MH, Palaniappan K (2009) Semantic concept mining based on hierarchical event detection for soccer video indexing. J Multimed 4(5):298–312

    Article  Google Scholar 

  15. Li B, Errico JH, Pan H, Sezan I (2004) Bridging the semantic gap in sports video retrieval and summarization. J Vis Commun Image Represent 15(3):393–424

    Article  MATH  Google Scholar 

  16. Liang C, Zhang Y, Xu C, Wang J, Lu H (2009) A hierarchical semantics-matching approach for sports video annotation. Advances in Multimedia Information Processing-PCM 2009, 684–696

  17. Pan H, van Beek, Sezan MI (2001) Detection of slow-motion replay segment in sports video for highlights generation. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Salt Lake City, UT, 3:1649–1652

  18. Qian X, Liu G, Wang Z, Li Z, Wang H (2010) Highlight events detection in soccer video using HCRF. In Proceedings of the Second International Conference on Internet Multimedia Computing and Service, Harbin, China

  19. Qian X, Wang H, Liu G, Hou X (2010) HMM based soccer video event detection using enhanced mid-level semantic. Multimed Tools Appl 60(1):1–23

    Google Scholar 

  20. Snoek CGM, Worring M (2003) Time interval maximum entropy based event indexing in soccer video. In Proceedings of IEEE International Conference on Multimedia and Expo (ICME), 3: 481–484

  21. Tjondronegoro DW, Chen YPP (2010) Knowledge-discounted event detection in sports video. IEEE Trans Syst Man Cybern Part A-Syst Hum 40(5):1009–1024

    Article  Google Scholar 

  22. Wang L, Lew M, Xu G (2004) Offense based temporal segmentation for event detection in soccer video. In Proceedings of the 6th ACM SIGMM International Workshop on Multimedia Information Retrieval, New York, NY, USA, 259–266

  23. Wang T, Li J, Diao Q, Hu W, Zhang Y, Dulong C (2006) Semantic event detection using conditional random fields. In Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop

  24. Wang F, Ma YF, Zhang HJ, Li JT 2004) Dynamic Bayesian network based event detection for soccer highlight extraction. In Proceedings of International Conference on Image Processing (ICIP), 1:633–636

  25. Xie L, Chang SF, Divakaran A, Sun H (2002) Structure analysis of soccer video with hidden markov models. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Orlando, FL, USA, IV-4096-IV-4099

  26. Xu H, Fong TH, Chua TS (2005) Fusion of multiple asynchronous information sources for event detection in soccer video. In Proceedings of IEEE International Conference on Multimedia and Expo (ICME), Vols 1 and 2, 1243–1246

  27. Xu CS, Wang J, Lu H, Zhang Y (2008) A novel framework for semantic annotation and personalized retrieval of sports video. IEEE Trans Multimed 10(3):421–436

    Article  Google Scholar 

  28. Xu C, Wang J, Wan K, Li Y, Duan L (2006) Live sports event detection based on broadcast video and web-casting text. In Proceedings of the 14th annual ACM International Conference on Multimedia, Santa Barbara, CA, USA, 221–230

  29. Xu P, Xie L, Chang SF, Divakaran A, Vetro A, Sun H (2001) Algorithms and system for segmentation and structure analysis in soccer video. In Proceedings of IEEE International Conference on Multimedia and Expo (ICME), 721–724

  30. Yina H, Liu G, Chollet G (2008) Goal event detection in broadcast soccer videos by combining heuristic rules with unsupervised fuzzy c-means algorithm. In Proceedings of International Conference on Control, Automation, Robotics and Vision (ICARCV), 888–891

  31. Ying Y, Lin S, Zhang Y, Tang S (2007) Highlights extraction in soccer videos based on goal-mouth detection. In Proceedings of 9th International Symposium on Signal Processing and Its Applications (ISSPA), 1–4

  32. Zawbaa HM, EI-Bendary N, Hassanien AE, Kim T (2011) Machine learning-based soccer video summarization system. Multimedia, Computer Graphics and Broadcasting, Springer Berlin Heidelberg, 263:19–28

  33. Zhang YZ, Wang JY, Dai YW (2009) Soccer video shot segmentation based on self-adapting dual threshold and dominant color percentage. J Nanjing Univ Sci Technol (Nat Sci) 33(4):432–437

    Google Scholar 

Download references

Acknowledgments

This work is financially supported by the National Natural Science Foundation of China (NSFC) under Grant No. 61173114 and 61202300.

Author information

Authors and Affiliations

  1. School of Computer Science and Technology, Huazhong University of Science and Technology, 430074, Wuhan, China

    Zengkai Wang, Junqing Yu, Yunfeng He & Tao Guan

Authors
  1. Zengkai Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Junqing Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Yunfeng He
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Tao Guan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tao Guan.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Wang, Z., Yu, J., He, Y. et al. Affection arousal based highlight extraction for soccer video. Multimed Tools Appl 73, 519–546 (2014). https://doi.org/10.1007/s11042-013-1619-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-013-1619-1

Keywords

Search

Navigation