Abstract
This paper presents a machine learning (ML) based event detection and summarization system for soccer matches. The proposed system is composed of six phases. Firstly, in the pre-processing phase, the system segments the whole video stream into small video shots. Then, in the shot processing phase, it applies two types of classification to the video shots resulted from the pre-processing phase. Afterwards, in the replay detection phase, the system applies two machine learning algorithms, namely; support vector machine (SVM) and neural network (NN), for emphasizing important segments with logo appearance. Also, in the score board detection phase, the system uses both ML algorithms for detecting the caption region providing information about the score of the game. Subsequently, in the excitement event detection phase, the system uses k-means algorithm and Hough line transform for detecting vertical goal posts and Gabor filter for detecting goal net. Finally, in the logo-based event detection and summarization phase, the system highlights the most important events during the match. Experiments on real soccer videos demonstrate encouraging results. Compared to the performance results obtained using SVM classifier, the proposed system attained good NN-based performance results concerning recall ratio, however it attained poor NN-based performance results concerning precision ratio.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chen, C.-Y., Wang, J.-C., Wang, J.-F., Hu, Y.-H.: Event-Based Segmentation of Sports Video Using Motion Entropy. In: Ninth IEEE International Symposium on Multimedia (ISM 2007), pp. 107–111 (2007)
Chen, C.-Y., Wang, J.-C., Wang, J.-F., Hu, Y.-H.: Motion Entropy Feature and Its Applications to Event-Based Segmentation of Sports Video. EURASIP Journal on Advances in Signal Processing 2008, Article ID 460913 (2008)
D’Orazio, T., Leo, M.: A review of vision-based systems for soccer video analysis. Pattern Recognition 43(8), 2911–2926 (2010)
Lotfi, E., Pourreza, H.R.: Event Detection and Automatic Summarization in Soccer Video. In: 4th Iranian Conference on Machine Vision and Image Processing (MVIP 2007), Mashhad, Iran (2007)
Yu, B., Zhu, D.H.: Automatic thesaurus construction for spam filtering using revised: back propagation neural network. Journal Expert Systems with Applications 37(1), 24–30 (2010)
Bishop, C.M.: Neural networks for pattern recognition. Oxford University Press (1995)
Wu, Q., Zhou, D.-X.: Analysis of support vector machine classification. J. Comput. Anal. Appl. 8, 99–119 (2006)
Ekin, A.: Sports Video Processing for Description, Summarization and Search. PhD Thesis, University of Rochester, Rochester (2003)
Xing-hua, S., Jing-yu, Y.: Inference and retrieval of soccer event. Journal of Communication and Computer 4(3) (2007)
Zawbaa, H.M., El-Bendary, N., Hassanien, A.E., Yeo, S.S.: Logo Detection in Broadcast Soccer Videos Using Support Vector Machine. Submitted to: The 2011 Online Conference On Soft Computing in Industerial Applications WWW (WSC16) (2011)
Tjondronegoro, D., Chen, Y.P., Pham, B.: The power of play-break for automatic detection and browsing of self-consumable sport video highlights. In: Multimedia Information Retrieval, pp. 267–274 (2004)
Ren, R., Jose, J.M.: Football Video Segmentation Based on Video Production Strategy. In: Losada, D.E., Fernández-Luna, J.M. (eds.) ECIR 2005. LNCS, vol. 3408, pp. 433–446. Springer, Heidelberg (2005)
Huang, C.-L., Shih, H.-C., Chao, C.-Y.: Semantic analysis of soccer video using dynamic Bayesian network. IEEE Transactions on Multimedia 8(4) (2006)
Zhao, Z., Jiang, S., Huang, Q., Ye, Q.: Highlight summarization in soccer video based on goalmouth detection. In: Asia-Pacific Workshop on Visual Information Processing (2006)
Wan, K., Yan, X., Yu, X., Xu, C.: Real-time Goal-Mouth Detection in MPEG Soccer Video. In: Proceedings of ACM MM 2003, Berkeley, USA, pp. 311–314 (2003)
Sun, X.: Pitch determination and voice quality analysis using subharmonic-to-harmonic ratio. In: The IEEE International Conference on Acoustics, Speech, Signal Processing (ICASSP 2002), Orlando, Florida, USA, vol. 1, pp. 333–336 (2002)
Tjondronegoro, D., Chen, Y.P., Pham, B.: Sports video summarization using highlights and play-breaks. In: The fifth ACM SIGMM International Workshop on Multimedia Information Retrieval (ACM MIR 2003), Berkeley, USA, pp. 201–208 (2003)
Ekin, A., Tekalp, A.M., Mehrotra, R.: Automatic Soccer Video Analysis and Summarization. IEEE Transactions on Image processing 12(7) (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zawbaa, H.M., El-Bendary, N., Hassanien, A.E., Kim, Th. (2011). Machine Learning-Based Soccer Video Summarization System. In: Kim, Th., et al. Multimedia, Computer Graphics and Broadcasting. MulGraB 2011. Communications in Computer and Information Science, vol 263. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27186-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-27186-1_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-27185-4
Online ISBN: 978-3-642-27186-1
eBook Packages: Computer ScienceComputer Science (R0)