Structure in Soccer Videos: Detecting and Classifying Highlights for Automatic Summarization

  • Ederson Sgarbi
  • Díbio Leandro Borges
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3773)


We propose an automatic framework to detect and classify highlights directly from soccer videos. Sports videos are amongst the most important events for TV transmissions and journalism, however for the purpose of archiving, reuse for sports analysts and coaches, and of main interest to the audience, the considered highlights of the match should be annotated and saved separately. This procedure is done manually by many assistants watching the match from a video. In this paper we develop an automatic framework to perform such a summarization of a soccer video using object-based features. The highlights of a soccer match are defined as shots towards any of the two goal areas, i.e. plays that have already passed the midfield area. Novel algorithms are presented to perform shot classification as long distance shot and others, highlights detection based on object-based features segmentation, and highlights classification for complete summarization of the event. Experiments are reported for complete soccer matches transmitted by TV stations in Brazil, testing for different illumination (day and night), different stadium fields, teams and TV broadcasters.


Recall Rate Goal Area Sport Video Complete Match Soccer Match 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Assfalg, J., Bertini, M., Del Bimbo, A., Nunziati, W., Pala, P.: Soccer highlights detection and recognition using HMMs. In: Proc. IEEE Int. Conf. Mult. and Expo (ICME), pp. 825–828 (2002)Google Scholar
  2. 2.
    Chang, S.: The holy grail of content-based media analysis. IEEE Multimedia 9, 957–962 (2002)Google Scholar
  3. 3.
    Eking, A., Tekalp, A., Mehrotra, R.: Automatic soccer video analysis and summarization. IEEE Transactions on Image Processing 12, 796–807 (2003)CrossRefGoogle Scholar
  4. 4.
    Gong, Y., Sin, L.T., Chuan, C.H., Zhang, H.J., Sakauchi, M.: Automatic parsing of TV soccer programs. In: Proc. IEEE Int. Conf. Mult. Comput. Systems, pp. 167–174 (1995)Google Scholar
  5. 5.
    Szenberg, F.: Acompanhamento de cenas com calibração automática de câmeras. Doctorate Thesis (in Portuguese), Departamento de Informática, PUC-Rio, Rio de Janeiro, Brasil (2001)Google Scholar
  6. 6.
    Vandenbroucke, N., Macaire, L., Vieren, C., Postaire, J.: Contribution of a color classification to soccer players tracking with snakes. In: Proc. IEEE Int. Conf. Systems, Man, and Cybernetics, pp. 3660–3665 (1997)Google Scholar
  7. 7.
    Vandenbroucke, N., Macaire, L., Postaire, J.: Color image segmentation by pixel classification in an adapted hybrid color space. An application to soccer image analysis. Computer Vision and Image Understanding 90, 190–216 (2003)CrossRefGoogle Scholar
  8. 8.
    Xie, L., Chang, S.F., Divakaran, A., Sun, H.: Structure analysis of soccer video with Hidden Markov Models. In: Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), pp. 4096–4099 (2002)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Ederson Sgarbi
    • 1
  • Díbio Leandro Borges
    • 2
  1. 1.Depto. de InformáticaFundação Faculdades Luiz MeneghelBandeirantesBrazil
  2. 2.BIOSOLOGoiâniaBrazil

Personalised recommendations