Skip to main content

General Highlight Detection in Sport Videos

  • Conference paper
Book cover Advances in Multimedia Modeling (MMM 2009)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 5371))

Included in the following conference series:

Abstract

Attention is a psychological measurement of human reflection against stimulus. We propose a general framework of highlight detection by comparing attention intensity during the watching of sports videos. Three steps are involved: adaptive selection on salient features, unified attention estimation and highlight identification. Adaptive selection computes feature correlation to decide an optimal set of salient features. Unified estimation combines these features by the technique of multi-resolution auto-regressive (MAR) and thus creates a temporal curve of attention intensity. We rank the intensity of attention to discriminate boundaries of highlights. Such a framework alleviates semantic uncertainty around sport highlights and leads to an efficient and effective highlight detection. The advantages are as follows: (1) the capability of using data at coarse temporal resolutions; (2) the robustness against noise caused by modality asynchronism, perception uncertainty and feature mismatch; (3) the employment of Markovian constrains on content presentation, and (4) multi-resolution estimation on attention intensity, which enables the precise allocation of event boundaries.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Besag, J.: Spatial interaction and statistical analysis of lattice system. Journal of Royal Statistical Society 36(2), 192–236 (1974)

    MathSciNet  MATH  Google Scholar 

  2. Ekin, A., Tekalp, A., Mehrotra, R.: Automatic soccer video analysis and summarization. IEEE Trans. on Image Processing 12(7), 796–807 (2003)

    Article  Google Scholar 

  3. Hanjalic, A.: Adaptive extraction of highlights from a sport video based on excitement modeling. IEEE Trans. on Multimedia 7(6), 1114–1122 (2005)

    Article  Google Scholar 

  4. Hanjalic, A., Xu, L.Q.: Affective video content repression and model. IEEE Trans on Multimedia 7(1), 143–155 (2005)

    Article  Google Scholar 

  5. Kang, Y., Lim, J., Kankanhalli, M., Xu, C.-S., Tian, Q.: Goal detection in soccer video using audio/visual keywords. In: ICIP 2004, vol. 3, pp. 1629–1632 (2004)

    Google Scholar 

  6. Kokaram, A., Rea, N., Dahyot, R., Tekalp, M., Bouthemy, P., Gros, P., Sezan, I.: Browsing sports video: trends in sports-related indexing and retrieval work. Signal Processing Magazine 23(2), 47–58 (2006)

    Article  Google Scholar 

  7. Lenardi, R., Migliorati, P., Prandini, M.: Semantic indexing of soccer audio-visual sequence: A multimodal approach based on controlled markov chains. IEEE Trans. on Circuits and System for Video Technology 14, 634–643 (2004)

    Article  Google Scholar 

  8. Lesser, M.J., Murray, D.K.C.: Mind as a dynamical system: Implications for autism. In: Durham conference Psychobiology of autism: current research and practice (1998)

    Google Scholar 

  9. Lew, M.S.: Principles of Visual Information Retrieval. Springer, Heidelberg (1996)

    MATH  Google Scholar 

  10. Ma, Y., Lu, L., Zhang, H., Li, M.: A user attention model for video summarization. In: ACM Multimedia 2002 (2002)

    Google Scholar 

  11. News, G.: 3g football best mobile service (January 2005)

    Google Scholar 

  12. Ren, R., Jose, J.M., He, Y.: Affective sports highlight detection. In: The 15th European Signal Processing Conference, Poznan, Poland, September 2007, pp. 728–732 (2007)

    Google Scholar 

  13. Tagare, H.D., Toyama, K., Wang, J.G.: A maximum-likelihood strategy for directing attention during visual search. IEEE Trans. on Pattern Analysis and Machine Intelligence 23(5), 490–500 (2001)

    Article  Google Scholar 

  14. Treisman, A.M., Kanwisher, N.G.: Perceiving visually presented objects: recognition, awareness, and modularity. Current Opinion in Neurobiology 8, 218–226 (1988)

    Article  Google Scholar 

  15. Willsky, A.: Multiresolution markov models for signal and image processing. Proceedings of the IEEE 90(8), 1396–1458 (2002)

    Article  Google Scholar 

  16. Xu, C., Wang, J., Wan, K., Li, Y., Duan, L.: Live sports event detection based on broadcast video and web-casting text. In: ACM Multimedia 2006 (2006)

    Google Scholar 

  17. Xu, G., Ma, Y., Zhang, H., Yang, S.: An hmm-based framework for video semantic analysis. IEEE Trans. on Circuits and System for Video Technology 15, 1422–1433 (2005)

    Article  Google Scholar 

  18. Zettl, H.: Sight, Sound, Motion: Applied Media Aesthetics. Wadsworth, Belmont CA (1990)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ren, R., Jose, J.M. (2009). General Highlight Detection in Sport Videos. In: Huet, B., Smeaton, A., Mayer-Patel, K., Avrithis, Y. (eds) Advances in Multimedia Modeling . MMM 2009. Lecture Notes in Computer Science, vol 5371. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-92892-8_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-92892-8_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-92891-1

  • Online ISBN: 978-3-540-92892-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics