Skip to main content
SpringerLink
Log in

A Comprehensive Study of Sports Video Analysis

  • Chapter
Multimedia Analysis, Processing and Communications

Part of the book series: Studies in Computational Intelligence ((SCI,volume 346))

Abstract

Commercial applications of video analysis are getting valuable with the development of digital television. People can easily record all kinds of programs and enjoy the videos in their leisure time. Among these programs, broadcasting sports videos are usually more tedious than others since they involve not only the main games, but also break time or commercials. And even main games comprise periods which are not splendid enough for the audience. Therefore, a considerable amount of research focuses on automatically annotating semantic concepts in sports videos, and providing a spellbinding way to browse videos. In this chapter, we briefly introduce related work of video analysis for different kinds of sports, and propose a generic framework for sports video annotation. We explicitly elaborate the state of the art techniques for sports videos analysis. Visual and audio information are utilized to extract mid-level features, and different models for semantic annotation are expounded with practical examples. We also expand on applications of sports video analysis from the viewpoints of the audience, professional athletes, and advertisers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 299.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 379.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 379.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Agrawal, R., Srikant, R.: Fast algorithms for mining association rules in large databases. In: Proc. Int. Conf. on Very Large Data Bases, pp. 487–499 (1994)

    Google Scholar 

  2. Allen, J.G., Xu, R.Y.D., Jin, J.S.: Object tracking using CamShift algorithm and multiple quantized feature spaces. In: Proc. Pan-Sydney Area Workshop on Visual Information Processing (2004)

    Google Scholar 

  3. Assfalg, J., Bertini, M., Bimbo, A.D., et al.: Soccer highlights detection and recognition using HMMs. In: Proc. IEEE ICME, vol. 1, pp. 825–828 (2002)

    Google Scholar 

  4. Babaguchi, N., Kawai, Y., Kitahashi, T.: Event based indexing of broadcasted sports video by intermodal collaboration. IEEE T. Multimedia 4(1), 68–75 (2002)

    Article  Google Scholar 

  5. Bach, N.H., Shinoda, K., Furui, S.: Robust highlight extraction using multi-stream hidden Markov models for baseball video. In: Proc. IEEE ICIP, vol. 3, pp. 173–176 (2005)

    Google Scholar 

  6. Bai, H., Hu, W., Wang, T., et al.: A novel sports video logo detector based on motion analysis. In: King, I., Wang, J., Chan, L.-W., Wang, D. (eds.) ICONIP 2006. LNCS, vol. 4233, pp. 448–457. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  7. Bishop, C.M.: Pattern recognition and machine learning. Springer, Heidelberg (2006)

    MATH  Google Scholar 

  8. Cai, R., Lu, L., Zhang, H.-J., Cai, L.-H.: Highlight sound effects detection in audio stream. In: Proc. IEEE ICME, vol. 3, pp. 37–40 (2003)

    Google Scholar 

  9. Chang, C.-C., Lin, C.-J.: LIBSVM: A library for support vector machines, http://www.csie.ntu.edu.tw/~cjlin/libsvm/

  10. Chang, C.-H., Hsieh, K.-Y., Chung, M.-C., et al.: ViSA: virtual spotlighted advertising. In: Proc. ACM MM, pp. 837–840 (2008)

    Google Scholar 

  11. Chen, H.-T., Tien, M.-C., Chen, Y.-W., et al.: Physics-based ball tracking and 3D trajectory reconstruction with applications to shooting location estimation in basketball video. J. Vis. Commun. Image R. 20(3), 204–216 (2009)

    Article  Google Scholar 

  12. Cheng, W.-H., Chu, W.-T., Wu, J.-L.: Semantic context detection based on hierar-chical audio models. In: Proc. ACM SIGMM Int. Workshop on Multimedia Information Retrieval, pp. 109–115 (2003)

    Google Scholar 

  13. Chou, C.-W., Tien, M.-C., Wu, J.-L.: Billiard Wizard: A tutoring system for broad-casting nine-ball billiards videos. In: Proc. IEEE ICASSP, pp. 1921–1924 (2009)

    Google Scholar 

  14. Chu, W.-T., Wu, J.-L.: Explicit semantic events detection and development of realistic applications for broadcasting baseball videos. Multimedia Tools and Applications 38(1), 27–50 (2008)

    Article  MathSciNet  Google Scholar 

  15. Duda, R.O., Hart, P.E., Stock, D.G.: Pattern classification. John Wiley and Sons, Chichester (2001)

    MATH  Google Scholar 

  16. Ekin, A., Tekalp, A.M.: Shot type classification by dominant color for sports video segmentation and summarization. In: Proc. ICASSP, vol. 3, pp. 173–176 (2003)

    Google Scholar 

  17. Ekin, A., Tekalp, A.M., Mehrotra, R.: Automatic soccer video analysis and sum-marization. IEEE T. Image Process. 12(7), 796–807 (2003)

    Article  Google Scholar 

  18. Fan, J., Elmagarmid, A.K., Zhu, X., et al.: ClassView: hierarchical video shot classification, indexing, and accessing. IEEE T. Multimedia 6(1), 70–86 (2004)

    Article  Google Scholar 

  19. Farin, D., Han, J., With, P.H.N.: Fast camera calibration for the analysis of sport sequences. In: Proc. IEEE ICME, pp. 482–485 (2005)

    Google Scholar 

  20. Farin, D., Krabbe, S., With, P.H.N., et al.: Robust camera calibration for sport videos using court models. In: Storage and retrieval methods and applications for multimedia, vol. 5307, pp. 80–91. SPIE, CA (2004)

    Google Scholar 

  21. Gao, X., Yang, Y., Tao, D., et al.: Discriminative optical flow tensor for video semantic analysis. Computer Vision and Image Understanding (Elsevier) 113(3), 372–383 (2009)

    Article  Google Scholar 

  22. Gao, X., Li, X., Feng, J., et al.: Shot-based video retrieval with optical flow tensor and HMMs. Pattern Recognition Letters (Elsevier) 30(2), 140–147 (2009)

    Article  Google Scholar 

  23. Gong, Y., Sin, L.T., Chuan, C.H., et al.: Automatic parsing of TV soccer programs. In: Proc. IEEE Int. Conf. on Multi Comput. Syst., pp. 167–174 (1995)

    Google Scholar 

  24. Guéziec, A.: Tracking pitches for broadcast television. IEEE Computer 35(3), 38–43 (2002)

    Google Scholar 

  25. Han, J., Kamber, M.: Data Mning: Concepts and Techniques. Morgan Kaufmann, San Francisco (2005)

    Google Scholar 

  26. Han, J., Dong, G., Yin, Y.: Efficient mining of partial periodic patterns in time series database. In: Proc. Int. Conf. on Data Engineering, pp. 106–115 (1999)

    Google Scholar 

  27. Hanjalic, A.: Shot-boundary detection: unraveled and resolved? IEEE T. Circ. Syst. Vid. 12(2), 90–105 (2002)

    Article  Google Scholar 

  28. Haoran, Y., Rajan, D., Tien, C.L.: A unified approach to detection of shot boundaries and subshots in compressed video. In: Proc. IEEE ICIP, vol. 2, pp. 1005–1008 (2003)

    Google Scholar 

  29. Intille, S.S., Bobick, A.F.: Recognizing planned, multi-person action. Comput. Vis. Image Und. 81, 414–445 (2001)

    Article  MATH  Google Scholar 

  30. Leonardi, R., Migliorati, P., Prandini, M.: Semantic indexing of soccer audio-visual sequences: a multimodal approach based on controlled Markov chains. IEEE T. Circ. Syst. Vid. 14(5), 634–643 (2004)

    Article  Google Scholar 

  31. Li, B., Sezan, I.: Event detection and summarization in American football broadcast video. Storage and retrieval for media databases. In: SPIE, vol. 4676, pp. 202–213 (2002)

    Google Scholar 

  32. Liang, D., Liu, Y., Huang, Q., et al.: Video2Cartoon: generating 3D cartoon from broadcast soccer video. In: Proc. ACM MM, pp. 217–218 (2005)

    Google Scholar 

  33. Lienhart, R.: Comparison of automatic shot boundary detection algorithms. Storage and retrieval for image and video databases. In: SPIE, vol. 3656, pp. 290–301 (1999)

    Google Scholar 

  34. Liu, H., Jiang, S., Huang, Q., et al.: A generic virtual content insertion system based on visual attention analysis. In: Proc. ACM MM, pp. 379–388 (2008)

    Google Scholar 

  35. Liu, S., Xu, M., Yi, H., et al.: Multimodal semantic analysis and annotation for basketball video. EURASIP J. Appl. Si. Pr. 2006, 1–13 (2006)

    Article  Google Scholar 

  36. Niu, Z., Gao, X., Tao, D., et al.: Semantic video shot segmentation based on color ratio feature and SVM. IEEE Cyberworlds, 157–162 (2008)

    Google Scholar 

  37. Pan, H., van Beek, P., Sezan, M.I.: Detection of slow-motion replay segments in sports video for highlights generation. In: Proc. IEEE ICASSP, vol. 3, pp. 1649–1652 (2001)

    Google Scholar 

  38. Pingali, G.S., Jean, Y., Carlbom, I.: Real time tracking for enhanced tennis broadcasts. In: Proc. IEEE CVPR, pp. 260–265 (1998)

    Google Scholar 

  39. Plataniotis, K.N., Venetsanopoulos, A.N.: Color Image Processing and Applications. Springer, Berlin (2000)

    Google Scholar 

  40. Rui, Y., Gupta, A., Acero, A.: Automatically extracting highlights for TV Baseball programs. In: Proc. ACM MM, pp. 105–115 (2000)

    Google Scholar 

  41. Shen, J., Tao, D., Li, X.: Modality mixture projections for semantic video event detection. IEEE T. Circ. Syst. Vid. 18(11), 1587–1596 (2008)

    Article  Google Scholar 

  42. Shum, H., Komura, T.: A spatiotemporal approach to extract the 3D trajectory of the baseball from a single view video sequence. In: Proc. IEEE ICME, vol. 3, pp. 1583–1586 (2004)

    Google Scholar 

  43. Tien, M.-C., Wang, Y.-T., Chou, C.-W., et al.: Event detection in tennis matches based on video data mining. In: IEEE ICME, pp. 1477–1480 (2008)

    Google Scholar 

  44. Tong, X., Lu, H., Liu, Q., et al.: Replay detection in broadcasting sports video. In: Proc. IEEE ICIG, pp. 337–340 (2004)

    Google Scholar 

  45. Tovinkere, V., Qian, R.J.: Detecting semantic events in soccer games: Towards a complete solution. In: Proc. IEEE ICME, pp. 1040–1043 (2001)

    Google Scholar 

  46. Wang, J., Xu, C., Chng, E., et al.: Event detection based on non-broadcast sports video. In: Proc. IEEE ICIP, vol. 3, pp. 1637–1640 (2004)

    Google Scholar 

  47. Wang, L., Liu, X., Lin, S., et al.: Generic slow-motion replay detection in sports video. In: Proc. IEEE ICIP, vol. 3, pp. 1585–1588 (2004)

    Google Scholar 

  48. Welch, G., Bishop, G.: An introduction to the Kalman Filter, http://www.cs.unc.edu/~welch/kalman/kalmanIntro.html

  49. Xie, L., Chang, S.-F., Divakaran, A., et al.: Structure analysis of soccer video with Hidden Markov Models. Pattern Recognition Letters, 767–775 (2002)

    Google Scholar 

  50. Xu, C., Wang, J., Lu, H., et al.: A novel framework for semantic annotation and personalized retrieval of sports video. IEEE T. Multimedia 10(3), 325–329 (2008)

    Google Scholar 

  51. Xu, P., Xie, L., Chang, S.-F., et al.: Algorithms and system for segmentation and structure analysis in soccer video. In: Proc. IEEE ICME, pp. 721–724 (2001)

    Google Scholar 

  52. Ye, Q., Huang, Q., Gao, W., et al.: Exciting event detection in broadcast soccer video with mid-level description and incremental learning. In: Proc. ACM MM, pp. 455–458 (2005)

    Google Scholar 

  53. Yeo, B.-L., Liu, B.: Rapid scene analysis on compressed video. IEEE T. Circ. Syst. Vid. 5(6), 533–544 (1995)

    Article  Google Scholar 

  54. Zabih, R., Miller, J., Mai, K.: A feature-based algorithm for detecting and classifying scene breaks. In: Proc. ACM MM, pp. 189–200 (1995)

    Google Scholar 

  55. Zhang, B., Dou, W., Chen, L.: Ball hit detection in table tennis games based on audio analysis. In: Proc. IEEE ICPR, vol. 3, pp. 220–223 (2006)

    Google Scholar 

  56. Zhang, D., Chang, S.-F.: Event detection in baseball video using superimposed caption recognition. In: Proc. ACM MM, pp. 315–318 (2002)

    Google Scholar 

  57. Zhang, H., Kankanhalli, A., Smoliar, S.W.: Automatic partitioning of full-motion video. Multimedia Syst. 1(1), 10–28 (1993)

    Article  Google Scholar 

  58. Zhu, G., Huang, Q., Xu, C., et al.: Trajectory based event tactics analysis in broadcast sports video. In: Proc. ACM MM, pp. 58–67 (2007)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Graduate Institute of Networking and Multimedia, National Taiwan University, No. 1, Sec. 4, Roosevelt Rd., Taipei, Taiwan, 10617

    Ming-Chun Tien & Ja-Ling Wu

  2. Department of Computer Science and Information Engineering, National Chung Cheng University, 168 University Road, Minhsiung Township, Chiayi County, Taiwan, 62102

    Wei-Ta Chu

Authors
  1. Ming-Chun Tien
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ja-Ling Wu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Wei-Ta Chu
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. School of Computer Engineering , Nanyang Technological University, 639798, Singapore

    Weisi Lin  & Dacheng Tao  & 

  2. Intelligent Systems Laboratory Systems Research Institute , Polish Academy of Sciences, Poland

    Janusz Kacprzyk

  3. Department of Computing , Hong Kong Polytechnic University, Hung Hom, Hong Kong

    Zhu Li

  4. School of Electronic Engineering and Computer Science, Queen Mary, University of London, London, U.K.

    Ebroul Izquierdo

  5. TCL-Thomson Electronics , Santa Clara, California

    Haohong Wang

Rights and permissions

Reprints and permissions

Copyright information

© 2011 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Tien, MC., Wu, JL., Chu, WT. (2011). A Comprehensive Study of Sports Video Analysis. In: Lin, W., Tao, D., Kacprzyk, J., Li, Z., Izquierdo, E., Wang, H. (eds) Multimedia Analysis, Processing and Communications. Studies in Computational Intelligence, vol 346. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-19551-8_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-19551-8_15

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-19550-1

  • Online ISBN: 978-3-642-19551-8

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation