Skip to main content
Log in

Application of deep learning in video target tracking of soccer players

  • Focus
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

Football matches have a high degree of attention and the analysis technology used for video contents has important practical significance and good application prospects. However, due to the diversity of conditions, i.e., football venues, clothing colors, etc., there is no universal tracker that can perfectly adapt to all scenarios. Due to its excellent feature extraction capabilities, deep learning technology has been widely used in the field of computer vision in recent years. The main objective of this article is the extraction of player’s trajectory in a football game, i.e., the path tracking of the player’s goal. To achieve this objective, deep learning technology is used for automatic extraction of the characteristic features of the player’s target in the context of target detection and tracking. The target detection method employed in this study is based on deep learning by forming new multi-scale features and modifying the generation rules of anchor points of the captured videos, making it more suitable for small target detection tasks in football match scenes. The generation rules are based on a complex decision support system for target tracking. This decision support system uses the method of constructing a similarity matrix to transform the multi-target tracking problem into a data association problem that can be solved by the Hungarian algorithm. The proposed approach is compared against state-of-the-art techniques in terms of area under the curve (AUC) value, track set scene distribution, number of frames, and other parameters. Based on the experimental results, the proposed approach outperforms these existing techniques with much better results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data Availability

Enquiries about data availability should be directed to the authors.

References

  • Barceló L, Binefa X, Kender JR (2005) Robust methods and representations for soccer player tracking and collision resolution. International conference on image and video retrieval. Springer, Berlin, Heidelberg, pp 237–246

    Chapter  Google Scholar 

  • Bradski GR (1998) Computer vision face tracking for use in a perceptual user interface

  • Choi K, Seo Y (2011) Automatic initialization for 3D soccer player tracking. Pattern Recogn Lett 32(9):1274–1282

    Article  Google Scholar 

  • Dearden A, Demiris Y, Grau O (2006) Tracking football player movement from a single moving camera using particle filters

  • Figueroa PJ, Leite NJ, Barros RL (2006) Tracking soccer players aiming their kinematical motion analysis. Comput vis Image Understand 101(2):122–135

    Article  Google Scholar 

  • Figueroa P, Leite N, Barros RML, et al (2004) Tracking soccer players using the graph representation. In: Proceedings of the 17th international conference on pattern recognition, 2004, vol 4. ICPR2004. IEEE, pp 787–790.

  • Fukunaga K, Hostetler L (1975) The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans Inform Theory 21(1):32–40

    Article  MathSciNet  Google Scholar 

  • Heydari M, Moghadam AME (2012) An MLP based player detection and tracking in broadcast soccer video. In: Proceedings of the 2012 international conference of robotics and artificial intelligence. IEEE, pp 195–199.

  • Intille SS, Bobick AF (1995) Closed-world tracking. In: International conference on computer vision. IEEE computer society

  • Khan SM, Shah M (2009) Tracking multiple occluding people by localizing on multiple scene planes. IEEE Trans Pattern Anal Mach Intel 31(3):505

    Article  Google Scholar 

  • Khatoonabadi SH, Rahmati M (2009) Automatic soccer players tracking in goal scenes by camera motion elimination. Image vis Comput 27(4):469–479

    Article  Google Scholar 

  • Liu J, Tong X, Li W et al (2009) Automatic player detection, labeling and tracking in broadcast soccer video. Pattern Recog Lett 30(2):103–113

    Article  Google Scholar 

  • Martín R, Martínez JM (2014) A semi-supervised system for players detection and tracking in multi-camera soccer videos. Multimedia Tools Appl 73(3):1617–1642

    Article  Google Scholar 

  • Najafzadeh N, Fotouhi M, Kasaei S (2015) Multiple soccer players tracking. In: International symposium on artificial intelligence and signal processing

  • Pallavi V, Mukherjee J, Majumdar AK et al (2008) Graph-based multiplayer detection and tracking in broadcast soccer videos. IEEE Trans Multimedia 10(5):794–805

    Article  Google Scholar 

  • Seo Y, Choi S, Kim H et al (1997) Where are the ball and players? Soccer game analysis with color-based tracking and image mosaic. International conference on image analysis and processing. Springer, Berlin, Heidelberg, pp 196–203

    Chapter  Google Scholar 

  • Sullivan J, Carlsson S (2006) Tracking and labelling of interacting multiple targets. European conference on computer vision. Springer, Berlin, Heidelberg, pp 619–632

    Google Scholar 

  • Sullivan J, Nillius P, Carlsson S (2009) Multi-target tracking on a large scale: experiences from football player tracking. In: Proceedings of the IEEE ICRA 2009 workshop on people detection and tracking

  • Svensson D (2010) Target tracking in complex scenarios. Chalmers University of Technology, Goteborg

    Google Scholar 

  • Taki T, Hasegawa J, Fukumura T (1996) Development of motion analysis system for quantitative evaluation of teamwork in soccer games. In: Proceedings of 3rd IEEE international conference on image processing, vol 3. IEEE, pp 815–818.

  • Tong X, Liu J, Wang T et al (2011) Automatic player labeling, tracking and field registration and trajectory mapping in broadcast soccer video. ACM Trans Intell Syst Technol (TIST) 2(2):15

    Google Scholar 

  • Xu M, Orwell J, Jones GA (2004) Tracking football players with multiple cameras. In: International conference on image processing. IEEE

  • Yoon HS (2002) A soccer image sequence mosaicking and analysis method using line and advertisement board detection. ETRI J 24(6):443–454

    Article  Google Scholar 

Download references

Funding

The paper did not receive any financial support.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Xin He.

Ethics declarations

Conflict of interest

The author has no conflicts of interest to this work publication.

Ethical approval

My paper does not deal with any ethical problems.

Informed consent

I have informed consent to the publication of my work.

Additional information

Communicated by Tiancheng Yang.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

He, X. Application of deep learning in video target tracking of soccer players. Soft Comput 26, 10971–10979 (2022). https://doi.org/10.1007/s00500-022-07295-2

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-022-07295-2

Keywords

Navigation