Skip to main content
SpringerLink
Log in

Automatic player detection and identification for sports entertainment applications

  • Industrial and Commercial Application
  • Published:
Pattern Analysis and Applications Aims and scope Submit manuscript

Abstract

In this paper, we develop an augmented reality sports broadcasting application for automatic detection, recognition of players during play, followed by display of personal information of players. The proposed application can be divided into four major steps. In first step, each player in the image is detected. In the second step, a face detection algorithm detects face of each player. In third step, we use a face recognition algorithm to match the faces of players with a database of players’ faces which also stores personal information of each player. In step four, personal information of each player is retrieved based on the face matching result. This application can be used to show the viewers’ information about players such as name of the player, sports record, age, highest score, and country of belonging. We develop this system for baseball game, however, it can be deployed in any sports where the audience can take a live video or images using smart phones. For the task of player and subsequent face detection, we use AdaBoost algorithm with haar-like features for both feature selection and classification while player face recognition system uses AdaBoost algorithm with linear discriminant analysis for feature selection and nearest neighbor classifier for classification. Detailed experiments are performed using 412 diverse images taken using a digital camera during baseball match. These images contain players in different sizes, facial expressions, lighting conditions and pose. The player and face detection accuracy is high in all situations, however, the face recognition module requires detected players’ faces to be frontal or near frontal. In general, restricting the head rotation to ±30° gives a high accuracy of overall system

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Looser J, Grasset R, Billinghurst M (2007) A 3D flexible and tangible magic lens in augmented reality. In: Proceedings of IEEE and ACM international symposium on mixed and augmented reality (ISMAR 2007), pp 51–54. ISBN: 978-1-4244-1749-0

  2. Han J, Farin D (2007) A real-time augmented-reality system for sports broadcast video enhancement. In: MM’07, September 23–28, 2007, Augsburg, Bavaria, Germany

  3. Inamoto N, Saito H (2004) Free viewpoint video synthesis and presentation of sporting events for mixed reality entertainment. In: Proceedings of ACM ACE, vol 74, pp 42–50

  4. Liang D, Liu Y, Huang Q, Zhu Q, Jiang S, Zhang Z, Gao W (2005) Video2cartoon: generating 3D cartoon from broadcast soccer video. In: Proceedings of ACM multimedia, pp 217–218

  5. Yu X, Yan X, Chi T, Cheong L (2006) Inserting 3D projected virtual content into broadcast tennis video. In: Proceedings of ACM multimedia, pp 619–622

  6. Matsui K, Iwase M, Agata M, Tanaka T, Ohnishi N (1998) Soccer image sequence computed by a virtual camera. In: Proceedings of CVPR, pp 860–865

  7. Mahmood Z, Ali T, Khattak S (2012) Automatic player detection and recognition in images using AdaBoost. In: 9th international bhurban conference on applied sciences and technology (IBCAST). IEEE, pp 64–69

  8. Viola P, Jones MJ (2004) Robust real-time face detection. Int J Comput Vis 57:137–154

    Article  Google Scholar 

  9. Viola P, Jones M (2001) Rapid object detection using a boosted cascade of simple features. Comp Vision Pattern Recogn Conf 2001(1):511–518

    Google Scholar 

  10. Lang L, Gu W (2009) Study of face detection algorithm for real-time face detection system. In: 2nd international symposium on electronic commerce and security, pp 129–132

  11. Lu J, Plataniotis K, Venetsanopoulos A, Li S (2006) Ensemble-based discriminant learning with boosting for face recognition. IEEE Trans Neural Networks 17(1):166–178

    Article  Google Scholar 

  12. Shylaja SS, Balasubramanya KN, Natarajan S. Dimensionality reduction techniques for face recognition. Department of Information Science and Engineering, PEC Institute of Technology, India. http://www.intechopen.com

  13. Yu J, Tao D, Wang M (2012) Adaptive hypergraph learning and its application in image classification. IEEE Trans Image Process 21(7):3262–3272

    Article  MathSciNet  Google Scholar 

  14. Yu J, Liu D, Tao D (2011) Complex object correspondence construction in two-dimensional animation. IEEE Trans Image Process 20(11):3257–3269

    Article  MathSciNet  Google Scholar 

  15. Yu J, Wang M, Tao D (2012) Semisupervised multiview distance metric learning for cartoon synthesis. IEEE Trans Image Process 21(11):4636–4648

    Article  MathSciNet  Google Scholar 

  16. Yu J, Liu D, Tao D (2012) On combining multiple features for cartoon character retrieval and clip synthesis. IEEE Trans Syst Man Cybern 42(5):1413–1427

    Article  Google Scholar 

  17. Yu J et al (2013) Pairwise constraints based multiview features fusion for scene classification. Pattern Recogn 46(2):483–496

    Article  MATH  Google Scholar 

  18. Raudys SJ, Jain AK (1991) Small sample size effects in statistical pattern recognition: recommendations for practitioners. IEEE Trans Pattern Anal Mach Intell 13(3):252–264

    Article  Google Scholar 

  19. Freund Y, Schapire RE (1997) A decision-theoretic generalization of on-line learning and an application to boosting. J Comput Syst Sci 55(1):119–139

    Article  MATH  MathSciNet  Google Scholar 

  20. Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720

    Article  Google Scholar 

  21. Kirchberg KJ, Jesorsky O, Frischholz RW (2002) Genetic optimization for hausdorff-distance based face localization. In: Intl. workshop on biometric authentication, Denmark, pp 103–111

  22. Wright J, Yang AY, Ganesh A, Sastry SS (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31(2):210–227

    Article  Google Scholar 

  23. Yu J, Rui Y, Chen B (2014) Exploiting click constraints and multi-view features for image re-ranking. IEEE Trans Multimedia 16(1):159–168

    Article  Google Scholar 

  24. Mahmood Z, Ali T, Khattak S, Aslam M, Mehmood H (2013) A color image enhancement technique using multiscale rtetinex. In: 11th international conference on frontiers of information technology (FIT). IEEE, pp 119–124

Download references

Author information

Authors and Affiliations

  1. Electrical Engineering, North Dakota State University, Fargo, USA

    Zahid Mahmood

  2. Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Enschede, Netherlands

    Tauseef Ali

  3. Electrical Engineering Departmant, COMSATS IIT, Abbottabad, Pakistan

    Shahid Khattak

  4. Computer Engineering Laboratory, Faculty of Electrical Engineering Mathematics and Computer Science, Delft University of Technology, Delft, The Netherlands

    Laiq Hasan

  5. Department of Computer Systems Engineering, University of Engineering and Technology, Peshawar, Pakistan

    Laiq Hasan

  6. Department of Electrical and Computer Engineering, North Dakota State University, Fargo, USA

    Samee U. Khan

Authors
  1. Zahid Mahmood
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tauseef Ali
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Shahid Khattak
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Laiq Hasan
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Samee U. Khan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zahid Mahmood.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mahmood, Z., Ali, T., Khattak, S. et al. Automatic player detection and identification for sports entertainment applications. Pattern Anal Applic 18, 971–982 (2015). https://doi.org/10.1007/s10044-014-0416-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10044-014-0416-4

Keywords

Search

Navigation