psDirector: An Automatic Director for Watching View Generation from Panoramic Soccer Video

  • Chunyang Li
  • Caiyan JiaEmail author
  • Zhineng Chen
  • Xiaoyan Gu
  • Hongyun Bao
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11296)


Watching TV or Internet video is the most common way for people perceiving soccer matches. However, it is immature to generalize this mean to amateur soccer, as it is expensive to direct a match professionally by human. As an alternative, using multiple cameras to generate a panoramic video can faithfully record the match, but with bad watching experience. In this work, we develop a psDirector system to address this dilemma. It takes the panoramic soccer video as input and outputs a corresponding watching view counterpart, which continuously focuses on attractive playing areas that people are interested in. The task is somewhat unique and we propose a novel pipeline to implement it. It first extracts several soccer-related semantics, i.e., soccer field, attractive ROI, distribution of players, attacking direction. Then, the semantics are reasonably utilized to produce the outputted video, where important match content, camera action as well as their consistency along the time axis are carefully considered to ensure the video quality. Experiments on school soccer videos show rationality of the proposed pipeline. Meanwhile, psDirector generates video with better watching experience than an existing commercial tool.


Panoramic video Video directing Amateur soccer Deep learning 



This research is supported by National Nature Science Foundation of China (Grant No. 61772526, 61876016).


  1. 1.
    Bertini, M., Del Bimbo, A., Nunziati, W.: Soccer videos highlight prediction and annotation in real time. In: Roli, F., Vitulano, S. (eds.) ICIAP 2005. LNCS, vol. 3617, pp. 637–644. Springer, Heidelberg (2005). Scholar
  2. 2.
    Ekin, A., Tekalp, A.M., Mehrotra, R.: Automatic soccer video analysis and summarization. IEEE Trans. Image Process. 12(7), 796–807 (2003). A Publication of the IEEE Signal Processing SocietyCrossRefGoogle Scholar
  3. 3.
    Gong, Y., Sin, L.T., Chuan, C.H., Zhang, H., Sakauchi, M.: Automatic parsing of TV soccer programs. In: International Conference on Multimedia Computing and Systems, p. 167 (2002)Google Scholar
  4. 4.
    Intille, S.S., Aaron, A., Bobick, F.: Tracking using a local closed-world assumption: tracking in the football domain. In: Proceedings of the SPIE Storage and Retrieval for Image and Video Databases (1994)Google Scholar
  5. 5.
    Khatoonabadi, S.H., Rahmati, M.: Automatic soccer players tracking in goal scenes by camera motion elimination. Image Vis. Comput. 27(4), 469–479 (2009)CrossRefGoogle Scholar
  6. 6.
    Redmon, J., Farhadi, A.: Yolov3: an incremental improvement (2018)Google Scholar
  7. 7.
    Seo, Y., Choi, S., Kim, H., Hong, K.-S.: Where are the ball and players? Soccer game analysis with color-based tracking and image mosaick. In: Del Bimbo, A. (ed.) ICIAP 1997. LNCS, vol. 1311, pp. 196–203. Springer, Heidelberg (1997). Scholar
  8. 8.
    Tong, X.F., Lu, H.Q., Liu, Q.S.: An effective and fast soccer ball detection and tracking method. In: International Conference on Pattern Recognition, vol. 4, pp. 795–798 (2004)Google Scholar
  9. 9.
    Wang, Z., Yu, J., He, Y.: Soccer video event annotation by synchronization of attack-defense clips and match reports with coarse-grained time information. IEEE Trans. Circuits Syst. Video Technol. 27(5), 1104–1117 (2017)CrossRefGoogle Scholar
  10. 10.
    Wang, Z., Yu, J., He, Y., Guan, T.: Affection arousal based highlight extraction for soccer video. Multimed. Tools Appl. 73(1), 519–546 (2014)CrossRefGoogle Scholar
  11. 11.
    Yao, A., Uebersax, D., Gall, J., Gool, L.V.: Tracking people in broadcast sports. In: DAGM Conference on Pattern Recognition, pp. 151–161 (2010)Google Scholar
  12. 12.
    Zawbaa, H.M., El-Bendary, N., Hassanien, A.E., Kim, T.: Machine learning-based soccer video summarization system. In: Kim, T., Adeli, H., Grosky, W.I., Pissinou, N., Shih, T.K., Rothwell, E.J., Kang, B.-H., Shin, S.-J. (eds.) MulGraB 2011. CCIS, vol. 263, pp. 19–28. Springer, Heidelberg (2011). Scholar
  13. 13.
    Zhao, Z., Jiang, S., Huang, Q., Ye, Q.: Highlight summarization in soccer video based on goalmouth detection. In: Asia (2006)Google Scholar
  14. 14.
    Zhao, Z., Jiang, S., Huang, Q., Zhu, G.: Highlight summarization in sports video based on replay detection. In: IEEE International Conference on Multimedia & Expo, pp. 1613–1616 (2006)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  • Chunyang Li
    • 1
    • 2
  • Caiyan Jia
    • 1
    Email author
  • Zhineng Chen
    • 2
  • Xiaoyan Gu
    • 3
  • Hongyun Bao
    • 2
  1. 1.School of Computer and Information TechnologyBeijing Jiaotong UniversityBeijingChina
  2. 2.Institute of AutomationChinese Academy of SciencesBeijingChina
  3. 3.Institute of Information EngineeringChinese Academy of SciencesBeijingChina

Personalised recommendations