psDirector: An Automatic Director for Watching View Generation from Panoramic Soccer Video
Watching TV or Internet video is the most common way for people perceiving soccer matches. However, it is immature to generalize this mean to amateur soccer, as it is expensive to direct a match professionally by human. As an alternative, using multiple cameras to generate a panoramic video can faithfully record the match, but with bad watching experience. In this work, we develop a psDirector system to address this dilemma. It takes the panoramic soccer video as input and outputs a corresponding watching view counterpart, which continuously focuses on attractive playing areas that people are interested in. The task is somewhat unique and we propose a novel pipeline to implement it. It first extracts several soccer-related semantics, i.e., soccer field, attractive ROI, distribution of players, attacking direction. Then, the semantics are reasonably utilized to produce the outputted video, where important match content, camera action as well as their consistency along the time axis are carefully considered to ensure the video quality. Experiments on school soccer videos show rationality of the proposed pipeline. Meanwhile, psDirector generates video with better watching experience than an existing commercial tool.
KeywordsPanoramic video Video directing Amateur soccer Deep learning
This research is supported by National Nature Science Foundation of China (Grant No. 61772526, 61876016).
- 3.Gong, Y., Sin, L.T., Chuan, C.H., Zhang, H., Sakauchi, M.: Automatic parsing of TV soccer programs. In: International Conference on Multimedia Computing and Systems, p. 167 (2002)Google Scholar
- 4.Intille, S.S., Aaron, A., Bobick, F.: Tracking using a local closed-world assumption: tracking in the football domain. In: Proceedings of the SPIE Storage and Retrieval for Image and Video Databases (1994)Google Scholar
- 6.Redmon, J., Farhadi, A.: Yolov3: an incremental improvement (2018)Google Scholar
- 8.Tong, X.F., Lu, H.Q., Liu, Q.S.: An effective and fast soccer ball detection and tracking method. In: International Conference on Pattern Recognition, vol. 4, pp. 795–798 (2004)Google Scholar
- 11.Yao, A., Uebersax, D., Gall, J., Gool, L.V.: Tracking people in broadcast sports. In: DAGM Conference on Pattern Recognition, pp. 151–161 (2010)Google Scholar
- 12.Zawbaa, H.M., El-Bendary, N., Hassanien, A.E., Kim, T.: Machine learning-based soccer video summarization system. In: Kim, T., Adeli, H., Grosky, W.I., Pissinou, N., Shih, T.K., Rothwell, E.J., Kang, B.-H., Shin, S.-J. (eds.) MulGraB 2011. CCIS, vol. 263, pp. 19–28. Springer, Heidelberg (2011). https://doi.org/10.1007/978-3-642-27186-1_3CrossRefGoogle Scholar
- 13.Zhao, Z., Jiang, S., Huang, Q., Ye, Q.: Highlight summarization in soccer video based on goalmouth detection. In: Asia (2006)Google Scholar
- 14.Zhao, Z., Jiang, S., Huang, Q., Zhu, G.: Highlight summarization in sports video based on replay detection. In: IEEE International Conference on Multimedia & Expo, pp. 1613–1616 (2006)Google Scholar