Community Discovery from Movie and Its Application to Poster Generation
Discovering roles and their relationship is critical in movie content analysis. However, most conventional approaches ignore the correlations among roles or require rich metadata such as casts and scripts, which makes them not practical when little metadata is available, especially in the scenarios of IPTV and VOD systems. To solve this problem, we propose a new method to discover key roles and their relationship by treating a movie as a small community. We first segment a movie into a hierarchical structure (including scene, shot, and key-frame), and perform face detection and grouping on the detected key-frames. Based on such information, we then create a community by exploiting the key roles and their correlations in this movie. The discovered community provides a wide variety of applications. In particular, we present in this paper the automatic generation of video poster (with four different visualizations) based on the community, as well as preliminary experimental results.
KeywordsContent-based movie analysis social network video poster
Unable to display preview. Download preview PDF.
- 2.Satoh, S., Kanade, T.: Name-It: Association of face and name in video. In: Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, pp. 368–373 (1997)Google Scholar
- 3.Everingham, M., Sivic, J., Zisserman, A.: Hello! My name is Buffy—automatic naming of characters in TV video. In: Proceedings of the British Machine Vision Conference (2006)Google Scholar
- 4.Liu, C., Jiang, S., Huang, Q.: Naming faces in broadcast news video by image google. In: Proceeding of ACM International Conference on Multimedia, Vancouver, Canada, pp. 717–720 (2008)Google Scholar
- 6.Weng, C.Y., Chu, W.T., Wu, J.L.: RoleNet: treat a movie as a small society. In: Proceedings of the international Workshop on Multimedia Information Retrieval, Augsburg, Bavaria, Germany, pp. 51–60 (2007)Google Scholar
- 7.AT&T: U-verse tv, http://www.att.com/u-verse/
- 9.Cao, Z., Yin, Q., Tang, X., Sun, J.: Face recognition with learning-based descriptor. In: Proceedings of IEEE International Conference on Computer Vision and Pattern Recognition (2010)Google Scholar
- 11.Scott, J.P.: Social Network Analysis: A Handbook. SAGE Publications (2000)Google Scholar
- 12.Frascara, J.: Communication design: principles, methods, and practice. Allworth Communications, Inc. (2004)Google Scholar
- 14.Wang, Y., Mei, T., Wang, J., Hua, X.S.: Dynamic video collage. In: International Conference on MultiMedia Modeling, Chongqing, China, pp. 793–795 (2010)Google Scholar
- 15.Wang, J., Sun, J., Quan, L., Tang, X., Shum, H.Y.: Picture collage. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 347–354 (2006)Google Scholar
- 16.Skolos, N., Wedell, T.: Type, Image, Message: A Graphic Design Layout Workshop. Rockport Publishers (2006)Google Scholar
- 17.Liu, T., Sun, J., Zheng, N.N., Tang, X., Shum, H.Y.: Learning to detect a salient object. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)Google Scholar