Video Search by Impression Extracted from Social Annotation

  • Satoshi Nakamura
  • Katsumi Tanaka
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5802)


This paper proposes a novel indexing and ranking method for video clips on video sharing Web sites that overcomes some of the problems with conventional systems. These problems include the difficulty of finding target video clips by the emotional impression they make, such as level of happiness, level of sadness, and so on because text summaries of video clips on video sharing Web sites usually do not contain such information. Our system extracts this type of information from comments on the video clips and generates an impression index for searching and ranking. In this work, we present analytical studies of video sharing Web site. Then, we propose an impression ranking method and show the usefulness of this method on the experimental test. In addition, we describe the future direction of this work.


Video IR ranking indexing impression social annotation video sharing Web sites 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Akutsu, A., Tonomura, Y., Hashimoto, H., Ohba, Y.: Video Indexing Using Motion Vectors. In: SPIE Proc. VCIP 1992, pp. 522–530 (1992)Google Scholar
  2. 2.
    Nakagawa, A., Tanaka, Y.: Automatic Video Indexing and Full-video Search for Object Appearances. IPSJ 33(4), 543–550Google Scholar
  3. 3.
    Saur, D., Tan, Y.P., Kulkarni, S., Ramadge, P.: Automated Analysis and Annotation of Basketball Video, Databases V. SPIE, vol. 3022, pp. 167–187Google Scholar
  4. 4.
    Miyamori, H.: Automatic Annotation of Tennis Action for Content-based Retrieval by Integrated Audio and Visual information. In: Bakker, E.M., Lew, M., Huang, T.S., Sebe, N., Zhou, X.S. (eds.) CIVR 2003. LNCS, vol. 2728, pp. 331–341. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  5. 5.
    Miyamori, H., Nakamura, S., Tanaka, K.: Generation of Views of TV Content Using TV Viewers’ Perspectives Expressed in Live Chats on the Web. In: Proceedings of ACM Multimedia 2005, November 2005, pp. 853–861 (2005)Google Scholar
  6. 6.
    Uehara, H., Yoshida, K.: Annotating TV Drama based on Viewer Dialogue - Analysis of Viewers’ Attention Generated on an Internet Bulletin Board. In: 2005 Symposium on Applications and the Internet (SAINT 2005), pp. 334–340 (2005)Google Scholar
  7. 7.
    Laptev, I., Perez, P.: Retrieving actions in movies. In: Proc. of ICCV 2007, October 2007, pp. 1–8 (2007)Google Scholar
  8. 8.
    Smith, M., Kanabe, T.: Video Skimming and Characterization through the Combination of Image and Language Understanding Techniques. In: Bakker, E.M., Lew, M., Huang, T.S., Sebe, N., Zhou, X.S. (eds.) CIVR 2003. LNCS, vol. 2728, pp. 331–341. Springer, Heidelberg (2003)Google Scholar
  9. 9.
    Dimitrova, N., Abdel Mottaleb, M.: Content-based Video Retrieval by Example Video Clip. In: Proc. of SPIE, vol. 3022, pp. 59–70 (1997)Google Scholar
  10. 10.
    Boydell, O., Smyth, B.: From social bookmarking to social summarization: an experiment in community-based summary generation. In: Proceedings of the 12th international conference on Intelligent User Interfaces, pp. 42–51Google Scholar
  11. 11.
    Heymann, P., Koutrika, G., Garcia-Molina, H.: Can social bookmarking improve web search? In: Proceedings of the international conference on Web search and Web Data Mining, pp. 195–206Google Scholar
  12. 12.
    Intille, S., Bobick, A.: Closed-world Tracking. In: Proceedings of the Fifth International Conference on Computer Vision, pp. 672–678Google Scholar
  13. 13.
    Sivic, J., Everingham, M., Zisserman, A.: Person spotting: video shot retrieval for face sets. In: Leow, W.-K., Lew, M., Chua, T.-S., Ma, W.-Y., Chaisorn, L., Bakker, E.M. (eds.) CIVR 2005. LNCS, vol. 3568, pp. 226–236. Springer, Heidelberg (2005)Google Scholar
  14. 14.
    Nakamura, Y., Kanabe, T.: Semantic Analysis for Video Contents Extraction Spotting by Association in News Video. In: ACM Multimedia, pp. 393–401Google Scholar
  15. 15.
    Yanbe, Y., Jatowt, A., Nakamura, S., Tanaka, K.: Can Social Bookmarking Enhance Search in the Web? In: Proc. of. JCDL 2007, pp. 107–116 (2007)Google Scholar
  16. 16.
    Nakamura, S., Shimizu, M., Tanaka, K.: Can Social Annotation Support Users in Evaluating the Trustworthiness of Video Clips? In: Proc. of WICOW 2008 (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Satoshi Nakamura
    • 1
  • Katsumi Tanaka
    • 1
  1. 1.Graduate School of Kyoto University, Yoshida-Honmachi, SakyoKyotoJapan

Personalised recommendations