Using Scripts for Affective Content Retrieval

  • Min Xu
  • Xiangjian He
  • Jesse S. Jin
  • Yu Peng
  • Changsheng Xu
  • Wen Guo
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6298)


Movie affective content analysis attracts increasing research efforts since affective content not only affect users attentions but also locate movie highlights. However, affective content retrieval is still a challenging task due to the limitation of affective features in movies. Scripts provide direct access to the movie content and represent affective aspects of the movie. In this paper, we utilize scripts as an important clue to retrieve video affective content. The proposed approach includes two main steps. Firstly, affective script partitions are extracted by detecting emotional words. Secondly, affective partitions are validated by using visual and auditory features. The results are encouraging and compared with the manually labelled ground truth.


Support Vector Machine Emotional Word Video Segment Emotion Category Video Shot 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kang, H.B.: Affective content detection using hmms. In: Proc. of ACM International Conference on Multimedia, pp. 259–262 (2003)Google Scholar
  2. 2.
    Hanjalic, A., Xu, L.Q.: Affective video content representation and modeling. IEEE Transaction on Multimedia 7, 143–154 (2005)CrossRefGoogle Scholar
  3. 3.
    Wang, H.L., Cheong, L.F.: Affective understanding in film. IEEE Transactions on Circuits and Systems for Video Technology 16, 689–704 (2006)CrossRefGoogle Scholar
  4. 4.
    Rasheed, Z., Sheikh, Y., Shah, M.: On the use of computable features for film classification. IEEE Transactions on Circuits and Systems for Video Technology 15, 52–64 (2005)CrossRefGoogle Scholar
  5. 5.
    Xu, M., Jin, J.S., Luo, S., Duan, L.: Hierarchical movie affective content analysis based on arousal and valence features. In: Proc. of ACM International Conference on Multimedia, pp. 677–680 (2008)Google Scholar
  6. 6.
    Zhang, S., Tian, Q., Huang, Q., Gao, W., Li, S.: Utilizing affective analysis for efficient movie browsing. In: Proc. of IEEE International Conference on Image Processing, ICIP (2009)Google Scholar
  7. 7.
    Soleymani, M., Kierkels, J.J.M., Chanel, G., Pun, T.: A bayesian framework for video affective representation. In: Proc. of the International Conference on Affective Computing and Intelligent Interaction (2009)Google Scholar
  8. 8.
    Jeon, J., Lavrenko, V., Manmatha, R.: Automatic image annotation and retrieval using cross-media relevance models. In: Proc. of International ACM SIGIR Conference on Research and Development in Informaion Retrieval, pp. 119–126 (2003)Google Scholar
  9. 9.
    Xu, C., Zhang, Y., Zhu, G., Rui, Y., Lu, H., Huang, Q.: Using webcast text for semantic event detection in broadcast sports video. IEEE Transactions on Multimedia 10, 1342–1355 (2008)CrossRefGoogle Scholar
  10. 10.
    Hanjalic, A.: Shot-boundary detection: unravelled and resolved. IEEE Transactions on Circuits and Systems for Video Technology 12(2), 90–105 (2002)CrossRefGoogle Scholar
  11. 11.
    Berry, M.W., Dumais, S.T., O’Brien, G.W.: Using linear algebra for intelligent information retrieval. SIAM Review 37, 301–328 (1995)CrossRefMathSciNetGoogle Scholar
  12. 12.
    Porter, M.F.: An algorithm for suffix stripping. Program 14(3), 130–137 (1980)Google Scholar
  13. 13.
    Berry, M.W., Drmavc, Z., Jessup, E.R.: Matrices, vector spaces, and information retrieval. SIAM Review 41, 335–362 (1999)zbMATHCrossRefMathSciNetGoogle Scholar
  14. 14.
    Drummond, T.: Vocabulary of Emotions,
  15. 15.
    Steve: Feeling Words: Words Describing Feelings,
  16. 16.
    Kovecses, Z.: Metaphor and Emotion Language, Culture, and Body in Human Feeling. Cambridge University Press, Cambridge (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Min Xu
    • 1
  • Xiangjian He
    • 1
  • Jesse S. Jin
    • 2
  • Yu Peng
    • 2
  • Changsheng Xu
    • 3
  • Wen Guo
    • 3
  1. 1.Faculty of Engineering and Information TechnologyUniversity of TechnologySydneyAustralia
  2. 2.School of Design, Communication and ITUniversity of NewcastleAustralia
  3. 3.National Lab of Pattern Recognition, Institute of AutomationChinese Academy of Sciences 

Personalised recommendations