Feasibility of Personalized Affective Video Summaries

  • Arthur G. Money
  • Harry Agius
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4868)

Abstract

Video summaries present the content of a video stream concisely while trying to preserve its original, essential message. By means of a feasibility study, this article investigates whether users’ physiological responses to video content can adequately serve as a basis for the creation of affective video summaries that are personalized for an individual user.

Keywords

Video summaries multimedia affect emotion physiological responses personalization 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Zhu, X., Wu, X., Fan, J., Elmagarmid, A.K., Aref, W.G.: Exploring Video Content Structure for Hierarchical Summarization. Multimedia Systems 10(2), 98–115 (2004)CrossRefGoogle Scholar
  2. 2.
    Li, Z., Schuster, G.M., Katsaggelos, A.K.: MINMAX Optimal Video Summarization. IEEE Transactions on Circuits and Systems for Video Technology 15(10), 1245–1256 (2005)CrossRefGoogle Scholar
  3. 3.
    Money, A.G., Agius, H.: Video Summarisation: A Conceptual Framework and Survey of the State of the Art. Journal of Visual Communication and Image Representation 19(2), 121–143 (2008)CrossRefGoogle Scholar
  4. 4.
    Everingham, M., Sivic, J., Zisserman, A.: Hello! My name is.. Buffy. In: 17th British Machine Vision Conference, vol. III, pp. 899–908 (2006), http://www.macs.hw.ac.uk/bmvc2006/BMVC06%20Proceedings%20III.pdf
  5. 5.
    Sivic, J., Schaffalitzky, F., Zisserman, A.: Object Level Grouping for Video Shots. International Journal of Computer Vision 67(2), 189–210 (2006)CrossRefGoogle Scholar
  6. 6.
    Wang, Y., Liu, Z., Huang, J.: Multimedia Content Analysis: Using Both Audio and Visual Clues. IEEE Signal Processing Magazine 17(6), 12–36 (2000)CrossRefGoogle Scholar
  7. 7.
    Shao, X., Xu, C., Maddage, N.C., Tian, Q., Kankanhalli, M.S., Jin, J.S.: Automatic Summarization of Music Videos. ACM Transactions on Multimedia Computing, Communications, and Applications 2(2), 127–148 (2006)CrossRefGoogle Scholar
  8. 8.
    Hanjalic, A.: Adaptive Extraction of Highlights from a Sport Video Based on Excitement Modeling. IEEE Transactions on Multimedia 7(6), 1114–1122 (2005)CrossRefGoogle Scholar
  9. 9.
    Hanjalic, A., Xu, L.: User-Oriented Affective Video Content Analysis. In: IEEE Workshop on Content-Based Access of Image and Video Libraries, pp. 50–57. IEEE Computer Society, Los Alamitos (2001)CrossRefGoogle Scholar
  10. 10.
    de Silva, G., Yamasaki, T., Aizawa, K.: Evaluation of Video Summarization for a Large Number of Cameras in Ubiquitous Home. In: 13th Annual ACM International Conference on Multimedia, pp. 820–828. ACM Press, New York (2005)CrossRefGoogle Scholar
  11. 11.
    Jaimes, A., Echigo, T., Teraguchi, M., Satoh, F.: Learning Personalized Video Highlights from Detailed MPEG-7 Metadata. In: IEEE International Conference on Image Processing, vol. I, pp. 133–136. IEEE, Piscataway (2002)Google Scholar
  12. 12.
    Takahashi, Y., Nitta, N., Babaguchi, N.: Video Summarization for Large Sports Video Archives. In: IEEE International Conference on Multimedia and Expo., pp. 1170–1173. IEEE, Piscataway (2005)CrossRefGoogle Scholar
  13. 13.
    Aizawa, K., Tancharoen, D., Kawasaki, S., Yamasaki, T.: Efficient Retrieval of Life Log Based on Context to Content. In: 1st ACM Workshop on Continuous Archival and Retrieval of Personal Experiences, pp. 22–31. ACM Press, New York (2004)CrossRefGoogle Scholar
  14. 14.
    Rui, Y., Zhou, S.X., Huang, T.S.: Efficient Access to Video Content in a Unified Framework. In: IEEE International Conference on Multimedia Computing and Systems, vol. 2, pp. 735–740. IEEE Computer Society, Los Alamitos (1999)Google Scholar
  15. 15.
    Zimmerman, J., Dimitrova, N., Agnihotri, L., Janevski, A., Nikolovska, L.: Interface Design for MyInfo: A Personal News Demonstrator Combining Web and TV Content. In: IFIP TC13 International Conference on Human-Computer Interaction (INTERACT), pp. 41–48. IOS Press, Amsterdam (2003)Google Scholar
  16. 16.
    Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-Based Image Retrieval at the End of the Early Years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12), 1349–1380 (2000)CrossRefGoogle Scholar
  17. 17.
    Simon, H.A.: Comments. In: Sydnor Clark, M., Fiske, S.T. (eds.) Affect and Cognition, pp. 333–342. Erlbaum, Hillsdale (1982)Google Scholar
  18. 18.
    Gomez, P., Danuser, B.: Affective and Physiological Responses to Environmental Noises and Music. International Journal of Psychophysiology 53(2), 91–103 (2004)CrossRefGoogle Scholar
  19. 19.
    Cacioppo, J.T., Berntson, G.G., Klein, D.J., Poehlmann, K.M.: The Psychophysiology of Emotion Across the Lifespan. Annual Review of Gerontology and Geriatrics 17, 27–74 (1997)Google Scholar
  20. 20.
    Carlson, N.R.: Psychology of Behaviour. Allyn and Bacon, Boston (2001)Google Scholar
  21. 21.
    Philippot, P., Chapelle, C., Blairy, S.: Respiratory Feedback in the Generation of Emotion. Cognition & Emotion 16(5), 605–627 (2002)CrossRefGoogle Scholar
  22. 22.
    Brown, W.A., Corriveau, D.P., Monti, P.M.: Anger Arousal by a Motion Picture: A Methodological Note. American Journal of Psychiatry 134, 930–931 (1977)Google Scholar
  23. 23.
    Detenber, B.H., Simons, R.F., Bennett, G.: Roll ’Em!: The Effects of Picture Motion on Emotional Responses. Journal of Broadcasting & Electronic Media 42(1), 113–127 (1998)Google Scholar
  24. 24.
    Lang, A., Bolls, P., Potter, R., Kawahara, K.: The effects of Production Pacing and Arousing Content on the Information Processing of Television Messages. Journal of Broadcasting and Electronic Media 43(4), 451–476 (1999)Google Scholar
  25. 25.
    Agius, H., Crockford, C., Money, A.G.: Emotion and Multimedia Content. In: Furht, B. (ed.) Encyclopedia of Multimedia, pp. 222–223. Springer, New York (2006)Google Scholar
  26. 26.
    McIntyre, G., Göcke, R.: The Composite Sensing of Affect. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)Google Scholar
  27. 27.
    van Reekum, C., Johnstone, T., Banse, R., Etter, A., Wehrle, T., Scherer, K.R.: Psychophysiological Responses to Appraisal Dimensions in a Computer Game. Cognition and Emotion 18(5), 663–688 (2004)CrossRefGoogle Scholar
  28. 28.
    Loviscach, J., Oswald, D.: In the Mood: Tagging Music with Affects. In: Peter, C., Beale, R. (eds.) Affect and Emotion in Human-Computer Interaction. LNCS, vol. 4868. Springer, Heidelberg (2008)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Arthur G. Money
    • 1
  • Harry Agius
    • 1
  1. 1.School of Information Systems, Computing and MathematicsBrunel UniversitySt John’s, UxbridgeUK

Personalised recommendations