Multimedia Tools and Applications

, Volume 69, Issue 2, pp 383–396 | Cite as

VideoSkip: event detection in social web videos with an implicit user heuristic

  • Chrysoula Gkonela
  • Konstantinos Chorianopoulos


In this paper, we present a user-based event detection method for social web videos. Previous research in event detection has focused on content-based techniques, such as pattern recognition algorithms that attempt to understand the contents of a video. There are few user-centric approaches that have considered either search keywords, or external data such as comments, tags, and annotations. Moreover, some of the user-centric approaches imposed an extra effort to the users in order to capture required information. In this research, we are describing a method for the analysis of implicit users’ interactions with a web video player, such as pause, play, and thirty-seconds skip or rewind. The results of our experiments indicated that even the simple user heuristic of local maxima might effectively detect the same video-events, as indicated manually. Notably, the proposed technique was more accurate in the detection of events that have a short duration, because those events motivated increased user interaction in video hot-spots. The findings of this research provide evidence that we might be able to infer semantics about a piece of unstructured data just from the way people actually use it.


Video Event detection Semantics Web User-based Experiment 



We are thankful to Ioannis Leftheriotis for his work on early system prototypes and to the participants of the user study.


  1. 1.
    Aisopos F, Papadakis G and Varvarigou T (2011) Sentiment analysis of social media content using N-Gram graphs. In Proceedings of the 3rd ACM SIGMM international workshop on Social media (WSM ’11). ACM, New York, NY, USA, 9–14Google Scholar
  2. 2.
    Cha S, Kwak M, Rodriguez H, Ahn P and Moon Y (2007) I tube, you tube, everybody tubes: analyzing the world’s largest user generated content video system. Proceedings of the 7th ACM SIGCOMM Conference on internet measurement. ACM, San Diego, California, USA, New York, NY, pp 1–14Google Scholar
  3. 3.
    Chen L, Chen G, Xu C, March J and Benford S (2008) EmoPlayer: a media player for video clips with affective annotations. Int Comp pp 17–28Google Scholar
  4. 4.
    Crockford C and Agius H (2006) An empirical investigation into user navigation of digital video using the VCR-like control set. Int J Hum Comput Stud pp 340–355Google Scholar
  5. 5.
    Doulamis AD, Doulamis ND (2004) Optimal content-based video decomposition for interactive video navigation. IEEE Trans Circ Syst Video Tech 14(6):757–775CrossRefGoogle Scholar
  6. 6.
    Doulamis DA, Gonzàlez J (2010) First ACM international workshop on analysis and retrieval of tracked events and motion in imagery streams (ARTEMI. ACM Multimedia 2010:1749–1750Google Scholar
  7. 7.
    Drucker S, Glatzer A and Mar SD, Wong C (2002) SmartSkip: consumer level browsing and skipping of digital video content. In Proceedings of the SIGCHI Conference on human factors in computing systems: changing our world, changing ourselves, Minneapolis, Minnesota, USA, pp 219–226Google Scholar
  8. 8.
    Girgensohn A, Boreczky J, Wilcox L (2001) Keyframe-based user interfaces for digital video. Computer 34:61–67CrossRefGoogle Scholar
  9. 9.
    He L, Sanocki E, Gupta A and Grudin J (1999) Auto-summarization of audio-video presentations. Proceedings of the seventh ACM international conference on Multimedia (Part 1) - MULTIMEDIA ’99, ACM Press, New York, New York, USA, pp 489–498Google Scholar
  10. 10.
    Hjelsvold R, Vdaygiri S and Léauté Y (2001) Web-based personalization and management of interactive video. Proceedings of the tenth international conference on World Wide Web - WWW ’01, pp 129–139Google Scholar
  11. 11.
    Kelly D (2009) Methods for evaluating interactive information retrieval systems with users, foundations and trends in information retrieval Vol. 3: No 1–2, pp 1–224Google Scholar
  12. 12.
    Kim J, Kim H, Park K (2006) Towards optimal navigation through video content on interactive TV. Inter Comp 18:723–746Google Scholar
  13. 13.
    Leftheriotis I, Gkonela C and Chorianopoulos K (2010) Efficient video indexing on the web: a system that leverages user interactions with a video player. In Proceedings of the 2nd International Conference on User-Centric Media (UCMEDIA)Google Scholar
  14. 14.
    Li FC, Gupta A, Sanocki E, He L-W and Rui Y (2000) Browsing digital video. Proceedings of the SIGCHI conference on human factors in computing systems - CHI ’00, vol. 2, pp 169–176Google Scholar
  15. 15.
    Ma Y-F and Zhang H-J (2005) Video snapshot: a bird view of video sequence. 11th International Multimedia Modelling Conference, IEEE, pp 94–101Google Scholar
  16. 16.
    Mitra S, Agrawal M, Yadav A, Carlsson N, Eager D and Mahanti A (2011) Characterizing web-based video sharing workloads. ACM Trans. Web 5, 2, Article 8 (May 2011)Google Scholar
  17. 17.
    Ntalianis KS, Doulamis AD, Sapatsoulis NT and Doulamis N (2010) Human action annotation, modeling and analysis based on implicit user interaction. Multimedia Tools Appl. 50, 1 (October 2010), 199–225Google Scholar
  18. 18.
    Peng W-T, Chu W-T, Chang C-H, Chou C-N, Huang W-J, Chang W-Y, Hung Y-P (2011) Editing by viewing: automatic home video summarization by viewing behavior analysis. IEEE Trans Multimed 13(3):539–550CrossRefGoogle Scholar
  19. 19.
    Shamma DA, Shaw R, Shafton PL and Liu Y (2007) Watch what I watch: using community activity to understand content. Proceedings of the international workshop on Workshop on multimedia information retrieval - MIR ’07, N. ACM, ACM Press, New York, ed., Augsburg, Bavaria, Germany, p 275Google Scholar
  20. 20.
    Shen X, Tan B and Zhai CX (2005) Implicit user modeling for personalized search. In Proceedings of the 14th ACM international conference on Information and knowledge management (CIKM ’05). ACM, New York, NY, USA, 824–831. SOCIOS EU project:
  21. 21.
    Syeda-Mahmood T and Ponceleon D (2001) Learning video browsing behavior and its application in the generation of video previews. Proceedings of the ninth ACM international conference on Multimedia - MULTIMEDIA ’01, ACM Press, New York, New York, USA, p 119Google Scholar
  22. 22.
    Takahashi Y, Nitta N and Babaguchi N (2005) Video summarization for large sports video archives. In Proceedings of the 13th Annual ACM international Conference on Multimedia, Hilton, Singapore, ACM, New York, pp 820–828Google Scholar
  23. 23.
    Yu B, Ma W-Y, Nahrstedt K and Zhang H-J (2003) Video summarization based on user log enhanced link analysis. Proceedings of the eleventh ACM international conference on Multimedia - MULTIMEDIA ’03, ACM Press, New York, New York, USA, p 382Google Scholar
  24. 24.
    Zhang D, Guo B, Yu Z (2011) The emergence of social and community intelligence. Computer 44(7):21–28CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2012

Authors and Affiliations

  • Chrysoula Gkonela
    • 1
  • Konstantinos Chorianopoulos
    • 1
  1. 1.Department of InformaticsIonian UniversityCorfuGreece

Personalised recommendations