Rich Internet Application for Semi-automatic Annotation of Semantic Shots on Keyframes

  • Elisabet Carcel
  • Manuel Martos
  • Xavier Giró-i-Nieto
  • Ferran Marqués
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7252)

Abstract

This paper describes a system developed for the semi- automatic annotation of keyframes in a broadcasting company. The tool aims at assisting archivists who traditionally label every keyframe manually by suggesting them an automatic annotation that they can intuitively edit and validate. The system is valid for any domain as it uses generic MPEG-7 visual descriptors and binary SVM classifiers. The classification engine has been tested on the multiclass problem of semantic shot detection, a type of metadata used in the company to index new content ingested in the system. The detection performance has been tested in two different domains: soccer and parliament. The core engine is accessed by a Rich Internet Application via a web service. The graphical user interface allows the edition of the suggested labels with an intuitive drag and drop mechanism between rows of thumbnails, each row representing a different semantic shot class. The system has been described as complete and easy to use by the professional archivists at the company.

Keywords

annotation RIA semantic shot classification MPEG-7 visual descriptors 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Wang, M., Hua, X.-S., Song, Y., Lai, W., Dai, L.-R., Wang, R.-H.: An Efficient Automatic Video Shot Size Annotation Scheme. In: Cham, T.-J., Cai, J., Dorai, C., Rajan, D., Chua, T.-S., Chia, L.-T. (eds.) MMM 2007, Part I. LNCS, vol. 4351, pp. 649–658. Springer, Heidelberg (2006), http://dx.doi.org/10.1007/978-3-540-69423-6_63 CrossRefGoogle Scholar
  2. 2.
    Duan, L., Xu, M., Xu, C.-S., Jin, J.S.: A unified framework for semantic shot classification of sports video. IEEE Trans. on Multimedia 7(6), 1066–1083 (2005)CrossRefGoogle Scholar
  3. 3.
    Bertini, M., Del Bimbo, A., Ioannidis, I., Stan, A., Bijk, E.: A flexible environment for multimedia management and publishing. In: 1st ACM International Conference on Multimedia Retrieval, art. 76. ACM, New York (2011), http://dx.doi.org/10.1145/1991996.1992072
  4. 4.
    Borth, D., Ulges, A., Breuel, T.M.: Lookapp: interactive construction of web-based concept detectors. In: 1st ACM International Conference on Multimedia Retrieval, art. 66. ACM, New York (2011), http://dx.doi.org/10.1145/1991996.1992062
  5. 5.
    Heyer, L.J., Kruglyak, S., Yooseph, S.: Exploring Expression Data: Identification and Analysis of Coexpressed Genes. Genome Research 9(11), 1106–1115 (1999)CrossRefGoogle Scholar
  6. 6.
    Manjunath, B.S., Salembier, P., Sikora, T.: Introduction to MPEG-7. Wiley, West Sussex (2002)Google Scholar
  7. 7.
    Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines. Trans. on Intelligent Systems and Technology 2(3) (2011), http://www.csie.ntu.edu.tw/~cjlin/libsvm

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Elisabet Carcel
    • 1
  • Manuel Martos
    • 1
  • Xavier Giró-i-Nieto
    • 1
  • Ferran Marqués
    • 1
  1. 1.Technical University of Catalonia (UPC)BarcelonaSpain

Personalised recommendations