Abstract
Due to massive amount of data, the description of audiovisual media by metadata nowadays can benefit by the support of (semi-)automatic methods during the annotation process. The presented tool enables the user to mark, interactively segment and track preselected objects. An integrated shot detection splits the video into disjoint parts, for instance to circumvent the semi-automated tracking of objects across shot boundaries. Arbitrary application dependent custom image processing chains can be created in conjunction with the research framework AMOPA. Created data is exported in compliance to MPEG7-DAVP.
Chapter PDF
Similar content being viewed by others
References
Smeaton, A.F., Over, P., Kraaij, W.: Evaluation Campaigns and Trecvid. In: Proceedings of the 8th ACM International Workshop on Multimedia Information Retrieval MIR 2006, New York, NY, USA, pp. 321–330 (2006)
Doermann, D., Mihalcik, D.: Tools and Techniques for Video Performance Evaluation. In: Proc. 15th International Conference on Pattern Recognition, vol. 4, pp. 167–170 (2000)
Lux, M.: Caliph & Emir: MPEG-7 Photo Annotation and Retrieval. In: Proceedings of the 17th ACM International Conference on Multimedia, Beijing, China, pp. 925–926 (2009)
Vezzani, R., Grana, C., Bulgarelli, D., Cucchiara, R.: A Semi-Automatic Video Annotation Tool with MPEG-7 Content Collections. In: Proceedings of the 8th IEEE International Symposium on Multimedia, San Diego, CA, USA (2006)
Petridis, K., Anastasopoulos, D., Saathoff, C., Timmermann, N., Kompatsiaris, Y., Staab, S.: M-OntoMat-Annotizer: Image Annotation. In: Linking Ontologies and Multimedia Low-Level Features. Engineered Applications of Semantic Web Session at the 10th Int’l. Conf. on Knowledge-Based & Intelligent Information & Engineering Systems, U.K. (2006)
Columbia University. IBM T. J. Watson Research Center: MARVEL: Multimedia Analysis and Retrieval System, http://domino.research.ibm.com/comm/research_people.nsf/pages/jsmith.projects.html
Naphade, M.R., Lin, C.-Y., Smith, J.R., Tseng, B., Basu, S.: Learning to Annotate Video Databases. In: Proc. SPIE, Storage and Retrieval for Media Databases vol. 4676, pp. 264–275 (2002)
Kounoudes, A., Tsapatsoulis, N., Theodosiou, Z., Milis, M.: A multi-level Video Annotation Tool based on XML-dictionaries. In: Proc. of the 10th WSEAS International Conference on Mathematical Methods, Computational Techniques and Intelligent Systems, Corfu, Greece (2008)
Luo, H., Eleftheriadis, A.: Designing an Interactive Tool for Video Object Segmentation and Annotation. In: Proc. of the 7th ACM International Conference on Multimedia, Orlando, FL, USA, pp. 265–269 (1999)
Goldman, D.B., Gonterman, C., Curless, B., Salesin, D., Seitz, S.M.: Video Object Annotation, Navigation, and Composition. In: Proc. of the 21st Annual ACM Symposium on User Interface Software and Technology, Monterey, CA, USA (2008)
Kipp, M.: Spatiotemporal Coding in ANVIL. In: Proc. of the 6th International Conference on Language Resources and Evaluation, LREC (2008)
Hagedorn, J., Hailpern, J., Karahalios, K.G.: VCode and VData: Illustrating a new Framework for Supporting the Video Annotation Workflow. In: AVI 2008, Napoli, Italy, pp. 317–321 (2008)
Schroeter, R., Hunter, J., Kosovic, D.: FilmEd: Collaborative Video Indexing, Annotation and Discussion Tools Over Broadband Networks. In: Proc. of the 10th IEEE International Conference on Multimedia Modeling, Los Alamitos, California, USA, pp. 346–353 (2004)
Concejero, P., Munuera, J., Lorenz, M.: The MESH Mobile Video Annotation Tool. In: Proc. of the 5th ACM Nordic Conference on Human-computer Interaction: Building Bridges, NordiCHI 2008, Schweden (2008)
Ritter, M., Eibl, M.: Ein erweiterbares Tool zur Annotation von Videos. In: Proc. 12th International Symposium on Information Science 2010, Hildesheim, Germany (2010) (in press)
Fan, J., Gao, Y., Hangzai, L., Jain, R.: Mining Multilevel Image Semantics via Hierarchical Classification. IEEE Transactions on Multimedia 10(2), 167–187 (2008)
Ritter, M., Eibl, M.: Visualizing steps for shot detection. In: LWA 2009: Lernen - Wissen - Adaption, Workshop Proceedings, Darmstadt, Germany, pp. 98–100 (2009)
Ritter, M.: Visualisierung von Prozessketten zur Shot Detection. In: Workshop Audiovisuelle Medien: WAM 2009, Technical Reports of Computer Science (CSR-09-04), Chemnitz University of Technology, Germany, pp. 135–150 (2009)
Liu, Z., Gibbon, D., Zavesky, E., Shahraray, B., Haffner, P.: AT&T RESEARCH AT TRECVID 2006 Workshop Contribution. AT&T Labs-Research (2006)
Zwicklbauer, S.: Evaluierung und Implementierung von Shot-Boundary-Detection-Algorithmen zur automatischen Video-Anno¬tation. Bachelor thesis, Universität Passau, pp. 48–52 (2010)
Talbot, J.F., Xu, X.: Implementing GrabCut. Brigham Young University, Provo, UT, USA (2006), http://www.justintalbot.com/course-work/
Orchard, M., Bouman, C.: Color Quantization of Images. IEEE Transactions on Signal Processing 39(12), 2677–2690 (1991)
Boykov, Y., Kolmogorov, V.: An Experimental Comparison of Min-cut/Max-flow Algorithms for Energy Minimization in Vision. IEEE Trans. on Pattern Analysis and Machine Intelligence 26(9), 1124–1137 (2004)
Höhlig, S.: Analyse und Implementierung eines Verfahrens zur interaktiven semi-automatischen Objektmarkierung und -verfolgung. Bachelor thesis, Chemnitz University of Technology (2010)
Beck, P.: Implementierung eines flexiblen Algorithmus zum Tracking von Objekten in Java. Seminar paper, TU Darmstadt, Germany (1999)
Bailer, W., Schallauer, P., Neuschmied, H.: Description of the MPEG-7 Detailed Audiovisual Profile (DAVP). Technical Report, Joanneum Research, Graz, Austria (2007)
Price, B.L., Morse, B.S., Cohen, S.: LIVEcut: Learning-based Interactive Video Segmentation by Evaluation of Multiple Propagated Cues. In: Proc. International Conference on Computer Vision (ICCV 2009), Kyoto, Japan (2009)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Ritter, M., Eibl, M. (2011). An Extensible Tool for the Annotation of Videos Using Segmentation and Tracking. In: Marcus, A. (eds) Design, User Experience, and Usability. Theory, Methods, Tools and Practice. DUXU 2011. Lecture Notes in Computer Science, vol 6769. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-21675-6_35
Download citation
DOI: https://doi.org/10.1007/978-3-642-21675-6_35
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-21674-9
Online ISBN: 978-3-642-21675-6
eBook Packages: Computer ScienceComputer Science (R0)