Abstract
Concept indexing in multimedia libraries is very useful for users searching and browsing but it is a very challenging research problem as well. Combining several modalities, features or concepts is one of the key issues for bridging the gap between signal and semantics. In this paper, we present three fusion schemes inspired from the classical early and late fusion schemes. First, we present a kernel-based fusion scheme which takes advantage of the kernel basis of classifiers such as SVMs. Second, we integrate a new normalization process into the early fusion scheme. Third, we present a contextual late fusion scheme to merge classification scores of several concepts. We conducted experiments in the framework of the official TRECVID’06 evaluation campaign and we obtained significant improvements with the proposed fusion schemes relatively to usual fusion schemes.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Ayache, S., et al.: CLIPS-LSR-NII experiments at TRECVID 2005. In: Proceedings of TRECVID Workshop (2005)
Ayache, S., et al.: Using topic concepts for semantic video shots classification. In: Sundaram, H., et al. (eds.) CIVR 2006. LNCS, vol. 4071, Springer, Heidelberg (2006)
Boughorbel, S., Tarel, J.P., Boujemaa, N.: Conditionally positive definite kernels for SVM based image recognition. In: Proceedings of ICME (2005)
Cancedda, N., et al.: Word-sequence kernels. Journal of Machine Learning Research (2003)
Dietterich, T.G.: Ensemble methods in machine learning. In: Kittler, J., Roli, F. (eds.) MCS 2000. LNCS, vol. 1857, Springer, Heidelberg (2000)
Iyengar, G., Nock, H.: Discriminative model fusion for semantic concept detection and annotation in video. In: Proceedings of ACM Multimedia, ACM Press, New York (2003)
Kraaij, W., et al.: TRECVID 2006 – An Introduction (2006), http://www-nlpir.nist.gov/projects/tvpubs/tv6.papers/tv6intro.pdf
Lanckriet, G.R., et al.: Kernel-based data fusion and its application to protein function prediction in yeast. In: Proceedings of the Pacific Symposium on Biocomputing, pp. 300–311 (2004)
Lin, W., Jin, R., Hauptmann, A.: Meta-classification of multimedia classifiers. In: Proceedings of First International Workshop on Knowledge Discovery (2002)
Lodhi, H., et al.: Text classification using string kernels. In: NIPS (2000)
Naphade, M.: On supervision and statistical learning for semantic multimedia analysis. Journal of Visual Communication and Image Representation (2004)
Shawe-Taylor, J., Cristianini, N.: Kernel Methods for Pattern Analysis. Cambridge University Press, Cambridge (2004)
Snoek, C., Worring, M., Smeulders, A.: Early versus late fusion in semantic video analysis. In: Proceedings of ACM Multimedia, ACM Press, New York (2005)
Snoek, C.G.M., et al.: The semantic pathfinder for generic news video indexing. In: Proceedings of ICME (2006)
Sonnenburg, S., Ratsch, G., Schafer, C.: A general and efficient multiple kernel learning algorithm. In: Proceedings of NIPS (2005)
Wolpert, D.H.: Stacked generalization. Journal of Neural Networks (1990)
Yilmaz, E., Aslam, J.A.: Estimating average precision with incomplete and imperfect judgments. In: Proceedings of CIKM (2006)
Zhang, J., et al.: Local features and kernels for classification of texture and object categories: A comprehensive study. In: Beyond Patches workshop, in conjunction with CVPR (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Ayache, S., Quénot, G., Gensel, J. (2007). Classifier Fusion for SVM-Based Multimedia Semantic Indexing. In: Amati, G., Carpineto, C., Romano, G. (eds) Advances in Information Retrieval. ECIR 2007. Lecture Notes in Computer Science, vol 4425. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71496-5_44
Download citation
DOI: https://doi.org/10.1007/978-3-540-71496-5_44
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-71494-1
Online ISBN: 978-3-540-71496-5
eBook Packages: Computer ScienceComputer Science (R0)