Abstract
Cross-media analysis and indexing leverage the individual potential of each indexing information provided by different modalities, such as speech, text and image, to improve the effectiveness of information retrieval and filtering in later stages. The process does not only constitute generating a merged representation of the digital content, such as MPEG-7, but also enriching it in order to help remedy the imprecision and noise introduced during the low-level analysis phases. It has been hypothesized that a system that combines different media descriptions of the same multi-modal audio-visual segment in a semantic space will perform better at retrieval and filtering time. In order to validate this hypothesis, we have developed a cross-media indexing system which utilises the Multiple Evidence approach by establishing links among the modality specific textual descriptions in order to depict topical similarity.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Shafer, G.: A Mathematical Theory of Evidence. Princeton University Press, Princeton (1976)
Jose, J.M., Harper, D.J.: A retrieval mechanism for semi-structured photographic collections. In: Tjoa, A.M. (ed.) DEXA 1997. LNCS, vol. 1308, Springer, Heidelberg (1997)
Lalmas, M., Moutogianni, E.: A Dempster-Shafer indexing for the focussed retrieval of a hierarchically structured document space: Implementation and experiments on a web museum collection. In: Proceedings of RIAO, Paris, France (2000)
Yakici, M., Crestani, F.: Design of a cross-media indexing system. In: Gonzalo, J., et al. (eds.) ECDL 2006. LNCS, vol. 4172, pp. 477–480. Springer, Heidelberg (2006)
Yakici, M., Crestani, F.: Design and implementation of a cross-media indexing system for the reveal-this system. In: Proceedings of Axmedis Conference (2006)
Singhal, A., Pereira, F.: Document expansion for speech retrieval. In: Proceedings of ACM SIGIR’99, Berkeley, California, United States, ACM Press, New York (1999)
Baillie, M., et al.: University of Strathclyde: the i-lab’s first big day out at TREC HARD. In: Voorhees, E.M., Buckland, L.M. (eds.) Proceedings of the Fourteenth Text Retrieval Conference (TREC-14). NIST Special Publication (2005)
Kullback, S.: Information theory and statistics. Wiley, New York (1959)
Xu, J., Croft, W.B.: Cluster-based language models for distributed retrieval. In: Proceedings of ACM SIGIR’99, Berkeley, California, United States, pp. 254–261. ACM Press, New York (1999)
Rocchio, J.J.: Relevance feedback in information retrieval. In: Salton, G. (ed.) The SMART retrieval system: experiments in automatic document processing, p. 313. Prentice-Hall, Englewood Cliffs (1971)
Ounis, I., et al.: Terrier: A High Performance and Scalable Information Retrieval Platform. In: Proceedings of ACM SIGIR’06, Workshop on Open Source Information Retrieval (OSIR 2006), Seattle, Washington, USA, ACM Press, New York (2006)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Yakıcı, M., Crestani, F. (2007). Investigation of the Effectiveness of Cross-Media Indexing. In: Amati, G., Carpineto, C., Romano, G. (eds) Advances in Information Retrieval. ECIR 2007. Lecture Notes in Computer Science, vol 4425. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-71496-5_61
Download citation
DOI: https://doi.org/10.1007/978-3-540-71496-5_61
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-71494-1
Online ISBN: 978-3-540-71496-5
eBook Packages: Computer ScienceComputer Science (R0)