Multi-modal Correlated Centroid Space for Multi-lingual Cross-Modal Retrieval

  • Aditya Mogadala
  • Achim Rettinger
Conference paper

DOI: 10.1007/978-3-319-16354-3_9

Part of the Lecture Notes in Computer Science book series (LNCS, volume 9022)
Cite this paper as:
Mogadala A., Rettinger A. (2015) Multi-modal Correlated Centroid Space for Multi-lingual Cross-Modal Retrieval. In: Hanbury A., Kazai G., Rauber A., Fuhr N. (eds) Advances in Information Retrieval. ECIR 2015. Lecture Notes in Computer Science, vol 9022. Springer, Cham

Abstract

We present a novel cross-modal retrieval approach where the textual modality is present in different languages. We retrieve semantically similar documents across modalities in different languages using a correlated centroid space unsupervised retrieval (C2SUR) approach. C2SUR consists of two phases. In the first phase, we extract heterogeneous features from a multi-modal document and project it to a correlated space using kernel canonical correlation analysis (KCCA). In the second phase, correlated space centroids are obtained using clustering to retrieve cross-modal documents with different similarity measures. Experimental results show that C2SUR outperforms the existing state-of-the-art English cross-modal retrieval approaches and achieve similar results for other languages.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Aditya Mogadala
    • 1
  • Achim Rettinger
    • 1
  1. 1.Institute AIFBKarlsruhe Institute of TechnologyGermany

Personalised recommendations