Advertisement

Large-Scale Cross-Media Retrieval of WikipediaMM Images with Textual and Visual Query Expansion

  • Zhi Zhou
  • Yonghong Tian
  • Yuanning Li
  • Tiejun Huang
  • Wen Gao
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5706)

Abstract

In this paper, we present our approaches for the WikipediaMM task at ImageCLEF 2008. We first experimented with a text-based image retrieval approach with query expansion, where the extension terms were automatically selected from a knowledge base that was semi-automatically constructed from Wikipedia. Encouragingly, the experimental results rank in the first place among all submitted runs. We also implemented a content-based image retrieval approach with query-dependent visual concept detection. Then cross-media retrieval was successfully carried out by independently applying the two meta-search tools and then combining the results through a weighted summation of scores. Though not submitted, this approach outperforms our text-based and content-based approaches remarkably.

Keywords

Image retrieval textual query expansion query-dependent visual concept detection cross-media re-ranking 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Tian, Y.H., Huang, T.J., Gao, W.: Exploiting multi-context analysis in semantic image classification. J. Zhejiang Univ. SCI. 6A(11), 1268–1283 (2005)CrossRefGoogle Scholar
  2. 2.
    Strube, M., Ponzetto, S.: WikiRelate! Computing semantic relatedness using Wikipedia. In: Proc. of National Conference on Artificial Intelligence (AAAI 2006), Boston, Mass, pp. 1419–1424 (2006)Google Scholar
  3. 3.
    Nakayama, K., Hara, T., Nishio, S.: A thesaurus construction method from large scale web dictionaries. In: Proc. of IEEE International Conference on Advanced Information Networking and Applications (AINA 2007), pp. 932–939 (2007)Google Scholar
  4. 4.
    Huang, C., Tian, Y.H., Zhou, Z., Ling, C.X., Huang, T.J.: Keyphrase extraction using Semantic Networks Structure Analysis. In: Proc. of the sixth IEEE Int’l. Conf. on Data Mining (ICDM 2006), pp. 275–284. IEEE press, Hong Kong (2006)CrossRefGoogle Scholar
  5. 5.
    Lowe, D.: Object recognition from local scale-invariant feature. In: Proc. Int’l Conf. Computer Vision (ICCV 1999), pp. 1150–1157 (1999)Google Scholar
  6. 6.
    Lazebnik, S., Schmid, C., Ponce, J.: Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In: Proceedings of the IEEE CVPR 2006, pp. 2169–2178 (2006)Google Scholar
  7. 7.
    Hofmann, T.: Unsupervised learning by probabilistic latent semantic analysis. Machine Learning 41, 177–196 (2001)CrossRefzbMATHGoogle Scholar
  8. 8.
    Smeulders, A.W.M., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Anal. Mach Intell. 22(12), 1349–1380 (2000)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Zhi Zhou
    • 1
    • 2
    • 3
  • Yonghong Tian
    • 3
  • Yuanning Li
    • 1
    • 2
    • 3
  • Tiejun Huang
    • 3
  • Wen Gao
    • 3
  1. 1.Key Laboratory of Intelligent Information Processing, Institute of Computing TechnologyChinese Academy of SciencesBeijingChina
  2. 2.Graduate University of Chinese Academy of SciencesBeijingChina
  3. 3.Institute of Digital Media, School of EE & CSPeking UniversityBeijingChina

Personalised recommendations