Tagging Image by Exploring Weighted Correlation between Visual Features and Tags

  • Xiaoming Zhang
  • Zhoujun Li
  • Yun Long
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6897)


Automatic image tagging automatically label images with semantic tags, which significantly facilitate image search and organization. Existing tagging methods often derive the probabilistic or co-occurring tags from the visually similar images, which based on the image level similarity between images. It may result in many noisy tags due to the problem of semantic gap. In this paper, we propose a novel automatic tagging algorithm. It represents each test image with a bag of visual words and a measure to estimate the correlation between visual words and tags is designed. Then, for each test image, its visual words are weighted based on their importance, and the more important visual word contributes more to tag the test image. To tag a test image, we select the tags which have strong correlation with the greatly weighted visual words. We conduct extensive experiments on the real-world image dataset downloaded from Flickr. The results confirm the effectiveness of our algorithm.


image retrieval image tagging feature correlation 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Liu, Y., Zhang, D., Lu, G., Ma, W.Y.: A survey of content-based image retrieval with high-level semantics. Pattern Recogn. 40(1), 262–282 (2007)CrossRefzbMATHGoogle Scholar
  2. 2.
    Naphade, M., et al.: Large-Scale Concept Ontology for Multimedia. IEEE Multimedia 13(3), 86–91 (2006)CrossRefGoogle Scholar
  3. 3.
    Zhou, X., Wang, M., Zhang, Q., Zhang, J., Shi, B.: Automatic image annotation by an iterative approach: Incorporating keyword correlations and region matching. In: Proceedings of the 6th ACM International Conference on Image and Video Retrieval, pp. 25–32 (2007)Google Scholar
  4. 4.
    Liu, D., Wang, M., Hua, X.S., Zhang, H.J.: Tag Ranking. In: Proceeding of the 18th ACM International Conference on World Wide Web, pp. 351–340 (2009)Google Scholar
  5. 5.
    Li, X.R., Snoek, C.G.M., Worring, M.: Learning tag relevance by neighbor voting for social image retrieval. In: Proceeding of 1st ACM International Conference on Multimedia Information Retrieval, pp. 30–31 (2008)Google Scholar
  6. 6.
    Lei, W., Linjun, Y., Nenghai, Y., Hua, X.S.: Learning to tag. In: Proceedings of the 18th ACM International Conference on World Wide Web, pp. 20–24 (2009)Google Scholar
  7. 7.
    Barnard, K., Duygulu, P., Forsyth, D., Freitas, N., Blei, D.M., Jordan, M.I.: Matching words and pictures. Jour. Machine Learning Research 3(6), 1107–1135 (2003)zbMATHGoogle Scholar
  8. 8.
    Lei, W., Steven, C.H., Jin, H.R., Jianke, Z., Nenghai, Y.: Distance Metric Learning from Uncertain Side Information with Application to Automated Photo Tagging. In: Proceeding of 17th ACM International Conference on Multimedia, pp. 15–24 (2009)Google Scholar
  9. 9.
    Geng, B., Yang, L., Xu, C., Hua, X.: Collaborative learning for image and video annotation. In: Proceeding of the 1st ACM International Conference on Multimedia Information Retrieval, pp. 443–450 (2008)Google Scholar
  10. 10.
    Bailloeul, T., Zhu, C.Z., Xu, Y.h.: Automatic Image Tagging As A Random Walk With Priors on the Canonical Correlation Subspace. In: Proceeding of 9th ACM International Conference on Multimedia Information Retrieval, pp. 75–82 (2008)Google Scholar
  11. 11.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. IJCV 60(2), 91–110 (2004)CrossRefGoogle Scholar
  12. 12.
    Nister, D., Stewenius, H.: Scalable recognition with a vocabulary tree. In: Proc. CVPR, pp. 2161–2168 (2006)Google Scholar
  13. 13.
    Wu, Z., Ke, Q.F., Sun, J.: Bundling features for large-scale partial-duplicate web image search. In: Proceeding of Computer Version and Pattern Recognition, pp. 25–32 (2009)Google Scholar
  14. 14.
    Zhang, S., Tian, Q., Hua, G., Huang, Q., Li, S.: Descriptive visual words and visual phrases for image applications. In: Proceedings of the Seventeen ACM International Conference on Multimedia, pp. 75–84 (2009)Google Scholar
  15. 15.
    Tong, H., Faloutsos, C., Pan, J.: Random walk with restart: fast solutions and applications. Knowl. Inf. Syst. 14(3), 327–346 (2008)CrossRefzbMATHGoogle Scholar
  16. 16.
    Yang, K., Wang, M., Zhang, H.: Active tagging for image indexing. In: Proceedings of the 2009 IEEE International Conference on Multimedia and Expo, pp. 1620–1623 (2009)Google Scholar
  17. 17.
    Siersdorfer, S., San Pedro, J., Sanderson, M.: Automatic Video Tagging using Content Redundancy. In: Proceeding of the 32nd ACM International Conference on Research and Development in Information Retrieval, pp. 16–23 (2009)Google Scholar
  18. 18.
    Heesch, D., Yavlinsky, A., Ruger, S.: Nnk: networks and automated annotation for browsing large image collections from the world wide web. In: Proceedings of the 14th ACM International Conference on Multimedia, pp. 493–494 (2006)Google Scholar
  19. 19.
    Wu, F., Han, Y.H., Tian, Q., Zhuang, Y.T.: Multi-label Boosting for Image Annotation by Structural Grouping Sparsity. In: Proc. ACM Multimedia (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Xiaoming Zhang
    • 1
  • Zhoujun Li
    • 1
  • Yun Long
    • 2
  1. 1.School of Computer Science and EngineeringBeihang UniversityBeijingChina
  2. 2.Economic and Management DepartmentUniversity of South ChinaHengyangChina

Personalised recommendations