Content-Free Image Retrieval by Combinations of Keywords and User Feedbacks

  • Shingo Uchihashi
  • Takeo Kanade
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3568)


The performance of a new content-free approach to image retrieval is demonstrated. Accumulated user feedback data that specify which images are (ir)relevant to each other and keywords obtained from a network game are recycled through collaborative filtering techniques to retrieve images without analyzing actual image pixels. Experimental results show the proposed method outperforms a conventional content-based approach using support vector machine. The result was achieved by the combination of feedback data and keywords. Applications of the proposed scheme in query-by-text image retrieval is also discussed.


Support Vector Machine Image Retrieval Relevance Feedback Retrieval Performance User Feedback 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Barnard, K., Forsyth, D.: Learning the semantics of words and pictures. In: Proceedings of International Conference on Computer Vision, pp. 408–415 (2001)Google Scholar
  2. 2.
    Brin, S., Page, L.: The anatomy of a large-scale hypertextual Web search engine. Computer Networks and ISDN Systems 30(1-7), 107–117 (1998)CrossRefGoogle Scholar
  3. 3.
    Fellbaum, C. (ed.): WordNet: An Electric Lexical Database. The MIT Press, Cambridge (1998)Google Scholar
  4. 4.
    He, X., King, O., Ma, W.-Y., Li, M., Zhang, H.-J.: Learning a semantic space from user’s relevance feedback for image retrieval. IEEE Transactions on Circuits and Systems for Video Technology 13(1), 39–48 (2003)CrossRefGoogle Scholar
  5. 5.
    Huang, J., Ravi Kumar, S., Mitra, M., Zhu, W.-J., Zabih, R.: Image indexing using color correlograms. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 762–768 (1997)Google Scholar
  6. 6.
    Kanade, T., Uchihashi, S.: User-powered content-free approach to image retrieval. In: Proceedings of International Symposium on Digital Libraries and Knowledge Communities in Networked Information Society, pp. 24–32 (2004)Google Scholar
  7. 7.
    Möler, H., Pun, T., Squire, D.: Learning from user behavior in image retrieval: Application of the market basket analysis. International Journal of Computer Vision 56(1-2), 65–77 (2004)CrossRefGoogle Scholar
  8. 8.
    Rowley, H.A., Baluja, S., Kanade, T.: Neural network-based face detection. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(1), 23–38 (1998)CrossRefGoogle Scholar
  9. 9.
    Rui, Y., Huang, T.: Optimizing learningg in image retrieval. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 236–243 (2000)Google Scholar
  10. 10.
    Smeulders, A.W.M., Woming, S., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12), 1349–1380 (2000)CrossRefGoogle Scholar
  11. 11.
    Smith, J.R., Chang, S.F.: An image and video search engine for the world wide web. In: Proceedings of SPIE Conference on Storage and Retrieval for Image and Video Databases, vol. 3022, pp. 84–95 (1997)Google Scholar
  12. 12.
    Tong, S., Chang, E.: Support vector machine active learning for image retrieval. In: Proc. AMC Int. Multimedia Conf, pp. 107–118 (2001)Google Scholar
  13. 13.
    Vailaya, A., Jain, A., Zhang, H.J.: On image classification: city images vs. landscapes. Pattern Recognition 31(12), 1921–1935 (1998)CrossRefGoogle Scholar
  14. 14.
    von Ahn, L., Dabbish, L.: Labeling images with a computer game. In: Proceedings of ACM CHI 2004, pp. 319–326 (2004)Google Scholar
  15. 15.
    Wang, J.Z., Li, J.: Learning-based linguistic indexing of pictures with 2-d mhmms. In: Proceedings of ACM Multimedia, pp. 436–445 (2002)Google Scholar
  16. 16.
    Wang, J.Z., Li, J., Wiederhold, G.: Simplicity: Semantics-sensitive integrated matching for picture libraries. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(9), 947–963 (2001)CrossRefGoogle Scholar
  17. 17.
    Wang, X.-J., Ma, W.-Y., Xue, G.-R., Li, X.: Multi-model similarity propagation and its application for web image retrieval. In: Proceedings of ACM Multimedia, New York City, USA, pp. 944–951 (2004)Google Scholar
  18. 18.
    Zhou, X.S., Rui, Y., Huang, T.S.: Exploration of Visual Data. Kluwer Academic Publishers, Dordrecht (2003)zbMATHGoogle Scholar
  19. 19.
    Zitnick, C.: Computing Conditional Probabilities in Large Domains by Maximizing R’enyi’s Quadratic Entropy. PhD thesis, Robotics Institute, Carnegie Mellon University, Technical Report CMU-RI-TR-03-20 (May 2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Shingo Uchihashi
    • 1
  • Takeo Kanade
    • 2
  1. 1.Department of Electrical and Computer Engineering 
  2. 2.Robotics InstituteCarnegie Mellon UniversityPittsburghUSA

Personalised recommendations