Photo Retrieval from Personal Memories Using Generic Concepts

  • Rui M. Jesus
  • Arnaldo J. Abrantes
  • Nuno Correia
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4261)

Abstract

This paper presents techniques for retrieving photos from personal memories collections using generic concepts that the users specify. It is part of a larger project for capturing, storing, and retrieving personal memories in different contexts of use. Semantic concepts are obtained by training binary classifiers using the Regularized Least Squares Classifier (RLSC)and can be combined to express more complex concepts. The results that were obtained so far are quite good and by adding more low level features, better results are possible. The paper describes the proposed approach, the classifier and features, and the results that were obtained.

Keywords

multimedia retrieval personal memories classification based on kernel 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Veltkamp, R., Tanase, M.: Content-Based Image Retrieval Systems: A Survey. Technical Report UU-CS-2000-34 (October 2000)Google Scholar
  2. 2.
    Hori, T., Aizawa, K.: Context-based video retrieval system for the life-log applications. In: Proceedings of the Fifth ACM SIGMM International Workshop on Multimedia Information Retrieval (Berkeley, CA), November 7, pp. 31–38. ACM Press, New York (2003)CrossRefGoogle Scholar
  3. 3.
    O’Hare, N., Jones, G., Gurrin, C., Smeaton, A.: Combination of content analysis and context features for digital photograph retrieval. In: IEE European Workshop on the Integration of Knowledge, Semantic and Digital Media Technologies, London (2005)Google Scholar
  4. 4.
    Lew, M., Sebe, N., Djeraba, C., Jain, R.: Content-based Multimedia Information Retrieval: State-of-the-art and Challenges. ACM Transactions on Multimedia Computing, Communication, and Applications 2(1) (2006)Google Scholar
  5. 5.
    Smeulders, A., Worring, M., Santini, S., Gupta, A., Jain, A.: Content-based image retrieval at the end of the early years. IEEE Trans. Pattern Analysis and Machine Intelligence 22(12), 1349–1380 (2000)CrossRefGoogle Scholar
  6. 6.
    Mori, Y., Takahashi, H., Oka, R.: Image-to-word transformation based on dividing and vector quantizing images with words. In: Proceedings of the International Workshop on Multimedia Intelligent Storage and Retrieval Management (1999)Google Scholar
  7. 7.
    Yong, R., Huang, T., Mehrotra, S.: Relevance feedback techniques in interactive content-based image retrieval. In: Storage and Retrieval for Image and Video Databases (SPIE), pp. 25–36 (1998)Google Scholar
  8. 8.
    Zhou, X., Huang, T.: Relevance feedback in image retrieval: A comprehensive review. Multimedia Systems 8(6), 536–544 (2003)CrossRefGoogle Scholar
  9. 9.
    Poggio, T., Smale, S.: The mathematics of learning: Dealing with data. Notice of American Mathematical Society 50(5), 537–544 (2003)MATHMathSciNetGoogle Scholar
  10. 10.
    Jesus, R., Magalhães, J., Yavlinsky, A., Rüger, S.: Imperial College at TRECVID. TREC Video Retrieval Evaluation (TRECVID), Gaithersburg, MD (November 2005)Google Scholar
  11. 11.
    Jesus, R., Abrantes, A., Marques, J.: Relevance feedback in CBIR using the RLS classifier. In: 5th EURASIP Conference focused on Speech and Image Processing, Multimedia communications and Services, Bratislava, Junho (2005)Google Scholar
  12. 12.
    Wenyin, L., Sun, Y., Zhang, H.: MiAlbum-A System for Home Photo Management Using the Semi-Automatic Image Annotation Approach. ACM Multimedia (2000)Google Scholar
  13. 13.
    Wilhelm, A., Takhteyev, Y., Sarvas, R., Van House, N., Davis, M.: Photo Annotation on a Camera Phone. In: Proc. ACM CHI 2004, pp. 1403–1406 (2004)Google Scholar
  14. 14.
    World-Wide Media eXchange (2005), http://wwmx.org
  15. 15.
    Cooper, M., Foote, J., Girgensohn, A.: Automatically organizing digital photographs using time and content. In: Proc. of the IEEE Intl. Conf. on Image Processing (ICIP 2003) (2003)Google Scholar
  16. 16.
    Jiebo, L., Boutell, M., Brown, C.: Pictures are not taken in a vacuum - an overview of exploiting context for semantic scene content understanding. Signal Processing Magazine, IEEE 23(2), 101–114 (2006)CrossRefGoogle Scholar
  17. 17.
    Jaimes, A.: Human Factors in Automatic Image Retrieval System Design and Evaluation. In: Proceedings of SPIE, Internet Imaging VII, San Jose, CA, USA, 6061 (2006)Google Scholar
  18. 18.
    Cusano, C., Ciocca, G., Schettini, R.: Image annotation using SVM. In: Proceedings of the SPIE, Internet Imaging V 2003, 5304, pp. 330–338 (2003)Google Scholar
  19. 19.
    Naphade, M.R., Huang, T.S.: A probabilistic framework for semantic video indexing, filtering, and retrieval. IEEE Transactions on Multimedia 3(1), 141–151 (2001)CrossRefGoogle Scholar
  20. 20.
    Manjunath, B.S., Ma, W.Y.: Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Machine Intell. 18, 837–842 (1996)CrossRefGoogle Scholar
  21. 21.
    Platt, J.C.: Probabilistic Outputs for Support Vector Machines and Comparisons to Regularized Likelihood Methods. In: Smola, P.B.A., Schölkopf, B., Schuurmans, D. (eds.) Advances in Large Margin Classifiers, pp. 61–74. MIT Press, Cambridge (1999)Google Scholar
  22. 22.
    Correia, N., Alves, L., Correia, H., Morgado, C., Soares, L., Cunha, J., Romão, T., Dias, A.E., Jorge, J.: InStory: A System for Mobile Information Access, Storytelling and Gaming Activities in Physical Spaces. In: ACE 2005 - ACM SIGCHI International Conference on Advances in Computer Entertainment Technology, Universidade Politècnica de Valencia (UPV), Spain, June 15-17 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Rui M. Jesus
    • 1
    • 2
  • Arnaldo J. Abrantes
    • 1
  • Nuno Correia
    • 2
  1. 1.Multimedia and Machine Learning GroupInstituto Superior de Engenharia de LisboaLisboaPortugal
  2. 2.Interactive Multimedia GroupDI/FCT, New University of LisbonMonte da CaparicaPortugal

Personalised recommendations