A Structured Visual Learning Approach Mixed with Ontology Dimensions for Medical Queries

  • Jean-Pierre Chevallet
  • Joo-Hwee Lim
  • Saïd Radhouani
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4022)


Precise image and text indexing requires domain knowledge and a learning process. In this paper, we present the use of an ontology to filter medical documents and of visual concepts to describe and index associated images. These visual concepts are meaningful medical terms with associated visual appearance from image samples that are manually designed and learned from examples. Text and image indexing processes are performed in parallel and merged to answer mixed-mode queries. We show that fusion of these two methods are of a great benefit and that external knowledge stored in an ontology is mandatory to solve precise queries and provide the overall best results.


Query Image Vector Space Model Visual Concept Query Vector Ontology Dimension 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Lim, J., Jin, J.: A structured learning framework for content-based image indexing and visual query. Multimedia Systems Journal 10, 317–331 (2005)CrossRefGoogle Scholar
  2. 2.
    Lim, J.-H., Chevallet, J.-P.: VisMed: A Visual Vocabulary Approach for Medical Image Indexing and Retrieval. In: Lee, G.G., Yamada, A., Meng, H., Myaeng, S.-H. (eds.) AIRS 2005. LNCS, vol. 3689, pp. 84–96. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  3. 3.
    Guyot, J., Radhouani, S., Falquet, G.: Ontology-based multilingual information retrieval. In: CLEF Workhop, Working Notes Multilingual Track, Vienna, Austria (2005)Google Scholar
  4. 4.
    Schmid, H.: Probabilistic part-of-speech tagging using decision trees. In: Proceedings of International Conference on New Methods in Language Processing (1994)Google Scholar
  5. 5.
    Chevallet, J.P.: X-iota: An open xml framework for ir experimentation application on multiple weighting scheme tests in a bilingual corpus. In: AIRS 2004 Conference. LNCS, vol. 3211, pp. 263–280. Springer, Heidelberg (2004)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Jean-Pierre Chevallet
    • 1
    • 4
  • Joo-Hwee Lim
    • 2
  • Saïd Radhouani
    • 3
    • 4
  1. 1.IPAL-CNRS, Institute for Infocomm Research 
  2. 2.Institute for Infocomm ResearchSingapore
  3. 3.Centre universitaire d’informatiqueGenève 4Switzerland
  4. 4.CLIPS-IMAGUniversité Joseph FourierFrance

Personalised recommendations