Advertisement

Medical Image Annotation and Retrieval Using Visual Features

  • Jing Liu
  • Yang Hu
  • Mingjing Li
  • Songde Ma
  • Wei-ying Ma
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4730)

Abstract

In this paper, we present the algorithms and results of our participation in the medical image annotation and retrieval tasks of ImageCLEFmed 2006. We exploit using global features and local features to describe medical images in the annotation task. Different kinds of global features are examined and the most descriptive ones are extracted to represent the radiographs, which effectively capture the intensity, texture and shape characters of the image content. We also evaluate the descriptive power of local features, i.e. local image patches, for medical images. A newly developed spatial pyramid matching algorithm is applied to measure the similarity between images represented by sets of local features. Both descriptors use multi-class SVM to classify the images. We achieve an error rate of 17.6% for global descriptor and 18.2% for the local one, which rank sixth and ninth respectively among all the submissions. For the medical image retrieval task, we only use visual features to describe the images. No textual information is considered. Different features are used to describe gray images and color images. Our submission achieves a mean average precision (MAP) of 0.0681, which ranks second in the 11 runs that also only use visual features.

Keywords

Medical Image Local Feature Visual Feature Training Image Query Image 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Chang, C.-C., Lin, C.-J.: LIBSVM : A Library for Support Vector Machines Software (2001), available at http://www.csie.ntu.edu.tw/cjlin/libsvm
  2. 2.
    Deselaers, T., Keysers, D., Ney, H.: Discriminative Training for Object Recognition Using Image Patches. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2005), San Diego, CA (June 2005)Google Scholar
  3. 3.
    Fritzke, B.: Growing Cell Structures - A Self-Organizing Network in k Dimensions. Artificial Neural Networks II, 1051–1056 (1992)Google Scholar
  4. 4.
    Keysers, D., Gollan, C., Ney, H.: Classification of Medical Images using Non-linear Distortion Models. Bildverarbeitung für die Medizin 2004 (BVM 2004), Berlin, Germany, pp. 366–370 (March 2004)Google Scholar
  5. 5.
    Lazebnik, S., Schmid, C., Ponce, J.: Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2006), New York (June 2006)Google Scholar
  6. 6.
    Lowe, D.G.: Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)CrossRefGoogle Scholar
  7. 7.
    Müller, H., Deselaers, T., Lehmann, T.M., Clough, P., Hersh, W.: Overview of the ImageCLEFmed 2006 medical retrieval and annotation tasks. In: 7th Workshop of the Cross-Language Evalution Forum, CLEF 2006, Alicante, Spain (in press, 2006)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Jing Liu
    • 1
  • Yang Hu
    • 2
  • Mingjing Li
    • 3
  • Songde Ma
    • 1
  • Wei-ying Ma
    • 3
  1. 1.Institute of Automation, Chinese Academy of Sciences, Beijing 100080China
  2. 2.University of Science and Technology of China, Hefei 230027China
  3. 3.Microsoft Research Asia, No 49, Zhichun Road, Beijing 100080China

Personalised recommendations