Medical Image Annotation and Retrieval Using Visual Features
In this paper, we present the algorithms and results of our participation in the medical image annotation and retrieval tasks of ImageCLEFmed 2006. We exploit using global features and local features to describe medical images in the annotation task. Different kinds of global features are examined and the most descriptive ones are extracted to represent the radiographs, which effectively capture the intensity, texture and shape characters of the image content. We also evaluate the descriptive power of local features, i.e. local image patches, for medical images. A newly developed spatial pyramid matching algorithm is applied to measure the similarity between images represented by sets of local features. Both descriptors use multi-class SVM to classify the images. We achieve an error rate of 17.6% for global descriptor and 18.2% for the local one, which rank sixth and ninth respectively among all the submissions. For the medical image retrieval task, we only use visual features to describe the images. No textual information is considered. Different features are used to describe gray images and color images. Our submission achieves a mean average precision (MAP) of 0.0681, which ranks second in the 11 runs that also only use visual features.
KeywordsMedical Image Local Feature Visual Feature Training Image Query Image
Unable to display preview. Download preview PDF.
- 1.Chang, C.-C., Lin, C.-J.: LIBSVM : A Library for Support Vector Machines Software (2001), available at http://www.csie.ntu.edu.tw/cjlin/libsvm
- 2.Deselaers, T., Keysers, D., Ney, H.: Discriminative Training for Object Recognition Using Image Patches. In: Proceedings of the IEEE International Conference on Computer Vision and Pattern Recognition (CVPR 2005), San Diego, CA (June 2005)Google Scholar
- 3.Fritzke, B.: Growing Cell Structures - A Self-Organizing Network in k Dimensions. Artificial Neural Networks II, 1051–1056 (1992)Google Scholar
- 4.Keysers, D., Gollan, C., Ney, H.: Classification of Medical Images using Non-linear Distortion Models. Bildverarbeitung für die Medizin 2004 (BVM 2004), Berlin, Germany, pp. 366–370 (March 2004)Google Scholar
- 5.Lazebnik, S., Schmid, C., Ponce, J.: Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2006), New York (June 2006)Google Scholar
- 7.Müller, H., Deselaers, T., Lehmann, T.M., Clough, P., Hersh, W.: Overview of the ImageCLEFmed 2006 medical retrieval and annotation tasks. In: 7th Workshop of the Cross-Language Evalution Forum, CLEF 2006, Alicante, Spain (in press, 2006)Google Scholar