Supervised Content Based Image Retrieval Using Radiology Reports
Content based image retrieval (CBIR) is employed in medicine to improve radiologists’ diagnostic performance. Today effective medical CBIR systems are limited to specific applications, as to reduce the amount of medical knowledge to model. Although supervised approaches could ease the incorporation of medical expertise, its application is not common due to the scarce number of available user annotations. This paper introduces the application of radiology reports to supervise CBIR systems. The concept is to make use of the textual distances between reports to build a transformation in image space through a manifold learning algorithm. A comparison was made between the presented approach and non-supervised CBIR systems, using a Leave-One-Patient-Out evaluation in a database of computer tomography scans of interstitial lung diseases. Supervised CBIR augmented the mean average precision consistently with an increase between 3 to 8 points, which suggests supervision by radiology reports increases CBIR performance.
KeywordsInterstitial Lung Disease Image Space Radiology Report Mean Average Precision Manifold Representation
Unable to display preview. Download preview PDF.
- 1.Aisen, A.M., Broderick, L.S., Winer-Muram, H., Brodley, C.E., Kak, A.C., Pavlopoulou, C., Dy, J., Shyu, C., Marchiori, A.: Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. Radiology 228(1), 265–270 (2003)CrossRefGoogle Scholar
- 6.Kockelkorn, T.T.J.P., de Jong, P.A., Gietema, H.A., Grutters, J.C., Prokop, M., van Ginneken, B.: Interactive annotation of textures in thoracic CT scans. In: Proceedings of SPIE, vol. 7624(1), 76240X–76240X-8 (March 2010)Google Scholar
- 10.Slaney, M., Weinberger, K., White, W.: Learning a metric for music similarity. In: Procedings of the 9th International Society for Music Information Retrieval Conference, pp. 313–318 (2008)Google Scholar
- 12.Yang, L., Jin, R., Mummert, L., Sukthankar, R., Goode, A., Zheng, B., Hoi, S.C., Satyanarayanan, M.: A boosting framework for Visuality-Preserving distance metric learning and its application to medical image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence 32(1), 30–44 (2010)CrossRefGoogle Scholar