Managing Biomedical Image Metadata for Search and Retrieval of Similar Images
- 336 Downloads
Radiology images are generally disconnected from the metadata describing their contents, such as imaging observations (“semantic” metadata), which are usually described in text reports that are not directly linked to the images. We developed a system, the Biomedical Image Metadata Manager (BIMM) to (1) address the problem of managing biomedical image metadata and (2) facilitate the retrieval of similar images using semantic feature metadata. Our approach allows radiologists, researchers, and students to take advantage of the vast and growing repositories of medical image data by explicitly linking images to their associated metadata in a relational database that is globally accessible through a Web application. BIMM receives input in the form of standard-based metadata files using Web service and parses and stores the metadata in a relational database allowing efficient data query and maintenance capabilities. Upon querying BIMM for images, 2D regions of interest (ROIs) stored as metadata are automatically rendered onto preview images included in search results. The system’s “match observations” function retrieves images with similar ROIs based on specific semantic features describing imaging observation characteristics (IOCs). We demonstrate that the system, using IOCs alone, can accurately retrieve images with diagnoses matching the query images, and we evaluate its performance on a set of annotated liver lesion images. BIMM has several potential applications, e.g., computer-aided detection and diagnosis, content-based image retrieval, automating medical analysis protocols, and gathering population statistics like disease prevalences. The system provides a framework for decision support systems, potentially improving their diagnostic accuracy and selection of appropriate therapies.
Key wordsImaging informatics data mining databases decision support body imaging cancer detection computed tomography computer-aided diagnosis (CAD) image retrieval PACS ROC curve ROC-based analysis web technology digital imaging and communications in medicine (DICOM) algorithms
This study is supported in part by NIH CA72023.
- 3.Lowe HJ, Antipov I, Hersh W, Smith CA: Towards knowledge-based retrieval of medical images. The role of semantic indexing, image content representation and knowledge-based retrieval. Proc AMIA Symp:882–886, 1998Google Scholar
- 4.Dina D-F, Sameer A, Mohammad-Reza S, Hamid S-Z, Farshad F, Kost E: Automatically Finding Images for Clinical Decision Support: IEEE Computer Society, 2007Google Scholar
- 5.Hai J, et al: Content and semantic context based image retrieval for medical image grid: IEEE Computer Society, 2007Google Scholar
- 6.Oria V, et al: Modeling Images for Content-Based Queries: The DISIMA Approach, 1997Google Scholar
- 7.Solomon A, Richard C, Lionel B: Content-Based and Metadata Retrieval in Medical Image Database: IEEE Computer Society, 2002Google Scholar
- 11.Rubin DL, Mongkolwat P, Kleper V, Supekar K, Channin DS: Medical Imaging on the Semantic Web: Annotation and Image Markup, Stanford University, 2008Google Scholar
- 13.Rubin DL, Rodriguez C, Shah P, Beaulieu C: iPad: Semantic annotation and markup of radiological images. AMIA Annu Symp Proc:626–630, 2008Google Scholar
- 19.Zhou XS, et al: Semantics and CBIR: a medical imaging perspective. ACM, New York, NY, USA, 2008Google Scholar
- 20.Lober WB, Trigg LJ, Bliss D, Brinkley JM: IML: An image markup language. Journal of the American Medical Informatics Association:403–407, 2001Google Scholar
- 22.Napel S, et al: Automated retrieval of CT images of liver lesions on the basis of image similarity: method and preliminary results. Radiology 256(1): 243–52, 2010Google Scholar