Skip to main content


Log in

Case-based lung image categorization and retrieval for interstitial lung diseases: clinical workflows

  • Original Article
  • Published:
International Journal of Computer Assisted Radiology and Surgery Aims and scope Submit manuscript



Clinical workflows and user interfaces of image-based computer-aided diagnosis (CAD) for interstitial lung diseases in high-resolution computed tomography are introduced and discussed.


Three use cases are implemented to assist students, radiologists, and physicians in the diagnosis workup of interstitial lung diseases.


In a first step, the proposed system shows a three-dimensional map of categorized lung tissue patterns with quantification of the diseases based on texture analysis of the lung parenchyma. Then, based on the proportions of abnormal and normal lung tissue as well as clinical data of the patients, retrieval of similar cases is enabled using a multimodal distance aggregating content-based image retrieval (CBIR) and text-based information search. The global system leads to a hybrid detection-CBIR-based CAD, where detection-based and CBIR-based CAD show to be complementary both on the user’s side and on the algorithmic side.


The proposed approach is in accordance with the classical workflow of clinicians searching for similar cases in textbooks and personal collections. The developed system enables objective and customizable inter-case similarity assessment, and the performance measures obtained with a leave-one-patient-out cross-validation (LOPO CV) are representative of a clinical usage of the system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others


  1. Abe H, MacMahon H, Engelmann R, Li Q, Shiraishi J, Katsuragawa S, Aoyama M, Ishida T, Ashizawa K, Metz CE, Doi K (2003) Computer-aided diagnosis in chest radiography: results of large-scale observer tests at the 1996–2001 RSNA scientific assemblies. RadioGraphics 23(1): 255–265

    Article  PubMed  Google Scholar 

  2. Aisen A, Broderick L, Winer-Muram H, Brodley C, Kak A, Pavlopoulou C, Dy J, Shyu C, Marchiori A (2003) Automated storage and retrieval of thin-section CT images to assist diagnosis: system description and preliminary assessment. Radiology 228(1): 265–270

    Article  PubMed  Google Scholar 

  3. Caritá EC, Seraphim E, Honda MO, Mazzoncini de Azevedo-Marques P (2008) Implementation and evaluation of a medical image management system with content-based retrieval support. Radiol Brasileira 41(5): 331–336

    Article  Google Scholar 

  4. Depeursinge A, Müller H (2010) Fusion techniques for combining textual and visual information retrieval. In: ImageCLEF, The springer international series on information retrieval, vol. 32. Springer, Berlin Heidelberg, pp 95–114

  5. Depeursinge A, Racoceanu D, Iavindrasana J, Cohen G, Platon A, Poletti PA, Müller H (2010) Fusing visual and clinical information for lung tissue classification in high-resolution computed tomography. Artif Intell Med 50(1): 13–21

    Article  PubMed  Google Scholar 

  6. Depeursinge A, Vargas A, Platon A, Geissbuhler A, Poletti PA, Müller H (2010) 3D case-based retrieval for interstitial lung diseases. In: MCBR-CDS 2009: Medical content-based retrieval for clinical decision support, lecture notes in computer science (LNCS). Springer, pp 39–48

  7. Depeursinge A, Vargas A, Platon A, Geissbuhler A, Poletti PA, Müller H Building a reference multimedia database for interstitial lung diseases. Comput Med Imaging Graph (to appear)

  8. Depeursinge A, Zrimec T, Busayarat S, Müller H (2011) 3D lung image retrieval using localized features In: Medical imaging 2011: computer-aided diagnosis, vol. 7963. SPIE, p 79632E

  9. Doi K (2007) Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph 31(4–5): 198–211

    Article  PubMed  Google Scholar 

  10. Duncan JS, Ayache N (2000) Medical image analysis: progress over two decades and the challenges ahead. IEEE Trans Pattern Anal Mach Intell 22(1): 85–106

    Article  Google Scholar 

  11. Engle RL (1992) Attempts to use computers as diagnostic aids in medical decision making: a thirty-year experience. Perspect Biol Med 35(2): 207–219

    PubMed  Google Scholar 

  12. Friedman C, Elstein A, Wolf F, Murphy G, Franz T, Heckerling P, Fine P, Miller T, Abraham V (1999) Enhancement of clinician’s diagnostic reasoning by computer-based consultation. J Am Med Assoc 282(19): 1851–1856

    Article  CAS  Google Scholar 

  13. Gallo L, De Pietro G, Coronato A, Marra I (2008) Toward a natural interface to virtual medical imaging environments. In: AVI ’08: Proceedings of the working conference on advanced visual interfaces, Association for Computing Machinery. New York, pp 429–432

  14. Hoffman EA, Reinhardt JM, Sonka M, Simon BA, Guo J, Saba O, Chon D, Samrah S, Shikata H, Tschirren J, Palagyi K, Beck KC, McLennan G (2003) Characterization of the interstitial lung disease via density-based and texture-based analysis of computed tomography images of lung structure and function. Acad Radiol 10(10): 1104–1118

    Article  PubMed  Google Scholar 

  15. Kelly K, Dean J, Lee SJ, Comulada W (2010) Breast cancer detection: radiologists’ performance using mammography with and without automated whole-breast ultrasound. Eur Radiol 20: 2557–2564

    Article  PubMed  Google Scholar 

  16. Keysers D, Dahmen J, Ney H, Wein BB, Lehmann TM (2003) A statistical framework for model-based image retrieval in medical applications. J Electron Imaging 12(1): 59–68

    Article  Google Scholar 

  17. King TE (2010) Approach to the adult with interstitial lung disease: clinical evaluation. In: Denise S. Basow (edn). UpToDate, Waltham, MA

  18. Kruger RP, Thompson WB, Turner AF (1974) Computer diagnosis of pneumoconiosis. IEEE Transact Syst Man Cybern SMC-4(1): 40–49

    Google Scholar 

  19. Lemaire JB, Schaefer JP, Martin LA, Faris P, Ainslie MD, Hull RD (1999) Effectiveness of the quick medical reference as a diagnostic tool. Can Med Assoc J 161(6): 725–728

    CAS  Google Scholar 

  20. Liu CT, Tai PL, Chen AYJ, Peng CH, Wang JS (2000) A content-based medical teaching file assistant for CT lung image retrieval. In: Proceedings of the IEEE international conference on electronics, circuits, systems. Jouneih-Kaslik, Lebanon, pp 361–365

  21. Mazoue JG (1990) Diagnosis without doctors. J Med Philos 15(6): 559–579

    PubMed  CAS  Google Scholar 

  22. Meyers P, Nice C, Becker H, Nettleton W, Sweeney J, Meckstroth GR (1964) Automated computer analysis of radiographic images. Radiology 83: 1029–1034

    PubMed  CAS  Google Scholar 

  23. Miller RA (1994) Medical diagnostic decision support systems-past, present, and future: a threaded bibliography and brief commentary. J Am Med Inform Assoc 1(1): 8–27

    Article  PubMed  CAS  Google Scholar 

  24. Müller H, Michoux N, Bandon D, Geissbuhler A (2004) A review of content-based image retrieval systems in medicine-clinical benefits and future directions. Int J Med Inform 73(1): 1–23

    Article  PubMed  Google Scholar 

  25. Müller H, Rosset A, Garcia A, Vallée JP, Geissbuhler A (2005) Benefits from content-based visual data access in radiology. RadioGraphics 25(3): 849–858

    Article  PubMed  Google Scholar 

  26. Nishikawa RM (2007) Current status and future directions of computer-aided diagnosis in mammography. Comput Med Imaging Graph 31(4–5): 224–235

    Article  PubMed  Google Scholar 

  27. Oliveira MC, Cirne W, de Azevedo Marques PM (2007) Towards applying content-based image retrieval in the clinical routine. Future Gener Comput Syst 23(3): 466–474

    Article  Google Scholar 

  28. Rosset A, Spadola L, Ratib O (2004) OsiriX: an open-source software for navigating in multidimensional DICOM images. J Digit Imaging 17(3): 205–216

    Article  PubMed  Google Scholar 

  29. Salgado R, Mulkens T, Bellinck P, Termote JL (2003) Volume rendering in clinical practice. a pictorial review. J Belge de Radiologie 86(4): 215–220

    CAS  Google Scholar 

  30. Sasso G, Marsiglia HR, Pigatto F, Basilicata A, Gargiulo M, Abate AF, Nappi M, Pulley J, Sasso FS (2005) A visual query-by-example image database from chest CT images: potential role as a decision and educational support tool for radiologists. J Digit Imaging 18(1): 78–84

    Article  PubMed  Google Scholar 

  31. Schroeder W, Martin K, Lorensen B (2006) The visualization toolkit—an object oriented approach to 3D graphics. 3rd edn. Kitware, Inc, Clifton park

    Google Scholar 

  32. Shyu CR, Brodley CE, Kak AC, Kosaka A, Aisen AM, Broderick LS (1999) ASSERT: a physician-in-the-loop content-based retrieval system for HRCT image databases. Comput Vis Imag Underst 75(1/2): 111–132

    Article  Google Scholar 

  33. Simel D, Drummond R (2008) The rational clinical examination: evidence-based clinical diagnosis. McGraw-Hill, NY

    Google Scholar 

  34. Sluimer IC, van Waes PF, Viergever MA, van Ginneken B (2003) Computer-aided diagnosis in high resolution CT of the lungs. Med Phys 30(12): 3081–3090

    Article  PubMed  Google Scholar 

  35. Smeulders AWM, Worring M, Santini S, Gupta A, Jain R (2000) Content-based image retrieval at the end of the early years. IEEE Trans Pattern Anal Mach Intell 22(12): 1349–1380

    Article  Google Scholar 

  36. Tao Y, Zhou XS, Bi J, Jerebkoa A, Wolf M, Salganicoff M, Krishnana A (2009) An adaptive knowledge-driven medical image search engine for interactive diffuse parenchymal lung disease quantification. In: Medical imaging 2009: computer-aided diagnosis, vol 7260. SPIE, p 726007

  37. Uchiyama Y, Katsuragawa S, Abe H, Shiraishi J, Li F, Li Q, Zhang CT, Suzuki K, Doi K (2003) Quantitative computerized analysis of diffuse lung disease in high-resolution computed tomography. Med Phys 30(9): 2440–2454

    Article  PubMed  Google Scholar 

  38. Vomweg TW (2008) Computer-aided diagnosis: clinical applications in the breast. In: Image processing in radiology, medical radiology. Berlin Heidelberg, Springer, pp 355–374

  39. Warner H, Bouhaddou O (1994) Innovation review: iliad-a medical diagnostic support program. Top Heal Inf Manag 14(4): 51–58

    Google Scholar 

  40. Webb WR, Müller NL, Naidich DP (2001) High-Resolution CT of the lung. Lippincott Williams & Wilkins, Philadelphia

    Google Scholar 

  41. Welter P, Deserno TM, Fischer B, Wein BB, Ott B, Günther RW (2009) Integration of CBIR in radiological routine in accordance with IHE. In: Medical imaging 2009: Advanced PACS-based imaging informatics and therapeutic applications, vol 7264. SPIE, p 726404

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Adrien Depeursinge.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Depeursinge, A., Vargas, A., Gaillard, F. et al. Case-based lung image categorization and retrieval for interstitial lung diseases: clinical workflows. Int J CARS 7, 97–110 (2012).

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: