Journal of Digital Imaging

, Volume 25, Issue 4, pp 497–503 | Cite as

Computer-Aided Diagnosis for Detection of Lacunar Infarcts on MR Images: ROC Analysis of Radiologists’ Performance

  • Yoshikazu Uchiyama
  • Takahiko Asano
  • Hiroki Kato
  • Takeshi Hara
  • Masayuki Kanematsu
  • Hiroaki Hoshi
  • Toru Iwama
  • Hiroshi Fujita


The purpose of this study was to retrospectively evaluate radiologist performance in detection of lacunar infarcts on T1- and T2-weighted images, without and with the use of a computer-aided diagnosis (CAD) scheme. Thirty T1-weighted and 30 T2-weighted MR images obtained from 30 patients were used for assessing observer performance. These images were acquired using the fast spin-echo sequence with a 1.5-T MR imaging scanner. The group included 15 patients (age range, 48–83 years; mean age, 67.2 years; 10 men and five women) with a lacunar infarct and 15 patients (age range, 39–76 years; mean age, 64.0 years; eight men and seven women) without lacunar infarcts. Nine radiologists participated in the study. The radiologists initially interpreted the T1- and T2-weighted images without and then with the use of CAD, which indicated their confidence levels regarding the presence (or absence) of lacunar infarcts and the most likely position of a lesion on each MR scan. The observers’ performance without and with the computer output was evaluated by performing receiver operating characteristic analysis. For the nine radiologists, the mean area under the best-fit binormal receiver operating characteristic curve plotted for unit square values of radiologists who interpreted the images without and with the scheme were 0.891 and 0.937, respectively. The performance of the radiologists improved significantly when they used the computer output (p = 0.032). The CAD scheme has potential to improve the accuracy of radiologists’ performance in detection of lacunar infarcts.


Lacunar infarct Magnetic resonance (MR) Computer-aided diagnosis (CAD) Observer study Receiver operating characteristic (ROC) 


  1. 1.
    Rosamond W, Flegal K, Furie K, et al: Heart disease and stroke statistics—2008 update: a report from the American Heart Association Statistics Committee and Stroke Statistics Subcommittee. Circulation 117:e25–e146, 2008PubMedCrossRefGoogle Scholar
  2. 2.
    Shintani S, Shiigai T, Arinami T: Silent lacunar infarction on magnetic resonance imaging (MRI): risk factors. J Neurol Sci 160:82–86, 1998PubMedCrossRefGoogle Scholar
  3. 3.
    Kobayashi S, Okada K, Koide H, et al: Subcortical silent brain infarction as a risk factor for clinical stroke. Stroke 28:1932–1939, 1997PubMedCrossRefGoogle Scholar
  4. 4.
    Vermeer SE, Hollander M, Dijk EJ, et al: Silent brain infarcts and white matter lesions increase stroke risk in the general population: the Rotterdam scan study. Stroke 34:1126–1129, 2003PubMedCrossRefGoogle Scholar
  5. 5.
    Bokura H, Kobayashi S, Yamaguchi S: Discrimination of silent lacunar infarction from enlarged Virchow-Robin spaces on brain magnetic resonance imaging: clinicopathological study. J Neurol 245:116–122, 1998PubMedCrossRefGoogle Scholar
  6. 6.
    Yokoyama R, Zhang X, Uchiyama Y, et al: Development of an automated method for detection of chronic lacunar infarct regions on brain MR images. IEICE Trans. Inf. & Syst. E90-D(6):943–954, 2007CrossRefGoogle Scholar
  7. 7.
    Uchiyama Y, Yokoyama R, Ando H, et al: Computer-aided diagnosis scheme for detection of lacunar infarcts on MR image. Acad Radiol 14(12):1554–1561, 2007PubMedCrossRefGoogle Scholar
  8. 8.
    Uchiyama Y, Yokoyama R, Asano T, et al: Improvement of automated detection method of lacunar infarcts in brain MR images. Conf. Proc. of IEEE Engineering in Medicine and Biology 2007:1599–1602, 2007Google Scholar
  9. 9.
    Free TM, Ulissey MJ: Screening mammography with computer-aided detection: prospective study of 12,860 patients in a community breast cancer. Radiology 220:781–786, 2001CrossRefGoogle Scholar
  10. 10.
    Karssemeijer N, Otten JD, Verbeek AL, et al: Computer-aided detection versus independent double reading of masses on mammograms. Radiology 227:192–200, 2003PubMedCrossRefGoogle Scholar
  11. 11.
    Gur D, Sumkin JH, Rockette HE, et al: Changes in breast cancer detection and mammography recall rates after the introduction of a computer-aided detection system. J Natl Cancer Inst 96(3):185–190, 2004PubMedCrossRefGoogle Scholar
  12. 12.
    Birdwell R, Bandodkar P, Ikeda D: Computer aided detection (CAD) with screening mammography in a university hospital setting. Radiology 236:451–457, 2005PubMedCrossRefGoogle Scholar
  13. 13.
    Morton MJ, Whaley DH, Brandt KR, et al: Screening mammograms: interpretation with computer-aided detection prospective evaluation. Radiology 239:375–383, 2006PubMedCrossRefGoogle Scholar
  14. 14.
    Dean JC, Ilvento CC: Improved cancer detection using computer-aided detection with diagnostic and screening mammography: prospective study of 104 cancers. AJR 187:20–28, 2006PubMedCrossRefGoogle Scholar
  15. 15.
    Kobayashi T, Xu XW, MacMahon H, et al: Effect of a computer-aided diagnosis scheme on radiologists’ performance in detection of lung nodules on radiographs. Radiology 199:843–848, 1996PubMedGoogle Scholar
  16. 16.
    Shiraishi J, Abe H, Engelmann R, et al: Computer-aided diagnosis to distinguish benign from malignant solitary pulmonary nodules on radiographs: ROC analysis of radiologists' performance—initial experience. Radiology 227:469–474, 2003PubMedCrossRefGoogle Scholar
  17. 17.
    Li F, Arimura H, Suzuki K, et al: Computer-aided detection of peripheral lung cancers missed at CT: ROC analyses without and with localization. Radiology 237:684–690, 2005PubMedCrossRefGoogle Scholar
  18. 18.
    Baker ME, Bogoni L, Obuchowski NA, et al: Computer-aided detection of colorectal polyps: can it improve sensitivity of less-experienced readers? Preliminary findings. Radiology 245:140–149, 2007PubMedCrossRefGoogle Scholar
  19. 19.
    Mang T, Reloschek P, Plank C, et al: Effect of computer-aided detection as a second reader in multidetector-row CT colonography. Eur Radiol 17:2598–2607, 2007PubMedCrossRefGoogle Scholar
  20. 20.
    Doi K: Computer-aided diagnosis in medical imaging: historical review, current status and future potential. Comput Med Imaging Graph 31:198–211, 2007PubMedCrossRefGoogle Scholar
  21. 21.
    Hayashi N, Masutani Y, Matsumoto T, et al: Feasibility of curvature-based enhanced display system for detecting cerebral aneurysms in MR angiography. Magnetic Resonance in Medical Science 2:29–36, 2003CrossRefGoogle Scholar
  22. 22.
    Arimura H, Li Q, Korogi Y, et al: Automated computerized scheme for detection of unruptured intracranial aneurysms in three-dimensional MRA. Acad Radiol 11(10):1093–1104, 2004PubMedCrossRefGoogle Scholar
  23. 23.
    Uchiyama Y, Ando H, Yokoyama R, et al: Computer-aided diagnosis scheme for detection of unruptured intracranial aneurysms in MR angiography. Conf. Proc. of IEEE Engineering in Medicine and Biology 3:3031–3034, 2005Google Scholar
  24. 24.
    Kobayashi S, Kondo K, Hata Y: Computer-aided diagnosis of intracranial aneurysms in MRA images with case-based reasoning. IEICE Trans. Inf. & Syst. E89-D(1):340–350, 2006CrossRefGoogle Scholar
  25. 25.
    Arimura H, Li Q, Korogi Y, et al: Computerized detection of intracranial aneurysms for three-dimensional MR angiography: feature extraction of small protrusions based on a shape-based difference image technique. Medical Physics 33(2):394–401, 2006PubMedCrossRefGoogle Scholar
  26. 26.
    Hirai T, Korogi Y, Arimura H, et al: Intracranial aneurysms at MR angiography: effect of computer-aided diagnosis on radiologists’ detection performance. Radiology 237:605–610, 2006CrossRefGoogle Scholar
  27. 27.
    Nakayama R, Uchiyama Y, Yamamoto K, et al: Computer-aided diagnosis scheme using a novel filter bank for detection of clustered microcalcifications in mammograms. IEEE Trans. on Biomedical Engineering 53(2):273–283, 2006CrossRefGoogle Scholar
  28. 28.
    Metz CE: ROC methodology in radiologic imaging. Invest Radiol 21:720–733, 1986PubMedCrossRefGoogle Scholar
  29. 29.
    Metz CE, Herman BA, Shen JH: Maximum likelihood estimation of receiver operating characteristic (ROC) curves from continuously-distributed data. Stat Med 17:1033–1053, 1998PubMedCrossRefGoogle Scholar
  30. 30.
    Pan X, Metz CE: The “proper” binormal model: parametric receiver operating characteristic curve estimation with degenerate data. Acad Radiol 4:380–389, 1997PubMedCrossRefGoogle Scholar
  31. 31.
    Hills SL, Obuchowski NA, Schartz KM, et al: A comparison of the Dorfman-Berbaum-Metz and Obuchowski-Rockette methods for receiver operating characteristic (ROC) data. Stat Med 24:1579–1607, 2005CrossRefGoogle Scholar
  32. 32.
    Hills SL, Berbaum KS: Monte Carlo validation of the Dorfman-Berbaum-Metz method using normalized pseudo values and less data-based model simplification. Acad Radiol 12:534–1541, 2005Google Scholar

Copyright information

© Society for Imaging Informatics in Medicine 2011

Authors and Affiliations

  • Yoshikazu Uchiyama
    • 1
  • Takahiko Asano
    • 2
  • Hiroki Kato
    • 2
  • Takeshi Hara
    • 3
  • Masayuki Kanematsu
    • 2
  • Hiroaki Hoshi
    • 2
  • Toru Iwama
    • 4
  • Hiroshi Fujita
    • 3
  1. 1.Department of Computer and Control EngineeringOita National College of TechnologyOita CityJapan
  2. 2.Department of Radiology, Graduate School of MedicineGifu UniversityGifuJapan
  3. 3.Department of Intelligent Image Information, Graduate School of MedicineGifu UniversityGifuJapan
  4. 4.Department of Neurosurgery, Graduate School of MedicineGifu UniversityGifuJapan

Personalised recommendations