Abstract
Application of computer-based expert systems to diagnostic medical problems has been described in many areas including clinical diagnosis and radiology. Expert systems are computer programs that contain encoded expert knowledge to provide expert advice. A modified observer-performance study was done comparing the efficacy of the Radiology Image Interpretation System (RIIS), an expert system that diagnoses focal bone abnormalities, and radiology residents on a known set of 44 abnormal and 10 normal cases. Modified receiver operating characteristic curves for four inexperienced residents, five experienced residents, and RIIS were generated using the set of known radiographs. The true-positive rates of RIIS and the residents at false-positive rates of 0.05, 0.15, and 0.20 were estimated using the modified receiver operating characteristics curve and were compared using a pairedt test. On the average, the RIIS system was less accurate when compared with experienced and inexperienced residents but the difference was only significant for experienced residents at a false-positive rate of 0.05. RIIS performed better than inexperienced residents when RIIS was used by experienced residents but this difference was not significant.
Article PDF
Similar content being viewed by others
References
de Vries PH, de Vries Robbe PF: An overview of medical expert systems. Methods Inf Med 24(2):57–64, 1985
Swett HA, Fisher PR, Cohn AI, et al: Expert system— Controlled image display. Radiology 172:487–493, 1989
Piraino D, Richmond B, Uetani M, et al: Problems in applying expert system technology to radiographic image interpretation. J Digit Imag 1(2):21–26, 1989
Lodwick GS, Haun CL, Smith WE, et al: Computer diagnosis of primary bone tumors: A preliminary report. Radiology 80:273–275, 1963
Miller RA, Pople HE, Myers JD: Internist-I, an experimental computer-based diagnostic consultant for general internal medicine. N Engl J Med 307:468–476, 1982
Swets JA, Pickett RM, Whitehead SF, et al: Assessment of diagnostic technologies. Science 205:753–759, 1979
Metz CE: Some practical issues of experimental design and data analysis in radiological ROC studies. Invest Radiol 24:234–245, 1989
Adlasing KP, Scheithauer W: Performance evaluation of medical expert systems using ROC curves. Comput Biomed Res 22:297–313, 1989
Swets JA, Pickett RM: Evaluation of diagnostic systems: Methods from signal detection theory. New York, NY, Academic, 1982, 51–58
Dorfman DD, Alf E: Maximum likelihood estimation of parameters of signal detection theory and determination of confidence interval-rating data. J Math Psych 6:487–496, 1969
Lundsgaarde HP: Evaluating medical expert systems. Soc Sci Med 24(10):805–819, 1987
Virtama P, Katevuo K, Makela P, et al: Computeraided diagnosis of bone tumors. Acta Radiol Diag 20:70–74, 1979
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Piraino, D., Richmond, B., Schluchter, M. et al. Radiology Image Interpretation System: Modified observer performance study of an image interpretation expert system. J Digit Imaging 4, 94–101 (1991). https://doi.org/10.1007/BF03170417
Issue Date:
DOI: https://doi.org/10.1007/BF03170417