Abstract
In any medical domain, it is common to have more than one test (classifier) to diagnose a disease. In image analysis, for example, there is often more than one reader or more than one algorithm applied to a certain data set. Combining of classifiers is often helpful, but determining the way in which classifiers should be combined is not trivial. Standard strategies are based on learning classifier combination functions from data. We describe a simple strategy to combine results from classifiers that have not been applied to a common data set, and therefore can not undergo this type of joint training. The strategy, which assumes conditional independence of classifiers, is based on the calculation of a combined Receiver Operating Characteristic (ROC) curve, using maximum likelihood analysis to determine a combination rule for each ROC operating point. We offer some insights into the use of ROC analysis in the field of medical imaging.
This work is supported by NIH grants R01CA109246, R01LM007861, R01CA1029246 and P41RR01970.
Chapter PDF
Similar content being viewed by others
Keywords
- Receiver Operating Characteristic
- Receiver Operating Characteristic Curve
- False Positive Rate
- True Positive Rate
- Receiver Operating Characteristic Analysis
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Black, M.A., Craig, B.A.: Estimating disease prevalence in the absence of a gold standard. Stats. Med. 21(18), 2653–2669 (2002)
Chan, I., Wells III, W., Mulkern, R.V., Haker, S., Zhang, J., Zou, K.H., Maier, S.E., Tempany, C.M.: Detection of prostate cancer by integration of line-scan diffusion, t2-mapping and t2-weighted magnetic resonance imaging; a multichannel statistical classifier. Med. Phys. 30(9), 2390–2398 (2003)
Kittler, J., Hatef, M., Duin, R.P.W., Matas, J.: On combining classifiers. IEEE Trans. Pattern Anal. Mach. Intell. 20(3), 226–239 (1998)
Lasko, T.A., Bhagwat, J.G., Zou, K.H., Ohno-Machado, L.: The use of receiver operating characteristic curves in biomedical informatics. J. Biomed. Informatics (2005) (in press)
Liu, A., Schisterman, E.F., Zhu, Y.: Realisable classifiers: improving operating performance on variable cost problems. Statist. Med. 24, 37–47 (2005)
Pepe, M.S., Thompson, M.L.: Combining diagnostic test results to increase accuracy. Biostatistics 1(2), 123–140 (2000)
Scott, M., Niranjan, M., Prager, R.: Realisable classifiers: improving operating performance on variable cost problems. In: British Machine Vision Conference. BMVC (1998)
Warfield, S.K., Zou, K.H., Wells, W.M.: Simultaneous truth and performance level estimation (staple): An algorithm for the validation of image segmentation. IEEE Trans. Med. Img. 23(7), 903–921 (2004)
Zou, K.H., Wells III, W.M., Kikinis, R., Warfield, S.K.: Three validation metrics for automated probabilistic image segmentation of brain tumors. Statistics in Medicine 23, 1259–1282 (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Haker, S. et al. (2005). Combining Classifiers Using Their Receiver Operating Characteristics and Maximum Likelihood Estimation. In: Duncan, J.S., Gerig, G. (eds) Medical Image Computing and Computer-Assisted Intervention – MICCAI 2005. MICCAI 2005. Lecture Notes in Computer Science, vol 3749. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11566465_63
Download citation
DOI: https://doi.org/10.1007/11566465_63
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-29327-9
Online ISBN: 978-3-540-32094-4
eBook Packages: Computer ScienceComputer Science (R0)