Abstract
In modern medical diagnoses, classifying a patient’s disease is often realized with the help of a system-aided symptoms interpreter. Most of these systems rely on supervised learning algorithms, which can statistically extend the doctor’s logic capabilities for interpreting and examining symptoms, thus supporting the doctor to find the correct diagnosis. Besides, these algorithms compute classifier scores and class labels that are used to statistically characterize the system’s confidence level on a patient’s type of disease. Unfortunately, most classifier scores are based on an arbitrary scale but not uniformed, thus the interpretations often lack of clinical significance and evaluation criterion. Especially combining multiple classifier scores within a diagnostic system, it is essential to apply a calibration process to make the different scores comparable.
As a frequently used calibration technique, we adapted isotonic regression for our medical diagnostic support system, to provide a flexible and effective scaling process that consequently calibrates the arbitrary scales of classifiers’ scores. In a comparative evaluation, we show that our disease diagnostic system with isotonic regression can actively improve the diagnostic result based on an ensemble of classifiers, also effectively remove outliers from data, thus optimize the decision support system to obtain better diagnostic results.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Arlot, S., Celisse, A.: A survey of cross-validation procedures for model selection. Dev. Appl. Stat. 4(2010). 4079, 159–177 (2003)
Auria, L., Moro, R.A.: Support vector machines (SVM) as a technique for solvency analysis (2008)
Chen, W., Sahiner, B., Samuelson, F., Pezeshk, A., Petrick, N.: Calibration of medical diagnostic classifier scores to the probability of disease. Stat. Methods Med. Res. 27(5), 1394–1409 (2018)
Wolberg, W.H., Street, W.N., Mangasarian, O.L.: UCI machine learning repository: breast cancer wisconsin (1995). http://archive.ics.uci.edu/ml/datasets
Schmid, C.H., Griffith, J.L.: Multivariate Classification Rules: Calibration and Discrimination. American Cancer Society (2005)
Kortum, X., Grigull, L., Lechner, W., Klawonn, F.: A dynamic adaptive questionnaire for improved disease diagnostics. In: Adams, N., Tucker, A., Weston, D. (eds.) IDA 2017. LNCS, vol. 10584, pp. 162–172. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-68765-0_14
Kortum, X., Grigull, L., Muecke, U., Lechner, W., Klawonn, F.: Diagnosis support for orphan diseases: a case study using a classifier fusion method. In: Yin, H., Gao, Y., Li, B., Zhang, D., Yang, M., Li, Y., Klawonn, F., Tallón-Ballesteros, A.J. (eds.) IDEAL 2016. LNCS, vol. 9937, pp. 379–385. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46257-8_41
Liaw, A., Wiener, M.: Classification and regression by random forest. R News 2(3), 18–22 (2002)
Ma, L., Liu, X., Song, L., Zhou, C., Zhao, X., Zhao, Y.: A new classifier fusion method based on historical and on-line classification reliability for recognizing common ct imaging signs of lung diseases. Comput. Med. Imaging Graph. 40, 39–48 (2015)
Mücke, U., et al.: Patients experience in pediatric primary immunodeficiency disorders: computerized classification of questionnaires. Front. Immunol. 8, 384 (2017)
Niculescu-Mizil, A., Caruana, R.: Predicting good probabilities with supervised learning. In: Proceedings of the 22nd International Conference on Machine Learning, pp. 625–632. ACM (2005)
Pohar, M., Blas, M., Turk, S.: Comparison of logistic regression and linear discriminant analysis: a simulation study. Metod. Zv. 1(1), 143 (2004)
Sboner, A., et al.: A multiple classifier system for early melanoma diagnosis. Artif. Intell. Med. 27(1), 29–44 (2003)
Stout, Q.F.: Isotonic regression algorithms. Accessed 6 Aug 2011
Zadrozny, B., Elkan, C.: Transforming classifier scores into accurate multiclass probability estimates. In: Proceedings of the Eighth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 694–699. ACM (2002)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer Nature Switzerland AG
About this paper
Cite this paper
Kortum, X., Grigull, L., Muecke, U., Lechner, W., Klawonn, F. (2018). Improving the Decision Support in Diagnostic Systems Using Classifier Probability Calibration. In: Yin, H., Camacho, D., Novais, P., Tallón-Ballesteros, A. (eds) Intelligent Data Engineering and Automated Learning – IDEAL 2018. IDEAL 2018. Lecture Notes in Computer Science(), vol 11314. Springer, Cham. https://doi.org/10.1007/978-3-030-03493-1_44
Download citation
DOI: https://doi.org/10.1007/978-3-030-03493-1_44
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-03492-4
Online ISBN: 978-3-030-03493-1
eBook Packages: Computer ScienceComputer Science (R0)