Neural Network Ensemble Based on Feature Selection for Non-Invasive Recognition of Liver Fibrosis Stage
Contemporary medicine concentrates on providing high quality diagnostic services, yet it should not be forgotten that the comfort of the patient during the examination is also of high importance. Therefore non-invasive methods that allows to precisely predict the state of the disease are currently one of the key issues in the medical business. The paper presents a novel ensemble of neural networks applied to recognition of liver fibrosis stage from indirect examination method. Several neural network models are build on the basis of outputs of different feature selection algorithms. Then an ensemble pruning procedure with the usage of diversity measures is conducted in order to eliminate redundant predictors from the pool. Finally the weights of classifiers in the fusion process are assessed to establish their influence on the output of the whole ensemble. Proposed method is compared with several state-of-the-art ensemble methods. Extensive experimental investigations, carried out on a dataset collected by authors, show that the proposed method achieve a satisfactory level of the fibrosis level recognition, outperforming other machine learning algorithms and thus may be used as a real-time medical decision support system for this task.
Keywordsmachine learning multiple classifier system neural network feature selection trained fuser diversity medical informatics liver fibrosis.
- 5.Guyon, I., Gunn, S., Nikravesh, M., Zadeh L. (eds.): Feature Extraction, Foundations and Applications. Springer, Heidelberg (2006)Google Scholar
- 10.Krawczyk, B., Woźniak, M., Orczyk, T., Porwik, P., Musialik, J., Błońska-Fajfrowska, B.: Classification techniques for non-invasive recognition of liver fibrosis stage. J. Med. Inform. Technol. 20, 121–127 (2012)Google Scholar
- 11.Krawczyk, B., Woźniak, M.: Combining diverse one-class classifiers. In: Corchado, E., Snasel, V., Abraham, A., Wozniak, M., Grana, M., Cho, S-B. (eds.) Hybrid Artificial Intelligent Systems, volume 7209 of Lecture Notes in Computer Science, pp. 590–601. Springer, Berlin (2012)Google Scholar
- 13.Orczyk, T., Pałys, M., Porwik, P., Musialik, J., Błońska-Fajfrowska, B.: Simple and non-invasive liver fibrosis stage prediction method. J. Med. Inform. Technol. 17, 227–232 (2011)Google Scholar
- 14.Rokach, L.: Pattern Classification Using Ensemble Methods. Series in Machine Perception and Artificial Intelligence. World Scientific Publishing, Singapore (2010)Google Scholar
- 15.R Development Core Team: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2008)Google Scholar
- 18.Wolpert, DH.: The supervised learning no-free-lunch theorems. In: Proceedings of the 6th Online World Conference on Soft Computing in Industrial Applications, pp. 25–42 (2001)Google Scholar
- 19.Michal Wozniak. Experiments with trained and untrained fusers. In Emilio Corchado, Juan Corchado, and Ajith Abraham, editors, Innovations in Hybrid Intelligent Systems, volume 44 of Advances in Soft Computing, pages 144–150. Springer Berlin / Heidelberg, 2007.Google Scholar
- 20.Wozniak, Michal, Zmyslony, Marcin: Combining classifiers using trained fuser—analytical and experimental results. Neural Netw. World 13(7), 925–934 (2010)Google Scholar
- 21.Yu, L., Liu, H.: Feature selection for high-dimensional data: a fast correlation-based filter solution. In: Proceedings of the Twentieth International Conference on Machine Learning, vol. 2, pp. 856–863 (2003)Google Scholar
- 23.Zmyslony, M., Krawczyk, B., Wozniak, M.: Combined classifiers with neural fuser for spam detection. In: Herrero, A., Snasel, V., Abraham, A., Zelinka, I., Baruque, B., Quintin, H, Calvo, JL., Sedano, J., Corchado, E. (eds.) International Joint Conference CISIS12-ICEUTE12-SOCO12 Special Sessions, volume 189 of Advances in Intelligent Systems and Computing, pp. 245–252. Springer, Heidelberg (2012)Google Scholar