Semantic Explanations in Ensemble Learning
A combination method is an integral part of an ensemble classifier. Existing combination methods determine the combined prediction of a new instance by relying on the predictions made by the majority of base classifiers. This can result in incorrect combined predictions when the majority predict the incorrect class. It has been noted that in group decision-making, the decision by the majority, if lacking consistency in the reasons for the decision provided by its members, could be less reliable than the minority’s decision with higher consistency in the reasons of its members. Based on this observation, in this paper, we propose a new combination method, EBCM, which considers the consistency of the features, i.e. explanations of individual predictions for generating ensemble classifiers. EBCM firstly identifies the features accountable for each base classifier’s prediction, and then uses the features to measure the consistency among the predictions. Finally, EBCM combines the predictions based on both the majority and the consistency of features. We evaluated the performance of EBCM with 16 real-world datasets and observed substantial improvement over existing techniques.
We acknowledge the University of South Australia and Data to Decisions CRC (D2DCRC) for partially funding this research.
- 9.Huang, Y.S., Suen, C.Y.: The behavior-knowledge space method for combination of multiple classifiers. In: Proceedings of CVPR, pp. 347–352. IEEE (1993)Google Scholar
- 15.Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: sentiment classification using machine learning techniques. In: Proceedings of EMNLP, pp. 79–86. ACL (2002)Google Scholar
- 18.Ribeiro, M.T., Singh, S., Guestrin, C.: “Why should I trust you?”: explaining the predictions of any classifier. In: The 22nd ACM SIGKDD, pp. 1135–1144 (2016)Google Scholar
- 24.Yan, Y., Yang, H., Wang, H.: Two simple and effective ensemble classifiers for twitter sentiment analysis. In: 2017 Computing Conference, pp. 1386–1393 (2017)Google Scholar