An Evidence Theoretic Ensemble Design Technique
Ensemble design techniques based on resampling the training set are successfully used to improve the classification accuracies of the base classifiers. In Boosting technique, each training set is obtained by drawing samples with replacement from the available training set according to a weighted distribution which is iteratively updated for generating new classifiers for the ensemble. The resultant classifiers are accurate in different parts of the input space mainly specified the sample weights. In this study, a dynamic integration of boosting based ensembles is proposed so as to take into account the heterogeneity of the input sets. In this approach, a Dempster-Shafer theory based framework is developed to consider the training sample distribution in the restricted input space of each test sample. The effectiveness of the proposed technique is compared to AdaBoost algorithm using nearest mean type base classifier.
KeywordsTraining Sample Base Classifier Belief Structure Focal Element Basic Probability Assignment
Unable to display preview. Download preview PDF.
- A. Tsymbal and S. Puuronen. Bagging and boosting with dynamic integration of classifiers. Principles of Data Mining and Knowledge Discovery, Proceedings of PKDD 2000, pages 116–125, 2000.Google Scholar
- G. Shafer. A Mathematical Theory of Evidence. Princeton University Press, 1976.Google Scholar
- R. P. W. Duin. PRTOOLS (version 4). A Matlab toolbox for pattern recognition. Pattern Recognition Group, Delft University, Netherlands, 2004.Google Scholar