An Effective Combination Based on Class-Wise Expertise of Diverse Classifiers for Predictive Toxicology Data Mining
This paper presents a study on the combination of different classifiers for toxicity prediction. Two combination operators for the Multiple-Classifier System definition are also proposed. The classification methods used to generate classifiers for combination are chosen in terms of their representability and diversity and include the Instance-based Learning algorithm (IBL), Decision Tree learning algorithm (DT), Repeated Incremental Pruning to Produce Error Reduction (RIPPER), Multi-Layer Perceptrons (MLPs) and Support Vector Machine (SVM). An effective approach of combining class-wise expertise of diverse classifiers is proposed and evaluated on seven toxicity data sets. The experimental results show that the performance of the combined classifier based on our approach over seven data sets can achieve 69.24% classification accuracy on average, which is better than that of the best classifier (generated by MLP) and four combination schemes studied.
KeywordsSupport Vector Machine Combination Scheme Diverse Classifier Classifier Combination Combination Operator
Unable to display preview. Download preview PDF.
- 1.Michie, D., Spiegelhalter, D.J., Taylor, C.C.: Machine Learning, Neural and Statistical Classification. Ellis Horwood (1994)Google Scholar
- 4.Nadal, C., Legault, R., Suen, C.Y.: Complementary Algorithms for the Recognition of Totally Unconstrained Hand Written Numeral. In: Proc. of the 10th International Conference on Pattern Recognition, vol. A, pp. 434–449 (1990)Google Scholar
- 6.Zhang, B., Srihari, S.N.: Class-Wise Multi-Classifier Combination Based on Dempster-Shafer Theory. In: Proc. of ICARV (2002)Google Scholar
- 9.Guo, G., Neagu, D.: Similarity-based Classifier Combination for Decision Making. In: IEEE International Conference on Systems, Man and Cybernetics (SMC 2005), Hawail, USA, pp. 176–181 (2005)Google Scholar
- 10.Neagu, D., Palade, V.: Modular Neuro-Fuzzy Networks: An Overview of Explicit and Implicit Knowledge Integration. In: Proc. of the 15th International FLAIRS-02 Conference, Special Track on Integrated Intelligent Systems, Pensacola, Florida, USA, May 14-16, 2002, pp. 277–281. AAAI Press, Menlo Park (2002)Google Scholar
- 12.EU FP5 Quality of Life DEMETRA QLRT-2001-00691: Development of Environmental Modules for Evaluation of Toxicity of pesticide Residues in Agriculture, http://www.demetra-tox.net
- 13.CSL (Central Science Laboratory York): Development of Artificial Intelligence-based In-silico Toxicity Models for Use in Pesticide Risk Assessment (2004-2007), http://www.csl.gov.uk
- 15.Witten, I.H., Frank, G.: Data Mining: Practical Machine Learning Tools with Java Implementations. Morgan Kaufmann, San Francisco (2000)Google Scholar