An Effective Combination of Multiple Classifiers for Toxicity Prediction

  • Gongde Guo
  • Daniel Neagu
  • Xuming Huang
  • Yaxin Bi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4223)


The performance of individual classifiers applied to complex data sets has for predictive toxicology a significant importance. An investigation was conducted to improve classification performance of combinations of classifiers. For this purpose some representative classification methods for individual classifier development have been used to assure a good range for model diversity. The paper proposes a new effective multi-classifier system based on Dempster’s rule of combination of individual classifiers. The performance of the new method has been evaluated on seven toxicity data sets. The classification accuracy of the proposed combination models achieved, according to our initial experiments, 2.97% better average than that of the best individual classifier among five classification methods (Instance-based Learning algorithm, Decision Tree, Repeated Incremental Pruning to Produce Error Reduction, Multi-Layer Perceptrons and Support Vector Machine) studied.


Support Vector Machine Class Label Mass Function Feature Subset Combination Method 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Xu, L., Krzyzak, A., Suen, C.Y.: Several Methods for Combining Multiple Classifiers and Their Applications in Handwritten Character Recognition. IEEE Trans. on System, Man and Cybernetics 22(3), 418–435 (1992)CrossRefGoogle Scholar
  2. 2.
    Denoeux, T.: A neural Network Classifier based on Dempster-Shafer Theory. IEEE transactions on Systems, Man and Cybernetics A 30(2), 131–150 (2000)CrossRefMathSciNetGoogle Scholar
  3. 3.
    Yang, Y., Ault, T., Pierce, T.: Combining Multiple Learning Strategies for Effective Cross Validation. In: Proc. of The Seventeenth International Conference on Machine Learning (ICML 2000), pp. 1167–1182 (2000)Google Scholar
  4. 4.
    Bi, Y., Bell, D., Wang, H., Guo, G., et al.: Combining Multiple Classifiers for Text Categorization using Dempster-Shafer Theory of Evidence. In: Torra, V., Narukawa, Y. (eds.) MDAI 2004. LNCS (LNAI), vol. 3131, pp. 127–138. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  5. 5.
    Guo, G., Neagu, D.: Similarity-based Classifier Combination for Decision Making. In: Proc. of IEEE International Conference on Systems, Man and Cybernetics, pp. 176–181 (2005)Google Scholar
  6. 6.
    Benfenati, E., Mazzatorta, P., Neagu, D., Gini, G.: Combining Classifiers of Pesticides Toxicity through a Neuro-fuzzy Approach. In: Roli, F., Kittler, J. (eds.) MCS 2002. LNCS, vol. 2364, p. 293. Springer, Heidelberg (2002)CrossRefGoogle Scholar
  7. 7.
    Ho, T.K.: Multiple Classifier Combination: Lessons and Next Steps, Tin Kam Ho. In: Kandel, A., Bunke, H. (eds.) Hybrid Methods in Pattern Recognition, pp. 171–198. World Scientific, Singapore (2002)CrossRefGoogle Scholar
  8. 8.
    Guo, G., Neagu, D., Cronin, M.T.D.: Using kNN Model for Automatic Feature Selection. In: Singh, S., Singh, M., Apte, C., Perner, P. (eds.) ICAPR 2005. LNCS, vol. 3686, pp. 410–419. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  9. 9.
    Li, Y.H., Jain, A.K.: Classification of Text Documents. The Computer Journal 41(8), 537–546 (1998)MATHCrossRefGoogle Scholar
  10. 10.
    Guan, J.W., Bell, D.: Evidence Theory and its applications, vol. 1&2 (1991)Google Scholar
  11. 11.
    EU FP5 Quality of Life DEMETRA QLRT-2001-00691: Development of Environmental Modules for Evaluation of Toxicity of pesticide Residues in AgricultureGoogle Scholar
  12. 12.
    CSL: Development of artificial intelligence-based in-silico toxicity models for use in pesticide risk assessment (2004-2007)Google Scholar
  13. 13.
    Schultz, T.W.: TETRATOX: Tetrahymena pyriformis population growth impairment endpoint-A surrogate for fish lethality. Toxicol. Methods 7, 289–309 (1997)CrossRefGoogle Scholar
  14. 14.
    Witten, I.H., Frank, G.: Data Mining: Practical Machine Learning Tools with Java Implementations. Morgan Kaufmann, San Francisco (2000)Google Scholar
  15. 15.
    Snedecor, G.W., Cochran, W.G.: Statistical Methods. Iowa State University Press (1989)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Gongde Guo
    • 1
    • 2
  • Daniel Neagu
    • 2
  • Xuming Huang
    • 1
    • 2
  • Yaxin Bi
    • 3
  1. 1.Dept. of Computer ScienceFujian Normal Univ.FuzhouChina
  2. 2.Dept. of ComputingUniv. of BradfordBradfordUK
  3. 3.School of Computing and MathematicsUniv. of UlsterUK

Personalised recommendations