An Effective Combination Based on Class-Wise Expertise of Diverse Classifiers for Predictive Toxicology Data Mining

  • Daniel Neagu
  • Gongde Guo
  • Shanshan Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4093)


This paper presents a study on the combination of different classifiers for toxicity prediction. Two combination operators for the Multiple-Classifier System definition are also proposed. The classification methods used to generate classifiers for combination are chosen in terms of their representability and diversity and include the Instance-based Learning algorithm (IBL), Decision Tree learning algorithm (DT), Repeated Incremental Pruning to Produce Error Reduction (RIPPER), Multi-Layer Perceptrons (MLPs) and Support Vector Machine (SVM). An effective approach of combining class-wise expertise of diverse classifiers is proposed and evaluated on seven toxicity data sets. The experimental results show that the performance of the combined classifier based on our approach over seven data sets can achieve 69.24% classification accuracy on average, which is better than that of the best classifier (generated by MLP) and four combination schemes studied.


Support Vector Machine Combination Scheme Diverse Classifier Classifier Combination Combination Operator 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Michie, D., Spiegelhalter, D.J., Taylor, C.C.: Machine Learning, Neural and Statistical Classification. Ellis Horwood (1994)Google Scholar
  2. 2.
    Ho, T.K., Hull, J.J., Srihari, S.N.: Decision Combination in Multiple Classifier Systems. IEEE Transactions on Pattern Analysis and Machine Intelligence 16(1), 66–75 (1994)CrossRefGoogle Scholar
  3. 3.
    Baykut, A., Ercil, A.: Towards Automated Classifier Combination for Pattern Recognition. In: Windeatt, T., Roli, F. (eds.) MCS 2003. LNCS, vol. 2709, pp. 94–105. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  4. 4.
    Nadal, C., Legault, R., Suen, C.Y.: Complementary Algorithms for the Recognition of Totally Unconstrained Hand Written Numeral. In: Proc. of the 10th International Conference on Pattern Recognition, vol. A, pp. 434–449 (1990)Google Scholar
  5. 5.
    Saerens, M., Fouss, F.: Yet Another Method for Combining Classifiers Outputs: A Maximum Entropy Approach. In: Roli, F., Kittler, J., Windeatt, T. (eds.) MCS 2004. LNCS, vol. 3077, pp. 82–91. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  6. 6.
    Zhang, B., Srihari, S.N.: Class-Wise Multi-Classifier Combination Based on Dempster-Shafer Theory. In: Proc. of ICARV (2002)Google Scholar
  7. 7.
    Bi, Y., Bell, D., Wang, H., Guo, G., Greer, K.: Combining Multiple Classifiers Using Dempster-Shafer’s Rule for Text Categorization. In: Torra, V., Narukawa, Y. (eds.) MDAI 2004. LNCS (LNAI), vol. 3131, pp. 127–138. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    Xu, L., Krzyzak, A., Suen, C.: Methods of Combination Multiple Classifiers and Their Applications to Handwritten Recognition. IEEE Transactions on Systems, Man and Cybernetics SMC-22(3), 418–435 (1992)CrossRefGoogle Scholar
  9. 9.
    Guo, G., Neagu, D.: Similarity-based Classifier Combination for Decision Making. In: IEEE International Conference on Systems, Man and Cybernetics (SMC 2005), Hawail, USA, pp. 176–181 (2005)Google Scholar
  10. 10.
    Neagu, D., Palade, V.: Modular Neuro-Fuzzy Networks: An Overview of Explicit and Implicit Knowledge Integration. In: Proc. of the 15th International FLAIRS-02 Conference, Special Track on Integrated Intelligent Systems, Pensacola, Florida, USA, May 14-16, 2002, pp. 277–281. AAAI Press, Menlo Park (2002)Google Scholar
  11. 11.
    Kuncheva, L.I.: Combining Classifiers: Soft Computing Solutions. In: Pal, S.K. (ed.) Pattern Recognition: From Classical to Modern Approaches, pp. 427–452. World Scientific, Singapore (2001)CrossRefGoogle Scholar
  12. 12.
    EU FP5 Quality of Life DEMETRA QLRT-2001-00691: Development of Environmental Modules for Evaluation of Toxicity of pesticide Residues in Agriculture,
  13. 13.
    CSL (Central Science Laboratory York): Development of Artificial Intelligence-based In-silico Toxicity Models for Use in Pesticide Risk Assessment (2004-2007),
  14. 14.
    Schultz, T.W.: TETRATOX: Tetrahymena Pyriformis Population Growth Impairment Endpoint - A Surrogate for Fish Lethality. Toxicol. Methods 7, 289–309 (1997)CrossRefGoogle Scholar
  15. 15.
    Witten, I.H., Frank, G.: Data Mining: Practical Machine Learning Tools with Java Implementations. Morgan Kaufmann, San Francisco (2000)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Daniel Neagu
    • 1
  • Gongde Guo
    • 1
    • 2
  • Shanshan Wang
    • 3
  1. 1.Dept. of ComputingUniv. of BradfordBradfordUK
  2. 2.Dept. of Computer ScienceFujian Normal Univ.FuzhouChina
  3. 3.Dept. of Computer ScienceNanjing Univ. of Aeronautics and AstronauticsChina

Personalised recommendations