Cost-Sensitive Splitting and Selection Method for Medical Decision Support System

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7435)


The paper presents a cost-sensitive modification of the Adaptive Splitting and Selection (AdaSS) algorithm, which trains a combined classifier based on a feature space partitioning. In this study the algorithm considers constraints put on the cost of selected features, which are one of the key-problems in the clinical decision support systems. The modified version takes into consideration both the overall classification accuracy and the cost constraints, returning balanced solution for the problem at hand. Proposed method was evaluated on the basis of computer experiments run on cost-sensitive medical benchmark datasets.


machine learning multiple classifier system cost-sensitive classification clustering and selection evolutionary algorithm feature selection 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Alpaydin, E.: Introduction to Machine Learning, 2nd edn. The MIT Press (2010)Google Scholar
  2. 2.
    Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification, 2nd edn. Wiley, New York (2001)zbMATHGoogle Scholar
  3. 3.
    Frank, A., Asuncion, A.: UCI machine learning repository (2010),
  4. 4.
    Jackowski, K., Wozniak, M.: Algorithm of designing compound recognition system on the basis of combining classifiers with simultaneous splitting feature space into competence areas. Pattern Analysis and Applications 12(4), 415–425 (2009)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Jain, A.K., Murty, M.N., Flynn, P.J.: Data clustering: a review. ACM Comput. Surv. 31, 264–323 (1999)CrossRefGoogle Scholar
  6. 6.
    Krawczyk, B., Woźniak, M.: Designing Cost-Sensitive Ensemble – Genetic Approach. In: Choraś, R.S. (ed.) Image Processing and Communications Challenges 3. AISC, vol. 102, pp. 227–234. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  7. 7.
    Kuncheva, L.I.: Combining Pattern Classifiers: Methods and Algorithms. Wiley-Interscience (2004)Google Scholar
  8. 8.
    Lirov, Y., Yue, O.-C.: Automated network troubleshooting knowledge acquisition. Applied Intelligence 1, 121–132 (1991)CrossRefGoogle Scholar
  9. 9.
    Michalewicz, Z.: Genetic algorithms + data structures = evolution programs, 3rd edn. Springer, London (1996)zbMATHGoogle Scholar
  10. 10.
    Núñez, M.: The use of background knowledge in decision tree induction. Mach. Learn. 6(3), 231–250 (1991)Google Scholar
  11. 11.
    Núñez, M.: Economic induction: A case study. In: EWSL, pp. 139–145 (1988)Google Scholar
  12. 12.
    Penar, W., Wozniak, M.: Cost-sensitive methods of constructing hierarchical classifiers. Expert Systems 27(3), 146–155 (2010)CrossRefGoogle Scholar
  13. 13.
    Peng, Y.H., Huang, Q., Jiang, P., Jiang, J.: Cost-Sensitive Ensemble of Support Vector Machines for Effective Detection of Microcalcification in Breast Cancer Diagnosis. In: Wang, L., Jin, Y. (eds.) FSKD 2005, Part II. LNCS (LNAI), vol. 3614, pp. 483–493. Springer, Heidelberg (2005)CrossRefGoogle Scholar
  14. 14.
    Tan, M., Schlimmer, J.C.: Cost-sensitive concept learning of sensor use in approach and recognition. In: Proceedings of the Sixth International Workshop on Machine Learning, pp. 392–395. Morgan Kaufmann Publishers Inc., San Francisco (1989)Google Scholar
  15. 15.
    R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria (2008)Google Scholar
  16. 16.
    Verdenius, F.: A method for inductive cost optimization. In: Kodratoff, Y. (ed.) EWSL 1991. LNCS, vol. 482, pp. 179–191. Springer, Heidelberg (1991)CrossRefGoogle Scholar
  17. 17.
    Wozniak, M., Krawczyk, B.: Combined classifier based on feature space partitioning. Journal of Applied Mathematics and Computer Science 22(4) (in press, to appear, 2012)Google Scholar
  18. 18.
    Wozniak, M., Zmyslony, M.: Combining classifiers using trained fuser - analytical and experimental results. Neural Network World 13(7), 925–934 (2010)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  1. 1.Department of Systems and Computer NetworksWroclaw University of TechnologyWroclawPoland

Personalised recommendations