Costs-Sensitive Classification in Two-Stage Binary Classifier

Conference paper
Part of the Advances in Intelligent and Soft Computing book series (AINSC, volume 102)


In the paper the problem of cost in the two-stage binary classifier is presented. Assuming that both the tree structure and the feature used at each non-terminal node have been specified, we present the expected total cost for two cases. The first one concerns the zero-one loss function, the second concerns the stage-dependent loss function. The work focuses on the difference between the expected total costs for these two cases of loss function. Obtained results relate to the globally optimal strategy of Bayes multistage classifier.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Breiman, L., Friedman, J., Olshen, R., Stone, C.: Classification and regression trees. California, Wadsworth (1984)zbMATHGoogle Scholar
  2. 2.
    Burduk, R.: Classification error in Bayes multistage recognition task with fuzzy observations. Pattern Analysis and Applications 13(1), 85–91 (2010)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Burduk, R.: Costs-sensitive classification in multistage classifier with fuzzy observations of object features. In: Corchado, E., Kurzyński, M., Woźniak, M. (eds.) HAIS 2011, Part II. LNCS, vol. 6679, pp. 245–252. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  4. 4.
    Knoll, U., Nakhaeizadeh, G., Tausend, B.: Cost-sensitive pruning of decision trees. In: Bergadano, F., De Raedt, L. (eds.) ECML 1994. LNCS, vol. 784, pp. 383–386. Springer, Heidelberg (1994)Google Scholar
  5. 5.
    Núñez, M.: The use of background knowledge in decision tree induction. Machine Learning 6(3), 231–250 (1991)Google Scholar
  6. 6.
    Penar, W., Woźniak, M.: Experiments on classifiers obtained via decision tree induction methods with different attribute acquisition cost limit. AISC, vol. 45, pp. 371–377 (2007)Google Scholar
  7. 7.
    Penar, W., Woźniak, M.: Cost-sensitive methods of constructing hierarchical classifiers. Expert Systems 27(3), 146–155 (2010)CrossRefGoogle Scholar
  8. 8.
    Saar-Tsechansky, M., Melville, P., Provost, F.: Active feature-value acquisition. Management Science 55(4), 664–684 (2009)CrossRefGoogle Scholar
  9. 9.
    Tan, M.: Cost-sensitive learning of classification knowledge and its applications in robotics. Machine Learning 13, 7–33 (1993)Google Scholar
  10. 10.
    Turney, P.: Cost-sensitive classificcation: Empirical evaluation of a hybrid genetic decision tree induction algorithm. Journal of Artificial Intelligence Research 2, 369–409 (1995)Google Scholar
  11. 11.
    Yang, Q., Ling, C., Chai, X., Pan, R.: Test-cost sensitive classification on data with missing values. IEEE Transactions on Knowledge and Data Engineering 18(5), 626–638 (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  1. 1.Department of Systems and Computer NetworksWroclaw University of TechnologyWroclawPoland

Personalised recommendations