Comparison of Cost for Zero-One and Stage-Dependent Fuzzy Loss Function

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7196)


In the paper we consider the two-stage binary classifier based on Bayes rule. Assuming that both the tree structure and the feature used at each non-terminal node have been specified, we present the expected total cost. This cost is considered for two types of loss function. First is the zero-one loss function and second is the node-dependent fuzzy loss function. The work focuses on the difference between the expected total costs for these two cases of loss function in the two-stage binary classifier. The obtained results are presented on the numerical example.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Breiman, L., Friedman, J., Olshen, R., Stone, C.: Classification and regression trees. California, Wadsworth (1984)zbMATHGoogle Scholar
  2. 2.
    Burduk, R.: Classification error in Bayes multistage recognition task with fuzzy observations. Pattern Analysis and Applications 13(1), 85–91 (2010)MathSciNetCrossRefGoogle Scholar
  3. 3.
    Burduk, R.: Costs-Sensitive Classification in Multistage Classifier with Fuzzy Observations of Object Features. In: Corchado, E., Kurzyński, M., Woźniak, M. (eds.) HAIS 2011, Part II. LNCS (LNAI), vol. 6679, pp. 245–252. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  4. 4.
    Burduk, R., Kurzynski, M.: Two-stage binary classifier with fuzzy-valued loss function. Pattern Analysis and Applications 9(4), 353–358 (2006)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Campos, L., González, A.: A Subjective Approach for Ranking Fuzzy Numbers. Fuzzy Sets and Systems 29, 145–153 (1989)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Domingos, P.: MetaCost: A General Method for Making Classifiers Cost-Sensitive. In: Proceedings of the Fifth International Conference on Knowledge Discovery and Data Mining (KDD 1999), pp. 155–164 (1999)Google Scholar
  7. 7.
    Jain, R.: Decision-Making in the Presence of Fuzzy Variables. IEEE Trans. Systems Man and Cybernetics 6, 698–703 (1976)zbMATHGoogle Scholar
  8. 8.
    Knoll, U., Nakhaeizadeh, G., Tausend, B.: Cost-Sensitive Pruning of Decision Trees. In: Bergadano, F., De Raedt, L. (eds.) ECML 1994. LNCS, vol. 784, pp. 383–386. Springer, Heidelberg (1994)CrossRefGoogle Scholar
  9. 9.
    Van Leekwijck, W., Kerre, E.: Defuzzification: criteria and classification. Fuzzy Sets and Systems 108(2), 159–178 (1999)MathSciNetCrossRefzbMATHGoogle Scholar
  10. 10.
    Núñez, M.: The use of background knowledge in decision tree induction. Machine Learning 6(3), 231–250 (1991)Google Scholar
  11. 11.
    Penar, W., Woźniak, M.: Experiments on classifiers obtained via decision tree induction methods with different attribute acquisition cost limit. Advances in Soft Computing 45, 371–377 (2007)CrossRefGoogle Scholar
  12. 12.
    Penar, W., Woźniak, M.: Cost-sensitive methods of constructing hierarchical classifiers. Expert Systems 27(3), 146–155 (2010)CrossRefGoogle Scholar
  13. 13.
    Saar-Tsechansky, M., Melville, P., Provost, F.: Active feature-value acquisition. Management Science 55(4), 664–684 (2009)CrossRefGoogle Scholar
  14. 14.
    Tan, M.: Cost-sensitive learning of classification knowledge and its applications in robotics. Machine Learning 13, 7–33 (1993)Google Scholar
  15. 15.
    Turney, P.: Cost-sensitive classification: Empirical evaluation of a hybrid genetic decision tree induction algorithm. Journal of Artificial Intelligence Research 2, 369–409 (1995)Google Scholar
  16. 16.
    Viertl, R.: Statistical Methods for Non-Precise Data. CRC Press, Boca Raton (1996)zbMATHGoogle Scholar
  17. 17.
    Yang, Q., Ling, C., Chai, X., Pan, R.: Test-cost sensitive classification on data with missing values. IEEE Transactions on Knowledge and Data Engineering 18(5), 626–638 (2006)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  1. 1.Department of Systems and Computer NetworksWroclaw University of TechnologyWroclawPoland

Personalised recommendations