An Extension of Multi-label Binary Relevance Models Based on Randomized Reference Classifier and Local Fuzzy Confusion Matrix

Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9375)


In this paper we addressed the issue of applying a stochastic classifier and a local, fuzzy confusion matrix under the framework of multi-label classification. We proposed a novel solution to the problem of correcting Binary Relevance ensembles. The main step of the correction procedure is to compute label-wise competence and cross-competence measures, which model error pattern of the underlying classifier. The method was evaluated using 20 benchmark datasets. In order to assess the efficiency of the introduced model, it was compared against 3 state-of-the-art approaches. The comparison was performed using 4 different evaluation measures. Although the introduced algorithm, as its base algorithm – Binary Relevance, is insensitive to dependencies between labels, the conducted experimental study reveals that the proposed algorithm outperform other methods in terms of Hamming-loss and False Discovery Rate.


Multi-label classification Binary relevance Confusion matrix 



Computational resources were provided by PL-Grid Infrastructure.


  1. 1.
    Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining multi-label data. In: Maimon, O., Rokach, L. (eds.) Data Mining and Knowledge Discovery Handbook, pp. 667–685. Springer, Heidelberg (2009)CrossRefGoogle Scholar
  2. 2.
    Zhang, M.L., Zhou, Z.H.: Multilabel neural networks with applications to functional genomics and text categorization. IEEE Trans. Knowl. Data Eng. 18, 1338–1351 (2006)CrossRefGoogle Scholar
  3. 3.
    Zhou, Z.-h., Zhang, M.-l.: Multi-instance multilabel learning with application to scene classification. In: Advances in Neural Information Processing Systems 19 (2007)Google Scholar
  4. 4.
    Wu, J.S., Huang, S.J., Zhou, Z.H.: Genome-wide protein function prediction through multi-instance multi-label learning. IEEE/ACM Trans. Comput. Biol. and Bioinf. 11, 891–902 (2014)CrossRefGoogle Scholar
  5. 5.
    Dembczyński, K., Waegeman, W., Cheng, W., Hüllermeier, E.: On label dependence and loss minimization in multi-label classification. Mach. Learn. 88, 5–45 (2012)MathSciNetCrossRefzbMATHGoogle Scholar
  6. 6.
    Pillai, I., Fumera, G., Roli, F.: Threshold optimisation for multi-label classifiers. Pattern Recognit. 46, 2055–2065 (2013)CrossRefzbMATHGoogle Scholar
  7. 7.
    Cherman, A.E., Metz, J., Monard, M.C.: A simple approach to incorporate label dependency in multi-label classification. In: Sidorov, G., Hernández Aguirre, A., García, C.A.R. (eds.) MICAI 2010, Part II. LNCS, vol. 6438, pp. 33–43. Springer, Heidelberg (2010) CrossRefGoogle Scholar
  8. 8.
    Read, J., Pfahringer, B., Holmes, G., Frank, E.: Classifier chains for multi-label classification. Mach. Learn. 85, 333–359 (2011)MathSciNetCrossRefGoogle Scholar
  9. 9.
    Read, J., Martino, L., Luengo, D.: Efficient monte carlo methods for multi-dimensional learning with classifier chains. Pattern Recognit. 47, 1535–1546 (2014)CrossRefzbMATHGoogle Scholar
  10. 10.
    Woloszynski, T., Kurzynski, M.: A probabilistic model of classifier competence for dynamic ensemble selection. Pattern Recognit. 44, 2656–2668 (2011)CrossRefzbMATHGoogle Scholar
  11. 11.
    Zadeh, L.: Fuzzy sets. Inf. Control 8, 338–353 (1965)CrossRefzbMATHGoogle Scholar
  12. 12.
    Hand, D.J., Yu, K.: Idiot’s bayes: not so stupid after all? Int. Stat. Rev. Revue Internationale de Statistique 69, 385 (2001)zbMATHGoogle Scholar
  13. 13.
    Tsoumakas, G., Spyromitros-Xioufis, E., Vilcek, J., Vlahavas, I.: Mulan: a java library for multi-label learning. J. Mach. Learn. Res. 12, 2411–2414 (2011)MathSciNetzbMATHGoogle Scholar
  14. 14.
    Read, J., Peter, R.: (Meka. Accessed 29-03-2015
  15. 15.
    Kuncheva, L.I.: Combining Pattern Classifiers: Methods and Algorithms, 1st edn. Wiley Interscience, Hoboken (2004) CrossRefzbMATHGoogle Scholar
  16. 16.
    Luaces, O., Díez, J., Barranquero, J., del Coz, J.J., Bahamonde, A.: Binary relevance efficacy for multilabel classification. Prog. Artif. Intell. 1, 303–313 (2012)CrossRefGoogle Scholar
  17. 17.
    Demšar, J.: Statistical comparisons of classifiers over multiple data sets. J. Mach. Learn. Res. 7, 1–30 (2006)MathSciNetzbMATHGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  1. 1.Department of Systems and Computer NetworksWroclaw University of TechnologyWroclawPoland

Personalised recommendations