A Simple Approach to Incorporate Label Dependency in Multi-label Classification
In multi-label classification, each example can be associated with multiple labels simultaneously. The task of learning from multi-label data can be addressed by methods that transform the multi-label classification problem into several single-label classification problems. The binary relevance approach is one of these methods, where the multi-label learning task is decomposed into several independent binary classification problems, one for each label in the set of labels, and the final labels for each example are determined by aggregating the predictions from all binary classifiers. However, this approach fails to consider any dependency among the labels. In this paper, we consider a simple approach which can be used to explore labels dependency aiming to accurately predict label combinations. An experimental study using decision trees, a kernel method as well as Naïve Bayes as base-learning techniques shows the potential of the proposed approach to improve the multi-label classification performance.
Keywordsmachine learning multilabel classification binary relevance label dependency
Unable to display preview. Download preview PDF.
- 1.Qi, G.J., Hua, X.S., Rui, Y., Tang, J., Mei, T., Zhang, H.J.: Correlative multi-label video annotation. In: MULTIMEDIA 2007: Proceedings of the 15th International Conference on Multimedia, pp. 17–26. ACM, New York (2007)Google Scholar
- 3.Blockeel, H., Schietgat, L., Struyf, J., Džeroski, S., Clare, A.: Decision trees for hierarchical multilabel classification: A case study in functional genomics. In: Fürnkranz, J., Scheffer, T., Spiliopoulou, M. (eds.) PKDD 2006. LNCS (LNAI), vol. 4213, pp. 18–29. Springer, Heidelberg (2006)CrossRefGoogle Scholar
- 4.Trohidis, K., Tsoumakas, G., Kalliris, G., Vlahavas, I.: Multilabel classification of music into emotions. In: ISMIR 2008: 9th International Conference on Music Information Retrieval, pp. 325–330 (2008)Google Scholar
- 5.Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining multi-label data. In: Data Mining and Knowledge Discovery Handbook, pp. 1–19 (2009)Google Scholar
- 8.Kang, F., Jin, R., Sukthankar, R.: Correlated label propagation with application to multi-label learning. In: CVPR, vol. (2), pp. 1719–1726. IEEE Computer Society, Los Alamitos (2006)Google Scholar