Machine Learning

, Volume 76, Issue 2, pp 211–225

Combining instance-based learning and logistic regression for multilabel classification


DOI: 10.1007/s10994-009-5127-5

Cite this article as:
Cheng, W. & Hüllermeier, E. Mach Learn (2009) 76: 211. doi:10.1007/s10994-009-5127-5


Multilabel classification is an extension of conventional classification in which a single instance can be associated with multiple labels. Recent research has shown that, just like for conventional classification, instance-based learning algorithms relying on the nearest neighbor estimation principle can be used quite successfully in this context. However, since hitherto existing algorithms do not take correlations and interdependencies between labels into account, their potential has not yet been fully exploited. In this paper, we propose a new approach to multilabel classification, which is based on a framework that unifies instance-based learning and logistic regression, comprising both methods as special cases. This approach allows one to capture interdependencies between labels and, moreover, to combine model-based and similarity-based inference for multilabel classification. As will be shown by experimental studies, our approach is able to improve predictive accuracy in terms of several evaluation criteria for multilabel prediction.


Multilabel classification Instance-based learning Nearest neighbor classification Logistic regression Bayesian inference 
Download to read the full article text

Copyright information

© Springer Science+Business Media, LLC 2009

Authors and Affiliations

  1. 1.Department of Mathematics and Computer ScienceUniversity of MarburgMarburgGermany

Personalised recommendations