Multi-label Lazy Associative Classification

  • Adriano Veloso
  • Wagner MeiraJr.
  • Marcos Gonçalves
  • Mohammed Zaki
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4702)


Most current work on classification has been focused on learning from a set of instances that are associated with a single label (i.e., single-label classification). However, many applications, such as gene functional prediction and text categorization, may allow the instances to be associated with multiple labels simultaneously. Multi-label classification is a generalization of single-label classification, and its generality makes it much more difficult to solve.

Despite its importance, research on multi-label classification is still lacking. Common approaches simply learn independent binary classifiers for each label, and do not exploit dependencies among labels. Also, several small disjuncts may appear due to the possibly large number of label combinations, and neglecting these small disjuncts may degrade classification accuracy. In this paper we propose a multi-label lazy associative classifier, which progressively exploits dependencies among labels. Further, since in our lazy strategy the classification model is induced on an instance-based fashion, the proposed approach can provide a better coverage of small disjuncts. Gains of up to 24% are observed when the proposed approach is compared against the state-of-the-art multi-label classifiers.


  1. 1.
    Boutell, M., Luo, J., Shen, X., Brown, C.: Learning multi-label scene classification. Pattern Recognition 37, 1757–1771 (2004)CrossRefGoogle Scholar
  2. 2.
    Comité, F., Gilleron, R., Tommasi, M.: Learning multi-label alternating decision trees from texts and data. In: Proc. of the Intl. Conf. on Machine Learning and Data Mining in Pattern Recognition, pp. 35–49 (2003)Google Scholar
  3. 3.
    Elisseeff, A., Weston, J.: A kernel method for multi-labelled classification. Advances in Neural Information Processing Systems 14, 681–687 (2001)Google Scholar
  4. 4.
    Holte, R., Acker, L., Porter, B.: Concept learning and the problem of small disjuncts. In: Proc. of the Intl. Joint Conf. on Artificial Intelligence, pp. 813–818 (1989)Google Scholar
  5. 5.
    Schapire, R., Singer, Y.: Boostexter: A boosting-based system for text categorization. Machine Learning 39, 135–168 (2000)zbMATHCrossRefGoogle Scholar
  6. 6.
    Thabtah, F., Cowling, P., Peng, Y.: Multiple labels associative classification. Knowledge and Information Systems 9, 109–129 (2006)CrossRefGoogle Scholar
  7. 7.
    Zhang, M., Zhou, Z.: Ml-knn: A lazy learning approach to multi-label learning. Pattern Recognition 40, 2038–2048 (2007)zbMATHCrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • Adriano Veloso
    • 1
  • Wagner MeiraJr.
    • 1
  • Marcos Gonçalves
    • 1
  • Mohammed Zaki
    • 2
  1. 1.Computer Science Department, Universidade Federal de Minas GeraisBrazil
  2. 2.Computer Science Department, Rensselaer Polytechnic InstituteUSA

Personalised recommendations