Learning and Inference in Probabilistic Classifier Chains with Beam Search

  • Abhishek Kumar
  • Shankar Vembu
  • Aditya Krishna Menon
  • Charles Elkan
Conference paper

DOI: 10.1007/978-3-642-33460-3_48

Part of the Lecture Notes in Computer Science book series (LNCS, volume 7523)
Cite this paper as:
Kumar A., Vembu S., Menon A.K., Elkan C. (2012) Learning and Inference in Probabilistic Classifier Chains with Beam Search. In: Flach P.A., De Bie T., Cristianini N. (eds) Machine Learning and Knowledge Discovery in Databases. ECML PKDD 2012. Lecture Notes in Computer Science, vol 7523. Springer, Berlin, Heidelberg

Abstract

Multilabel learning is an extension of binary classification that is both challenging and practically important. Recently, a method for multilabel learning called probabilistic classifier chains (PCCs) was proposed with numerous appealing properties, such as conceptual simplicity, flexibility, and theoretical justification. However, PCCs suffer from the computational issue of having inference that is exponential in the number of tags, and the practical issue of being sensitive to the suitable ordering of the tags while training. In this paper, we show how the classical technique of beam search may be used to solve both these problems. Specifically, we show how to use beam search to perform tractable test time inference, and how to integrate beam search with training to determine a suitable tag ordering. Experimental results on a range of multilabel datasets show that these proposed changes dramatically extend the practical viability of PCCs.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Abhishek Kumar
    • 1
  • Shankar Vembu
    • 2
  • Aditya Krishna Menon
    • 1
  • Charles Elkan
    • 1
  1. 1.Department of Computer ScienceUC San DiegoUSA
  2. 2.Donnelly Centre for Cellular and Biomolecular ResearchUniversity of TorontoCanada

Personalised recommendations