Machine Learning

, Volume 79, Issue 1–2, pp 123–149

Multi-domain learning by confidence-weighted parameter combination


DOI: 10.1007/s10994-009-5148-0

Cite this article as:
Dredze, M., Kulesza, A. & Crammer, K. Mach Learn (2010) 79: 123. doi:10.1007/s10994-009-5148-0


State-of-the-art statistical NLP systems for a variety of tasks learn from labeled training data that is often domain specific. However, there may be multiple domains or sources of interest on which the system must perform. For example, a spam filtering system must give high quality predictions for many users, each of whom receives emails from different sources and may make slightly different decisions about what is or is not spam. Rather than learning separate models for each domain, we explore systems that learn across multiple domains. We develop a new multi-domain online learning framework based on parameter combination from multiple classifiers. Our algorithms draw from multi-task learning and domain adaptation to adapt multiple source domain classifiers to a new target domain, learn across multiple similar domains, and learn across a large number of disparate domains. We evaluate our algorithms on two popular NLP domain adaptation tasks: sentiment classification and spam filtering.


Online learning Domain adaptation Classifier combination Transfer learning Multi-task learning 

Copyright information

© The Author(s) 2009

Authors and Affiliations

  1. 1.Human Language Technology Center of ExcellenceJohns Hopkins UniversityBaltimoreUSA
  2. 2.Department of Computer and Information ScienceUniversity of PennsylvaniaPhiladelphiaUSA
  3. 3.Department of Electrical EngineeringThe TechnionHaifaIsrael

Personalised recommendations