Machine Learning

, Volume 79, Issue 1–2, pp 105–121

A co-classification approach to learning from multilingual corpora

Article

Abstract

We address the problem of learning text categorization from a corpus of multilingual documents. We propose a multiview learning, co-regularization approach, in which we consider each language as a separate source, and minimize a joint loss that combines monolingual classification losses in each language while ensuring consistency of the categorization across languages. We derive training algorithms for logistic regression and boosting, and show that the resulting categorizers outperform models trained independently on each language, and even, most of the times, models trained on the joint bilingual data. Experiments are carried out on a multilingual extension of the RCV2 corpus, which is available for benchmarking.

Keywords

Text categorization Multilingual data Logistic regression Boosting 

Copyright information

© The Author(s) 2009

Authors and Affiliations

  1. 1.Interactive Language Technologies groupNational Research Council CanadaGatineauCanada

Personalised recommendations