Representative Sampling for Text Classification Using Support Vector Machines

  • Zhao Xu
  • Kai Yu
  • Volker Tresp
  • Xiaowei Xu
  • Jizhi Wang
Conference paper

DOI: 10.1007/3-540-36618-0_28

Part of the Lecture Notes in Computer Science book series (LNCS, volume 2633)
Cite this paper as:
Xu Z., Yu K., Tresp V., Xu X., Wang J. (2003) Representative Sampling for Text Classification Using Support Vector Machines. In: Sebastiani F. (eds) Advances in Information Retrieval. ECIR 2003. Lecture Notes in Computer Science, vol 2633. Springer, Berlin, Heidelberg

Abstract

In order to reduce human efforts, there has been increasing interest in applying active learning for training text classifiers. This paper describes a straightforward active learning heuristic, representative sampling, which explores the clustering structure of ‘uncertain’ documents and identifies the representative samples to query the user opinions, for the purpose of speeding up the convergence of Support Vector Machine (SVM) classifiers. Compared with other active learning algorithms, the proposed representative sampling explicitly addresses the problem of selecting more than one unlabeled documents. In an empirical study we compared representative sampling both with random sampling and with SVM active learning. The results demonstrated that representative sampling offers excellent learning performance with fewer labeled documents and thus can reduce human efforts in text classification tasks.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Zhao Xu
    • 1
  • Kai Yu
    • 2
  • Volker Tresp
    • 3
  • Xiaowei Xu
    • 4
  • Jizhi Wang
    • 1
  1. 1.Tsinghua UniversityBeijingChina
  2. 2.Institute for Computer ScienceUniversity of MunichGermany
  3. 3.Corporate TechnologySiemens AGMunichGermany
  4. 4.University of Arkansas at Little RockLittle RockUSA

Personalised recommendations