Abstract
This paper proposes a virtual relevant document technique in the learning phase for text categorization. The method uses a simple transformation of relevant documents, i.e. making virtual documents by combining document pairs in the training set. The virtual document produced by this method has the enriched term vector space, with greater weights for the terms that co-occur in two relevant documents. The experimental results showed a significant improvement over the baseline, which proves the usefulness of the proposed method: 71% improvement on TREC-11 filtering test collection and 11% improvement on Reuters-21578 test set for the topics with less than 100 relevant documents in the micro average F1. The result analysis indicates that the addition of virtual relevant documents contributes to the steady improvement of the performance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Allan, J., Ballesteros, L., Callan, J., Croft, W., Lu, Z.: Recent experiments with INQUERY. In: Proc. of the Fourth Text REtrieval Conference, TREC-4 (1996)
DeCoste, D., Schölkopf, B.: Training invariant support vector machines. Machine Learning 46(1), 161–190 (2002)
Joachims, T.: Making large-scale support vector machine learning practical. In: Schölkopf, B., et al. (eds.) Advances in Kernel Methods: Support Vector Machines, MIT Press, Cambridge (1999)
Kawatani, T.: Topic Difference Factor Extraction between Two Document Sets and its Application to Text Categorization. In: Proc. of 25th ACM-SIGIR Conference on Research and Development in Information Retrieval (2002)
Kwok, K., Grunfeld, L.: TREC-5 English and Chinese retrieval experiments using PIRCS. In: The Proc. of the Fifth Text REtrieval Conference, TREC-5 (1997)
Lewis, D.: Reuters-21578 text categorization test collection distribution 1.0 (1999), http://www.daviddlewis.com/
Poggio, T., Vetter, T.: Recognition and structure from one 2D model view: observations on prototypes, object classes and symmetries. A.I. Memo No. 1347, Artificial Intelligence Laboratory, MIT (1992)
Robertson, S., Soboroff, I.: The TREC 2001 Filtering Track Report. In: Proc. of the Tenth Text REtrieval Conference, TREC-10 (2001)
Rose, T.G., Stevenson, M., Whitehead, M.: The Reuters Corpus Volume 1 - from Yesterday’s News to Tomorrow’s Language Resources. In: Proc. of the Third International Conference on Language Resources and Evaluation (2002)
Schölkopf, B.: Support Vector Learning. R. Oldenbourg Verlag, Munchen. Doktorarbeit, TU Berlin (1997)
Schölkopf, B., Burges, C., Vapnik, V.: Extracting support data for a given task. In: Proc. of the First International Conference on Knowledge Discovery & Data Mining, AAAI Press, Menlo Park (1995)
Singhal, A., Mitra, M., Buckley, C.: Learning routing queries in a query zone. In: Proc. of the Twentieth ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 21–29 (1997)
Vapnick, V.: The Nature of Statistical Learning Theory. Springer, New York (1995)
Yang, Y., Liu, X.: A re-examination of text categorization methods. In: Proc. of the 22nd ACM-SIGIR Conference on Research and Development in Information Retrieval (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Lee, KS., Kageura, K. (2003). Incorporating Virtual Relevant Documents for Learning in Text Categorization. In: Sembok, T.M.T., Zaman, H.B., Chen, H., Urs, S.R., Myaeng, SH. (eds) Digital Libraries: Technology and Management of Indigenous Knowledge for Global Access. ICADL 2003. Lecture Notes in Computer Science, vol 2911. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24594-0_6
Download citation
DOI: https://doi.org/10.1007/978-3-540-24594-0_6
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20608-8
Online ISBN: 978-3-540-24594-0
eBook Packages: Springer Book Archive