Compilation of a Spanish Representative Corpus

  • Alexander Gelbukh
  • Grigori Sidorov
  • Liliana Chanona-Hernández
Conference paper

DOI: 10.1007/3-540-45715-1_27

Part of the Lecture Notes in Computer Science book series (LNCS, volume 2276)
Cite this paper as:
Gelbukh A., Sidorov G., Chanona-Hernández L. (2002) Compilation of a Spanish Representative Corpus. In: Gelbukh A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2002. Lecture Notes in Computer Science, vol 2276. Springer, Berlin, Heidelberg

Abstract

Due to the Zipf law, even a very large corpus contains very few occurrences (tokens) for the majority of its different words (types). Only a corpus containing enough occurrences of even rare words can provide necessary statistical information for the study of contextual usage of words. We call such corpus representative and suggest to use Internet for its compilation. The corresponding algorithm and its application to Spanish are described. Different concepts of a representative corpus are discussed.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2002

Authors and Affiliations

  • Alexander Gelbukh
    • 1
  • Grigori Sidorov
    • 1
  • Liliana Chanona-Hernández
    • 1
  1. 1.Center for Computing ResearchNational Polytechnic InstituteUSA

Personalised recommendations