Skip to main content

Analyzing the Sense Distribution of Concordances Obtained by Web as Corpus Approach

  • Conference paper
  • 2184 Accesses

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 7816)


In corpus-based lexicography and natural language processing fields some authors have proposed using the Internet as a source of corpora for obtaining concordances of words. Most techniques implemented with this method are based on information retrieval-oriented web searchers. However, rankings of concordances obtained by these search engines are not built according to linguistic criteria but to topic similarity or navigational oriented criteria, such as page-rank. It follows that examples or concordances could not be linguistically representative, and so, linguistic knowledge mined by these methods might not be very useful. This work analyzes the linguistic representativeness of concordances obtained by different relevance criteria based web search engines (web, blog and news search engines). The analysis consists of comparing web concordances and SemCor (the reference) with regard to the distribution of word senses. Results showed that sense distributions in concordances obtained by web search engines are, in general, quite different from those obtained from the reference corpus. Among the search engines, those that were found to be the most similar to the reference were the informational oriented engines (news and blog search engines).


  • Web As Corpus
  • Word Sense Disambiguation

This is a preview of subscription content, access via your institution.

Buying options

USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Kilgarriff, A., Grefenstette, G.: Introduction to the special issue on the web as corpus. Comput. Linguist. 29, 333–347 (2003)

    CrossRef  MathSciNet  Google Scholar 

  2. Morley, B.: WebCorp: A tool for Online Linguistic Information Retrieval and Analysis. In: Renouf, A., Kehoe, A. (arg.) The Changing Face of Corpus Linguistics. Rodopi (2006)

    Google Scholar 

  3. Baroni, M., Bernardini, S.: WaCky!: Working Papers on the Web as Corpus. Gedit (2006)

    Google Scholar 

  4. Agirre, E., Ansa, O., Hovy, E., Martínez, D.: Enriching very large ontologies using the WWW. In: Proceedings of the ECAI 2000 Workshop «OntologyLearning» (2000)

    Google Scholar 

  5. Broder, A.: A taxonomy of web search. SIGIR Forum 36, 3–10 (2002)

    CrossRef  Google Scholar 

  6. Mihalcea, R.: Semcor semantically tagged corpus (1998),

  7. Martinez, D., Agirre, E.: The effect of bias on an automatically-built word sense corpus. In: Proceedings of the Fourth International Conference on Language Resources and Evaluations (LREC 2004), Lisbon, Portugal (2004)

    Google Scholar 

  8. Kilgarriff, A.: Getting to Know Your Corpus. In: Sojka, P., Horák, A., Kopeček, I., Pala, K. (eds.) TSD 2012. LNCS, vol. 7499, pp. 3–15. Springer, Heidelberg (2012)

    CrossRef  Google Scholar 

  9. Nakov, P., Nakov, S.: Improved word alignments using the web as a corpus. In: Proceedings of RANLP 2007 (2007)

    Google Scholar 

  10. Kozareva, Z., Riloff, E., Hovy, E.: Semantic class learning from the web with hyponym pattern linkage graphs. In: Proceedings of ACL 2008: HLT, pp. 1048–1056 (2008)

    Google Scholar 

  11. Chen, P., Brown, D., Tran, A., Ozoka, N., Ortiz, R.: Word sense distribution in a web corpus. In: 2010 9th IEEE International Conference on Cognitive Informatics (ICCI), pp. 449–453 (2010)

    Google Scholar 

  12. Santamaría, C., Gonzalo, J., Artiles, J.: Wikipedia as sense inventory to improve diversity in Web search results. In: Proceedings of the 48th Annual Meeting of the Association for Computational Linguistics, pp. 1357–1366. Association for Computational Linguistics, Stroudsburg (2010)

    Google Scholar 

  13. McCarthy, D., Koeling, R., Weeds, J., Carroll, J.: Finding predominant word senses in untagged text. In: Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics. Association for Computational Linguistics, Stroudsburg (2004)

    Google Scholar 

  14. Kilgarriff, A.: How Dominant Is the Commonest Sense of a Word? In: Sojka, P., Kopeček, I., Pala, K. (eds.) TSD 2004. LNCS (LNAI), vol. 3206, pp. 103–111. Springer, Heidelberg (2004)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations


Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Saralegi, X., Gamallo, P. (2013). Analyzing the Sense Distribution of Concordances Obtained by Web as Corpus Approach. In: Gelbukh, A. (eds) Computational Linguistics and Intelligent Text Processing. CICLing 2013. Lecture Notes in Computer Science, vol 7816. Springer, Berlin, Heidelberg.

Download citation

  • DOI:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-37246-9

  • Online ISBN: 978-3-642-37247-6

  • eBook Packages: Computer ScienceComputer Science (R0)