A Case Study of Using Web Search Statistics: Case Restoration

  • Silviu Cucerzan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6008)

Abstract

We investigate the use of Web search engine statistics for the task of case restoration. Because most engines are case insensitive, an approach based on search hit counts, as employed in previous work in natural language ambiguity resolution, is not applicable for this task. Consequently, we study the use of statistics computed from the snippets generated by a Web search engine, and we show that such statistics can achieve performance similar to corpus-based approaches. We also note that the top few results returned by a search engine may not the most representative for modeling phenomena in a language.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Brants, T., Franz, A.: Web 1T 5-gram Version 1. Linguistic Data Consortium, Catalog ID: LDC2006T13 (2006)Google Scholar
  2. 2.
    Brill, E., Lin, J., Banko, M., Dumais, S., Ng, A.: Data-intensive question answering. In: Proceedings of TREC 2001, pp. 393–400 (2001)Google Scholar
  3. 3.
    Church, K.: A stochastic parts program and noun phrase parser for unrestricted text. In: Proceedings of ANLP 1988, pp. 136–143 (1988)Google Scholar
  4. 4.
    Church, K.: One Term or Two? In: Proceedings of SIGIR 1995, pp. 310–318 (1995)Google Scholar
  5. 5.
    Cucerzan, S., Yarowsky, D.: Minimally Supervised Induction of Grammatical Gender. In: Proceedings of HLT/NAACL 2003, pp. 40–47 (2003)Google Scholar
  6. 6.
    Gale, W.A., Church, K., Yarowsky, D.: Discrimination Decisions for 100,000-Dimensional Spaces. In: Current Issues in Computational Linguistics, pp. 429–450 (1987)Google Scholar
  7. 7.
    Gale, W.A., Church, K., Yarowsky, D.: One Sense per Discourse. In: Proceedings of the 4th DARPA Speech and NL Workshop, pp. 233–237 (1992)Google Scholar
  8. 8.
    Grefenstette, G.: The World Wide Web as a Resource for Example-based Machine Translation Tasks. In: Proceedings of the ASLIB Conference on Translating and Computer (1998)Google Scholar
  9. 9.
    Keller, F., Lapata, M., Ouriopina, O.: Using the Web to overcome data sparseness. In: Proceedings of EMNLP 2002, pp. 230–237 (2002)Google Scholar
  10. 10.
    Liţă, L.V., Ittycheriah, A., Roukos, S., Kambhatla, N.: tRuEcasIng. In: Proceedings of ACL 2003, pp. 152–159 (2003)Google Scholar
  11. 11.
    Mihalcea, R.: Bootstrapping Large Sense Tagged Corpora. In: Proceedings of LREC 2002 (2002), http://www.cs.unt.edu/~rada/papers/mihalcea.lrec02.pdf
  12. 12.
    Mikev, A.: A Knowledge-free Method for Capitalized Word Disambiguation. In: Proceedings of ACL 1999, pp. 159–166 (1999)Google Scholar
  13. 13.
    Palmer, D.D., Hearst, M.A.: Adaptive Sentence Boundary Disambiguation. In: Proceedings of ANLP 1994, pp. 78–83 (1994)Google Scholar
  14. 14.
    Radev, D., Qi, H., Zheng, Z., Blair-Goldstein, S., Zhang, Z., Fan, W., Prager, J.: Mining the Web for Answers to Natural Language Questions. In: Proceedings of CIKM 2001, pp. 143–150 (2001)Google Scholar
  15. 15.
    Reynar, J.C., Ratnaparkhi, A.: A Maximum Entropy Approach to Identifying Sentence Boundaries. In: Proceedings of ANLP 1997, pp. 16–19 (1997)Google Scholar
  16. 16.
    Sampson, G.: Writing systems: A Linguistic Introduction. Stanford University Press (1985)Google Scholar
  17. 17.
    Sumita, E., Sugaya, F.: Using the Web to Disambiguate Acronyms. In: Proceedings of HLT/NAACL 2006, pp. 161–164 (2006)Google Scholar
  18. 18.
    Tang, J., Li, H., Cao, Y., Tang, Z.: Email Data Cleaning. In: Proceedings of KDD 2005, pp. 489–498 (2005)Google Scholar
  19. 19.
    Yarowsky, D.: Decision Lists for Lexical Ambiguity Resolution: Application to Accent Restoration in Spanish and French. In: Proceedings of ACL 1994, pp. 88–95 (1994)Google Scholar
  20. 20.
    Zhu, X., Rosenfeld, R.: Improving Trigram Language Modeling with the World Wide Web. In: Proceedings of ICASSP 2001, pp. 592–597 (2001)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Silviu Cucerzan
    • 1
  1. 1.Microsoft ResearchRedmondUSA

Personalised recommendations