Retrieval of Snippets of Web Pages Converted to Plain Text. More Questions Than Answers

  • Carlos G. Figuerola
  • José Luis Alonso Berrocal
  • Ángel F. Zazo Rodríguez
  • Montserrat Mateos
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5706)

Abstract

This year’s WebCLEF task was to retrieve snippets and pieces from documents on various topics. The extraction and the choice of the most widely used snippets can be carried out using various methods. However, the way in which web pages are usually converted to plain text introduces a series of problems that cause inefficiency in the retrieval. Duplicate information, absolutely irrelevants snippets or even meaningless, are some of these problems. Also, it is intended in this paper to explore the real impact of the use of several languages in obtaining relevant fragments.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Jijkoun, V., de Rijke, M.: Overview of webclef 2007. In: Peters, C., Jijkoun, V., Mandl, T., Müller, H., Oard, D.W., Peñas, A., Petras, V., Santos, D. (eds.) CLEF 2007. LNCS, vol. 5152, pp. 725–731. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  2. 2.
    Figuerola, C.G., Alonso Berrocal, J., Zazo Rodrguez, A.: Reina at webclef 2007. selecting useful snippets. In: Nardi, A., Peters, C. (eds.) Working Notes for the CLEF 2007 Workshop (2007)Google Scholar
  3. 3.
    Li, S., Momoi, K.: A composite approach to language/encoding detection. In: 19th International Conference on Unicode (2001)Google Scholar
  4. 4.
    Zazo, Á.F., Figuerola, C.G., Alonso Berrocal, J.L., Rodríguez, E.: Reformulation of queries using similarity thesauri. Information Processing & Management 41(5), 1163–1173 (2005)CrossRefGoogle Scholar
  5. 5.
    Yu, S., Cai, D., Wen, J.R., Ma, W.Y.: Improving pseudo-relevance feedback in web information retrieval using web page segmentation. In: Proceedings of the Twelfth International World Wide Web Conference, WWW 2003, Budapest, Hungary, May 20-24, pp. 11–18. ACM, New York (2003)CrossRefGoogle Scholar
  6. 6.
    Mikheev, A.: Tagging sentence boundaries. In: Proceedings of the First Meeting of the North American Chapter of the Computational Linguistics (NAACL 2000), pp. 264–271. Morgan Kaufmann, San Francisco (2000)Google Scholar
  7. 7.
    Figuerola, C.G., Zazo, Á.F., Rodríguez Vázquez de Aldana, E., Alonso Berrocal, J.L.: La recuperación de información en español y la normalización de términos. Inteligencia Artificial. Revista Iberoamericana de Inteligencia Artificial 8(22), 135–145 (2004), http://tornado.dia.fi.upm.es/caepia/numeros/22/raepiaF08.pdf Google Scholar
  8. 8.
    Singhal, A., Buckley, C., Mitra, M.: Pivoted document length normalization. In: Proceedings of the 19th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Special Issue of the SIGIR Forum), Zurich, Switzerland, August 18–22, pp. 21–29. ACM, New York (1996)CrossRefGoogle Scholar
  9. 9.
    Overwijk, A., Nguyen, D., Hauff, C., Trieschnigg, R., Hiemstra, D., Jong, F.d.: On the evaluation of snippet selection for information retrieval. In: Working Notes for the CLEF 2008 Workshop (2008)Google Scholar
  10. 10.
    Yang, Y., Zhang, H.: Html page analysis based on visual cues. In: ICDAR, pp. 859–864. IEEE Computer Society, Los Alamitos (2001)Google Scholar
  11. 11.
    Kang, J., Choi, J.: A preliminary report for an information extraction system based on visual block segmentation. Technical Report TR-IS-2007-1, Hanyang University, Intelligent Systems Laboratory (2007)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Carlos G. Figuerola
    • 1
  • José Luis Alonso Berrocal
    • 1
  • Ángel F. Zazo Rodríguez
    • 1
  • Montserrat Mateos
    • 1
  1. 1.REINA Research GroupUniversity of Salamanca, Email: reina@usal.esSalamancaSpain

Personalised recommendations