Skip to main content

Schema-Based Web Wrapping

  • Conference paper
Conceptual Modeling – ER 2004 (ER 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3288))

Included in the following conference series:

Abstract

An effective solution to automate information integration is represented by wrappers, i.e. programs which are designed for extracting relevant contents from a particular information source, such as web pages. Wrappers allow such contents to be delivered through a self-describing and easily processable representation model. However, most existing approaches to wrapper designing focus mainly on how to generate extraction rules, while do not weigh the importance of specifying and exploiting the desired schema of the extracted information. In this paper, we propose a new wrapping approach which encompasses both extraction rules and the schema of required information in wrapper definitions. We investigate the advantages of suitably exploiting extraction schemata, and we define a clean declarative wrapper semantics by introducing (preferred) extraction models for source HTML documents with respect to a given wrapper.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Baumgartner, R., Flesca, S., Gottlob, G.: Visual Web Information Extraction with Lixto. In: Proc. 27th VLDB Conf., pp. 119–128 (2001)

    Google Scholar 

  2. Crescenzi, V., Mecca, G., Merialdo, P.: RoadRunner: Towards Automatic Data Extraction from Large Web Sites. In: Proc. 27th VLDB Conf., pp. 109–118 (2001)

    Google Scholar 

  3. Embley, D.W., Tao, C., Liddl, S.W.: Automatically Extracting Ontologically Specified Data from HTML Tables of Unknown Structure. In: Proc. 21st ER Conf., pp. 322–337 (2002)

    Google Scholar 

  4. Flesca, S., Greco, S.: Partially Ordered Regular Languages for Graph Queries. In: Proc. 26th ICALP, pp. 321–330 (1999)

    Google Scholar 

  5. Flesca, S., Tagarelli, A.: Schema-based Web Wrapping. Tech. Rep., DEIS - University of Calabria (2004), Available at http://www.deis.unical.it/tagarelli/

  6. Freitag, D., Kushmerick, N.: Boosted Wrapper Induction. In: Proc. 17th AAAI Conf., pp. 577–583 (2000)

    Google Scholar 

  7. Gottlob, G., Koch, C.: Monadic Datalog and the Expressive Power of Languages for Web Information Extraction. In: Proc. 21st PODS Symp., pp. 17–28 (2002)

    Google Scholar 

  8. Hammer, J., McHugh, J., Garcia-Molina, H.: Semistructured Data: The TSIMMIS Experience. In: Proc. 1st ADBIS Symp., pp. 1–8 (1997)

    Google Scholar 

  9. Hsu, C.-H., Dung, M.-T.: Generating Finite-State Transducers for Semistructured Data Extraction from the Web. Information Systems 23(8), 521–538 (1998)

    Article  Google Scholar 

  10. Kim, D., Jung, H., Geunbae Lee, G.: Unsupervised Learning of mDTD Extraction Patterns for Web Text Mining. Information Processing and Management 39(4), 623–637 (2003)

    Article  MATH  Google Scholar 

  11. Kushmerick, N.: Wrapper Induction: Efficiency and Expressiveness. Artificial Intelligence 118(1-2), 15–68 (2000)

    Article  MATH  MathSciNet  Google Scholar 

  12. Kushmerick, N., Weld, D.S., Doorenbos, R.: Wrapper Induction for Information Extraction. In: Proc. 15th IJCAI, pp. 729–737 (1997)

    Google Scholar 

  13. Laender, H.F., Ribeiro-Neto, B.A., da Silva, A.S.: DEByE - Data Extraction By Example. Data & Knowledge Engineering 40(2), 121–154 (2002)

    Article  MATH  Google Scholar 

  14. Liu, L., Pu, C., Han, W.: XWRAP: An XML-Enabled Wrapper Construction System for Web Information Sources. In: Proc. 16th ICDE, pp. 611–621 (2000)

    Google Scholar 

  15. May, W., Himmeröder, R., Lausen, G., Ludäscher, B.: A Unified Framework for Wrapping, Mediating and Restructuring Information from the Web. In: ER Workshops, pp. 307–320 (1999)

    Google Scholar 

  16. Meng, X., Lu, H., Wang, H., Gu, M.: Data Extraction from the Web Based on Pre-Defined Schema. JCST 17(4), 377–388 (2002)

    MATH  Google Scholar 

  17. Muslea, I., Minton, S., Knoblock, C.: Hierarchical Wrapper Induction for Semistructured Information Sources. Autonomous Agents and Multi-Agent Systems 4(1/2), 93–114 (2001)

    Article  Google Scholar 

  18. Sahuguet, A., Azavant, F.: Building Intelligent Web Applications Using Lightweight Wrappers. Data & Knowledge Engineering 36(3), 283–316 (2001)

    Article  MATH  Google Scholar 

  19. World Wide Web Consortium – W3C. Extensible Markup Language 1.0 (2000)

    Google Scholar 

  20. World Wide Web Consortium – W3C. XML Path Language 2.0 (2003)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Flesca, S., Tagarelli, A. (2004). Schema-Based Web Wrapping. In: Atzeni, P., Chu, W., Lu, H., Zhou, S., Ling, TW. (eds) Conceptual Modeling – ER 2004. ER 2004. Lecture Notes in Computer Science, vol 3288. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-30464-7_23

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-30464-7_23

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-23723-5

  • Online ISBN: 978-3-540-30464-7

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics