Abstract
This chapter discusses some of the issues in Web information extraction, focusing on automatic extraction methods that exploit wrapper induction. In particular, we point out the limitations of traditional heuristic-based wrapper-generation systems, and as a solution, we emphasize the importance of the domain knowledge in the process of wrapper generation. We demonstrate the effectiveness of domain knowledge by presenting our scheme of knowledge-based wrapper generation for semistructured and labeled documents. Our information-extraction system, XTROS, represents both the domain knowledge and the wrappers using XML documents to increase modularity, flexibility, and interoperability. XTROS shows good performance on several Web sites in the domain of real estate, and it is expected to be easily adaptable to different domains by plugging in appropriate XML-based domain knowledge.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
J. Ambite, N. Ashish, G. Barish, C. Knoblock, S. Minton, P. Modi, I. Muslea, A. Philpot, S. Tejada: ARIADNE: A system for constructing mediators for Internet sources. In: L.M. Haas, A. Tiwary (eds.), Proc. ACM SIGMOD Int. Conf. on Management of Data, Seattle, WA, 2–4 June 1998 (ACM Press 1998) pp. 561–563
P. Atzeni, G. Mecca, P. Merialdo: Semi-structured and structured data in the Web: going back and forth. In: Proc. ACM SIGMOD Workshop on Management of Semistructured Data, Tucson, AZ, 13–15 May 1997 (ACM Press 1997) pp. 1–9
A. Blum, T. Mitchell: Combining labeled and unlabeled data with co-training. In: Proc. 11th Conf. on Computational Learning Theory, Madison, WI, 24–26 July 1998 (ACM Press 1998 ) pp. 92–100
R. Doorenbos, O. Etzioni, D. Weld: A scalable comparison-shopping agent for the World-Wide Web. In: Proc. 1st Int. Conf. on Autonomous Agents, Marina del Rey, CA, 5–8 Feburary 1997 (ACM Press, New York 1997 ) pp. 39–48
W. Cohen: A Web-based information system that reasons with structured collections of text. In: K.P. Sycara, M. Wooldridge (eds.), Proc. 2nd Int. Conf. on Autonomous Agents, Minneapolis, MN, 9–13 May 1998 (ACM Press, New York 1998 ) pp. 400–407
J. Hammer, H. Garcia-Molina, S. Nestorov, R. Yemeni, M. Breunig, V. Vassalos: Template-based wrappers in the TSIMMIS system. In: J. Peckham (ed.), Proc. ACM SIGMOD Int. Conf. on Management of Data, Tucson, AZ, 13–15 May 1997 (ACM Press 1997 ) pp. 532–535
N. Kushmerick, D. Weld, R. Doorenbos: Wrapper induction for information extraction. In: Proc. 15th Int. Joint Conf. on Artif. Intell., Nagoya, Japan,23–29 August 1997 (Morgan Kaufmann 1997) pp. 729–735
N. Kushmerick: Gleaning the Web. IEEE Intelligent Systems 14, 20–22 (1999)
N. Kushmerick: Wrapper induction: efficiency and expressiveness. Artif. Intell. 118, 1568 (2000)
L. Liu, C. Pu, W. Han: An XML-based wrapper generator for Web information extraction. In: A. Delis, C. Faloutsos, S. Ghandeharizadeh (eds.), Proc. ACM SIGMOD Int. Conf. on Management of Data, Philadelphia, PA, 1–3 June 1999 (ACM Press 1999 ) pp. 540–543
I. Muslea, S. Minton, C. Knoblock: A hierarchical approach to wrapper induction. In: Proc. 3rd Int. Conf. on Autonomous Agents, Seattle, WA, 1–5 May 1999 (ACM Press 1999) pp. 190–197
E. Riloff: Automatically constructing a dictionary for information extraction tasks.In: Proc. 11th Nat. Conf. on Artif. Intell., Washington, DC, 11–15 July 1993 (AAAI Press/The MIT Press 1993) pp. 811–816
S. Soderland, D. Fisher, J. Aseltine, W. Lehnert: CRYSTAL: inducing a conceptual dictionary. In: Proc. 14th Int. Joint Conf. on Artif. Intell., Montreal, Canada, 20–25 August 1995 (Morgan Kaufmann 1995) pp. 1314–1321
S. Soderland: Learning information extraction rules for semi-structured and free text. Machine Learning 34, 233–272 (1999)
J. Yang, E. Lee, J. Choi: A shopping agent that automatically constructs wrappers for semi-structured online vendors. In: K. Leung, L. Chan, H. Meng (eds.), Intelligent Data Engineering and Automated Learning, LNCS 1983 (Springer, Berlin, Heidelberg, New York 2000 ) pp. 368–373
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this chapter
Cite this chapter
Yang, J., Choi, J. (2003). Knowledge-Based Wrapper Induction for Intelligent Web Information Extraction. In: Zhong, N., Liu, J., Yao, Y. (eds) Web Intelligence. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-662-05320-1_8
Download citation
DOI: https://doi.org/10.1007/978-3-662-05320-1_8
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-07936-8
Online ISBN: 978-3-662-05320-1
eBook Packages: Springer Book Archive