Abstract
This paper proposes a shopping agent with a robust inductive learning method that automatically constructs wrappers for semistructured online stores. Strong biases assumed in many existing systems are weakened so that the real stores with reasonably complex document structures can be handled. Our method treats a logical line as a basic unit, and recognizes the position and the structure of product descriptions by finding the most frequent pattern from the sequence of logical line information in output HTML pages. This method is capable of analyzing product descriptions that comprise multiple logical lines, and even those with extra or missing attributes. Experimental tests on over 60 sites show that it successfully constructs correct wrappers for most real stores.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ambite, J., Ashish, N., Barish, G., Knoblock, C., Minton, S., Modi, P., Muslea, I., Philpot, A., Tejada, S.: ARIADNE: A System for Constructing Mediators for Internet Sources. ACM SIGMOD International Conference on Management of Data (1998) 561–563
Atzeni, P., Mecca, G., Merialdo, P.: Semi-structured and Structured Data in the Web: Going Back and Forth. ACM SIGMOD Workshop on Management of Semi-structured Data (1997) 1–9
Doorenbos, R., Etzioni, O., Weld, D.: A Scalable Comparison-Shopping Agent for the World Wide Web. First International Conference on Autonomous Agents (1997) 39–48
Hammer, J., Garcia-Molina, H., Nestorov, S., Yerneni, R., Breunig, M., Vassalos, V.: Template-based wrappers in the TSIMMIS system. ACM SIGMOD International Conference on Management of Data (1997) 532–
Kushmerick, N., Weld, D., Doorenbos, R.: Wrapper Induction for Information Extraction. International Joint Conference on Artificial Intelligent (1997) 729–735
Muslea, I., Minton, S., Knoblock, C.: A Hierarchical Approach toWrapper Induction. Third International Conference on Autonomous Agents (1999) 190–197
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Yang, J., Lee, E., Choi, J. (2000). A Shopping Agent That Automatically Constructs Wrappers for Semi-Structured Online Vendors. In: Leung, K.S., Chan, LW., Meng, H. (eds) Intelligent Data Engineering and Automated Learning — IDEAL 2000. Data Mining, Financial Engineering, and Intelligent Agents. IDEAL 2000. Lecture Notes in Computer Science, vol 1983. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44491-2_53
Download citation
DOI: https://doi.org/10.1007/3-540-44491-2_53
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41450-6
Online ISBN: 978-3-540-44491-6
eBook Packages: Springer Book Archive