ISMIS 2003: Foundations of Intelligent Systems pp 179-186 | Cite as
MetaNews: An Information Agent for Gathering News Articles on the Web
Abstract
This paper presents MetaNews, an information gathering agent for news articles on the Web. MetaNews reads HTML documents from online news sites and extracts article information from them. In order to recognize and extract articles from an HTML document, MetaNews removes redundant HTML tags, builds a reference string which is a sequence of semantic components of a noise-removed document, and performs pattern matching between the reference string and each of pre-defined information patterns for articles. With a few training inputs from the operator with intermediate-level skills, MetaNews is capable of adding new sites easily and extracting articles in real time. By reducing the complexity of designing and creating wrapper interfaces, the proposed techniques in MetaNews are useful for many information-mediator applications such as meta-search engines, information-push solutions, and comparison-shopping agents.
Keywords
Pattern Match News Article Noise Removal Information Pattern Information AgentPreview
Unable to display preview. Download preview PDF.
References
- 1.Angluin, D.: Interface of reversible languages. Journal of ACM 29(3), 741–765 (1982)MATHCrossRefMathSciNetGoogle Scholar
- 2.Ashish, N., Knoblock, C.: Wrapper generation for semi-structured Internet sources. In: Proc. Workshop on Management of Semistructured Data, Tucson, Arizona (1997)Google Scholar
- 3.Choi, J.: A customized comparison-shopping agent. IEICE Trans. Comm. E84-B(6), 1694–1696 (2001)Google Scholar
- 4.Cohen, W.: A web-based information system that reasons with structured collections of text. In: Proc. 2nd International Conf. on Autonomous Agent, May 1998, pp. 400–407. Minneapolis/ St. Paul, Minnesota (1998)CrossRefGoogle Scholar
- 5.Doorenbos, R., Etzioni, O., Weld, D.: A scalable comparison-shopping agent for the World Wide Web. In: Proc. 1st International Conf. on Autonomous Agent, Marina del Rey, California, February 1997, pp. 39–48 (1997)Google Scholar
- 6.Hammer, J., Garcia-Molina, H., Cho, J., Aranha, R., Crespo, A.: Extracting semistructured information from the Web. In: Proc. Workshop on Management of Semistructured Data, Tucson, Arizona (1997)Google Scholar
- 7.Kushmerick, N.: Wrapper induction: efficiency and expressiveness. Artificial Intelligence 118, 15–68 (2000)MATHCrossRefMathSciNetGoogle Scholar
- 8.Muslea, I., Minton, S., Knoblock, C.: A hierarchical approach to wrapper induction. In: Proc. 3rd International Conf. on Autonomous Agents, pp. 190–197 (1999)Google Scholar