Abstract
We propose a framework for building a high-quality web page collection considering page group structure in a two-step process: rough filtering and accurate classification. In both processes, we apply the idea of local page group structure. The rough filtering comprehensively gathers all potential homepages from the web with as few noise pages as possible. It uses property-based keyword lists according to four page group models that are based on the page group structure. The accurate classification uses a textual feature set for the support vector machine, which is composed by independently concatenating the feature subsets on the surrounding pages grouped according to the page group structure. Using a combination of a recall-assured classifier and a precision-assured classifier, we build a three-way classifier to accurately select the pages that need manual assessment to assure the required quality. The effectiveness of proposed method is shown by the experimental results.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Chakrabarti, S.: Data mining for hypertext: a tutorial survey. ACM SIGKDD Explorations 1(2), 1–11 (2000)
Sun, A., Lim, E.-P., Ng, W.-K.: Web classification using support vector machine. In: Proc. of the fourth international workshop on web information and data management, McLean, Virginia, USA, pp. 96–99. ACM Press, New York (2002)
Kan, M.-Y.: Web Page Categorization without the Web Page. In: Proc. of 13th World Wide Web Conference (WWW2004), New York, NY, USA, May 17-22 (2004)
Kan, M.-Y., Thi, H.O.N.: Fast webpage classification using URL features. In: CIKM’05, Bremen, Germany, pp. 325–326 (2005)
Shih, L.K., Karger, D.R.: Using URLs and table layout for web classification tasks. In: WWW2004, New York, NY, USA, pp. 193–202 (2004)
Masada, T., Takasu, A., Adachi, J.: Improving web search performance with hyperlink information. IPSJ Transactions on Databases 46(8), 48–59 (2005)
Sun, A., Lim, E.-P.: Web unit mining: finding and classifying subgraphs of web pages. In: Proc. of International Conference on Information and Knowledge Management (CIKM2003), New Orleans, Louisiana, USA, pp. 108–115 (2003)
Chau, M.: Applying web analysis in web page filtering. In: Proc. of the ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL’04), Tucson, Arizona, USA, p. 376 (2004)
Craven, M., DiPasquo, D., Freitag, D., McCallum, A., Mitchell, T., Nigam, K., Slattery, S.: Learning to Extract Symbolic Knowledge from the World Wide Web. In: Proceedings of AAAI-98, Madison, Wisconsin, pp. 509–516 (1998)
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 2007 Springer Berlin Heidelberg
About this paper
Cite this paper
Wang, Y., Oyama, K. (2007). Framework for Building a High-Quality Web Page Collection Considering Page Group Structure. In: Dong, G., Lin, X., Wang, W., Yang, Y., Yu, J.X. (eds) Advances in Data and Web Management. APWeb WAIM 2007 2007. Lecture Notes in Computer Science, vol 4505. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-72524-4_13
Download citation
DOI: https://doi.org/10.1007/978-3-540-72524-4_13
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-72483-4
Online ISBN: 978-3-540-72524-4
eBook Packages: Computer ScienceComputer Science (R0)