Finding Neighbor Communities in the Web Using Inter-site Graph
In recent years, link-based information retrieval methods from the Web are developed. A framework of these methods is a Web graph using pages as vertices and Web-links as edges. In the last year, the authors have claimed that an inter-site graph using sites as vertices and global-links (links between sites) as edges is more natural and useful as a framework for link-based information retrieval than a Web graph. They have proposed directory-based sites as a new model of Web sites and established a method of identifying them from URL and Web-link data. They have examined that this method can identify directory-based sites almost correctly by using data of URLs and links in .jp domain. In this paper, we show that this framework is also useful for information retrieval in response to user’s query. We develop a system called Neighbor Community Finder (NCF, for short). NCF finds Web communities related to given URLs by constructing an inter-site graph with neighborhood sites and links obtained from the real Web on demand. We show that in several cases NCF is a more effective tool for finding related pages than Google’s service by computational experiments.
Unable to display preview. Download preview PDF.
- 1.Amento, B., Terveen, L.G., Hill, W.C.: Does “authority” mean quality? Predicting expert quality ratings of web documents. In: Proceedings of SIGIR 2000, pp. 296–303 (2000)Google Scholar
- 2.Asano, Y.: A New Framework for Link-based Information Retrieval from the Web. PhD thesis, The University of Tokyo (December 2002)Google Scholar
- 3.Asano, Y., Imai, H., Toyoda, M., Kitsuregawa, M.: Applying the site information to the information retrieval from the Web. In: Proceedings of the 3rd International Conference on Web Information Systems Engineering, pp. 83–92 (2002)Google Scholar
- 4.Asano, Y., Imai, H., Toyoda, M., Kitsuregawa, M.: Focusing on Sites in the Web. In: Proceedings of IASTED International Conference Information Systems and Databases 2002, pp. 154–159 (2002)Google Scholar
- 5.Asano, Y., Imai, H., Toyoda, M., Kitsuregawa, M.: The Web-Linkage Viewer: Finding graph structures in the Web. In: Proceedings of the 3rd International Conference on Web-Age Information Management, pp. 441–442 (2002)Google Scholar
- 6.Craswell, N., Hawking, D., Robertson, S.: Effective site finding using link anchor information. In: Proceedings of SIGIR 2001, pp. 250–257 (2001)Google Scholar
- 7.Dean, J., Henzinger, M.R.: Finding related pages in the World Wide Web. In: Proceedings of the 8th International World Wide Web Conference (1999)Google Scholar
- 8.Flake, G.W., Lawrence, S., Giles, C.L.: Efficient identification of Web communities. In: Proceedings of the Sixth International Conference on Knowledge Discovery and Data Mining (ACM SIGKDD-2000), pp. 150–160 (2000)Google Scholar
- 9.Kleinberg, J.: Authoritative sources in a hyperlinked environment. In: Proceedings of the 9th Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 668–677 (1998)Google Scholar
- 10.Kumar, R., Raghavan, P., Rajagopalan, S., Tomkins, A.: Trawling the Web for emerging cyber-communities. In: Proceedings of the 8th International World Wide Web Conference (1999)Google Scholar
- 11.Murata, T.: Finding related Web pages based on connectivity information from a search engine. In: Poster Proceedings of the 10th International World Wide Web Conference (2001)Google Scholar