Mining Neighbors’ Topicality to Better Control Authority Flow
Web pages are often recognized by others through contexts. These contexts determine how linked pages influence and interact with each other. When differentiating such interactions, the authority of web pages can be better estimated by controlling the authority flows among pages. In this work, we determine the authority distribution by examining the topicality relationship between associated pages. In addition, we find it is not enough to quantify the influence of authority propagation from only one type of neighbor, such as parent pages in PageRank algorithm, since web pages, like people, are influenced by diverse types of neighbors within the same network. We propose a probabilistic method to model authority flows from different sources of neighbor pages. In this way, we distinguish page authority interaction by incorporating the topical context and the relationship between associated pages. Experiments on the 2003 and 2004 TREC Web Tracks demonstrate that this approach outperforms other competitive topical ranking models and produces a more than 10% improvement over PageRank on the quality of top 10 search results. When increasing the types of incorporated neighbor sources, the performance shows stable improvements.
KeywordsAuthority Propagation Current Page Open Directory Project Authority Distribution Parent Page
Unable to display preview. Download preview PDF.
- 1.Cai, D., He, X., Wen, J.-R., Ma, W.-Y.: Block-level link analysis. In: Proc. 27th Annual Int’l ACM SIGIR Conf. on Research and Dev. in Information Retrieval (July 2004)Google Scholar
- 2.Haveliwala, T.H.: Topic-sensitive PageRank. In: Proc. of the 11th Int’l World Wide Web Conf., pp. 517–526. ACM Press, New York (2002)Google Scholar
- 3.McCallum, A.K.: Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering (1996), http://www.cs.cmu.edu/~mccallum/bow
- 4.Nie, L., Davison, B.D.: Separate and inequal: Preserving heterogeneity in topical authority flows. In: Proc. 31st Annual Int’l ACM SIGIR Conf. on Research and Dev. in Information Retrieval, July 2008, pp. 443–450 (2008)Google Scholar
- 5.Nie, L., Davison, B.D., Qi, X.: Topical link analysis for web search. In: Proc. 29th Annual Int’l ACM SIGIR Conf. on Research & Dev. in Info. Retrieval, August 2006, pp. 91–98 (2006)Google Scholar
- 6.The dmoz Open Directory Project, ODP (2009), http://www.dmoz.org/
- 7.Qin, T., Liu, T.-Y., Zhang, X.-D., Chen, Z., Ma, W.-Y.: A study of relevance propagation for web search. In: Proc. 28th Annual Int’l ACM SIGIR Conf. on Research and Dev. in Information Retrieval, pp. 408–415 (2005)Google Scholar
- 9.Shakery, A., Zhai, C.: A probabilistic relevance propagation model for hypertext retrieval. In: Proc. of the 15th ACM Int’l Conf. on Information and Knowledge Management (CIKM), pp. 550–558 (2006)Google Scholar