Mining Neighbors’ Topicality to Better Control Authority Flow

  • Na Dai
  • Brian D. Davison
  • Yaoshuang Wang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5993)


Web pages are often recognized by others through contexts. These contexts determine how linked pages influence and interact with each other. When differentiating such interactions, the authority of web pages can be better estimated by controlling the authority flows among pages. In this work, we determine the authority distribution by examining the topicality relationship between associated pages. In addition, we find it is not enough to quantify the influence of authority propagation from only one type of neighbor, such as parent pages in PageRank algorithm, since web pages, like people, are influenced by diverse types of neighbors within the same network. We propose a probabilistic method to model authority flows from different sources of neighbor pages. In this way, we distinguish page authority interaction by incorporating the topical context and the relationship between associated pages. Experiments on the 2003 and 2004 TREC Web Tracks demonstrate that this approach outperforms other competitive topical ranking models and produces a more than 10% improvement over PageRank on the quality of top 10 search results. When increasing the types of incorporated neighbor sources, the performance shows stable improvements.


Authority Propagation Current Page Open Directory Project Authority Distribution Parent Page 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Cai, D., He, X., Wen, J.-R., Ma, W.-Y.: Block-level link analysis. In: Proc. 27th Annual Int’l ACM SIGIR Conf. on Research and Dev. in Information Retrieval (July 2004)Google Scholar
  2. 2.
    Haveliwala, T.H.: Topic-sensitive PageRank. In: Proc. of the 11th Int’l World Wide Web Conf., pp. 517–526. ACM Press, New York (2002)Google Scholar
  3. 3.
    McCallum, A.K.: Bow: A toolkit for statistical language modeling, text retrieval, classification and clustering (1996),
  4. 4.
    Nie, L., Davison, B.D.: Separate and inequal: Preserving heterogeneity in topical authority flows. In: Proc. 31st Annual Int’l ACM SIGIR Conf. on Research and Dev. in Information Retrieval, July 2008, pp. 443–450 (2008)Google Scholar
  5. 5.
    Nie, L., Davison, B.D., Qi, X.: Topical link analysis for web search. In: Proc. 29th Annual Int’l ACM SIGIR Conf. on Research & Dev. in Info. Retrieval, August 2006, pp. 91–98 (2006)Google Scholar
  6. 6.
    The dmoz Open Directory Project, ODP (2009),
  7. 7.
    Qin, T., Liu, T.-Y., Zhang, X.-D., Chen, Z., Ma, W.-Y.: A study of relevance propagation for web search. In: Proc. 28th Annual Int’l ACM SIGIR Conf. on Research and Dev. in Information Retrieval, pp. 408–415 (2005)Google Scholar
  8. 8.
    Robertson, S.E.: Overview of the OKAPI projects. Journal of Documentation 53, 3–7 (1997)CrossRefGoogle Scholar
  9. 9.
    Shakery, A., Zhai, C.: A probabilistic relevance propagation model for hypertext retrieval. In: Proc. of the 15th ACM Int’l Conf. on Information and Knowledge Management (CIKM), pp. 550–558 (2006)Google Scholar
  10. 10.
    Shakery, A., Zhai, C.: Smoothing document language models with probabilistic term count propagation. Inf. Retr. 11(2), 139–164 (2008)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • Na Dai
    • 1
  • Brian D. Davison
    • 1
  • Yaoshuang Wang
    • 1
  1. 1.Department of Computer Science & EngineeringLehigh UniversityUSA

Personalised recommendations