Find out how to access preview-only content
Volume 5369 of the series Lecture Notes in Computer Science pp 680-691
On the Stability of Web Crawling and Web Search
- Reid AndersonAffiliated withMicrosoft Research
- , Christian BorgsAffiliated withMicrosoft Research
- , Jennifer ChayesAffiliated withMicrosoft Research
- , John HopcroftAffiliated withCornell University
- , Vahab MirrokniAffiliated withGoogle Research
- , Shang-Hua TengAffiliated withBoston University
Abstract
In this paper, we analyze a graph-theoretic property motivated by web crawling. We introduce a notion of stable cores, which is the set of web pages that are usually contained in the crawling buffer when the buffer size is smaller than the total number of web pages. We analyze the size of core in a random graph model based on the bounded Pareto power law distribution. We prove that a core of significant size exists for a large range of parameters 2 < α< 3 for the power law.
- Title
- On the Stability of Web Crawling and Web Search
- Book Title
- Algorithms and Computation
- Book Subtitle
- 19th International Symposium, ISAAC 2008, Gold Coast, Australia, December 15-17, 2008. Proceedings
- Pages
- pp 680-691
- Copyright
- 2008
- DOI
- 10.1007/978-3-540-92182-0_60
- Print ISBN
- 978-3-540-92181-3
- Online ISBN
- 978-3-540-92182-0
- Series Title
- Lecture Notes in Computer Science
- Series Volume
- 5369
- Series ISSN
- 0302-9743
- Publisher
- Springer Berlin Heidelberg
- Copyright Holder
- Springer-Verlag Berlin Heidelberg
- Additional Links
- Topics
- Industry Sectors
- eBook Packages
- Editors
-
- Seok-Hee Hong (1)
- Hiroshi Nagamochi (2)
- Takuro Fukunaga (3)
- Editor Affiliations
-
- 1. School of Information Technologies, University of Sydney
- 2. Graduate School of Informatics, Kyoto University
- 3. Graduate School of Informatics, Kyoto University
- Authors
-
- Reid Anderson (4)
- Christian Borgs (4)
- Jennifer Chayes (4)
- John Hopcroft (5)
- Vahab Mirrokni (6)
- Shang-Hua Teng (7)
- Author Affiliations
-
- 4. Microsoft Research,
- 5. Cornell University,
- 6. Google Research,
- 7. Boston University,
Continue reading...
To view the rest of this content please follow the download PDF link above.