Adaptive Web Search Based on a Colony of Cooperative Distributed Agents

  • Fabio Gasparetti
  • Alessandro Micarelli
Part of the Lecture Notes in Computer Science book series (LNCS, volume 2782)


This work introduces an adaptive Web search system, based on a reactive agent architecture, which drew inspiration from the Ant System computational paradigm. This system aims at searching reactively and autonomously information about a particular topic, in huge hypertextual collections, such as the Web. The adaptivity allows it to be robust to environmental alterations and to user information need changes. Besides showing significant results on standard collections, this work widens further the range of intelligent search topic, towards theories and architectures of agent and multiagent systems.


Multiagent System User Query Inverse Document Frequency Focus Crawling Current Page 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Aggarwal, C.C., Al-Garawi, F., Yu, P.S.: Intelligent Crawling on the World Wide Web with Arbitrary Predicates. In: Proc. of the WWW10 Conference, pp. 96–105 (2001)Google Scholar
  2. 2.
    Bailey, P., Craswell, N., Hawking, D.: Dark matter on the web. Poster Proc. of the WWW9 Conference (2000)Google Scholar
  3. 3.
    Bonabeau, E., Dorigo, M., Theraulaz, G.: Inspiration for optimization from social insect behavior. Nature 406, 39–42 (2000)CrossRefGoogle Scholar
  4. 4.
    Brin, S., Page, L.: The Anatomy of a Large-Scale HypertextualWeb Search Engine. Computer Networks and ISDN Systems 30, 107–117 (1998)CrossRefGoogle Scholar
  5. 5.
    Brooks, R.A.: Intelligence without representation. Artificial Intelligence 45, 139–159 (1991)CrossRefGoogle Scholar
  6. 6.
    Broder, A., Kumar, R., Maghoul, F., Raghavan, P., Rajagopalan, S., Stata, R., Tomkins, A., Wiener, J.: Graph structure in the web. In: Proc. of the WWW9 Conference, pp. 309–320 (2000)Google Scholar
  7. 7.
    Chakrabarti, S., Van Den Berg, M., Dom, B.: Focused Crawling: A New Approach to Topic-Specific Web Resource Discovery. In: Proc. of the WWW8 Conference, pp. 1623–1640 (1999)Google Scholar
  8. 8.
    Chen, H., Chung, Y., Ramsey, M., Yang, C.C.: An Intelligent Personal Spider (Agent) for Dynamic Internet/Intranet Searching Decision Support Systems, Vol. 23(1), pp.41–58 (1998)Google Scholar
  9. 9.
    Cho, J., Garcia-Molina, H.G., Page, L.: Efficient Crawling Through URL Ordering. Computer Networks and ISDN Systems 30(1-7), 161–172 (1998)Google Scholar
  10. 10.
    Di Caro, G., Dorigo, M.: AntNet: Distributed stigmergetic control for communications networks. Journal of Artificial Intelligence Research 9, 317–365 (1998)zbMATHGoogle Scholar
  11. 11.
    Dorigo, M., Maniezzo, V., Colorni, A.: The Ant System: Optimization by a colony of coop-erating agents. IEEE Transactions on Systems, Man, and Cybernetics–Part B 26(2), 29–41 (1996)CrossRefGoogle Scholar
  12. 12.
    Kleinberg, J.M.: Authoritative Source in a Hyperlinked Environment. Journal of the ACM 46(5), 604–632 (1999)zbMATHCrossRefMathSciNetGoogle Scholar
  13. 13.
    Klusch, M.: Information Agent Technology for the Internet: A Survey. Journal on Data and Knowledge Engineering 36(3), 337–372 (2001)zbMATHCrossRefGoogle Scholar
  14. 14.
    Kube, C.R., Zhang, H.: Collective robotics: from social insects to robots. Adaptive Behavior 2, 189–218 (1993)CrossRefGoogle Scholar
  15. 15.
    Lawrence, S.: Context in Web Search. IEEE Data Engineering Bulletin 23(3), 25–32 (2000)Google Scholar
  16. 16.
    Lieberman, H.: Autonomous Interface Agents. In: Proc. of ACM Conference on CHI 1997, Atlanta, USA (1997)Google Scholar
  17. 17.
    Lieberman, H.: Personal Assistants for the Web: An MIT Perspective. In: Klusch, M. (ed.) Intelligent Information Agents, pp. 272–292. Springer, Berlin (1999)Google Scholar
  18. 18.
    Maes, P.: Agents that Reduce Work and Information Overload. Communications of the ACM 37(7), 31–40 (1994)zbMATHCrossRefGoogle Scholar
  19. 19.
    Manning, C.D., Schutze, H.: Foundations of Statitical Natural Language Processing. MIT Press, Cambridge (1999)Google Scholar
  20. 20.
    Menczer, F., Monge, A.E.: Scalable Web Search by Adaptive Online Agents: An InfoSpiders Case Study. In: Klusch, M. (ed.) Intelligent Information Agents, pp. 323–340. Springer, Berlin (1999)Google Scholar
  21. 21.
    Menczer, F., Pant, G., Srinivasan, P., Ruiz, M.E.: Evaluating Topic-Driven Web Crawlers. In: Proc. 24th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 241–249 (2001)Google Scholar
  22. 22.
    Mizuuchi, Y., Tajima, K.: Finding Context Paths for Web Pages. In: Proc. of ACM Hypertext, pp. 13–22 (1999)Google Scholar
  23. 23.
    Salton, G., McGill, M.J.: Introduction to Modern Information Retrieval. McGraw- Hill, New York (1983)zbMATHGoogle Scholar
  24. 24.
    Schoonderwoerd, R., Holland, O., Bruten, J., Rothkrantz, L.: Ant-based load balancing in telecommunications networks. Adaptive Behavior 5(2), 169–207 (1996)CrossRefGoogle Scholar
  25. 25.
    Witten, I.H., Moffat, A., Bell, T.C.: Managing Gigabytes: Compressing and Indexing Documents and Images. Morgan Kaufmann Publishing, San Francisco (1999)Google Scholar
  26. 26.
    Wooldridge, M., Jennings, N.R.: Intelligent Agents: Theory and Practice. Knowledge Engineering Review 10(2), 115–152 (1995)CrossRefGoogle Scholar
  27. 27.
    Wooldridge, M.: Intelligent Agents. In: Weiss, G. (ed.) Multiagent Systems: A Modern Approach to Distributed Artificial Intelligence. The MIT Press, Cambridge (1999)Google Scholar
  28. 28.
    Yang, C.C., Yen, J., Chen, H.: Intelligent Internet searching agent based on hybrid simulated annealing. Decision Support Systems 28, 269–277 (2000)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2003

Authors and Affiliations

  • Fabio Gasparetti
    • 1
  • Alessandro Micarelli
    • 1
  1. 1.Dipartimento di Informatica e AutomazioneUniversità degli Studi “Roma Tre”RomaItaly

Personalised recommendations