A Novel Meta Crawling Algorithm for Terrorist Network Knowledge Aggregation from the Internet

  • R. D. GaharwarEmail author
  • D. B. Shah
Conference paper
Part of the Smart Innovation, Systems and Technologies book series (SIST, volume 77)


Nowadays, World Wide Web is flooded with different types of web browsers. Each of these web browsers differs from one another on the basis of search time, search efficiency and the area of the Internet they cover in their search. The popular search engines like Yahoo Search, Google, Dogpile, Bing, Ask, etc., are facing efficiency challenges due to tremendous growth rate of data on the Internet. Moreover, the current state of the art in this field works on the general search results. Hence, special data mining search results require customized search services. Terrorist network mining is one such field of data mining which requires customized search services. This paper presents the algorithm for customized Terrorist Meta Crawler. The algorithm presented in this paper is optimized to search terrorist-related information on World Wide Web using different web services. The last section of this paper presents the comparative effectiveness of Terrorist Meta Crawler along with other popular search engines, and results show Terrorist Meta Crawler is a better solution for customized search.


Meta crawler Search engine Terrorist networks Terrorist network mining Web crawler 


  1. 1.
    Gaharwar, R.D., Shah, D.B.: Architectural design of Meta Crawler for Terrorist Network Mining. Commun. Appl. Electron. 5(8), 37–40 (2016)CrossRefGoogle Scholar
  2. 2.
    Etzioni, O.: Moving up the information food chain: deploying softbots on the world wide web. AI Mag. 18(2), 11 (1997)Google Scholar
  3. 3.
    Gaharwar, R.D., Shah, D.B., Gaharwar, G.K.S.: The study of multi-search services for Terrorist Network Mining. Commun. Appl. Electron. 5(8), 37–40 (2016)CrossRefGoogle Scholar
  4. 4.
    Links & Law: Information about legal aspects of search engines, linking and framing.
  5. 5.
    Yang, X., Zhang, M.: Necessary constraints for fusion algorithms in meta search engine systems. In: Proceedings of the International Conference on Intelligent Technologies, pp. 409–416 (2000)Google Scholar
  6. 6.
    Selberg, E., Etzioni, O.: Multi-service search and comparison using the MetaCrawler. In: Proceedings of the Fourth International WWW Conference, Boston (1995)Google Scholar
  7. 7.
    Laria, V.G., Griffiths, R., Winstanley, G.: Application of a clustering algorithm to recover topic content in an unstructured text-based environment.
  8. 8.
    Selberg, E., Etzioni, O.: The MetaCrawler architecture for resource aggregation on the Web. IEEE Expert 12(1), 11–14 (1997)CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2018

Authors and Affiliations

  1. 1.G H Patel Post Graduate Department of Computer Science and TechnologySardar Patel UniversityVallabh VidyanagarIndia

Personalised recommendations