Skip to main content
SpringerLink
Log in

Open Source Intelligence Initiating Efficient Investigation and Reliable Web Searching

  • Conference paper
  • First Online:
Advances in Computing and Data Sciences (ICACDS 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1244))

Included in the following conference series:

Abstract

Open Source Intelligence (OSINT) is the collection and processing of information collected from publicly available or open-source web portals or sites. OSINT has been around for hundreds of years, under one name or another. With the emergence of instantaneous communication and rapid knowledge transfer, a great deal of actionable and analytical data can now be collected from unclassified, public sources. Using OSINT as the base concept, we have attempted to provide solutions for two different use cases i.e. the first is an investigation platform that would help in avoiding manual information gathering saving time and resources of information gatherers providing only the relevant data in an understandable template format rather than in graphical structure and focuses on demanding minimal input data. The second is a business intelligence solution that allows users to find details about an individual or themselves for business growth, brand establishment, and client tracking further elaborated in the paper.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. George, R.Z., Kline, R.D., Lowenthal, M.M.: Intelligence and the National Security Strategist: Enduring Issues and Challenges, vol. 58, pp. 273–284. Rowman and Littlefield (2005). ISBN 9780742540392

    Google Scholar 

  2. Byrne, J., Marx, G.: Technological innovations in crime prevention and policing. A review of the research on implementation and impact. J. Police Stud. 20(3), 17–40 (2011). ISBN 978-90-466-0412-0

    Google Scholar 

  3. Rico, R.A.P., Medina, M.J.H., Hernández, C.C.P., López, D.O.D., Ruíz, J.C.C.G.: Open source intelligence (OSINT) as support of cybersecurity operations. use of OSINT in a colombian context and sentiment Analysis. Revista Vínculos: Ciencia, Tecnología y Sociedad 15, 195–214 (2018)

    Article  Google Scholar 

  4. Pastor-Galindo, J., Nespoli, P., Mármol, F.G., Pérez, G.M.: The not yet exploited goldmine of OSINT: opportunities, open challenges and future trends. IEEE Access 8, 10282–10304 (2020)

    Article  Google Scholar 

  5. Schaurer, F., Störger, J.: Guide to the Study of intelligence. The evolution of open source intelligence (OSINT) intelligencer. J. U.S. Intell. Stud. 19(3), 53–56 (2010)

    Google Scholar 

  6. Adderley, R., Musgrove, P.: Police crime recording and investigation systems – a user’s view. Polic. Int. J. Police Strat. Manag. Emerald 24(1), 100–114 (2001)

    Article  Google Scholar 

  7. Clive, B.: Web mining for open source intelligence. In: IEEE. 12th International Conference Information Visualisation, London, pp. 321–325 (2008)

    Google Scholar 

  8. Nacci, G.: The general theory for open source intelligence in brief. A proposal, pp. 1–3. Intelli|sfèra (2019)

    Google Scholar 

  9. Hassan, N.A., Hijazi, R.: Open Source Intelligence Methods and Tools, pp. 15–18. Apress Media LLC, New York (2018). ISBN-13 (pbk): 978-1-4842-3212-5. ISBN-13 (electronic): 978-1-4842-3213-2

    Book  Google Scholar 

  10. Satheesh, A., Singh, M.: Comparative study of open source automated web testing tools: selenium and sahi. Indian J. Sci. Technol. 10(13), 1–9 (2017). ISSN (Print): 0974-6846. ISSN (Online): 0974-5645

    Article  Google Scholar 

  11. Dobbelaere, P., Esmaili, K.S.: Kafka versus RabbitMQ: a comparative study of two industry reference publish/subscribe implementations. Industry Paper, pp. 227–238 (2017)

    Google Scholar 

  12. Jason, B.: Machine Learning Streaming with Kafka, pp. 239–303. O’Reilly, Sebastopol (2020)

    Google Scholar 

  13. Shree, R., Choudhury, T., Gupta, S.C., Kumar, P.: KAFKA: the modern platform for data management and analysis in big data domain. In: 2nd International Conference on Telecommunication and Networks (TEL-NET), pp. 1–5 (2017)

    Google Scholar 

  14. Wang, X., Loguinov, D.: Load-balancing performance of consistent hashing: asymptotic analysis of random node join. IEEE/ACM Trans. Netw. 15(4), 892–905 (2007)

    Article  Google Scholar 

  15. Zhang, Z., Qiang, Y., Li, Y.: Using Naïve Bayes classifier to distinguish reviews from non-review documents in Chinese. In: 2007 International Conference on Management Science and Engineering, Harbin, pp. 115–121 (2007)

    Google Scholar 

  16. Francesco, P.D., Malavolta, I., Lago, P.: Research on architecting microservices: trends, focus, and potential for industrial adoption. In: 2017 IEEE International Conference on Software Architecture (ICSA), Gothenburg, pp. 21–30 (2017)

    Google Scholar 

  17. Christudas, B.: Spring Boot, Practical Microservices Architectural Patterns, pp. 147–182. Apress, New York (2019)

    Book  Google Scholar 

  18. Reddy, K.: Web Applications with Spring Boot - Beginning Spring Boot 2: Applications and Microservices with the Spring Framework, pp. 107–132. Apress, New York (2017)

    Book  Google Scholar 

  19. Chen, R., Miao, H.: A selenium based approach to automatic test script generation for refactoring JavaScript code. In: 2013 IEEE/ACIS 12th International Conference on Computer and Information Science (ICIS), Niigata, pp. 341–346 (2013)

    Google Scholar 

  20. Cosmina, I.: Building Reactive Applications Using Spring. Pivotal Certified Professional Core Spring 5 Developer Exam, pp. 903–955 (2020)

    Google Scholar 

  21. Abdhullah, S.S., Jyoti, K., Sharma, S., Pandey, U.S.: Review of recent load balancing techniques in cloud computing and BAT algorithm variants. In: 2016 3rd International Conference on Computing for Sustainable Global Development (INDIACom), New Delhi, pp. 2428–2431 (2016)

    Google Scholar 

  22. Prakash, S.W., Deepalakshmi, P.: Server-based dynamic load balancing. In: 2017 International Conference on Networks & Advances in Computational Technologies (NetACT), Thiruvanthapuram, pp. 25–28 (2017)

    Google Scholar 

  23. Wehner, P., Piberger, C., Göhringer, D.: Using JSON to manage communication between services in the Internet of Things. In: 9th International Symposium on Reconfigurable and Communication-Centric Systems-on-Chip (ReCoSoC), Montpellier, pp. 1–4 (2014)

    Google Scholar 

  24. Mishra, A.: Amazon Rekognition - Machine Learning in the AWS Cloud, pp. 421–444. Wiley, New York (2019). Chap. 18

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of IT, ABES Institute of Technology, Ghaziabad, 201009, Uttar Pradesh, India

    Shiva Tiwari, Ravi Verma, Janvi Jaiswal & Bipin Kumar Rai

Authors
  1. Shiva Tiwari
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ravi Verma
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Janvi Jaiswal
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Bipin Kumar Rai
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Shiva Tiwari , Ravi Verma , Janvi Jaiswal or Bipin Kumar Rai .

Editor information

Editors and Affiliations

  1. University of KwaZulu-Natal, Durban, South Africa

    Mayank Singh

  2. Jaypee University of Information Technology, Waknaghat, Himachal Pradesh, India

    P. K. Gupta

  3. Jaypee University of Engineering and Technology, Guna, Madhya Pradesh, India

    Vipin Tyagi

  4. Institute of Information Theory and Automation, Prague, Czech Republic

    Jan Flusser

  5. University of Ottawa, Ottawa, ON, Canada

    Tuncer Ören

  6. University of Malta, Valletta, Malta

    Gianluca Valentino

Appendix

Appendix

  • f = frequency of letter in the document.

  • d = JSONF document.

  • D = total number of JSONF documents.

  • N = number of d in which t occurs

  • pi = ith person

  • cw = crawler

  • S = set of links to be searched

  • lst = local storage of each crawl result

  • G_Stack = Global stack

  • JSONF = final JSON

  • t = triggers

  • ß = learning rate.

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Tiwari, S., Verma, R., Jaiswal, J., Rai, B.K. (2020). Open Source Intelligence Initiating Efficient Investigation and Reliable Web Searching. In: Singh, M., Gupta, P., Tyagi, V., Flusser, J., Ören, T., Valentino, G. (eds) Advances in Computing and Data Sciences. ICACDS 2020. Communications in Computer and Information Science, vol 1244. Springer, Singapore. https://doi.org/10.1007/978-981-15-6634-9_15

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-6634-9_15

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-6633-2

  • Online ISBN: 978-981-15-6634-9

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation