Skip to main content
SpringerLink
Log in

Artificial Intelligence Cyberattacks in Red Teaming: A Scoping Review

  • Conference paper
  • First Online:
Good Practices and New Perspectives in Information Systems and Technologies (WorldCIST 2024)

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 985))

Included in the following conference series:

  • 14 Accesses

Abstract

Advances in artificial intelligence are creating possibilities to use these methods in red team activities, such as cyberattacks. These AI attacks can automate the process of penetrating a target or collecting sensitive data while accelerating the pace of carrying out the attacks. This survey explores how AI is employed in cybersecurity attacks and what kind of targets are typical. We used scoping review methodology to sift through articles to find out AI methods, targets, and models that red teams can use to emulate cybercrime. Out of the 470 records screened, 11 were included in the review. Multiple cyberattack methods can be found to exploit sensitive data, systems, social media user profiles, passwords, and URLs. The use of AI in cybercrime to build versatile attack models poses a growing threat. Additionally, cybersecurity can use AI-based techniques to offer better protection tools to deal with those problems.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 249.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    https://janet.finna.fi/.

  2. 2.

    https://scholar.google.com/.

References

  1. Department of Defence Interface Standard, Common Warfighting Symbology. Standard MIL-STD-2525C, United States of America, Department of Defence (2008)

    Google Scholar 

  2. Brundage, M., et al.: The malicious use of artificial intelligence: forecasting, prevention, and mitigation. arXiv preprint arXiv:1802.07228 (2018)

  3. Brynielsson, J., Franke, U., Tariq, M.A., Varga, S.: Using cyber defense exercises to obtain additional data for attacker profiling. In: 2016 IEEE Conference on Intelligence and Security Informatics (ISI), pp. 37–42 (2016). https://doi.org/10.1109/ISI.2016.7745440

  4. Clinton, L. (ed.): Cybersecurity for Business. Kogan Page, London (2022)

    Google Scholar 

  5. Computer Security Resource Center (CSRC) of National Institute of Standards and Technology (NIST). The Glossary of Terms and Definitions Extracted Verbatim from NIST’s Cybersecurity- and Privacy-Related Publications. https://csrc.nist.gov/glossary/term/red_team. Accessed 15 Sept 2023

  6. Ghafir, I., Prenosil, V.: Advanced persistent threat and spear phishing emails. In: Hrubý, M. (ed.) Proceedings of the International Conference Distance Learning, Simulation and Communication ‘DLSC 2015’, pp. 34–41. University of Defence, Brno (2015)

    Google Scholar 

  7. Guembe, B., Azeta, A., Misra, S., Osamor, V.C., Fernandez-Sanz, L., Pospelova, V.: The emerging threat of AI-driven cyber attacks: a review. Appl. Artif. Intell. 36(1), 2037254 (2022)

    Google Scholar 

  8. Kaloudi, N., Li, J.: The AI-based cyber threat landscape: a survey. ACM Comput. Surv. 53(1), 1–34 (2020)

    Article  Google Scholar 

  9. Kick, J.: Cyber exercise playbook (2014). https://www.mitre.org/news-insights/publication/cyber-exercise-playbook. Accessed 15 Sept 2023

  10. King, T.C., Aggarwal, N., Taddeo, M., Floridi, L.: Artificial intelligence crime: an interdisciplinary analysis of foreseeable threats and solutions. Sci. Eng. Ethics 26, 89–120 (2020)

    Article  Google Scholar 

  11. Kokkonen, T., Puuska, S.: Blue team communication and reporting for enhancing situational awareness from white team perspective in cyber security exercises. In: Galinina, O., Andreev, S., Balandin, S., Koucheryavy, Y. (eds.) Internet of Things, Smart Spaces, and Next Generation Networks and Systems. LNCS, vol. 11118, pp. 277–288. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-01168-0_26

  12. Longbine, D.F.: Red Teaming: Past and Present. School of Advanced Military Studies, Fort Leavenworth (2008)

    Google Scholar 

  13. McGowan, J., et al.: Reporting scoping reviews—PRISMA ScR extension. J. Clin. Epidemiol. 123, 177–179 (2020). https://doi.org/10.1016/j.jclinepi.2020.03.016

  14. Munn, Z., Peters, M.D., Stern, C., Tufanaru, C., McArthur, A., Aromataris, E.: Systematic review or scoping review? guidance for authors when choosing between a systematic or scoping review approach. BMC Med. Res. Methodol. 18, 1–7 (2018)

    Article  Google Scholar 

  15. NATO Standardization Office (NSO). NATO standard app-6, NATO joint military symbology. Standard Edition D, Version 1, North Atlantic Treaty Organization (NATO) (2017)

    Google Scholar 

  16. Pistono, F., Yampolskiy, R.V.: Unethical research: how to create a malevolent artificial intelligence. In: Proceedings of Ethics for Artificial Intelligence Workshop (AI-Ethics-2016), pp. 1–7 (2016)

    Google Scholar 

  17. Renaud, K., Warkentin, M., Westerman, G.: From ChatGPT to HackGPT: meeting the cybersecurity threat of generative AI. MIT Sloan Management Review (2023). Reprint #64428

    Google Scholar 

  18. Smith, J., Theisen, C., Barik, T.: A case study of software security red teams at Microsoft. In: 2020 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC), pp. 1–10. IEEE (2020). https://doi.org/10.1109/VL/HCC50065.2020.9127203

  19. Sommestad, T., Hallberg, J.: Cyber security exercises and competitions as a platform for cyber security experiments. In: Jøsang, A., Carlsson, B. (eds.) Secure IT Systems. LNCS, vol. 7617, pp. 47–60. Springer, Heidelberg (2012). https://doi.org/10.1007/978-3-642-34210-3_4

  20. Truong, T.C., Diep, Q.B., Zelinka, I.: Artificial intelligence in the cyber domain: offense and defense. Symmetry 12(3), 410 (2020)

    Article  Google Scholar 

  21. Wang, C., Chen, J., Yang, Y., Ma, X., Liu, J.: Poisoning attacks and countermeasures in intelligent networks: status quo and prospects. Digit. Commun. Netw. 8(2), 225–234 (2022)

    Article  Google Scholar 

  22. Wang, W., Siau, K.: Artificial intelligence, machine learning, automation, robotics, future of work and future of humanity: a review and research agenda. J. Datab. Manag. 30(1), 61–79 (2019). https://doi.org/10.4018/JDM.2019010104

    Article  Google Scholar 

  23. Ward, D., Wooderson, P.: Automotive Cybersecurity: An Introduction to ISO/SAE 21434, p. 106. SAE International (2021)

    Google Scholar 

  24. Wilhelmson, N., Svensson, T.: Handbook for planning, running and evaluating information technology and cyber security exercises. In: The Swedish National Defence College, Center for Asymmetric Threats Studies (CATS) (2014)

    Google Scholar 

  25. Yamin, M.M., Ullah, M., Ullah, H., Katt, B.: Weaponized AI for cyber attacks. J. Inf. Secur. Appl. 57, 102722 (2021)

    Google Scholar 

  26. Yuen, J.: Automated Cyber Red Teaming. DSTO Defence Science and Technology Organisation, Edinburgh (2015)

    Google Scholar 

  27. Zhou, W.C., Sun, S.L.: Red Teaming Strategy: Huawei’s Organizational Learning and Resilience, pp. 299–317. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-47579-6_13

  28. Zouave, E., Bruce, M., Colde, K., Jaitner, M., Rodhe, I., Gustafsson, T.: Artificially intelligent cyberattacks. Tech. Rep. FOI, Swedish Defence Research Agency, FOI (2020)

    Google Scholar 

Download references

Acknowledgements

This research was partially funded by the Resilience of Modern Value Chains in a Sustainable Energy System project, co-funded by the European Union and the Regional Council of Central Finland (grant number J10052). The authors would like to thank Ms. Tuula Kotikoski for proofreading the manuscript.

Author information

Authors and Affiliations

  1. Institute of Information Technology, Jamk University of Applied Sciences, Jyväskylä, Finland

    Mays Al-Azzawi, Dung Doan, Tuomo Sipola, Jari Hautamäki & Tero Kokkonen

Authors
  1. Mays Al-Azzawi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Dung Doan
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tuomo Sipola
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jari Hautamäki
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tero Kokkonen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tuomo Sipola .

Editor information

Editors and Affiliations

  1. ISEG, Universidade de Lisboa, Lisbon, Portugal

    Álvaro Rocha

  2. College of Engineering, The Ohio State University, Columbus, OH, USA

    Hojjat Adeli

  3. Institute of Data Science and Digital Technologies, Vilnius University, Vilnius, Lithuania

    Gintautas Dzemyda

  4. DCT, Universidade Portucalense, Porto, Portugal

    Fernando Moreira

  5. Institute of Information Technology, Lodz University of Technology, Łódz, Poland

    Aneta Poniszewska-Marańda

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Al-Azzawi, M., Doan, D., Sipola, T., Hautamäki, J., Kokkonen, T. (2024). Artificial Intelligence Cyberattacks in Red Teaming: A Scoping Review. In: Rocha, Á., Adeli, H., Dzemyda, G., Moreira, F., Poniszewska-Marańda, A. (eds) Good Practices and New Perspectives in Information Systems and Technologies. WorldCIST 2024. Lecture Notes in Networks and Systems, vol 985. Springer, Cham. https://doi.org/10.1007/978-3-031-60215-3_13

Download citation

Publish with us

Policies and ethics

Search

Navigation