Skip to main content

Implementation-Oriented Feature Selection in UNSW-NB15 Intrusion Detection Dataset

Part of the Lecture Notes in Networks and Systems book series (LNNS,volume 418)

Abstract

With a daily global average of 30,000 websites breached in 2021, security challenges grow in difficulty, complexity, and importance. Since it’s publication, UNSW-NB15 dataset was used in many machine-learning, and statistics based intrusion detection solutions. It provides over 2.5 million instances of benign and malicious network flow captures.

In this paper, we present an implementation-oriented feature selection that reduces the number of features while maintaining high accuracy. The proposed reduction resulted in a dataset with 5 features that are focused on making machine learning models more implementable, practical, and efficient. Testing showed that the reduced dataset maintained an accuracy of 99% with a testing time reduction of up to 84%.

Keywords

  • Intrusion detection
  • Dataset
  • IoT
  • Malware

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   229.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   299.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Moustafa, N., Slay, J.: UNSW-NB15: a comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set). In: 2015 Military Communications and Information Systems Conference (MilCIS), pp. 1–6 (2015). IEEE

    Google Scholar 

  2. UNSW-NB15 - Google Scholar (2021). Accessed 30 Sept 2021. https://scholar.google.com/scholar?q=unsw-nb15

  3. Moustafa, N., Slay, J.: The significant features of the UNSW-NB15 and the KDD99 data sets for network intrusion detection systems. In: 2015 4th International Workshop on Building Analysis Datasets and Gathering Experience Returns for Security (BADGERS), pp. 25–31. IEEE (2015)

    Google Scholar 

  4. Elkan, C.: Results of the KDD’99 classifier learning. ACM SIGKDD Explorat. Newslett. 1(2), 63–64 (2000)

    CrossRef  Google Scholar 

  5. Janarthanan, T., Zargari, S.: Feature selection in UNSW-NB15 AND KDDCUP’ 99 datasets. In: 2017 IEEE 26th International Symposium on Industrial Electronics (ISIE), pp. 1881–1886. IEEE (2017)

    Google Scholar 

  6. Al-Daweri, M.S., Zainol Ariffin, K.A., Abdullah, S., et al.: An analysis of the KDD99 and UNSW-NB15 datasets for the intrusion detection system. Symmetry 12(10), 1666 (2020)

    CrossRef  Google Scholar 

  7. Khan, N.M., Nalina Madhav, C., Negi, A., Thaseen, I.S.: Analysis on improving the performance of machine learning models using feature selection technique. In: Abraham, A., Cherukuri, A., Melin, P., Gandhi, N. (eds.) Intelligent Systems Design and Applications, pp. 69–77. Springer, Cham, Switzerland (2019). https://doi.org/10.1007/978-3-030-16660-1_7

  8. Kanimozhi, V., Jacob, P.: UNSW-NB15 dataset feature selection and network intrusion detection using deep learning. Int. J. Recent Technol. Eng. 7(5S2), 443–446 (2019)

    Google Scholar 

  9. Kasongo, S.M., Sun, Y.: Performance analysis of intrusion detection systems using a feature selection method on the UNSW-NB15 dataset. J. Big Data 7(1), 1–20 (2020)

    CrossRef  Google Scholar 

  10. Almomani, O.: A feature selection model for network intrusion detection system based on PSO, GWO, FFA and GA algorithms. Symmetry 12(6), 1046 (2020)

    CrossRef  Google Scholar 

  11. Moualla, S., Khorzom, K., Jafar, A.: Improving the performance of machine learning-based network intrusion detection systems on the UNSWNB15 dataset. Comput. Intell. Neurosci. 2021 (2021)

    Google Scholar 

  12. Suresh Kumar, P., Akthar, S.: Building an efficient feature selection for intrusion detection system on UNSW-NB15. In: Jyothi, S., Mamatha, D.M., Zhang, YD., Raju, K.S. (eds.) Proceedings of the 2nd International Conference on Computational and Bio Engineering, pp. 641–649 (2021). https://doi.org/10.1007/978-981-16-1941-0_64

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Mohammed M. Alani .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Alani, M.M. (2022). Implementation-Oriented Feature Selection in UNSW-NB15 Intrusion Detection Dataset. In: Abraham, A., Gandhi, N., Hanne, T., Hong, TP., Nogueira Rios, T., Ding, W. (eds) Intelligent Systems Design and Applications. ISDA 2021. Lecture Notes in Networks and Systems, vol 418. Springer, Cham. https://doi.org/10.1007/978-3-030-96308-8_51

Download citation