Skip to main content

kNN and SVM Classification for EEG: A Review

  • Conference paper
  • First Online:
InECCE2019

Part of the book series: Lecture Notes in Electrical Engineering ((LNEE,volume 632))

Abstract

This paper review the classification method of EEG signal based on k-nearest neighbor (kNN) and support vector machine (SVM) algorithm. For instance, a classifier learns an input features from a dataset using specific approach and tuning parameters, develop a classification model, and use the model to predict the corresponding class of new input in an unseen dataset. EEG signals contaminated with various noises and artefacts, non-stationary and poor in signal-to-noise ratio (SNR). Moreover, most EEG applications involve high dimensional feature vector. kNN and SVM were used in EEG classification and has been proven successfully in discriminating features in EEG dataset. However, different results were observed between different EEG applications. Hence, this paper reviews the used of kNN and SVM classifier on various EEG applications, identifying their advantages and disadvantages, and also their overall performances.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or Ebook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Haas L (2003) Hans Berger (1873–1941), Richard Caton (1842–1926), and electroencephalography. J Neurol Neurosurg Psychiatry 74:9

    Article  Google Scholar 

  2. Sanei S, Chambers JA (2013) EEG signal processing. Wiley

    Google Scholar 

  3. Vaid S, Singh P, Kaur C (2015) EEG signal analysis for BCI interface: a review. In: 2015 fifth international conference on advanced computing & communication technologies, pp 143–147

    Google Scholar 

  4. iMotion, Top 6 most common applications for human EEG research, 2015

    Google Scholar 

  5. He L, Hu D, Wan M, Wen Y, Deneen KMV, Zhou M (2016) Common Bayesian network for classification of EEG-based multiclass motor imagery BCI. IEEE Transa Syst Man Cybern Syst 46:843–854

    Google Scholar 

  6. An X, Kuang D, Guo X, Zhao Y, He L (2014) A deep learning method for classification of EEG data based on motor imagery. Cham, pp 203–210

    Google Scholar 

  7. Rezaee K, Azizi E, Haddadnia J (2016) Optimized seizure detection algorithm: a fast approach for onset of epileptic in EEG signals using GT discriminant analysis and K-NN classifier. J Biomed Phys Eng 6:81–94

    Google Scholar 

  8. Al-Qazzaz NK, Ali SHBM, Ahmad SA, Islam MS, Escudero J (2018) Discrimination of stroke-related mild cognitive impairment and vascular dementia using EEG signal analysis. Med Biol Eng Comput 56:137–157

    Article  Google Scholar 

  9. Fuad N, Taib M, Jailani R, Marwan M (2014) Brainwave classification for brain balancing index (BBI) via 3D EEG model using k-NN technique. Int J Comput Electr Autom Control Inf Eng 8

    Google Scholar 

  10. Al-Shargie F, Tang TB, Badruddin N, Kiguchi M (2015) Mental stress quantification using EEG signals. In: International conference for innovation in biomedical engineering and life sciences, pp 15–19

    Google Scholar 

  11. Murugappan M, Ramachandran N, Sazali Y (2010) Classification of human emotion from EEG using discrete wavelet transform. J Biomed Sci Eng 3:390

    Article  Google Scholar 

  12. Kraljević L, Russo M, Sikora M (2017) Emotion classification using linear predictive features on wavelet-decomposed EEG data. In: 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN), pp 653–657

    Google Scholar 

  13. Murugappan M, Murugappan S, Gerard C (2014) Wireless EEG signals based neuromarketing system using Fast Fourier Transform (FFT). In: 2014 IEEE 10th international colloquium on signal processing and its applications, pp 25–30

    Google Scholar 

  14. Wei Z, Wu C, Wang X, Supratak A, Wang P, Guo Y (2018) Using support vector machine on EEG for advertisement impact assessment. Front Neurosci 12

    Google Scholar 

  15. Teplan M (2002) Fundamentals of EEG measurement. Measur Sci Rev 2:1–11

    Google Scholar 

  16. Lotte F, Bougrain L, Cichocki A, Clerc M, Congedo M, Rakotomamonjy A et al (2018) A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update. J Neural Eng 15:031005

    Article  Google Scholar 

  17. Zheng WL, Zhu JY, Peng Y, Lu BL (2014) EEG-based emotion classification using deep belief networks. In: Proceedings—IEEE international conference on multimedia and expo

    Google Scholar 

  18. An X, Kuang D, Guo X, Zhao Y, He L (2014) A deep learning method for classification of eeg data based on motor imagery. In Lecture notes in computer science (including subseries Lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 8590 LNBI, pp 203–210

    Google Scholar 

  19. Subha DP, Joseph PK, Acharya R, Lim CM (2010) EEG signal analysis: a survey. J Med Syst 34:195–212

    Article  Google Scholar 

  20. Sokolova M, Lapalme G (2009) A systematic analysis of performance measures for classification tasks. Inf Process Manage 45:427–437

    Article  Google Scholar 

  21. Cover TM, Hart PE (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13:21–27

    Article  Google Scholar 

  22. Cunningham P, Delany SJ (2007) k-Nearest neighbour classifiers

    Google Scholar 

  23. Hassanat AB, Abbadi MA, Altarawneh GA, Alhasanat AA (2014) Solving the problem of the K parameter in the KNN classifier using an ensemble learning approach. arXiv preprint arXiv:1409.0919

    Google Scholar 

  24. Yazdani A, Ebrahimi T, Hoffmann U (2009) Classification of EEG signals using Dempster Shafer theory and a k-nearest neighbor classifier. In: 2009 4th international IEEE/EMBS conference on neural engineering, pp 327–330

    Google Scholar 

  25. Bhattacharyya S, Khasnobish A, Chatterjee S, Konar A, Tibarewala D (2010) Performance analysis of LDA, QDA and KNN algorithms in left-right limb movement classification from EEG data. In: 2010 International conference on systems in medicine and biology, pp 126–131

    Google Scholar 

  26. Ahangi A, Karamnejad M, Mohammadi N, Ebrahimpour R, Bagheri N (2013) Multiple classifier system for EEG signal classification with application to brain–computer interfaces. Neural Comput Appl 23:1319–1327

    Article  Google Scholar 

  27. Mousa FA, El-Khoribi RA, Shoman ME (2015) EEG Classification based on machine learning techniques. Int J Comput Appl 975:8887

    Google Scholar 

  28. Aditya S, Tibarewala D (2012) Comparing ANN, LDA, QDA, KNN and SVM algorithms in classifying relaxed and stressful mental state from two-channel prefrontal EEG data. Int J Artif Intell Soft Comput 3:143–164

    Article  Google Scholar 

  29. Hosseinifard B, Moradi MH, Rostami R (2013) Classifying depression patients and normal subjects using machine learning techniques and nonlinear features from EEG signal. Comput Methods Programs Biomed 109:339–345

    Article  Google Scholar 

  30. Soroush MZ, Maghooli K, Setarehdan SK, Nasrabadi AM (2019) Emotion classification through nonlinear EEG analysis using machine learning methods. Int Clin Neurosci J 5:135–149

    Article  Google Scholar 

  31. Mehmood RM, Lee HJ (2015) Emotion classification of EEG brain signal using SVM and KNN. In: 2015 IEEE international conference on multimedia & expo workshops (ICMEW), pp 1–5

    Google Scholar 

  32. Guo L, Rivero D, Dorado J, Munteanu CR, Pazos A (2011) Automatic feature extraction using genetic programming: an application to epileptic EEG classification. Expert Syst Appl 38:10425–10436

    Article  Google Scholar 

  33. Zainuddin A, Lee KY, Mansor W, Mahmoodin Z (2016) Optimized KNN classify rule for EEG based differentiation between capable dyslexic and normal children. In: 2016 IEEE EMBS conference on biomedical engineering and sciences (IECBES), pp 685–688

    Google Scholar 

  34. Alonso LFN, Gil JG (2012) Brain computer interfaces, a review. Sensors 12:1211

    Article  Google Scholar 

  35. Duan K, Keerthi SS, Poo AN (2003) Evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing 51:41–59

    Article  Google Scholar 

  36. Hsu C-W, Chang C-C, Lin C-J (2003) A practical guide to support vector classification

    Google Scholar 

  37. Li X, Chen X, Yan Y, Wei W, Wang Z (2014) Classification of EEG signals using a multiple kernel learning support vector machine. Sensors 14:12784–12802

    Article  Google Scholar 

  38. Nguyen T, Khosravi A, Creighton D, Nahavandi S (2015) EEG signal classification for BCI applications by wavelets and interval type-2 fuzzy logic systems. Expert Syst Appl 42:4370–4380

    Article  Google Scholar 

  39. Li M, Chen W, Zhang T (2017) Automatic epileptic EEG detection using DT-CWT-based non-linear features. Biomed Signal Process Control 34:114–125

    Article  Google Scholar 

  40. Acharya UR, Molinari F, Sree SV, Chattopadhyay S, Ng K-N, Suri JS (2012) Automated diagnosis of epileptic EEG using entropies. Biomed Signal Process Control 7:401–408

    Google Scholar 

  41. Bashar SK, Das AB, Bhuiyan MIH (2015) Motor imagery movements detection of EEG signals using statistical features in the Dual Tree Complex Wavelet Transform domain. In: 2015 International conference on electrical engineering and information communication technology (ICEEICT), pp 1–6

    Google Scholar 

  42. Lotte F, Congedo M, Lécuyer A, Lamarche F, Arnaldi B (2007) A review of classification algorithms for EEG-based brain–computer interfaces. J Neural Eng 4:R1

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank the Research Management Center of Universiti Tun Hussein Onn Malaysia (UTHM) by funding this study under the Tier 1 research grant code H268 and U923. Appreciation also goes to the Faculty of Electrical Engineering, Centre of Diploma Studies, members of Artificial Intelligent Laboratory and Brainwave Research Group (BRG) for their support.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to M. N. A. H. Sha’abani .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sha’abani, M.N.A.H., Fuad, N., Jamal, N., Ismail, M.F. (2020). kNN and SVM Classification for EEG: A Review. In: Kasruddin Nasir, A.N., et al. InECCE2019. Lecture Notes in Electrical Engineering, vol 632. Springer, Singapore. https://doi.org/10.1007/978-981-15-2317-5_47

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-2317-5_47

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-2316-8

  • Online ISBN: 978-981-15-2317-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics