Advertisement

InECCE2019 pp 555-565 | Cite as

kNN and SVM Classification for EEG: A Review

  • M. N. A. H. Sha’abaniEmail author
  • N. Fuad
  • Norezmi Jamal
  • M. F. Ismail
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 632)

Abstract

This paper review the classification method of EEG signal based on k-nearest neighbor (kNN) and support vector machine (SVM) algorithm. For instance, a classifier learns an input features from a dataset using specific approach and tuning parameters, develop a classification model, and use the model to predict the corresponding class of new input in an unseen dataset. EEG signals contaminated with various noises and artefacts, non-stationary and poor in signal-to-noise ratio (SNR). Moreover, most EEG applications involve high dimensional feature vector. kNN and SVM were used in EEG classification and has been proven successfully in discriminating features in EEG dataset. However, different results were observed between different EEG applications. Hence, this paper reviews the used of kNN and SVM classifier on various EEG applications, identifying their advantages and disadvantages, and also their overall performances.

Keywords

Electroencephalogram (EEG) Classification kNN SVM 

Notes

Acknowledgements

The authors would like to thank the Research Management Center of Universiti Tun Hussein Onn Malaysia (UTHM) by funding this study under the Tier 1 research grant code H268 and U923. Appreciation also goes to the Faculty of Electrical Engineering, Centre of Diploma Studies, members of Artificial Intelligent Laboratory and Brainwave Research Group (BRG) for their support.

References

  1. 1.
    Haas L (2003) Hans Berger (1873–1941), Richard Caton (1842–1926), and electroencephalography. J Neurol Neurosurg Psychiatry 74:9CrossRefGoogle Scholar
  2. 2.
    Sanei S, Chambers JA (2013) EEG signal processing. WileyGoogle Scholar
  3. 3.
    Vaid S, Singh P, Kaur C (2015) EEG signal analysis for BCI interface: a review. In: 2015 fifth international conference on advanced computing & communication technologies, pp 143–147Google Scholar
  4. 4.
    iMotion, Top 6 most common applications for human EEG research, 2015Google Scholar
  5. 5.
    He L, Hu D, Wan M, Wen Y, Deneen KMV, Zhou M (2016) Common Bayesian network for classification of EEG-based multiclass motor imagery BCI. IEEE Transa Syst Man Cybern Syst 46:843–854Google Scholar
  6. 6.
    An X, Kuang D, Guo X, Zhao Y, He L (2014) A deep learning method for classification of EEG data based on motor imagery. Cham, pp 203–210Google Scholar
  7. 7.
    Rezaee K, Azizi E, Haddadnia J (2016) Optimized seizure detection algorithm: a fast approach for onset of epileptic in EEG signals using GT discriminant analysis and K-NN classifier. J Biomed Phys Eng 6:81–94 Google Scholar
  8. 8.
    Al-Qazzaz NK, Ali SHBM, Ahmad SA, Islam MS, Escudero J (2018) Discrimination of stroke-related mild cognitive impairment and vascular dementia using EEG signal analysis. Med Biol Eng Comput 56:137–157CrossRefGoogle Scholar
  9. 9.
    Fuad N, Taib M, Jailani R, Marwan M (2014) Brainwave classification for brain balancing index (BBI) via 3D EEG model using k-NN technique. Int J Comput Electr Autom Control Inf Eng 8Google Scholar
  10. 10.
    Al-Shargie F, Tang TB, Badruddin N, Kiguchi M (2015) Mental stress quantification using EEG signals. In: International conference for innovation in biomedical engineering and life sciences, pp 15–19Google Scholar
  11. 11.
    Murugappan M, Ramachandran N, Sazali Y (2010) Classification of human emotion from EEG using discrete wavelet transform. J Biomed Sci Eng 3:390CrossRefGoogle Scholar
  12. 12.
    Kraljević L, Russo M, Sikora M (2017) Emotion classification using linear predictive features on wavelet-decomposed EEG data. In: 2017 26th IEEE international symposium on robot and human interactive communication (RO-MAN), pp 653–657Google Scholar
  13. 13.
    Murugappan M, Murugappan S, Gerard C (2014) Wireless EEG signals based neuromarketing system using Fast Fourier Transform (FFT). In: 2014 IEEE 10th international colloquium on signal processing and its applications, pp 25–30Google Scholar
  14. 14.
    Wei Z, Wu C, Wang X, Supratak A, Wang P, Guo Y (2018) Using support vector machine on EEG for advertisement impact assessment. Front Neurosci 12Google Scholar
  15. 15.
    Teplan M (2002) Fundamentals of EEG measurement. Measur Sci Rev 2:1–11Google Scholar
  16. 16.
    Lotte F, Bougrain L, Cichocki A, Clerc M, Congedo M, Rakotomamonjy A et al (2018) A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update. J Neural Eng 15:031005CrossRefGoogle Scholar
  17. 17.
    Zheng WL, Zhu JY, Peng Y, Lu BL (2014) EEG-based emotion classification using deep belief networks. In: Proceedings—IEEE international conference on multimedia and expoGoogle Scholar
  18. 18.
    An X, Kuang D, Guo X, Zhao Y, He L (2014) A deep learning method for classification of eeg data based on motor imagery. In Lecture notes in computer science (including subseries Lecture notes in artificial intelligence and lecture notes in bioinformatics), vol 8590 LNBI, pp 203–210Google Scholar
  19. 19.
    Subha DP, Joseph PK, Acharya R, Lim CM (2010) EEG signal analysis: a survey. J Med Syst 34:195–212CrossRefGoogle Scholar
  20. 20.
    Sokolova M, Lapalme G (2009) A systematic analysis of performance measures for classification tasks. Inf Process Manage 45:427–437CrossRefGoogle Scholar
  21. 21.
    Cover TM, Hart PE (1967) Nearest neighbor pattern classification. IEEE Trans Inf Theory 13:21–27CrossRefGoogle Scholar
  22. 22.
    Cunningham P, Delany SJ (2007) k-Nearest neighbour classifiersGoogle Scholar
  23. 23.
    Hassanat AB, Abbadi MA, Altarawneh GA, Alhasanat AA (2014) Solving the problem of the K parameter in the KNN classifier using an ensemble learning approach. arXiv preprint arXiv:1409.0919Google Scholar
  24. 24.
    Yazdani A, Ebrahimi T, Hoffmann U (2009) Classification of EEG signals using Dempster Shafer theory and a k-nearest neighbor classifier. In: 2009 4th international IEEE/EMBS conference on neural engineering, pp 327–330Google Scholar
  25. 25.
    Bhattacharyya S, Khasnobish A, Chatterjee S, Konar A, Tibarewala D (2010) Performance analysis of LDA, QDA and KNN algorithms in left-right limb movement classification from EEG data. In: 2010 International conference on systems in medicine and biology, pp 126–131Google Scholar
  26. 26.
    Ahangi A, Karamnejad M, Mohammadi N, Ebrahimpour R, Bagheri N (2013) Multiple classifier system for EEG signal classification with application to brain–computer interfaces. Neural Comput Appl 23:1319–1327CrossRefGoogle Scholar
  27. 27.
    Mousa FA, El-Khoribi RA, Shoman ME (2015) EEG Classification based on machine learning techniques. Int J Comput Appl 975:8887Google Scholar
  28. 28.
    Aditya S, Tibarewala D (2012) Comparing ANN, LDA, QDA, KNN and SVM algorithms in classifying relaxed and stressful mental state from two-channel prefrontal EEG data. Int J Artif Intell Soft Comput 3:143–164CrossRefGoogle Scholar
  29. 29.
    Hosseinifard B, Moradi MH, Rostami R (2013) Classifying depression patients and normal subjects using machine learning techniques and nonlinear features from EEG signal. Comput Methods Programs Biomed 109:339–345CrossRefGoogle Scholar
  30. 30.
    Soroush MZ, Maghooli K, Setarehdan SK, Nasrabadi AM (2019) Emotion classification through nonlinear EEG analysis using machine learning methods. Int Clin Neurosci J 5:135–149CrossRefGoogle Scholar
  31. 31.
    Mehmood RM, Lee HJ (2015) Emotion classification of EEG brain signal using SVM and KNN. In: 2015 IEEE international conference on multimedia & expo workshops (ICMEW), pp 1–5Google Scholar
  32. 32.
    Guo L, Rivero D, Dorado J, Munteanu CR, Pazos A (2011) Automatic feature extraction using genetic programming: an application to epileptic EEG classification. Expert Syst Appl 38:10425–10436CrossRefGoogle Scholar
  33. 33.
    Zainuddin A, Lee KY, Mansor W, Mahmoodin Z (2016) Optimized KNN classify rule for EEG based differentiation between capable dyslexic and normal children. In: 2016 IEEE EMBS conference on biomedical engineering and sciences (IECBES), pp 685–688Google Scholar
  34. 34.
    Alonso LFN, Gil JG (2012) Brain computer interfaces, a review. Sensors 12:1211CrossRefGoogle Scholar
  35. 35.
    Duan K, Keerthi SS, Poo AN (2003) Evaluation of simple performance measures for tuning SVM hyperparameters. Neurocomputing 51:41–59CrossRefGoogle Scholar
  36. 36.
    Hsu C-W, Chang C-C, Lin C-J (2003) A practical guide to support vector classificationGoogle Scholar
  37. 37.
    Li X, Chen X, Yan Y, Wei W, Wang Z (2014) Classification of EEG signals using a multiple kernel learning support vector machine. Sensors 14:12784–12802CrossRefGoogle Scholar
  38. 38.
    Nguyen T, Khosravi A, Creighton D, Nahavandi S (2015) EEG signal classification for BCI applications by wavelets and interval type-2 fuzzy logic systems. Expert Syst Appl 42:4370–4380CrossRefGoogle Scholar
  39. 39.
    Li M, Chen W, Zhang T (2017) Automatic epileptic EEG detection using DT-CWT-based non-linear features. Biomed Signal Process Control 34:114–125CrossRefGoogle Scholar
  40. 40.
    Acharya UR, Molinari F, Sree SV, Chattopadhyay S, Ng K-N, Suri JS (2012) Automated diagnosis of epileptic EEG using entropies. Biomed Signal Process Control 7:401–408Google Scholar
  41. 41.
    Bashar SK, Das AB, Bhuiyan MIH (2015) Motor imagery movements detection of EEG signals using statistical features in the Dual Tree Complex Wavelet Transform domain. In: 2015 International conference on electrical engineering and information communication technology (ICEEICT), pp 1–6Google Scholar
  42. 42.
    Lotte F, Congedo M, Lécuyer A, Lamarche F, Arnaldi B (2007) A review of classification algorithms for EEG-based brain–computer interfaces. J Neural Eng 4:R1CrossRefGoogle Scholar

Copyright information

© Springer Nature Singapore Pte Ltd. 2020

Authors and Affiliations

  • M. N. A. H. Sha’abani
    • 1
    Email author
  • N. Fuad
    • 2
    • 3
  • Norezmi Jamal
    • 2
  • M. F. Ismail
    • 1
  1. 1.Centre for Diploma StudiesUniversiti Tun Hussein Onn MalaysiaParit RajaMalaysia
  2. 2.Faculty of Electrical and Electronic EngineeringUniversiti Tun Hussein Onn MalaysiaParit RajaMalaysia
  3. 3.Computational, Signal, Imaging and Intelligent Focus Group (CSII)Universiti Tun Hussein Onn MalaysiaParit RajaMalaysia

Personalised recommendations