Skip to main content
Log in

Efficient space learning based on kernel trick and dimension reduction technique for multichannel motor imagery EEG signals classification

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

Electroencephalogram (EEG) signals show the electrical activity of the brain, which are one of the inputs of the brain–computer interface (BCI). The BCI provides the communication path between the brain and the computer. One of the critical applications of BCI is Motor imagery (MI). MI is a mental process that a person practices or simulates a particular movement without physically acting. BCI allows the person to communicate with their environment independently of peripheral muscles and nerves, using EEG brain signals by assistive devices such as wheelchairs, robotic arms, and computers. In this paper, a space learning concept is proposed for EEG motor imagery signal classification. Our innovation in the proposed method is to increase and then, reduce the data dimensions, which has led to learning the efficient space for signals classification. It is based on two techniques: Multi-Kernel Learning (MKL) and dimension reduction. The composite kernel is made of a combination of four kernels by The Heuristic MKL Algorithm. This algorithm uses heuristic rules to estimate the weight of kernels with high accuracy and very little computational complexity. The weight associated with each base kernel and its parameters is calculated by the Equilibrium Optimizer. Dimensions of data are reduced to avoid the curse of dimensions. In this step, the number of dimensions of reduced space and the mapping matrix are learned to reduce the dimensions of data linearly. We selected ELM, KNN, and SVM classifiers for classification. The BCI Competition dataset was used for evaluation, which consists of five subsets aa, al, ay, aw, av, and two classes of the right hand and right foot. The proposed method with the ELM was improved the average classification accuracy and standard deviation by 3.9% and 2.28, respectively, and achieved 91.4% accuracy. The lower standard deviation than other methods shows that our method is more robust than all other methods to subject variety. The proposed method is compared with twelve state-of-the-art methods and has shown higher accuracy than other methods such as the deep convolutional neural networks. The results show the superiority of the proposed method over other methods in the Wilcoxon signed test.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  1. Acı Çİ, Kaya M, Mishchenko Y (2019) Distinguishing mental attention states of humans via an EEG-based passive BCI using machine learning methods. Expert Syst Appl 134:153–166

    Article  Google Scholar 

  2. Kaur B, Singh D, Roy PP (2019) Age and gender classification using brain–computer interface. Neural Comput Appl 31(10):5887–5900

    Article  Google Scholar 

  3. Alazrai R, Alwanni H, Daoud MI (2019) EEG-based BCI system for decoding finger movements within the same hand. Neurosci Lett 698:113–120

    Article  Google Scholar 

  4. Wei CS, Wang YT, Lin CT, Jung TP (2018) Toward drowsiness detection using non-hair-bearing EEG-based brain-computer interfaces. IEEE Trans Neural Syst Rehabil Eng 26(2):400–406

    Article  Google Scholar 

  5. Nicolas-Alonso LF, Gomez-Gil J (2012) Brain computer interfaces, a review. Sensors 12(2):1211–1279

    Article  Google Scholar 

  6. Subha DP, Joseph PK, Acharya R, Lim CM (2010) EEG signal analysis: a survey. J Med Syst 34(2):195–212

    Article  Google Scholar 

  7. Khan KA, Shanir PP, Khan YU, Farooq O (2020) A hybrid local binary pattern and wavelets based approach for EEG classification for diagnosing epilepsy. Expert Syst Appl 140:112895

    Article  Google Scholar 

  8. Zhang Y, Zhang S, Ji X (2018) EEG-based classification of emotions using empirical mode decomposition and autoregressive model. Multimed Tools Appl 77(20):26697–26710

    Article  Google Scholar 

  9. Yang S, Bornot JMS, Wong-Lin K, Prasad G (2019) M/EEG-based bio-markers to predict the MCI and alzheimer’s disease: a review from the ML perspective. IEEE Trans Biomed Eng 66(10):2924–2935

    Article  Google Scholar 

  10. Saini, N., Bhardwaj, S., & Agarwal, R. (2019). Classification of EEG signals using hybrid combination of features for lie detection. Neural Computing and Applications, 1–11.

  11. Jeannerod M (1995) Mental imagery in the motor context. Neuropsychologia 33(11):1419–1432

    Article  Google Scholar 

  12. Pourali H, Omranpour H (2023) CSP-Ph-PS: Learning CSP-phase space and Poincare sections based on evolutionary algorithm for EEG signals recognition. Expert Syst Appl 211:118621

    Article  Google Scholar 

  13. Gupta GS, Tripathi PR, Kumar S, Ghosh S, Sinha RK (2022) Prototype design for bidirectional control of stepper motor using features of brain signals and soft computing tools. Biomed Signal Process Control 71:103245

    Article  Google Scholar 

  14. Tang X, Li W, Li X, Ma W, Dang X (2020) Motor imagery EEG recognition based on conditional optimization empirical mode decomposition and multi-scale convolutional neural network. Expert Syst Appl 149:113285

    Article  Google Scholar 

  15. Jana, G. C., Shukla, S., Srivastava, D., & Agrawal, A. (2020). Performance Estimation and Analysis Over the Supervised Learning Approaches for Motor Imagery EEG Signals Classification. In Intelligent Computing and Applications (pp. 125–141). Springer, Singapore.

  16. Jiang A, Shang J, Liu X, Tang Y, Kwan HK, Zhu Y (2020) Efficient CSP Algorithm With Spatio-Temporal Filtering for Motor Imagery Classification. IEEE Trans Neural Syst Rehabil Eng 28(4):1006–1016

    Article  Google Scholar 

  17. Park Y, Chung W (2019) Frequency-optimized local region common spatial pattern approach for motor imagery classification. IEEE Trans Neural Syst Rehabil Eng 27(7):1378–1388

    Article  Google Scholar 

  18. Park SH, Lee D, Lee SG (2017) Filter bank regularized common spatial pattern ensemble for small sample motor imagery classification. IEEE Trans Neural Syst Rehabil Eng 26(2):498–505

    Article  Google Scholar 

  19. Baig MZ, Aslam N, Shum HP, Zhang L (2017) Differential evolution algorithm as a tool for optimal feature subset selection in motor imagery EEG. Expert Syst Appl 90:184–195

    Article  Google Scholar 

  20. Wang, Y., Gao, S., & Gao, X. (2006, January). Common spatial pattern method for channel selelction in motor imagery based brain-computer interface. In 2005 IEEE engineering in medicine and biology 27th annual conference (pp. 5392–5395). IEEE.

  21. Niazmardi S, Demir B, Bruzzone L, Safari A, Homayouni S (2017) Multiple kernel learning for remote sensing image classification. IEEE Trans Geosci Remote Sens 56(3):1425–1443

    Article  Google Scholar 

  22. Gönen M, Alpaydın E (2011) Multiple kernel learning algorithms. The Journal of Machine Learning Research 12:2211–2268

    MathSciNet  Google Scholar 

  23. Abbasnejad ME, Ramachandram D, Mandava R (2012) A survey of the state of the art in learning the kernels. Knowl Inf Syst 31(2):193–221

    Article  Google Scholar 

  24. Faramarzi A, Heidarinejad M, Stephens B, Mirjalili S (2020) Equilibrium optimizer: A novel optimization algorithm. Knowl-Based Syst 191:105190

    Article  Google Scholar 

  25. Dhongade, D. V., & Rao, T. V. K. H. (2017, March). Classification of sleep disorders based on EEG signals by using feature extraction techniques with KNN classifier. In 2017 International Conference on Innovations in Green Energy and Healthcare Technologies (IGEHT) (pp. 1–5). IEEE.

  26. Birjandtalab J, Pouyan MB, Cogan D, Nourani M, Harvey J (2017) Automated seizure detection using limited-channel EEG and non-linear dimension reduction. Comput Biol Med 82:49–58

    Article  Google Scholar 

  27. Ozkan, Y., & Barkana, B. D. (2020, October). Multi-class Mental Task Classification Using Statistical Descriptors of EEG by KNN, SVM, Decision Trees, and Quadratic Discriminant Analysis Classifiers. In 2020 IEEE 5th Middle East and Africa Conference on Biomedical Engineering (MECBME) (pp. 1–6). IEEE.

  28. Chaovalitwongse WA, Fan YJ, Sachdeo RC (2007) On the time series $ k $-nearest neighbor classification of abnormal brain activity. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans 37(6):1005–1016

    Article  Google Scholar 

  29. Zhang Y, Wang Y, Zhou G, Jin J, Wang B, Wang X, Cichocki A (2018) Multi-kernel extreme learning machine for EEG classification in brain-computer interfaces. Expert Syst Appl 96:302–310

    Article  Google Scholar 

  30. Huang G, Huang GB, Song S, You K (2015) Trends in extreme learning machines: A review. Neural Netw 61:32–48

    Article  Google Scholar 

  31. Shi TW, Chang GM, Qiang JF, Ren L, Cui WH (2023) Brain computer interface system based on monocular vision and motor imagery for UAV indoor space target searching. Biomed Signal Process Control 79:104114

    Article  Google Scholar 

  32. Hong D, Man S, Martin JV (2016) A stochastic mechanism for signal propagation in the brain: Force of rapid random fluctuations in membrane potentials of individual neurons. J Theor Biol 389:225–236

    Article  MathSciNet  Google Scholar 

  33. Khanal, B., Pant, S., Pokharel, K., & Gaire, S. (2018, October). Mental State Prediction by Deployment of Trained SVM Model on EEG Brain Signal. In 2018 IEEE 3rd International Conference on Computing, Communication and Security (ICCCS) (pp. 82–85). IEEE.

  34. Tang X, Wang T, Du Y, Dai Y (2019) Motor imagery EEG recognition with KNN-based smooth auto-encoder. Artif Intell Med 101:101747

    Article  Google Scholar 

  35. Yu T, Xiao J, Wang F, Zhang R, Gu Z, Cichocki A, Li Y (2015) Enhanced motor imagery training using a hybrid BCI with feedback. IEEE Trans Biomed Eng 62(7):1706–1717

    Article  Google Scholar 

  36. Pfurtscheller G (2001) Functional brain imaging based on ERD/ERS. Vision Res 41(10–11):1257–1260

    Article  Google Scholar 

  37. Mackenroth, U. (2004). Rational Transfer Functions. In Robust Control Systems (pp. 17–40). Springer, Berlin, Heidelberg.

  38. An-na, W., Yue, Z., Yun-tao, H., & Yun-lu, L. I. (2010, January). A novel construction of SVM compound kernel function. In 2010 International Conference on Logistics Systems and Intelligent Management (ICLSIM) (Vol. 3, pp. 1462–1465). IEEE.

  39. Li X, Chen X, Yan Y, Wei W, Wang ZJ (2014) Classification of EEG signals using a multiple kernel learning support vector machine. Sensors 14(7):12784–12802

    Article  Google Scholar 

  40. Lotte F, Congedo M, Lécuyer A, Lamarche F, Arnaldi B (2007) A review of classification algorithms for EEG-based brain–computer interfaces. J Neural Eng 4(2):R1

    Article  Google Scholar 

  41. "http://www.bbci.de/competition/iii/datasetIVa.

  42. Blankertz B, Muller KR, Krusienski DJ, Schalk G, Wolpaw JR, Schlogl A, Birbaumer N (2006) The BCI competition III: Validating alternative approaches to actual BCI problems. IEEE Trans Neural Syst Rehabil Eng 14(2):153–159

    Article  Google Scholar 

  43. Jin J, Miao Y, Daly I, Zuo C, Hu D, Cichocki A (2019) Correlation-based channel selection and regularized feature optimization for MI-based BCI. Neural Netw 118:262–270

    Article  Google Scholar 

  44. Hang, W., Feng, W., Liang, S., Wang, Q., Liu, X., & Choi, K. S. (2020). Deep Stacked Support Matrix Machine Based Representation Learning for Motor Imagery EEG Classification. Computer Methods and Programs in Biomedicine, 105466.

  45. Yu Z, Ma T, Fang N, Wang H, Li Z, Fan H (2020) Local temporal common spatial patterns modulated with phase locking value. Biomed Signal Process Control 59:101882

    Article  Google Scholar 

  46. Guo Y, Zhang Y, Chen Z, Liu Y, Chen W (2020) EEG classification by filter band component regularized common spatial pattern for motor imagery. Biomed Signal Process Control 59:101917

    Article  Google Scholar 

  47. Jin J, Liu C, Daly I, Miao Y, Li S, Wang X, Cichocki A (2020) Bispectrum-based channel selection for motor imagery based brain-computer interfacing. IEEE Trans Neural Syst Rehabil Eng 28(10):2153–2163

    Article  Google Scholar 

  48. Shi B, Wang Q, Yin S, Yue Z, Huai Y, Wang J (2021) A binary harmony search algorithm as channel selection method for motor imagery-based BCI. Neurocomputing 443:12–25

    Article  Google Scholar 

  49. Miao, M., Hu, W., & Zhang, W. (2021). A spatial-frequency-temporal 3D convolutional neural network for motor imagery EEG signal classification. Signal, Image and Video Processing, 1–8.

  50. Miao Y, Jin J, Daly I, Zuo C, Wang X, Cichocki A, Jung TP (2021) Learning Common Time-Frequency-Spatial Patterns for Motor Imagery Classification. IEEE Trans Neural Syst Rehabil Eng 29:699–707

    Article  Google Scholar 

  51. Liang, S., Hang, W., Yin, M., Shen, H., Wang, Q., Qin, J., ... & Zhang, Y. (2022). Deep EEG feature learning via stacking common spatial pattern and support matrix machine. Biomedical Signal Processing and Control, 74, 103531.

  52. Tiwari, A., & Chaturvedi, A. (2022). Automatic EEG channel selection for multiclass brain-computer interface classification using multiobjective improved firefly algorithm. Multimedia Tools and Applications, 1–29.

  53. Tiwari, A., & Chaturvedi, A. (2022). Automatic Channel Selection using Multiobjective X-shaped Binary Butterfly algorithm for Motor Imagery Classification. Expert Systems with Applications, 117757.

  54. Derrac J, García S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology for comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1(1):3–18

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Contributions

YA contributed to programmer validation, visualization, investigation, and writing—original draft. HO contributed to supervision, project administration, conceptualization, methodology, and writing—reviewing and editing.

Corresponding author

Correspondence to Hesam Omranpour.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Data availability

The datasets generated during and/or analyzed during the current study are available from the corresponding author on reasonable request.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Amiri, Y., Omranpour, H. Efficient space learning based on kernel trick and dimension reduction technique for multichannel motor imagery EEG signals classification. Neural Comput & Applic 36, 1199–1214 (2024). https://doi.org/10.1007/s00521-023-09090-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-023-09090-y

Keywords

Navigation