Skip to main content
Log in

Performance enhancement of mental task classification using EEG signal: a study of multivariate feature selection methods

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

Abstract

In the recent years, the research community has shown interest in the development of brain–computer interface applications which assist physically challenged people to communicate with their brain electroencephalogram (EEG) signal. Representation of these EEG signals for mental task classification in terms of relevant features is important to achieve higher performance in terms of accuracy and computation time. For feature extraction from the EEG, empirical mode decomposition and wavelet transform are more appropriate as they are suitable for the analysis of non-linear and non-stationary time series signals. However, the size of the feature vector obtained from them is huge and may hinder the performance of mental task classification. To obtain a minimal set of relevant and non-redundant features for classification, six popular multivariate filter methods have been investigated which are based on different criteria: distance measure, causal effect and mutual information. Experimental results demonstrate that the classification accuracy improves while the computation time reduces considerably with the use of each of the six multivariate feature selection methods. Among all the combinations of feature extraction and selection methods that are investigated, the combination of wavelet transform and linear regression performs the best. Ranking analysis and statistical tests are also performed to validate the empirical results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. http://www.cs.colostate.edu/eeg/main/data/1989_Keirn_and_Aunon.

  2. http://perso.enslyon.fr/patrick.flandrin/emd.html.

References

  • Adhikari R, Agrawal RK (2012) Performance evaluation of weights selection schemes for linear combination of multiple forecasts. Artif Intell Rev. doi:10.1007/s10462-012-9361-z

  • Anderson CW, Stolz EA, Shamsunder S (1998) Multivariate autoregressive models for classification of spontaneous electroencephalographic signals during mental tasks. IEEE Trans Biomed Eng 45(3):277–286

    Article  Google Scholar 

  • Babiloni F, Cincotti F, Lazzarini L, Millan J, Mourino J, Varsta M, Heikkonen J, Bianchi L, Marciani MG (2000) Linear classification of low-resolution EEG patterns produced by imagined hand movements. IEEE Trans Rehab Eng 8(2):184–186

    Article  Google Scholar 

  • Bashashati A, Faourechi M, Ward RK, Brich GE (2007) A survey of signal processing algorithms in brain computer interface based on electrical brain signals. J Neural Eng 4:R32–R57

    Article  Google Scholar 

  • Basseville M, Benveniste A (1983) Sequential segmentation of non-stationary digital signals using spectral analysis. Inf Sci 29(1):57–73

    Article  MATH  Google Scholar 

  • Bellman RE (1961) Adaptive control processes: a guided tour. Princeton University Press, Princeton

  • Bhattacharyya A (1943) On a measure of divergence between two statistical populations defined by their probability distributions. Bull Calcutta Math Soc 35:99–110

    MATH  MathSciNet  Google Scholar 

  • Bhattacharyya S, Sengupta A, Chakraborti T, Konar A, Tibarewala D (2014) Automatic feature selection of motor imagery EEG signals using differential evolution and learning automata. Med Biol Eng Comput 52(2):131–139

    Article  Google Scholar 

  • Bostanov V (2004) BCI competition 2003-data sets Ib and IIb: feature extraction from event-related brain potentials with the continuous wavelet transform and the t-value scalogram. IEEE Trans Biomed Eng 51(6):1057–1061

  • Cabrera A, Farina D, Dremstrup K (2010) Comparison of feature selection and classification methods for a brain-computer interface driven by non-motor imagery. Med Biol Eng Comput 0140–0118(48):123–132

    Article  Google Scholar 

  • Corralejo R, Hornero R, Alvarez D (2011) Feature selection using a genetic algorithm in a motor imagery-based brain computer interface. In: Annual international conference of the IEEE engineering in medicine and biology society (EMBC), pp 7703–7706

  • Cvetkovic D, Übeyli ED, Cosic I (2008) Wavelet transform feature extraction from human PPG, ECG, and EEG signal responses to ELF PEMF exposures: A pilot study. Digit Signal Process 18(5):861–874

  • Daubcheies I (1990) The wavelet transform. Time–frequency localizition and signal analysis. IEEE Trans Inf Theory 3(5):961–1005

    Article  Google Scholar 

  • Demsar J (2006) Statistical comparisons of classifiers over multiple data sets. J Mach Learn Res 7:1–30

    MATH  MathSciNet  Google Scholar 

  • Derrac J, Garcia S, Molina D, Herrera F (2011) A practical tutorial on the use of nonparametric statistical tests as a methodology or comparing evolutionary and swarm intelligence algorithms. Swarm Evol Comput 1:3–18

  • Devijver PA, Kittler J (1982) Pattern recognition: a statistical approach. PHI

  • Dias N, Kamrunnahar M, Mendes P, Schiff S, Correia J (2010) Feature selection on movement imagery discrimination and attention detection. Med Biol Eng Comput 48:331–341

    Article  Google Scholar 

  • Diez PF, Mut V, Lacier E (2009) Application of the empirical mode decomposition to the extraction of features from EEG signals for mental task classification. In: 31st Annual International Conference of the IEEE EMBS Minneapolis, pp 2579–2582

  • Freeman WJ (1999) Comparison of brain models for active vs. passive perception. Inf Sci 116:97–107

    Article  Google Scholar 

  • Friedman M (1937) The use of ranks to avoid the assumption of normality implicit in the analysis of variance. J Am Stat Assoc 32(1937):674–701

    Google Scholar 

  • Garrett D, Peterson D, Anderson C, Thaut M (2003) Comparison of linear, nonlinear, and feature selection methods for EEG signal classification. IEEE Trans Neural Syst Rehab Eng 11(2):141–144

  • Graimann B, Huggins JE, Schlogl A, Levine SP, Pfurtscheller G (2003) Detection of movement-related desynchronization patterns in on-going single-channel electrocardiogram. IEEE Trans Neural Syst Rehab Eng 11(3):276–281

    Article  Google Scholar 

  • Groissboeck W, Lughofer E, Klement EP (2004) A comparison of variable selection methods with the main focus on orthogonalization. Adv Soft Comput 479–486

  • Gupta A, Agrawal RK (2012) Relevant feature selection from EEG signal for mental task classification. In: Pacific-Asia conference on knowledge discovery and data mining (PAKDD), in part II. Lecture Notes in Computer Science, vol 7302, pp 431–442

  • Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Res 3:1157–1182

    MATH  Google Scholar 

  • Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning: data mining, inference and prediction, 2nd edn. Springer, New York

    Book  Google Scholar 

  • Haury AC, Gestraud P, Vert JP (2011) The influence of feature selection methods on accuracy, stability and interpretability of molecular signatures. PLoS One 6(12). doi:10.1371/journal.pone.0028210

  • Hazarika N, Chen JZ, Tsoi AC, Sergejew A (1997) Classification of EEG signals using the wavelet transform. Signal Process 59(1):61–72

    Article  MATH  Google Scholar 

  • Hsu WY, Sun YN (2009) EEG-based motor imagery analysis using weighted wavelet transform features. J Neurosci Methods 176(2):310–318

    Article  Google Scholar 

  • Huang NE, Shen Z, Long SR, Wu ML, Shih HH, Zheng Q, Yen NC, Tung CC, Liu HH (1998) The empirical mode decomposition and Hilbert spectrum for nonlinear and non-stationarytime series analysis. Proc R Soc Lond A 454:903–995

    Article  MATH  MathSciNet  Google Scholar 

  • Iman R, Davenport J (1980) Approximations of the critical region of the Friedman statistic. Commun Stat 9(1980):571–595

    Article  Google Scholar 

  • Kaleem MF, Sugavaneswaran L, Guergachi A, Krishnan S (2010) Application of empirical mode decomposition and teager energy operator to EEG signals for mental task classification. In: Annual international conference of the engineering in medicine and biology society (EMBC). IEEE Press, New York, pp 4590–4593

  • Kauhanen L, Nykopp T, Lehtonen J, Jylanki P, Heikkonen J, Rantanen P, Alaranta H, Sams M (2006) EEG and MEG brain-computer interface for tetraplegic patients. IEEE Trans Neural Syst Rehab Eng 14(2):190–193

    Article  Google Scholar 

  • Keirn ZA, Aunon JI (1990) A new mode of communication between man and his surroundings. IEEE Trans Biomed Eng 37(12):1209–1214

    Article  Google Scholar 

  • Kohavi R, John G (1997) Wrapper for feature subset selection. Artif Intell 97(1–2):273–324

    Article  MATH  Google Scholar 

  • Koprinska I (2009) Feature selection for brain-computer interfaces. In: International workshop on new frontiers in applied data mining (PAKDD), LNCS, vol 5669, pp 106–117

  • Kronegg J, Chanel G, Voloshynovskiy S, Pun T (2007) EEG-based synchronized brain-computer interfaces: a model for optimizing the number of mental tasks. IEEE Trans Neural Syst Rehab Eng 15(1):50–58

    Article  Google Scholar 

  • Kullback S, Liebler RA (1951) On information and sufficiency. Ann Math Stat 22:79–86

    Article  MATH  Google Scholar 

  • Lakany H, Conway BA (2007) Understanding intention of movement from electroencephalograms. Expert Syst 24:295–304

    Article  Google Scholar 

  • Lempel A, Ziv J (1976) On the complexity of finite sequences. IEEE Trans Inf Theory 22:75–81

  • Li Y (2004) On incremental and robust subspace learning. Pattern Recognit 37(7):1509–1518

  • Lughofer E (2011) On-line incremental feature weighting in evolving fuzzy classifiers. Fuzzy Sets Syst 163(1):1–23

    Article  MATH  MathSciNet  Google Scholar 

  • Mallat GS (1989) A theory for multi-resolution signal decomposition the wavelet representation. IEEE Trans Pattern Anal Mach Intell 11(7):674–693

  • Mosquera C, Verleysen M, Navia Vazquez A (2010) EEG feature selection using mutual information and support vector machine: a comparative analysis. In: 32nd annual international IEEE EMBC conference, pp 4946–4949

  • Murugappan M, Ramachandran N, Sazali Y (2010) Classification of human emotion from EEG using discrete wavelet transform. J Biomed Sci Eng 3(4):390–396

  • Ocak H (2009) Automatic detection of epileptic seizures in EEG using discrete wavelet transform and approximate entropy. Expert Syst Appl 36(2):2027–2036

    Article  Google Scholar 

  • Park HS, Yoo SHY, Cho SB (2007) Forward selection method with regression analysis for optimal gene selection in cancer classification. Int J Comput Math 84(5):653–668

  • Peng H, Loung F, Ding C (2005) Feature selection based on mutual information criteria of max-dependency. Max-relevance and min-redundancy. IEEE Trans Pattern Anal Mach Intell 27(8):1226–1238

    Article  Google Scholar 

  • Penny WD, Roberts SJ, Curran EA, Stokes MJ (2000) Eeg-based communication: a pattern recognition approach. IEEE Trans Rehab Eng 8(2):214–215

    Article  Google Scholar 

  • Pfurtscheller G, Neuper C, Schlogl A, Lugger K (1998) Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. IEEE Trans Rehab Eng 6(3):316–325

  • Rejer I, Lorenz K (2013) Genetic algorithm and forward method for feature selection in EEG feature space. J Theor Appl Comput Sci 7(2):72–82

    Google Scholar 

  • Rodríguez-Bermúdez G, García-Laencina PJ, Roca-Dorda J (2013) Efficient automatic selection and combination of EEG features in least squares classifiers for motor imagery brain-computer interfaces. Int J Neural Syst 23(4). doi:10.1142/S0129065713500159

  • Sakar OC, Kursun O, Gurgen F (2012) A feature selection method based on kernel canonical correlation analysis and the minimum redundancy-maximum relevance filter method. Expert Syst Appl 39:3432–3437

    Article  Google Scholar 

  • Shannon CE (1948) A mathematical theory of communication. AT T Tech J 27(379–423):623–656

    MathSciNet  Google Scholar 

  • Wilcoxon F (1945) Individual comparisons by ranking methods. Biometrics 1:80–83

    Article  Google Scholar 

  • Wolpaw RJ, Birbaumer N, McFarland JD, Pfurtscheller G, Vaughaun MT (2002) Brain-computer interfaces for communication and control. Clin Neurophysiol 767–791

Download references

Acknowledgments

The first author expresses his gratitude to the Council of Scientific and Industrial Research (CSIR), India, for the obtained financial support in performing this research work. We also thank the reviewers for the constructive and valuable review of our paper that has helped us to further strengthen the overall quality of the paper.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Akshansh Gupta.

Additional information

Communicated by V. Loia.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gupta, A., Agrawal, R.K. & Kaur, B. Performance enhancement of mental task classification using EEG signal: a study of multivariate feature selection methods. Soft Comput 19, 2799–2812 (2015). https://doi.org/10.1007/s00500-014-1443-1

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-014-1443-1

Keywords

Navigation