Emotion recognition from EEG signals by using multivariate empirical mode decomposition
This paper explores the advanced properties of empirical mode decomposition (EMD) and its multivariate extension (MEMD) for emotion recognition. Since emotion recognition using EEG is a challenging study due to nonstationary behavior of the signals caused by complicated neuronal activity in the brain, sophisticated signal processing methods are required to extract the hidden patterns in the EEG. In addition, multichannel analysis is another issue to be considered when dealing with EEG signals. EMD is a recently proposed iterative method to analyze nonlinear and nonstationary time series. It decomposes a signal into a set of oscillations called intrinsic mode functions (IMFs) without requiring a set of basis functions. In this study, a MEMD-based feature extraction method is proposed to process multichannel EEG signals for emotion recognition. The multichannel IMFs extracted by MEMD are analyzed using various time and frequency domain techniques such as power ratio, power spectral density, entropy, Hjorth parameters and correlation as features of valance and arousal scales of the participants. The proposed method is applied to the DEAP emotional EEG data set, and the results are compared with similar previous studies for benchmarking.
KeywordsEmpirical mode decomposition Multivariate empirical mode decomposition Emotion recognition Electroencephalogram
This work was partially supported by The Research Fund of The University of Istanbul, Project numbers 45259 and 54959.
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
- 2.Bos DO (2006) EEG-based emotion recognition: the influence of visual and auditory stimuli. Available: http://hmi.ewi.utwente.nl/verslagen/capita-selecta/CS-Oude_Bos-Danny.pdf
- 7.Huang NE, Shen Z, Long SR, Wu MC, Shih HH, Zheng Q, Yen NC, Tung CC, Liu HH (1998) The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proc R Soc A Math Phys Eng Sci 454:903–995. doi: 10.1098/rspa.1998.0193 MathSciNetCrossRefMATHGoogle Scholar
- 13.Mert A, Niyazi K, Bilgili E, Akan A (2014) Breast cancer detection with reduced feature set. Comput Math Methods Med. Article ID 265138:11 pagesGoogle Scholar
- 15.Morris JD (1995) Observations: Sam: the self-assessment manikin; an efficient cross-cultural measurement of emotional response. J Advert Res 35(6):63–68Google Scholar
- 17.Rached TS, Perkusich A (2013) Emotion recognition based on brain–computer interface systems. In: Fazel-Rezai R (ed) Brain–computer interface systems—recent progress and future prospects. InTech, RijekaGoogle Scholar
- 27.Wu CH, Chang HC, Lee PL, Li KS, Sie JJ, Sun CW, Yang CY, Li PH, Deng HT, Shyu KK (2011) Frequency recognition in an SSVEP-based brain computer interface using empirical mode decomposition and refined generalized zero-crossing. J Neurosci Methods 196:170–181. doi: 10.1016/j.jneumeth.2010.12.014 CrossRefGoogle Scholar