Investigating Gender Differences of Brain Areas in Emotion Recognition Using LSTM Neural Network
In this paper, we investigate key brain areas of men and women using electroencephalography (EEG) data on recognising three emotions, namely happy, sad and neutral. Considering that emotion changes over time, Long Short-Term Memory (LSTM) neural network is adopted with its capacity of capturing time dependency. Our experimental results indicate that the neural patterns of different emotions have specific key brain areas for males and females, with females showing right lateralization and males being more left lateralized. Accordingly, two non-overlapping brain regions are selected for two genders. The classification accuracy for females (79.14%) using the right lateralized region is significantly higher than that for males (67.61%), and the left lateralized area educes a significantly higher classification accuracy for males (82.54%) than females (73.51%), especially for happy and sad emotions.
KeywordsElectroencephalography Emotion Long Short-Term Memory neural network Gender differences Brain areas
This work was supported in part by grants from the National Key Research and Development Program of China (Grant No. 2017YFB1002501), the National Natural Science Foundation of China (Grant No. 61673266), the Major Basic Research Program of Shanghai Science and Technology Committee (Grant No. 15JC1400103), ZBYY-MOE Joint Funding (Grant No. 6141A02022604), and the Technology Research and Development Program of China Railway Corporation (Grant No. 2016Z003-B).
- 2.Duan, R.N., Zhu, J.Y., Lu, B.L.: Differential entropy feature for EEG-based emotion classification. In: 6th International IEEE/EMBS Conference on Neural Engineering, vol. 8588, pp. 81–84 (2013)Google Scholar
- 4.Lu, Y., Zheng, W.L., Li, B., Lu, B.L.: Combining eye movements and EEG to enhance emotion recognition. In: International Conference on Artificial Intelligence, pp. 1170–1176 (2015)Google Scholar
- 8.Shi, L.C., Lu, B.L.: Off-line and on-line vigilance estimation based on linear dynamical system and manifold learning. In: Engineering in Medicine and Biology Society, pp. 6587–6590. IEEE (2010)Google Scholar
- 11.Weiss, E., Siedentopf, C.M., Hofer, A., Deisenhammer, E.A., Hoptman, M.J., Kremser, C., Golaszewski, S., Felber, S., Fleischhacker, W.W., Delazer, M.: Sex differences in brain activation pattern during a visuospatial cognitive task: a functional magnetic resonance imaging study in healthy volunteers. Neurosci. Lett. 344(3), 169–172 (2003)CrossRefGoogle Scholar