Investigating Gender Differences of Brain Areas in Emotion Recognition Using LSTM Neural Network

  • Xue Yan
  • Wei-Long Zheng
  • Wei Liu
  • Bao-Liang Lu
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10637)


In this paper, we investigate key brain areas of men and women using electroencephalography (EEG) data on recognising three emotions, namely happy, sad and neutral. Considering that emotion changes over time, Long Short-Term Memory (LSTM) neural network is adopted with its capacity of capturing time dependency. Our experimental results indicate that the neural patterns of different emotions have specific key brain areas for males and females, with females showing right lateralization and males being more left lateralized. Accordingly, two non-overlapping brain regions are selected for two genders. The classification accuracy for females (79.14%) using the right lateralized region is significantly higher than that for males (67.61%), and the left lateralized area educes a significantly higher classification accuracy for males (82.54%) than females (73.51%), especially for happy and sad emotions.


Electroencephalography Emotion Long Short-Term Memory neural network Gender differences Brain areas 



This work was supported in part by grants from the National Key Research and Development Program of China (Grant No. 2017YFB1002501), the National Natural Science Foundation of China (Grant No. 61673266), the Major Basic Research Program of Shanghai Science and Technology Committee (Grant No. 15JC1400103), ZBYY-MOE Joint Funding (Grant No. 6141A02022604), and the Technology Research and Development Program of China Railway Corporation (Grant No. 2016Z003-B).


  1. 1.
    Clements, A.M., Rimrodt, S.L., Abel, J.R., Blankner, J.G., Mostofsky, S.H., Pekar, J.J., Denckla, M.B., Cutting, L.E.: Sex differences in cerebral laterality of language and visuospatial processing. Brain Lang. 98(2), 150–158 (2006)CrossRefGoogle Scholar
  2. 2.
    Duan, R.N., Zhu, J.Y., Lu, B.L.: Differential entropy feature for EEG-based emotion classification. In: 6th International IEEE/EMBS Conference on Neural Engineering, vol. 8588, pp. 81–84 (2013)Google Scholar
  3. 3.
    Hochreiter, S., Schmidhuber, J.: Long short-term memory. Neural Comput. 9(8), 1735–1780 (1997)CrossRefGoogle Scholar
  4. 4.
    Lu, Y., Zheng, W.L., Li, B., Lu, B.L.: Combining eye movements and EEG to enhance emotion recognition. In: International Conference on Artificial Intelligence, pp. 1170–1176 (2015)Google Scholar
  5. 5.
    Nolen-Hoeksema, S., Aldao, A.: Gender and age differences in emotion regulation strategies and their relationship to depressive symptoms. Pers. Individ. Differ. 51(6), 704–708 (2011)CrossRefGoogle Scholar
  6. 6.
    Peng, H., Long, F., Ding, C.: Feature selection based on mutual information: criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27(8), 1226–1238 (2005)CrossRefGoogle Scholar
  7. 7.
    Rowland, N., Meile, M., Nicolaidis, S., et al.: EEG alpha activity reflects attentional demands, and beta activity reflects emotional and cognitive processes. Science 228(4700), 750–752 (1985)CrossRefGoogle Scholar
  8. 8.
    Shi, L.C., Lu, B.L.: Off-line and on-line vigilance estimation based on linear dynamical system and manifold learning. In: Engineering in Medicine and Biology Society, pp. 6587–6590. IEEE (2010)Google Scholar
  9. 9.
    Wager, T.D., Phan, K.L., Liberzon, I., Taylor, S.F.: Valence, gender, and lateralization of functional brain anatomy in emotion: a meta-analysis of findings from neuroimaging. Neuroimage 19(3), 513–531 (2003)CrossRefGoogle Scholar
  10. 10.
    Wang, X.W., Nie, D., Lu, B.L.: Emotional state classification from EEG data using machine learning approach. Neurocomputing 129(4), 94–106 (2014)CrossRefGoogle Scholar
  11. 11.
    Weiss, E., Siedentopf, C.M., Hofer, A., Deisenhammer, E.A., Hoptman, M.J., Kremser, C., Golaszewski, S., Felber, S., Fleischhacker, W.W., Delazer, M.: Sex differences in brain activation pattern during a visuospatial cognitive task: a functional magnetic resonance imaging study in healthy volunteers. Neurosci. Lett. 344(3), 169–172 (2003)CrossRefGoogle Scholar
  12. 12.
    Welsh, T.N., Elliott, D.: Gender differences in a dichotic listening and movement task: lateralization or strategy? Neuropsychologia 39(1), 25–35 (2001)CrossRefGoogle Scholar
  13. 13.
    Zhu, J.-Y., Zheng, W.-L., Lu, B.-L.: Cross-subject and cross-gender emotion classification from EEG. In: Jaffray, D.A. (ed.) World Congress on Medical Physics and Biomedical Engineering. IP, vol. 51, pp. 1188–1191. Springer, Cham (2015). doi: 10.1007/978-3-319-19387-8_288 Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Xue Yan
    • 1
  • Wei-Long Zheng
    • 1
  • Wei Liu
    • 1
  • Bao-Liang Lu
    • 1
    • 2
    • 3
  1. 1.Department of Computer Science and Engineering, Center for Brain-like Computing and Machine IntelligenceShanghai Jiao Tong UniversityShanghaiChina
  2. 2.Key Laboratory of Shanghai Education Commission for Intelligent Interaction and Cognitive EngineeringShanghai Jiao Tong UniversityShanghaiChina
  3. 3.Brain Science and Technology Research CenterShanghai Jiao Tong UniversityShanghaiChina

Personalised recommendations