Skip to main content
SpringerLink
Log in

A survey on EEG-based neurophysiological research for emotion recognition

  • Survey Paper
  • Published:
CCF Transactions on Pervasive Computing and Interaction Aims and scope Submit manuscript

Abstract

Emotions play a significant part in a person's social connections, decision-making, and perception of the world. Elicited emotions cause a change in a person's physiological and psychological states. As Electroencephalography (EEG) facilitates a close study of brain activity, it is becoming a standard method among the research community for reliable recognition of human emotions. This work demonstrates various advancements in emotion recognition utilizing EEG signals and points out major changing trends by making a comparison of previously available research in this field. In addition to the survey a detailed explanation of the procedure for refining EEG for emotion recognition has been explained in this work. This aims to help researchers, especially beginners, have a thorough understanding of the developmental research in this field.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

Data availability

Data Sharing not applicable as research data has been clearly mentioned in the text of the manuscript.

References

  • Akter, S., Prodhan, R.A., Pias, T.S., Eisenberg, D., Fresneda Fernandez, J.: M1M2: deep-learning-based real-time emotion recognition from neural activity. Sensors 22(21), 8467 (2022)

    Article  Google Scholar 

  • Alarcao, S.M., Fonseca, M.J.: Emotions recognition using EEG signals: a survey. IEEE Trans. Affect. Comput. 10(3), 374–393 (2017)

    Article  Google Scholar 

  • Alazrai, R., Homoud, R., Alwanni, H., Daoud, M.I.: EEG-based emotion recognition using quadratic time-frequency distribution. Sensors 18(8), 2739 (2018)

    Article  Google Scholar 

  • Al-Nafjan, A., Hosny, M., Al-Ohali, Y., Al-Wabil, A.: Review and classification of emotion recognition based on EEG brain-computer interface system research: a systematic review. Appl. Sci. 7(12), 1239 (2017)

    Article  Google Scholar 

  • Badajena, J. C., Sethi, S., Dash, A., Rout, P., Sahoo, R. K. Smart wheelchair using brain waves through machine learning. In: Intelligent systems: proceedings of ICMIB 2021, pp. 445–457. Singapore: Springer Nature Singapore (2022)

  • Badajena, J. C., Sethi, S., & Sahoo, R. K.: Comparative analysis of full training set and cross-validation for machine learning approach to run smart wheelchair. In: Intelligent Systems and Applications: Select Proceedings of ICISA 2022, pp. 121–132. Springer Nature Singapore (2023)

  • Becker, H., Fleureau, J., Guillotel, P., Wendling, F., Merlet, I., Albera, L.: Emotion recognition based on high-resolution EEG recordings and reconstructed brain sources. IEEE Trans. Affect. Comput. 11(2), 244–257 (2017)

    Article  Google Scholar 

  • Bekkedal, M.Y., Rossi, J., III., Panksepp, J.: Human brain EEG indices of emotions: delineating responses to affective vocalizations by measuring frontal theta event-related synchronization. Neurosci. Biobehav. Rev. 35(9), 1959–1970 (2011)

    Article  Google Scholar 

  • Bos, D.O.: EEG-based emotion recognition. Influence vis. Audit. Stimuli 56(3), 1–17 (2006)

    Google Scholar 

  • Brouwer, A.M., Zander, T.O., Van Erp, J.B., Korteling, J.E., Bronkhorst, A.W.: Using neurophysiological signals that reflect cognitive or affective state: six recommendations to avoid common pitfalls. Front. Neurosci. 9, 136 (2015)

    Article  Google Scholar 

  • Cheng, J., Chen, M., Li, C., Liu, Y., Song, R., Liu, A., Chen, X.: Emotion recognition from multi-channel EEG via deep forest. IEEE J. Biomed. Health Inform. 25(2), 453–464 (2020)

    Article  Google Scholar 

  • Deng, Y., Chang, L., Yang, M., Huo, M., Zhou, R.: Gender differences in emotional response: inconsistency between experience and expressivity. PLoS ONE 11(6), e0158666 (2016)

    Article  Google Scholar 

  • Doma, V., Pirouz, M.: A comparative analysis of machine learning methods for emotion recognition using EEG and peripheral physiological signals. J. Big Data 7(1), 1–21 (2020)

    Article  Google Scholar 

  • Ekman, P.: Basic Emotions. Hoboken (1999)

  • Electrode Position Nomenclature Committee: Guideline thirteen: guidelines for standard electrode position nomenclature. J. Clin. Neurophysiol. 11, 111–113 (1994)

    Article  Google Scholar 

  • Goldstein, E. B. (Ed.).: Encyclopedia of Perception. Sage (2010)

  • GS, S. K., Sampathila, N., & Tanmay, T.: Wavelet based machine learning models for classification of human emotions using EEG signal. Meas. Sens. 24, 100554 (2022)

  • Hasanzadeh, F., Annabestani, M., Moghimi, S.: Continuous emotion recognition during music listening using EEG signals: a fuzzy parallel cascades model. Appl. Soft Comput. 101, 107028 (2021)

    Article  Google Scholar 

  • He, H., Tan, Y., Ying, J., Zhang, W.: Strengthen EEG-based emotion recognition using firefly integrated optimization algorithm. Appl. Soft Comput. 94, 106426 (2020)

    Article  Google Scholar 

  • Homan, R.W., Herman, J., Purdy, P.: Cerebral location of international 10–20 system electrode placement. Electroencephalogr. Clin. Neurophysiol. 66(4), 376–382 (1987)

    Article  Google Scholar 

  • Huang, C.: Recognition of psychological emotion by EEG features. Netw. Model. Anal. Health Inform. Bioinform. 10(1), 1–11 (2021)

    Article  Google Scholar 

  • Huang, D., Chen, S., Liu, C., Zheng, L., Tian, Z., Jiang, D.: Differences first in asymmetric brain: a bi-hemisphere discrepancy convolutional neural network for EEG emotion recognition. Neurocomputing 448, 140–151 (2021)

    Article  Google Scholar 

  • Hwang, S., Ki, M., Hong, K., & Byun, H.: Subject-independent EEG-based emotion recognition using adversarial learning. In: 2020 8th International Winter Conference on Brain–Computer Interface (BCI), pp. 1–4. IEEE (2020)

  • Jin, L., Kim, E.Y.: Interpretable cross-subject EEG-based emotion recognition using channel-wise features. Sensors 20(23), 6719 (2020)

    Article  Google Scholar 

  • Katsigiannis, S., Ramzan, N.: DREAMER : A database for emotion recognition through EEG and ECG signals from wireless low-cost off-the-shelf devices. IEEE J. Biomed. Health Inform. 22(1), 98–107 (2017)

    Article  Google Scholar 

  • Kim, S., Yang, H.J., Nguyen, N.A.T., Prabhakar, S.K., Lee, S.W.: WeDea: a new EEG-based framework for emotion recognition. IEEE J. Biomed. Health Inform. 26(1), 264–275 (2021)

    Article  Google Scholar 

  • Koelstra, S., Muhl, C., Soleymani, M., Lee, J.S., Yazdani, A., Ebrahimi, T., Patras, I.: Deap: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2011)

    Article  Google Scholar 

  • Lang, P.J.: The emotion probe: studies of motivation and attention. Am. Psychol. 50(5), 372 (1995)

    Article  Google Scholar 

  • Levenson, R.W., Carstensen, L.L., Friesen, W.V., Ekman, P.: Emotion, physiology, and expression in old age. Psychol. Aging 6(1), 28 (1991)

    Article  Google Scholar 

  • Li, X., Song, D., Zhang, P., Zhang, Y., Hou, Y., Hu, B.: Exploring EEG features in cross-subject emotion recognition. Front. Neurosci. 12, 162 (2018)

    Article  Google Scholar 

  • Liu, Y., Sourina, O. EEG-based subject-dependent emotion recognition algorithm using fractal dimension. In: 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 3166–3171. IEEE (2014)

  • Liu, S., Wang, X., Zhao, L., Zhao, J., Xin, Q., Wang, S.: Subject-independent emotion recognition of EEG signals based on dynamic empirical convolutional neural network. In: IEEE/ACM Transactions on Computational Biology and Bioinformatics (2020)

  • Luck, S. J., Kappenman, E. S. (Eds.).: The Oxford Handbook of Event-Related Potential Components. Oxford University Press (2011)

  • Meng, Q., Yan, J., & Xu, H.: Research on EEG signal recognition based on channel selection. In: 2017 Chinese Automation Congress (CAC), pp. 6413–6417. IEEE (2017)

  • Mokatren, L.S., Ansari, R., Cetin, A.E., Leow, A.D., Ajilore, O.A., Klumpp, H., Vural, F.T.Y.: EEG classification by factoring in sensor spatial configuration. IEEE Access 9, 19053–19065 (2021)

    Article  Google Scholar 

  • Moon, S. E., Jang, S., Lee, J. S.: Convolutional neural network approach for EEG-based emotion recognition using brain connectivity and its spatial information. In: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 2556–2560. IEEE (2018)

  • Nanthini, B.S., Santhi, B.: Electroencephalogram signal classification for automated epileptic seizure detection using genetic algorithm. J. Nat. Sci. Biol. Med. 8(2), 159 (2017)

    Article  Google Scholar 

  • Naser, D.S., Saha, G.: Influence of music liking on EEG based emotion recognition. Biomed. Signal Process. Control 64, 102251 (2021)

    Article  Google Scholar 

  • Nawaz, R., Cheah, K.H., Nisar, H., Yap, V.V.: Comparison of different feature extraction methods for EEG-based emotion recognition. Biocybern. Biomed. Eng. 40(3), 910–926 (2020)

    Article  Google Scholar 

  • Nygaard, V., Løland, A., Holden, M., Langaas, M., Rue, H., Liu, F., et al.: Effects of mRNA amplification on gene expression ratios in cDNA experiments estimated by analysis of variance. BMC Genom. 4(1), 1–13 (2003)

    Article  Google Scholar 

  • Ozdemir, M.A., Degirmenci, M., Izci, E., Akan, A.: EEG-based emotion recognition with deep convolutional neural networks. Biomed. Eng. 66(1), 43–57 (2021)

    Article  Google Scholar 

  • Pandey, P., &Seeja, K. R.: Emotional state recognition with EEG signals using subject independent approach. In: Data Science and Big Data Analytics, pp. 117–124. Springer, Singapore (2019)

  • Pane, E. S., Hendrawan, M. A., Wibawa, A. D., Purnomo, M. H.: Identifying rules for electroencephalograph (EEG) emotion recognition and classification. In: 2017 5th International Conference on Instrumentation, Communications, Information Technology, and Biomedical Engineering (ICICI-BME), pp. 167–172. IEEE (2017)

  • Plutchik, R.: The nature of emotions. Am. Sci. 89(4), 344 (2001)

    Article  Google Scholar 

  • Posner, J., Russell, J.A., Peterson, B.S.: The circumplex model of affect: an integrative approach to affective neuroscience, cognitive development, and psychopathology. Dev. Psychopathol. 17(3), 715–734 (2005)

    Article  Google Scholar 

  • Qing, C., Qiao, R., Xu, X., Cheng, Y.: Interpretable emotion recognition using EEG signals. IEEE Access 7, 94160–94170 (2019)

    Article  Google Scholar 

  • Rani, P., Liu, C., Sarkar, N., Vanman, E.: An empirical study of machine learning techniques for affect recognition in human–robot interaction. Pattern Anal. Appl. 9(1), 58–69 (2006)

    Article  Google Scholar 

  • Sakalle, A., Tomar, P., Bhardwaj, H., Acharya, D., Bhardwaj, A.: A LSTM based deep learning network for recognizing emotions using wireless brainwave driven system. Expert Syst. Appl. 173, 114516 (2021)

    Article  Google Scholar 

  • Salankar, N., Mishra, P., Garg, L.: Emotion recognition from EEG signals using empirical mode decomposition and second-order difference plot. Biomed. Signal Process. Control 65, 102389 (2021)

    Article  Google Scholar 

  • Samavat, A., Khalili, E., Ayati, B., Ayati, M.: Deep learning model with adaptive regularization for EEG-based emotion recognition using temporal and frequency features. IEEE Access 10, 24520–24527 (2022)

    Article  Google Scholar 

  • Sheykhivand, S., Mousavi, Z., Rezaii, T.Y., Farzamnia, A.: Recognizing emotions evoked by music using CNN-LSTM networks on EEG signals. IEEE Access 8, 139332–139345 (2020)

    Article  Google Scholar 

  • Subasi, A., Tuncer, T., Dogan, S., Tanko, D., Sakoglu, U.: EEG-based emotion recognition using tunable Q wavelet transform and rotation forest ensemble classifier. Biomed. Signal Process. Control 68, 102648 (2021)

    Article  Google Scholar 

  • Suhaimi, N. S., Mountstephens, J., Teo, J.: EEG-based emotion recognition: a state-of-the-art review of current trends and opportunities. Computat. Intell. Neurosci. (2020)

  • Sur, S., Sinha, V.K.: Event-related potential: an overview. Ind. Psychiatry J. 18(1), 70 (2009)

    Article  Google Scholar 

  • Taran, S., Bajaj, V.: Emotion recognition from single-channel EEG signals using a two-stage correlation and instantaneous frequency-based filtering method. Comput. Methods Programs Biomed. 173, 157–165 (2019)

    Article  Google Scholar 

  • Teplan, M.: Fundamentals of EEG measurement. Meas. Sci. Rev. 2(2), 1–11 (2002)

    Google Scholar 

  • Topic, A., Russo, M.: Emotion recognition based on EEG feature maps through deep learning network. Eng. Sci. Technol. Int. J. 24(6), 1442–1454 (2021)

    Google Scholar 

  • Walsh, P., Kane, N., Butler, S.: The clinical role of evoked potentials. J. Neurol. Neurosurg. Psychiatry. 76(suppl 2), ii16–ii22 (2005)

    Google Scholar 

  • Wang, Z., Zhang, Z., & Wang, W.: Emotion recognition based on framework of badeba-SVM. Math. Problems Eng. 2019 (2019)

  • Wioleta, S.: Using physiological signals for emotion recognition. In: 2013 6th international conference on human system interactions (HSI), pp. 556–561. IEEE (2013)

  • Zhao, G., Song, J., Ge, Y., Liu, Y., Yao, L., Wen, T.: Advances in emotion recognition based on physiological big data. J. Comput. Res. Dev. 53(1), 80 (2016)

    Google Scholar 

  • Zhao, G., Ge, Y., Shen, B., Wei, X., Wang, H.: Emotion analysis for personality inference from EEG signals. IEEE Trans. Affect. Comput. 9(3), 362–371 (2017)

    Article  Google Scholar 

  • Zheng, X., Liu, X., Zhang, Y., Cui, L., Yu, X.: A portable HCI system-oriented EEG feature extraction and channel selection for emotion recognition. Int. J. Intell. Syst. 36(1), 152–176 (2021)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Indira Gandhi Institute of Technology, Sarang,Utkal University, Bhubaneswar, India

    Jenamani Chandrakanta Badajena

  2. Indira Gandhi Institute of Technology, Sarang, India

    Srinivas Sethi & Ramesh Kumar Sahoo

  3. Odisha University of Technology and Research, Bhubaneswar, India

    Sanjit Kumar Dash

Authors
  1. Jenamani Chandrakanta Badajena
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Srinivas Sethi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Sanjit Kumar Dash
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ramesh Kumar Sahoo
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

All authors have made substantial contributions to the conception of the work and contributed to the acquisition, analysis, or interpretation of data.

Corresponding author

Correspondence to Jenamani Chandrakanta Badajena.

Ethics declarations

Conflict of interest

The authors have no competing interests.

Ethics approval and consent to participate

Not Applicable.

Consent for publication

Not applicable.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Badajena, J.C., Sethi, S., Dash, S.K. et al. A survey on EEG-based neurophysiological research for emotion recognition. CCF Trans. Pervasive Comp. Interact. 5, 333–349 (2023). https://doi.org/10.1007/s42486-023-00129-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s42486-023-00129-6

Keywords

Search

Navigation