Skip to main content

Objective Emotion Quantification in the Metaverse Using Brain Computer Interfaces

  • Conference paper
  • First Online:
Internet of Things. Advances in Information and Communication Technology (IFIPIoT 2023)

Abstract

Certain human emotions can be quantified by processing electroencephalography (EEG) data. Recent advances in Brain Computer Interfaces (BCI) allow us to record, process and determine user functional intent and emotional implication from such data. The Metaverse captures an extensive spectrum of multi-modal content on the Internet including social media, games, videos, and more complex VR, AR, MR platforms. We propose an objective method to quantify user emotion using EEG data collected through non-invasive BCIs during user interaction. BCI’s qualify as IoT sensors that record EEG data in real-time as users are exploring multimedia content through several emotion-generating scenarios.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 89.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 119.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Longo, B., Castillo, J., Bastos, T.: Brain-computer interface combined with virtual reality environment (VRE) for inferior limbs rehabilitation in post-stroke subjects. In: SBBIOTEC, BMC 2014, vol. 8 (2014). https://doi.org/10.1186/1753-6561-8-S4-P18

  2. Statthaler, K., Schwarz, A., Steyrl, D.: Cybathlon experiences of the Graz BCI racing team Mirage91 in the brain-computer interface discipline. J. Neuro Eng. Rehabil. 14, 1–16 (2017). https://doi.org/10.1186/s12984-017-0344-9

    Article  Google Scholar 

  3. Torres, E., Hernández-Álvarez, M., Yoo, S.G.: EEG-based BCI emotion recognition: a survey. Sensors 20, 5083 (2020). https://doi.org/10.3390/s20185083

    Article  Google Scholar 

  4. NeuroSky Homepage. https://neurosky.com/2016/11/bci-what-is-it-and-where-is-it-going/. Accessed 3 Nov 2016

  5. Yan, W., Liu, X., Shan, B., Zhang, X., Pu, Y.: Research on the emotions based on brain-computer technology: a bibliometric analysis and research agendas. Front. Psychol. 12, 771591 (2021). https://doi.org/10.3389/fpsyg.2021.771591

    Article  Google Scholar 

  6. UWA. https://online.uwa.edu/news/emotional-psychology/. Accessed 22 June 2020

  7. Liu, Y., Zhang, Y., Tao, D.: Wearable sensors for emotion recognition: a comprehensive review. IEEE Trans. Affect. Comput. 10 (2019)

    Google Scholar 

  8. Ekman, P.: An argument for basic emotions. Cogn. Emot. 6, 169–200 (1992). https://doi.org/10.1038/s41598-021-85163-z

    Article  Google Scholar 

  9. Özerdem, M.S., Polat, H.: Emotion recognition based on EEG features in movie clips with channel selection. Brain Inform. 4(4), 241–252 (2017). https://doi.org/10.1007/s40708-017-0069-3

    Article  Google Scholar 

  10. Russell, J.A.: Core affect and the psychological construction of emotion. Psychol. Rev. 110, 145 (2003). https://doi.org/10.1037/0033-295X.110.1.145

    Article  Google Scholar 

  11. Baumeister, R.F., Stillwell, A.M., Heatherton, T.F.: Guilt: an interpersonal approach. Psychol. Bull. 115, 243 (1994). https://doi.org/10.1037/0033-2909.115.2.243

    Article  Google Scholar 

  12. Llinares, C., et al.: Affective computing in virtual reality: emotion recognition from brain and heartbeat dynamics using wearable sensors. Sci. Rep. 8, 13657 (2018). https://doi.org/10.1038/s41598-018-32063-4

    Article  Google Scholar 

  13. Schubring, D., et al.: Virtual reality potentiates emotion and task effects of alpha/beta brain oscillations. Brain Sci. 10, 537 (2020). https://doi.org/10.3390/brainsci10080537

    Article  Google Scholar 

  14. Hongyu, G., Wurong, G.: Metaverse-powered experiential situational english-teaching design: an emotion-based analysis method. Front. Psychol. 13, 859159 (2022). https://doi.org/10.3389/fpsyg.2022.859159

    Article  Google Scholar 

  15. Perez-Valero, E., et al.: Quantitative assessment of stress through EEG during a virtual reality stress-relax session. Front Comput. Neurosci. 15, 684423 (2021). https://doi.org/10.3389/fncom.2021.684423

    Article  Google Scholar 

  16. Souza, R., et al.: Attention detection in virtual environments using EEG signals: a scoping review. Front. Physiol. 12, 727840 (2021). https://doi.org/10.3389/fphys.2021.727840

    Article  Google Scholar 

  17. Lang, P.J., et al.: Technical manual and affective ratings of the International Affective Picture System (IAPS), NIMH Center for the Study of Emotion and Attention (1997)

    Google Scholar 

  18. Yan, J., Chen, S., Deng, S.: An EEG-based emotion recognition model with rhythm and time characteristics. Brain Inf. 6, 1–8 (2019). https://doi.org/10.1186/s40708-019-0100-y

    Article  Google Scholar 

  19. Suhaimi, N.S., Mountstephens, J., Teo, J.: EEG-based emotion recognition: a state-of-the-art review of current trends and opportunities. CIN 2020 (2020). https://doi.org/10.1155/2020/8875426

Download references

Author information

Authors and Affiliations

Authors

Corresponding authors

Correspondence to Anca O. Muresan , Meenalosini V. Cruz or Felix G. Hamza-Lup .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 IFIP International Federation for Information Processing

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Muresan, A.O., Cruz, M.V., Hamza-Lup, F.G. (2024). Objective Emotion Quantification in the Metaverse Using Brain Computer Interfaces. In: Puthal, D., Mohanty, S., Choi, BY. (eds) Internet of Things. Advances in Information and Communication Technology. IFIPIoT 2023. IFIP Advances in Information and Communication Technology, vol 683. Springer, Cham. https://doi.org/10.1007/978-3-031-45878-1_24

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-45878-1_24

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-45877-4

  • Online ISBN: 978-3-031-45878-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics