A study of decoding human brain activities from simultaneous data of EEG and fMRI using MVPA
- 174 Downloads
Neuroscientists have investigated the functionality of the brain in detail and achieved remarkable results but this area still need further research. Functional magnetic resonance imaging (fMRI) is considered as the most reliable and accurate technique to decode the human brain activity, on the other hand electroencephalography (EEG) is a portable and low cost solution in brain research. The purpose of this study is to find whether EEG can be used to decode the brain activity patterns like fMRI. In fMRI, data from a very specific brain region is enough to decode the brain activity patterns due to the quality of data. On the other hand, EEG can measure the rapid changes in neuronal activity patterns due to its higher temporal resolution i.e., in msec. These rapid changes mostly occur in different brain regions. In this study, multivariate pattern analysis (MVPA) is used both for EEG and fMRI data analysis and the information is extracted from distributed activation patterns of the brain. The significant information among different classes is extracted using two sample t test in both data sets. Finally, the classification analysis is done using the support vector machine. A fair comparison of both data sets is done using the same analysis techniques, moreover simultaneously collected data of EEG and fMRI is used for this comparison. The final analysis is done with the data of eight participants; the average result of all conditions are found which is 65.7% for EEG data set and 64.1% for fMRI data set. It concludes that EEG is capable of doing brain decoding with the data from multiple brain regions. In other words, decoding accuracy with EEG MVPA is as good as fMRI MVPA and is above chance level.
KeywordsEEG fMRI Visual decoding SVM DWT
This research is supported by the Ministry of Education (MOE), Malaysia under the Grant of Higher Institution Centre of Excellence (HICoE) for CISIR (Ref: 0153CA-002).
Compliance with ethical standards
Conflict of interest
Aamir Saeed Malik has received the above grant and he declares that he has no conflict of interest.
All procedures performed in this study involving human participants were in accordance with the ethical standards of the Hospital Universiti Sains Malaysia (HUSM) and is already used in a recent study . The study protocol was approved by the local ethics committee of HUSM.
Informed consent was obtained from all individual participants included in the study before the start of the experiment.
- 1.Penny WD, Friston KJ, Ashburner JT, Kiebel SJ, Nichols TE (2011) Statistical parametric mapping: the analysis of functional brain images. Academic Press, CambridgeGoogle Scholar
- 7.Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–587Google Scholar
- 19.Zafar R, Kamel N, Naufal M, Malik AS, Dass SC, Ahmad RF, Abdullah JM, Reza F (2017) Decoding of visual activity patterns from fMRI responses using multivariate pattern analyses and convolutional neural network. J Integr Neurosc 16(3):275–289. https://doi.org/10.3233/JIN-170016 CrossRefGoogle Scholar
- 20.Gallant JL (2016) The Gallant Lab at UC BerkeleyGoogle Scholar
- 32.Douglas PK, Lau E, Anderson A, Head A, Kerr W, Wollner M, Moyer D, Li W, Durnhofer M, Bramen J (2013) Single trial decoding of belief decision making from EEG and fMRI data using independent components features. Front Hum Neurosci 7(392):1–10. https://doi.org/10.3389/fnhum.2013.00392 CrossRefGoogle Scholar
- 33.Winters-Hilt S, Merat S (2007) SVM clustering. BMC Bioinform 8:S18-S18Google Scholar
- 34.Zafar R, Dass SC, Malik A, Kamel N, Rehman J, Ahmad RF, Abdullah JM, Reza F (2017) Prediction of human brain activity using likelihood ratio based score fusion. In: IEEE access, pp 1–1Google Scholar
- 35.Ashburner J, Barnes G, Chen C, Daunizeau J, Flandin G, Friston K, Gitelman D, Kiebel S, Kilner J, Litvak V (2008) SPM8 manual functional imaging laboratory. Institute of Neurology, London, p 41Google Scholar
- 39.Bibian S, Zikov T, Ries CR, Dumont GA, Huzmezan M (2004) The wavelet-based anesthetic value (WAV): a novel alternative to the bispectral index (BIS). Anesthesiology 101:A342Google Scholar
- 40.Lundqvist KK, Bibian S, Ries C, Yu P, Dumont G (2004) Can the wavelet-based anesthetic value (WAV) predict airway motor response to LMA insertion? Anesthesiology 101:A606Google Scholar
- 42.Yohanes RE, Ser W, Huang G-B (2012) Discrete wavelet transform coefficients for emotion recognition from EEG signals. In: Engineering in medicine and biology society (EMBC), 2012 annual international conference of the IEEE, pp 2251–2254Google Scholar
- 47.Wang L, Fu X (2006) Data mining with computational intelligence. Springer, New YorkGoogle Scholar
- 51.Friedman J (1996) Another approach to polychotomous classification, technical report. Department of Statistics, Stanford University, StanfordGoogle Scholar
- 52.Yin, Rosanna Soentpiet (1999) In: Schölkopf B, Burges CJ, Smola AJ (eds) Advances in Kernel Methods: Support Vector Learning, vol 1. MIT Press, p. 376Google Scholar
- 55.Teplan M (2002) Fundamentals of EEG measurement. Meas Sci Rev 2:1–11Google Scholar
- 56.CBS (2009). How technology may soon “read” your mind. https://novascience.wordpress.com/2009/01/04/how-technology-may-soon-read-your-mind/