Advertisement

Analysis of Similarity and Differences in Brain Activities Between Perception and Production of Facial Expressions Using EEG Data and the NeuCube Spiking Neural Network Architecture

  • Hideaki Kawano
  • Akinori Seo
  • Zohreh Gholami Doborjeh
  • Nikola Kasabov
  • Maryam Gholami Doborjeh
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9950)

Abstract

This paper is a feasibility study of using the NeuCube spiking neural network (SNN) architecture for modeling EEG brain data related to perceiving versus mimicking facial expressions. It is demonstrated that the proposed model can be used to study the similarity and differences between corresponding brain activities as complex spatio-temporal patterns. Two SNN models are created for each of the 7 basic emotions for a group of Japanese subjects, one when subjects are perceiving an emotional face and another, when the same subjects are mimicking this emotion. The evolved connectivity in the two models are then subtracted to study the differences. Analysis of the models trained on the collected EEG data shows greatest similarity in sadness, and least similarity in happiness and fear, where differences in the T6 EEG channel area were observed. The study, being based on the well-known mirror neuron concept in the brain, is the first to analyze and visualize similarity and differences as evolved spatio-temporal patterns in a brain-like SNN model.

Keywords

Mirror neuron system Facial expression EEG data NeuCube Spiking neural network (SNN) 

References

  1. 1.
    Gallese, V., Fadiga, L., Fogassi, L., Rizzolatti, G.: Action recognition in the premotor cortex. Brain 119, 593–609 (1996)CrossRefGoogle Scholar
  2. 2.
    Iacoboni, M., Woods, R.P., Brass, M., Bekkering, H., Mazziotta, J.C., Rizzolatti, G.: Cortical mechanisms of human imitation. Science 286(5449), 2526–2528 (1999)CrossRefGoogle Scholar
  3. 3.
    Binkofski, F., Buccino, G., Posse, S., Seitz, R.J., Rizzolatti, G., Freund, H.-J.: A fronto-parietal circuit for object manipulation in man: evidence from an fMRI-study. Eur. J. Neurosci. 11, 3276–3286 (1999)CrossRefGoogle Scholar
  4. 4.
    Kasabov, N.: NeuCube: a spiking neural network architecture for mapping, learning and understanding of spatio-temporal brain data. Neural Netw. 52, 62–76 (2014)CrossRefGoogle Scholar
  5. 5.
    Tu, E., Kasabov, N., Yang, J.: Mapping temporal variables Into the NeuCube for improved pattern recognition, predictive modelling and understanding of stream data. IEEE Trans. Neural Netw. Learn. Syst, 1–13 (2016)Google Scholar
  6. 6.
    Kasabov, N., Scott, N., Tu, E., Marks, S., Sengupta, N., Capecci, E.: Evolving spatio-temporal data machines based on the NeuCube neuromorphic framework: design methodology and selected applications, Neural Netw. (2016, to appear)Google Scholar
  7. 7.
    Doborjeh, M.G., Capecci, E., Kasabov, N.: Classification and segmentation of fMRI spatio-temporal brain data with a Neucube evolving spiking neural network model. In: IEEE SSCI, U.S.A, Orlando (2014)Google Scholar
  8. 8.
    Doborjeh, M.G., Wang, G., Kasabov, N., Kydd, R., Russell, B.R.: A Neucube spiking neural network model for the study of dynamic brain activities during a GO/NO_GO task: a case study on using EEG data of healthy Vs addiction vs treated subjects. IEEE Trans. Biomed. Eng. (2016, to appear)Google Scholar
  9. 9.
    Maryam Gholami, D., Nikola, K.: Dynamic 3D clustering of spatio-temporal brain data in the NeuCube spiking neural network architecture on a case study of fMRI data. In: Neural Information Processing, Istanbul (2015)Google Scholar
  10. 10.
    Song, S., Miller, K.D., Abbott, L.F.: Competitive Hebbian learning through spike-timing-dependent synaptic plasticity. Nature Neurosci. 3(9), 919–926 (2000)CrossRefGoogle Scholar
  11. 11.
    Kasabov, N., Dhoble, K., Nuntalid, N., Indiveri, G.: Dynamic evolving spiking neural networks for on-line spatio-and spectro-temporal pattern recognition. Neural Netw. 41, 188–201 (2013)CrossRefGoogle Scholar
  12. 12.
    Matsumoto, D., Ekman, P.: Japanese, Caucasian facial expressions of emotion (JACFEE) [Slides]. Intercultural and Emotion Research Laboratory, Department of Psychology, San Francisco State University, San Francisco (1988)Google Scholar
  13. 13.
    Talairach, J., Tournoux, P.: Co-planar Stereotaxic Atlas of the Human Brain. 3-Dimensional Proportional System: An Approach to Cerebral Imaging. Thieme Medical Publishers, New York (1988)Google Scholar
  14. 14.
    Koessler, L., Maillard, L., Benhadid, A., Vignal, J.P., Felblinger, J., Vespignani, H., Braun, M.: Automated cortical projection of EEG sensors: anatomical correlation via the international 10–10 system. Neuroimage 46(1), 64–72 (2009)CrossRefGoogle Scholar
  15. 15.
    Alfano, K.M., Cimino, C.R.: Alteration of expected hemispheric asymmetries: valence and arousal effects in neuropsychological models of emotion. Brain Cogn. 66, 213–220 (2008)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2016

Authors and Affiliations

  • Hideaki Kawano
    • 1
  • Akinori Seo
    • 1
  • Zohreh Gholami Doborjeh
    • 2
  • Nikola Kasabov
    • 2
  • Maryam Gholami Doborjeh
    • 2
  1. 1.Faculty of EngineeringKyushu Institute of TechnologyKitakyushuJapan
  2. 2.Knowledge Engineering and Discovery Research InstituteAuckland University of TechnologyAucklandNew Zealand

Personalised recommendations