Fuzzy Integral Optimization with Deep Q-Network for EEG-Based Intention Recognition
Non-invasive brain-computer interface using electroencephalography (EEG) signals promises a convenient approach empowering humans to communicate with and even control the outside world only with intentions. Herein, we propose to analyze EEG signals using fuzzy integral with deep reinforcement learning optimization to aggregate two aspects of information contained within EEG signals, namely local spatio-temporal and global temporal information, and demonstrate its benefits in EEG-based human intention recognition tasks. The EEG signals are first transformed into a 3D format preserving both topological and temporal structures, followed by distinctive local spatio-temporal feature extraction by a 3D-CNN, as well as the global temporal feature extraction by an RNN. Next, a fuzzy integral with respect to the optimized fuzzy measures with deep reinforcement learning is utilized to integrate the two extracted information and makes a final decision. The proposed approach retains the topological and temporal structures of EEG signals and merges them in a more efficient way. Experiments on a public EEG-based movement intention dataset demonstrate the effectiveness and superior performance of our proposed method.
- 2.Bashivan, P., Rish, I., Yeasin, M., Codella, N.: Learning representations from EEG with deep recurrent-convolutional neural networks. In: International Conference on Learning Representations (2016)Google Scholar
- 3.Zhang, X., Yao, L., Zhang, D., Wang, X., Sheng, Q., Gu, T.: Multi-person brain activity recognition via comprehensive EEG signal analysis. In: 14th International Conference on Mobile and Ubiquitous Systems: Computing, Networking and Services (2017)Google Scholar
- 8.Shoaie, Z., Esmaeeli, M., Shouraki, S.B.: Combination of multiple classifiers with fuzzy integral method for classifying the EEG signals in brain-computer interface. In: International Conference on Biomedical and Pharmaceutical Engineering, ICBPE 2006, pp. 157–161. IEEE (2006)Google Scholar
- 12.Shenoy, H.V., Vinod, A.P., Guan, C.: Shrinkage estimator based regularization for EEG motor imagery classification. In: 2015 10th International Conference on Information, Communications and Signal Processing (ICICS), pp. 1–5. IEEE (2015)Google Scholar
- 13.Sita, J., Nair, G.: Feature extraction and classification of EEG signals for mapping motor area of the brain. In: 2013 International Conference on Control Communication and Computing (ICCC), pp. 463–468. IEEE (2013)Google Scholar
- 15.He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)Google Scholar