Hybrid Brain Computer Interface Based on Gaming Technology: An Approach with Emotiv EEG and Microsoft Kinect

Abstract

Brain computer interfaces (BCIs) can be used to improve quality-of-life of people with motor or communication impairments. However, these systems may not work properly for all users. The complex set-up, the intensive training required for BCI operation and the expensive devices often used, difficult the application to real-life scenarios, as well as, technology dissemination. Gaming technology devices may help to disseminate this technology and facilitate real-life validation due to lower costs and easier set-up. This paper presents the integration of gaming technology in a hybrid BCI based on Emotiv EEG and the Microsoft Kinect. This approach enables the collection of visual depth and RGB data from Microsoft Kinect, and electroencephalographic data from Emotiv EEG. Data combination from both devices and online labeling based on Kinect to avoid strict protocols are explored and system potentialities are discussed.