Real-time Brain Assessment for Adaptive Virtual Reality Game : A Neurofeedback Approach
Humans’ cognitive and affective states are constantly subject to regular and sudden changes. The origins of these changes are multiple and unpredictable. Virtual Reality (VR) game environments could represent an immersive unconstrained experimental context in which game designers could control a wide range of parameters that act on these states. In this paper, we propose to track and adapt to individuals’ frustration and excitement levels in real time while interacting with a VR environment. We developed “AmbuRun”, a VR game designed to modify the speed and the difficulty in real time. A neural agent was created to control these parameters within the game using an intervention strategy that was intended to induce appropriate modifications of the players ‘excitement and frustration level. An experimental study involving 20 participants was conducted to evaluate our neurofeedback approach. Results showed that intelligent control through neurofeedback of speed and difficulty affected excitement and frustration before and after the agent action.
KeywordsNeurofeedback Intelligent agent Virtual reality Adaptive game Emotional intelligence
Unable to display preview. Download preview PDF.
- 2.Biocca, F.: The Cyborg’s Dilemma: Progressive Embodiment in Virtual Environments . J. Comput.-Mediat. Commun. 3 (2006)Google Scholar
- 4.Bohil, C.J., Alicea, B., Biocca, F.A.: Virtual reality in neuroscience research and therapy. Nat. Rev., Neurosci. (2011)Google Scholar
- 5.Benlamine, M.S, Chaouachi, M., Frasson, C.: Dufresne, Aude: Predicting Spontaneous Facial Expressions from EEG. Intell. Tutoring Syst. (2016)Google Scholar
- 12.Chaouachi, M., Jraidi, I., Frasson, C.: Adapting to learners’ mental states using a physiological computing approach. In: FLAIRS 2015 Twenty-Eighth Int. Flairs Conf. (2015)Google Scholar
- 13.Ghali, R., Ben Abdessalem, H., Frasson, C.: Improving Intuitive Reasoning Through Assistance Strategies in a Virtual Reality Game (2017)Google Scholar
- 15.Van Doren, J., Heinrich, H., Bezold, M., Reuter, N., Kratz, O., Horndasch, S., Berking, M., Ros, T., Gevensleben, H., Moll, G.H., Studer, P.: Theta/beta neurofeedback in children with ADHD: Feasibility of a short-term setting and plasticity effects. Int. J. Psychophysiol. 112, 80–88 (2017)CrossRefGoogle Scholar
- 17.Duric, N.S., Elgen, I., Assmus, J.: Self-reported efficacy of neurofeedback treatment in a clinical randomized controlled study of ADHD children and adolescents. Neuropsychiatr. Dis. Treat., 1645 (2014)Google Scholar