Multimodal Head-Mounted Virtual-Reality Brain-Computer Interface for Stroke Rehabilitation
Rehabilitation after stroke requires the exploitation of active movement by the patient in order to efficiently re-train the affected side. Individuals with severe stroke cannot benefit from many training solutions since they have paresis and/or spasticity, limiting volitional movement. Nonetheless, research has shown that individuals with severe stroke may have modest benefits from action observation, virtual reality, and neurofeedback from brain-computer interfaces (BCIs). In this study, we combined the principles of action observation in VR together with BCI neurofeedback for stroke rehabilitation to try to elicit optimal rehabilitation gains. Here, we illustrate the development of the REINVENT platform, which takes post-stroke brain signals indicating an attempt to move and drives a virtual avatar arm, providing patient-driven action observation in head-mounted VR. We also present a longitudinal case study with a single individual to demonstrate the feasibility and potentially efficacy of the REINVENT system.
KeywordsVirtual reality Brain-computer interfaces Stroke rehabilitation
This research was supported by the American Heart Association through the REINVENT project (Grant #16IRG26960017) and US Army Research Office through the Cortically Coupled Computing project (W911NNF-14-D-0005).
- 1.Mozaffarian, D., et al.: American heart association statistics committee and stroke statistics subcommittee: heart disease and stroke statistics–2015 update: a report from the American heart association. Circulation 131, e29–e322 (2015)Google Scholar
- 2.Miller, E.L., et al.: American heart association council on cardiovascular nursing and the stroke council: comprehensive overview of nursing and interdisciplinary rehabilitation care of the stroke patient: a scientific statement from the American heart association. Stroke 41, 2402–2448 (2010)CrossRefGoogle Scholar
- 9.Paraskevopoulos, I., Tsekleves, E., Warland, A., Kilbride, C.: Virtual reality-based holistic framework: a tool for participatory development of customised playful therapy sessions for motor rehabilitation. In: 2016 8th International Conference on Games and Virtual Worlds for Serious Applications (VS-Games), September (2016)Google Scholar
- 11.Vourvopoulos, A., Bermudez i Badia, S.: Usability and cost-effectiveness in brain-computer interaction: is it user throughput or technology related? In: Proceedings of the 7th Augmented Human International Conference. ACM, Geneva, Switzerland (2016)Google Scholar
- 12.Schomer, D.L., Lopes da Silva, F.H.: Niedermeyer’s Electroencephalography: Basic Principles, Clinical Applications, and Related Fields. Lippincott Williams & Wilkins, Philadelphia (2011)Google Scholar
- 19.Vourvopoulos, A., Ferreira, A., Bermúdez i Badia, S.: NeuRow: an immersive VR environment for motor-imagery training with the use of brain-computer interfaces and vibrotactile feedback. In: 3rd International Conference on Physiological Computing Systems, Lisbon (2016)Google Scholar
- 21.Spicer, R., Anglin, J., Krum, D.M., Liew, S.L.: REINVENT: a low-cost, virtual reality brain-computer interface for severe stroke upper limb motor recovery. In: 2017 IEEE Virtual Reality (VR), pp. 385–386 (2017)Google Scholar
- 22.Klem, G.H., Luders, H.O., Jasper, H.H., Elger, C.: The ten-twenty electrode system of the international federation. Electroencephalogr. Clin. Neurophysiol. 52, 3–6 (1999). The International Federation of Clinical NeurophysiologyGoogle Scholar
- 23.Kothe, C.: Lab streaming layer (LSL). https://github.com/sccn/labstreaminglayer. Accessed 26 Oct 2015 (2014)
- 24.Fugl-Meyer, A.R., Jääskö, L., Leyman, I., Olsson, S., Steglind, S.: The post-stroke hemiplegic patient. 1. a method for evaluation of physical performance. Scand. J. Rehabil. Med. 7, 13–31 (1975)Google Scholar
- 29.Bouchard, S., Robillard, G., Renaud, P., Bernier, F.: Exploring new dimensions in the assessment of virtual reality induced side effects. J. Comput. Inf. Technol. 1, 20–32 (2011)Google Scholar
- 38.Dubovik, S., et al.: EEG alpha band synchrony predicts cognitive and motor performance in patients with ischemic stroke. https://www.hindawi.com/journals/bn/2013/109764/abs/