Abstract
Introduction: As a direct bridge between the brain and the outer world, brain–computer interface (BCI) is expected to replace, restore, enhance, supplement, or improve the natural output of brain. The prospect of BCI serving humans is very broad. However, the extensive applications of BCI have not been fully achieved. One of reasons is that the cost of calibration reduces the convenience and usability of BCI. Methods: In this study, we proposed a calibration-free approach, which is based on the ideas of reinforcement learning and transfer learning, for P300-based BCI. This approach, composed of two algorithms: P300 linear upper confidence bound (PLUCB) and transferred PLUCB (TPLUCB), is able to learn during the usage by exploration and exploitation and allows P300-based BCI to start working without any calibration. Results: We tested the performances of PLUCB and TPLUCB using stepwise linear discriminant analysis (SWLDA), a commonly used method that needs calibration, as a baseline in simulated online experiments. The results showed the merits of PLUCB and TPLUCB. PLUCB can quickly increase the accuracies to the level of SWLDA. TPLUCB has surpassed SWLDA in the sample accuracy since it starts running. Both PLUCB and TPLUCB have the ability to keep improving the classification performance during the process. The overall sample accuracies (\(73.6\pm 4.8\%\), \(73.1\pm 4.9\%\)), overall symbol accuracies (\(80.4\pm 12.8\%\), \(79.6\pm 14.0\%\)), F-measures (\(0.45\pm 0.06\), \(0.44\pm 0.06\)) and information transfer ratios (ITR) (\(36.4\pm 9.1\), \(35.5\pm 9.8\)) of PLUCB and TPLUCB are significantly better than those of SWLDA (overall sample accuracy: \(58.8\pm 3.8\%\), overall symbol accuracy: \(69.0\pm 18.3\%\), F-measure: \(0.38\pm 0.04\), ITR: \(28.7\pm 10.7\)). Conclusions: The proposed approach, which does not need calibration but outperform SWLDA, is a very good option for the implementation of P300-based BCI.
Similar content being viewed by others
References
Wolpaw JR, Wolpaw EW, editors. Brain-Computer Interfaces: Principles and Practice. New York, USA: Oxford University Press; 2012.
Edelman BJ, Meng J, Suma D, Zurn C, Nagarajan E, Baxter BS, Cline CC, He B. Noninvasive neuroimaging enhances continuous neural tracking for device control. Sci Robot. 2019;4(31):eaaw6844.
Shukla PK, Chaurasiya RK, Verma S. Performance improvement of P300-based home appliances control classification using convolution neural network. Biomed Signal Process Control. 2021;63:102220.
Bauer R, Gharabaghi A. Reinforcement learning for adaptive threshold control of restorative brain-computer interfaces: a Bayesian simulation. Front Neurosci. 2015;9: Article 36.
Abiri R, Borhani S, Sellers EW, Jiang Y, Zhao X. A comprehensive review of EEG-based brain-computer interface paradigms. J Neural Eng. 2019;16(1):011001.
Ben-David S, Blitzer J, Crammer K, Kulesza A, Pereira F, Vaughan JW. A theory of learning from different domains. Mach Learn. 2010;79(1–2):151–75.
Pan SJ, Yang Q. A survey on transfer learning. IEEE Trans Knowl Data Eng. 2010;22(10):1345–59.
Jayaram V, Alamgir M, Altun Y, Scholkopf B, Grosse-Wentrup M. Transfer learning in brain-computer interfaces. IEEE Comput Intell Mag. 2016;11(1):20–31.
Wan Z, Yang R, Huang M, Zeng N, Liu X. A review on transfer learning in EEG signal analysis. Neurocomputing. 2021;421:1–14.
Kaelbling LP, Littman ML, Moore AW. Reinforcement learning: A survey. J Artif Intell Res. 1996;4:237–85.
Crammer K, Dekel O, Shalev-Shwartz S, Singer Y. Online passive-aggressive algorithms. J Mach Learn Res. 2006;7(3):551–85.
Hazan E. Introduction to online convex optimization. Foundations and Trends in Optimization. 2015;2(3–4):157–325.
Fazli S, Popescu F, Danóczy M, Blankertz B, Müller K-R, Grozea C. Subject-independent mental state classification in single trials. Neural Netw. 2009;22(9):1305–12.
Kindermans P-J, Tangermann M, Müller K-R, Schrauwen B. Integrating dynamic stopping, transfer learning and language models in an adaptive zero-training ERP speller. J Neural Eng. 2014;11(3):035005.
Gayraud NT, Rakotomamonjy A, Clerc M. Optimal transport applied to transfer learning for p300 detection. In: BCI 2017-7th Graz Brain-Computer Interface Conference. 2017. p. 6.
Qi H, Xue Y, Xu L, Cao Y, Jiao X. A speedy calibration method using riemannian geometry measurement and other-subject samples on a P300 speller. IEEE Trans Neural Syst Rehabil Eng. 2018;26(3):602–8.
Hübner D, Kindermans P-J, Verhoeven T, Müller K-R, Tangermann M. Rethinking BCI paradigm and machine learning algorithm as a symbiosis: Zero calibration, guaranteed convergence and high decoding performance. In: Brain-Computer Interface Research. Springer. 2019. p. 63–73.
Lee J, Won K, Kwon M, Jun SC, Ahn M. CNN with large data achieves true zero-training in online P300 brain-computer interface. IEEE Access. 2020;8:74385–400.
Li F, Xia Y, Wang F, Zhang D, Li X, He F. Transfer learning algorithm of P300-EEG signal based on xdawn spatial filter and riemannian geometry classifier. Appl Sci. 2020;10(5):1804.
Buttfield A, Ferrez PW, Millan JR. Towards a robust BCI: error potentials and online learning. IEEE Trans Neural Syst Rehabil Eng. 2006;14(2):164–8.
Kindermans P-J, Schreuder M, Schrauwen B, Müller K-R, Tangermann M. True zero-training brain-computer interfacing-an online study. PloS One. 2014;9(7):e102504.
Grizou J, Iturrate I, Montesano L, Oudeyer P-Y, Lopes M. Calibration-Free BCI Based Control. In: Twenty-Eighth AAAI Conference on Artificial Intelligence. Quebec, Canada; 2014. p. 1–8.
Liu W, Zhang L, Tao D, Cheng J. Reinforcement online learning for emotion prediction by using physiological signals. Pattern Recogn Lett. 2018;107:123–30.
Ma Z, Cheng J, Tao D. Online learning using projections onto shrinkage closed balls for adaptive brain-computer interface. Pattern Recogn. 2020;97:107017.
Farwell LA, Donchin E. Talking off the top of your head : toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr Clin Neurophysiol. 1988;70(6):510–23.
Li L, Chu W, Langford J, Schapire RE. A contextual-bandit approach to personalized news article recommendation. In: Proceedings of the 19th international conference on World wide web. 2010. p. 661–670.
Kim SK, Kirchner EA, Stefes A, Kirchner F. Intrinsic interactive reinforcement learning-using error-related potentials for real world human-robot interaction. Sci Rep. 2017;7:17562.
Schalk G, McFarland DJ, Hinterberger T, Birbaumer N, Wolpaw JR. BCI2000: a general-purpose brain-computer interface (BCI) system. IEEE Trans Biomed Eng. 2004;51(6):1034–43.
Lotte F, Bougrain L, Cichocki A, Clerc M, Congedo M, Rakotomamonjy A, Yger F. A review of classification algorithms for EEG-based brain-computer interfaces: a 10 year update. J Neural Eng. 2018;15(3):031005.
Arvaneh M, Robertson IH, Ward TE. A P300-based brain-computer interface for improving attention. Front Hum Neurosci. 2019;12:524.
Allison BZ, Kübler A, Jin J. 30+ years of P300 brain-computer interfaces. Psychophysiology. 2020;57(7):e13569.
Collins AGE. Reinforcement learning: bringing together computation and cognition. Curr Opin Behav Sci. 2019;29:63–8.
Lawrence EJ, Su L, Barker GJ, Medford N, Dalton J, Williams S, Birbaumer N, Veit R, Ranganatha S, Bodurka J. Self-regulation of the anterior insula: Reinforcement learning using real-time fMRI neurofeedback. Neuroimage. 2014;88:113–24.
Cortese A, Lau H, Kawato M. Unconscious reinforcement learning of hidden brain states supported by confidence. Nat Commun. 2020;11:4429.
Hoerl AE, Kennard RW. Ridge regression: Biased estimation for nonorthogonal problems. Technometrics. 2000;42(1):80–6.
Walsh TJ, Szita I, Diuk C, Littman ML. Exploring compact reinforcement-learning representations with linear regression. arXiv preprint arXiv:1205.2606. 2012.
Huang Z, Zheng W, Wu Y, Wang Y. Ensemble or pool: A comprehensive study on transfer learning for c-VEP BCI during interpersonal interaction. J Neurosci Methods. 2020;343(4)108855.
Townsend G, LaPallo B, Boulay C, Krusienski D, Frye G, Hauser C, Schwartz N, Vaughan T, Wolpaw J, Sellers E. A novel P300-based brain-computer interface stimulus presentation paradigm: Moving beyond rows and columns. Clin Neurophysiol. 2010;121(7):1109–20.
Fawcett T. An introduction to ROC analysis. Pattern Recogn Lett. 2006;27(8):861–74.
Yuan P, Gao X, Allison B, Wang Y, Bin G, Gao S. A study of the existing problems of estimating the information transfer rate in online brain-computer interfaces. J Neural Eng. 2013;10(2):026014.
Mladenovic J, Frey J, Joffily M, Maby E, Lotte F, Mattout J. Active inference as a unifying, generic and adaptive framework for a P300-based BCI. J Neural Eng. 2020;17(1):016054.
Acknowledgements
Zhilei Lv, Faqiang Peng and Ting Li participated in this work when they studied at Fuzhou University. We thank them for their contributions.
Funding
This study was supported by the Transformation Project of Scientific and Technological Achievements of Fuzhou, China (2020-GX-12), the Natural Science Foundation of Fujian Province,China (2019J01242) and the National Natural Science Foundation of China (62076064).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Ethical Approval
All procedures performed in the study involving human participants were in accordance with the ethical standards of the Institutional Review Board at Fuzhou University and with the 1964 Helsinki declaration and its later amendments.
Informed Consent
Informed consent was obtained from all individual participants included in the study.
Conflicts of Interest
No conflict of interest exists.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Huang, Z., Guo, J., Zheng, W. et al. A Calibration-free Approach to Implementing P300-based Brain–computer Interface. Cogn Comput 14, 887–899 (2022). https://doi.org/10.1007/s12559-021-09971-1
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12559-021-09971-1