Abstract
Wheelchair control requires multiple degrees of freedom and fast intention detection, which makes electroencephalography (EEG)-based wheelchair control a big challenge. In our previous study, we have achieved direction (turning left and right) and speed (acceleration and deceleration) control of a wheelchair using a hybrid brain–computer interface (BCI) combining motor imagery and P300 potentials. In this paper, we proposed hybrid EEG-EOG BCI, which combines motor imagery, P300 potentials, and eye blinking to implement forward, backward, and stop control of a wheelchair. By performing relevant activities, users (e.g., those with amyotrophic lateral sclerosis and locked-in syndrome) can navigate the wheelchair with seven steering behaviors. Experimental results on four healthy subjects not only demonstrate the efficiency and robustness of our brain-controlled wheelchair system but also indicate that all the four subjects could control the wheelchair spontaneously and efficiently without any other assistance (e.g., an automatic navigation system).
Similar content being viewed by others
References
Allison B, Brunner C, Kaiser V, Müller-Putz G, Neuper C, Pfurtscheller G (2010) Toward a hybrid brain-computer interface based on imagined movement and visual attention. J Neural Eng 7(2):1–9
Bin G, Gao X, Yan Z, Hong B, Gao S (2009) An online multi-channel ssvep-based brain-computer interface using a canonical correlation analysis method. J Neural Eng 6:1–6
Birbaumer N (1999) Slow cortical potentials: plasticity, operant control, and behavioral effects. Neuroscientist 5(2):74–78
Blanchard G, Blankertz B (2004) BCI competition 2003-data set IIa: spatial patterns of self-controlled brain rhythm modulations. IEEE Trans Biomed Eng 51(6):1062–1066
Bromberg MB (2008) Quality of life in amyotrophic lateral sclerosis. Phys Med Rehabil Clin N Am 19(3):591–605
Borghetti D, Bruni A, Fabbrini M, Murri L, Sartucci F (2007) A low-cost interface for control of computer functions by means of eye movements. Comput Biol Med 37(12):1765–1770
Dornhege G, Blankertz B, Curio G, Müller KR (2004) Boosting bit rates in noninvasive EEG single-trial classifications by feature combination and multiclass paradigms. IEEE Trans Biomed Eng 51(6):993–1002
Hardoon D, Szedmak S, Shawe-Taylor J (2004) Canonical correlation analysis: an overview with application to learning methods. Neural Comput 16(12):2639–2664
Huang D, Qian K, Fei D-Y, Jia W, Chen X, Bai O (2012) Electroencephalography (eeg)-based brain-computer interface (bci): a 2-d virtual wheelchair control based on event-related desynchronization/synchronization and state control. IEEE Trans Neural Syst Rehabil Eng 20(3):379–388
Iturrate I, Antelis JM, Kubler A, Minguez J (2009) A noninvasive brain-actuated wheelchair based on a p300 neurophysiological protocol and automated navigation. IEEE Trans Robot 25(3):614–627
Kim Y, Doh N, Youm Y, Chung WK (2001) Development of human-mobile communication system using electrooculogram signals. In: Intelligent robots and systems, 2001. Proceedings of 2001 IEEE/RSJ international conference on, vol 4. IEEE, pp. 2160–2165
Li Y, Long J, Yu T, Yu Z, Wang C, Zhang H, Guan C (2010) An EEG-based BCI system for 2-D cursor control by combining Mu/Beta rhythm and P300 potential. IEEE Trans Biomed Eng 57(10):2495–2505
Li Y, Guan C (2008) Joint feature re-extraction and classification using an iterative semi-supervised support vector machine algorithm. Mach Learn 71(1):33–53
Li Y, Pan J, Wang F, Yu Z (2013) A hybrid bci system combining p300 and ssvep and its application to wheelchair control. IEEE Trans Biomed Eng 60(11):3156–3166
Long J, Li Y, Wang H, Yu T, Pan J, Li F (2012) A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair. IEEE Trans Neural Syst Rehabil Eng 20(4):720–729
Lv Z, Wu X, Li M, Zhang C (2008) Implementation of the eog-based human computer interface system. In: Bioinformatics and biomedical engineering, 2008. ICBBE 2008. The 2nd international conference on. IEEE, pp. 2188–2191
Millán J, Galán F, Vanhooydonck D, Lew E, Philips J, Nuttin M (2009) Asynchronous non-invasive brain-actuated control of an intelligent wheelchair. In: Engineering in medicine and biology society, 2009. Annual international conference of the IEEE, pp. 3361–3364
Nakanishi M, Mitsukura Y (2013) Wheelchair control system by using electrooculogram signal processing, In: Frontiers of Computer Vision, (FCV), IEEE joint workshop on 2013 19th Korea-Japan, pp. 137–142
Panicker R, Puthusserypady S, Sun Y (2011) An asynchronous p300 bci with ssvep-based control state detection. IEEE Trans Biomed Eng 99:1781–1788
Pfurtscheller G, Neuper C, Guger C, Harkam W, Ramoser H, Schlogl A, Obermaier B, Pregenzer M (2000) Current trends in Graz brain-computer interface (BCI) research. IEEE Trans Neural Syst Rehabil Eng 8(2):216–219
Pfurtscheller G, Solis-Escalante T, Ortner R, Linortner P, Muller-Putz GR (2010) Self-paced operation of an ssvep-based orthosis with and without an imagery-based brain switch: a feasibility study towards a hybrid bci. IEEE Trans Neural Syst Rehabil Eng 18(4):409–414
Rebsamen B, Guan C, Zhang H, Wang C, Teo C, Ang MH, Burdet E (2010) A brain controlled wheelchair to navigate in familiar environments. IEEE Trans Neural Syst Rehabil Eng 18(6):590–598
Rebsamen B, Burdet E, Guan C, Zhang H, Teo C, Zeng Q, Ang M, Laugier C (2006) A brain-controlled wheelchair based on p300 and path guidance. In Biomedical robotics and biomechatronics, 2006. BioRob 2006. The first IEEE/RAS-EMBS international conference on. IEEE, pp. 1101–1106
Sellers E, Kubler A, Donchin E (2006) Brain-computer interface research at the university of south florida cognitive psychophysiology laboratory: the p300 speller. IEEE Trans Neural Syst Rehabil Eng 14(2):221–224
Usakli AB, Gurkan S, Aloise F, Vecchiato G, Babiloni F (2010) On the use of electrooculogram for efficient human computer interfaces. Computational intelligence and neuroscience Vol. 2010, p. 1
Williams MT, Donnelly JP, Holmlund T, Battaglia M (2008) Als: Family caregiver needs and quality of life. Amyotroph Lateral Scler 9(5):279–286
Acknowledgments
This research is supported by the National High-Tech R and D Program of China (863 Program) under Grant 2012AA011601, National Natural Science Foundation of China under Grant 91120305, University High Level Talent Program of Guangdong, China under Grant N9120140A, Foundation for Distinguished Young Talents in Higher Education of Guangdong, China under Grant LYM11122, Project supported by Jiangmen R and D Program 2012(156) and Science Foundation for Young Teachers of Wuyi University (NO:2013zk08).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Wang, H., Li, Y., Long, J. et al. An asynchronous wheelchair control by hybrid EEG–EOG brain–computer interface. Cogn Neurodyn 8, 399–409 (2014). https://doi.org/10.1007/s11571-014-9296-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11571-014-9296-y