Wheelchair Control Based on Multimodal Brain-Computer Interfaces

  • Jie Li
  • Hongfei Ji
  • Lei Cao
  • Rong Gu
  • Bin Xia
  • Yanbing Huang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8226)


Electroencephalogram (EEG) based brain-computer interfaces (BCIs) for wheelchair control have great value for those with devastating neuromuscular disorders. Although there have been many attempts to implement EEG-based wheelchair control systems by P300, steady state visual evoked potential (SSVEP), and motor imagery (MI) related event-related desynchronization/synchronization (ERD/ERS), the number of simultaneous control commands in those BCI systems is strictly limited, and those BCI control do not work for a non-negligible portion of users due to the problem of BCI Illiteracy.

In this paper, we develop a multimodal BCI based wheelchair control system, the user could employ subject-optimized mental strategies to produce multiple commands to control the wheelchair, which include ERD/ERS, SSVEP, and simultaneous ERD/ERS and SSVEP. It could not only help address ”BCI illiteracy”, but also provide simultaneous control commands for complex control. Experiment results demonstrate the proposed system is effective and flexible in practical application.


BCI wheelchair control multimodal BCI Illiteracy 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Blankertz, B., Curio, G., Muller, K.R.: Classifying single trial EEG: Towards brain computer interfacing. Advances in Neural Information Processing Systems 1, 157–164 (2002)Google Scholar
  2. 2.
    Leeb, R., Friedman, D., Mller-Putz, G.R., Scherer, R., Slater, M., Pfurtscheller, G.: Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: a case study with a tetraplegic. Computational Intelligence and Neuroscience (2007)Google Scholar
  3. 3.
    Tsui, C.S.L., Gan, J.Q., Hu, H.: A self-paced motor imagery based brain-computer interface for robotic wheelchair control. Clinical EEG and Neuroscience 42(4), 225–229 (2011)CrossRefGoogle Scholar
  4. 4.
    Li, J., Liang, J., Zhao, Q., Li, J., Hong, K., Zhang, L.: Design of assistive wheelchair system directly steered by human thoughts. International Journal of Neural Systems 23(3) (2013)Google Scholar
  5. 5.
    Iturrate, I., Antelis, J.M., Kubler, A., Minguez, J.: A noninvasive brain-actuated wheelchair based on a P300 neurophysiological protocol and automated navigation. IEEE Transactions on Robotics 25(3), 614–627 (2009)CrossRefGoogle Scholar
  6. 6.
    Rebsamen, B., Guan, C., Zhang, H., Wang, C., Teo, C., Ang, M.H., Burdet, E.: A brain controlled wheelchair to navigate in familiar environments. IEEE Transactions on Neural Systems and Rehabilitation Engineering 18(6), 590–598 (2010)CrossRefGoogle Scholar
  7. 7.
    Mandel, C., Luth, T., Laue, T., Rofer, T., Graser, A., Krieg-Bruckner, B.: Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2009, pp. 1118–1125. IEEE (October 2009)Google Scholar
  8. 8.
    Blankertz, B., Vidaurre, C.: Towards a cure for BCI illiteracy: machine learning based co-adaptive learning. BMC Neuroscience 10(suppl. 1), 85 (2009)CrossRefGoogle Scholar
  9. 9.
    Vidaurre, C., Blankertz, B.: Towards a cure for BCI illiteracy. Brain Topography 23(2), 194–198 (2010)CrossRefGoogle Scholar
  10. 10.
    Tan, D.S., Nijholt, A.: Brain-Computer Interfaces: applying our minds to human-computer interaction. Springer (2010)Google Scholar
  11. 11.
    Blankertz, B., Sanelli, C., Halder, S., Hammer, E.M., Kübler, A., Müller, K.R., Dickhaus, T.: Predicting BCI performance to study BCI illiteracy (2009)Google Scholar
  12. 12.
    Ramoser, H., Muller-Gerking, J., Pfurtscheller, G.: Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Transactions on Rehabilitation Engineering 8(4), 441–446 (2000)CrossRefGoogle Scholar
  13. 13.
    Lin, Z., Zhang, C., Wu, W., Gao, X.: Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs. IEEE Transactions on Biomedical Engineering 53(12), 2610–2614 (2006)CrossRefGoogle Scholar
  14. 14.
    Chang, C.C., Lin, C.J.: LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology (TIST) 2(3), 27 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Jie Li
    • 1
  • Hongfei Ji
    • 1
  • Lei Cao
    • 1
  • Rong Gu
    • 2
  • Bin Xia
    • 3
  • Yanbing Huang
    • 3
  1. 1.Department of Computer Science and TechnologyTong Ji UniversityShanghaiChina
  2. 2.Department of Electronic Science and TechnologyTong Ji UniversityShanghaiChina
  3. 3.Institute of Information EngineeringShanghai Maritime UniversityShanghaiChina

Personalised recommendations