Advertisement

Robot Navigation Using a Brain Computer Interface Based on Motor Imagery

  • Majid Aljalal
  • Ridha Djemal
  • Sutrisno Ibrahim
Original Article
  • 28 Downloads

Abstract

An interface between a human brain and a computer (or any external device) can be implemented for interchanging orders using a brain–computer interface (BCI) system. Motor imagery (MI), which represents human intention to execute actions or movements, can be captured and analyzed using brain signals such as electroencephalograms (EEGs). The present study focuses on a synchronous control system with a BCI based on MI for robot navigation. We employ a new feature extraction technique using common spatial pattern (CSP) filtering combined with band power to form feature vectors. Linear discriminant analysis (LDA) is employed to classify two types of MI tasks (right hand and left hand). In addition, we have developed posture-dependent control architecture that translates the obtained MI into four robot motion commands: going forward, turning left, turning right, and stopping. The EEGs of eight healthy volunteer male subjects were recorded and employed to navigate a simulated robot to a goal in a virtual environment. On a predefined task, the developed BCI robot control system achieved its task in170 s with a collision number of 0.65, distance of 23.92 m, and successful command rate of 80%. Although the performance of the complete system varied from one subject to another, the robot always reached its final position successfully. The developed BCI robot control system yields promising results compared to manual controls.

Keywords

Brain computer interface (BCI) Common spatial pattern (CSP) Electroencephalogram (EEG) Motor imagery Robot navigation 

Notes

Acknowledgement

The authors acknowledge the College of Engineering Research Center and Deanship of Scientific Research at King Saud University in Riyadh, Saudi Arabia, for the financial support to carry out the research work reported in this paper.

References

  1. 1.
    Shih, J. J., Krusienski, D. J., & Wolpaw, J. R. (2012). Brain-computer interfaces in medicine. Mayo Clinic Proceedings, 87(3), 268–279.CrossRefGoogle Scholar
  2. 2.
    Anderson, R. A., Musallam, S., & Pesaran, B. (2004). Selecting the signals for a brain-machine interface. Current Opinion in Neurobiology, l4(6), 720–726.Google Scholar
  3. 3.
    Sanei, S., & Chambers, J. (2007). EEG signal processing. England: John Wiley & Sons.CrossRefGoogle Scholar
  4. 4.
    Alonso, N., Fernando, L., & Gomez-Gil, J. (2012). Brain computer interfaces, a review. Sensors, 12(2), 1211–1279.CrossRefGoogle Scholar
  5. 5.
    Dasgupta, S., Fanton, M., Pham, J., Willard, M., Nezamfar, H., Shafai, B., & Erdogmus, D. (2010). Brain controlled robotic platform using steady state visual evoked potentials acquired by EEG. Proceedings of. 2010 Conference Record Forty Fourth Asilomar Conference Signals, System Computers, California, USA (pp. 1371–1374).Google Scholar
  6. 6.
    Ortner, R., Guger, C., Prueckl, R., Grünbacher, E., & Edlinger, G. (2010). SSVEP-based brain-computer interface for robot control. Proceedings of 12th International Conference Computers Helping People with Special Needs, Vienna, Austria (pp. 85–90).Google Scholar
  7. 7.
    Pires, G., Castelo-Branco, M., & Nunes, U. (2008). Visual P300-based BCI to steer a wheelchair: A Bayesian approach. Proceedings of IEEE Engineering Medicine Biol Soc, British Columbia, Canada (pp. 658–661).Google Scholar
  8. 8.
    Choi, K., & Cichocki, A. (2008). Control of a wheelchair by motor imagery in real time. Proc. 9th Int Conf Intell Data Eng Autom Learning, (pp. 330–337).Google Scholar
  9. 9.
    Choi, K. (2011). Control of a vehicle with EEG signals in real-time and system evaluation. European Journal of Applied Physiology, 112(2), 755–766.CrossRefGoogle Scholar
  10. 10.
    Shedeed, H. A., Issa, M. F., & El-sayed, S. M. (2013). Brain EEG signal processing for controlling a robotic arm. 8th International Conference on Computer Engineering & Systems (ICCES), (pp. 152–157).Google Scholar
  11. 11.
    Müller-Putz, G. R., & Pfurtscheller, G. (2008). Control of an electrical prosthesis with an SSVEP-based BCI. IEEE Transactions on Biomedical Engineering, 55(1), 361–364.CrossRefGoogle Scholar
  12. 12.
    Pfurtscheller, G., Solis-Escalante, T., Ortner, R., Linortner, P., & Muller-Putz, G. R. (2010). Self-paced operation of an SSVEP-based orthosis with and without an imagery-based “brain switch:” a feasibility study towards a hybrid BCI. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 18(4), 409–414.CrossRefGoogle Scholar
  13. 13.
    Song, W., Wang, X., Zheng, S., & Lin, Y. (2014). Mobile robot control by BCI based on motor imagery. Sixth International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), 2(26–27), 383–387.Google Scholar
  14. 14.
    Barbosa, A. O. G., Achanccaray, D. R., & Meggiolaro, M. A. (2010). Activation of a mobile robot through a brain computer interface. Proc Conf Rec 2010 IEEE Int Conf Robot Autom, (pp. 4815–4821).Google Scholar
  15. 15.
    Varona-Moya, S., Velasco-Álvarez, F., Sancha-Ros, S., Fernández-Rodríguez, Á., Blanca, M. J., & Ron-Angevin R. (2015). Wheelchair navigation with an audio-cued, two-class motor imagery-based brain-computer interface system. 7th International IEEE/EMBS Conference on Neural Engineering (NER), (pp. 174–177).Google Scholar
  16. 16.
    Fan, X. A., Bi, L., Teng, T., Ding, H., & Liu, Y. (2015). A brain–computer interface-based vehicle destination selection system using P300 and SSVEP Signals. IEEE Transactions on Intelligent Transportation Systems, 16(1), 274–283.CrossRefGoogle Scholar
  17. 17.
    Leeb, R., Friedman, D., Muller-Putz, G., Scherer, R., Slater, M., & Pfurtscheller, G. (2007). Self-paced (asynchronous) BCI control of a wheelchair in virtual environments: a case study with a tetraplegic. Computational Intelligence and Neuroscience, 2007, 1–7.CrossRefGoogle Scholar
  18. 18.
    Tsui, C. S. L., & Gan, J. Q. (2007). Asynchronous BCI control of a robot simulator with supervised online training. Proceedings of 8th International Conference Intellignet Data Engineering Automated Learn, (pp. 125–134).Google Scholar
  19. 19.
    Tsui, C. S. L., Gan, J. Q., & Roberts, S. J. (2009). A self-paced brain–computer interface for controlling a robot simulator: An online event labelling paradigm and an extended Kalman filter based algorithm for online training. Medical & biological engineering & computing, 47(3), 257–265.CrossRefGoogle Scholar
  20. 20.
    G.tec (2016) Advanced biosignal acquisition, processing and analysis. Product catalogue, g.tec.Google Scholar
  21. 21.
    Jasper, H. H., & Andrews, H. L. (1938). Electro-encephalography. III. Normal differentiation of occipital and precentral regions in man. Archives of Neurology & Psychiatry, 39, 95–115.Google Scholar
  22. 22.
    Djemal, R., Bazyed, A., Belwafi, K., Gannouni, S., & Kaaniche, W. (2016). Three-class EEG-based motor imagery classification using phase-space reconstruction technique. Brain Sciences, 2016(6), 36.CrossRefGoogle Scholar
  23. 23.
    Perrin, X., Chavarriaga, R., Colas, F., Siegwart, R., & Millán, J. D. R. (2010). Brain-coupled interaction for semi-autonomous navigation of an assistive robot. Robotics Autonomous Systems, 58(12), 1246–1255.CrossRefGoogle Scholar
  24. 24.
    Blankertz, B., Tomioka, R., Lemm, S., Kawanabe, M., & Müller, K. R. (2008). Optimizing spatial filters for robust EEG single-trial analysis. IEEE Signal Processing Magazine, 25(1), 41–56.CrossRefGoogle Scholar
  25. 25.
    Ramoser, H., Muller-Gerking, J., & Pfurtscheller, G. (2000). Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Transactions on Rehabilitation Engineering, 8(4), 441–446.CrossRefGoogle Scholar
  26. 26.
    Townsend, G., Graimann, B., & Pfurtscheller, G. (2006). A comparison of common spatial patterns with complex band power features in a four-class BCI experiment. IEEE Transactions on Biomedical Engineering, 53(4), 642–651.CrossRefGoogle Scholar
  27. 27.
    Mason, S. G., Bashashati, A., Fatourechi, M., Navarro, K. F., & Birch, G. E. (2007). A Comprehensive Survey of Brain Interface Technology Designs. Annals of Biomedical Engineering, 35(2), 137–169.CrossRefGoogle Scholar
  28. 28.
    Brodu, N., Lotte, F., Lécuyer, A. (2011). Comparative study of band-power extraction techniques for Motor Imagery classification. 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB), Paris (pp. 1–6).Google Scholar
  29. 29.
    Duda, R. O., Hart, P. E., & Stork, D. G. (2001). Pattern classification. England: John Wiley & Sons.MATHGoogle Scholar
  30. 30.
    Refaeilzadeh, P., Tang, L., Liu, H. (2009). Cross-validation. Encyclopedia of database system. Berlin, Germany: Springer.Google Scholar

Copyright information

© Taiwanese Society of Biomedical Engineering 2018

Authors and Affiliations

  1. 1.Department of Electrical Engineering, College of EngineeringKing Saud University, Saudi ArabiaRiyadhSaudi Arabia

Personalised recommendations