Advertisement

Multimedia Tools and Applications

, Volume 75, Issue 13, pp 7999–8017 | Cite as

Towards an EEG-based brain-computer interface for online robot control

  • Yantao Li
  • Gang Zhou
  • Daniel Graham
  • Andrew Holtzhauer
Article

Abstract

According to New York Times, 5.6 million people in the United States are paralyzed to some degree. Motivated by requirements of these paralyzed patients in controlling assisted-devices that support their mobility, we present a novel EEG-based BCI system, which is composed of an Emotive EPOC neuroheadset, a laptop and a Lego Mindstorms NXT robot in this paper. We provide online learning algorithms that consist of k-means clustering and principal component analysis to classify the signals from the headset into corresponding action commands. Moreover, we also discuss how to integrate the Emotiv EPOC headset into the system, and how to integrate the LEGO robot. Finally, we evaluate the proposed online learning algorithms of our BCI system in terms of precision, recall, and the F-measure, and our results show that the algorithms can accurately classify the subjects’ thoughts into corresponding action commands.

Keywords

EEG BCI system k-means clustering algorithm Principal component analysis 

Notes

Acknowledgments

The work is supported in part by the National Natural Science Foundation of China Grant 61402380, U.S. National Science Foundation Grants CNS-1253506 (CAREER) and CNS-1250180, the Fundamental Research Funds for the Central Universities Grant XDJK2015B030, the State Ethnic Affairs Commission of China Grant 14GZZ012, and the Science and Technology Foundation of Guizhou Grant LH20147386.

References

  1. 1.
    Acampora G, Cook DJ, Rashidi P, Vasilakos AV (2013) A survey on ambient intelligence in healthcare. IEEE Proc. 101:2470–2494CrossRefGoogle Scholar
  2. 2.
    Birbaumer N, Ghanayim N, Hinterberger T, Iversen I, Kotchoubey B, Kuber A, Perelmouter J, Taub E, Flor H (1999) A spelling device for the paralysed. Nature 398:297–298CrossRefGoogle Scholar
  3. 3.
    Birbaumer N, Hinterberger T, Kubler A, Neumann N (2003) The thought-translation device (TTD): neurobehavioral mechanisms and clinical outcome. IEEE Trans Neural Syst Rehabil Eng 111(2):120–123CrossRefGoogle Scholar
  4. 4.
    Blankertz B, Losch F, Krauledat M, Dornhege G, Curio G, KR Muller (2008) The Berlin brain computer interface: accurate performance from first-session in BCI-nave subjects. IEEE Trans Biomed Eng 55(10):2452–2462CrossRefGoogle Scholar
  5. 5.
    Barry RJ, Clarke AR, McCarthy R, Selikowitz M (2002) Evaluation of the effectiveness of EEG neurofeedback training for ADHD in a clinical setting as measured by changes in TOVA scores, behavioral ratings, and WISC-R performance. Appl Psychophysiol Biofeedback 20(1):83–99Google Scholar
  6. 6.
    Barry RJ, Clarke AR, McCarthy R, Selikowitz M (2002) EEG coherence in attention-deficit/hyperactivity disorder: A comparative study of two DSM-IV types. Clin Neurophysiol 113(4):579–85CrossRefGoogle Scholar
  7. 7.
    Buttfield A, Ferrez PW, Millan JR (2006) Towards a robust BCI: Error potentials and online learning. IEEE Trans Neural Syst Rehabil Eng 14(2):164–168CrossRefGoogle Scholar
  8. 8.
    Brain Controlled NXT Robot (2013). http://bci.vourvopoulos.com/
  9. 9.
    Choi K, Cichocki A (2008) Control of a wheelchair by motor imagery in real time. Int Data Eng Autom Learn–IDEAL 5:330–337Google Scholar
  10. 10.
    Chen M, Gonzalez S, Vasilakos A, Cao H S, Leung VCM (2011) Body area networks: a survey. Mob Netw Appl 16:171–193CrossRefGoogle Scholar
  11. 11.
    Cernea D, Olech PS, Ebert A, Kerren A (2011) EEG-based measurement of subjective parameters in evaluations. HCI Int 2011–Posters Extended Abstr Commun Comput Inf Sci 174:279–283CrossRefGoogle Scholar
  12. 12.
    Duvinage M, Castermans T, Dutoit T, Petieau M, Hoellinger T, Saedeleer C, Seetharaman K, Cheron G (2012) A P300-based Quantitative Comparison between the Emotiv Epoc Headset and a Medical EEG Device. Biomedical Engineering/765: Telehealth/766: Assistive TechnologiesGoogle Scholar
  13. 13.
    Develop for EPOC (2013). http://emotiv.com/epoc/develop.php
  14. 14.
    Emotiv EPOC Software Development Kit (2013). http://www.emotiv.com/store/hardware/299/
  15. 15.
  16. 16.
    Friman O, Luth T, Volosyak I, Graser A (2007) Spelling with steady-state visual evoked potentials. In: 3rd international IEEE/EMBS conference on neural engineering. Kohala Coast, pp 354–357Google Scholar
  17. 17.
    Fortino G, Fatta GD, Pathan M, Vasilakos AV (2014) Cloud-assisted body area networks: state-of-the-art and future challenges. Wirel Netw 20:1925–1938CrossRefGoogle Scholar
  18. 18.
    Hill NJ, Lal TN, Hinterberger T, Wilhelm B, Nijboer F, Mochty U, Widman G, Elger C, Scholkopf B, Kubler A, Birbaumer N (2006) Classifying EEG and ECoG signals without subject training for fast BCI implementation: comparison of nonparalyzed and completely paralyzed subjects. IEEE Trans Neural Syst Rehabil Eng 14(2):183–186CrossRefGoogle Scholar
  19. 19.
    Hayajneh T, Almashaqbeh G, Ullah S, Vasilakos AV (2014) A survey of wireless technologies coexistence in WBAN: analysis and open research issues. Wirel Netw 20(8):2165–2199CrossRefGoogle Scholar
  20. 20.
    Kalcher J, Flotzinger D, Neuper C, Gölly S, Pfurtscheller G (1996) Graz brain-computer interface II: towards communication between humans and computers based on online classification of three different EEG patterns. Med Biol Eng Comput 34(5):382–388CrossRefGoogle Scholar
  21. 21.
    Kubler A, Nijboer F, Mellinger J, Vaughan TM, Pawelzik H, Schalk G, Mcfarland DJ, Birbaumer N, Wolpaw JR (2005) Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface. Neurology 64 (10):1175–1177CrossRefGoogle Scholar
  22. 22.
    Leeb R, Lee F, Keinrath C, Scherer R, Bischof H, Pfurtscheller G (2008) Brain-computer communication: motivation, aim, and impact of exploring a virtual apartment. IEEE Trans Neural Syst Rehabil Eng 15(4):473–482CrossRefGoogle Scholar
  23. 23.
    Lablor EC, Kelly SP, Finucane C, Burke R, Smith R, Reilly RB, McDarby G (2005) Steady-state VEP-based brain-computer interface control in an immersive 3D gaming environment. EURASIP J Appl Signal Process 19:3156–3164CrossRefzbMATHGoogle Scholar
  24. 24.
  25. 25.
    Movassaghi S, Abolhasan M, Lipman J, Smith D, Jamalipour A (2014) Wireless body area networks: a survey. IEEE Commun Surveys Tuts 16:1658–1686CrossRefGoogle Scholar
  26. 26.
    Martinez P, Bakardjian H, Cichocki A (2006) Fully online multicommand brain-computer interface with visual neurofeedback using SSVEP paradigm. Comput Intell Neurosci 2007(2007):1–9Google Scholar
  27. 27.
    Muller-Putz GR, Pfurtscheller G (2008) Control of an electrical prosthesis with an SSVEP-based BCI. IEEE Trans Biomed Eng 55(1):361–364CrossRefGoogle Scholar
  28. 28.
    Muller-Putz GR, Scherer R, Brauneis C, Pfurtscheller G (2005) Steady-state visual evoked potential (SSVEP)-based communication: impact of harmonic frequency components. J Neural Eng 2(4):123–130CrossRefGoogle Scholar
  29. 29.
    Martin AR, Sankar T, Lipsman N, Lozano A M (2012) Brain-Machine Interfaces for Motor Control: A Guide for Neuroscience Clinicians. Can J Neurol Sci 39:11–22CrossRefGoogle Scholar
  30. 30.
    Neuper C, Muller-Putz GR, Kubler A, Birbaumer N, Pfurtscheller G (2003) Clinical application of an EEG-based brain-computer interface: a case study in a patient with severe motor impairment. Clin Neurophysiol 114(3):399–409CrossRefGoogle Scholar
  31. 31.
    Nijholt A, Tan D, Pfurtscheller G, Brunner C, Millan JR, Allison BZ, Graimann B, Popescu F, Blankertz B, Muller KR (2008) Brain-computer interface for intelligent systems. IEEE Intell Syst 23(3):72–79CrossRefGoogle Scholar
  32. 32.
    Pfurtscheller G, Neuper C (2001) Motor imagery and direct brain-computer communication. IEEE Proc 89(7):1123–1134CrossRefGoogle Scholar
  33. 33.
    Piccione F, Giorgi F, Tonin P, Priftis K, Giove S, Silvoni S, Palmas G, Beverina F (2006) P300-based brain-computer interface: reliability and performance in healthy and paralysed participants. Clin Neurophysiol 117(3):531–537CrossRefGoogle Scholar
  34. 34.
    Pedrycz W, Vasilakos AV (1999) Linguistic Models and Linguistic Modeling. IEEE Trans Syst, Man, Cybern. B, Cybern 29:745–757CrossRefGoogle Scholar
  35. 35.
    Scherer R, Muller-Putz GR, Neuper C, Graimann B, Pfurtscheller G (2004) An asynchronously controlled EEG-based virtual keyboard: improvement of the spelling rate. IEEE Trans Biomed Eng 51(6):979–984CrossRefGoogle Scholar
  36. 36.
    Sugiarto I, Allison BZ, Graser A (2009) Optimization strategy for SSVEP-based BCI in spelling program application. In: ICCET’08 international conference on computer engineering and technology, pp 223–226Google Scholar
  37. 37.
    Salameh HB, Shu T, Krunz M (2007) Adaptive crosslayer MAC design for improved energy-efficiencey in multi-channel wireless sensor networks. Ad Hoc Net 5:844–854CrossRefGoogle Scholar
  38. 38.
    Trejo LJ, Rosipal R, Matthews B (2006) Brain-computer interfaces for 1-D and 2-D cursor control: designs using volitional control of the EEG spectrum or steady-state visual evoked potentials. IEEE Trans Neural Syst Rehabil Eng 14(2):225–229CrossRefGoogle Scholar
  39. 39.
    Ullah S, Vasilakos AV, Chao HC, Suzuki J (2014) Cloud-assisted wireless body area networks. Inf Sci 284:81–83CrossRefGoogle Scholar
  40. 40.
    Vaughan TM, McFarland DJ, Schalk G, Sarnacki WA, Krusienski DJ, Seller EW, Wolpow JR (2006) The Wadsworth BCI research and development program: at home with BCI. IEEE Trans Neural Syst Rehabil Eng 14(2):229–233CrossRefGoogle Scholar
  41. 41.
    VAROL E (2010) Raw EEG data classification and applications using SVM. Tese de doutorado. Istanbul Technical University. Electrical-electronics Engineering FacultyGoogle Scholar
  42. 42.
    Vourvopoulos A, Liarokapis F (2011) Brain-controlled NXT Robot: Tele-operating a robot through brain electrical activity. 2011 Third International Conference on Games and Virtual Worlds for Serious Applications (VS-GAMES)Google Scholar
  43. 43.
    Yao JT, Vasilakos AV, Pedrycz W (2013) Granular Computing: Perspectives and Challenges. IEEE Tran Cybern 43(6):1977–1989CrossRefGoogle Scholar
  44. 44.
    Zhang ZY, Wang HG, Vasilakos AV, Fang H (2012) ECG-cryptography and authentication in body area networks. IEEE Trans Inf Technol Biomed 16(6):1070–1078CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Yantao Li
    • 1
  • Gang Zhou
    • 2
  • Daniel Graham
    • 2
  • Andrew Holtzhauer
    • 3
  1. 1.College of Computer and Information SciencesSouthwest UniversityChongqingChina
  2. 2.Department of Computer ScienceCollege of William and MaryWilliamsburgUSA
  3. 3.The MITRE CorporationMcLeanUSA

Personalised recommendations