Indoor space target searching based on EEG and EOG for UAV
- 64 Downloads
This paper puts forward a noninvasive electrooculography (EOG) and electroencephalogram (EEG)-based hybrid computer interface (HCI) system to implement the indoor target searching in three-dimensional (3D) space for a low-speed multi-rotor aircraft. The HCI system mainly consists of three subsystems, including the interface switching, decision and semi-autonomous navigation. The interface switching subsystem is accomplished by detecting the eyeblink EOG. The continuous wavelet transform is employed to indentify eyeblink features which are used to switch interfaces between horizontal and vertical motor imagery (MI) tasks. The average accuracy of the eyeblink feature detection reaches to 97.95%. The decision subsystem employs the joint regression (JR) model and spectral powers methods to extract the time and frequency domain features of MI tasks by analyzing the left- and right-hand MI EEG. Simultaneously, the support vector machine is applied to accomplish the MI tasks classification and final decision. The average classification accuracy of the HCI system reaches to 93.99%. The semi-autonomous navigation subsystem extracts the environmental features to avoid obstacles semi-automatically in 3D space and provide feasible directions for the decision subsystem. The actual indoor 3D space target searching experiments are put forward to verify the feasibility and adaptation performances of this proposed HCI system.
KeywordsElectrooculography Electroencephalogram Motor imagery Continuous wavelet transform Joint regression model Spectral powers Support vector machine
Tianwei Shi has been supported by the Department of Education of Liaoning Province (2017FWDF03), Natural Science Foundation of Liaoning Province of China (20180550567) and University of Science and Technology Liaoning Youth Fund (2017QN05). Wenhua Cui has been supported by the Department of Education of Liaoning Province (2016HZZD05).
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
Human and animal rights
This article contains the calibration experiments and actual indoor 3D space target searching experiments with human participants performed by the authors. Five males and five females participated in the experiments. This study was approved by the Human Research Protections Program of University of Science and Technology Liaoning and Northeastern University. Simultaneously, it was performed in accordance with the Declaration of Helsinki. All participants were asked to read and sign an informed consent form before participating in the study.
- Blankertz B, Mller KR, Curio G, Vaughan TM, Schalk G, Wolpaw JR, Schloegl A, Neuper C, Pfurtscheller G, Hinterberger T, Schroeder M, Birbaumer N (2004) The BCI competition 2003: progress and perspectives in detection and discrimination of EEG single trials. IEEE Trans Biomed Eng 51(6):1044–1051CrossRefGoogle Scholar
- Gandolfi M, Formaggio E, Geroin C, Storti SF, Galazzo IB, Bortolami M, Saltuari L, Picelli A, Waldner A, Manganotti P, Smania N (2018) Quantification of upper limb motor recovery and eeg power changes after robot-assisted bilateral arm training in chronic stroke patients: a prospective pilot study. Neural Plast 1:1–15CrossRefGoogle Scholar
- Ghayab HA, Li Y, Siuly S, Abdulla S (2018) Epileptic EEG signal classification using optimum allocation based power spectral density estimation. IET Signal Proc 12(6):1–13 Google Scholar
- Huang Q, He S, Wang Q, Gu Z, Peng N, Kai L, Zhang Y, Shao M, Li Y (2017) An eog-based human–machine interface for wheelchair control. IEEE Trans Biomed Eng 99:1Google Scholar
- Jung TP, Humphries C, Lee TW, Makeig S, McKeown MJ, Iragui V, Sejnowski TJ (1998) Extended ICA removes artifacts from electroencephalographic recordings. Adv Neural Inf Process Syst 10:894–900Google Scholar
- Wu W, Gao X, Hong B, Gao S (2008) Classifying single-trial EEG during motor imagery by iterative spatio-spectral patterns learning (ISSPL). IEEE Trans Biomed Eng 55(6):1733–1743Google Scholar
- Xu B, Song A, Wu J (2007) Algorithm of imagined left-right hand movement classification based on wavelet transform and AR parameter model. In: 1st international conference on bioinformatics and biomedical engineering, pp 539–542Google Scholar