Abstract
This paper presents a hybrid electroencephalography (EEG)-based brain-computer interface system combined with head motion sensing for smart home control to assist the elderly and disabled. The system mainly includes an EMOTIV Insight headset used to extract the user’s EEG data and head motion, an Android application, and an Arduino Uno that controls the appliances. The Android application is wirelessly connected via Bluetooth to the headset and the Arduino Uno through an HC-06 module. The application uses the blink, attention level, and head motion data to allow the user to turn on and off the desired appliance. Various analyses are performed to evaluate the effect of attention and blink on the extracted brain wave signals. In addition, the accelerometer’s data was used to detect the head motion and control the application in combination with the EEG data. Double blink detection achieved an accuracy of 90% whereas the active attention level detection achieved a 75% accuracy. A 100% accuracy was achieved when detecting upward and downward motion whereas an 85% accuracy was achieved for the left and right motions. Finally, as a proof of concept, the developed system was successfully used to control four different home appliances. The successful outcomes of the proposed system demonstrate that it can be easily implemented into home automation to assist disabled and elderly people due to its ease of use, portability, low cost, and expandable circuitry.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Data availability
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Adams M, Ben-Salem S, Islam Z et al (2019) Towards an SSVEP-BCI controlled smart home. In: 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC). IEEE, pp 2737–2742. https://doi.org/10.1109/SMC.2019.8914668
Agarwal M, Sivakumar R (2019) Blink: a fully automated unsupervised algorithm for eye-blink detection in EEG signals. In: 2019 57th Annual Allerton Conference on Communication, Control, and Computing, Allerton 2019. Institute of Electrical and Electronics Engineers Inc., pp 1113–1121. https://doi.org/10.1109/ALLERTON.2019.8919795
Almajidy RK, Le KS, Hofmann UG (2016) Novel near infrared sensors for hybrid BCI applications. In: Advanced Microscopy Techniques IV; and Neurophotonics II (2015), paper 95361H. The Optical Society, p 95361H. https://doi.org/10.1364/ecbo.2015.95361h
al-Qerem A, Kharbat F, Nashwan S et al (2020) General model for best feature extraction of EEG using discrete wavelet transform wavelet family and differential evolution. Int J Distrib Sens Netw 16:1550147720911009. https://doi.org/10.1177/1550147720911009
Alshebly YS, Nafea M (2019) Isolation of fetal ECG signals from abdominal ECG using wavelet analysis. IRBM. https://doi.org/10.1016/j.irbm.2019.12.002
Amiribesheli M, Benmansour A, Bouchachia A (2015) A review of smart homes in healthcare. J Ambient Intell Humaniz Comput 6:495–517. https://doi.org/10.1007/s12652-015-0270-2
Azeta J, Bolu C, Hinvi D, Abioye AA (2019) Obstacle detection using ultrasonic sensor for a mobile robot. In: IOP Conference Series: Materials Science and Engineering. IOP Publishing Ltd, p 012012. https://doi.org/10.1088/1757-899X/707/1/012012
Berger H (1929) Über das Elektrenkephalogramm des Menschen. Arch Psychiatr Nervenkr 87:527–570. https://doi.org/10.1007/BF01797193
Blondet MVR, Badarinath A, Khanna C, Jin Z (2013) A wearable real-time BCI system based on mobile cloud computing. In: International IEEE/EMBS Conference on Neural Engineering, NER. pp 739–742. https://doi.org/10.1109/NER.2013.6696040
Carroll A (2012) World report on disability. In: Ir. Med. J. https://www.who.int/publications/i/item/9789241564182. Accessed 15 Jul 2021
Chai X, Zhang Z, Guan K et al (2020) A hybrid BCI-controlled smart home system combining SSVEP and EMG for individuals with paralysis. Biomed Signal Process Control 56:101687. https://doi.org/10.1016/j.bspc.2019.101687
Chhabra K, Mathur P, Baths V (2020) BCI controlled quadcopter using SVM and recursive LSE implemented on ROS. In: IEEE Transactions on Systems, Man, and Cybernetics: Systems. Institute of Electrical and Electronics Engineers Inc., pp 4250–4255. https://doi.org/10.1109/SMC42975.2020.9282898
Craik A, He Y, Contreras-Vidal JL (2019) Deep learning for electroencephalogram (EEG) classification tasks: a review. J Neural Eng 16:31001. https://doi.org/10.1088/1741-2552/ab0ab5
Demos JN (2005) Getting started with neurofeedback, 1st edn. WW Norton & Company, New York
Dhole SR, Kashyap A, Dangwal AN, Mohan R (2019) A novel helmet design and implementation for drowsiness and fall detection of workers on-site using EEG and random-forest classifier. Procedia Comput Sci 151:947–952. https://doi.org/10.1016/j.procs.2019.04.132
Djamal EC, Pangestu DP, Dewi DA (2017) EEG-based recognition of attention state using wavelet and support vector machine. In: Proceeding—2016 International Seminar on Intelligent Technology and Its Application, ISITIA 2016: Recent Trends in Intelligent Computational Technologies for Sustainable Energy. Institute of Electrical and Electronics Engineers Inc., pp 139–144. https://doi.org/10.1109/ISITIA.2016.7828648
Ericson K, Pallickara S, Anderson CW (2010) Analyzing electroencephalograms using cloud computing techniques. In: Proceedings—2nd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2010. IEEE, pp 185–192. https://doi.org/10.1109/CloudCom.2010.80
Ghazal B, Al-Khatib K (2015) Smart home automation system for elderly, and handicapped people using XBee. Int J Smart Home 9:203–210. https://doi.org/10.14257/ijsh.2015.9.4.21
Hairston WD, Whitaker KW, Ries AJ et al (2014) Usability of four commercially-oriented EEG systems. J Neural Eng 11:46018. https://doi.org/10.1088/1741-2560/11/4/046018
Haufe S, DeGuzman P, Henin S et al (2018) Elucidating relations between fMRI, ECoG, and EEG through a common natural stimulus. Neuroimage 179:79–91. https://doi.org/10.1016/j.neuroimage.2018.06.016
Hong KS, Khan MJ (2017) Hybrid brain-computer interface techniques for improved classification accuracy and increased number of commands: a review. Front Neurorobot 11:35
Hooda N, Das R, Kumar N (2020) Fusion of EEG and EMG signals for classification of unilateral foot movements. Biomed Signal Process Control 60:101990. https://doi.org/10.1016/j.bspc.2020.101990
Hossain T, Rakshit A, Konar A (2020) Brain-computer interface based user authentication system for personal device security. In: 2020 International Conference on Computer, Electrical and Communication Engineering, ICCECE 2020. Institute of Electrical and Electronics Engineers Inc.https://doi.org/10.1109/ICCECE48148.2020.9223069
Jafri SRA, Hamid T, Mahmood R et al (2019) Wireless brain computer interface for smart home and medical system. Wirel Pers Commun 106:2163–2177. https://doi.org/10.1007/s11277-018-5932-x
Jalaly Bidgoly A, Jalaly Bidgoly H, Arezoumand Z (2020) A survey on methods and challenges in EEG based authentication. Comput Secur 93:101788. https://doi.org/10.1016/j.cose.2020.101788
Kasammongkonchai N, Pan-Ngum S (2020) Smart hub based on brain computer interface by low cost devices. In: International Conference on ICT and Knowledge Engineering. IEEE Computer Society https://doi.org/10.1109/ICTKE50349.2020.9289913
Nafea M, Nawabjan A, Mohamed Ali MS (2018b) A wirelessly-controlled piezoelectric microvalve for regulated drug delivery. Sens Actuat A Phys 279:191–203. https://doi.org/10.1016/j.sna.2018.06.020
Nafea M, Hisham AB, Abdul-Kadir NA, Che Harun FK (2018a) Brainwave-controlled system for smart home applications. In: 2018a 2nd International Conference on BioSignal Analysis, Processing and Systems (ICBAPS). IEEE, pp 75–80. https://doi.org/10.1109/ICBAPS.2018.8527397
Nasir TB, Lalin MAM, Niaz K, et al (2021) EEG based human assistance rover for domestic application. In: ICREST 2021—2nd International Conference on Robotics, Electrical and Signal Processing Techniques. Institute of Electrical and Electronics Engineers Inc., pp 461–466. https://doi.org/10.1109/ICREST51555.2021.9331224
Parbez RMS, Mamun KA (2020) BlinkFruity: a real-time EEG based neurofeedback game for brain-computer interface. In: 2020 2nd International Conference on Advanced Information and Communication Technology, ICAICT 2020. Institute of Electrical and Electronics Engineers (IEEE), pp 404–409. https://doi.org/10.1109/ICAICT51780.2020.9333469
Park S, Cha HS, Im CH (2019) Development of an online home appliance control system using augmented reality and an SSVEP-based brain-computer interface. IEEE Access 7:163604–163614. https://doi.org/10.1109/ACCESS.2019.2952613
Roy PP, Kumar P, Chang V (2020) A hybrid classifier combination for home automation using EEG signals. Neural Comput Appl 32:16135–16147. https://doi.org/10.1007/s00521-020-04804-y
Shao L, Zhang L, Belkacem AN et al (2020) EEG-controlled wall-crawling cleaning robot using SSVEP-based brain-computer interface. J Healthc Eng 2020:6968713. https://doi.org/10.1155/2020/6968713
Thomas J, Maszczyk T, Sinha N, et al (2017) Deep learning-based classification for brain-computer interfaces. In: 2017 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2017. Institute of Electrical and Electronics Engineers Inc., pp 234–239. https://doi.org/10.1109/SMC.2017.8122608
Tiwari N, Edla DR, Dodia S, Bablani A (2018) Brain computer interface: a comprehensive survey. Biol Inspired Cogn Archit 26:118–129
Tsiouris KM, Konitsiotis S, Koutsouris DD, Fotiadis DI (2019) Unsupervised seizure detection based on rhythmical activity and spike detection in EEG signals. In: 2019 IEEE EMBS International Conference on Biomedical and Health Informatics, BHI 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc.https://doi.org/10.1109/BHI.2019.8834644
Vishwakarma R, Khwaja H, Samant V et al (2020) EEG signals analysis and classification for BCI systems: a review. In: International Conference on Emerging Trends in Information Technology and Engineering, ic-ETITE 2020. Institute of Electrical and Electronics Engineers Inc.https://doi.org/10.1109/ic-ETITE47903.2020.066
Yao L, Shoaran M (2019) Enhanced classification of individual finger movements with ECoG. In: Conference Record - Asilomar Conference on Signals, Systems and Computers. IEEE Computer Society, pp 2063–2066. https://doi.org/10.1109/IEEECONF44664.2019.9048649
Zhang X, Yao L, Wang X et al (2021) A survey on deep learning-based non-invasive brain signals: recent advances and new frontiers. J Neural Eng. https://doi.org/10.1088/1741-2552/abc902
Zhang H, Dong E, Zhu L (2020) Brain-controlled wheelchair system based on SSVEP. In: Proceedings—2020 Chinese Automation Congress, CAC 2020. Institute of Electrical and Electronics Engineers (IEEE), pp 2108–2112. https://doi.org/10.1109/CAC51589.2020.9327651
Zhao W, Zhang X, Qu J, et al (2019) A virtual smart home based on EEG control. In: ICEIEC 2019 - Proceedings of 2019 IEEE 9th International Conference on Electronics Information and Emergency Communication. Institute of Electrical and Electronics Engineers Inc., pp 85–89. https://doi.org/10.1109/ICEIEC.2019.8784485
Funding
No funding was received to assist with the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
MDJA: conceptualization, formal analysis, investigation, methodology, visualization, writing—original draft. MN: conceptualization, formal analysis, investigation, methodology, project administration, supervision, validation, visualization, writing—review and editing. HN: investigation, methodology, validation, writing—review and editing.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
This study was approved by the Science & Engineering Research Ethics Committee (SEREC), University of Nottingham Malaysia (application identification number: MD24920).
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Jayakody Arachchige, M.D., Nafea, M. & Nugroho, H. A hybrid EEG and head motion system for smart home control for disabled people. J Ambient Intell Human Comput 14, 4023–4038 (2023). https://doi.org/10.1007/s12652-022-04469-6
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12652-022-04469-6