Abstract
The Brain Computer Interface (BCI) of the near future must be suitable for widespread use in real-world environments. As such, it will be robust, portable, user friendly and discreet—and ideally wearable. In addition, for ‘affective’ functionality, standard electroencephalogram (EEG) based BCI needs to be augmented with sensors for other physiological modalities. Our generic ‘Hearables’ earpiece, equipped with miniature multimodal sensors, provides such a multimodal solution for reliable measurement of both neural activity and vital signs. Real-world viability is demonstrated through single-channel, multimodal digital noise removal in the EEG, standard BCI responses and more than 100 h of out-of-clinic sleep analysis. The benefits of collocated, multimodal sensing of the neural function and vital signs within our Hearables are demonstrated to extend beyond the enhancement of current BCIs, and into BCI-enabled eHealth. Finally, the advantages of our device are validated in an ‘affective’ BCI setting—where both the mental and physical state of the user is integrated through simultaneous monitoring of brain and vital functions.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Y. Alqurashi et al., The efficacy of a novel in-ear electroencephalography (EEG) sensor to measure overnight sleep in healthy participants. Am. J. Respir. Crit. Care Med., 199 (2019)
B. Blankertz et al., The Berlin brain-computer interface: non-medical uses of BCI technology. Front. Neurosci. 4, 198 (2010)
M.G. Bleichner, S. Debener, Concealed, unobtrusive ear-centered eeg acquisition: cEEGrids for transparent EEG. Front. Hum. Neurosci. 11, 163 (2017)
A.J. Casson, Wearable EEG and beyond. Biomed. Eng. Lett. 9(1), 53–71 (2019)
C.B. Christensen et al., Ear-EEG-based objective hearing threshold estimation evaluated on normal hearing subjects. IEEE Trans. Biomed. Eng. 65(5), 1026–1034 (2018a)
C.B. Christensen et al., Toward EEG-assisted hearing aids: objective threshold estimation based on ear-EEG in subjects with sensorineural hearing loss. Trends Hear. 22, 2331216518816203 (2018b)
EEG—ECG—Biosensors. Available: Neurosky.com/
P.T. Gibbs, L.B. Wood, H.H. Asada, Active motion artifact cancellation for wearable health monitoring sensors using collocated MEMS accelerometers. Smart Struct. Mater. 2005: Sens.S Smart Struct. Technol. Civ., Mech., Aerosp., Pts 1 and 2 5765, 811–819 (2005)
V. Goverdovsky et al., Co-located multimodal sensing: a next generation solution for wearable health. IEEE Sens. J. 15(1), 138–145 (2015)
V. Goverdovsky et al., In-ear EEG from viscoelastic generic earpieces: robust and unobtrusive 24/7 monitoring. IEEE Sens. J. 16(1), 271–277 (2016)
V. Goverdovsky et al., Hearables: multimodal physiological in-ear sensing. Sci. Rep. 7, 6948 (2017)
B. Ko et al., Motion artifact reduction in electrocardiogram using adaptive filtering based on half cell potential monitoring. 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) (2012), pp. 1590–1593
Y. Liu, O. Sourina, M.K. Nguyen, Real-time EEG-based human emotion recognition and visualization. (2010)
D. Looney, D. Mandic, Ear-EEG: user-centered and wearable BCI, in Brain-Computer Interface Research (Springer, 2014)
D. Looney et al., The in-the-ear recording concept user-centered and wearable brain monitoring. IEEE Pulse 3(6), 32–42 (2012)
D. Looney et al., Wearable in-ear encephalography sensor for monitoring sleep preliminary observations from nap studies. Ann. Am. Thorac. Soc. 13(12), 2229–2233 (2016)
K.B. Mikkelsen et al., Accurate whole-night sleep monitoring with dry-contact ear-EEG. Scientific Reports 9, 16824 (2019a)
K.B. Mikkelsen et al., Machine-learning-derived sleep-wake staging from around-the-ear electroencephalogram outperforms manual scoring and actigraphy. J. Sleep Res. 28(2), UNSP e12786 (2019b)
C. Muhl et al., Affective brain-computer interfaces (aBCI 2011). Affect. Comput. Intell. Interact., Pt Ii 6975, 435 (2011)
T. Nakamura, V. Goverdovsky, D.P. Mandic, In-ear EEG biometrics for feasible and readily collectable real-world person authentication. IEEE Trans. Inf. Forensics Secur. 13(3), 648–661 (2018)
T. Nakamura et al., Hearables: automatic overnight sleep monitoring with standardized in-ear EEG sensor. IEEE Trans. Biomed. Eng. 67(1), 203–212 (2020)
A. Pantelopoulos, N.G. Bourbakis, A survey on wearable sensor-based systems for health monitoring and prognosis. IEEE Trans. Syst. Man Cybern. Part C—Appl. Rev. 40(1), 1–12 (2010)
R.W. Picard, Affective Computing (MIT Press, 2000)
B. Schuller, Can affective computing save lives? Meet mobile health. Computer 50(5), 13 (2017)
G. Troster, The agenda of wearable healthcare. Yearbook Med. Inform. 1, 125–138 (2005)
D. Valeriani, C. Cinel, R. Poli, Group augmentation in realistic visual-search decisions via a hybrid brain-computer interface. Sci. Rep. 7, 7772 (2017)
J.J. Vidal, Toward direct brain-computer communication. Annu. Rev. Biophys. Bioeng. 2, 157–180 (1973)
W. von Rosenberg et al., Hearables: feasibility of recording cardiac rhythms from head and in-ear locations. R. Soc. Open Sci. 4(11), 171214 (2017)
E. Wascher et al., Evaluating mental load during realistic driving simulations by means of round the ear electrodes. Front. Neurosci. 13, 940 (2019)
E. Waterhouse, New horizons in ambulatory electroencephalography. IEEE Eng. Med. Biol. Mag. 22(3), 74–80 (2003)
Wireless EEG Headset. Available: www.emotiv.com/epoc
P. Xu, X. Tao, S. Wang, Measurement of wearable electrode and skin mechanical interaction using displacement and pressure sensors. (2011)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this chapter
Cite this chapter
Yarici, M.C., Davies, H.J., Nakamura, T., Williams, I., Mandic, D.P. (2021). Hearables: In-Ear Multimodal Brain Computer Interfacing. In: Guger, C., Allison, B.Z., Tangermann, M. (eds) Brain-Computer Interface Research. SpringerBriefs in Electrical and Computer Engineering. Springer, Cham. https://doi.org/10.1007/978-3-030-60460-8_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-60460-8_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-60459-2
Online ISBN: 978-3-030-60460-8
eBook Packages: EngineeringEngineering (R0)