Abstract
We developed a system for measuring the attentional process during the performance of specific activities. The proposed biomarker device is able to estimate the mental concentration using a single-channel EEG. The system captures the EEG signal and several brain waves located in the left orbitofrontal brain region. Furthermore, we extended the input features of the system applying spectrum analysis. We applied two well-known evolutionary algorithms for selecting the best combination of input features: simulated annealing and geometric particle swarm optimization. Besides, we solved the binary classification problem (concentration vs. relaxation) using support vector machines and neural networks. Support vector machines are among the most common instruments for solving binary classification problems. On the other hand, we selected to study a family of neural networks named echo state networks, because the model is ideal for embedded systems and has shown good accuracy in real-world applications. The training and execution are fast, robust, and reliable. The developed system is autonomous, portable, reliable, non-invasive and has a low economic cost. Besides, it can be easily adjusted for each person and for each problem.
Similar content being viewed by others
References
Anguita D, Ghio A, Oneto L, Parra X, Reyes-Ortiz JL (2012) Human activity recognition on smartphones using a multiclass hardware-friendly support vector machine. In: Bravo J, Hervás R, Rodríguez M (eds) Ambient assisted living and home care. Springer, Berlin, pp 216–223
Bacciu D, Barsocchi P, Chessa S, Gallicchio C, Micheli A (2014) An experimental characterization of reservoir computing in ambient assisted living applications. Neural Comput Appl 24(6):1451–1464. https://doi.org/10.1007/s00521-013-1364-4
Bao L, Intille SS (2004) Activity recognition from user-annotated acceleration data. In: Ferscha A, Mattern F (eds) Pervasive computing. Springer, Berlin, pp 1–17
Basterrech S Availability of source code and dataset: goo.gl/zmDgSu
Basterrech S (2017) Empirical analysis of the necessary and sufficient conditions of the echo state property. In: 2017 International joint conference on neural networks (IJCNN 2017), Anchorage, AK, USA, May 14–19, 2017, pp 888–896
Basterrech S, Bobrov P, Frolov A, Husek D (2015) Nature-inspired algorithms for selecting EEG sources for motor imagery based BCI. In: Rutkowski L, Korytkowski M, Scherer R, Tadeusiewicz R, Zadeh LA, Zurada JM (eds) Artificial intelligence and soft computing, volume 9120 of lecture notes in computer science. Springer, Berlin, pp 79–90
Basterrech S, Fyfe C, Rubino G (2011) Self-organizing maps and scale-invariant maps in echo state networks. In: 11th International conference on intelligent systems design and applications (ISDA 2011), Córdoba, Spain, pp 94–99
Basterrech S, Rubino G (2017) Echo state queueing networks: a combination of reservoir computing and random neural networks. Probab Eng Inf Sci 31:457–476
Biesiada J, Duch W, Kachel A, Maczka K, Palucha S (2005) Feature ranking methods based on information entropy with parzen windows. In: International conference on research in electrotechnology and applied informatics, vol 1, p 1
Bobrov P, Frolov AA, Cantor C, Fedulova I, Bakhnyan M, Zhavoronkov A (2011) Brain-computer interface based on generation of visual images. PLoS ONE 6(6):1–12
Butcher JB, Verstraeten D, Schrauwen B, Day CR, Haycock PW (2013) Reservoir computing and extreme learning machines for non-linear time-series data analysis. Neural Netw 38:76–89
Campbell C, Ying Y (2011) Learning with support vector machines. Synth Lect Artif Intell Mach Learn 5(1):1–95
Cleghorn CW, Engelbrecht AP (2014) A generalized theoretical deterministic particle swarm model. Swarm Intell 8(1):35–59
Clerc M (2010) Particle swarm optimization. ISTE, Wiley, New York
Clerc M, Kennedy J (2002) The particle swarm—explosion, stability, and convergence in a multidimensional complex space. IEEE Trans Evol Comput 6(1):58–73
Dashdamirov H, Basterrech S, Kromer P (2018) A nature-inspired system for mental state recognition. In: 2018 IEEE Congress on evolutionary computation (CEC), pp 1–8
Diao R, Shen Q (2015) Nature inspired feature selection meta-heuristics. Artif Intell Rev 44(3):311–340
Dirk K, Ott J (2003) Dynamic device access for mobile users. In: Proceedings of the eighth international conference on personal wireless communications
Engelbrecht A (2007) Computational intelligence: an introduction, 2nd edn. Wiley, New York
Frolov AA, Husek D, Bobrov P, Korshakov A, Chernikova L, Konovalov R, Mokienko O (2012) Sources of EEG activity most relevant to performance of brain–computer interface based on motor imagery. Neural Netw World 22(1):21–37
Frolov AA, Husek D, Bobrov P, Mokienko O, Tintera J (2013) Sources of electrical brain activity most relevant to performance of brain–computer interface based on motor imagery. In: Brain–computer interface systems—recent progress and future prospects. InTech, pp 175–193
Funahashi K, Nakamura Y (1993) Approximation of dynamical systems by continuous time recurrent neural networks. Neural Netw 6:801–806
Gallicchio C, Micheli A, Pedrelli L (2017) Deep reservoir computing: a critical experimental analysis. Neurocomputing 268(Supplement C):87 – 99. Advances in artificial neural networks, machine learning and computational intelligence
Hamel LH (2009) Knowledge discovery with support vector machines. Wiley, New York
Hastie T, Tibshirani R, Friedman J (2001) The elements of statistical learning. Spring series in statistics. Springer, New York
Herbrich R (2001) Learning kernel classifiers: theory and algorithms (adaptive computation and machine learning). MIT Press, Cambridge
Jaeger H (2001) The “echo state” approach to analysing and training recurrent neural networks. Technical Report 148, German National Research Center for Information Technology
Jaeger H, Lukoševičius M, Popovici D, Siewert U (2007) Optimization and applications of echo state networks with leaky-integrator neurons. Neural Netw 20(3):335–352
Jongen HT, Meer K, Triesch E (2004) Optimization theory. Kluwer, Dordrecht
Kafka F (1925) The trial. Der Prozeß. Translated by David Wyllie
Kecman V (2005) Support vector machines: an introduction. In: Wang L (ed) Support vector machines: theory and applications, volume 177 of studies in fuzziness and soft computing. Springer, Berlin, pp 605–605
Kennedy J, Eberhart R (1995) Particle swarm optimization. In: Proceedings of the IEEE international conference on neural networks, vol 4, pp 1942–1948
Kirkpatrick S, Gelatt CD, Vecchi MP (1983) Optimization by simulated annealing. Science 220(4598):671–680
Liu H, Motoda H (2013) Feature selection for knowledge discovery and data mining. The Springer international series in engineering and computer science. Springer, US
Lukoševičius M (2010) On self-organizing reservoirs and their hierarchies. Technical Report 25, Jacobs University, Bremen
Lukoševičius M, Jaeger H (2009) Reservoir computing approaches to recurrent neural network training. Comput Sci Rev 3:127–149
Lukoševičius M (2012) A practical guide to applying echo state networks. In: Montavon G, Orr GB, Müller K-R (eds) Neural networks: tricks of the trade, volume 7700 of lecture notes in computer. Springer, Berlin, pp 659–686
Maass W (1999) Noisy spiking neurons with temporal coding have more computational power than sigmoidal neurons. Technical Report TR-1999-037, Institute for Theorical Computer Science. Technische Universitaet Graz. Graz, Austria
Manjunath G, Jaeger H (2013) Echo state property linked to an input: exploring a fundamental characteristic of recurrent neural networks. Neural Comput 25(3):671–696
Moraglio A, Di Chio C, Togelius J, Poli R (2008) Geometric particle swarm optimization. J Artif Evol Appl 2008:11:1–11:14
Rolls ET (2004) The functions of the orbitofrontal cortex. Brain Cognit 55:11–29
Ravindran AR (2016) Operations research and management science handbook. Operations research series. CRC Press, Boca Raton
Rodan A, Tino P (2012) Simple deterministically constructed cycle reservoirs with regular jumps. Neural Comput 24:1822–1852
Rumelhart DE, Hinton GE, McClelland JL (1986) A general framework for parallel distributed processing. In: Rumelhart DE, McClelland JL, the PDP Research Group (eds) Parallel distributed processing: explorations in the microstructure of cognition, volume 1 of computational models of cognition and perception, chapter 2. MIT Press, Cambridge, pp 45–76.
Schmidhuber J, Wierstra D, Gagliolo M, Gomez F (2007) Training recurrent networks by Evolino. Neural Netw 19:757–779
Siegelmann HT, Sontag ED (1991) Turing computability with neural nets. Appl Math Lett 4(6):77–80
Technologies Neurosky Brain Computer (2015) MindWave mobile: user guide. NeuroSky’s Mindset Company, Technical report. http://neurosky.com
Tong S, Thakor NV (eds) (2009) Quantitative EEG analysis methods and clinical applications. Artech House Series, Engineering in Medicine & Biology. ISBN-13: 978-1-59693-204-3
Verstraeten D, Schrauwen B, D’Haene M, Stroobandt D (2007) An experimental unification of reservoir computing methods. Neural Netw 20(3):287–289
Wegener I (2005) Simulated annealing beats metropolis in combinatorial optimization. In: Caires L, Italiano GF, Monteiro L, Palamidessi C, Yung M (eds) Automata, languages and programming. Springer, Berlin, pp 589–601
Yildiza IB, Jaeger H, Kiebela SJ (2012) Re-visiting the echo state property. Neural Netw 35:1–9
Acknowledgements
This work was supported by the Technology Agency of the Czech Republic in the frame of the project no. TN01000024 “National Competence Center – Cybernetics and Artificial Intelligence”, and by the projects SP2019/135 and SP2019/141 of the Student Grant System, VSB – Technical University of Ostrava.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that there is no conflict of interests regarding the publication paper.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Basterrech, S., Krömer, P. A nature-inspired biomarker for mental concentration using a single-channel EEG. Neural Comput & Applic 32, 7941–7956 (2020). https://doi.org/10.1007/s00521-019-04574-2
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-019-04574-2