Abstract
An auditory feedback for Brain Computer Interface (BCI) applications is proposed. This is achieved based on the so-called sonification of the mental states of humans, captured by Electro-Encephalogram (EEG) recordings. Two time-frequency signal decomposition techniques, the Bump Modelling and Empirical Mode Decomposition (EMD), are used to map the EEG recordings onto musical scores. This auditory feedback proves to have extremely high potential in the development of on-line BCI interfaces. Examples based on the responses from visual stimuli support the analysis.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Wolpaw, J.R., Birbaumer, N., McFarland, D.J., Pfurtscheller, G., Vaughan, T.M.: Brain–computer interfaces for communication and control. Clinical Neurophysiology 113, 767–791 (2002)
Wolpaw, J.R., McFarland, D.J.: Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. Proceedings of National Academy of Sciences of the United States America 101(51), 17849–17854 (2004)
Niedermeyer, E., Da Silva, F.L. (eds.): Electroencephalography: Basic Principles, Clinical Applications, and Related Fields, 5th edn. Lippincott Williams & Wilkins (2004)
Kelly, S.P., Lalor, E.C., Finucane, C., McDarby, G., Reilly, R.B.: Visual spatial attention control in an independent brain-computer interface. IEEE Transactions on Biomedical Engineering 52(9), 1588–1596 (2005)
Miranda, E., Brouse, A.: Interfacing the brain directly with musical systems: On developing systems for making music with brain signals. LEONARDO 38(4), 331–336 (2005)
Jovanov, E., Starcevic, D., Samardzic, A., Marsh, A., Obrenovic, Z.: EEG analysis in a telemedical virtual world. Future Generation Computer Systems 15, 255–263 (1999)
Vialatte, F.: Modelisation en bosses pour l’analyse des motifs oscillatoires reproductibles dans l’activite de populations neuronales: applications a l’apprentissage olfactif chez l’animal et a la detection precoce de la maladie d’Alzheimer. PhD thesis, Paris VI University, Paris (2005), http://www.neurones.espci.fr/Theses_PS/VIALATTE_F.pdf
Vialatte, F., Cichocki, A., Dreyfus, G., Musha, T., Rutkowski, T., Gervais, R.: Blind source separation and sparse bump modelling of time frequency representation of EEG signals: New tools for early detection of Alzheimer’s disease. In: Proceedings of the 2005 IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing, Mystic CT, USA, pp. 27–32. IEEE, Los Alamitos (2005)
Rilling, G., Flandrin, P., Goncalves, P.: On empirical mode decomposition and its algorithms. In: Proceedings of IEEE-EURASIP Workshop on Nonlinear Signal and Image Processing, NSIP 2003. IEEE, Los Alamitos (2003)
Huang, N., Shen, Z., Long, S., Wu, M., Shih, H., Zheng, Q., Yen, N.C., Tung, C., Liu, H.: The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences 454(1971), 903–995 (1998)
Eerola, T., Toiviainen, P.: MIR in Matlab: The MIDI toolbox. In: Proceedings of The 5th International Conference on Music Information Retrieval, ISMIR 2004, Barcelona, Spain, Audiovisual Institute, Universitat Pompeu Fabra, pp. 22–27 (2004)
Przybyszewski, A., Rutkowski, T.: Processing of the incomplete representation of the visual world. In: Proceedings of the First Warsaw International Seminar on Intelligent Systems, WISIS 2004, Warsaw, Poland (2004)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Rutkowski, T.M., Vialatte, F., Cichocki, A., Mandic, D.P., Barros, A.K. (2006). Auditory Feedback for Brain Computer Interface Management – An EEG Data Sonification Approach. In: Gabrys, B., Howlett, R.J., Jain, L.C. (eds) Knowledge-Based Intelligent Information and Engineering Systems. KES 2006. Lecture Notes in Computer Science(), vol 4253. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11893011_156
Download citation
DOI: https://doi.org/10.1007/11893011_156
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-46542-3
Online ISBN: 978-3-540-46544-7
eBook Packages: Computer ScienceComputer Science (R0)