The Hybrid Brain Computer Music Interface - Integrating Brainwave Detection Methods for Extended Control in Musical Performance Systems
In the pursuit of creative interfaces for music making brain-computer interfacing (BCI) control methods offer limited usability especially in terms of providing simultaneous yet independent input controls. This article outlines the development of the hybrid brain-computer music interface (BCMI) and presents the work undertaken towards the design, implementation, and combined BCI control methods employed. Two active (steady state visually evoked potential (SSVEP) and motor imagery (MI)) and one passive (affective response) control methods are integrated in a new BCMI system, which can be applied to a range of music-making activities. This paper also briefly outlines the design of bespoke, customisable and modular SSVEP stimuli and feedback units. As a demonstration of the hybrid-BCMI, the performance piece A Stark Mind illustrates how such a system is in for live performance. The piece uses the brainwave control methods to generate and control a visual score for an ensemble of musicians to perform.
KeywordsNeuro-technology Brain music Brainwave control Live performance Brain-computer music interfacing
The authors gratefully acknowledge the support of a doctoral scholarship awarded by Plymouth University.
- 1.Biofeedback and the Arts: Results of Early Experiments: Aesthetic Research Center, Vancouver, British Columbia, p. 162 (1976)Google Scholar
- 2.de Campo, A., et al.: New sonification tools for EEG data screening and monitoring. In: 13th International Conference on Auditory Display, Montreal, Canada (2007)Google Scholar
- 4.Nijholt, A.: Competing and collaborating brains: multi-brain computer interfacing. In: Hassanien, A.E., Azar, A.T. (eds.) Brain-Computer Interfaces, vol. 74, pp. 313–335. Springer, Heidelberg (2015)Google Scholar
- 5.Eaton, J., Miranda, E.: BCMI systems for musical performance. In: 10th International Symposium on Computer Music Multidisciplinary Research (CMMR): Sound, Music and Motion, Marseille, France (2013)Google Scholar
- 6.Beverina, F., et al.: User adaptive BCIs: SSVEP and P300 based interfaces. PsychNol. J. 1(4), 331–354 (2003)Google Scholar
- 7.Guger, C., Edlinger, G., Krausz, G.: Hardware/software components and applications of BCIs. In: Fazel-Rezai, R. (ed.) Recent Advances in Brain-Computer Interface Systems, pp. 1–24. InTech, Rjeka (2011)Google Scholar
- 15.Eaton, J., Williams, D., Miranda, E.: Affective jukebox: a confirmatory study of EEG emotional correlates in response to musical stimuli. In: 11th Sound and Music Conference, 14th International Computer Music Conference Joint ICMC and SMC 2014, University of Athens, Greece (2014)Google Scholar
- 17.Liu, Y., et al.: Implementation of SSVEP based BCI with emotiv EPOC. In: Virtual Environments Human-Computer Interfaces and Measurement Systems (VECIMS). IEEE (2012)Google Scholar
- 18.Eaton, J., Miranda, E.: Expanding on brain control: a real-time hybrid BCMI for drum machine combining active (SSVEP) and passive (affective response) brainwave control. In: 9th Conference on Interdisciplinary Musicology – CIM14, Berlin, Germany (2014)Google Scholar
- 19.Pfurtscheller, G., et al.: The hybrid BCI. Front. Neurosci. 4, 30 (2010)Google Scholar
Open Access This chapter is licensed under the terms of the Creative Commons Attribution-NonCommercial 2.5 International License (http://creativecommons.org/licenses/by-nc/2.5/), which permits any noncommercial use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license and indicate if changes were made.
The images or other third party material in this chapter are included in the chapter's Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the chapter's Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder.