Abstract
In this chapter, the historical context and relevant scientific, artistic, and cultural milieus from which the idea of brain-computer interfaces involving multiple participants emerged is discussed. Additional contextualization includes descriptions of the intellectual climate from which ideas about brain biofeedback led to pioneering applications in music and its allied arts. The chapter then proceeds with more in-depth explanations of what are termed contingent and non-contingent feedback schemes, along with descriptions of early artistic applications and how those might be differentiated. Effects ensuing from the qualitative nature of the feedback signals in brainwave music are also briefly discussed. Following this, substantial space is devoted to describing selected examples of relatively recent musical and artistic pieces that employ multi-agent BCI. These are described with more extensive technical details that illustrate how the ideas, some of which could only have been imagined in earlier times, are now made possible by advances in available technology and new methods for analyzing brain signals from both individuals and groups. These include: implementing biofeedback schemes in which feedback signals depend upon contingent conditions in electroencephalographic features measured among multiple participants, multivariate principal oscillation pattern detection, “hyper-brain” scanning, employing wearable technology, and other related methods. Complex brain-computer music systems are also described in detail. Key artistic concepts explored include the idea of active imaginative listening as performance and cooperative multi-agent artistic productions with BCIs. Some concluding commentary and ideas for future research are also offered.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Berlyne DE (1971) Aesthetics and psychobiology. Appleton-Century-Crofts, New York
Birbaumer NW et al (1996) Perception of music and dimensional complexity of brain activity. Int J Bifurc Chaos 6:267–278
Brown S (2015) Assembly. Arthur C. Clarke Center for Human Imagination. http://www.imagination.ucsd.edu/assembly/
Brown S (2016) Cognogenesis. YouTube, 8 May 2016, youtu.be/MFno-ww8XV0
Choi I (2018) Interactive sonification exploring emergent behavior applying models for biological information and listening. Frontiers in neuroscience, vol 12, Neuroprosthetics. https://www.frontiersin.org/article/10.3389/fnins.2018.00197
Fehmi L, Rosenboom D (1971) Group contingent feedback. Talk given at the Spring 1971 Convention of the Association for Humanistic Psychology, Washington, D.C.
Holland JH (1995) Hidden order–how adaptation builds complexity. Addison-Wesley Publishing Company, Reading, MA
Holt J (2018) When Einstein walked with Gödel–excursions to the edge of thought. Farrar, Straus and Giroux, New York
Ilstedt Hjelm S, Browall C (2000) Brainball–using brain activity for cool competition. In: Proceedings of NordiCHI 2000, pp 177–188. http://www.mindball.pl/pdf/brainballChi.pdf
Intheon (2018) NeuroScale, www.neuroscale.io
Kaufman S (2000) Investigations. Oxford University Press, New York
Kelso JAS (1995) Dynamic patterns—the self-organization of brain and behavior. The MIT Press, Cambridge, MA
Kovacevic N, Ritter P, Tays W, Moreno S, McIntosh AR (2015) ‘My Virtual Dream’: collective neurofeedback in an immersive art environment. PLoS ONE 10(7):e0130129
Leslie G, Mullen T (2011) MoodMixer: EEG-based collaborative sonification. Proceedings of the international conference on new interfaces for musical expression. Department of Musicology, University of Oslo, Norwegian Academy of Music, pp 296–299
Liao L-D, Lin C-T, McDowell K, Wickenden AE, Gramann K, Jung T-P, Ko L-W, Chang J-Y (2012) Biosensor technologies for augmented brain–computer interfaces in the next decades. In: Proceedings of the IEEE 100, special centennial issue, no. (May 2012), pp 1553–1566
Longuet-Higgins HC (1969) The non-local storage and associative retrieval of spatio-temporal patterns. In: Leibovic KN (ed) Information processing in the nervous system. Springer, New York
Mann S, Fung J, Garten A (2007) DECONcert: bathing in the light, sounds, and waters of the musical brainbaths. In: Proceedings of the 2007 international computer music conference (ICMC2007), vol 2, August 27–31, 2007. Copenhagen, Denmark, pp 204–211
Mullen T, Worrell G, Makeig S (2012) Multivariate principal oscillation pattern analysis of ICA sources during seizure. In: Proceedings of the 34th annual international conference of the IEEE, EMBS San Diego, CA
Mullen T et al (2015) MindMusic: playful and social installations at the interface between music and the brain. In: Nijholt A (ed) More playful user interfaces. Interfaces that invite social and physical interaction. Gaming media and social effects. Springer, Singapore, pp 221–229. ISBN 978-981-287-545-7, ISBN 978-981-287-546-4 (eBook)
Novello A (2012) From invisible to visible, the EEG as a tool for music creation and control. Thesis. https://www.researchgate.net/publication/329072229
Rosenboom D (1972) Homuncular homophony. In: Rosenboom D (ed) Biofeedback and the arts, results of early experiments. Aesthetic Research Centre of Canada Publications, Vancouver
Rosenboom D (1975) Brainwave music. Vinyl record. Aesthetic Research Centre of Canada, Maple, Ontario
Rosenboom D (ed) (1976) Biofeedback and the arts, results of early experiments. Aesthetic Research Centre of Canada Publications, Vancouver
Rosenboom D (1977) On being invisible. Vinyl record. Music Gallery Editions, Toronto
Rosenboom D (1992) Complex adaptive systems in music. (Abstract from invited presentation.) J Acoust Soc Am 92(4), (2):2403
Rosenboom D (1994) Music from–On Being Invisible II (Hypatia Speaks to Jefferson in a Dream). https://davidrosenboom.com/compositions-19912000
Rosenboom D (1996) B.C.–A.D. and two lines, two ways of making music while exploring instability, in tribute to Salvatore Martirano. Perspect New Music 34(1):210–226
Rosenboom D (1997) Extended musical interface with the human nervous system: assessment and prospectus. Revised electronic monograph: https://davidrosenboom.com/writings/. (Original (1990), San Francisco: Leonardo, Monograph, 1)
Rosenboom D (2000a) Invisible gold, classics of live electronic music involving extended musical interface with the human nervous system. Audio CD. Pogus Productions 21002-2. Chester, New York
Rosenboom D (2000b) Music from–On Being Invisible II (Hypatia Speaks to Jefferson in a Dream), on transmigration music. Audio CD. Centaur Records, Inc., Consortium to Distribute Computer Music, vol. 30, CRC 2940, Baton Rouge, LA
Rosenboom D (2000c) Propositional music: on emergent properties in morphogenesis and the evolution of music, essays, propositions, commentaries, imponderable forms and compositional methods. In: Zorn J (ed) Arcana, musicians on music. Granary Books/Hips Road, New York, pp 203–232
Rosenboom D (2003) Propositional music from extended musical interface with the human nervous system. In: Avazini G et al (eds) The neurosciences and music, annals of the New York academy of sciences, vol 999. New York Academy of Sciences, New York, pp 263–271
Rosenboom D (2006) Brainwave music 2006. Audio CD. EM Records EM1054CD, Osaka, Japan
Rosenboom D (2014) Active imaginative listening—a neuromusical critique. Frontiers in neuroscience, auditory cognitive neuroscience, vol 8, The Musical Brain. http://journal.frontiersin.org/article/10.3389/fnins.2014.00251
Rosenboom D (2015) The experiment–from Hopscotch. Score available online: https://davidrosenboom.com/compositions
Rosenboom D (2018) Propositional music of many nows. In: Bogdanovic D, Bouvier X (eds) Tradition and synthesis–multiple modernities for composer-performers. Doberman-Yppan, Lévis, Québec, Canada, pp 121–142
Rosenboom D (2019a) Deviant resonances—live electronic music with instruments, voices & brains. Audio CD and digital distribution. Ravello Records RR8009, North Hampton, NH
Rosenboom D (2019b) Brainwave music. Double vinyl records. Black Truffle Records. http://www.blacktrufflerecords.com
The Industry (2015) Hopscotch–a mobile opera for 24 cars. http://hopscotchopera.com. Los Angeles
Vidal JJ (1973) Toward direct brain-computer communication. Annu Rev Biophys Bioeng 2:157–180
von Foerster H (1981) Observing systems. Intersystems Publications, Seaside, CA
Zao JK, Gan T-T, You C-K, Mendez SJR, Chung C-E, Wang Y-T, Mullen T, Jung T-P (2014a) Augmented brain computer interaction based on fog computing and linked data. In: Proceedings—2014 international conference on intelligent environments, IE 2014
Zao JK, Gan T-T, You C-K, Chung C-E, Wang Y-T, Méndez SJR, Mullen T et al (2014b) Pervasive brain monitoring and data sharing based on multi-tier distributed computing and linked data technology. Front Hum Neurosci 8(June):370. January 2014
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Rosenboom, D., Mullen, T. (2019). More Than One—Artistic Explorations with Multi-agent BCIs. In: Nijholt, A. (eds) Brain Art. Springer, Cham. https://doi.org/10.1007/978-3-030-14323-7_4
Download citation
DOI: https://doi.org/10.1007/978-3-030-14323-7_4
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-14322-0
Online ISBN: 978-3-030-14323-7
eBook Packages: Computer ScienceComputer Science (R0)