Skip to main content

More Than One—Artistic Explorations with Multi-agent BCIs

  • Chapter
  • First Online:
Brain Art

Abstract

In this chapter, the historical context and relevant scientific, artistic, and cultural milieus from which the idea of brain-computer interfaces involving multiple participants emerged is discussed. Additional contextualization includes descriptions of the intellectual climate from which ideas about brain biofeedback led to pioneering applications in music and its allied arts. The chapter then proceeds with more in-depth explanations of what are termed contingent and non-contingent feedback schemes, along with descriptions of early artistic applications and how those might be differentiated. Effects ensuing from the qualitative nature of the feedback signals in brainwave music are also briefly discussed. Following this, substantial space is devoted to describing selected examples of relatively recent musical and artistic pieces that employ multi-agent BCI. These are described with more extensive technical details that illustrate how the ideas, some of which could only have been imagined in earlier times, are now made possible by advances in available technology and new methods for analyzing brain signals from both individuals and groups. These include: implementing biofeedback schemes in which feedback signals depend upon contingent conditions in electroencephalographic features measured among multiple participants, multivariate principal oscillation pattern detection, “hyper-brain” scanning, employing wearable technology, and other related methods. Complex brain-computer music systems are also described in detail. Key artistic concepts explored include the idea of active imaginative listening as performance and cooperative multi-agent artistic productions with BCIs. Some concluding commentary and ideas for future research are also offered.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 199.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  • Berlyne DE (1971) Aesthetics and psychobiology. Appleton-Century-Crofts, New York

    Google Scholar 

  • Birbaumer NW et al (1996) Perception of music and dimensional complexity of brain activity. Int J Bifurc Chaos 6:267–278

    Google Scholar 

  • Brown S (2015) Assembly. Arthur C. Clarke Center for Human Imagination. http://www.imagination.ucsd.edu/assembly/

  • Brown S (2016) Cognogenesis. YouTube, 8 May 2016, youtu.be/MFno-ww8XV0

  • Choi I (2018) Interactive sonification exploring emergent behavior applying models for biological information and listening. Frontiers in neuroscience, vol 12, Neuroprosthetics. https://www.frontiersin.org/article/10.3389/fnins.2018.00197

  • Fehmi L, Rosenboom D (1971) Group contingent feedback. Talk given at the Spring 1971 Convention of the Association for Humanistic Psychology, Washington, D.C.

    Google Scholar 

  • Holland JH (1995) Hidden order–how adaptation builds complexity. Addison-Wesley Publishing Company, Reading, MA

    Google Scholar 

  • Holt J (2018) When Einstein walked with Gödel–excursions to the edge of thought. Farrar, Straus and Giroux, New York

    Google Scholar 

  • Ilstedt Hjelm S, Browall C (2000) Brainball–using brain activity for cool competition. In: Proceedings of NordiCHI 2000, pp 177–188. http://www.mindball.pl/pdf/brainballChi.pdf

  • Intheon (2018) NeuroScale, www.neuroscale.io

  • Kaufman S (2000) Investigations. Oxford University Press, New York

    Google Scholar 

  • Kelso JAS (1995) Dynamic patterns—the self-organization of brain and behavior. The MIT Press, Cambridge, MA

    Google Scholar 

  • Kovacevic N, Ritter P, Tays W, Moreno S, McIntosh AR (2015) ‘My Virtual Dream’: collective neurofeedback in an immersive art environment. PLoS ONE 10(7):e0130129

    Google Scholar 

  • Leslie G, Mullen T (2011) MoodMixer: EEG-based collaborative sonification. Proceedings of the international conference on new interfaces for musical expression. Department of Musicology, University of Oslo, Norwegian Academy of Music, pp 296–299

    Google Scholar 

  • Liao L-D, Lin C-T, McDowell K, Wickenden AE, Gramann K, Jung T-P, Ko L-W, Chang J-Y (2012) Biosensor technologies for augmented brain–computer interfaces in the next decades. In: Proceedings of the IEEE 100, special centennial issue, no. (May 2012), pp 1553–1566

    Google Scholar 

  • Longuet-Higgins HC (1969) The non-local storage and associative retrieval of spatio-temporal patterns. In: Leibovic KN (ed) Information processing in the nervous system. Springer, New York

    Google Scholar 

  • Mann S, Fung J, Garten A (2007) DECONcert: bathing in the light, sounds, and waters of the musical brainbaths. In: Proceedings of the 2007 international computer music conference (ICMC2007), vol 2, August 27–31, 2007. Copenhagen, Denmark, pp 204–211

    Google Scholar 

  • Mullen T, Worrell G, Makeig S (2012) Multivariate principal oscillation pattern analysis of ICA sources during seizure. In: Proceedings of the 34th annual international conference of the IEEE, EMBS San Diego, CA

    Google Scholar 

  • Mullen T et al (2015) MindMusic: playful and social installations at the interface between music and the brain. In: Nijholt A (ed) More playful user interfaces. Interfaces that invite social and physical interaction. Gaming media and social effects. Springer, Singapore, pp 221–229. ISBN 978-981-287-545-7, ISBN 978-981-287-546-4 (eBook)

    Google Scholar 

  • Novello A (2012) From invisible to visible, the EEG as a tool for music creation and control. Thesis. https://www.researchgate.net/publication/329072229

  • Rosenboom D (1972) Homuncular homophony. In: Rosenboom D (ed) Biofeedback and the arts, results of early experiments. Aesthetic Research Centre of Canada Publications, Vancouver

    Google Scholar 

  • Rosenboom D (1975) Brainwave music. Vinyl record. Aesthetic Research Centre of Canada, Maple, Ontario

    Google Scholar 

  • Rosenboom D (ed) (1976) Biofeedback and the arts, results of early experiments. Aesthetic Research Centre of Canada Publications, Vancouver

    Google Scholar 

  • Rosenboom D (1977) On being invisible. Vinyl record. Music Gallery Editions, Toronto

    Google Scholar 

  • Rosenboom D (1992) Complex adaptive systems in music. (Abstract from invited presentation.) J Acoust Soc Am 92(4), (2):2403

    Google Scholar 

  • Rosenboom D (1994) Music from–On Being Invisible II (Hypatia Speaks to Jefferson in a Dream). https://davidrosenboom.com/compositions-19912000

  • Rosenboom D (1996) B.C.–A.D. and two lines, two ways of making music while exploring instability, in tribute to Salvatore Martirano. Perspect New Music 34(1):210–226

    Google Scholar 

  • Rosenboom D (1997) Extended musical interface with the human nervous system: assessment and prospectus. Revised electronic monograph: https://davidrosenboom.com/writings/. (Original (1990), San Francisco: Leonardo, Monograph, 1)

  • Rosenboom D (2000a) Invisible gold, classics of live electronic music involving extended musical interface with the human nervous system. Audio CD. Pogus Productions 21002-2. Chester, New York

    Google Scholar 

  • Rosenboom D (2000b) Music from–On Being Invisible II (Hypatia Speaks to Jefferson in a Dream), on transmigration music. Audio CD. Centaur Records, Inc., Consortium to Distribute Computer Music, vol. 30, CRC 2940, Baton Rouge, LA

    Google Scholar 

  • Rosenboom D (2000c) Propositional music: on emergent properties in morphogenesis and the evolution of music, essays, propositions, commentaries, imponderable forms and compositional methods. In: Zorn J (ed) Arcana, musicians on music. Granary Books/Hips Road, New York, pp 203–232

    Google Scholar 

  • Rosenboom D (2003) Propositional music from extended musical interface with the human nervous system. In: Avazini G et al (eds) The neurosciences and music, annals of the New York academy of sciences, vol 999. New York Academy of Sciences, New York, pp 263–271

    Google Scholar 

  • Rosenboom D (2006) Brainwave music 2006. Audio CD. EM Records EM1054CD, Osaka, Japan

    Google Scholar 

  • Rosenboom D (2014) Active imaginative listening—a neuromusical critique. Frontiers in neuroscience, auditory cognitive neuroscience, vol 8, The Musical Brain. http://journal.frontiersin.org/article/10.3389/fnins.2014.00251

  • Rosenboom D (2015) The experiment–from Hopscotch. Score available online: https://davidrosenboom.com/compositions

  • Rosenboom D (2018) Propositional music of many nows. In: Bogdanovic D, Bouvier X (eds) Tradition and synthesis–multiple modernities for composer-performers. Doberman-Yppan, Lévis, Québec, Canada, pp 121–142

    Google Scholar 

  • Rosenboom D (2019a) Deviant resonances—live electronic music with instruments, voices & brains. Audio CD and digital distribution. Ravello Records RR8009, North Hampton, NH

    Google Scholar 

  • Rosenboom D (2019b) Brainwave music. Double vinyl records. Black Truffle Records. http://www.blacktrufflerecords.com

  • The Industry (2015) Hopscotch–a mobile opera for 24 cars. http://hopscotchopera.com. Los Angeles

  • Vidal JJ (1973) Toward direct brain-computer communication. Annu Rev Biophys Bioeng 2:157–180

    Google Scholar 

  • von Foerster H (1981) Observing systems. Intersystems Publications, Seaside, CA

    Google Scholar 

  • Zao JK, Gan T-T, You C-K, Mendez SJR, Chung C-E, Wang Y-T, Mullen T, Jung T-P (2014a) Augmented brain computer interaction based on fog computing and linked data. In: Proceedings—2014 international conference on intelligent environments, IE 2014

    Google Scholar 

  • Zao JK, Gan T-T, You C-K, Chung C-E, Wang Y-T, Méndez SJR, Mullen T et al (2014b) Pervasive brain monitoring and data sharing based on multi-tier distributed computing and linked data technology. Front Hum Neurosci 8(June):370. January 2014

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to David Rosenboom .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2019 Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Rosenboom, D., Mullen, T. (2019). More Than One—Artistic Explorations with Multi-agent BCIs. In: Nijholt, A. (eds) Brain Art. Springer, Cham. https://doi.org/10.1007/978-3-030-14323-7_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-14323-7_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-14322-0

  • Online ISBN: 978-3-030-14323-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics