A Hypothesis of Brain-to-Brain Coupling in Interactive New Media Art and Games Using Brain-Computer Interfaces

  • Polina Zioga
  • Paul Chapman
  • Minhua Mae
  • Frank Pollick
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 9090)

Abstract

Interactive new media art and games belong to distinctive fields, but nevertheless share common grounds, tools, methodologies, challenges, and goals, such as the use of applications and devices for engaging multiple participants and players, and more recently electroencephalography (EEG)-based brain-computer interfaces (BCIs). At the same time, an increasing number of new neuroscientific studies explore the phenomenon of brain-to-brain coupling, the dynamics and processes of the interaction and synchronisation between multiple subjects and their brain activity. In this context, we discuss interactive works of new media art, computer and serious games that involve the interaction of the brain-activity, and hypothetically brain-to-brain coupling, between multiple performer/s, spectator/s, or participants/players. We also present Enheduanna – A Manifesto of Falling (2015), a new live brain-computer cinema performance, with the use of an experimental passive multi-brain BCI system under development. The aim is to explore brain-to-brain coupling between performer/s and spectator/s as means of controlling the audio-visual creative outputs.

Keywords

Brain-to-brain coupling Brain-Computer Interface (BCI) Human-Computer Interaction (HCI) Electroencephalography (EEG) New media art Computer games Serious games Performer Audience Spectator Participant Player 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Zioga, P., Chapman, P., Ma, M., Pollick, F.: A Wireless Future: performance art, interaction and the brain-computer interfaces. In: INTER-FACE: International Conference on Live Interfaces 2014, Lisbon (2014)Google Scholar
  2. 2.
    Hasson, U., Ghazanfar, A.A., Galantucci, B., Garrod, S., Keysers, C.: Brain-to-brain coupling: a mechanism for creating and sharing a social world. Trends in Cognitive Neuroscience 16(2), 114–121 (2012). doi:10.1016/j.tics.2011.12.007 Google Scholar
  3. 3.
    Stephens, G.J., Silbert, L., Hasson, U.: Speaker–listener neural coupling underlies successful communication. Proceedings of the National Academy of Sciences of the United States of America 107(32), 14425–14430 (2010)Google Scholar
  4. 4.
    Schippers, M.B., Roebroeck, A., Renken, R., Nanettia, L., Keysers, C.: Mapping the information flow from one brain to another during gestural communication. Proceedings of the National Academy of Sciences of the United States of America 107(20), 9388–9393 (2010)Google Scholar
  5. 5.
    Anders, S., Heinzle, J., Weiskopf, N., Ethofer, T., Haynes, J.-D.: Flow of affective information between communicating brains. Neuroimage 54(1–4), 439–446 (2011)CrossRefGoogle Scholar
  6. 6.
    Jola, C., McAleer, P., Grosbras, M.-H., Love, S.A., Morison, G., Pollick, F.E.: Uni- and multisensory brain areas are synchronized across spectators when watching unedited dance recordings. i-Perception 4(4), 265–284 (2013)CrossRefGoogle Scholar
  7. 7.
    Mori, M., Bregenz, K., Schneider, E.: Mariko Mori: wave UFO. Verlag der Buchhandlung Walther König, Köln (2003)Google Scholar
  8. 8.
    Dikker, S.: REAL-TIME INTERACTIVE BRAIN INSTALLATIONS (Last Modified September 2014). https://files.nyu.edu/sd1083/public/art.html. (accessed October 19, 2014)
  9. 9.
    Marina Abramovic Institute: Out of the Lab (2014). http://www.immaterial.org/content/2014/6/9/out-of-the-lab. (accessed October 19, 2014)
  10. 10.
    Eaton, J.: The Space Between Us. Vimeo video, 06:35. Posted by “joel eaton” (2015). https://vimeo.com/116013316. (accessed March 04, 2015)
  11. 11.
    Eaton, J., Jin, W., Miranda, E.: The space between us: a live performance with musical score generated via affective correlates measured in EEG of one performer and an audience member. In: NIME 2014 International Conference on New Interfaces for Musical Expression, pp. 593-596. NIME 2014, London (2014)Google Scholar
  12. 12.
    Nijholt, A., Gürkök, H.: Multi-brain games: cooperation and competition. In: Stephanidis, C., Antona, M. (eds.) UAHCI 2013, Part I. LNCS, vol. 8009, pp. 652–661. Springer, Heidelberg (2013)Google Scholar
  13. 13.
    Bonnet, L., Lotte, F., Lecuyer, A.: Two Brains, One Game: Design and Evaluation of a Multi-User BCI Video Game Based on Motor Imagery. IEEE Transactions on Computational Intelligence and AI in games, IEEE Computational Intelligence Society 5(2), 185–198 (2013)Google Scholar
  14. 14.
    Bahrami, B., Olsen, K., Latham, P.E., Roepstorff, A., Rees, G., Frith, C.D.: Optimally interacting minds. Science 329(5995), 1081–1085 (2010)CrossRefGoogle Scholar
  15. 15.
    Rao, R.P.N., Stocco, A., Bryan, M., Sarma, D., Youngquist, T.M., Wu, J., Prat, C.: A Direct Brain-to-Brain Interface in Humans. University of Washington Computer Science and Engineering. In: Technical Report No. UW-CSE-14-07-01 (July 2014). http://homes.cs.washington.edu/~rao/brain2brain/UW-CSE-14-07-01.PDF.pdf. (accessed October 22, 2014)
  16. 16.
    MyndPlay: Focus Pocus for Windows (2015). http://myndplay.com/software.php?swid=19. (accessed March 04, 2014)
  17. 17.
    Zioga, P., Katsinavaki, A.: Enheduanna – A Manifesto of Falling. Premiere 30th July 2015. Centre for Contemporary Arts, Glasgow, UK. Performers: Anastassia Katsinavaki, Minas Borboudakis, and Polina Zioga. Director: Polina Zioga (2015)Google Scholar
  18. 18.
    Willis, H.: Real Time Live: Cinema as Performance. AfterImage 37(1), 11–15 (2009)Google Scholar
  19. 19.
    Hasson, U., Landesman, O., Knappmeyer, B., Vallines, I., Rubin, N., Heeger, D.: Neurocinematics: The Neuroscience of Film. Projections: The Journal for Movies and Mind 2(1), 1–26 (2008)CrossRefGoogle Scholar
  20. 20.
    Zander T.O., Kothe C, Welke S, Roetting M.: Enhancing human-machine systems with secondary input from passive brain-computer interfaces. In: Proceedings of the 4th International BCI Workshop & Training Course, Graz, Austria, 2008. Graz University of Technology Publishing House, Graz (2008)Google Scholar
  21. 21.
    MyndPlay: BrainBandXL & MyndPlay Pro Bundle (2015). http://myndplay.com/products.php?prod=9. (accessed March 04, 2014)
  22. 22.
    Renard, Y., Lotte, F., Gibert, G., Congedo, M., Maby, E., Delannoy, Bertrand, V. O., Lécuyer, A.: OpenViBE: An Open-Source Software Platform to Design, Test and Use Brain-Computer Interfaces in Real and Virtual Environments, Presence: Teleoperators and Virtual Environments 19(1) (2010)Google Scholar
  23. 23.
    Swartz Center of Computational Neuroscience – University of California San Diego: Introduction To Modern Brain-Computer Interface Design Wiki (2012). http://sccn.ucsd.edu/wiki/Introduction_To_Modern_Brain-Computer_Interface_Design. (accessed September 24, 2014)

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Polina Zioga
    • 1
  • Paul Chapman
    • 1
  • Minhua Mae
    • 2
  • Frank Pollick
    • 3
  1. 1.Digital Design StudioGlasgow School of ArtGlasgowUK
  2. 2.School of Art, Design and ArchitectureUniversity of HuddersfieldHuddersfieldUK
  3. 3.School of PsychologyUniversity of GlasgowGlasgowUK

Personalised recommendations