Abstract
This chapter explores the space of Brain-Computer Interaction as a tool to enhance storytelling within cinema, as a means to overcome some of the main critiques of interactive film in terms of interaction and immersion in the media. Using the Performance-led Research in the Wild methodology, we create complete professionally-made experiences to explore possible brain-computer interactions with film, and exhibit them in-the-wild to the public. As well as reviewing the findings of these investigations, this chapter primarily contributes an exposition on artistic practices, and draws conclusions for future developments in brain-controlled film. We present two case studies of BCI films that have been made and publicly screened, The Disadvantages of Time Travel (2015) and The MOMENT (2018). For each we (a) describe the experience we produced, (b) present detail about how it was made regarding different elements of the filmmaking process, (c) give an overview of how they were received by audiences, and (d) summarise key lessons learned about filmmaking practice. In discussing how they were made and received, therefore, we set out implications for scripting, storyboarding, sound design, cinematography, directing and editing as well as interactive platform development. The chapter concludes by discussing possible techniques, processes, mappings, and BCI implementations that could be put together to make future films, as well as presenting both opportunities for industry and open challenges that remain for brain-controlled film.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
Notes
- 1.
- 2.
This was revisited after the premiere, by analysing the log files created while people watched The MOMENT; we found the average length of attention at 4.2 s.
- 3.
References
Anderson S (2006) Soft cinema: navigating the database. Mov Image 6(1):136–139. https://doi.org/10.1353/mov.2006.0002
Benford S, Greenhalgh C, Crabtree A, Flintham M, Walker B, Marshall J, Koleva B, Rennick Egglestone S, Giannachi G, Adams M, Tandavanitj N, Row Farr J (2013) Performance-led research in the wild. ACM Trans Comput-Hum Interact 20(3):14:1–14:22. http://doi.acm.org/10.1145/2491500.2491502
Bordwell D (2002) Intensified continuity visual style in contemporary american film. Film Quart 55(3):16–28
Chesney R, Citron DK (2018) Deep fakes: a looming challenge for privacy, democracy, and national security
Chion M (1994) Audio-vision: sound on screen. Columbia University Press
CtrlMovie (2016) Ctrlmovie. http://www.ctrlmovie.com/. Accessed 19 Sept 2018
Cutting JE (2014) Event segmentation and seven types of narrative discontinuity in popular movies. Acta Psychologica 149:69–77. https://doi.org/10.1016/j.actpsy.2014.03.003
Fabe M (2014) Closely watched films: an introduction to the art of narrative film technique. Univ of California Press
Gaver WW, Beaver J, Benford S (2003) Ambiguity as a resource for design. In: Proceedings of the SIGCHI conference on human factors in computing systems. ACM, New York, NY, USA, CHI ’03, pp 233–240. http://doi.acm.org/10.1145/642611.642653
Hales C (2015) Interactive cinema in the digital age. In: Koenitz H, Ferri G, Haahr M, Sezen D, Sezen TI (eds) Interactive digital narrative: history. Theory and Practice, Routledge, London, UK, pp 36–50
Hasson U, Landesman O, Knappmeyer B, Vallines I, Rubin N, Heeger DJ (2008) Neurocinematics: the neuroscience of film. Projections 2(1):1–26. https://doi.org/10.3167/proj.2008.020102
Höök K (2008) Affective loop experiences—what arethey? In: Oinas-Kukkonen H, Hasle P, Harjumaa M, Segerståhl K, Øhrstrøm P (eds) Persuasive technology. Springer, Berlin, Heidelberg, pp 1–12
Kim Y, Moon J, Lee H, Bae C, Sohn S (2012) Integration of electroencephalography based services into consumer electronics. In: 2012 IEEE 16th international symposium on consumer electronics, pp 1–2. https://doi.org/10.1109/ISCE.2012.6241692
Kinder M (2003) Designing a database cinema. The cinematic imaginary after film, Future cinema, pp 346–353
Kirke A, Williams D, Miranda E, Bluglass A, Whyte C, Pruthi R, Eccleston A (2018) Unconsciously interactive films in a cinema environment—a demonstrative case study. Digital Creativity 29(2–3):165–181. https://doi.org/10.1080/14626268.2017.1407344
Lim CG, Lee TS, Guan C, Fung DSS, Zhao Y, Teng SSW, Zhang H, Krishnan KRR (2012) A brain-computer interface based attention training program for treating attention deficit hyperactivity disorder. PLOS One 7(10):1–8. https://doi.org/10.1371/journal.pone.0046692
Livingstone I (1984) Deathtrap dungeon. Wizard Books
Manovich L, Malina RF, Cubitt S (2001) The language of new media. MIT press
Murch W (2001) In the blink of an eye: a perspective on film editing. Silman-James Press
Murray R (2011) 65daysofstatic score ‘silent running’. https://www.clashmusic.com/news/65daysofstatic-score-silent-running. Accessed 29 Jan 2019
Ninja Tune (2003) Man with a movie camera by the cinematic orchestra. https://www.ninjatune.net/release/the-cinematic-orchestra/man-with-a-movie-camera-2. Accessed 29 Jan 2019
Penlington N, Guiterrez De Jesus F, Smail S, Waston N (2014) Choose your own documentary, theatre performance, 16th oct–18th oct 2014. Giant Dwarf Theatre, Sydney, viewed 18th Oct
Petric V (1987) Constructivism in film: the Man with the Movie Camera: a cinematic analysis. Cambridge University Press Cambridge
Pike M, Ramchurn R, Benford S, Wilson ML (2016) #scanners: Exploring the control of adaptive films using brain-computer interaction. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, ACM, New York, NY, USA, CHI ’16, pp 5385–5396, http://doi.acm.org/10.1145/2858036.2858276
Polaine A (2005) The flow principle in interactivity. In: Proceedings of the second Australasian conference on interactive entertainment. Creativity & Cognition Studios Press, Sydney, Australia, Australia, IE ’05, pp 151–158. http://dl.acm.org/citation.cfm?id=1109180.1109204
Poulaki M (2014) Neurocinematics and the discourse of control: towards a critical neurofilmology. Cinéma & Cie: Int Film stud J 22–23
Pressman J (2006) House of leaves: reading the networked novel. Stud Am Fict 34(1):107–128
Ramchurn R, Chamberlain A, Benford S (2018) Designing musical soundtracks for brain controlled interface BCI systems. In: Proceedings of AM’18. ACM, New York, NY, USA, pp 28:1–28:8. http://doi.acm.org/10.1145/3243274.3243288
Ramchurn R, Martindale S, Wilson ML, Benford S (2019) From director’s cut to user’s cut: to watch a brain-controlled film is to edit it. In: Proceedings of the 2019 CHI conference on human factors in computing systems. ACM, New York, NY, USA. https://doi.org/10.1145/3290605.3300378, (In Press)
Randall K (2011) Rise of neurocinema: how hollywood studios harness your brainwaves to win oscars. https://www.fastcompany.com/1731055/rise-neurocinema-how-hollywood-studios-harness-your-brainwaves-win-oscars
Reynolds M (2018) The inside story of bandersnatch, the weirdest black mirror tale yet. https://www.wired.co.uk/article/bandersnatch-black-mirror-episode-explained
Schmeder A, Freed A, Wessel D (2010) Best practices for open sound control. In: Linux audio conference, vol 10
Sengers P, Gaver B (2006) Staying open to interpretation: engaging multiple meanings in design and evaluation. In: Proceedings of the 6th conference on designing interactive systems. ACM, New York, NY, USA, DIS ’06, pp 99–108. http://doi.acm.org/10.1145/1142405.1142422
Shaul NB (2008) Hyper-narrative interactive cinema: problems and solutions. BRILL
Shneiderman B, Plaisant C, Cohen M, Jacobs S, Elmqvist N, Diakopoulos N (2016) Designing the user interface: strategies for effective human-computer interaction. Pearson
Tikka P (2010) Enactive media—generalising from enactive cinema. Digital Creativity 21(4):205–214. https://doi.org/10.1080/14626268.2011.550028
Willoughby I (2007) Groundbreaking czechoslovak interactive film system revived 40 years later. https://www.radio.cz/en/section/panorama/groundbreaking-czechoslovak-interactive-film-system-revived-40-years-later
Zander TO, Kothe C (2011) Towards passive brain-computer interfaces: applying brain-computer interface technology to human-machine systems in general. J Neural Eng 8(2):025005
Zone R (2014) Stereoscopic cinema and the origins of 3-D film, 1838–1952. University Press of Kentucky
Zuboff S (2015) Big other: surveillance capitalism and the prospects of an information civilization. J Inf Technol 30(1):75–89
Acknowledgements
This work was supported by the Engineering and Physical Sciences Research Council [grant numbers EP/L015463/1, EP/M02315X/1]. We would like to acknowledge the financial support we received from the BFI Film Hub Propeller Scheme, Arts Council England Grants for the Arts, the EPSRC Telling Tales of Engagement competition, and those who contributed to the original Kickstarter campaign. Further, we would like to acknowledge the support provided by our partners: B3 Media and Live Cinema. Finally, we would like to acknowledge our long-time collaborators Mat Johns, Scrubber Fox, Hallvardur Asgierson, and Rachel Ramchurn, as well as the cast and crew for both our productions.
Data access: As per the previously published works from this project, datasets cannot be made available due to concerns over protecting the anonymity of our participants.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this chapter
Cite this chapter
Ramchurn, R., Martindale, S., Wilson, M.L., Benford, S., Chamberlain, A. (2019). Brain-Controlled Cinema. In: Nijholt, A. (eds) Brain Art. Springer, Cham. https://doi.org/10.1007/978-3-030-14323-7_14
Download citation
DOI: https://doi.org/10.1007/978-3-030-14323-7_14
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-14322-0
Online ISBN: 978-3-030-14323-7
eBook Packages: Computer ScienceComputer Science (R0)