Neurointerfaces, Mental Imagery and Sensory Translation in Art and Science in the Digital Age

  • Ksenia Fedorova


This chapter focuses on the issue of transmedial and sensory exchange in the context of digital culture and biometric technology. It analyzes critically the epistemic claims behind various brain-scanning technologies, focusing on the status of the inner images that underlie cognitive activity. Multimedia performances and artistic experiments designed in collaboration with neuroscientists open up new dimensions in the discussion of translation between different sensory modalities, as well as translation between human perceptive apparatus and computational systems. Engaging the methodologies of contemporary image science and critical neuroscience, the chapter shows how artistic scenarios help to both localize and expand our understanding of mental imagery and to offer an alternative to the existing correlations-based approach.

Works Cited

  1. Bach-y-Rita, Paul, “Sensory Substitution and Qualia.” In Vision and Mind: Selected Readings in the Philosophy of Perception, edited by Alva Noё and Evan Thompson. Cambridge, MA: MIT Press, 2002.Google Scholar
  2. Beaulieu, Anne, “Images Are Not the (Only) Truth: Brain Mapping, Visual Knowledge, and Iconoclasm.” Science, Technology & Human Values 27 (2002): 53–86.CrossRefGoogle Scholar
  3. Bend, Hannes, Shawn Slater, Benjamin Knapp, et al. “Mindful Technologies Research and Developments in Science and Art.” In Proceedings of Association for the Advancement of Artificial Intelligence (2016).Google Scholar
  4. Boehm, Gottfried, Wie Bilder Sinn erzeugen. Berlin: Berlin University Press, 2007.Google Scholar
  5. Bredekamp, Horst, Theorie des Bildacts. Berlin: Suhrkamp Verlag, 2010.Google Scholar
  6. Cartwright, Lisa, Screening the Body: Tracing Medicine’s Visual Culture. Minneapolis: University of Minnesota, 1995.Google Scholar
  7. Dahl, Cortland J., Richard J. Davidson, and Antoine Lutz, “Reconstructing and Deconstructing the Self: Cognitive Mechanisms in Meditation Practice.” Trends in Cognitive Science 19, no. 9 (2015): 515–23.CrossRefGoogle Scholar
  8. Daston, Lorraine, and Peter Galison, Objectivity. Cambridge, MA: MIT Press, 2007.Google Scholar
  9. De Vos, Jan, “The Iconographic Brain: A Critical Philosophical Inquiry into (the Resistance of) the Image.” Frontiers in Human Neuroscience 8 (2014): 1–13.Google Scholar
  10. Dumit, Joseph, Picturing Personhood: Brain Scans and Biomedical Identity. Princeton: Princeton University Press, 2004.Google Scholar
  11. Hansen, Mark B.N., Bodies in Code: Interfaces with Digital Media. London and New York: Routledge, 2006.Google Scholar
  12. Hansen, Mark B.N., Feed Forward: On the Future of Twenty-First Century Media. Chicago: University of Chicago Press, 2015.Google Scholar
  13. Hessler, Martina, and Dieter Mersch, eds., Logik des Bildlichen. Zur Kritik der ikonischen Vernunft. Bielefeld: Transcript, 2009.Google Scholar
  14. Johnston, John, “Machinic Vision.” Critical Inquiry 26, no. 1 (1999): 27–48. CrossRefGoogle Scholar
  15. Kosslyn, Stephen, Image and Brain: The Resolution of the Imagery Debate. Cambridge, MA: MIT Press, 1994.CrossRefGoogle Scholar
  16. Martinovic, Ivan, Doug Davies, and Mario Frank, “On the Feasibility of Side-Channel Attacks with Brain-Computer Interfaces.” In Proceedings of the 21st USENIX Security Symposium (2012).Google Scholar
  17. Milburn, Colin, Nanovision: Engineering the Future. Durham: Duke University Press, 2008.Google Scholar
  18. Mitchell, William J.T., Iconology: Images, Text, Ideology. Chicago: University of Chicago Press, 1986.Google Scholar
  19. Mitchell, William J.T., Picture Theory: Essays on Verbal and Visual Representation. Chicago: University of Chicago Press, 1994.Google Scholar
  20. Munster, Anna, Materializing New Media: Embodiment in Information Aesthetics. Hanover: Dartmouth, 2006.Google Scholar
  21. Scott, Jillian, and Esther Stöckli, Neuromedia: Art and Neuroscience Research. Berlin and Heidelberg: Springer, 2012.CrossRefGoogle Scholar
  22. Slaby, Jan, “Steps Towards a Critical Neuroscience.” Phenomenology and the Cognitive Sciences 9 (2010): 397–416.CrossRefGoogle Scholar
  23. Wittgenstein, Ludwig, Tractatus Logico-Philosophicus. Translated by David Pears and Brian McGuinness. London: Routledge, 1961.Google Scholar

Copyright information

© The Author(s) 2019

Authors and Affiliations

  • Ksenia Fedorova
    • 1
  1. 1.Humboldt UniversityBerlinGermany

Personalised recommendations