Augmented Reality Art pp 201-214

Part of the Springer Series on Cultural Computing book series (SSCC) | Cite as

Why We Might Augment Reality: Art’s Role in the Development of Cognition



In our investigations, here and elsewhere, art serves a neurological role, shaped by evolution. Art, not as a thing that is, but as a function that occurs, we will call Behavioral Art (BA). An important aspect of BA is “borrowing intelligence” from a humanly organized source, such as a painting, and applies it to a computer process. This process might easily be mistaken for an objet de (computer) art, but we must look further into the larger dynamic system, one that includes the audience as well. As we discuss, the machine itself is incapable of any type of organization. A human (often the programmer) must supply the organizational paradigm to the input, and a human must recognize one in the output. However, by sampling from the environment via machine, a process we can now call Augmented Reality, we might imbue whatever quality triggered an interpretation of “potentially meaningful” in audience members regarding that painting, to our computed output. In this chapter, we address how and why humans tends to employ this particular form of nonverbal expression.


  1. Ackernan J, Bargh J. Two to tango: automatic social coordination and the role of felt effort. In: Bruya B, editor. Effortless attention: a new perspective in the cognitive science of attention and action. Cambridge: MIT Press; 2010. p. 235–71.Google Scholar
  2. Allen S. Finding significance. In: Finding significance, Exploratorium research series. San Francisco: Exploratorium; 2004.Google Scholar
  3. Arbabi F. Classical Persian music (Radif). New York: Freydoon Arbabi/McGraw Hill; 2000.Google Scholar
  4. Ash R. Information theory. Mineola: Dover; 1965.MATHGoogle Scholar
  5. Baron-Cohen S. Autism: the empathizing-systematizing (E-S) theory, cognitive neuroscience 1156. New York: New York Academy of Sciences; 2009.Google Scholar
  6. Bavelas J, Coates A, Johnson T. Listener responses as a collaborative process: the role of gaze. J Commun. 2002;52(3):566–80.CrossRefGoogle Scholar
  7. Becker J. Deep listeners. Bloomington: Indiana University Press; 2004.Google Scholar
  8. Benjamin W. Some remarks on folk art. In: The work of art in the age of its technological reproducibility and other writings on media. Cambridge: Harvard University Press; 1929.Google Scholar
  9. Bjorklund D, Pellegrini A. The origins of human nature: evolutionary developmental psychology. Washington, DC: American Psychological Association; 2001.Google Scholar
  10. Boyd D. Autistic social software. SuperNova conference, San Francisco; 2004. p. 35–45.Google Scholar
  11. Bregman A. Auditory scene analysis. Cambridge, MA: MIT Press; 1999.Google Scholar
  12. Cage J. Silence. Middletown: Wesleyan Paperback; 1961.Google Scholar
  13. Campbell J. The hero with a thousand faces. Novato: New World Library; 1949.Google Scholar
  14. Campbell D. The Mozart effect: tapping the power of music to heal the body, strengthen the mind, and unleash the creative spirit. New York: Avon Books; 1997.Google Scholar
  15. Campbell J, Moyers B. The power of myth. New York: Doubleday; 1988.Google Scholar
  16. Castelfranchi C. For a ‘cognitive anatomy’ of human emotions ad a mind-reading based affective interaction. In: Gökçay D, Yildirim G, editors. Affective computing and interaction: psychological, cognitive, and neuroscientific perspectives. Hershey: IGI Global; 2011. p. 110–32.Google Scholar
  17. Chomsky N. Syntactic structures. Berlin: Walter Gruyter GMBH; 1957.Google Scholar
  18. Chomsky N. New horizons in the study of language and mind. Cambridge: Cambridge University Press; 2000.CrossRefGoogle Scholar
  19. Clancy S. Abducted: how people come to believe they were kidnapped by aliens. Cambridge: Harvard University Press; 2005.Google Scholar
  20. Coe M. Breaking the Maya code. New York: Thames and Hudson; 1999.Google Scholar
  21. Cohen D. Perception and response to schemata in different cultures: Western and Arab music. In: Alderage D, Fachner J, editors. Music and altered states: consciousness, transcendence, therapy, and addictions. London: Jessica Kingsley Publishers; 2006. p. 60–73.Google Scholar
  22. Crystal D. How language works: how babies babble, words change meaning and languages live or die. Woodstock: Overlook Press; 2005.Google Scholar
  23. Curtis S. The joy of movement in early childhood. New York: Teachers College Press; 1992.Google Scholar
  24. Dewey J. How we think. Boston: Dover; 1910.CrossRefGoogle Scholar
  25. Doidge N. The brain that changes itself. New York: Viking; 2007.Google Scholar
  26. Edelman G. Mind without biology. In: Bright air, brilliant fire: on the matter of the mind. New York: Basic Books; 1992. p. 211–52.Google Scholar
  27. Eliot L. What’s going on in there?: how the brain and mind develop in the first five years of life. New York: Bantam Books; 1999.Google Scholar
  28. Fischer J. Where is the information in animal communication? In: Menzel R, Fischer J, editors. Animal thinking: contemporary issues in comparative cognition. Cambridge: MIT Press; 2011. p. 151–62.Google Scholar
  29. Gardner H. Frames of mind: the theory of multiple intelligences. New York: Basic Books; 1983.Google Scholar
  30. Glimcher P. Neuroscience, psychology, and economic behavior: the emerging field of neuroeconomics. In: Tommasi L, Peterson M, Nadel L, editors. Cognitive biology: evolutionary and developmental perspectives on mind, brain, and behavior. Cambridge: MIT Press; 2009. p. 261–78.CrossRefGoogle Scholar
  31. Gold L. Music in Bali. New York: Oxford University Press; 2005.Google Scholar
  32. Hauser M. The evolution of communication. Cambridge: MIT Press; 1998.Google Scholar
  33. Heider F, Simmel A. An experimental study of human behavior. Am J Psychol. 1944;2(57):243–59.CrossRefGoogle Scholar
  34. Hoffman D. Visual intelligence: how we create what we see. New York: Norton; 1998.Google Scholar
  35. Horzyk A, Tadeusiewicz R. Comparison of plasticity of self-optimizing neural networks and natural neural networks. In: Míra J, Álvarez J. editors. Mechanisms, symbols, and models underlying cognition, first international conference on the interplay between natural and artificial computation, Universidad Nacional de Educatión a Disrancia, De Ingenería Informática, Departmento de Inteligencia Artificial 3561. Berlin: Springer; 2005. p. 156–65.Google Scholar
  36. Humphrey T, Gutwill J. Fostering active prolonged engagement. In: Fostering active prolonged engagement, Exploratorium research series. San Francisco: Exploratorium; 2005.Google Scholar
  37. Joseph B. Random order: Robert Rauschenberg and the Neo-Avant-Garde. Cambridge: MIT Press; 2003.Google Scholar
  38. Jourdain R. Music, the brain, and ecstasy: how music captures our imagination. New York: Harper Collins; 1997.Google Scholar
  39. Jung C. The concept of the collective unconscious. In: St Bartholomew’s journal, reprinted in The Portable Jung. Penguin: New York; 1935. p. 59–69.Google Scholar
  40. Kartomi M. Musical strata in Sumatra, Java, and Bali. In: May E, editor. Music of many cultures. Los Angeles: University of California Press; 1980. p. 111–33.Google Scholar
  41. Knapp M, Hall J. Nonverbal communication in human interaction. Belmont: Thompson Higher Education; 2006.Google Scholar
  42. Koch C, Tononi G. A test for consciousness. Sci Am. 2011;6(304):44–7.CrossRefGoogle Scholar
  43. Kohn A. Education and democracy today, progressive education. Nat Assoc Indep Sch. 2008;Spring:1–7.Google Scholar
  44. Lakoff G, Johnson M. Metaphors we live by. Chicago: The University of Chicago Press; 1980.Google Scholar
  45. Lerdahl F, Jackendoff R. A generative theory of tonal music. Cambridge: MIT Press; 1983.Google Scholar
  46. Levitin D. This is your brain on music. New York: Penguin; 2006.Google Scholar
  47. Licklider J. Man-computer symbiosis. IRE Trans Hum Fact Electron. 1960; HFE-1: 4–11.Google Scholar
  48. Millikan R. Pushmi-pullyu representations. In: Nuccetelli S, Seay G, editors. Philosophy of language: central topics. Plymouth: Rowman and Littlefield Publishers, Inc.; 1995. p. 363–76.Google Scholar
  49. Morrow R. Sesame street and the reform of children’s television. Baltimore: The Johns Hopkins University Press; 2006.Google Scholar
  50. Nissan N, Schocken S. The elements of computing systems: building a modern computer from first principles. Cambridge: MIT Press; 2005.Google Scholar
  51. Patel A. Music, language, and the brain. New York: Oxford University Press; 2008.Google Scholar
  52. Phillips D, Soltis J. Perspectives on learning. New York: Teachers College Press; 2009.Google Scholar
  53. Piaget J. The child’s conception of the world. New York: Rowman & Littlefield Publishers, Inc.; 1929.Google Scholar
  54. Piaget J. Play, dreams, and imitation in childhood. New York: W.W. Norton & Co.; 1962.Google Scholar
  55. Piaget J. Genetic epistemology. New York: W.W. Norton & Co.; 1971.Google Scholar
  56. Reeves B, Nass C. The media equation: how people treat computers, television, and new media like real people and places. Cambridge: Cambridge University Press; 1996.Google Scholar
  57. Schmeichal B, Baumeister R. Effortful attention control. In: Bruya B, editor. Effortless attention: a new perspective in the cognitive science of attention and action. Cambridge: MIT Press; 2010. p. 29–50.CrossRefGoogle Scholar
  58. Searle J. Rationality in action. Cambridge: MIT Press; 2001.Google Scholar
  59. Sfard A. Thinking as communicating: human development, the growth of discourse, and mathemetizing. New York: Cambridge University Press; 2008.CrossRefGoogle Scholar
  60. Shanahan M. Solving the frame problem: a mathematical investigation of the common sense law of inertia. Cambridge: MIT Press; 1997.Google Scholar
  61. Shannon C, Weaver W. The mathematical theory of communication. Chicago: University of Illinois Press; 1949.MATHGoogle Scholar
  62. Solso R. The psychology of art and the evolution of the conscious brain. Cambridge: MIT Press; 2003.Google Scholar
  63. Sporns O. Networks of the brain. Cambridge: MIT Press; 2011.Google Scholar
  64. Tough P. How children succeed: grit, curiosity, and the hidden power of character. New York: Houghton Mifflin Publishers; 2012.Google Scholar
  65. von Neumann J, Morgenstern O. The theory of games and economic behavior. Princeton: Princeton University Press; 1944.Google Scholar
  66. Vygotsky L. Mind in society: the development of higher psychological processes. Cambridge: Harvard University Press; 1978.Google Scholar
  67. Vygotsky L. Thought and language. Cambridge: MIT Press; 1986.Google Scholar
  68. Wiener N. Problems of sensory prosthesis. In: Selected papers of Norbert Wiener. Cambridge: MIT Press; 1950. p. 431–9.Google Scholar
  69. Wiener J, Shettleworth S, Bingman V, Cheng K, Healy S, Jacobs L, Jeffrey K, Mallot H, Menzel R, Newcombe N. Animal navigation: a synthesis. In: Menzell R, Fitscher J, editors. Animal thinking: contemporary issues in comparative cognition. Cambridge: MIT Press; 2011. p. 51–76.Google Scholar
  70. Wright J. Neuroacoustics: integrating the strengths of computer technology and human biology through music, Sonic Ideas/Ideas Sónicas 1(3). The Mexican Center for Music and Sonic Arts; 2010.Google Scholar
  71. Wright J. Interaction’s role as catalyst of synthesized intelligence in art. In: Aceti L, Jefferies J, Papadimitriou I (vol. editors) Munro J, Sahin O, editors. Leonardo Electronic Almanac, Publications: Touch and Go (18)3; 2012a. p. 190–99. Leonardo.Google Scholar
  72. Wright J. Borrowed intelligence: observing and implementing the culture of the art world. In: Accolas S, Wanono N, editors. Paris: Création and transmission en Anthropologie Visuelle. Journal des Anthropologues December, AFA (French Association of Anthropologists); 2012b. p. 130–31.Google Scholar
  73. Wright J. Discovering the non-self: the construction of language, trance, and space. In: Broadhurst S, editor. Body Space Technol J. 2013a;2(11):1–12.Google Scholar
  74. Wright J. Can you tell me how to get, how to get to e-learning: development and complexity. In: Eletti V, editors. J e-Learn Knowl Complex. 2013b;3(9):41–53.Google Scholar
  75. Zonis E. Classical Iranian music. In: May E, editor. Music of many cultures. Los Angeles: University of California Press; 1980. p. 269–83.Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  1. 1.Pump OrginNew YorkUSA

Personalised recommendations