Skip to main content
Log in

A Theory of Resonance: Towards an Ecological Cognitive Architecture

  • Published:
Minds and Machines Aims and scope Submit manuscript

Abstract

This paper presents a blueprint for an ecological cognitive architecture. Ecological psychology, I contend, must be complemented with a story about the role of the CNS in perception, action, and cognition. To arrive at such a story while staying true to the tenets of ecological psychology, it will be necessary to flesh out the central metaphor according to which the animal perceives its environment by ‘resonating’ to information in energy patterns: what is needed is a theory of resonance. I offer here the two main elements of such a theory: a framework (Anderson’s neural reuse) and a methodology (multi-scale fractal DST).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

Notes

  1. It is important to note that I use the wording “computational approach” or “computationalism” in the broadest possible sense. This means that by these terms I refer both to classic computational approaches (Fodor 1975) and to new computational-like ones (e.g., Clark 2015). If it is more comfortable for the reader, “computational approach” may be understood as “information-processing approach”.

  2. See Chemero (2009) for a contemporary account of ecological psychology.

  3. The explanation in ecological terms is, of course, more technical and complicated and involves the ecological variable tau, for example. I left these details out of the text to avoid technicalities that do not add too much to its purpose. See Todd (1981) for a deeper study of those technicalities.

  4. Gibson (1966) famously introduced the concept of perceptual system to capture the role of many parts of organisms and their very action as constitutive elements of perceptual processes. The visual system, for example, is constituted by the CNS, but also by the peripheral nervous system, and the eyes placed in a movable head, which at the same time is placed in a movable body, etc. All these elements are relevant to explain visual perception, and a theory of resonance based just on the CNS-environment interactions will be inadequate for grasping its complexity.

  5. Both Gibson’s main books (1966, 1979) and classic texts on ecological psychology (Turvey et al. 1981; Michaels and Carello 1981; Lombardo 1987; Reed 1997) offer arguments against computation. Such arguments may be also found in the contemporary ecological psychology literature (e.g., Richardson et al. 2008; Chemero 2009; Michaels and Palatinus 2014).

  6. Other reasons such as the necessity of a homunculus (Turvey et al. 1981, 1982) or the appeal to loans of intelligence (Dennett 1978; Kugler and Turvey 1987) to any computational theory to work have been described in the literature as well. I will not review them here due to the lack of space.

  7. See Chomsky (1980) or Fodor (1981) for the argument. See Michaels and Carello (1981), for a critique from ecological psychology.

  8. In his influential textbook Cognitive Psychology (1967), Neisser claims: “These patterns of light at the retina are… one-sided in their perspective, shifting radically several times each second, unique and novel every moment… bear little resemblance to either the real object that gave rise to them or to the object of experience that the perceiver will construct… Visual cognition, then, deals with the process by which a perceived, remembered, and thought-about world is brought into being from as unpromising a beginning as the retinal patterns.” (pp. 7–8).

  9. Marr (1982), for instance, famously offered a mechanism for the construction of a 3D image from a 2D one, going through an intermediate step known as 2D1/2.

  10. Chemero’s example can be further reinforced. In the classical interpretation of the visual event, perception happens at the end of the inner computational chain: we perceive the representation of the of outer object, and such a representation is at the last link of the chain. According to most ecological psychologists, perception is the whole chain. Perception is a state of the whole animal-environment system as a physical system. The inner end of the chain is not special in any regard. This is another way in which the idea of computation is incompatible with the main tenets of ecological psychology.

  11. I will not deny the possibility of finding a way to interpret Anderson’s proposals in After Phrenology as computational. However, I think there are unambiguous claims explicitly pointing to anti-computationalism, such as: “[I]t is worth an initial if brief reflection on an important disanalogy between the brain and a computer: whereas a computer is typically understood as a device that carries out a specific instruction set on (and in response to) inputs, brain responses to stimuli are characterized instead by specific deviations from intrinsic dynamics.” (Anderson 2014, p. xx). Or: “My current approach to this problem… is to quantify the functional properties of neural assemblies in a multidimensional manner, in terms of their tendency to respond across a range of circumstances—that is, in terms of their dispositional tendencies—rather than trying to characterize their activities in terms of computational or information-processing operations.” (Anderson 2014, p. xxii–xxii).

  12. Interestingly enough, it is possible that Gibson also had in mind an idea similar to neural reuse for the functional organization of the brain. In his Gibson biography, Reed (1988) refers and quotes some unpublished works in the Gibson archive at Cornell University. He writes: “Considering the capacity of the nervous system to adjust to stimulation in many different ways, Gibson hypothesized that ‘a given set of neurons is equipotential for various different functions in perception and behavior. The same neuron may be excited for different uses at different times. [Therefore] neurons, nerves, and parts of the brain have a vicarious function. A nerve cell is not the same unit in a different combination of nerve cells.’ (Ibid.)” (Reed 1988, p. 224; emphasis is mine). The similarity with neural reuse is, again, astonishing and reinforces the parallelism between both theories I am defending here.

  13. This aspect is crucial regarding NSF’s grand challenges for the sciences of the mind. More on this in the last section.

  14. This is the collective variable of the HKB model, one of the most famous instantiations of the explanation of a behavior by the appeal to an ecological variable (Haken et al. 1985).

  15. Any kind of comprehensive account of such details is completely out of the scope of this work. However, the NSF’s Tutorial in Contemporary Non-Linear Methods for the Behavioral Sciences (edited by Guy van Orden and Michael Riley) is a good introduction to the field. See: https://www.nsf.gov/sbe/bcs/pac/nmbs/nmbs.jsp.

  16. A full account of active search is out of the scope of this paper, but the idea is that once the CNS system is described in terms of metastability and self-organized criticality, active search becomes a phenomenon easy to explain.

References

  • Aks, D. J. (2005). 1/f Dynamic in complex visual search: Evidence for self-organized criticality in human perception. In M. A. Riley & G. C. Van Orden (Eds.), Tutorials in contemporary nonlinear methods for the behavioral sciences (pp. 319–352). http://www.nsf.gov/sbe/bcs/pac/nmbs/nmbs.jsp.

  • Anderson, M. L. (2010). Neural reuse: A fundamental organization principle of the brain. Behavioral and Brain Sciences, 33, 245–313.

  • Anderson, M. L. (2014). After phrenology: Neural reuse and the interactive brain. Cambridge, MA: MIT Press.

    Google Scholar 

  • Bak, P. (1996). How nature work: The science of self-organized criticality. New York: Copernicus.

    Book  MATH  Google Scholar 

  • Beer, R. D. (1995). A dynamical systems perspective on agent-environment Interaction. Artificial Intelligence, 72, 173–215.

    Article  Google Scholar 

  • Bizzarri, M., Giuliani, A., Cucina, A., D’Anselmi, F., Soto, A. M., & Sonnenschein, C. (2011). Fractal analysis in a systems biology approach to cancer. Seminars in Cancer Biology, 21, 175–182.

    Article  Google Scholar 

  • Calvo, P., & Gomila, T. (2008). Handbook of cognitive science: An embodied approach. San Diego, CA: Elsevier.

    Google Scholar 

  • Calvo, P., & Symmons, J. (2014). The architecture of cognition. Cambridge, MA: MIT Press.

    Book  Google Scholar 

  • Chemero, A. (2009). Radical embodied cognitive science. Cambridge, MA: MIT Press.

    Google Scholar 

  • Chomsky, N. (1980). Rules and representations. Oxford, UK: Basil Blackwell.

    Google Scholar 

  • Clark, A. (2015). Surfing uncertainty. London, UK: Oxford University Press.

    Google Scholar 

  • de Rugy, A., Taga, G., Montagne, G., Buekers, M. J., & Laurent, M. (2002). Perception-action coupling model for human locomotor pointing. Biological Cybernetics, 87, 141–150.

    Article  MATH  Google Scholar 

  • Dennett, D. I. (1978). Brainstorms: Philosophical essays on mind and psychology. Montgomery, VT: Bradford Books.

    Google Scholar 

  • Edelman, S. (2008). Computing the mind: How the mind really works. Oxford, UK: Oxford University Press.

    Google Scholar 

  • Eliasmith, C. (2013). How to build a brain. New York: Oxford University Press.

    Book  Google Scholar 

  • Favela, L. H. (2014). Radical embodied cognitive neuroscience: Addressing “Grand Challenges” of the mind sciences. Frontiers in Human Neuroscience, 8, 796.

    Article  Google Scholar 

  • Fink, P., Foo, P., & Warren, W. (2009). Catching fly balls in virtual reality: A critical test of the outfielder problem. Journal of Vision, 9(13), 1–8. doi:10.1167/9.13.14

    Article  Google Scholar 

  • Fodor, J. A. (1975). The language of thought. Cambridge, MA: Harvard University Press.

    Google Scholar 

  • Fodor, J. A. (1981). Representations: Philosophical essays on the foundations of cognitive science. Cambridge, MA: The MIT Press.

    Google Scholar 

  • Gallistel, C. R., & King, A. P. (2009). Memory and the computational brain: Why cognitive science will transform neuroscience. Oxford, UK: Wiley-Blackwell.

    Book  Google Scholar 

  • Gibson, J. J. (1966). The Senses considered as perceptual systems. Boston, MA: Houghton Miffin.

    Google Scholar 

  • Gibson, J. J. (1979). The ecological approach to visual perception. Boston, MA: Houghton Miffin.

    Google Scholar 

  • Haken, H., Kelso, J. A. S., & Bunz, H. (1985). A theoretical model of phase transitions in human hand movements. Biological Cybernetics, 51, 347–356.

    Article  MathSciNet  MATH  Google Scholar 

  • Hutto, D., & Myin, E. (2013). Radicalizing enactivism: Basic minds without content. Cambridge, MA: MIT Press.

    Google Scholar 

  • Ibáñez-Gijón, J., Buekers, M., Morice, A., Rao, G., Mascret, N., Laurin, J., et al. (2016). A scale-based approach to interdisciplinary research and expertise in sports. Journal of Sports Sciences. doi:10.1080/02640414.2016.1164330.

    Google Scholar 

  • Juarrero, A. (1999). Dynamics in action: Intentional behavior as a complex system. Cambridge, MA: The MIT Press.

    Google Scholar 

  • Kelso, J. A. S., & Tognoli, E. (2007). Toward a complementary neuroscience: Metastable coordination dynamics of the brain. In L. I. Perlovsky & R. Kozma (Eds.), Neurodynamics of cognition and consciousness (pp. 39–59). Berlin: Springer.

    Chapter  Google Scholar 

  • Kiverstein, J., & Miller, M. (2015). The embodied brain: Towards a radical embodied cognitive neuroscience. Frontiers in Human Neuroscience, 9, 237.

    Article  Google Scholar 

  • Kugler, P. N., & Turvey, M. T. (1987). Information, natural law, and the self-assembly of rhythmic movement. Hillsdale, NJ: Lawrence Erlbaum Associates.

    Google Scholar 

  • Lamarque, C.-H., Ture Savadkooh, A., Etcheverria, E., & Dimitrijevic, Z. (2012). Multi-scale dynamics of two coupled nonsmooth systems. International Journal of Bifurcation and Chaos, 22(12), 1250295.

    Article  MathSciNet  MATH  Google Scholar 

  • Large, E. W. (2008). Resonating to musical rhythm: Theory and experiment. In S. Grondin (Ed.), The psychology of time. West Yorkshire: Emerald.

    Google Scholar 

  • Large, E. W., Kim, J. C., Flaig, N. K., Bharucha, J. J., & Krumhansl, C. L. (2016). A neurodynamic account of musical tonality. Music Perception, 33(3), 319–331.

    Article  Google Scholar 

  • Lee, D. N. (2009). General tau theory: Evolution to date. Special issue: Landmarks in perception. Perception, 38, 837–858.

    Article  Google Scholar 

  • Liebovitch, L. S., & Shehadeh, L. A. (2005). Introduction to Fractals. In M. A. Riley & G. C. Van Orden (Eds.), Tutorials in contemporary nonlinear methods for the behavioral sciences (pp. 178–266). http://www.nsf.gov/sbe/bcs/pac/nmbs/nmbs.jsp.

  • Lombardo, T. J. (1987). The reciprocity of perceiver and environment. In The evolution of James J. Gibson’s ecological psychology. New Jersey: Lawrence Erlbaum Associates.

  • Marr, D. (1982). Vision: A computational investigation into the human representation and processing of visual information. New York: Freeman.

    Google Scholar 

  • McBeath, M. K., Shaffer, D. M., & Kaiser, M. K. (1995). How baseball outfielders determine where to run to catch fly balls. Science, 268(5210), 569–573.

    Article  Google Scholar 

  • Merchant, H., Battaglia-Mayer, A., & Georgopoulos, A. P. (2004). Neural responses during interception of real and apparent circularly moving stimuli in motor cortex and area 7a. Cerebral Cortex, 14, 314–331.

    Article  Google Scholar 

  • Michaels, C., & Carello, C. (1981). Direct perception. Englewood Cliffs, NJ: Prentice-Hall.

    Google Scholar 

  • Michaels, C., & Palatinus, Z. (2014). A ten commandments for ecological psychology. In L. Shapiro (Ed.), The Routledge handbook of embodied cognition (pp. 19–28). New York, NY: Routledge.

    Google Scholar 

  • Milkowski, M. (2013). Explaining the computational mind. Cambridge, MA: MIT Press.

    Google Scholar 

  • Moreau, A. L. D., Lorite, G. S., Rodrigues, C. M., Souza, A. A., & Cotta, A. (2009). Fractal Analysis of Xylella fastidiosa Biofilm Formation. Journal of Applied Physics. doi:10.1063/1.13173172.

    Google Scholar 

  • Neisser, U. (1967). Cognitive psychology. Englewood Cliffs, NJ: Prentice-Hall.

    Google Scholar 

  • O’Regan, J. K., & Noë, A. (2001). A sensorimotor account of vision and visual consciousness. Brain and Behavioral Sciences, 24, 939–1031.

    Article  Google Scholar 

  • Orekhova, E. V., Stroganova, T. A., & Posikera, I. N. (1999). Theta synchronization during sustained anticipatory attention in infants over the second half of the first year of life. International Journal of Psychophysiology, 32, 151–172.

    Article  Google Scholar 

  • Ouyang, F.-Y., Zheng, B., & Jiang, X.-F. (2015). Intrinsic multi-scale dynamic behaviors of complex financial systems. PLoS ONE, 10(10), e0139420.

    Article  Google Scholar 

  • Port, N. L., Kruse, W., Lee, D., & Georgopoulos, A. P. (2001). Motor cortical activity during interception of moving targets. Journal of Cognitive Neuroscience, 13, 306–318.

    Article  Google Scholar 

  • Raja, V., Biener, Z., & Chemero, A. (2017). From Kepler to Gibson. Ecological Psychology, 29(2), 146–160.

    Article  Google Scholar 

  • Reed, E. S. (1988). James J. Gibson and the Psychology of Perception. New Haven, CT: Yale University Press.

    Google Scholar 

  • Reed, E. S. (1997). Encountering the world: Toward an ecological psychology. New York, NY: Oxford University Press.

    Book  Google Scholar 

  • Richardson, M. J., Shockley, K., Fajen, B. R., Riley, M. A., & Turvey, M. T. (2008). Ecological psychology: Six principles for an embodied-embedded approach to behavior. In P. Calvo & T. Gomila (Eds.), Handbook of cognitive science: An embodied approach (pp. 161–188). San Diego, CA: Elsevier.

    Google Scholar 

  • Riley, M. A., & Van Orden, G. C. (Eds.) (2005). Tutorials in contemporary nonlinear methods for the behavioral sciences. http://www.nsf.gov/sbe/bcs/pac/nmbs/nmbs.jsp.

  • Rumelhart, D. E., McClelland, J. L., & The PDP Research Group. (1986). Parallel distributed processing (Vol. 1 & 2). Cambridge, MA: MIT Press.

    Google Scholar 

  • Shaffer, D. M., Krauchunas, S. M., Eddy, M., & McBeath, M. K. (2004). How dogs navigate to catch frisbees. Psychological Science, 15(7), 437–441.

    Article  Google Scholar 

  • Shapiro, L. (2014). The Routledge handbook of embodied cognition. New York, NY: Routledge.

    Google Scholar 

  • Taga, G. (1998). A model of the neuro-musculo-skeletal system for anticipatory adjustment of human locomotion during obstacle avoidance. Biological Cybernetics, 78, 9–17.

  • Todd, J. T. (1981). Visual information about moving objects. Journal of Experimental Psychology: Human Perception and Performance, 7(4), 795–810.

    Google Scholar 

  • Tognoli, E., & Kelso, J. A. S. (2014). The metastable brain. Neuron, 81, 35–48.

    Article  Google Scholar 

  • Tuller, B., Fitch, H. L., & Turvey, M. T. (1982). The Bernstein perspective: II. The concept of muscle linkage or coordinative structure. In J. A. S. Kelso (Ed.), Understanding human motor control. Champaign, IL: Human Kinetics.

    Google Scholar 

  • Turvey, M. T. (1992). Ecological foundations of cognition: Invariants of perception and action. In H. L. Herbert, P. W. van der Broek, & D. C. Knill (Eds.), Cognition: conceptual and methodological issues (pp. 85–117). Washington, DC, US: American Psychological Association.

    Chapter  Google Scholar 

  • Turvey, M. T., Fitch, H. L., & Tuller, B. (1982). The Bernstein perspective: I. The problems of degrees of freedom and context-conditioned variability. In J. A. S. Kelso (Ed.), Understanding human motor control. Champaign, IL: Human Kinetics.

    Google Scholar 

  • Turvey, M. T., Shaw, R., Reed, E. S., & Mace, W. (1981). Ecological laws for perceiving and acting: A reply to Fodor and Pylyshyn. Cognition, 10, 237–304.

    Article  Google Scholar 

  • van der Weel, F. R., & van der Meer, A. L. H. (2009). Seeing it coming: Infants’ brain responses to looming danger. Naturwissenschaften, 96, 1385–1391.

    Article  Google Scholar 

  • Van Orden, G. C., Holden, J. G., & Turvey, M. T. (2003). Self-organization of cognitive performance. Journal of Experimental Psychology: General, 132(3), 331–350.

    Article  Google Scholar 

  • Van Orden, G. C., Hollis, G., & Wallot, S. (2012). The blue-collar brain. Frontiers in Psychology, 3, 207.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Vicente Raja.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Raja, V. A Theory of Resonance: Towards an Ecological Cognitive Architecture. Minds & Machines 28, 29–51 (2018). https://doi.org/10.1007/s11023-017-9431-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11023-017-9431-8

Keywords

Navigation