Why deep neural nets cannot ever match biological intelligence and what to do about it?
- 5k Downloads
The recently introduced theory of practopoiesis offers an account on how adaptive intelligent systems are organized. According to that theory, biological agents adapt at three levels of organization and this structure applies also to our brains. This is referred to as tri-traversal theory of the organization of mind or for short, a T3-structure. To implement a similar T3-organization in an artificially intelligent agent, it is necessary to have multiple policies, as usually used as a concept in the theory of reinforcement learning. These policies have to form a hierarchy. We define adaptive practopoietic systems in terms of hierarchy of policies and calculate whether the total variety of behavior required by real-life conditions of an adult human can be satisfactorily accounted for by a traditional approach to artificial intelligence based on T2-agents, or whether a T3-agent is needed instead. We conclude that the complexity of real life can be dealt with appropriately only by a T3-agent. This means that the current approaches to artificial intelligence, such as deep architectures of neural networks, will not suffice with fixed network architectures. Rather, they will need to be equipped with intelligent mechanisms that rapidly alter the architectures of those networks.
KeywordsArtificial intelligence neural networks strong artificial intelligence practopoiesis machine learning
The author would like to thank Hrvoje Nikolić, Raul C. Muresan, Shan Yu and Matt Mahoney for valuable comments on previous versions of the manuscript.
- D. Nikolić. Practopoiesis: How cybernetics of biology can help AI. [Online], Availabe: https://www.singularityweblog.com/practopoiesis/, 2014.Google Scholar
- R. S. Sutton, A. G. Barto. Reinforcement Learning, Cambridge, Mass, USA: MIT Press, 1998.Google Scholar
- C. J. C. H. Watkins. Learning from Delayed Rewards, Ph.D. dissertation, Cambridge University, UK, 1989.Google Scholar
- T. M. Bartol, C. Bromer, J. P. Kinney, M. A. Chirillo, J. N. Bourne, K. M. Harris, T. J. Sejnowski. Hippocampal spine head sizes are highly precise. bioRxiv, [Online], Available: http://dx.doi.org/10.1101/016329, March 11, 2015.Google Scholar
- R. W. Engle, M. Kane, S. W. Tuholski. Individual differences in working memory capacity and what they tell us about controlled attention, general fluid intelligence, and functions of the prefrontal cortex. Models of Working Memory: Mechanisms of Active Maintenance and Executive Control, A. Miyake, P. Shah, Eds., Cambridge, USA: Cambridge University Press, pp. 102–134, 1999.CrossRefGoogle Scholar
- A. Cervatiuc. Highly Proficient Adult Non-native English Speakers’ Perceptions of their Second Language Vocabulary Learning Process, Ph.D. dissertation, University of Calgary, Canada, 2007.Google Scholar
- P. Nation, R. Waring. Vocabulary size, text coverage and word lists. Vocabulary: Description, Acquisition and Pedagogy, N. Schmitt, M. McCarthy, Eds., Cambridge, USA: Cambridge University Press, pp. 6–19, 1997.Google Scholar
- D. Nikolić. Testing the theory of practopoiesis using closed loops. Closed Loop Neuroscience, A. El Hady, Ed., Amsterdam: Academic Press, 2016.Google Scholar
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.