Abstract
Learning to survive in a complex environment is a more relevant task for the design of intelligent autonomous machines than complex problem solving. To establish this statement, we emphasize that autonomy requires emotional- and motivational-like characteristics that are much more straightforward to define in the context of survival tasks than in problem solving which is classically considered with intelligent agents. We also propose that using a simulation platform is a good preliminary step before the design of real machines because it allows to consider another fundamental challenge, related to the association of these emotional and motivational characteristics to higher cognitive functions. These considerations are illustrated by current simulations that we are carrying out with a bio-inspired neuronal model of the cerebral architecture of primates.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Alexander, G., DeLong, M., Strick, P.: Parallel organization of functionally segregated circuits linking basal ganglia and cortex. Ann. Rev. Neurosci. 9, 357–381 (1986)
Balleine, B.W., Liljeholm, M., Ostlund, S.B.: The integrative function of the basal ganglia in instrumental conditioning. Behav. Brain Res. 199(1), 43–52 (2009)
Cardinal, R.N., Parkinson, J.A., Hall, J., Everitt, B.J.: Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex. Neurosci. Biobehav. Rev. 26(3), 321–352 (2002)
Carrere, M., Alexandre, F.: A pavlovian model of the amygdala and its influence within the medial temporal lobe. Front. Syst. Neurosci. 9(41) (2015)
Constantino, S.M., Daw, N.D.: Learning the opportunity cost of time in a patch-foraging task. Cogn. Affect. Behav. Neurosci. 15(4), 837–853 (2015)
Damasio, A.R., Everitt, B.J., Bishop, D.: The somatic marker hypothesis and the possible functions of the prefrontal cortex. Philos. Trans. R. Soc. Lond. Ser. B Biol. Sci. 351(1346), 1413–1420 (1996)
Dickinson, A., Balleine, B.W.: The role of learning in the operation of motivational systems. In: Pashler, H., Gallistel, R. (eds.) Stevens’ Handbook of Experimental Psychology, Learning, Motivation and Emotion, vol. 3, 3rd edn, pp. 497–533. Wiley, New York (2002)
Friston, K., FitzGerald, T., Rigoli, F., Schwartenbeck, P., Pezzulo, G., et al.: Active inference and learning. Neurosci. Biobehav. Rev. 68, 862–879 (2016)
Hazy, T.E., Frank, M.J., O’Reilly, R.C.: Banishing the homunculus: making working memory work. Neuroscience 139(1), 105–118 (2006)
Johnson, M., Hofmann, K., Hutton, T., Bignell, D.: The malmo platform for artificial intelligence experimentation. In: IJCAI, pp. 4246–4247 (2016)
Kolling, N., Behrens, T.E., Mars, R.B., Rushworth, M.F.: Neural mechanisms of foraging. Science 336(6077), 95–98 (2012)
Konidaris, G., Barto, A.: An adaptive robot motivational system. In: Nolfi, S., Baldassarre, G., Calabretta, R., Hallam, J.C.T., Marocco, D., Meyer, J.-A., Miglino, O., Parisi, D. (eds.) SAB 2006. LNCS (LNAI), vol. 4095, pp. 346–356. Springer, Heidelberg (2006). https://doi.org/10.1007/11840541_29
Leblois, A., Boraud, T., Meissner, W., Bergman, H., Hansel, D.: Competition between feedback loops underlies normal and pathological dynamics in the basal ganglia. J. Neurosci. 26(13), 3567–3583 (2006)
Matiisen, T., Oliver, A., Cohen, T., Schulman, J.: Teacher-student curriculum learning (2017). arXiv preprint arXiv:1707.00183
Pasquereau, B., Nadjar, A., Arkadir, D., Bezard, E., Goillandeau, M., Bioulac, B., Gross, C.E., Boraud, T.: Shaping of motor responses by incentive values through the basal ganglia. J. Neurosci. 27(5), 1176–1183 (2007)
Redgrave, P., Prescott, T.J., Gurney, K.: The basal ganglia: a vertebrate solution to the selection problem? Neuroscience 89(4), 1009–1023 (1999)
Strannegård, C., Svangård, N., Bach, J., Steunebrink, B.: Generic animats. In: Everitt, T., Goertzel, B., Potapov, A. (eds.) AGI 2017. LNCS (LNAI), vol. 10414, pp. 23–32. Springer, Cham (2017a). https://doi.org/10.1007/978-3-319-63703-7_3
Strannegård, C., Svangård, N., Lindström, D., Bach, J., Steunebrink, B.: The animat path to artificial general intelligence. In: Proceedings of IJCAI-17 Workshop on Architectures for Generality & Autonomy (2017b)
Topalidou, M., Rougier, N.P.: [re] interaction between cognitive and motor cortico-basal ganglia loops during decision making: a computational study. ReScience J. 1(1) (2015)
Acknowledgements
We would like to acknowledge Thierry Viéville, INRIA Sophia Antipolis, France, for his collaboration.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2018 Springer International Publishing AG, part of Springer Nature
About this paper
Cite this paper
Nallapu, B.T., Alexandre, F. (2018). A Survival Task for the Design and the Assessment of an Autonomous Agent. In: Vouloutsi , V., et al. Biomimetic and Biohybrid Systems. Living Machines 2018. Lecture Notes in Computer Science(), vol 10928. Springer, Cham. https://doi.org/10.1007/978-3-319-95972-6_36
Download citation
DOI: https://doi.org/10.1007/978-3-319-95972-6_36
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-95971-9
Online ISBN: 978-3-319-95972-6
eBook Packages: Computer ScienceComputer Science (R0)