Motivational Engine with Sub-goal Identification in Neuroevolution Based Cognitive Robotics

  • Rodrigo Salgado
  • Abraham Prieto
  • Pilar Caamaño
  • Francisco Bellas
  • Richard J. Duro
Conference paper

DOI: 10.1007/978-3-319-32034-2_55

Part of the Lecture Notes in Computer Science book series (LNCS, volume 9648)
Cite this paper as:
Salgado R., Prieto A., Caamaño P., Bellas F., Duro R.J. (2016) Motivational Engine with Sub-goal Identification in Neuroevolution Based Cognitive Robotics. In: Martínez-Álvarez F., Troncoso A., Quintián H., Corchado E. (eds) Hybrid Artificial Intelligent Systems. HAIS 2016. Lecture Notes in Computer Science, vol 9648. Springer, Cham

Abstract

A first approach towards a new motivational system for an autonomous robot that can learn chains of sub-goals leading to a final reward is proposed in this paper. The motivational system provides the motivation that guides the robot operation according to its knowledge of its sensorial space so that rewards are maximized during its lifetime. In order to do this, a motivational engine progressively and interactively creates an internal model of expected future reward (value function) for areas of the robot’s state space, through a neuroevolutionary process, over samples obtained in the sensorial (state space) traces followed by the robot whenever it obtained a reward. To improve this modelling process, a strategy is proposed to decompose the global value function leading to the reward or goal into several more local ones, thus discovering sub-goals that simplify the whole learning process and that can be reused in the future. The motivational engine is tested in a simulated experiment with very promising results.

Keywords

Neuroevolution Cognitive systems Motivation Autonomous robots 

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Rodrigo Salgado
    • 1
  • Abraham Prieto
    • 1
  • Pilar Caamaño
    • 1
  • Francisco Bellas
    • 1
  • Richard J. Duro
    • 1
  1. 1.Integrated Group for Engineering ResearchUniversidade da CoruñaFerrolSpain

Personalised recommendations