Self-programming Robots Boosted by Neural Agents

  • Oscar ChangEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11309)


This paper deals with Brain-Inspired robot controllers, based on a special kind of artificial neural structures that burn “dark” energy to promote the self-motivated initiation of behaviors. We exploit this ambient to train a virtual multi-joint robot, with many moving parts, muscles and sensors distributed through the robot body, interacting with elements that satisfy Newtonian laws. The robot faces a logical-mechanical challenge where a heavy, slippery ball, pressed against a wall has to be pushed up by means of coordinate muscles activation, where energy, timing and balancing conditions add noticeable technical complications. As in living brains our robots contains self-motivating neural agents that consumes energy and function by themselves even without external stimulus. Networks that handle sensory and timing information are combined with agents to construct our controller. We prove that by using appropriate learning algorithms, the self-motivating capacity of agents provides the robot with powerful self-programming aptitudes, capable of solving the ball lifting problem in a quick, efficient way.


Neural agents Self-programming robots Artificial intelligence 


  1. 1.
    Martinez, H., Bengio, Y., Yannakakis, G.: Learning deep physiological models of affect. IEEE Comput. Intell. Mag. 8(2), 20–33 (2013). Scholar
  2. 2.
    Bengio, Y.: Learning deep architectures for AI. Found. Trends Mach. Learn. 2(1), 1–127 (2009). Scholar
  3. 3.
    Maye, A., Hsieh, Ch., Sugihara, G., Brembs, B.: Order in spontaneous behavior. PLoS One 10(1371) (2007). Scholar
  4. 4.
    Brembs, B.: Genetic analysis of behavior in drosophila. Cognition and Behavioral Neuroscience. Online Publication Date February 2017.
  5. 5.
    Raichle, M., Snyder, A.Z.: A default mode of brain function: a brief history of an evolving idea. Neuroimage 37(4), 1083–1090 (2007). Scholar
  6. 6.
    Raichle, M.E.: Two views of brain function. Trends Cogn. Sci. 14(4), 180–190 (2010). Scholar
  7. 7.
    Eban-Rothschild, A., Bloch, G.: Circadian rhythms and sleep in honey bees. In: Galizia, C., Eisenhardt, D., Giurfa, M. (eds.) Honeybee Neurobiology and Behavior, pp. 31–45. Springer, Dordrecht (2012). Scholar
  8. 8.
    Palyanov, A., Khayrulin, S., Larson, S.D., Dibert, A.: Towards a virtual C. elegans: a framework for simulation and visualization of the neuromuscular system in a 3D physical environment. In Silico Biol. 11(3–4), 137–147 (2012). Scholar
  9. 9.
    Huerta, R.: Learning pattern recognition and decision making in the insect brain. In: AIP Conference Proceedings, vol. 1510, pp. 101–191 (2013).
  10. 10.
    Yiming, J., Chenguang, Y., Jing, N., Guang, L., Yanan, L., Junpei, Z.: A brief review of neural networks based learning and control and their applications for robots. Hindawi Complex. 2017, article ID 1895897, 14 p. (2017). Scholar
  11. 11.
    Ran, L., Zhang, Y., Zhang, Q., Yang, T.: Convolutional neural network-based robot navigation using uncalibrated spherical images. 17(6) (2017). Scholar
  12. 12.
    Ritcher, Ch., Jentzsch, S., Hostettler, R.: Musculoskeletal robots: scalability in neural control. IEEE Robot. Autom. Mag. 23, 4 (2016). Scholar
  13. 13.
    Heess, N., Hunt, J., Lillicrap, T., Silver, D.: Memory-based control with recurrent neural networks. CoRR abs/1512.04455 (2015).
  14. 14.
    Chang, O.: Evolving cooperative neural agents for controlling vision guided mobile robots. In: Proceedings of 2009 8th IEEE International Conference on Cybernetic Intelligent Systems, 9–10 September 2009, Birmingham University, UK (2009)Google Scholar
  15. 15.
    Shackleford, B.: Neural data structures: programming with neurons. Hewlett-Packard J. 40(3), 69–78 (1989)Google Scholar
  16. 16.
    Chang, O.: Autonomous robots and behavior initiators. In: Human-Robot Interaction, Theory and Application (2018, in Press). ISBN 978-953-51-5611-6Google Scholar
  17. 17.
    Woolridge, M., Jennings, N.R.: Intelligent agents: theory and practice. Knowl. Eng. Rev. 10(2) (1994)Google Scholar
  18. 18.
    Rensing, L., Meyer-Grahle, U., Ruoff, P.: Biological timing and the clock metaphor: oscillatory and hourglass mechanisms. Chronobiol. Int. 18(3), 329–369 (2001)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Yachay Tech UniversityUrcuquiEcuador

Personalised recommendations