Skip to main content

Self-programming Robots Boosted by Neural Agents

  • Conference paper
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 11309))

Abstract

This paper deals with Brain-Inspired robot controllers, based on a special kind of artificial neural structures that burn “dark” energy to promote the self-motivated initiation of behaviors. We exploit this ambient to train a virtual multi-joint robot, with many moving parts, muscles and sensors distributed through the robot body, interacting with elements that satisfy Newtonian laws. The robot faces a logical-mechanical challenge where a heavy, slippery ball, pressed against a wall has to be pushed up by means of coordinate muscles activation, where energy, timing and balancing conditions add noticeable technical complications. As in living brains our robots contains self-motivating neural agents that consumes energy and function by themselves even without external stimulus. Networks that handle sensory and timing information are combined with agents to construct our controller. We prove that by using appropriate learning algorithms, the self-motivating capacity of agents provides the robot with powerful self-programming aptitudes, capable of solving the ball lifting problem in a quick, efficient way.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Martinez, H., Bengio, Y., Yannakakis, G.: Learning deep physiological models of affect. IEEE Comput. Intell. Mag. 8(2), 20–33 (2013). https://doi.org/10.1109/MCI.2013.2247823

    Article  Google Scholar 

  2. Bengio, Y.: Learning deep architectures for AI. Found. Trends Mach. Learn. 2(1), 1–127 (2009). https://doi.org/10.1561/2200000006

    Article  MathSciNet  MATH  Google Scholar 

  3. Maye, A., Hsieh, Ch., Sugihara, G., Brembs, B.: Order in spontaneous behavior. PLoS One 10(1371) (2007). https://doi.org/10.1371/journal.pone.0000443

    Article  Google Scholar 

  4. Brembs, B.: Genetic analysis of behavior in drosophila. Cognition and Behavioral Neuroscience. Online Publication Date February 2017. https://doi.org/10.1093/oxfordhb/9780190456757.013.37

  5. Raichle, M., Snyder, A.Z.: A default mode of brain function: a brief history of an evolving idea. Neuroimage 37(4), 1083–1090 (2007). https://doi.org/10.1016/j.neuroimage.2007.02.041

    Article  Google Scholar 

  6. Raichle, M.E.: Two views of brain function. Trends Cogn. Sci. 14(4), 180–190 (2010). https://doi.org/10.1016/j.tics.2010.01.008

    Article  Google Scholar 

  7. Eban-Rothschild, A., Bloch, G.: Circadian rhythms and sleep in honey bees. In: Galizia, C., Eisenhardt, D., Giurfa, M. (eds.) Honeybee Neurobiology and Behavior, pp. 31–45. Springer, Dordrecht (2012). https://doi.org/10.1007/978-94-007-2099-2_3

    Chapter  Google Scholar 

  8. Palyanov, A., Khayrulin, S., Larson, S.D., Dibert, A.: Towards a virtual C. elegans: a framework for simulation and visualization of the neuromuscular system in a 3D physical environment. In Silico Biol. 11(3–4), 137–147 (2012). https://doi.org/10.3233/isb-2012-0445

    Article  Google Scholar 

  9. Huerta, R.: Learning pattern recognition and decision making in the insect brain. In: AIP Conference Proceedings, vol. 1510, pp. 101–191 (2013). https://doi.org/10.1063/1.4776507

  10. Yiming, J., Chenguang, Y., Jing, N., Guang, L., Yanan, L., Junpei, Z.: A brief review of neural networks based learning and control and their applications for robots. Hindawi Complex. 2017, article ID 1895897, 14 p. (2017). https://doi.org/10.1155/2017/1895897

    MathSciNet  MATH  Google Scholar 

  11. Ran, L., Zhang, Y., Zhang, Q., Yang, T.: Convolutional neural network-based robot navigation using uncalibrated spherical images. 17(6) (2017). https://doi.org/10.3390/s17061341

    Article  Google Scholar 

  12. Ritcher, Ch., Jentzsch, S., Hostettler, R.: Musculoskeletal robots: scalability in neural control. IEEE Robot. Autom. Mag. 23, 4 (2016). https://doi.org/10.1109/MRA.2016.2535081

    Article  Google Scholar 

  13. Heess, N., Hunt, J., Lillicrap, T., Silver, D.: Memory-based control with recurrent neural networks. CoRR abs/1512.04455 (2015). http://arxiv.org/abs/1512.04455

  14. Chang, O.: Evolving cooperative neural agents for controlling vision guided mobile robots. In: Proceedings of 2009 8th IEEE International Conference on Cybernetic Intelligent Systems, 9–10 September 2009, Birmingham University, UK (2009)

    Google Scholar 

  15. Shackleford, B.: Neural data structures: programming with neurons. Hewlett-Packard J. 40(3), 69–78 (1989)

    Google Scholar 

  16. Chang, O.: Autonomous robots and behavior initiators. In: Human-Robot Interaction, Theory and Application (2018, in Press). ISBN 978-953-51-5611-6

    Google Scholar 

  17. Woolridge, M., Jennings, N.R.: Intelligent agents: theory and practice. Knowl. Eng. Rev. 10(2) (1994)

    Google Scholar 

  18. Rensing, L., Meyer-Grahle, U., Ruoff, P.: Biological timing and the clock metaphor: oscillatory and hourglass mechanisms. Chronobiol. Int. 18(3), 329–369 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Oscar Chang .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chang, O. (2018). Self-programming Robots Boosted by Neural Agents. In: Wang, S., et al. Brain Informatics. BI 2018. Lecture Notes in Computer Science(), vol 11309. Springer, Cham. https://doi.org/10.1007/978-3-030-05587-5_42

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-05587-5_42

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-05586-8

  • Online ISBN: 978-3-030-05587-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics