Evolution of Neuro-controllers for Multi-link Robots

  • José Antonio H. Martín
  • Javier de Lope
  • Matilde Santos
Part of the Advances in Soft Computing book series (AINSC, volume 44)


A general method to learn the inverse kinematics of multi-link robots by means of neuro-controllers is presented. We can find analytical solutions for the most used and known robots in the bibliography. However, these solutions are specific to a particular robot configuration and are not generally applicable to other robot morphologies. The proposed method is general in the sense that it is not dependant on the robot morphology. We base our method in the Evolutionary Computation paradigm for obtaining incrementally better neuro-controllers. Furthermore, the proposed method solves some very specific issues in robotic neuro-controller learning. (1) It allows to escape from any neural network learning algorithm which relies on the classical supervised input-target learning scheme and hence it lets to obtain neuro-controllers without providing targets or correct answers which -in this case- are un known in prior. (2) It can converge beyond local optimal solutions which is one of the main drawbacks of some neural-network training algorithms based on gradient descent when applied to highly redundant robot morphologies. (3) Using learning algorithms such as the Neuro-Evolution of Augmenting Topologies (NEAT) it is also possible learning the neural network topology on-the-fly which is a common source of empirical testing in neuro-controllers design. Finally, experimental results are provided by applying the method in two multi-link robot learning tasks with a comparison between fixed and learnable topologies.


Neuro-Evolution Multi-Link Robots Inverse Kinematics Reinforcement Learning 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    J. Denavit and R. Hartenberg. A kinematic notation for lower-pair mechanisms based on matrices. ASME J. Applied Mechanics, pp. 215–221, June 1955.Google Scholar
  2. 2.
    P.J. Angeline, G.M. Saunders, and J.B. Pollack. An evolutionary algorithm that constructs recurrent neural networks. IEEE Trans. Neural Networks, 5(1):54–65, 1994.CrossRefGoogle Scholar
  3. 3.
    N. Hansen and A. Ostermeier. Adapting arbitrary normal mutation distributions in evolution strategies: The covariance matrix adaptation. In Int. Conf. on Evolutionary Computation, pp 312–317, 1996.Google Scholar
  4. 4.
    K.O. Stanley and R. Miikkulainen. Evolving neural networks through augmenting topologies. Evol. Comput., 10(2):99–127, 2002.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2007

Authors and Affiliations

  • José Antonio H. Martín
    • 1
  • Javier de Lope
    • 2
  • Matilde Santos
    • 1
  1. 1.Facultad de InformáticaUniversidad Complutense de MadridMadrid
  2. 2.Dept. Sistemas Inteligentes AplicadosUniversidad Politécnica de MadridMadrid

Personalised recommendations