Evolution of Biped Walking Using Neural Oscillators and Physical Simulation

  • Daniel Hein
  • Manfred Hild
  • Ralf Berger
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5001)


Controlling a biped robot with a high degree of freedom to achieve stable movement patterns is still an open and complex problem, in particular within the RoboCup community. Thus, the development of control mechanisms for biped locomotion have become an important field of research. In this paper we introduce a model-free approach of biped motion generation, which specifies target angles for all driven joints and is based on a neural oscillator. It is potentially capable to control any servo motor driven biped robot, in particular those with a high degree of freedom, and requires only the identification of the robot’s physical constants in order to provide an adequate simulation. The approach was implemented and successfully tested within a physical simulation of our target system - the 19-DoF Bioloid robot. The crucial task of identifying and optimizing appropriate parameter sets for this method was tackled using evolutionary algorithms. We could show, that the presented approach is applicable in generating walking patterns for the simulated biped robot. The work demonstrates, how the important parameters may be identified and optimized when applying evolutionary algorithms. Several so evolved controllers were capable of generating a robust biped walking behavior with relatively high walking speeds, even without using sensory information. In addition we present first results of laboratory experiments, where some of the evolved motions were tried to transfer to real hardware.


Biped Walking Humanoid Robot Simulation Evolutionary Algorithms Walking Controllers Neural Oscillators 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Hashimoto, S., Narita, S., Kasahara, H., et al.: Humanoid Robots in Waseda University–Hadaly-2 and WABIAN. Auton. Robots 12(1), 25–38 (2002)MATHCrossRefGoogle Scholar
  2. 2.
    Vukobratović, M., Borovac, B.: Zero-Moment Point – Thirty Five Years of its Life. International Journal of Humanoid Robots 1(1), 157–173 (2004)CrossRefGoogle Scholar
  3. 3.
    Grillner, S.: Neurobiological Bases of Rhythmic Motor Acts in Vertebrates. Science 228(4696), 143–149 (1985)CrossRefGoogle Scholar
  4. 4.
    Grillner, S.: Neural Networks for Vertebrate Locomotion. j-SCI-AMER 274(1) (January 1996)Google Scholar
  5. 5.
    Ijspeert, A.J.: The Handbook of Brain Theory and Neural Networks. In: Arbib, M. (ed.) Locomotion, Vertebrate, 2nd edn., pp. 649–654. MIT Press (2002)Google Scholar
  6. 6.
    Ijspeert, A.J., Cabelguen, J.-M.: Gait Transition from Swimming to Walking: Investigation of Salamander Locomotion Control Using Nonlinear Oscillators. Technical report, Swiss Federal Institute of Technology (2002)Google Scholar
  7. 7.
    Chiel, H.J., Beer, R.D., Gallagher, J.C.: Evolution and Analysis of Model CPGs for Walking: I. Dynamical Modules. Journal of Computational Neuroscience 7(2) (1999)Google Scholar
  8. 8.
    Beer, R.D., Chiel, H.J., Gallagher, J.C.: Evolution and Analysis of Model CPGs for Walking: II. General Principles and Individual Variability. Journal of Computational Neuroscience 7(2), 119–147 (1999)CrossRefGoogle Scholar
  9. 9.
    Matsuoka, K.: Mechanisms of Frequency and Pattern Control in the Neural Rhythm Generators. Biological Cybernetics 56(5–6), 345–353 (1987)CrossRefGoogle Scholar
  10. 10.
    Miyakoshi, S., Taga, G., Kuniyoshi, Y., Nagakubo, A.: Three Dimensional Bipedal Stepping Motion Using Neural Oscillators — Towards Humanoid Motion in the Real World. In: Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (1998)Google Scholar
  11. 11.
    Endo, G., Nakanishi, J., Morimoto, J., Cheng, G.: Experimental Studies of a Neural Oscillator for Biped Locomotion with QRIO. In: IEEE 2005: International Conference on Robotics & Automation (2005)Google Scholar
  12. 12.
    Fujii, A., Ishiguro, A., Eggenberger, P.: Evolving a CPG Controller for a Biped Robot with Neuromodulation. In: Proceedings of the 5th International Conference on Climbing and Walking Robots, Paris, France, pp. 17–24 (2002)Google Scholar
  13. 13.
    Endo, K., Maeno, T., Kitano, H.: Co-Evolution of Morphology and Walking Pattern of Biped Humanoid Robot Using Evolutionary Computation - Consideration of Characteristic of the Servomotors. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2002), pp. 787–792 (2002)Google Scholar
  14. 14.
    Smith, R.: Homepage of Open Dynamics Engine project, http://www.ode.org
  15. 15.
    Chapeau-Blondeau, F., Chauvet, G.A.: Stable, Oscillatory, and Chaotic Regimes in the Dynamics of Small Neural Networks with Delay. Neural Networks 5(5) (1992)Google Scholar
  16. 16.
    Haschke, R., Steil, J.J., Ritter, H.: Controlling Oscillatory Behavior of a Two Neuron Recurrent Neural Network Using Inputs. In: Proc. of the Int. Conf. on Artificial Neural Networks (ICANN), Wien, Austria (2001)Google Scholar
  17. 17.
    Pasemann, F., Hild, M., Zahedi, K.: SO(2)-Networks as Neural Oscillators. In: IWANN (1), pp. 144–151 (2003)Google Scholar
  18. 18.
    Thompson, J.M.T., Stewart, H.B.: Nonlinear Dynamics and Chaos, 2nd edn. John Wiley & Sons, Chichester (2002)MATHGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2008

Authors and Affiliations

  • Daniel Hein
    • 1
  • Manfred Hild
    • 1
  • Ralf Berger
    • 1
  1. 1.Department of Computer ScienceHumboldt University Berlin 

Personalised recommendations