A Study of Adaptive Locomotive Behaviors of a Biped Robot: Patterns Generation and Classification

  • John Nassour
  • Patrick Hénaff
  • Fathi Ben Ouezdou
  • Gordon Cheng
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6226)


Neurobiological studies showed the important role of Centeral Pattern Generators for spinal cord in the control and sensory feedback of animals’ locomotion. In this paper, this role is taken into account in modeling bipedal locomotion of a robot. Indeed, as a rhythm generator, a non-classical model of a neuron that can generate oscillatory as well as diverse motor patterns is presented. This allows different motion patterns on the joints to be generated easily. Complex tasks, like walking, running, and obstacle avoidance require more than just oscillatory movements. Our model provides the ability to switch between intrinsic behaviors, to enable the robot to react against environmental changes quickly. To achieve complex tasks while handling external perturbations, a new space for joints’ patterns is introduced. Patterns are generated by our learning mechanism based on success and failure with the concept of vigilance. This allows the robot to be prudent at the beginning and adventurous at the end of the learning process, inducing a more efficient exploration for new patterns. Motion patterns of the joint are classified into classes according to a metric, which reflects the kinetic energy of the limb. Due to the classification metric, high-level control for action learning is introduced. For instance, an adaptive behavior of the rhythm generator neurons in the hip and the knee joints against external perturbation are shown to demonstrate the effectiveness of the proposed learning approach.


Obstacle Avoidance Central Pattern Generator Biped Robot Rhythmic Movement Rhythm Generator 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Orlovsky, G.N., Deliagina, T., Grillner, S.: Neuronal control of locomotion: from mollusc to man, Anonymous. Oxford University Press, New York (1999)Google Scholar
  2. 2.
    McCrea, D.A., Rybak, I.A.: Organization of mammalian locomotor rhythm and pattern generation. Brain Research Reviews 57(1), 134–146 (2008)CrossRefGoogle Scholar
  3. 3.
    Graham-Brown, T.: The intrinsic factors in the act of progression in the mammal. Proc. R. Soc. Lond. B. Biol. Sci. 84, 308–319 (1911)CrossRefGoogle Scholar
  4. 4.
    Ijspeert, A.J.: Central pattern generators for locomotion control in animals and robots: a review. Neural Networks 21(4), 642–653 (2008)CrossRefGoogle Scholar
  5. 5.
    Taga, G., Yamaguchi, Y., Shimizu, H.: Self-organized control of bipedal locomotion by neural oscillators. Biological Cybernetic. 65, 147–159 (1991)zbMATHCrossRefGoogle Scholar
  6. 6.
    Kimura, H., Akiyama, S., Sakurama, K.: Realization of dynamic walking and running of the quadruped using neural oscillator. Auton. Robots. 7, 247–258 (1999)CrossRefGoogle Scholar
  7. 7.
    Endo, J., Morimoto, J., Matsubara, T., Nakanishi, J., Cheng, G.: Learning CPG-based Biped Locomotion with a Policy Gradient Method: Application to a Humanoid Robot. The International Journal of Robotics Research, Special Issue on Machine Learning in Robotics 27(2), 213–228 (2008)Google Scholar
  8. 8.
    Morimoto, J., Endo, J., Nakanishi, J., Cheng, G.: A Biologically Inspired Biped Locomotion Strategy for Humanoid Robots: Modulation of Sinusoidal Patterns by a Coupled Oscillator Model. IEEE Transaction on Robotics 24(1), 185–191 (2008)CrossRefGoogle Scholar
  9. 9.
    Matsuoka, K.: Sustained oscillations generated by mutually inhibiting neurons with adaptation. Biological Cybernetics 52(6), 367–376 (1985)zbMATHCrossRefMathSciNetGoogle Scholar
  10. 10.
    McMillen, D.R., D’Eleuterio, G.M.T.: Simple Central Pattern Generator model using phasic analog neurons. Physical Review 59(6), 6994–6999 (1999)Google Scholar
  11. 11.
    Righetti, L., Buchli, J., Ijspeert, A.J.: Adaptive Frequency Oscillators and Applications. The Open Cybernetics and Systemics Journal 3, 64–69 (2009)CrossRefMathSciNetGoogle Scholar
  12. 12.
    Righetti, L., Buchli, J., Ijspeert, A.J.: Dynamic hebbian learning in adaptive frequency oscillators. Physica D 216(2), 269–281 (2006)zbMATHCrossRefMathSciNetGoogle Scholar
  13. 13.
    Nakanishi, J., Morimoto, J., Endo, G., Cheng, G., Schaal, S., Kawato, M.: Learning from demonstration and adaptation of biped locomotion. Robotics and Autonomous Systems Journal 47(2-3), 79–91 (2004)CrossRefGoogle Scholar
  14. 14.
    Rowat, P.F., Selverston, A.I.: Learning algorithms for oscillatory networks with gap junctions and membrane currents. Network 2(1), 17–41 (1991)zbMATHCrossRefMathSciNetGoogle Scholar
  15. 15.
    Ivanenko, Y.P., Cappellini, G., Dominici, N., Oppele, R.E., Lacquaniti, F.: Modular Control of Limb Movements during Human Locomotion. The Journal of Neuroscience 27(41), 11149–11161 (2007)CrossRefGoogle Scholar
  16. 16.
    Marder, E., Calabrese, R.L.: Principles of rhythmic motor pattern generation. Physiol. Rev. 76, 687–717 (1996)Google Scholar
  17. 17.
    Kuo, A.D.: The relative roles of feedforward and feedback in the control of rhythmic movements. Motor. Control. 6, 129–145 (2002)Google Scholar
  18. 18.
    Kiehn, O., Butt, S.J.: Physiological, anatomical and genetic identification of CPG neurons in the developing mammalian spinal cord. Prog. Neurobiol. 70, 347–361 (2003)CrossRefGoogle Scholar
  19. 19.
    Williams, S.M., Purves, D.: Neuroscience, 2nd edn., January 15. Sinauer Associates (2001)Google Scholar
  20. 20.
    Taga, G.: Adaptive Motion of Animals and Machines. In: Nonlinear Dynamics of Human Locomotion: from Real-Time Adaptation to Development, pp. 189–204. Springer, Tokyo (2006)Google Scholar
  21. 21.
    Graham-Brown, T.G.: On the fundamental activity of the nervous centres: together with an analysis of the conditioning of rhythmic activity in progression, and a theory of the evolution of function in the nervous system. J. Physiol. 48, 18–41 (1914)Google Scholar
  22. 22.
    Perret, C., Cabelguen, J.M., Orsal, D.: Analysis of the pattern of activity in knee flexor motoneurons during locomotion in the cat. In: Gurfinkle, V.S., Ioffe, M.E., Massion, J., Roll, J.P. (eds.) Stance and Motion: Facts and Concepts, pp. 133–141. Plenum Press, New York (1988)Google Scholar
  23. 23.
    Koshland, G.F., Smith, J.L.: Mutable and immutable features of paw-shake responses after hindlimb deafferentation in the cat. J. Neurophysiol. 62, 162–173 (1989)Google Scholar
  24. 24.
    Taga, G.: A model of the neuro-musculo-skeletal system for anticipatory adjustment of human locomotion during obstacle avoidance. Biological Cybernetics 78(1), 9–17 (1998)zbMATHCrossRefGoogle Scholar
  25. 25.
    Wadden, T., Ekeberg, O.: A neuro-mechanical model of legged locomotion: single leg control. Biological Cybernetics 79(2), 161–173 (1998)CrossRefGoogle Scholar
  26. 26.
    Geng, T., Porr, B., Wörgötter, F.: Fast Biped Walking with a Sensor-driven Neuronal Controller and Real-time Online Learning. The International Journal of Robotics Research 25(3), 243–259 (2006)CrossRefGoogle Scholar
  27. 27.
    Nassour, J., Hénaff, P., Ben Ouezdou, F., Cheng, G.: Experience-based learning mechanism for neural controller adaptation: Application to walking biped robots. In: The IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA, pp. 2616–2621 (2009)Google Scholar
  28. 28.
    Kohonen, T.: Self-Organizing Maps, 3rd Extended edn. Springer Series in Information Sciences, 501 pages. Springer, Heidelberg (1995/1997/2001), ISBN 3-540-67921-9, ISSN 0720-678XGoogle Scholar
  29. 29.
    Ahn, H., Picard, R.: Affective-Cognitive Learning and Decision Making: A Motivational Reward Framework For Affective Agent. In: The 1st International Conference on Affective Computing and Intelligent Interaction, Beijing, China, pp. 22–24 (2005)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2010

Authors and Affiliations

  • John Nassour
    • 1
    • 3
  • Patrick Hénaff
    • 2
  • Fathi Ben Ouezdou
    • 1
  • Gordon Cheng
    • 3
  1. 1.Versailles Saint Quentin UniversityFrance
  2. 2.University of Cergy Pontoise, ENSEA, CNRS-F95000 Cergy Pontoise 
  3. 3.Institute for Cognitive SystemsTechnical University Munich 

Personalised recommendations