Abstract
Robust walking is one of the key requirements for soccer playing humanoid robots. Developing such a biped walk algorithm is non-trivial due to the complex dynamics of the walk process. In this paper, we first present a method for learning a corrective closed-loop policy to improve the walk stability for the Aldebaran Nao robot using real-time human feedback combined with an open-loop walk cycle. The open-loop walk cycle is obtained from the recorded joint commands while the robot is walking using an existing walk algorithm as a black-box unit. We capture the corrective feedback signals delivered by a human using a wireless feedback mechanism in the form of corrections to the particular joints and we present experimental results showing that a policy learned from a walk algorithm can be used to improve the stability of another walk algorithm. We then follow up with improving the open-loop walk cycle using advice operators before performing real-time human demonstration. During the demonstration, we then capture the sensory readings and the corrections in the form of displacements of the foot positions while the robot is executing improved open-loop walk cycle. We then translate the feet displacement values into individual correction signals for the leg joints using a simplified inverse kinematics calculation. We use a locally weighted linear regression method to learn a mapping from the recorded sensor values to the correction values. Finally, we use a simple anomaly detection method by modeling the changes in the sensory readings throughout the walk cycle during a stable walk as normal distributions and executing the correction policy only if a sensory reading goes beyond the modeled values. Experimental results demonstrate an improvement in the walk stability.
Chapter PDF
Similar content being viewed by others
Keywords
References
Graf, C., Härtl, A., Röfer, T., Laue, T.: A robust closed-loop gait for the standard platform league humanoid. In: Zhou, C., Pagello, E., Menegatti, E., Behnke, S., Röfer, T. (eds.) Proceedings of the Fourth Workshop on Humanoid Soccer Robots in conjunction with the 2009 IEEE-RAS International Conference on Humanoid Robots, Paris, France, pp. 30–37 (2009)
Röfer, T., Laue, T., Müller, J., Bösche, O., Burchardt, A., Damrose, E., Gillmann, K., Graf, C., de Haas, T.J., Härtl, A., Rieskamp, A., Schreck, A., Sieverdingbeck, I., Worch, J.-H.: B-Human 2009 Team Report. Technical report, DFKI Lab and University of Bremen, Bremen, Germany (2009), http://www.b-human.de/download.php?file=coderelease09_doc
Liu, J., Chen, X., Veloso, M.: Simplified Walking: A New Way to Generate Flexible Biped Patterns. In: Tosun, O., Akin, H.L., Tokhi, M.O., Virk, G.S. (eds.) Proceedings of the Twelfth International Conference on Climbing and Walking Robots and the Support Technologies for Mobile Machines (CLAWAR 2009), Istanbul, Turkey, September 9-11. World Scientific, Singapore (2009)
Liu, J., Veloso, M.: Online ZMP Sampling Search for Biped Walking Planning. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2008), Nice, France (September 2008)
Gokce, B., Akin, H.L.: Parameter optimization of a signal-based biped locomotion approach using evolutionary strategies. In: Tosun, O., Akin, H.L., Tokhi, M.O., Virk, G.S. (eds.) Proceedings of the Twelfth International Conference on Climbing and Walking Robots and the Support Technologies for Mobile Machines (CLAWAR 2009), Istanbul, Turkey, September 9-11. World Scientific, Singapore (2009)
Strom, J., Slavov, G., Chown, E.: Omnidirectional walking using ZMP and preview control for the NAO humanoid robot. In: Baltes, J., Lagoudakis, M.G., Naruse, T., Ghidary, S.S. (eds.) RoboCup 2009. LNCS, vol. 5949, pp. 378–389. Springer, Heidelberg (2010)
Czarnetzki, S., Kerner, S., Urbann, O.: Observer-based dynamic walking control for biped robots. Robotics and Autonomous Systems 57, 839–845 (2009)
Nakanishi, J., Morimoto, J., Endo, G., Cheng, G., Schaal, S., Kawato, M.: Learning from demonstration and adaptation of biped locomotion. Robotics and Autonomous Systems 47(2-3), 79–91 (2004); Robot Learning from Demonstration
Grollman, D.H., Jenkins, O.C.: Dogged learning for robots. In: International Conference on Robotics and Automation (ICRA 2007), Rome, Italy, pp. 2483–2488 (April 2007)
Grollman, D.H., Jenkins, O.C.: Learning elements of robot soccer from demonstration. In: International Conference on Development and Learning (ICDL 2007), London, England, pp. 276–281 (July 2007)
Argall, B., Browning, B., Veloso, M.: Learning from demonstration with the critique of a human teacher. In: Second Annual Conference on Human-Robot Interactions (HRI 2007) (2007)
Argall, B., Browning, B., Veloso, M.: Learning robot motion control with demonstration and advice-operators. In: Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2008) (2008)
Chernova, S., Veloso, M.: Interactive policy learning through confidence-based autonomy. Journal of Artificial Intelligence Research 34 (2009)
Chernova, S., Veloso, M.: Teaching collaborative multirobot tasks through demonstration. In: Proceedings of AAMAS 2008, the Seventh International Joint Conference on Autonomous Agents and Multi-Agent Systems, Estoril, Portugal (May 2008)
Meriçli, Ç., Veloso, M.: Biped walk learning through playback and corrective demonstration. In: AAAI 2010: Twenty-Fourth Conference on Artificial Intelligence (2010)
Nintendo. Nintendo - Wii Game Controllers (2007), http://www.nintendo.com/wii/what/controllers
Atkeson, C., Moore, A., Schaal, S.: Locally weighted learning. AI Review 11, 11–73 (1997)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Meriçli, Ç., Veloso, M. (2011). Improving Biped Walk Stability Using Real-Time Corrective Human Feedback. In: Ruiz-del-Solar, J., Chown, E., Plöger, P.G. (eds) RoboCup 2010: Robot Soccer World Cup XIV. RoboCup 2010. Lecture Notes in Computer Science(), vol 6556. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-20217-9_17
Download citation
DOI: https://doi.org/10.1007/978-3-642-20217-9_17
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-20216-2
Online ISBN: 978-3-642-20217-9
eBook Packages: Computer ScienceComputer Science (R0)