Automated Robot Skill Learning from Demonstration for Various Robot Systems
Transferring human movements to robotic systems is of high interest to equip the systems with new behaviors without expert knowledge. Typically, skills are often only learned for a very specific setup and a certain robot. We propose a modular framework to learn skills that is applicable on different robotic systems without adaptations. Our work builds on the recently introduced BesMan Learning Platform, which comprises the full workflow to transfer human demonstrations to a system, including automatized behavior segmentation, imitation learning, reinforcement learning for motion refinement, and methods to generalize to related tasks. For this paper, we extend this approach in order that different skills can be imitated by various systems in an automated fashion with a minimal amount of configuration, e.g., definition of the target system and environment. For this, we focus on the imitation of the demonstrated movements and show their transferability without movement refinement. We demonstrate the generality of the approach on a large dataset, consisting of about 700 throwing demonstrations. Nearly all of these human demonstrations are successfully transferred to four different robot target systems, namely Universal Robot’s UR5 and UR10, KUKA LBR iiwa, and DFKI’s robot COMPI. An analysis of the quality of the imitated movement on the real UR5 robot shows that useful throws can be executed on the system which can be used as starting points for further movement refinement.
KeywordsBehavior learning Learning from demonstration Behavior segmentation Imitation learning Transfer learning Manipulation Robotics
This work was supported through grants from the German Federal Ministry for Economic Affairs and Energy (BMWi, No 50RA1703, No 50RA1701), one grant from the European Union’s Horizon 2020 research and innovation program (No H2020-FOF 2016 723853), and part of the work was done in a collaboration with Intel Labs China. We would like to thank Intel Corp. for financial support.
- 2.Bargsten, V., de Gea Fernández, J.: Compi: Development of a 6-DOF compliant robot arm for human-robot cooperation. In: Proceedings of the 8th International Workshop on Human-Friendly Robotics. Technische Universitaet Muenchen (TUM) (2015)Google Scholar
- 5.Gleicher, M.: Retargetting motion to new characters. In: Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 1998, pp. 33–42. ACM, New York (1998). https://doi.org/10.1145/280814.280820
- 6.Gutzeit, L., Otto, M., Kirchner, E.A.: Simple and robust automatic detection and recognition of human movement patterns in tasks of different complexity. In: Physiological Computing Systems. Springer (2019, submitted)Google Scholar
- 8.Gutzeit, L., Kirchner, E.A.: Automatic detection and recognition of human movement patterns in manipulation tasks. In: Proceedings of the 3rd International Conference on Physiological Computing Systems (2016)Google Scholar
- 12.Michieletto, S., Chessa, N., Menegatti, E.: Learning how to approach industrial robot tasks from natural demonstrations. In: 2013 IEEE Workshop on Advanced Robotics and its Social Impacts, pp. 255–260, November 2013. https://doi.org/10.1109/ARSO.2013.6705538
- 15.Pastor, P., Hoffmann, H., Asfour, T., Schaal, S.: Learning and generalization of motor skills by learning from demonstration. In: IEEE International Conference on Robotics and Automation, pp. 763–768 (2009)Google Scholar
- 16.Pollard, N.S., Hodgins, J.K., Riley, M.J., Atkeson, C.G.: Adapting human motion for the control of a humanoid robot. In: Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No. 02CH37292). vol. 2, pp. 1390–1397, May 2002. https://doi.org/10.1109/ROBOT.2002.1014737
- 18.Senger, L., Schröer, M., Metzen, J.H., Kirchner, E.A.: Velocity-based multiple change-point inference for unsupervised segmentation of human movement behavior. In: Proceedings of the 22th International Conference on Pattern Recognition (ICPR2014), pp. 4564–4569 (2014). https://doi.org/10.1109/ICPR.2014.781