Autonomous Robots

, Volume 40, Issue 5, pp 903–927

A modular approach to learning manipulation strategies from human demonstration

  • Bidan Huang
  • Miao Li
  • Ravin Luis De Souza
  • Joanna J. Bryson
  • Aude Billard
Article

DOI: 10.1007/s10514-015-9501-9

Cite this article as:
Huang, B., Li, M., De Souza, R.L. et al. Auton Robot (2016) 40: 903. doi:10.1007/s10514-015-9501-9

Abstract

Object manipulation is a challenging task for robotics, as the physics involved in object interaction is complex and hard to express analytically. Here we introduce a modular approach for learning a manipulation strategy from human demonstration. Firstly we record a human performing a task that requires an adaptive control strategy in different conditions, i.e. different task contexts. We then perform modular decomposition of the control strategy, using phases of the recorded actions to guide segmentation. Each module represents a part of the strategy, encoded as a pair of forward and inverse models. All modules contribute to the final control policy; their recommendations are integrated via a system of weighting based on their own estimated error in the current task context. We validate our approach by demonstrating it, both in a simulation for clarity, and on a real robot platform to demonstrate robustness and capacity to generalise. The robot task is opening bottle caps. We show that our approach can modularize an adaptive control strategy and generate appropriate motor commands for the robot to accomplish the complete task, even for novel bottles.

Keywords

Learning by demonstration Manipulation Modular approach 

Supplementary material

10514_2015_9501_MOESM1_ESM.wmv (17.4 mb)
Supplementary material 1 (wmv 17807 KB)

Copyright information

© Springer Science+Business Media New York 2015

Authors and Affiliations

  • Bidan Huang
    • 1
  • Miao Li
    • 3
  • Ravin Luis De Souza
    • 3
  • Joanna J. Bryson
    • 2
  • Aude Billard
    • 3
  1. 1.The Hamlyn CentreImperial College LondonLondonUnited Kingdom
  2. 2.Intelligent Systems Group (IS), Computer Science DepartmentUniversity of BathNorth East SomersetUnited Kingdom
  3. 3.Learning Algorithms and Systems Laboratory (LASA)Swiss Federal Institute of Technology Lausanne (EPFL)LausanneSwitzerland

Personalised recommendations