Abstract
We propose a layered system for autonomous planning of complex service robot environment manipulation challenges. Motion planning, logic-based planning and probabilistic mission planning are integrated into a single system and planning models are generated using Programming by [human] Demonstration (PbD). The strength of planning models arises from the flexibility they give the robot in dealing with changing scenes and highly varying sequences of events. This comes at the cost of complex planning model representations and generation, however. Manually engineering very general descriptions covering a large sets of challenges is infeasible as is learning them exclusively by robot self-exploration. Thus, we present PbD for planning models together with generation of parameters from analysis of geometric scene properties to tackle that difficulty. Experimental results show the applicability of these techniques on natural learning and autonomous execution of complex robot manipulation challenges.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Alami, R., Chatila, R., Fleury, S., Ghallab, M., Ingrand, F.: An architecture for autonomy. International Journal of Robotics Research 17, 315–337 (1998)
Allen, J.: Maintaining knowledge about temporal intervals. Communications of the ACM 26, 832–843 (1983)
Asfour, T., Regenstein, K., Azad, P., Schröder, J., Vahrenkamp, N., Dillmann, R.: Armar-III: An integrated humanoid platform for sensory-motor control. In: 6th IEEE-RAS International Conference on Humanoid Robots, Genova (2006)
Aström, K.J.: Optimal control of Markov decision processes with incomplete state estimation. Journal of Mathematical Analysis and Applications 10, 174–205 (1965)
Azad, P., Asfour, T., Dillmann, R.: Combining apperance-based and model-based methods for real-time object recognition and 6D localization. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing (2006)
Azad, P., Gockel, T., Dillmann, R.: Computer Vision: Das Praxisbuch. Elektor-Verlag, Aachen (2007)
Bengio, Y., Louradour, J., Collobert, R., Weston, J.: Curriculum learning. In: 26th Annual International Conference on Machine Learning, New York (2009)
Berenson, D., Srinivasa, S., Ferguson, D., Collet, A., Kuffner, J.: Manipulation planning with workspace goal regions. In: IEEE International Conference on Robotics and Automation, Kobe (2009)
Berenson, D., Srinivasa, S., Ferguson, D., Kuffner, J.: Manipulation planning on constraint manifolds. In: IEEE International Conference on Robotics and Automation, Kobe (2009)
Breazeal, C., Berlin, M., Brooks, A.G., Gray, J., Thomaz, A.L.: Using perspective taking to learn from ambiguous demonstrations. Robotics and Autonomous Systems 54, 385–393 (2006)
Brock, O., Kuffner, J., Xiao, J.: Motion for manipulation tasks. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics, pp. 615–645. Springer, Heidelberg (2008)
Bullet: The bullet physics library, http://bulletphysics.org
Calinon, S., Billard, A.: Teaching a humanoid robot to recognize and reproduce social cues. In: 15th IEEE International Symposium on Robot and Human Interactive Communication, Hatfield, UK (2006)
Calinon, S., Billard, A.: A probabilistic programming by demonstration framework handling skill constraints in joint space and task space. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice (2008)
Calinon, S., Guenter, F., Billard, A.: Goal-directed imitation in a humanoid robot. In: IEEE International Conference on Robotics and Automation, Barcelona (2005)
Calinon, S., Guenter, F., Billard, A.: On learning, representing, and generalizing a task in a humanoid robot. IEEE Transactions on Systems, Man, and Cybernetics, Part B 37, 286–298 (2007)
Cassandra, A.R., Kaelbling, L.P., Littman, M.L.: Acting optimally in partially observable stochastic domains. In: 12th National Conference on Artificial Intelligence, Seattle, WA (1994)
Chang, C., Lin, C.J.: LIBSVM: a Library for Support Vector Machines (2001)
Choi, D., Kang, Y., Lim, H., You, B.J.: Knowledge-based control of a humanoid robot. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Saint Louis, MO (2009)
Choi, J., Amir, E.: Combining planning and motion planning. In: IEEE International Conference on Robotics and Automation, Kobe (2009)
Daley, P., Frank, J., Iatauro, M., McGann, C., Taylor, W.: Planworks: A debugging environment for constraint based planning systems. In: International Conference on Knowledge Engeneering in Planning and Scheduling, Monterey, CA (2005)
Davies, D., Bouldin, D.: A cluster separation measure. IEEE Transactions on Pattern Analysis and Machine Intelligence 1, 224–227 (1979)
Deckers, P., Dollar, A.M., Howe, R.D.: Guiding grasping with proprioception and Markov models. In: Robotics: Science and Systems, Workshop on “Robot Manipulation: Sensing and Adapting to the Real World”, Atlanta, GA (2007)
Dornhege, C., Gissler, M., Teschner, M., Nebel, B.: Integrating symbolic and geometric planning for mobile manipulation. In: IEEE International Workshop on Safety, Security and Rescue Robotics, Denver, CO (2009)
Eiben, A., Smith, J.: Introduction to Evolutionary Computing. Springer, New York (2003)
Ekvall, S., Aarno, D., Kragic, D.: Task learning using graphical programming and human demonstrations. In: 15th IEEE International Symposium on Robot and Human Interactive Communication, Hatfield, UK (2006)
Erlhagen, W., Mukovskiy, A., Bicho, E., Panin, G., Kiss, C., Knoll, A., van Schie, H.T., Bekkering, H.: Goal-directed imitation for robots: A bio-inspired approach to action understanding and skill learning. Robotics and Autonomous Systems 54, 353–360 (2006)
Freeman, J.: The modelling of spatial relations. Computer Graphics and Image Processing 4, 156–171 (1975)
Friedrich, H., Dillmann, R., Rogalla, O.: Interactive Robot Programming Based on Human Demonstration and Advice. In: Noltemeier, H., Christensen, H.I. (eds.) Dagstuhl Seminar 1998. LNCS (LNAI), vol. 1724, pp. 96–119. Springer, Heidelberg (1999)
Gat, E.: On three-layer architectures. In: Kortenkamp, D., Bonnasso, R.P., Murphy, R. (eds.) Artificial Intelligence and Mobile Robots, pp. 195–210. AAAI, MIT Press, Cambridge, MA (1997)
Gat, E., Slack, M., Miller, D., Firby, R.: Path planning and execution monitoring for a planetary rover. In: IEEE International Conference on Robotics and Automation, Taipei (2003)
Genz, A.: Numerical computation of rectangular bivariate and trivariate normal and t probabilities. Statistics and Computing 14, 151–160 (2004)
Gottschalk, S., Lin, M.C., Manocha, D.: OBBTree: A hierarchical structure for rapid interference detection. In: 23rd International Conference on Computer Graphics and Interactive Techniques, New Orleans, LA (1996)
Guan, Y., Yokoi, K.: Reachable space generation of a humanoid robot using the Monte Carlo method. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing (2006)
Guilamo, L., Kuffner, J., Nishiwaki, K., Kagami, S.: Efficient prioritized inverse kinematic solutions for redundant manipulators. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton (2005)
Halkidi, M., Vazirgiannis, M., Batistakis, Y.: Quality scheme assessment in the clustering process. In: Zighed, D.A., Komorowski, J., Żytkow, J.M. (eds.) PKDD 2000. LNCS (LNAI), vol. 1910, pp. 265–276. Springer, Heidelberg (2000)
Hertzberg, J., Chatila, R.: AI reasoning methods for robotics. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics, pp. 207–223. Springer, Heidelberg (2008)
Hoey, J., von Bertoldi, A., Poupart, P., Mihailidis, A.: Assisting persons with dementia during handwashing using a partially observable Markov decision process. In: 5th International Conference on Computer Vision Systems, Bielefeld (2007)
Hsiao, K., Kaelbling, L.P., Lozano-Pérez, T.: Grasping POMDPs. In: IEEE International Conference on Robotics and Automation, Roma (2007)
Ijspeert, A.J., Nakanishi, J., Schaal, S.: Movement imitation with nonlinear dynamical systems in humanoid robots. In: IEEE International Conference on Robotics and Automation, Washington, DC (2002)
Jäkel, R., Meißner, P., Schmidt-Rohr, S.R., Dillmann, R.: Distributed generalization of learned planning models in robot Programming by Demonstration. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, San Francisco, CA (2011)
Jäkel, R., Schmidt-Rohr, S.R., Lösch, M., Dillmann, R.: Representation and constrained planning of manipulation strategies in the context of Programming by Demonstration. In: IEEE International Conference on Robotics and Automation, Anchorage, AK (2010)
Jäkel, R., Schmidt-Rohr, S.R., Lösch, M., Kasper, A., Dillmann, R.: Learning of generalized manipulation strategies in the context of Programming by Demonstration. In: 10th IEEE-RAS International Conference on Humanoid Robots, Nashville, TN (2010)
Kasper, A.: KIT ObjectModels Web Database, http://wwwiaim.ira.uka.de/ObjectModels
Kavraki, L., Svestka, P., Latombe, J.C., Overmars, M.: Probabilistic roadmaps for path planning in high-dimensional configuration spaces. In: IEEE International Conference on Robotics and Automation, Minneapolis, MN (1996)
Keijzer, M., Merelo, J.J., Romero, G., Schoenauer, M.: Evolving objects: A general purpose evolutionary computation library. In: Collet, P., Fonlupt, C., Hao, J.-K., Lutton, E., Schoenauer, M. (eds.) EA 2001. LNCS, vol. 2310, pp. 231–242. Springer, Heidelberg (2002)
Kim, Y.J., Otaduy, M.A., Lin, M.C., Manocha, D.: Fast penetration depth computation using rasterization hardware and hierarchical refinement, Technical Report, Department of Computer Science, University of North Carolina (2002)
Kleer, J.D., Brown, J.S.: A qualitative physics confluences. Artificial Intelligence 24, 7–83 (1984)
Kormushev, P., Calinon, S., Saegusa, R., Metta, G.: Learning the skill of archery by a humanoid robot Icub. In: 10th IEEE-RAS International Conference on Humanoid Robots, Nashville, TN (2010)
Kuffner, J.J., LaValle, S.M.: RRT-Connect: An efficient approach to single-query path planning. In: IEEE International Conference on Robotics and Automation, San Francisco, CA (2000)
Kurniawati, H., Hsu, D., Lee, W.: SARSOP: Efficient point-based POMDP planning by approximating optimally reachable belief spaces. In: Robotics: Science and Systems, Zurich (2008)
Lemaignan, S., Ros, R., Mösenlechner, L., Alami, R., Beetz, M.: ORO, a knowledge management platform for cognitive architectures in robotics. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei (2010)
Lösch, M., Schmidt-Rohr, S., Knoop, S., Vacek, S., Dillmann, R.: Feature set selection and optimal classifier for human activity recognition. In: 16th IEEE International Symposium on Robot and Human Interactive Communication, Jeju Island, Korea (2007)
Lösch, M., Schmidt-Rohr, S.R., Dillmann, R.: Making feature selection for human motion recognition more interactive through the use of taxonomies. In: 17th IEEE International Symposium on Robot and Human Interactive Communication, München (2008)
MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: 5th Berkeley Symposium on Mathematical Statistics and Probability, Berkeley, CA (1967)
Mahalanobis, P.C.: On the generalised distance in statistics. Proceedings National Institute of Science, India 2(1), 49–55 (1936)
Meeussen, W., Rutgeerts, J., Gadeyne, K., Bruyninckx, H., De Schutter, J.: Contact-state segmentation using particle filters for programming by human demonstration in compliant-motion tasks. IEEE Transactions on Robotics 23, 218–231 (2006)
Meißner, P., Schmidt-Rohr, S.R., Lösch, M., Jäkel, R., Dillmann, R.: Robust localization of furniture parts by integrating depth and intensity data suitable for range sensors with varying image quality. In: 15th International Conference on Advanced Robotics, Tallinn (2011)
Morinaga, S., Kosuge, K.: Collision detection system for manipulator based on adaptive impedance control law. In: IEEE International Conference on Robotics and Automation, Taipei (2003)
Mühlig, M., Gienger, M., Steil, J., Goerick, C.: Automatic selection of task spaces for imitation learning. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Saint Louis, MO (2009)
Mühlig, M., Gienger, M., Steil, J.J.: Human-robot interaction for learning and adaptation of object movements. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei (2010)
Mülling, K., Kober, J., Peters, J.: Simulating human table tennis with a biomimetic robot setup. In: Doncieux, S., Girard, B., Guillot, A., Hallam, J., Meyer, J.-A., Mouret, J.-B. (eds.) SAB 2010. LNCS, vol. 6226, pp. 273–282. Springer, Heidelberg (2010)
Pastor, P., Kalakrishnan, M., Chitta, S., Theodorou, E., Schaal, S.: Skill learning and task outcome prediction for manipulation. In: IEEE International Conference on Robotics and Automation, Shanghai (2011)
Patrón, P., Miguelañez, E., Petillot, Y.R., Lane, D.M.: Fault tolerant adaptive mission planning with semantic knowledge representation for autonomous underwater vehicles. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice (2008)
Pettersson, O.: Execution monitoring in robotics: A survey. Robotics and Autonomous Systems 53, 73–88 (2005)
Pineau, J., Gordon, G., Thrun, S.: Point-based value iteration: An anytime algorithm for POMDPs. In: International Joint Conference on Artificial Intelligence, Acapulco (2003)
Pineau, J., Thrun, S.: High-level robot behavior control using POMDPs. In: AAAI Workshop on Cognitive Robotics, Edmonton (2002)
Primesense Nite Middleware, http://www.primesense.com/en/nite
Rühl, S.W., Hermann, A., Xue, Z., Kerscher, T., Dillmann, R.: Generating a symbolic scene description for robot manipulation using physics simulation. In: Multibody Dynamics, Brussels (2011)
Rühl, S.W., Hermann, A., Xue, Z., Kerscher, T., Dillmann, R.: Graspability: A description of work surfaces for planning of robot manipulation sequences. In: IEEE International Conference on Robotics and Automation, Shanghai (2011)
Rühl, S.W., Xue, Z., Zöllner, J., Dillmann, R.: Integration of a loop based and an event based framework for control of a bimanual dextrous service robot. In: IEEE International Conference on Robotics and Biomimetics, Guilin, China (2009)
Russell, S.J., Norvig, P.: Artificial Intelligence: A Modern Approach, 2nd edn. Prentice Hall, Upper Saddle River (2003)
Sakoe, H., Chiba, S.: Dynamic programming algorithm optimization for spoken word recognition. IEEE Transactions on Acoustics, Speech and Signal Processing 26, 43–49 (1978)
Schmidt-Rohr, S.R., Dirschl, G., Meissner, P., Dillmann, R.: A knowledge base for learning probabilistic decision making from human demonstrations by a multimodal service robot. In: 15th International Conference on Advanced Robotics, Tallinn (2011)
Schmidt-Rohr, S.R., Knoop, S., Lösch, M., Dillmann, R.: Bridging the gap of abstraction for probabilistic decision making on a multi-modal service robot. In: Robotics: Science and Systems, Zurich (2008)
Schmidt-Rohr, S.R., Lösch, M., Jäkel, R., Dillmann, R.: Programming by Demonstration of probabilistic decision making on a multi-modal service robot. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei (2010)
Siciliano, B., Khatib, O. (eds.): Springer Handbook of Robotics. Springer, Heidelberg (2008)
Simeon, T., Cortes, J., Sahbani, A., Laumond, J.P.: A manipulation planner for pick and place operations under continuous grasps and placements. In: IEEE International Conference on Robotics and Automation, Washington, DC (2002)
Slaney, J., Thiebaux, S.: Blocks world revisited. Artificial Intelligence 125, 119–153 (2001)
Sondik, E.J.: The optimal control of partially observable Markov decision processes, Ph.D. thesis, Stanford University (1971)
Sridharan, M., Wyatt, J., Dearden, R.: Hippo: Hierarchical POMDPs for planning information processing and sensing actions on a robot. In: International Conference on Automated Planning and Scheduling, Sydney (2008)
Steffen, J., Elbrechter, C., Haschke, R., Ritter, H.: Bio-inspired motion strategies for a bimanual manipulation task. In: 10th IEEE-RAS International Conference on Humanoid Robots, Nashville, TN (2010)
Stilman, M.: Task constrained motion planning in robot joint space. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA (2007)
Stilman, M., Schamburek, J.U., Kuffner, J., Asfour, T.: Manipulation planning among movable obstacles. In: IEEE International Conference on Robotics and Automation, Roma (2007)
Suh, I.H., Lim, G.H., Hwang, W., Suh, H., Choi, J.H., Park, Y.T.: Ontology-based multi-layered robot knowledge framework (OMRKF) for robot intelligence. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA (2007)
Tenorth, M., Beetz, M.: KnowRob — Knowledge processing for autonomous personal robots. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Saint Louis, MO (2009)
Vahrenkamp, N., Scheurer, C., Asfour, T., Kuffner, J., Dillmann, R.: Adaptive motion planning for humanoid robots. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice (2008)
Veeraraghavan, H., Veloso, M.M.: Learning task specific plans through sound and visually interpretable demonstrations. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, Nice (2008)
Xie, X., Beni, G.: A validity measure for fuzzy clustering. IEEE Transactions on Pattern Analysis and Machine Intelligence 13, 841–847 (1991)
Xue, Z., Kasper, A., Zöllner, J., Dillmann, R.: An automatic grasp planning system for service robots. In: 14th International Conference on Advanced Robotics, München (2009)
Yu, L., Liu, H.: Efficient feature selection via analysis of relevance and redundancy. Journal of Machine Learning Research 5, 1205–1224 (2004)
Zacharias, F., Borst, C., Hirzinger, G.: Capturing robot workspace structure: Representing robot capabilities. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA (2007)
Zöllner, R., Pardowitz, M., Knoop, S., Dillmann, R.: Towards cognitive robots: Building hierarchical task representations of manipulations from human demonstration. In: IEEE International Conference on Robotics and Automation, Barcelona (2005)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag GmbH Berlin Heidelberg
About this chapter
Cite this chapter
Jäkel, R., Rühl, S.W., Schmidt-Rohr, S.R., Lösch, M., Xue, Z., Dillmann, R. (2012). Layered Programming by Demonstration and Planning for Autonomous Robot Manipulation. In: Siciliano, B. (eds) Advanced Bimanual Manipulation. Springer Tracts in Advanced Robotics, vol 80. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29041-1_1
Download citation
DOI: https://doi.org/10.1007/978-3-642-29041-1_1
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-29040-4
Online ISBN: 978-3-642-29041-1
eBook Packages: EngineeringEngineering (R0)