Gathering and Conceptualizing Plan-Based Robot Activity Experiences

  • Vahid Mokhtari
  • Gi Hyun Lim
  • Luís Seabra Lopes
  • Armando J. Pinho
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 302)


Learning from experiences is an effective approach to enhance robot’s competence. This paper focuses on developing capabilities for a robot to obtain robot activity experiences and conceptualize the experiences as plan schemata, which are used as heuristics for the robot to make plans in similar situations. The plan-based robot activity experiences are obtained through human-robot interactions where a teaching action from a command-line user interface triggers recording of an experience. To represent human-robot interaction activities, ontologies for experiences and user instructions are integrated into a robot ontology. Recorded experiences are episodic descriptions of the robot’s activities including relevant perceptions of the environment, the goals pursued, successes, and failures. Since the amount of experience data is large, a graph simplification algorithm based on ego networks is investigated to filter out irrelevant information in an experience. Finally, an approach to robot activity conceptualization based on deductive generalization and abstraction is presented. The proposed system was demonstrated in a scenario where a PR2 robot is taught how to “serve a coffee” to a guest, in the EU project RACE.


Plan-based robot activity Experience gathering Ego network Plan schema Abstraction and generalization Conceptualization 



We would like to thank the other RACE project partners for their efforts in the integration and the demonstrations, and especially to the Technical Aspects of Multimodal Systems (TAMS) group, University of Hamburg, for making the PR2 robot available do the project.


  1. 1.
    Mugan, J., Kuipers, B.: Autonomous learning of high-level states and actions in continuous environments. IEEE Transactions on Autonomous Mental Development (TAMD) 4(1) (2012) 70–86Google Scholar
  2. 2.
    Kompella, V.R., Luciw, M., Stollenga, M., Pape, L., Schmidhuber, J.: Autonomous learning of abstractions using curiosity-driven modular incremental slow feature analysis. In: Development and Learning and Epigenetic Robotics (ICDL), 2012 IEEE International Conference on, IEEE (2012) 1–8Google Scholar
  3. 3.
    Kirsch, A.: Robot learning language - integrating programming and learning for cognitive systems. Robotics and Autononomous Systems 57(9) (September 2009) 943–954Google Scholar
  4. 4.
    Pardowitz, M., Knoop, S., Dillmann, R., Zollner, R.D.: Incremental learning of tasks from user demonstrations, past experiences, and vocal comments. IEEE Transactions on Systems, Man, and Cybernetics, Part B 37(2) (2007) 322–332Google Scholar
  5. 5.
    Kirsch, A.: Integration of Programming and Learning in a Control Language for Autonomous Robots Performing Everyday Activities. PhD thesis, Technische Universitaet Muenchen (2008)Google Scholar
  6. 6.
    Ekvall, S., Kragic, D.: Learning task models from multiple human demonstrations. In: Robot and Human Interactive Communication, 2006. ROMAN 2006. The 15th IEEE International Symposium on, IEEE (2006) 358–363Google Scholar
  7. 7.
    Ekvall, S., Kragic, D.: Robot learning from demonstration: A task-level planning approach. International Journal of Advanced Robotic Systems 5(3) (2008)Google Scholar
  8. 8.
    Nicolescu, M.N., Mataric, M.J.: Natural methods for robot task learning: Instructive demonstrations, generalization and practice. In: Proceedings of the second international joint conference on Autonomous agents and multiagent systems, ACM (2003) 241–248Google Scholar
  9. 9.
    Schou, C., Damgaard, J.S., Bogh, S., Madsen, O.: Human-robot interface for instructing industrial tasks using kinesthetic teaching. In: Robotics (ISR), 2013 44th International Symposium on, IEEE (2013) 1–6Google Scholar
  10. 10.
    Rockel, S., Neumann, B., Zhang, J., Dubba, K.S.R., Cohn, A.G., S̆. Konec̆ný, Mansouri, M., Pecora, F., Saffiotti, A., Günther, M., Stock, S., Hertzberg, J., Tomé, A.M., Pinho, A.J., Lopes, L.S., von Riegen, S., Hotz, L.: An ontology-based multi-level robot architecture for learning from experiences. In: Designing Intelligent Robots: Reintegrating AI II, AAAI Spring Symposium, Stanford (USA) (2013)Google Scholar
  11. 11.
    S̆. Konec̆ný, Stock, S., Pecora, F., Saffiotti, A.: Planning domain + execution semantics: a way towards robust execution? In: accepted to present in Qualitative Representations for Robots, AAAI Spring Symposium. (2014)Google Scholar
  12. 12.
    S. Stock, M.G., Hertzberg, J.: Generating and executing hierarchical mobile manipulation plans. In: ISR/Robotik 2014, Munich (accepted). (2014)Google Scholar
  13. 13.
    Tulving, E.: Episodic memory and autonoesis: Uniquely human? In H. S. Terrace,J.M., ed.: The Missing Link in Cognition. Oxford Univ. Press, NewYork, NY (2005) 4–56Google Scholar
  14. 14.
    Lim, G.H., Oliveira, M., Mokhtari Hassanabad, V., Kasaei, S.H., Seabra Lopes, L., Maria Tomé, A.: Interactive teaching and experience extraction for learning about objects and robot activities. In: RO-MAN 2014, IEEE (accepted). (2014)Google Scholar
  15. 15.
    Chauhan, A., Seabra Lopes, L., Tomé, A.M., Pinho, A.: Towards supervised acquisition of robot activity experiences: an ontology-based approach. In: 16th Portuguese Conference on Artificial Intelligence - EPIA’2013. (2013)Google Scholar
  16. 16.
    Lim, G.H., Suh, I.H., Suh, H.: Ontology-based unified robot knowledge for service robots in indoor environments. Systems, Man and Cybernetics, Part A: Systems and Humans, IEEE Transactions on 41(3) (2011) 492–509Google Scholar
  17. 17.
    Newman, M.E.: Ego-centered networks and the ripple effect. Social Networks 25(1) (2003) 83–95Google Scholar
  18. 18.
    Hu, Y.: Efficient, high-quality force-directed graph drawing. Mathematica Journal 10(1) (2005) 37–71Google Scholar
  19. 19.
    Seabra Lopes, L.: Failure recovery planning for robotized assembly based on learned semantic structures. In: IFAC Workshop on Intelligent Assembly and Disassembly (IAD’2007). (2007) 65–70Google Scholar
  20. 20.
    Levine, G., DeJong, G.: Explanation-based acquisition of planning operators. In: ICAPS. (2006) 152–161Google Scholar

Copyright information

© Springer International Publishing Switzerland 2016

Authors and Affiliations

  • Vahid Mokhtari
    • 1
  • Gi Hyun Lim
    • 1
  • Luís Seabra Lopes
    • 1
    • 2
  • Armando J. Pinho
    • 1
    • 2
  1. 1.IEETAUniversity of AveiroAveiroPortugal
  2. 2.DETIUniversity of AveiroAveiroPortugal

Personalised recommendations