Hierarchical Psychologically Inspired Planning for Human-Robot Interaction Tasks

  • Gleb Kiselev
  • Aleksandr PanovEmail author
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11659)


This paper presents a new algorithm for hierarchical case-based behavior planning in a coalition of agents – HierMAP. The considered algorithm, in contrast to the well-known planners HEART, PANDA, and others, is intended primarily for use in multi-agent tasks. For this, the possibility of dynamically distributing agent roles with different functionalities was realized. The use of a psychologically plausible approach to the representation of the knowledge by agents using a semiotic network allows applying HierMAP in groups in which people participate as one of the actors. Thus, the algorithm allows us to represent solutions of collaborative problems, forming human-interpretable results at each planning step. Another advantage of the proposed method is the ability to save and reuse experience of planning – expansion in the field of case-based planning. Such extension makes it possible to consider information about the success/ failure of interaction with other members of the coalition. Presenting precedents as a special part of the agent’s memory (semantic network on meanings) allows to significantly reduce the planning time for a similar class of tasks. The paper deals with smart relocation tasks in the environment. A comparison is made with the main hierarchical planners widely used at present.


Cognitive agent Sign Sign-based world model Human-like knowledge representation Behavior planning Spatial planning Pseudo-physical logic Task planning 



The reported study was supported by RFBR, research Project No. 17-29-07051.


  1. 1.
    Kortenkamp, D., Simmons, R.: Robotic systems architectures and programming. In: Siciliano, B., Khatib, O. (eds.) Springer Handbook of Robotics, pp. 187–206. Springer, Berlin (2008)CrossRefGoogle Scholar
  2. 2.
    Gat, E.: On three-layer architectures. Artificial Intelligence and Mobile Robots. MIT Press, Cambridge (1998)Google Scholar
  3. 3.
    Arkin, R.C.: Behavior-based Robotics, 1st edn. MIT Press, Cambridge (1998)Google Scholar
  4. 4.
    Ellman, T.: Hillclimbing in a Hierarchy of Abstraction Spaces, pp. 0–12 (1974)Google Scholar
  5. 5.
    Brafman, R.I.: A privacy preserving algorithm for multi-agent planning and search. In: Proceedings of the Twenty-Fourth International Joint Conference on Artificial Intelligence (IJCAI 2015), pp. 1530–1536 (2015)Google Scholar
  6. 6.
    Rovida, F., Grossmann, B., Kruger, V.: Extended behavior trees for quick definition of flexible robotic tasks. IEEE International Conference on Intelligent Robots and Systems, pp. 6793–6800 (2017)Google Scholar
  7. 7.
    Grea, A., Matignon, L., Aknine, S.: HEART. In: International Conference on Automated Planning and Scheduling, pp. 17–25 (2018)Google Scholar
  8. 8.
    Bechon, P., et al.: Integrating planning and execution for a team of heterogeneous robots with time and communication constraints, pp. 1091–1097 (2018)Google Scholar
  9. 9.
    Sohrabi, S., Baier, J.A., McIlraith, S.A.: HTN planning with preferences. In: IJCAI International Joint Conference on Artificial Intelligence, pp. 1790–1797 (2009)Google Scholar
  10. 10.
  11. 11.
    Daniel, H., Bercher, P., Behnke, G., Biundo, S.: HTN Plan Repair Using Unmodified Planning Systems, pp. 26–30 (2018)Google Scholar
  12. 12.
    Boerkoel, J.C., Planken, L.R., Wilcox, R.J., Shah, J.A.: Distributed algorithms for incrementally maintaining multiagent simple temporal networks. In: Proceedings of the Autonomous Robots and Multirobot Systems Workshop (at AAMAS-12), vol. 59, pp. 256–263 (2012)Google Scholar
  13. 13.
    Kiselev, G.A., Panov, A.I.: Sign-based approach to the task of role distribution in the coalition of cognitive agents. In: SPIIRAS Proceedings, pp. 161–187 (2018)CrossRefGoogle Scholar
  14. 14.
    Tversky, B.: Functional significance of visuospatial representations. In: Shah, P., Miyake, A. (eds.) Handbook of Higher-Level Visuospatial Thinking, pp. 1–34. Cambridge University Press, Cambridge (2005)Google Scholar
  15. 15.
    Lakoff, G., Johnson, M.: Philosophy in the Flesh. Basic Books, New York (1999)Google Scholar
  16. 16.
    Erdem, U.M., Hasselmo, M.E.: A biologically inspired hierarchical goal directed navigation model. J. Physiol. Paris 108(1), 28–37 (2014)CrossRefGoogle Scholar
  17. 17.
    Daniel, K., et al.: Any-angle path planning on grids. J. Artif. Intell. Res. 39, 533–579 (2010)MathSciNetCrossRefGoogle Scholar
  18. 18.
    Pospelov D.A.: Situacionnoe upravlenie. Teoria i praktika. Nauka. p. 288 (1986)Google Scholar
  19. 19.
    Aitygulov, E., Kiselev, G., Panov, A.I.: Task and spatial planning by the cognitive agent with human-like knowledge representation. In: Ronzhin, A., Rigoll, G., Meshcheryakov, R. (eds.) Interactive Collaborative Robotics, pp. 1–12. Springer International Publishing, New York (2018)Google Scholar
  20. 20.
    Epstein, S.L., Aroor, A., Sklar, E.I., Parsons, S.: Navigation with Learned Spatial Affordances, pp. 1–6 (2013)Google Scholar
  21. 21.
    Epstein, S.L., et al.: Spatial abstraction for autonomous robot navigation. Cogn. Process. 16, 215–219 (2015)CrossRefGoogle Scholar
  22. 22.
    Erdem, U.M., Hasselmo, M.E.: A biologically inspired hierarchical goal directed navigation model. J. Physiol. Paris 108(1), 28–37 (2014)CrossRefGoogle Scholar
  23. 23.
    Milford, M., Wyeth, G.: Persistent navigation and mapping using a biologically inspired slam system. Int. J. Robot. Res. 29(9), 1131–1153 (2010)CrossRefGoogle Scholar
  24. 24.
    Milford, M., Schulz, R.: Principles of goal-directed spatial robot navigation in biomimetic models. Philos. Trans. R. Soc. B: Biol. Sci. 369(1655), 20130484 (2014)CrossRefGoogle Scholar
  25. 25.
    Huang, S.H., Held, D., Abbeel, P., Dragan, A.D.: Enabling Robots to Communicate their Objectives (2017)Google Scholar
  26. 26.
    Kuipers, B., Byun, Y.T.: A robot exploration and mapping strategy based on a semantic hierarchy of spatial representations. Robot. Auton. Syst. 8, 47–63 (1991)CrossRefGoogle Scholar
  27. 27.
    Milford, M.J., Wyeth, G.F., Prasser, D.P.: Rat- SLAM on the edge: revealing a coherent representation from an overloaded rat brain. In: Proceedings of the International Conference on Robots and Intelligent Systems, pp. 4060–4065 (2006)Google Scholar
  28. 28.
    Osipov, G.S., Panov, A.I.: Relationships and operations in a sign-based world model of the actor. Sci. Tech. Inf. Process. 45, 317–330 (2018)CrossRefGoogle Scholar
  29. 29.
    Panov, A.I.: Behavior planning of intelligent agent with sign world model. Biol Inspired Cogn. Archit. 19, 21–31 (2017)MathSciNetGoogle Scholar
  30. 30.
    Osipov, G.S., Panov, A.I., Chudova, N.V.: Behavior control as a function of consciousness. I. world model and goal setting. J. Comput. Syst. Sci. Int. 53, 517–529 (2014)MathSciNetCrossRefGoogle Scholar
  31. 31.
    Osipov, G.S., Panov, A.I., Chudova, N.V.: Behavior control as a function of consciousness. II. synthesis of a behavior plan. Journal of Computer and Systems Sciences International 54, 882–896 (2015)MathSciNetCrossRefGoogle Scholar
  32. 32.
    Osipov, G.S.: Sign-based representation and word model of actor. In: Yager, R., Sgurev, V., Hadjiski, M., Jotsov, V. (eds.) 2016 IEEE 8th International Conference on Intelligent Systems (IS). p. 2226. IEEE (2016)Google Scholar
  33. 33.
    Leontyev, A.N.: The Development of Mind. Erythros Press and Media, Kettering (2009)Google Scholar
  34. 34.
    Vygotsky, L.S.: Thought and Language. MIT Press, Cambridge (1986)Google Scholar
  35. 35.
    Panov, A.I.: Goal setting and behavior planning for cognitive agent. Scientific and Technical Information Processing. 6, (In press) (2019)Google Scholar
  36. 36.
    Primeau, N., et al.: Improving task allocation in risk-aware robotic sensor networks via auction protocol selection. In: 2016 IEEE 20th Jubilee International Conference on Intelligent Engineering Systems (INES). pp. 21–26 (2016)Google Scholar
  37. 37.
    Holodkova, A.V.: Application of agents is in model of contractual network. Inf. Process. Syst. 4(102), 142–145 (2012)Google Scholar
  38. 38.
    Kiselev, G., Kovalev, A., Panov, A.I.: Spatial reasoning and planning in sign-based world model. In: Kuznetsov, S., Osipov, G.S., Stefanuk, V. (eds.) Artificial Intelligence, pp. 1–10. Springer, Berlin (2018)Google Scholar
  39. 39.
    Panov, A.I., Yakovlev, K.: Behavior and path planning for the coalition of cognitive robots in smart relocation tasks. In: Kim, J.H., et al. (eds.) Robot Intelligence Technology and Applications, vol. 4, pp. 3–20. Springer, Berlin (2016)Google Scholar
  40. 40.
    Panov, A.I., Yakovlev, K.S.: psychologically inspired planning method for smart relocation task. Procedia Comput. Sci. 88, 115–124 (2016)CrossRefGoogle Scholar
  41. 41.
    Emel’yanov, S., Makarov, D., Panov, A.I., Yakovlev, K.: Multilayer cognitive architecture for UAV control. Cogn. Syst. Res. 39, 58–72 (2016)CrossRefGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Artificial Intelligence Research Institute FRC CSC RASMoscowRussia
  2. 2.Moscow Institute of Physics and TechnologyMoscowRussia

Personalised recommendations