Hierarchical Modeling for Strategy-Based Multi-agent Multi-team Systems

  • D. Michael FranklinEmail author
Conference paper
Part of the Lecture Notes in Networks and Systems book series (LNNS, volume 70)


Modeling complex environments is a challenging problem that is compounded when there are multiple agents acting together as a team, and the team needs to maintain its own goals while allowing the agents to have some level of autonomy. We prepose a modeling framework for strategy-based multi-agent multi-team simulation environments. For these types of environments it is necessary to have a modeling infrastructure that allows for high-level, high-complexity, hierarchical interactions where team goals are prevalent but individual needs are balanced. Such modeling is proposed in this paper – modeling that will avoid large, monolithic models while maintaining complexity of expression balanced with simplicity of operation.


Artificial intelligence Multi-agent systems Strategy Hierarchical modeling Modeling 


  1. 1.
    Bowling, M., Veloso, M., et al.: Existence of multiagent equilibria with limited agents. J. Artif. Intell. Res. (JAIR) 22, 353–384 (2004)MathSciNetCrossRefGoogle Scholar
  2. 2.
    Greenwald, A., Hall, K., Serrano, R.: Correlated Q-learning. ICML 20, 242 (2003)Google Scholar
  3. 3.
    Hu, J., Wellman, M., et al.: Multiagent reinforcement learning: theoretical framework and an algorithm. In: Proceedings of the Fifteenth International Conference on Machine Learning, vol. 242, p. 250. Citeseer (1998)Google Scholar
  4. 4.
    Laviers, K., Sukthankar, G., Aha, D.W., Molineaux, M., Darken, C., et al.: Improving offensive performance through opponent modeling. In: AIIDE (2009)Google Scholar
  5. 5.
    Littman, M.: Markov games as a framework for multi-agent reinforcement learning. In: Proceedings of the Eleventh International Conference on Machine Learning, vol. 157, p. 163 (1994)Google Scholar
  6. 6.
    Parson, Simon, Woolridge, Michael: Game theory and decision theory in multi-agent systems. Auton. Agents Multi-Agent Syst. 5, 243–254 (2002)CrossRefGoogle Scholar
  7. 7.
    Stone, P., Veloso, M.: Task decomposition and dynamic role assignment for real-time strategic teamwork. In: Intelligent Agents V: Agents Theories, Architectures, and Languages, pp. 293–308 (1999)CrossRefGoogle Scholar
  8. 8.
    Treuille, A., Lewis, A., Popović, Z.: Model reduction for real-time fluids. In: ACM SIGGRAPH 2006 Papers, SIGGRAPH ’06, pp. 826–834. ACM, New York (2006). 10.1145/1179352.1141962.
  9. 9.
    Treuille, A., Lewis, A., Popović, Z.: Model reduction for real-time fluids. ACM Trans. Graph. 25(3), 826–834 (2006). 10.1145/1141911.1141962. Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Kennesaw State UniversityMariettaUSA

Personalised recommendations