Action Selection Using Theory of Mind: A Case Study in the Domain of Fighter Pilot Training

  • Mark Hoogendoorn
  • Robbert-Jan Merk
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7345)


Theory of mind based reasoning is crucial for humans that interact with each other. Also in the domain of multi-agent systems the importance of theory of mind based reasoning has been stressed, for instance in the process of selecting appropriate actions. In this paper, a theory of mind based approach is presented which goes beyond the capabilities of currently existing agent-based theory of mind approaches by adding certainties to predicted states, and predicting over a longer period of time thereby generating multiple predictions using the theory of mind model. This approach has been applied to the domain of fighter pilots whereby intelligent opponents are developed to facilitate dedicated training for F16 fighter pilots.


Action Selection Opponent Action Hypothetical Situation Form Belief Opponent Model 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Barringer, H., Fisher, M., Gabbay, D., Owens, R., Reynolds, M.: The Imperative Future: Principles of Executable Temporal Logic. John Wiley & Sons (1996)Google Scholar
  2. 2.
    Baron-Cohen, S.: Mindblindness. MIT Press (1995)Google Scholar
  3. 3.
    Bosse, T., Jonker, C.M., van der Meij, L., Sharpanskykh, A., Treur, J.: Specification and Verification of Dynamics in Agent Models. International Journal of Cooperative Information Systems 18, 167–193 (2009)CrossRefGoogle Scholar
  4. 4.
    Bosse, T., Jonker, C.M., van der Meij, L., Treur, J.: A Language and Environment for Analysis of Dynamics by Simulation. International Journal of Artificial Intelligence Tools 16, 435–464 (2007)CrossRefGoogle Scholar
  5. 5.
    Castelfranchi, C.: Modelling social action for AI agents. Artificial Intelligence 103, 157–182 (1998)zbMATHCrossRefGoogle Scholar
  6. 6.
    Harbers, M., van den Bosch, K., Meyer, J.J.: Modeling Agent with a Theory of Mind. In: Baeza-Yates, R., Lang, J., Mitra, S., Parsons, S., Pasi, G. (eds.) Proceedings of the 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Agent Technology, pp. 217–224. IEEE Computer Society Press (2009)Google Scholar
  7. 7.
    Hoogendoorn, M., Soumokil, J.: Evaluation of Virtual Agents Attributed with Theory of Mind in a Real Time Action Game. In: van der Hoek, Kaminka, Lesperance, Luck, Send (eds.) Proceedings of the Ninth International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2010, pp. 59–66 (2010)Google Scholar
  8. 8.
    Laird, J.: It Knows What You’re Going To Do: Adding Anticipation to a Quakebot. In: Andre, E., Sen, S., Frasson, C., Muller, J.P. (eds.) Proceedings of the 5th International Joint Conference on Autonomous Agents, pp. 385–392. ACM Press (2001)Google Scholar
  9. 9.
    Parker, L.E.: Adaptive action selection for cooperative agent teams. In: Meyer, J.-A., Roitblat, H., Wilson, S. (eds.) Proceedings of the 2nd International Conference on Simulation of Adaptive Behavior, pp. 442–450. MIT Press, Cambridge (1992)Google Scholar
  10. 10.
    Veloso, M., Stone, P., Bowling, M.: Anticipation as a key for collaboration in a team of agents: A case study in robotic soccer. In: Proceedings of SPIE Sensor Fusion and Decentralized Control in Robotic Systems II, vol. 3839 (1999)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Mark Hoogendoorn
    • 1
  • Robbert-Jan Merk
    • 2
  1. 1.Department of Computer ScienceVU University AmsterdamAmsterdamThe Netherlands
  2. 2.National Aerospace LaboratoryTraining, Simulation, and Operator PerformanceAmsterdamThe Netherlands

Personalised recommendations