Are You Thinking What I’m Thinking? An Evaluation of a Simplified Theory of Mind
- 2.3k Downloads
We examine the effectiveness of an agent’s approximate theory of mind when interacting with human players in a wartime negotiation game. We first measure how accurately the agent’s theory of mind captured the players’ actual behavior. We observe significant overlap between the players’ behavior and the agents’ idealized expectations, but we also observe significant deviations. Forming an incorrect expectation about a person is not inherently damaging, so we then analyzed how different deviations affected the game outcomes. We observe that many classes of inaccuracy in the agent’s theory of mind did not hurt the agent’s performance and, in fact, some of them played to the agent’s benefit. The results suggest potential advantages to giving an agent a computational model of theory of mind that is overly simplified, especially as a first step when investigating a domain with as much uncertainty as wartime negotiation.
Keywordstheory of mind cognitive models wartime negotiation evaluation of formal models
Unable to display preview. Download preview PDF.
- 1.Baker, C.L., Tenenbaum, J.B., Saxe, R.R.: Goal inference as inverse planning. In: CogSci (2007)Google Scholar
- 3.Dupuis, E.C., Cohn, E.S.: A new scale to measure war attitudes: Construction and predictors. Journal of Psychological Arts and Sciences 3(1), 6–15 (2006)Google Scholar
- 5.Hoogendoorn, M., Soumokil, J.: Evaluation of virtual agents utilizing theory of mind in a real time action game. In: AAMAS, pp. 59–66 (2010)Google Scholar
- 8.Kim, J.M., Hill Jr., R.W., Durlach, P.J., Lane, H.C., Forbell, E., Core, M., Marsella, S., Pynadath, D., Hart, J.: Bilat: A game-based environment for practicing negotiation in a cultural context. International Journal of Artificial Intelligence in Education 19(3), 289–308 (2009)Google Scholar
- 10.Marsella, S.C., Pynadath, D.V., Read, S.J.: PsychSim: Agent-based modeling of social interactions and influence. In: ICCM, pp. 243–248 (2004)Google Scholar
- 12.Neale, M.A., Bazerman, M.H.: Cognition and rationality in negotiation. Free Press (1991)Google Scholar
- 14.Pynadath, D.V., Marsella, S.C.: PsychSim: Modeling theory of mind with decision-theoretic agents. In: IJCAI, pp. 1181–1186 (2005)Google Scholar
- 15.Pynadath, D.V., Marsella, S.C.: Minimal mental models. In: AAAI, pp. 1038–1046 (2007)Google Scholar
- 16.Pynadath, D.V., Marsella, S.C., Wang, N.: Computational models of human behavior in wartime negotiations. In: CogSci (to appear, 2013)Google Scholar
- 18.Slantchev, B.L.: The principle of convergence in wartime negotiations. American Political Science Review 97, 621–632 (2003)Google Scholar
- 20.Whiten, A. (ed.): Natural Theories of Mind. Basil Blackwell, Oxford (1991)Google Scholar