Evolution of Intrinsic Motives in Multi-agent Simulations

  • Kamran Shafi
  • Kathryn E. Merrick
  • Essam Debie
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7673)


In humans, intrinsic motives help us to identify, prioritize, select and adapt the goals we will pursue. A variety of computational models of intrinsic motives have been developed for artificial agents including curiosity, achievement, affiliation and power motivation. Previous research has focused on using models of intrinsic motivation in individual agents, such as developmental robots or virtual agents. However, in humans, intrinsic motives evolve over time in response to personal and social factors. This paper presents evolutionary models of intrinsically motivated agents. The models are evaluated in multi-agent simulations of agents playing iterated prisoner’s dilemma games.


Intrinsic motivation achievement affiliation power cognitive agents evolutionary game theory 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Saunders, R.: Curious Design Agents and Artificial Creativity: A Synthetic Approach to the Study of Creative Behaviour. PhD thesis, Department of Architectural and Design Science, Faculty of Architecture, University of Sydney (2002)Google Scholar
  2. 2.
    Merrick, K., Maher, M.L.: Motivated reinforcement learning: curious characters for multiuser games. Springer, Berlin (2009)Google Scholar
  3. 3.
    Merrick, K.: A computational model of achievement motivation for artificial agents. In: Autonomous Agents and Multi-Agent Systems (AAMAS 2011), Taiwan, pp. 1067–1068 (2011)Google Scholar
  4. 4.
    Merrick, K., Shafi, K.: Achievement, affiliation and power: motive profiles for artificial agents. Adaptive Behavior 9(1), 40–62 (2011)CrossRefGoogle Scholar
  5. 5.
    Oudeyer, P.Y., Kaplan, F., Hafner, V.V.: Intrinsic motivation systems for autonomous mental development. IEEE Transactions on Evolutionary Computation 11(2), 265–286 (2007)CrossRefGoogle Scholar
  6. 6.
    Heckhausen, J., Heckhausen, H.: Motivation and action. Cambridge University Press (2008)Google Scholar
  7. 7.
    Baldassarre, G.: What are intrinsic motivations? a biological perspective. In: 2011 IEEE International Conference on Development and Learning (ICDL), vol. 2, pp. 1–8 (August 2011)Google Scholar
  8. 8.
    Oudeyer, P.Y., Kaplan, F.: What is intrinsic motivation? a typology of computational approaches. Frontiers in Neurorobotics 1(6) (2007) (online, open–access)Google Scholar
  9. 9.
    Rapoport, A., Chammah, A.: Prisoner’s dilemma: A study in conflict and cooperation, vol. 165. Univ. of Michigan Press (1965)Google Scholar
  10. 10.
    Poundstone, W.: Prisoner’s Dilemma. Doubleday, New York (1992)Google Scholar
  11. 11.
    Terhune, K.W.: Motives, situation, and interpersonal conflict within prisoner’s dilemma. Journal of Personality and Social Psychology 8(3, pt. 2), 1–24 (1968)CrossRefGoogle Scholar
  12. 12.
    Nowak, M., Sasaki, A., Taylor, C., Fudenberg, D.: Emergence of cooperation and evolutionary stability in finite populations. Nature 428(6983), 646–650 (2004)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Kamran Shafi
    • 1
  • Kathryn E. Merrick
    • 1
  • Essam Debie
    • 1
  1. 1.School of Engineering and Information TechnologyUniversity of New South Wales, Australian Defence Force AcademyCanberraAustralia

Personalised recommendations