Skip to main content

Learning models for the prisoner’s dilemma game: A review

  • Conference paper
Social Dilemmas and Cooperation
  • 120 Accesses

Abstract

The paper provides a review of mathematical learning models for gaming behavior in sequences of prisoner’s dilemma games. The introductory part of the paper gives some basic information about the mathematics of traditional learning models. Three types of models are explained: Linear operator models, choice models and Markov-models. In the first part classical learning models for overt gaming behavior are presented. They were developed by Anatol Rapoport and his co-workers. Results for two Markov-models and a linear operator model are discussed. Van der Sanden developed a Markov-model with two latent value states and a transitional intermediate state. This model is based on earlier work of Meeker. Micko, Brückner und Ratzke developed a linear operator model with two latent dimensions called “cooperative inclination” and “trust”. The basic ideas of this model are very similar to Pruitt and Kimmel’s goal-expectation theory. Schulz and co-workers developed a series of learning models which account for players’ expectations and separate social value parameters and information processing parameters. In the most recent model of this type goals, expectations, and choices are overt variables. This model allows empirical tests of the goal expectation theory.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Axelrod, R.M. (1984). The evolution of cooperation. New York: Basic Books.

    Google Scholar 

  • Brückner, G. (1976). Vorhersage und Erzeugung von kooperativem Verhalten in einem Nicht-Nullsummenspiel (Prediction and induction of cooperative behavior in a non-zero game), Unpublished diploma thesis, Technische Universität Braunschweig.

    Google Scholar 

  • Busch, R.R., & Mosteller, F. (1955). Stochastic models for learning. New York: Wiley.

    Google Scholar 

  • Festinger, L. (1957). A theory of cognitive dissonance. Stanford, CA: Stanford University Press.

    Google Scholar 

  • Heider, F. (1958). The psychology of interpersonal relationships. New York: Wiley.

    Book  Google Scholar 

  • Hermiter, J., Williams, A., & Wolpert, J. (1967). Learning to cooperate. Peace Research Society, Vol. VII, Papers. Chicago, Conference.

    Google Scholar 

  • Howard, N. (1966). The theory of metagames. General Systems, 77, 156–200.

    Google Scholar 

  • Howard, N. (1971). Paradoxes of rationality: The theory of metagames and political behavior. Cambridge: MIT Press.

    Google Scholar 

  • Howard, N. (1974). “General” metagames: An extension of the metagames concept. In A. Rapoport (Ed.), Game theory as a theory of conflict resolution (pp. 258–280). Dordrecht: Reidel.

    Google Scholar 

  • Howard, N. (1976). Prisoner’s Dilemma: The solution by general metagames. Behavioral Science, 27, 524–531.

    Article  Google Scholar 

  • Luce, R.D. (1959). Individual choice behavior. New York: Wiley.

    Google Scholar 

  • May, T.W. (1983). Individuelles Entscheiden in sequentiellen Konfliktspielen (Individual decision making in sequential conflict games). Frankfurt a.M.: Lang.

    Google Scholar 

  • Meeker, B.F. (1971). Value conflict in social exchange A Markov model. Journal of Mathematical Psychology, 8, 389–403.

    Article  Google Scholar 

  • Micko, H.C., Brückner, G., & Ratzke, H. (1977). Theories and strategies for Prisoner’s Dilemma. In W.F. Kempf, & B.H. Repp (Eds.), Mathematical models for social psychology. Bern: Huber.

    Google Scholar 

  • Pruitt, D.G., & Kimmel, M.J. (1977). Twenty years of experimental gaming: Critique, Synthesis, and suggestions for the future. Annual Review of Psychology, 28, 363–392.

    Article  Google Scholar 

  • Rapoport, A., & Chammah, A.M. (1965). Prisoner’s Dilemma. Ann Arbor: University of Michigan Press.

    Google Scholar 

  • Rapoport, A., & Dale, P. (1966). Models for Prisoner’s Dilemma. Journal of Mathematical Psychology, 5, 269–286.

    Article  Google Scholar 

  • Schulz, U. (1979). Ein mathematisches Modell für das Verhalten in Sequenzen von Prisoner’s-Dilemma-Spielen unter Berücksichtigung von Erwartungen. (A mathematical model for the behavior in sequences of prisoner’s dilemma games in consideration of expectations). In W. Albers, G. Bamberg, & R. Selten (Eds.), Entscheidung in kleinen Gruppen. (Decision in small groups.) Mathematical Systems in Economics, 45, 107–123, Meisenheim: Hain.

    Google Scholar 

  • Schulz, U. (1991). Verhalten in Konfliktspielen: Modelle für Entscheidungsverhalten und Informationsverarbeitung in Sequenzen von einfachen Konfliktspielen mit zwei Personen (Behavior in conflict games: Models for decision behavior and information processing in sequences of simple two person conflict games). Frankfurt a.M.: Lang.

    Google Scholar 

  • Schulz, U., & May, T.W. (1983a). The dependence of cognition and behavior in 2x2 matrice games. In R.W. Scholz (Ed.), Decision making under uncertainty (pp. 253–270). North Holland: Elsevier Science Publishers B.V.

    Google Scholar 

  • Schulz, U., & May, T.W. (1983b). Ein Modell für das Verhalten in Sequenzen von Konfliktspielen unter Berücksichtigung von Antizipationen und subjektiven Sicherheiten. (A model for the behavior in sequences of conflict games in consideration of anticipations and subjective confidence). Zeitschrift für Sozialpsychologie, 14, 322–340.

    Google Scholar 

  • Spada, H., & Ernst, A.M. (1992). Wissen, Ziele und Verhalten in einem ökologisch-sozialen Dilemma. (Knowledge, goals and behavior in an ecological-social dilemma), In K. Pawlik, & K.-H. Stapf (Eds.), Umwelt und Verhalten (Environment and behavior) (pp. 83–106). Bern: Huber.

    Google Scholar 

  • van der Sanden, A.M.L. (1979). Value states and dynamic decision making in the Prisoner’s Dilemma Game. Nijmegen, Stichting Studentenpres.

    Google Scholar 

  • Wickens, T.D. (1982). Models for behavior: Stochastic processes in psychology. San Francisco: W.H. Freeman & Co.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 1984 Springer-Verlag Berlin · Heidelberg

About this paper

Cite this paper

Micko, H.C. (1984). Learning models for the prisoner’s dilemma game: A review. In: Schulz, U., Albers, W., Mueller, U. (eds) Social Dilemmas and Cooperation. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-78860-4_19

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-78860-4_19

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-78862-8

  • Online ISBN: 978-3-642-78860-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics