Skip to main content
Log in

Empirical content as a criterion for evaluating models

  • Opinion Papers and Commentaries
  • Published:
Cognitive Processing Aims and scope Submit manuscript

Abstract

Hypotheses derived from models can be tested in an empirical study: If the model reliably fails to predict behavior, it can be dismissed or modified. Models can also be evaluated before data are collected: More useful models have a high level of empirical content (Popper in Logik der Forschung, Mohr Siebeck, Tübingen, 1934), i.e., they make precise predictions (degree of precision) for many events (level of universality). I apply these criteria to reflect on some critical aspects of Kirsch’s (Cognit Process, 2019. https://doi.org/10.1007/s10339-019-00904-3) unifying computational model of decision making.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Notes

  1. I thank the reviewer who made me aware of this work.

  2. I use the terms theory and model interchangeably but see, in contrast, Thagard (2012, Chapter 1) for a differentiation.

  3. See also Glöckner and Betsch (2011) for a recent application of these criteria for evaluating models in judgment and decision making.

References

  • Dennet DC (1981) Brainstorms: philosophical essays on mind and psychology. The MIT Press, Cambridge

    Book  Google Scholar 

  • Farrell S, Lewandowsky S (2010) Computational models as aids to better reasoning in psychology. Curr Dir Psychol Sci 19:329–335

    Article  Google Scholar 

  • Festinger L (1957) A theory of cognitive dissonance. Row, Peterson, Evanston

    Google Scholar 

  • Fiedler K (2004) Tools, toys, truisms, and theories: some thoughts on the creative cycle of theory formation. Personal Soc Psychol Rev 8:123–131

    Article  Google Scholar 

  • Fiske ST (2004) Mind the gap: in praise of informal sources of formal theory. Personal Soc Psychol Rev 8:132–137

    Article  Google Scholar 

  • Gigerenzer G, Goldstein DG (1996) Reasoning the fast and frugal way: models of bounded rationality. Psychol Rev 103:650–669

    Article  CAS  PubMed  Google Scholar 

  • Gigerenzer G, Todd PM (1999) Simple heuristics that make us smart. University Press, Oxford

    Google Scholar 

  • Glöckner A, Betsch T (2011) The empirical content of theories in judgment and decision making: shortcomings and remedies. Judgm Decis Mak 6:711–721

    Google Scholar 

  • Glöckner A, Hilbig BE, Jekel M (2014) What is adaptive about adaptive decision making? A parallel constraint satisfaction account. Cognition 133:641–666

    Article  PubMed  Google Scholar 

  • Higgins ET (2004) Making a theory useful: lessons handed down. Personal Soc Psychol Rev 8:138–145

    Article  Google Scholar 

  • Kahneman D, Tversky A (1979) Prospect theory: an analysis of decision under risk. Econometrica 47:263–292

    Article  Google Scholar 

  • Kirsch A (2019) A unifying computational model of decision making. Cognit Process. https://doi.org/10.1007/s10339-019-00904-3

    Article  Google Scholar 

  • Klein S (2014) What can recent replication failures tell us about the theoretical commitments of psychology? Theory Psychol 24:326–338

    Article  Google Scholar 

  • Krajbich I, Armel C, Rangel A (2010) Visual fixations and the computation and comparison of value in simple choice. Nat Neurosci 13:1292–1300

    Article  CAS  PubMed  Google Scholar 

  • Marewski JN, Olsson H (2009) Beyond the null ritual: formal modeling of psychological processes. J Psychol 217:49–60

    Google Scholar 

  • Myung IJ, Pitt MA (1997) Applying Occam’s razor in modeling cognition: a Bayesian approach. Psychon Bull Rev 4:79–95

    Article  Google Scholar 

  • Myung IJ, Navarro DJ, Pitt MA (2006) Model selection by normalized maximum likelihood. J Math Psychol 50:167–179

    Article  Google Scholar 

  • Pitt MA, Myung IJ (2000) When a good fit can be bad. Trends Cognit Sci 6:421–425

    Article  Google Scholar 

  • Pitt MA, Myung IJ, Zhang S (2002) Towards a method for selecting among computational models for cognition. Psychol Rev 109:472–491

    Article  PubMed  Google Scholar 

  • Platt JR (1964) Strong inference. Science 146:347–353

    Article  CAS  PubMed  Google Scholar 

  • Popper KR (1934/2005) Logik der Forschung, 11th edn. Mohr Siebeck, Tübingen

  • Rieskamp J, Otto PE (2006) SSL: a theory of how people learn to select strategies. J Exp Psychol General 135:207–236

    Article  Google Scholar 

  • Roberts S, Pashler H (2000) How persuasive is a good fit? A comment on theory testing. Psychol Rev 107:358–367

    Article  CAS  PubMed  Google Scholar 

  • Ross D (2019) Empiricism, sciences, and engineering: cognitive science as a zone of integration. Cogn Process. https://doi.org/10.1007/s10339-019-00916-z

    Article  PubMed  Google Scholar 

  • Shultz TR, Lepper MR (1996) Cognitive dissonance reduction as constraint satisfaction. Psychol Rev 103:219–240

    Article  CAS  PubMed  Google Scholar 

  • Thagard P (2012) The cognitive science of science: explanation, discovery, and conceptual change. The MIT Press, Cambridge

    Book  Google Scholar 

  • Van Lange PA, Kruglanksi AW, Higgins ET (2012) Theories of social psychology: an introduction. In: Van Lange PA, Kruglanksi AW, Higgins ET (eds) Handbook of theories of social psychology. Sage, London, pp 1–8

    Google Scholar 

  • Vanpaemel W, Lee MD (2012) Using priors to formalize theory: optimal attention and the generalized context model. Psychon Bull Rev 19:1047–1056

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marc Jekel.

Ethics declarations

Conflict of interest

The author declares that he has no conflict of interest.

Human and animal rights statements

This article does not contain any studies with human participants or animals performed by the author.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Jekel, M. Empirical content as a criterion for evaluating models. Cogn Process 20, 273–275 (2019). https://doi.org/10.1007/s10339-019-00913-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10339-019-00913-2

Keywords

Navigation