Abstract
Unequal payoffs engender separate reward- and accuracy-maximizing decision criteria; unequal base rates do not. When payoffs are unequal, observers place greater emphasis on accuracy than is optimal. This study compares objective classifier (the objectively correct response) with optimal classifier feedback (the optimal classifier’s response) when payoffs or base rates are unequal. It provides a critical test of Maddox and Bohil’s (1998) competition between reward and accuracy maximization (COBRA) hypothesis, comparing it with a competition between reward and probability matching (COBRM) and a competition between reward and equal response frequencies (COBRE) hypothesis. The COBRA prediction that optimal classifier feedback leads to better decision criterion learning relative to objective classifier feedback when payoffs are unequal, but not when base rates are unequal, was supported. Model-based analyses suggested that the weight placed on accuracy was reduced for optimal classifier feedback relative to objective classifier feedback. In addition, delayed feedback affected learning of the reward-maximizing decision criterion.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Akaike, H. (1974). A new look at the statistical model identification.IEEE Transactions on Automatic Control,19, 716–723.
Ashby, F. G. (1992a). Multidimensional models of categorization. In F. G. Ashby (Ed.),Multidimensional models of perception and cognition (pp. 449–484). Hillsdale, NJ: Erlbaum.
Ashby, F. G. (1992b). Multivariate probability distributions. In F. G. Ashby (Ed.),Multidimensional models of perception and cognition (pp. 1–34). Hillsdale, NJ: Erlbaum.
Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., &Waldron, E. M. (1998). A neuropsychological theory of multiple systems in category learning.Psychological Review,105, 442–481.
Ashby, F. G., &Lee, W. W. (1993). Perceptual variability as a fundamental axiom of perceptual science. In S. C. Masin (Ed.),Foundations of perceptual theory (pp. 369–399). Amsterdam: Elsevier.
Ashby, F. G., &Maddox, W. T. (1993). Relations between prototype, exemplar, and decision bound models of categorization.Journal of Mathematical Psychology,37, 372–400.
Ashby, F. G., &Maddox, W. T. (1998). Stimulus categorization. In M. H. Birnbaum (Ed.),Measurement, judgement, and decision making (pp. 251–301). New York: Academic Press.
Ashby, F. G., &Townsend, J. T. (1986). Varieties of perceptual independence.Psychological Review,93, 154–179.
Bettman, J. R., Johnson, E. J., Luce, M. F., &Payne, J. W. (1993). Correlation, conflict, and choice.Journal of Experimental Psychology: Learning, Memory, & Cognition,19, 931–951.
Bohil, C. J., &Maddox, W. T. (2003). On the generality of optimal versus objective classifier feedback effects on decision criterion learning in perceptual categorization.Memory & Cognition,31, 181–198.
Busemeyer, J. R., &Myung, I. J. (1992). An adaptive approach to human decision making: Learning theory, decision theory, and human performance.Journal of Experimental Psychology: General,121, 177–194.
Dusoir, A. E. (1980). Some evidence on additive learning models.Perception & Psychophysics,27, 163–175.
Erev, I. (1998). Signal detection by human observers: A cutoff reinforcement learning model of categorization decisions under uncertainty.Psychological Review,105, 280–298.
Erickson, M. A., &Kruschke, J. K. (1998). Rules and exemplars in category learning.Journal of Experimental Psychology: General,127, 107–140.
Estes, W. K. (1976). The cognitive side of probability learning.Psychological Review,83, 37–64.
Estes, W. K., &Maddox, W. T. (1995). Interactions of stimulus attributes, base rates, and feedback in recognition.Journal of Experimental Psychology: Learning, Memory, & Cognition,21, 1075–1095.
Green, D. M., &Swets, J. A. (1966).Signal detection theory and psychophysics. New York: Wiley.
Healy, A. F., &Kubovy, M. (1981). Probability matching and the formation of conservative decision rules in a numerical analog of signal detection.Journal of Experimental Psychology: Human Learning & Memory,7, 344–354.
Heit, E., Brockdorff, N., &Lamberts, K. (2003). Adaptive changes of response criterion in recognition memory.Psychonomic Bulletin & Review,10, 718–723.
Herrnstein, R. J. (1961). Relative and absolute strength of response as a function of frequency of reinforcement.Journal of the Experimental Analysis of Behavior,4, 267–272.
Herrnstein, R. J. (1970). On the law of effect.Journal of the Experimental Analysis of Behavior,13, 243–266.
Herrnstein, R. J., &Heyman, G. M. (1979). Is matching compatible with reinforcement maximization on concurrent variable interval, variable ratio?Journal of the Experimental Analysis of Behavior,31, 209–223.
Kubovy, M., &Healy, A. F. (1977). The decision rule in probabilistic categorization: What it is and how it is learned.Journal of Experimental Psychology: General,106, 427–466.
Maddox, W. T. (2002). Toward a unified theory of decision criterion learning in perceptual categorization.Journal of the Experimental Analysis of Behavior,28, 1003–1018.
Maddox, W. T., &Ashby, F. G. (1993). Comparing decision bound and exemplar models of categorization.Perception & Psychophysics,53, 49–70.
Maddox, W. T., &Bohil, C. J. (1998). Base-rate and payoff effects in multidimensional perceptual categorization.Journal of Experimental Psychology: Learning, Memory, & Cognition,24, 1459–1482.
Maddox, W. T., &Bohil, C. J. (2001). Feedback effects on cost-benefit learning in perceptual categorization.Memory & Cognition,29, 598–615.
Maddox, W. T., &Bohil, C. J. (2004). Probability matching, accuracy maximization, and a test of the optimal classifier’s independence assumption in perceptual categorization.Perception & Psychophysics,66, 104–118.
Maddox, W. T., &Dodd, J. L. (2001). On the relation between baserate and cost-benefit learning in simulated medical diagnosis.Journal of Experimental Psychology: Learning, Memory, & Cognition,27, 1367–1384.
Parducci, A. (1965). Category judgment: A range-frequency model.Psychological Review,72, 407–418.
Pickering, A. D. (1997). New approaches to study of amnesic patients: What can a neurofunctional philosophy and neural network methods offer?Memory,5, 255–300.
Reber, P. J., &Squire, L. R. (1994). Parallel brain systems for learning with and without awareness.Learning & Memory,1, 217–229.
Russo, J. E., &Dosher, B. A. (1983). Strategies for multi-attribute binary choice.Journal of Experimental Psychology: Learning, Memory, & Cognition,9, 676–696.
Smith, E. E., Patalano, A., &Jonides, J. (1998). Alternative strategies of categorization.Cognition,65, 167–196.
Stevenson, M. K., Busemeyer, J. R., &Naylor, J.C. (1991). Judgment and decision-making theory. In M. D. Dunnette & L. M. Hough (Eds.),Handbook of industrial and organizational psychology (2nd ed., Vol. 1, pp. 283–374). Palo Alto, CA: Consulting Psychologists Press.
Thomas, E. A. C. (1975). Criterion adjustment and probability matching.Perception & Psychophysics,18, 158–162.
Thomas, E. A. C., &Legge, D. (1970). Probability matching as a basis for detection and recognition decisions.Psychological Review,77, 65–72.
von Winterfeldt, D., &Edwards, W. (1982). Costs and payoffs in perceptual research.Psychological Bulletin,91, 609–622.
Wickens, T. D. (1982).Models for behavior: Stochastic processes in psychology. San Francisco: Freeman.
Williams, B. A. (1988). Reinforcement, choice, and response strength. In C. R. Atkinson, R. J. Herrnstein, G. Lindzey, & R. D. Luce (Eds.),Stevens’ Handbook of experimental psychology: Vol. 2. Learning and cognition (pp. 167–244). New York: Wiley.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported in part by National Institutes of Health Grant No. 5 R01MH59196 and by NIMH National Research Service Award No. MH14257 to the University of Illinois.
Rights and permissions
About this article
Cite this article
Maddox, W.T., Bohil, C.J. Optimal classifier feedback improves cost-benefit but not base-rate decision criterion learning in perceptual categorization. Mem Cogn 33, 303–319 (2005). https://doi.org/10.3758/BF03195319
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03195319