Abstract
Category learning has traditionally been studied by examining how percentage correct changes with experience (i.e., in the form of learning curves). An alternative and more powerful approach is to examine dynamical learning trajectories — that is, to examine how the parameters that describe the current state of the model change with experience. We describe results from a new experimental paradigm in which empirical-learning trajectories are directly observable. In these experiments, participants learned two categories of spatial position, and they were constrained to identify and use a linear decision bound on every trial. The dependent variables of principal interest were the slope and the intercept of the bound used on each trial. Data from two experiments supported the following conclusions. (1) Gradient descent provided a poor description of the empirical trajectories. (2) The magnitude of changes in decision strategy decreased with experience at a rate that was faster than that predicted by gradient descent. (3) Learning curves suffered from substantial identifiability problems.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Akaike, H. (1974). A new look at the statistical model identification.IEEE Transactions on Automatic Control,19, 716–723.
Alfonso-Reese, L. (1996).Dynamics of category learning. Unpublished doctoral dissertation, University of California, Santa Barbara.
Ashby, F. G. (1992a). Multidimensional models of categorization. In F. G. Ashby (Ed.),Multidimensional models of perception and cognition (pp. 449–483). Hillsdale, NJ: Erlbaum.
Ashby, F. G. (1992b). Multivariate probability distributions. In F. G. Ashby (Ed.),Multidimensional models of perception and cognition (pp. 1–34). Hillsdale, NJ: Erlbaum.
Ashby, F. G., Alfonso-Reese, L. A., Turken, A. U., &Waldron, E. M. (1998). A neuropsychological theory of multiple systems in category learning.Psychological Review,105, 442–481.
Ashby, F. G., &Ell, S. W. (2001). The neurobiology of human category learning.Trends in Cognitive Sciences,5, 204–210.
Ashby, F. G., &Gott, R. E. (1988). Decision rules in the perception and categorization of multidimensional stimuli.Journal of Experimental Psychology: Learning, Memory, & Cognition,14, 33–53.
Ashby, F. G., &Maddox, W. T. (1993). Relations between prototype, exemplar, and decision bound models of categorization.Journal of Mathematical Psychology,37, 372–400.
Brainard, D. H. (1997). The Psychophysics Toolbox.Spatial Vision,10, 433–436.
Brooks, L. (1978). Nonanalytic concept formation and memory for in-stances. In E. Rosch & B. B. Lloyd (Eds.),Cognition and categorization (pp. 169–211). Hillsdale, NJ: Erlbaum.
Busemeyer, J. R., &Myung, I. J. (1992). An adaptive approach to human decision making: Learning theory, decision theory and human performance.Journal of Experimental Psychology: General,121, 177–194.
Busemeyer, J. R., Myung, I. J., &McDaniel, M. A. (1993). Cue competition effects: Theoretical implications for adaptive network learning models.Psychological Science,4, 196–202.
Busemeyer, J. R., Swenson, K. N., &Lazarte, A. (1986). An adaptive approach to resource allocation.Organizational Behavior & Human Decision Processes,38, 318–341.
Darken, C., &Moody, J. E. (1992). Towards faster stochastic gradient search. In J. E. Moody, S. J. Hanson, & R. P. Lippmann (Eds.),Advances in neural information processing systems (pp. 1009–1016). San Mateo, CA: Morgan Kaufman.
Erickson, M. A., &Kruschke, J. K. (1998). Rules and exemplars in category learning.Journal of Experimental Psychology: General,127, 107–140.
Estes, W. K. (1993). Models of categorization and category learning. In G. V. Nakamura & D. L. Medin (Eds.),Categorization by humans and machines (pp. 15–56). San Diego: Academic Press.
Estes, W. K. (1994).Classification and cognition. Oxford: Oxford University Press.
Estes, W. K., Campbell, J. A., Hatsopoulos, N., &Hurwitz, J. B. (1989). Base-rate effects in category learning: A comparison of parallel network and memory storage-retrieval models.Journal of Experimental Psychology: Learning, Memory, & Cognition,13, 556–571.
Geman, S., &Geman, D. (1984). Stochastic relaxation, Gibbs distribution, and the Bayesian restoration of images.IEEE Transactions on Pattern Analysis & Machine Intelligence,6, 721–741.
Gluck, M. A., &Bower, G. H. (1988). From conditioning to category learning: An adaptive network model.Journal of Experimental Psychology: General,117, 227–247.
Hayes, N. A., &Broadbent, D. (1988). Two modes of learning for interactive tasks.Cognition,28, 249–276.
Haykin, S. (1994).Neural networks. Englewood Cliffs, NJ: Macmillan.
Hurwitz, J. B. (1990).A hidden-pattern unit model of category learning. Unpublished doctoral dissertation, Harvard University.
Keele, S. W., Ivry, R. B., Mayr, U., Hazeltine, E., &Heuer, H. (2003). The cognitive and neural architecture of sequence representation.Psychological Review,110, 316–339.
Kendler, T. S., &Kendler, H. H. (1962). Inferential behavior in children as a function of age and subgoal constancy.Journal of Experimental Psychology,64, 460–466.
Kruschke, J. K. (1992). ALCOVE: An exemplar-based connectionist model of category learning.Psychological Review,99, 22–44.
Kubovy, M., &Healy, A. F. (1977). The decision rule in probabilistic categorization: What it is and how it is learned.Journal of Experimental Psychology: General,106, 427–446.
Lee, W., &Janke, M. (1964). Categorizing externally distributed stimulus samples for three continua.Journal of Experimental Psychology,68, 376–382.
Lee, W., &Janke, M. (1965). Categorizing externally distributed stimulus samples for unequal molar probabilities.Psychological Reports,17, 79–90.
Maddox, W. T., &Ashby, F. G. (1993). Comparing decision bound and exemplar models of categorization.Perception & Psychophysics,53, 49–70.
Maddox, W. T., &Ashby, F. G. (2004). Dissociating explicit and procedural-learning based systems of perceptual category learning.Behavioral Processes,66, 309–332.
Minda, J. P., &Smith, J. D. (2001). Prototypes in category learning: The effects of category size, category structure, and stimulus complexity.Journal of Experimental Psychology: Learning, Memory, & Cognition,27, 775–799.
Minsky, M. L., &Papert, S. A. (1969).Perceptrons. Cambridge, MA: MIT Press.
Nosofsky, R. M. (1986). Attention, similarity, and the identification-categorization relationship.Journal of Experimental Psychology: General,115, 39–57.
Nosofsky, R. M., &Kruschke, J. K. (2001). Single-system models and interference in category learning: Commentary on Waldron and Ashby (2001).Psychonomic Bulletin & Review,9, 169–174.
Nosofsky, R. M., Kruschke, J. K., &McKinley, S. C. (1992). Combining exemplar-based category representations and connectionist learning rules.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 211–233.
Pelli, D. G. (1997). The VideoToolbox software for visual psychophysics: Transforming numbers into movies.Spatial Vision,10, 437–442.
Pickering, A. D. (1997). New approaches to the study of amnesic patients: What can a neurofunctional philosophy and neural network methods offer? in A. R. Mayes & J. J. Downes (Eds.),Theories of organic amnesia (pp. 255–300). Hove, U.K.: Psychology Press.
Rosenblatt, F. (1958). The perceptron: A probabilistic model for information storage and organization in the brain.Psychological Review,65, 386–408.
Rumelhart, D. E., Hinton, G. E., &Williams, R. J. (1986). Learning representations by back-propagating errors.Nature,323, 533–535.
Schwarz, G. (1978). Estimating the dimension of a model.Annals of Statistics,6, 461–464.
Shepard, R. N., Hovland, C. L., & Jenkins, H. M. (1961). Learning and memorization of classification.Psychological Monographs,75(13, Whole No. 517).
Sloman, S. A. (1996). The empirical case for two systems of reasoning.Psychological Bulletin,119, 3–22.
Smith, J. D., &Minda, J. P. (1998). Prototypes in the mist: The early epochs of category learning.Journal of Experimental Psychology: Learning, Memory, & Cognition,24, 1411–1436.
Smith, J. D., &Minda, J. P. (2000). Thirty categorization results in search of a model.Journal of Experimental Psychology: Learning, Memory, & Cognition,26, 3–27.
White, H. (1989). Some asymptotic results from learning in single hidden-unit feedforward network models.Journal of the American Statistical Association,84, 1003–1013.
Wickens, T. D. (1982).Models for behavior: Stochastic processes in psychology. San Francisco: Freeman.
Widrow, G., &Hoff, M. E. (1960). Adaptive switching circuits.Institute of Radio Engineers, Western Electric Show & Convention, Convention Record,4, 96–104.
Willingham, D. B., Nissen, M. J., &Bullemer, P. (1989). On the development of procedural knowledge.Journal of Experimental Psychology: Learning, Memory, & Cognition,15, 1047–1060.
Author information
Authors and Affiliations
Corresponding author
Additional information
This research was supported in part by National Science Foundation Grant BCS99-75037. Portions of this research were reported at the 1999 meetings of the Society for Mathematical Psychology.
Rights and permissions
About this article
Cite this article
Ell, S.W., Ashby, F.G. Dynamical trajectories in category learning. Perception & Psychophysics 66, 1318–1340 (2004). https://doi.org/10.3758/BF03195001
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/BF03195001