Abstract
In two experiments, two groups of rats were trained in a navigation task according to either a continuous or a partial schedule of reinforcement. In Experiment 1, animals that were given continuous reinforcement extinguished the spatial response of approaching the goal location more readily than animals given partial reinforcement—a partial reinforcement extinction effect. In Experiment 2, after partially or continuously reinforced training, animals were trained in a new task that made use of the same reinforcer according to a continuous reinforcement schedule. Animals initially given partial reinforcement performed better in the novel task than did rats initially given continuous reinforcement. These results replicate, in the spatial domain, well-known partial reinforcement phenomena typically observed in the context of Pavlovian and instrumental conditioning, suggesting that similar principles govern spatial and associative learning. The results reported support the notion that salience modulation processes play a key role in determining partial reinforcement effects.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Amsel, A. (1958). The role of frustrative nonreward in noncontinuous reward situations. Psychological Bulletin, 55, 102–119.
Amsel, A. (1967). Partial reinforcement effects in vigor and persistence: Advances in frustration theory derived from a variety of within- subjects experiments. In K. W. Spence & J. T. Spence (Eds.), The psychology of learning and motivation (Vol. 1, pp. 1–65). New York: Academic Press.
Amsel, A. (1992). Frustration theory: An analysis of dispositional learning and memory. Cambridge: Cambridge University Press.
Artigas, A. A., Aznar-Casanova, J. A., & Chamizo, V. D. (2005). Effects of absolute proximity between landmark and platform in a virtual Morris pool task with humans. International Journal of Comparative Psychology, 18, 224–239.
Best, P. J., White, A. M., & Minai, A. (2001). Spatial processing in the brain: The activity of hippocampal place cells. Annual Review of Neuroscience, 24, 459–486.
Blair, C. A. J., & Hall, G. (2003). Perceptual learning in flavor aversion: Evidence for learned changes in stimulus effectiveness. Journal of Experimental Psychology: Animal Behavior Processes, 29, 39–48.
Bonardi, C., Honey, R. C., & Hall, G. (1990). Context specificity of conditioning in flavor-aversion learning: Extinction and blocking tests. Learning & Behavior, 18, 229–237.
Capaldi, E. J. (1967). A sequential theory of instrumental training. In K. W. Spence & J. T. Spence (Eds.), The psychology of learning and motivation (Vol. 1, pp. 67–156). New York: Academic Press.
Gallistel, C. R. (1990). The organization of learning. Cambridge, MA: MIT Press.
Hall, G. (2003). Learned changes in the sensitivity of stimulus representations: Associative and nonassociative mechanisms. Quarterly Journal of Experimental Psychology, 56B, 43–55.
Hall, G., & Honey, R. C. (1989). Contextual effects in conditioning, latent inhibition, and habituation: Associative and retrieval functions of contextual cues. Journal of Experimental Psychology: Animal Behavior Processes, 15, 232–241.
Hall, G., & Honey, R. C. (1990). Context-specific conditioning in the conditioned-emotional-response procedure. Journal of Experimental Psychology: Animal Behavior Processes, 16, 271–278.
Hall, G., Prados, J., & Sansa, J. (2005). Modulation of the effective salience of a stimulus by direct and associative activation of its representation. Journal of Experimental Psychology: Animal Behavior Processes, 31, 267–276.
Haselgrove, M., Aydin, A., & Pearce, J. M. (2004). A partial reinforcement extinction effect despite equal rates of reinforcement during Pavlovian conditioning. Journal of Experimental Psychology: Animal Behavior Processes, 30, 240–250.
Honey, R. C., Willis, A., & Hall, G. (1990). Context specificity in pigeon autoshaping. Learning & Motivation, 21, 125–136.
Lattal, K. M., & Abel, T. (2000). Cellular and molecular mechanisms of learning and memory. In M. E. A. Reith (Ed.), Cerebral signal transduction: From first to fourth messengers (pp. 27–71). Totaway, NJ: Humana.
Lattal, K. M., Mullen, M. T., & Abel, T. (2003). Extinction, renewal, and spontaneous recovery of a spatial preference in the water maze. Behavioral Neuroscience, 117, 1017–1028.
Mackintosh, N. J. (1974). The psychology of animal learning. London: Academic Press.
Morris, R. G. M. (1981). Spatial localization does not require the presence of local cues. Learning & Motivation, 12, 239–260.
O’Keefe, J. (1999). Do hippocampal pyramidal cells signal non-spatial as well as spatial information? Hippocampus, 9, 352–364.
O’Keefe, J., & Dostrovsky, J. (1971). The hippocampus as a spatial map: Preliminary evidence from unit activity in the freely-moving rat. Brain Research, 34, 171–175.
O’Keefe, J., & Nadel, L. (1978). The hippocampus as a cognitive map. Oxford: Oxford University Press, Clarendon Press.
Pavlov, I. P. (1927). Conditioned reflexes: An investigation of the physiological activity of the cerebral cortex (G. V. Anrep, Trans.). London: Oxford University Press.
Pearce, J. M., Redhead, E. S., & Aydin, A. (1997). Partial reinforcement in appetitive Pavlovian conditioning with rats. Quarterly Journal of Experimental Psychology, 50B, 273–294.
Prados, J., Artigas, A. A., & Sansa, J. (2007). Preexposure effects in the spatial domain: Dissociation between latent inhibition and perceptual learning. Journal of Experimental Psychology: Animal Behavior Processes, 33, 115–123.
Prados, J., Chamizo, V. D., & Mackintosh, N. J. (1999). Latent inhibition and perceptual learning in a swimming-pool navigation task. Journal of Experimental Psychology: Animal Behavior Processes, 25, 37–44.
Prados, J., Manteiga, R. D., & Sansa, J. (2003). Recovery effects after extinction in the Morris swimming pool navigation task. Learning & Behavior, 31, 299–304.
Redhead, E. S., Roberts, A., Good, M., & Pearce, J. M. (1997). Interaction between piloting and beacon homing by rats in a swimming pool. Journal of Experimental Psychology: Animal Behavior Processes, 23, 340–350.
Rescorla, R. A. (1999). Partial reinforcement reduces the associative change produced by nonreinforcement. Journal of Experimental Psychology: Animal Behavior Processes, 25, 403–414.
S. B. Klein (Eds.), Handbook of contemporary learning theories (pp. 119–154). Mahwah, NJ: Erlbaum.
Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and non-reinforcement. In A. H. Black & W. F. Prokasy (Eds.), Classical conditioning II: Current research and theory (pp. 64–99). New York: Appleton-Century-Crofts.
Rodrigo, T., Chamizo, V. D., McLaren, I. P. L., & Mackintosh, N. J. (1997). Blocking in the spatial domain. Journal of Experimental Psychology: Animal Behavior Processes, 23, 110–118.
Rodrigo, T., Sansa, J., Baradad, P., & Chamizo, V. D. (2006). Generalization gradients in a navigation task with rats. Learning & Motivation, 37, 247–268.
Ross, R. R. (1964). Positive and negative partial-reinforcement extinctioneffects carried through continuous reinforcement, changed motivation, and changed response. Journal of Experimental Psychology, 68, 492–502.
Sánchez-Moreno, J., Rodrigo, T., Chamizo, V. D., & Mackintosh, N. J. (1999). Overshadowing in the spatial domain. Learning & Behavior, 27, 391–398.
Sansa, J., & Prados, J. (2003). Overshadowing between landmarks in a navigation task. Psicológica, 24, 17–29.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by a grant from the Spanish Ministerio de Educación y Ciencia to the authors.
Rights and permissions
About this article
Cite this article
Prados, J., Sansa, J. & Artigas, A.A. Partial reinforcement effects on learning and extinction of place preferences in the water maze. Learning & Behavior 36, 311–318 (2008). https://doi.org/10.3758/LB.36.4.311
Received:
Accepted:
Issue Date:
DOI: https://doi.org/10.3758/LB.36.4.311