A Salience Theory of Learning and Behavior: With Perspectives on Neurobiology and Cognition
- 728 Downloads
- 10 Citations
Abstract
Traditional behaviorists have described behaviors fundamentally as responses to stimuli or, perhaps more liberally, as behaviors under the control of discriminative stimuli or contexts. They have held responses or behaviors to be established, strengthened, sustained, and inhibited or extinguished by contingent events: notably reinforcers, punishers, or the absence of either. In addition, they believed reinforcement acts on the response, the behavior, not on the organism. Here, and in support of Hebb’s view, we advance a contrarian view. A key principle of our framework is that species’ brains are uniquely designed to perceive and to relate stimulus events that are contiguous, salient, and relevant to adaptation. In accordance with what we here view as the constructive biases of species’ brains, stimuli are differentially organized into amalgams that reflect an exchange of salience and response-eliciting properties of component units, which are then integrated to form a basis of knowledge about the organism and its ecological niche. One can then base adaptation on overarching principles and rules, not just on simple associations. Species may create emergent behaviors with no history of specific training, and even new capacities, to service adaptation to both familiar and novel challenges.
Keywords
adaptation amalgam behaviorism conditioning constructive bias in brain function contiguity emergents habit reinforcement reward salienceNotes
Acknowledgments
Grants HD06016 and HD-38051 from the National Institute of Child Health and Human Development supported preparation of this manuscript. Institutional support from the Great Ape Trust of Iowa and from the College of Arts and Sciences of Georgia State University also is gratefully acknowledged. We thank Professor Carl Halgren for his several helpful suggestions during preparation of the article.
References
- Antonov, I., Antonova, I., Kandel, E. R., & Hawkins, R. D. (2003). Activity-dependent presynaptic facilitation and Hebbian LTP are both required and interact during classical conditioning in Aplysia. Neuron, 37, 135–148.PubMedCrossRefGoogle Scholar
- Barr, R., Marrott, H., & Rovee-Collier, C. (2003). The role of sensory preconditioning in memory retrieval by preverbal infants. Learning and Behavior, 31, 111–123.PubMedGoogle Scholar
- Breland, K., & Breland, M. (1961). The misbehavior of organisms. American Psychologist, 16, 681–684.CrossRefGoogle Scholar
- Brembs, B., Lorenzetti, F. D., Reyes, F. D., Baxter, D. A., & Byme, J. H. (2002). Operant reward learning in Aplysia: Neuronal correlates and mechanisms. Science, 296, 1706–1710.PubMedCrossRefGoogle Scholar
- Brown, P. L., & Jenkins, H. M. (1968). Auto-shaping the pigeon’s peck. Journal of the Experimental Analysis of Behavior, 11, 1–8.PubMedCrossRefGoogle Scholar
- Carlson, N. R. (2004). Physiology of behavior (8th ed.). Boston: Pearson Education.Google Scholar
- Collier, G. (2005). A functional analysis of feeding. Advances in the Study of Behavior, 35, 63–103.Google Scholar
- Cuevas, K., Rovee-Collier, C., & Learmonth, A. E. (2006). Infants form associations between memory representations of stimuli that are absent. Psychological Science, 17, 543–549.PubMedCrossRefGoogle Scholar
- Domjan, M. (2003). The principles of learning and behavior (5th ed.). Belmont, CA: Wadsworth-Thomson Learning.Google Scholar
- Domjan, M. (2005). Pavlovian conditioning: A functional perspective. Annual Review of Psychology, 56, 179–206.PubMedCrossRefGoogle Scholar
- Gentner, D. (2003). Why we’re so smart. In D. Gentner & S. Goldin-Meadow (Eds.), Language in mind (pp. 195–235). Cambridge, MA: MIT Press.Google Scholar
- Gottlieb, G. (1963). A naturalistic study of imprinting in wood ducklings (Anas platyrhynchos). Behaviour, 18, 205–225.Google Scholar
- Gurden, H., Takita, M., & Jay, T. M. (2000). Essential role of D1 but not D2 receptor s in the NMDA receptor-dependent long-term potentiation at hippocampal-prefrontal cortex synapses in vivo. Journal of Neuroscience, 20, RC106.PubMedGoogle Scholar
- Gurden, H., Tassin, J. P., & Jay, T. M. (1999). Integrity of the meso-cortical dopaminergic system is necessary for complete expression of in vivo hippocampal-prefrontal cortex long-term potentiation. Neuroscience, 94, 1019–1027.PubMedCrossRefGoogle Scholar
- Harlow, H. F. (1949). The formation of learning sets. Psychological Review, 56, 51–65.CrossRefPubMedGoogle Scholar
- Hawkins, R. D., Clark, G. A., & Kandel, E. R. (2006). Operant conditioning of gill withdrawal in Aplysia. Journal of Neuroscience, 26, 2443–2448.PubMedCrossRefGoogle Scholar
- Hebb, D. O. (1949). The organization of behavior: A neurophysiological theory. New York: John Wiley & Sons.Google Scholar
- Hillix, W. A., & Rumbaugh, D. M. (2004). Animal bodies, human minds: Ape, dolphin, and parrot language skills. New York: Klüwer/Academic Press.Google Scholar
- Immelmann, K. (1972). Sexual and other long-term aspects of imprinting. In D. S. Lehrman, R. A. Hinde, & E. Shaw (Eds.), Advances in the study of behavior (vol. 4, pp. 147–174). New York: Academic Press.Google Scholar
- Kelley, A. E., Smith-Roe, S. L., & Holahan, M. R. (1997). Response-reinforcement learning is dependent on N-methyl-d-aspartate receptor activation in the nucleus accumbens core. Proceedings of the National Academy of Sciences of the United States of America, 94, 12174–12179.PubMedCrossRefGoogle Scholar
- King, D. L. (2001). Grouping and assimilation in perception, memory, and conditioning. Review of General Psychology, 5, 23–43.CrossRefGoogle Scholar
- Köhler, W. (1925). The mentality of apes. New York: Harcourt, Brace.Google Scholar
- Kolb, B., & Whishaw, I. Q. (2006). An introduction to brain and behavior (2nd ed.). New York: Worth Publishers.Google Scholar
- Mackintosh, N. J. (1975). A theory of attention: Variations in the associability of stimuli with reinforcement. Psychological Review, 82, 276–298.CrossRefGoogle Scholar
- Mahometa, M. J., & Domjan, M. (2005). Classical conditioning increases reproductive success in Japanese quail, Coturnix japonica. Animal Behavior, 69, 983–989.CrossRefGoogle Scholar
- Marx, M. H., & Hillix, W. A. (1979). Systems and theories in psychology (3rd ed.). New York: McGraw-Hill.Google Scholar
- Mason, W. A. (2002). The natural history of primate development. In D. J. Lewkowicsz & R. Lickliter (Eds.), Conceptions of development (pp. 105–134). New York: Psychology Press.Google Scholar
- Matsuzawa, T. (2001). Primate foundations of human intelligence: A view of tool use in nonhuman primates and fossil hominids. In T. Matsuzawa (Ed.), Primate origins of human cognition and behavior (pp. 557–574). Tokyo: Springer.Google Scholar
- Mirenowicz, J., & Schultz, W. (1994). Importance of unpredictability for reward responses in primate dopamine neurons. Journal of Neurophysiology, 72, 1024–1027.PubMedGoogle Scholar
- Mirenowicz, J., & Schultz, W. (1996). Preferential activation of mid-brain dopamine neurons by appetitive rather than aversive stimuli. Nature, 379, 449–451.PubMedCrossRefGoogle Scholar
- Murphy, G. G., & Glanzman, D. L. (1997). Mediation of classical conditioning in Aplysia californica by long-term potentiation of sensorimotor synapse. Science, 278, 467–471.PubMedCrossRefGoogle Scholar
- Rescorla, R. A., & Wagner, A. R. (1972). A theory of Pavlovian conditioning: Variation in the effectiveness of reinforcement and nonreinforcement. In A. Black & W. F. Prokasy (Eds.), Classical conditioning II (pp. 64–99). New York: Appleton-Century-Crofts.Google Scholar
- Rosenkranz, J. A., & Grace, A. A. (1999). Modulation of basolateral amygdala neuronal firing and afferent drive by dopamine receptor activation in vivo. Journal of Neuroscience, 19, 11027–11039.PubMedGoogle Scholar
- Rumbaugh, D. M. (1997). The psychology of Harry F. Harlow: A bridge from radical to rational behaviorism. Philosophical Psychology, 10, 197–210.CrossRefGoogle Scholar
- Rumbaugh, D. M. (2002). Emergents and rational behaviorism. Eye on Psi Chi, 6, 8–14.Google Scholar
- Rumbaugh, D. M., & Washburn, D. A. (2003). Intelligence of apes and other rational beings. New Haven: Yale University Press.Google Scholar
- Rumbaugh, D. M., Washburn, D. A., & Hillix, W. A. (1996). Respondents, operants, and emergents: Toward an integrated perspective on behavior. In K. Pribram & J. King (Eds.), Learning as a self-organizing process (pp. 57–73). Hillsdale, NJ: Lawrence Erlbaum.Google Scholar
- Savage-Rumbaugh, E. S., Murphy, J., Sevcik, R. A., Brakke, K. E., Williams, S. L., Rumbaugh, D. M., & Bates, E. (1993). Language comprehension in ape and child. Monographs of the Society for Research in Child Development, 233, 58 no. 3/4, 1–125.Google Scholar
- Sternberg, R. J., & Preiss, D. D. (Eds.) (2005). Intelligence and technology: The impact of tools on the nature and development of human abilities. Mahwah, NJ: Lawrence Erlbaum.Google Scholar
- Sutherland, N. S., & Mackintosh, N. J. (1971). Mechanisms of animal discrimination learning. New York: Academic Press.Google Scholar
- Tancin, V., Kraetzl, W.-D., Schams, D., Bruckmaier, R. M. (2001). The effect of conditioning to suckling, milking and of calf presence on the release of oxytocin in dairy cows. Applied Animal Behaviour Science, 72, 235–246.Google Scholar
- von Uexküll, J. (1934/1957). A stroll through the world of animals and men: A picture book of invisible worlds. In C. H. Schiller (Ed.), Instinctive behavior: The development of a modern concept (pp. 5–80). New York: International Universities Press.Google Scholar
- Washburn, D. A. (Ed.) (2006). Primate perspectives on behavior and cognition. Washington, D. C.: American Psychological Association Press.Google Scholar
- West-Eberhard, M. J. (2003). Developmental plasticity and evolution. New York: Oxford University Press.Google Scholar