Abstract
Previous research has provided abundant evidence that negative as well as positive reinforcers can elicit operant responding in rats. Less is known, however, about the relative impact of positive versus negative reinforcers on the dynamics of spatial choice in a complex setting, including old and new stimuli. To study such dynamics, we devised a behavioral paradigm consisting of an initial learning phase, followed by a “transition test,” which included a novel stimulus. In the initial learning phase, rats acquired an operant nose-poke response to a visual (LED) onset at the central hole in the front wall of a Skinner box. We trained two groups of rats, with different types of reinforcement; Group 1(appetitive learning) obtained a food pellet as reinforcement for correct responding, whereas Group 2 (appetitive and avoidance learning) obtained a food pellet and avoided a foot shock as reinforcement for correct responding. Once both groups had established similar, near-perfect levels of performance, we introduced a first transition test, in which a second visual (LED) onset was presented simultaneously with the visual onset at the center. The rats were free to continue responding to the central hole (with the same reinforcement schedule for central responding as during the initial learning). However, the rats obtained three instead of only one food pellet for responding to the peripheral hole (Group 1 and Group 2) as well as avoiding a foot shock (Group 2). Overall, as compared to rats in Group 1, the rats that underwent both appetitive and avoidance learning showed more efficient transition, switching to peripheral responding. These data cannot easily be accommodated by operant conditioning models, according to which the rats in Group 2 should have been particularly motivated to continue responding at the central hole. Instead, we propose that their spatial choice was modified by a complex interaction of classic and operant learning.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Ilango, A., Wetzel, W., Scheich, H., Ohl, F.W.: The combination of appetitive and aversive reinforcers and the nature of their interaction during auditory learning. Neuroscience 166 (2010) 752–762
Kobayashi, S., Nomoto, K., Watanabe, M., Hikosaka, O., Schultz, W., Sakagami, M.: Influences of rewarding and aversive outcomes on activity in Macaque lateral prefrontal cortex. Neuron 51 (2006) 861–870
Simon, N.W., Gilbert, R.J., Mayse, J.D., Bizon, J.L., Setlow, B.: Balancing risk and reward: A rat model of risky decision-making. Neuropsychopharmacology 34 (2009) 2208–2217
Dickinson, A., Balleine, B.: Motivational control of goal-directed action. Anim Learn Behav. 22 (1994) 1–18
Blaisdell, A.P.: Cognitive dimension of operant learning. In Menzel, R. (Ed.), Learning theory and behavior. Vol. 1 of Learning and memory: A comprehensive reference. 4 vols, (2008) 173–195, Oxford: Elsevier
Bindra, D., Palfai, T.: Nature of positive and negative incentive-motivational effects on general activity. J Comp Physiol Psychol.. 63 (1967) 288–297
Dinsmoor, J.A.: Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. J Exp Anal Behav. 76 (2001) 311–333
Foote, A.L., Crystal, J.D.: Metacognition in the rat. Curr Biol. 17 (2007) 551–555
Kepecs, A., Uchida, N., Zariwala, H.A., Mainen, Z.F.: Neural correlates, computation and behavioural impact of decision confidence. Nature 455 (2008) 227–231
Molet, M., Urcelay, G.P., Miguez, G., Miller, R.R.: Using context to resolve temporal ambiguity. J Exp Psychol Anim Behav Process. 36 (2010) 126–136
Berlyne, D.E.: Curiosity and exploration. Science 153 (1966) 25–33
Catania, A.C.: Freedom and knowledge: An experimental analysis of preference in pigeons. J Exp Anal Behav. 24 (1975) 89–106
Field, D.P., Tonneau, F., Ahearn, W., Hineline, P.N.: Preference between variable-ratio and fixed-ratio schedules: Local and extended relations. J Exp Anal Behav. 66 (1996) 283–295
Bromberg-Martin, E.S., Hikosaka, O.: Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 63 (2009) 119–126
Takahashi, M., Lauwereyns, J., Sakurai, Y., Tsukada, M.: A code for spatial alternation in rat hippocampal CA1 neurons. J. Neurophysiol. 102 (2009) 556–567
Acknowledgments
This work was supported by Human Frontier Science Program award RGP0039/2010.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer Science+Business Media Dordrecht
About this paper
Cite this paper
Nishida, H., Takahashi, M., Kinoshita, J., Lauwereyns, J. (2013). Transition Dynamics in Spatial Choice. In: Yamaguchi, Y. (eds) Advances in Cognitive Neurodynamics (III). Springer, Dordrecht. https://doi.org/10.1007/978-94-007-4792-0_53
Download citation
DOI: https://doi.org/10.1007/978-94-007-4792-0_53
Published:
Publisher Name: Springer, Dordrecht
Print ISBN: 978-94-007-4791-3
Online ISBN: 978-94-007-4792-0
eBook Packages: Biomedical and Life SciencesBiomedical and Life Sciences (R0)