Skip to main content

Transition Dynamics in Spatial Choice

  • Conference paper
  • First Online:
Advances in Cognitive Neurodynamics (III)

Abstract

Previous research has provided abundant evidence that negative as well as positive reinforcers can elicit operant responding in rats. Less is known, however, about the relative impact of positive versus negative reinforcers on the dynamics of spatial choice in a complex setting, including old and new stimuli. To study such dynamics, we devised a behavioral paradigm consisting of an initial learning phase, followed by a “transition test,” which included a novel stimulus. In the initial learning phase, rats acquired an operant nose-poke response to a visual (LED) onset at the central hole in the front wall of a Skinner box. We trained two groups of rats, with different types of reinforcement; Group 1(appetitive learning) obtained a food pellet as reinforcement for correct responding, whereas Group 2 (appetitive and avoidance learning) obtained a food pellet and avoided a foot shock as reinforcement for correct responding. Once both groups had established similar, near-perfect levels of performance, we introduced a first transition test, in which a second visual (LED) onset was presented simultaneously with the visual onset at the center. The rats were free to continue responding to the central hole (with the same reinforcement schedule for central responding as during the initial learning). However, the rats obtained three instead of only one food pellet for responding to the peripheral hole (Group 1 and Group 2) as well as avoiding a foot shock (Group 2). Overall, as compared to rats in Group 1, the rats that underwent both appetitive and avoidance learning showed more efficient transition, switching to peripheral responding. These data cannot easily be accommodated by operant conditioning models, according to which the rats in Group 2 should have been particularly motivated to continue responding at the central hole. Instead, we propose that their spatial choice was modified by a complex interaction of classic and operant learning.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 329.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ilango, A., Wetzel, W., Scheich, H., Ohl, F.W.: The combination of appetitive and aversive reinforcers and the nature of their interaction during auditory learning. Neuroscience 166 (2010) 752–762

    Article  CAS  PubMed  Google Scholar 

  2. Kobayashi, S., Nomoto, K., Watanabe, M., Hikosaka, O., Schultz, W., Sakagami, M.: Influences of rewarding and aversive outcomes on activity in Macaque lateral prefrontal cortex. Neuron 51 (2006) 861–870

    Article  CAS  PubMed  Google Scholar 

  3. Simon, N.W., Gilbert, R.J., Mayse, J.D., Bizon, J.L., Setlow, B.: Balancing risk and reward: A rat model of risky decision-making. Neuropsychopharmacology 34 (2009) 2208–2217

    Article  PubMed Central  PubMed  Google Scholar 

  4. Dickinson, A., Balleine, B.: Motivational control of goal-directed action. Anim Learn Behav. 22 (1994) 1–18

    Article  Google Scholar 

  5. Blaisdell, A.P.: Cognitive dimension of operant learning. In Menzel, R. (Ed.), Learning theory and behavior. Vol. 1 of Learning and memory: A comprehensive reference. 4 vols, (2008) 173–195, Oxford: Elsevier

    Google Scholar 

  6. Bindra, D., Palfai, T.: Nature of positive and negative incentive-motivational effects on general activity. J Comp Physiol Psychol.. 63 (1967) 288–297

    Article  CAS  PubMed  Google Scholar 

  7. Dinsmoor, J.A.: Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. J Exp Anal Behav. 76 (2001) 311–333

    Article  Google Scholar 

  8. Foote, A.L., Crystal, J.D.: Metacognition in the rat. Curr Biol. 17 (2007) 551–555

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  9. Kepecs, A., Uchida, N., Zariwala, H.A., Mainen, Z.F.: Neural correlates, computation and behavioural impact of decision confidence. Nature 455 (2008) 227–231

    Article  CAS  PubMed  Google Scholar 

  10. Molet, M., Urcelay, G.P., Miguez, G., Miller, R.R.: Using context to resolve temporal ambiguity. J Exp Psychol Anim Behav Process. 36 (2010) 126–136

    Article  PubMed Central  PubMed  Google Scholar 

  11. Berlyne, D.E.: Curiosity and exploration. Science 153 (1966) 25–33

    Article  CAS  PubMed  Google Scholar 

  12. Catania, A.C.: Freedom and knowledge: An experimental analysis of preference in pigeons. J Exp Anal Behav. 24 (1975) 89–106

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  13. Field, D.P., Tonneau, F., Ahearn, W., Hineline, P.N.: Preference between variable-ratio and fixed-ratio schedules: Local and extended relations. J Exp Anal Behav. 66 (1996) 283–295

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  14. Bromberg-Martin, E.S., Hikosaka, O.: Midbrain dopamine neurons signal preference for advance information about upcoming rewards. Neuron 63 (2009) 119–126

    Article  CAS  PubMed Central  PubMed  Google Scholar 

  15. Takahashi, M., Lauwereyns, J., Sakurai, Y., Tsukada, M.: A code for spatial alternation in rat hippocampal CA1 neurons. J. Neurophysiol. 102 (2009) 556–567

    Article  PubMed  Google Scholar 

Download references

Acknowledgments

This work was supported by Human Frontier Science Program award RGP0039/2010.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Johan Lauwereyns .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer Science+Business Media Dordrecht

About this paper

Cite this paper

Nishida, H., Takahashi, M., Kinoshita, J., Lauwereyns, J. (2013). Transition Dynamics in Spatial Choice. In: Yamaguchi, Y. (eds) Advances in Cognitive Neurodynamics (III). Springer, Dordrecht. https://doi.org/10.1007/978-94-007-4792-0_53

Download citation

Publish with us

Policies and ethics