A Neural Theory of Punishment and Avoidance, II: Quantitative Theory

  • Stephen Grossberg
Part of the Boston Studies in the Philosophy of Science book series (BSPS, volume 70)


This article continues where section VIII of Chapter 4 leaves off. The article is filled with psychopharmacological predictions, some of which have since been confirmed. Others still need to be tested. The article follows the conceptual path forced by the synchronization problem. It leads to a reinforcement theory whose network realizations define explicit drive, reinforcement, and incentive motivational concepts.


Avoidance Response Lateral Hypothalamus Inhibitory Interneuron Shock Intensity Neural Theory 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    N. E. Andén, A. Carlsson and J. Häggendal, Adrenergic Mechanisms, Ann. Rev. Pharmacol. (H. W. Elliott, W. C. Cutting and R. H. Dreisbach eds.) 9,119–134 (1969).Google Scholar
  2. 2.
    Z. Annau and L. J. Kamin, The conditioned emotional response as a function of intensity of the US, J. Comp. Physiol. Psychol. 54, 428–432 (1961).CrossRefGoogle Scholar
  3. 3.
    A. B. Ashton, S. C. Bitgood and J. W. Moore, Auditory differential conditioning of the rabbit nictitating membrane response: III. Effects of US shock intensity and duration, Psychonomic Sci. 15, 127–128 (1969).Google Scholar
  4. 4.
    B. Berger, D. L. Margules and L. Stein, Prevention of learning of fear by oxazepam and scopolamine. Amer. Psychol. 22, 492 (1967).Google Scholar
  5. 5.
    F. E. Bloom and N. J. Giarman, Physiological and Pharmacological Considerations of Biogenic Amines in the Nervous System, Ann. Rev. Pharmacol. (H. W. Elliott, W. C. Cutting and R. H. Dreisbach, eds.) 8, 229–258 (1968).Google Scholar
  6. 6.
    E. E. Boe, Effect of punishment duration and intensity on the extinction of an instrumental response. J. Exptl. Psychol. 72, 125–131 (1966).CrossRefGoogle Scholar
  7. 7.
    Z. Bohdanecky and M. E. Jarvik, Impairment of one-trial passive avoidance learning in mice by scopolamine, scopolamine methylbromide, and physostigmine, Intern. J Neuropharmacol. 6, 217–222 (1967).CrossRefGoogle Scholar
  8. 8.
    J. J. Boren, M. Sidman and R. J. Herrnstein, Avoidance, escape and extinction as functions of shock intensity. J. Comp. Physiol. Psychol. 52, 420–425 (1959).CrossRefGoogle Scholar
  9. 9.
    G. Borozci, L. H. Storms and W. E. Broen, Response suppression and recovery of responding at different deprivation levels as functions of intensity and duration of punishment. J Comp. Physiol. Psychol. 58, 456–459 (1964).CrossRefGoogle Scholar
  10. 10.
    O. Buresova, J. Bures, Z. Bohdanecky and T. Weiss, Effect of atropine on learning, extinction, retention and retrieval in rats. Psychopharmacologia 5, 255–263 (1964).CrossRefGoogle Scholar
  11. 11.
    P. L. Carlton, Brain-acetylcholine and inhibition, in Reinforcement and Behavior ( J. T. Tapp, ed.), Academic Press, New York (1969).Google Scholar
  12. 12.
    B. A. Campbell, Interaction of aversive stimuli: Summation on inhibition? J Exptl. Psychol. 78, 181–190 (1968).CrossRefGoogle Scholar
  13. 13.
    R. M. Church, Response suppression, in Punishment and Aversive Behavior ( B. A. Campbell and R. M. Church, eds.), Appleton, New York (1969).Google Scholar
  14. 14.
    R. M. Church, G. A. Raymond and R. D. Beauchamp, Response suppression as a function of intensity and duration of punishment. J. Comp. Physiol. Psychol. 63, 39–44 (1967).CrossRefGoogle Scholar
  15. 15.
    V. C. Cox and E. S. Valenstein, Attenuation of aversive properties of peripheral shock by hypothalamic stimulation. Science 149, 323–325 (1965).CrossRefGoogle Scholar
  16. 16.
    V. C. Cox and E. S. Valenstein, Effects of stimulus intensity on behavior elicited by hypothalamic stimulation, J. Comp. Physiol. Psychol. 69, 730–733 (1969).CrossRefGoogle Scholar
  17. 17.
    M. R. D’Amato, J. Fazzaro and M. Etkin, Discriminated bar-press avoidance maintenance and extinction in rats as a function of shock intensity. J. Comp. Physiol, Psychol 63, 351–354.Google Scholar
  18. 18.
    S. S. Fox, Self-maintained sensory input and sensory deprivation in monkeys: A behavioral and neuropharmacological study, J. Comp. Physiol. Psychol. 55, 438–444 (1962).CrossRefGoogle Scholar
  19. 19.
    K. Fuxe, T. Hökfelt, and U. Ungerstedt, Morphological and functional Aspects of Central Monoamine Neurons, in Intern. Rev. Neurobiol. (C. C. Pfeiffer and J. R. Symythies, eds.) 13, 93–126. Academic Press, New York (1970).Google Scholar
  20. 20.
    W. J. Gardner, J. C. R. Licklider and A. Z. Weisz, Suppression of pain by sound. Science 132, 32–33 (1961).CrossRefGoogle Scholar
  21. 21.
    S. P. Grossman, The VMH: a center for affective reactions, satiety, or both? Physiol. Behavior 1, 1–10 (1966).CrossRefGoogle Scholar
  22. 22.
    S. Grossberg, Embedding fields: A theory of learning with physiological implications. J. Math. Psychol 6, 209–239 (1969).CrossRefGoogle Scholar
  23. 23.
    S. Grossberg, On learning, information, lateral inhibition, and transmitters, Math. Biosci. 4, 255–310 (1969).CrossRefGoogle Scholar
  24. 24.
    S. Grossberg, On the production and release of chemical transmitters and related topics in cellular control, J. Theoret. Biol. 22, 325–364 (1969).CrossRefGoogle Scholar
  25. 25.
    S. Grossberg, Neural pattern discrimination. J. Theoret. Biol. 27, 291–337 (1970).CrossRefGoogle Scholar
  26. 26.
    S. Grossberg, Embedding Fields: Underlying philosophy, mathematics, and applications to psychology, physiology, and anatomy, J. Cybernet. 1, 28–50 (1971).CrossRefGoogle Scholar
  27. 27.
    S. Grossberg, On the dynamics of operant conditioning. J. Theoret. Biol. 33, 225–255 (1971).CrossRefGoogle Scholar
  28. 28.
    S. Grossberg, Neural expectation: Cerebellar and retinal analogs of cells fired by learnable or unlearned pattern classes, Kybernetik (1972).Google Scholar
  29. 29.
    S. Grossberg, A neural theory of punishment and avoidance, I, Qualitative theory, Math. Biosci 15, 39–68 (1972).CrossRefGoogle Scholar
  30. 30.
    S. Grossberg and J. Pepe, Schizophrenia: Possible dependence of associational span, bowing, and primacy vs. recency on spiking threshold, Behav. Sci. 15, 359–362 (1970).CrossRefGoogle Scholar
  31. 31.
    S. Grossberg and J. Pepe, Spiking threshold and overarousal effects in serial learning, J. Statist. Phys. 1, 319–350 (1971).CrossRefGoogle Scholar
  32. 32.
    J. A. Harvey and C. E. Lints, Lesions in the medial forebrain bundle: Delayed effects on sensitivity to electric shock, Science 148, 250–251 (1965).CrossRefGoogle Scholar
  33. 33.
    R. H. Haude, Effects of scopolamine on discriminated responding in the rat. J. Pharmacol. Exp. Therap. 126, 349–358 (1959).Google Scholar
  34. 34.
    D. O. Hebb, Drives and the CNS (conceptual nervous system), Psychol. Rev. 62, 243–254 (1955).CrossRefGoogle Scholar
  35. 35.
    F. W. Huff, T. P. Piantanida and G. L. Morris, Free operant avoidance responding as a function of serially presented variations in UCS intensity, Psychonomic Sci. 8, 111–112(1967).Google Scholar
  36. 36.
    J. L. Johnson and R. M. Church, Effects of shock intensity on nondiscriminative avoidance learning of rats in a shuttlebox, Psychonomic Sci., 3, 497–498 (1965).Google Scholar
  37. 37.
    L. J. Kamin, C. J. Brimer and A. H. Black, Conditioned suppression as a monitor of fear in the course of avoidance training. J. Comp. Physiol. Psychol. 56, 497–501 (1963).CrossRefGoogle Scholar
  38. 38.
    J. D. Keehn, Effect of shock duration on Sidman avoidance response rates, Psychol. Repts, 13, 852 (1963).CrossRefGoogle Scholar
  39. 39.
    K. A. Khavari, Effects of central versus intraperitoneal d-amphetamine administration on learned behavior, J. Comp. Physiol. Psychol 68, 226–234 (1969).CrossRefGoogle Scholar
  40. 40.
    K. A. Khavari, Adrenergic-cholinergic involvement in modulation of learned behavior, J. Comp. Physiol. Psychol. 74, 284–291 (1971).CrossRefGoogle Scholar
  41. 41.
    J. Kopa, I. Szabó and E. Grastyán, A dual behavioral effect from stimulating the same thalamic point with identical stimulus parameters in different conditional reflex situations, Acta Physiol. Acad. Sci. Hungaricae (Budapest), 21, 207–214 (1962).Google Scholar
  42. 42.
    C. Kornetsky and M. Eliasson, Reticular stimulation and chlorpromazine: an animal model for schizophrenic overarousal, Science 165, 1273–1274 (1969).CrossRefGoogle Scholar
  43. 43.
    D. Macht, A pharmacodynamic analysis OF the cerebral effects of atropin, homatropin, scopolamin and related drugs, J. Pharmacol. Exptl. Therap. 22, 35–48 (1923).Google Scholar
  44. 44.
    D. L. Margules and L. Stein, Neuroleptics vs. tranquillizers: Evidence from animal behavior studies of mode and site of action, in Neuropsychopharmacology (H. Brill, ed.), International Congress Series No. 129. Excerpta Medica Foundation, Amsterdam (1967).Google Scholar
  45. 45.
    L. K. Martin and D. Reiss, Effects of US intensity during previous discrete delay conditioning on conditioned acceleration during avoidance conditioning, J. Comp. Physiol. Psychol. 69, 196–200 (1969).CrossRefGoogle Scholar
  46. 46.
    W. R. Miles, Hyoscine vs. alcohol: Effect on the behavior of rats in the elevated maze, Proc. 9th Intern. Congr. Psychol. (1929), pp. 309–310.Google Scholar
  47. 47.
    N. E. Miller, Learning resistance to pain and fear: Effects of overlearning, exposure, and rewarded exposure in context, J. Exptl. Psychol 60, 137–145 (1960).CrossRefGoogle Scholar
  48. 48.
    A. K. Myers, Effects of continuous loud noise during instrumental shock-escape conditioning, J. Comp. Physiol. Psychol 68, 617–622 (1969).CrossRefGoogle Scholar
  49. 49.
    W. J. H. Nauta and W. Haymaker, Hypothalamic nuclei and fiber connections, in The Hypothalamus (W. Haymaker, E. Anderson and W. J. H. Nauta, eds.), C. C. Thomas, Springfield, Illinois (1969).Google Scholar
  50. 50.
    J. Olds, A. Yuwiler, M. E. Olds and C. Yun, Neurohumors in hypothalamic sub-states of reward, Amer. J. Physiol 207, 242–254 (1964).Google Scholar
  51. 51.
    M. I. Phillips and P. B. Bradley, Reticular stimulation and chlorpromazine, Science 168, 1122–1123 (1970).CrossRefGoogle Scholar
  52. 52.
    D. Reiss, Sidman avoidance in rats as a function of shock intensity and duration, J. Comp. Physiol Psychol 73, 481–485 (1970).CrossRefGoogle Scholar
  53. 53.
    J. Sepinwall, Enhancement and impairment of avoidance behavior by chemical stimulation of the hypothalamus, J. Comp. Physiol Psychol 68, 393–399 (1969).CrossRefGoogle Scholar
  54. 54.
    J. Sepinwall and F. S. Grodsky, Effects of cholinergic stimulation of the rat hypothalamus or cholinergic blockade on discrete-trial conflict. Paper presented at the meeting of the Eastern Psychological Association, Washington, April (1968).Google Scholar
  55. 55.
    M. H. Sheard, J. B. Appel, D. X. Freedman, J. Psychiat. Res. 5, 237–242 (1967).CrossRefGoogle Scholar
  56. 56.
    C. D. Shute and P. R. Lewis, Cholinergic and monoaminergic pathways in the hypothalamus, Brit. Med. Bull 22, 221–226 (1966).Google Scholar
  57. 57.
    L. Stein, Noradrenergic substrates f positive reinforcements: Site of motivational action of amphetamine and chlorpromazine, in Neuropsychopharmacology (H. Brill et al., eds.), Excerpta Med. Foundation, Amsterdam (1967).Google Scholar
  58. 58.
    A. Strouthes, Effect of CS-onset, UCS-termination delay, UCS duration, CS-onset interval, and number of CS-UCS pairings on conditioned fear response. J. Exptl Psychol 69, 287–291 (1965).CrossRefGoogle Scholar
  59. 59.
    R. F. Thompson, Foundations of Physiological Psychology, Harper, New York (1967).Google Scholar
  60. 60.
    N. Weiner, Regulation of norepinephrine biosynthesis, in Ann. Rev. Pharmacol (N. W. Elliott, W. C. Cutting, and R. H. Dreisbach, eds.) 10, 273–290 (1970).Google Scholar
  61. 61.
    B. Weiss and V. G. Laties, Behavioral Pharmacology and Toxicology, in Ann. Rev. Pharmacol (H. W. Elliott, W. C. Cutting and R. H. Dreisbach, eds.), 9, 297–326 (1969).Google Scholar
  62. 62.
    C. Wise and L. Stein, Facilitation of brain self-stimulation by central administration of norepinephrine, Science 163, 299–301 (1969).CrossRefGoogle Scholar

Copyright information

© D. Reidel Publishing Company, Dordrecht, Holland 1982

Authors and Affiliations

  • Stephen Grossberg
    • 1
  1. 1.Department of MathematicsBoston UniversityUSA

Personalised recommendations