, Volume 10, Issue 1, pp 49–57 | Cite as

Neural expectation: cerebellar and retinal analogs of cells fired by learnable or unlearned pattern classes

  • Stephen Grossberg


Neural networks are introduced which can be taught by classical or instrumental conditioning to fire in response to arbitrary learned classes of patterns. The filters of output cells are biased by presetting cells whose activation prepares the output cell to “expect” prescribed patterns. For example, an animal that learns to expect food in response to a lever press becomes frustrated if food does not follow the lever press. It's expectations are thereby modified, since frustration is negatively reinforcing. A neural analog with aspects of cerebellar circuitry is noted, including diffuse mossy fiber inputs feeding parallel fibers that end in Purkinje cell dendrites, climbing fiber inputs ending in Purkinje cell dendrites and giving off collaterals to nuclear cells, and inhibitory Purkinje cell outputs to nuclear cells. The networks are motivated by studying mechanisms of pattern discrimination that require no learning. The latter often use two successive layers of inhibition, analogous to horizontal and amacrine cell layers in vertebrate retinas. Cells exhibiting hue (in)constancy, brightness (in)constancy, or movement detection properties are included. These results are relevant to Land's retinex theory and to the existence of opponent- and nonopponent-type cell responses in retinal cells. Some adaptation mechanisms, and arousal mechanisms for crispening the pattern weights that can fire a given cell, are noted.


Mossy Fiber Amacrine Cell Lever Press Nuclear Cell Instrumental Conditioning 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Abramov, I.: Further analysis of the responses of LGN cells. J. Opt. Soc. Amer. 58, 574 (1968).Google Scholar
  2. Baylor, D.A., Fuortes, M.G.F.: Electrical responses of single cones in the retina of the turtle. J. Physiol. (Lond.) 207, 77 (1970).Google Scholar
  3. Bell, C.C., Dow, R.S.: Cerebellar circuitry. In: Neurosciences Research Symposium Summaries, vol.2 (Schmitt, F.O., Melnechuk, T., Quarton, G. C., and Adelman, G., eds.). Cambridge, Mass.: M.I.T. Press 1967.Google Scholar
  4. Bennett, M.V.L.: Analysis of parallel excitatory and inhibitory synaptic channels. J. Neurophysiol. 34, 69 (1971).Google Scholar
  5. Blackenship, J.E., Wachtel, H., Kandel, E.R.: Ionic mechamisms of excitatory, inhibitory, and dual synaptic actions mediated by an identified interneuron in abdominal ganglion of Aplysia. J. Neurophysiol. 34, 76 (1971).Google Scholar
  6. Bloedel, J.R., Roberts, W.J.: Action of climbing fibers in cerebellar cortex of the cat. J. Neurophysiol. 34, 32 (1971).Google Scholar
  7. Cornsweet, T.N.: Visual perception. New York: Academic Press 1970.Google Scholar
  8. Creutzfeldt, O.D., Sakmann, B., Scheich, H., Korn, A.: Sensitivity distribution and spatial summation within receptivefield center of retinal on-center ganglion cells and transfer function of the retina. J. Neurophysiol. 33, 654 (1970).Google Scholar
  9. Dowling, J.E., Werblin, F.S.: Organization of retina of the mudpuppy Necturus maculosus. I. Synaptic structure. J. Neurophysiol. 32, 315 (1969).Google Scholar
  10. Eccles, J.C., Ito, M., Szentagothai, J.: The cerebellum as a neuronal machine. Berlin-Heidelberg-New York: Springer 1967.Google Scholar
  11. Freeman, J.A.: Responses of cat cerebellar Purkinje cells to convergent inputs from cerebral cortex and peripheral sensory systems. J. Neurophysiol. 33, 697 (1970).Google Scholar
  12. Grossberg, S.: Embedding fields: A theory of learning with physiological implications. J. Mathematical Psychology 6, 209 (1969a).Google Scholar
  13. — Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, I. J. Math. Mech. 19, 53 (1969b).Google Scholar
  14. — On learning of spatiotemporal patterns by networks with ordered sensory and motor components, I. Excitatory components of the cerebellum. Studies in Applied Mathematics 48, 105 (1969c)Google Scholar
  15. — Neural pattern discrimination. J. theor. Biol. 27, 291 (1970a).Google Scholar
  16. — Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, II. Studies in Applied Mathematics 49, 135 (1970b).Google Scholar
  17. — Pavlovian pattern learning in nonlinear neural networks. Proc. nat. Acad. Sci. (Wash.) 68, 828 (1971).Google Scholar
  18. - A neural theory of punishment and avoidance. Mathematical Biosciences 1972, submitted for publication.Google Scholar
  19. Kaneko, A.: Physiological and morphological identification of horizontal, bipolar and amacrine cells in goldfish retina. J. Physiol. (Lond.) 207, 623 (1970).Google Scholar
  20. Kimble, G.A.: Conditioning and learning. New York: Apple-ton-Century-Crofts 1961.Google Scholar
  21. Komisaruk, B. R.: Synchrony between limbic system theta activity and rhythmical behavior in rats. J. comp. physiol. Psychol. 70, 482 (1970).Google Scholar
  22. Land, E.H.: The retinex. Amer. Scientist 52, 247 (1969).Google Scholar
  23. — McCann, J. J.: Lightness theory. J. Opt. Soc. Amer. 61, 1 (1971).Google Scholar
  24. Miller, S., Oscarsson, O.: Termination and functional organization of spinoolivocerebellar paths. In: The cerebellum in health and disease (Fields, W. S., and Willis, W. D., eds.). St. Louis: W.H. Green 1970.Google Scholar
  25. Naka, K.I., Rushton, W.A.H.: S-potentials from color units in the retina of fish (Cyprinidae). J. Physiol. (Lond.) 185, 536 (1966).Google Scholar
  26. Sperling, G.: Model of visual adaptation and contrast detection. Perception and Psychophysics 8, 143 (1970).Google Scholar
  27. — Sondhi, M.M.: Model for visual luminance discrimination and flicker detection. J. Opt. Soc. Amer. 58, 1133 (1968).Google Scholar
  28. Stell, W.K.: The structure and relationship of horizontal cells and photo-receptor-bipolar synaptic complexes in goldfish retina. Amer. J. Anat. 121, 401 (1967).Google Scholar
  29. Wachtel, H., Kandel, E.R.: Conversion of synaptic excitation to inhibition at a dual chemical synapse. J. Neurophysiol. 34, 56 (1971).Google Scholar
  30. Wagner, A.R.: Frustrative nonreward: A variety of punishment. In: Punishment and aversive behavior (Campbell, B.A., and Church, R.M., eds.). New York: Appleton-Century-Crofts 1969.Google Scholar
  31. Werblin, F.S.: Response of retinal cells to moving spots: Intracellular recording in Necturus maculosus. J. Neurophysiol. 33, 342 (1970).Google Scholar
  32. — Dowling, J.E.: Organization of the retina of the mudpuppy, Necturus maculosus. II. Intracellular recording. J. Neurophysiol. 32, 339 (1969).Google Scholar

Copyright information

© Springer-Verlag 1972

Authors and Affiliations

  • Stephen Grossberg
    • 1
  1. 1.Massachusetts Institute of TechnologyCambridgeUSA

Personalised recommendations