Abstract
Neural networks are introduced which can be taught by classical or instrumental conditioning to fire in response to arbitrary learned classes of patterns. The filters of output cells are biased by presetting cells whose activation prepares the output cell to “expect” prescribed patterns. For example, an animal that learns to expect food in response to a lever press becomes frustrated if food does not follow the lever press. It's expectations are thereby modified, since frustration is negatively reinforcing. A neural analog with aspects of cerebellar circuitry is noted, including diffuse mossy fiber inputs feeding parallel fibers that end in Purkinje cell dendrites, climbing fiber inputs ending in Purkinje cell dendrites and giving off collaterals to nuclear cells, and inhibitory Purkinje cell outputs to nuclear cells. The networks are motivated by studying mechanisms of pattern discrimination that require no learning. The latter often use two successive layers of inhibition, analogous to horizontal and amacrine cell layers in vertebrate retinas. Cells exhibiting hue (in)constancy, brightness (in)constancy, or movement detection properties are included. These results are relevant to Land's retinex theory and to the existence of opponent- and nonopponent-type cell responses in retinal cells. Some adaptation mechanisms, and arousal mechanisms for crispening the pattern weights that can fire a given cell, are noted.
Similar content being viewed by others
References
Abramov, I.: Further analysis of the responses of LGN cells. J. Opt. Soc. Amer. 58, 574 (1968).
Baylor, D.A., Fuortes, M.G.F.: Electrical responses of single cones in the retina of the turtle. J. Physiol. (Lond.) 207, 77 (1970).
Bell, C.C., Dow, R.S.: Cerebellar circuitry. In: Neurosciences Research Symposium Summaries, vol.2 (Schmitt, F.O., Melnechuk, T., Quarton, G. C., and Adelman, G., eds.). Cambridge, Mass.: M.I.T. Press 1967.
Bennett, M.V.L.: Analysis of parallel excitatory and inhibitory synaptic channels. J. Neurophysiol. 34, 69 (1971).
Blackenship, J.E., Wachtel, H., Kandel, E.R.: Ionic mechamisms of excitatory, inhibitory, and dual synaptic actions mediated by an identified interneuron in abdominal ganglion of Aplysia. J. Neurophysiol. 34, 76 (1971).
Bloedel, J.R., Roberts, W.J.: Action of climbing fibers in cerebellar cortex of the cat. J. Neurophysiol. 34, 32 (1971).
Cornsweet, T.N.: Visual perception. New York: Academic Press 1970.
Creutzfeldt, O.D., Sakmann, B., Scheich, H., Korn, A.: Sensitivity distribution and spatial summation within receptivefield center of retinal on-center ganglion cells and transfer function of the retina. J. Neurophysiol. 33, 654 (1970).
Dowling, J.E., Werblin, F.S.: Organization of retina of the mudpuppy Necturus maculosus. I. Synaptic structure. J. Neurophysiol. 32, 315 (1969).
Eccles, J.C., Ito, M., Szentagothai, J.: The cerebellum as a neuronal machine. Berlin-Heidelberg-New York: Springer 1967.
Freeman, J.A.: Responses of cat cerebellar Purkinje cells to convergent inputs from cerebral cortex and peripheral sensory systems. J. Neurophysiol. 33, 697 (1970).
Grossberg, S.: Embedding fields: A theory of learning with physiological implications. J. Mathematical Psychology 6, 209 (1969a).
— Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, I. J. Math. Mech. 19, 53 (1969b).
— On learning of spatiotemporal patterns by networks with ordered sensory and motor components, I. Excitatory components of the cerebellum. Studies in Applied Mathematics 48, 105 (1969c)
— Neural pattern discrimination. J. theor. Biol. 27, 291 (1970a).
— Some networks that can learn, remember, and reproduce any number of complicated space-time patterns, II. Studies in Applied Mathematics 49, 135 (1970b).
— Pavlovian pattern learning in nonlinear neural networks. Proc. nat. Acad. Sci. (Wash.) 68, 828 (1971).
- A neural theory of punishment and avoidance. Mathematical Biosciences 1972, submitted for publication.
Kaneko, A.: Physiological and morphological identification of horizontal, bipolar and amacrine cells in goldfish retina. J. Physiol. (Lond.) 207, 623 (1970).
Kimble, G.A.: Conditioning and learning. New York: Apple-ton-Century-Crofts 1961.
Komisaruk, B. R.: Synchrony between limbic system theta activity and rhythmical behavior in rats. J. comp. physiol. Psychol. 70, 482 (1970).
Land, E.H.: The retinex. Amer. Scientist 52, 247 (1969).
— McCann, J. J.: Lightness theory. J. Opt. Soc. Amer. 61, 1 (1971).
Miller, S., Oscarsson, O.: Termination and functional organization of spinoolivocerebellar paths. In: The cerebellum in health and disease (Fields, W. S., and Willis, W. D., eds.). St. Louis: W.H. Green 1970.
Naka, K.I., Rushton, W.A.H.: S-potentials from color units in the retina of fish (Cyprinidae). J. Physiol. (Lond.) 185, 536 (1966).
Sperling, G.: Model of visual adaptation and contrast detection. Perception and Psychophysics 8, 143 (1970).
— Sondhi, M.M.: Model for visual luminance discrimination and flicker detection. J. Opt. Soc. Amer. 58, 1133 (1968).
Stell, W.K.: The structure and relationship of horizontal cells and photo-receptor-bipolar synaptic complexes in goldfish retina. Amer. J. Anat. 121, 401 (1967).
Wachtel, H., Kandel, E.R.: Conversion of synaptic excitation to inhibition at a dual chemical synapse. J. Neurophysiol. 34, 56 (1971).
Wagner, A.R.: Frustrative nonreward: A variety of punishment. In: Punishment and aversive behavior (Campbell, B.A., and Church, R.M., eds.). New York: Appleton-Century-Crofts 1969.
Werblin, F.S.: Response of retinal cells to moving spots: Intracellular recording in Necturus maculosus. J. Neurophysiol. 33, 342 (1970).
— Dowling, J.E.: Organization of the retina of the mudpuppy, Necturus maculosus. II. Intracellular recording. J. Neurophysiol. 32, 339 (1969).
Author information
Authors and Affiliations
Additional information
Supported in part by the Alfred P. Sloan Foundation and the Office of Naval Research (N00014-67-A-0204-0051).
Rights and permissions
About this article
Cite this article
Grossberg, S. Neural expectation: cerebellar and retinal analogs of cells fired by learnable or unlearned pattern classes. Kybernetik 10, 49–57 (1972). https://doi.org/10.1007/BF00288784
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00288784