Abstract
Interaction mechanisms between excitatory and inhibitory impulse sequences operating on neurons play an important role for the processing of information by the nervous system. For instance, the convergence of excitatory and inhibitory influences on retinal ganglion cells to form their receptive fields has been taken as an example for the process of neuronal sharpening by lateral inhibition. In order to analyze quantitatively the functional behavior of such a system, Shannon's entropy method for multiple access channels has been applied to biological two-inputs-one-output systems using the theoretical model developed by Tsukada et al. (1979). Here we give an extension of this procedure from the point of view to reduce redundancy of information in the input signal space of single neurons and attempt to obtain a new interpretation for the information processing of the system. The concept for the redundancy reducing mechanism in single neurons is examined and discussed for the following two processes. The first process is concerned with a signal space formed by superposing two random sequences on the input of a neuron. In this process, we introduce a coding technique to encode the inhibitory sequence by using the timing of the excitatory sequence, which is closely related to an encoding technique of multiple access channels with a correlated source (Marko, 1966, 1970, 1973; Slepian and Wolf, 1973) and which is an invariant transformation in the input signal space without changing the information contents of the input. The second process is concerned with a procedure of reducing redundant signals in the signal space mentioned before. In this connection, it is an important point to see how single neurons reduce the dimensionality of the signal space via transformation with a minimum loss of effective information. For this purpose we introduce the criterion that average transmission of information from signal space to the output does not change when redundant signals are added. This assumption is based on the fact that two signals are equivalent if and only if they have identical input-output behavior. The mechanism is examined and estimated by using a computer-simulated model. As the result of such a simulation we can estimate the minimal segmentation in the signal space which is necessary and sufficient for temporal pattern sensitivity in neurons.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Attneave, F.: Informational aspects of visual perception. Psychol. Rev. 61, 183–193 (1954)
Barlow, H.B.: Trigger features, adaption and economy of impulses. In: Information Processing in the Nervous system, K. N. Leibovic, ed.: Berlin, Heidelberg, New York: Springer (1969)
Barlow, H.B., Narasimhan, R., Rosenfeld, A: Visual pattern analysis in machines and animals. Science 117, 567–575 (1972)
Barlow, H.B.: Sensory mechanisms, the reduction of redundancy and intelligence. Symposium on the mechanization of thought processes at the National Physical Laboratory, London. H. M. Stationary Office, Symp. No. 10, 535–539 (1959)
Bishop, P.O., Levik, W.R., Williams, W.O.: Statistical analysis of dark discharge of lateral geniculate neurons. J. Physiol. (London) 170, 598–612 (1964)
Coleman, R., Gastwirth, J.L.: Some models for interaction of renewal processes related to neuron firing. J. Appl. Probab. 6, 38–58 (1969)
Cox, D.R.: On the superposition of renewal processes. Biometrika 41, 91–99 (1954)
Cox, D.R.: Renewal theory: John Wiley and Sons, Inc., New York (1962)
Gerstein, G.L., Clark, W.A.: Simultaneous studies of firing patterns in several neurons. Science 143, 1325–1327 (1964)
Hauske, G., Neuburger, E.: Gerichtete Informationsgrößen zur Analyse gekoppelter Verhaltensweisen, Kybernetik 4, 171–181 (1968)
Ten Hoopen, M., Reuver, H.A.: Selective interaction between two independent recurrent processes. J. Appl. Probab. 2, 286–292 (1965)
Ten Hoopen, M.: Multimodal interval distributions. Kybernetik 3, 17–24 (1966)
Ten Hoopen, M.: Pooling of impulse sequence with emphasis on applications to neuronal spike data. Kybernetik 4, 1–10 (1967)
Marko, H.: Die Theorie der bidirektionalen Kommunikation und ihre Anwendung auf die Informationsübermittlung zwischen Menschen (subjektive Information): Kybernetik, 3, 128–136, (1966)
Marko, H.: Information theory and Cybernetics. IEEE Spectrum, 75–83, (1970)
Marko, H., Neuburger, E.: Über gerichtete Größen in der Informationstheorie (Untersuchungen zur Theorie der bidirektionalen Kommunikation). Arch. Elekt. Übertragung 21, 61–69 (1967)
Marko, H.: The bidirectional communication theory: a generalization of information theory; IEEE Trans., COM-21, 12, 1345–1357 (1973)
Marmarelis, P.Z., Naka, K.-I.: Nonlinear analysis and synthesis of receptive-field responses in the catfish retina. I. Horizontal cell ganglion cell chain. J. Neurophysiol. 36, 605–678 (1973a)
Marmarelis, P.Z., Naka, K.-I.: Nonlinear analysis and synthesis of off-receptive-field responses in the catfish retina. II. One-input white-noise analysis. J Neurophysiol. 36, 619–633 (1973b)
Marmarelis, P.Z., Naka, K.-I.: Nonlinear analysis and synthesis of receptive-field responses in the catfish retina. III. Two-input white-noise analysis. J. Neurophysiol. 36, 634–648 (1973c)
Matsuyama, Y., Shirai, K., Akizuki, K.: On some properties of stochastic information processes in neurons and neuron populations. Kybernetik 15, 127–145 (1974)
McGill, W.J.: Multivariate information transmission. IRE Trans. Inf. Theory 4, 93–177 (1954)
Perkel, D.H., Gerstein, G.L., Moore, G.P.: Neural spike trains and stochastic point processes: I. The single spike train. II. Biophys. J. 7, 397–418 (1967)
Perkel, D.H., Gerstein, G.L., Moore, G.P.: Neural spike trains and stochastic point processes. II. Simultaneous spike train. Biophys. J. 7, 419–440 (1967)
Sanderson, A.C., Kozak, W.M., Calvert, T.W.: Distribution coding in the visual pathway. Biophys. J. 18, 218–244 (1973)
Sengundo, J.P., Perkel, D.H., Moore, G.P.: Spike probability in neurons: Influence of temporal structure in the train of synaptic events. Kybernetik 3, 67–82 (1966)
Segundo, J.P., Perkel, D.H., Wyman, H., Hegstad, H., Moore, G.P.: Input-output relations in computer simulated nerve cells. Kybernetik 4, 157–171 (1968)
Shannon, C., Weaver, W.: The mathematical theory of communication. Urbana, Univ. of Illinois Press 1949
Slepian, D., Wolf, H.K.: A coding theorem for multiple access channels with correlated sources. B.S.T.J. 52, 1037–1076 (1973)
Sromovasam, S.K., Rajamannar, G.: Selective interaction between two independent stationary recurrent point processes. J. Appl. Prob. 7, 476–482 (1970)
Stein, R.B.: The information capacity of nerve cells using a frequency code. Biophys. J. 7, 797–826 (1967)
Tsukada, M., Sato, R.: Statistical analysis and functional interpretation of input-output relation in computer simulated nerve cell. Japan J. Med. Electron. Biol. Erg. 10, 370–378 (1972)
Tsukada, M., Ishii, N., Sato, R.: Temporal pattern discrimination of impulse sequences in the computersimulated nerve cells. Biol. Cybern. 17, 19–28 (1975)
Tsukada, M., Obara, K., Sato, R.: Information transmission in multi-input-output stochastic neuron models: Biol. Cybern. 34, 119–124 (1979)
Tsukada, M., Usami, H., Sato, R.: Stochastic automaton models for interaction of excitatory and inhibitory impulse sequences in neurons. Biol. Cybern. 27, 235–245 (1977)
Usami, H., Tsukada, M., Sato, R.: Interaction between excitatory and inhibitory input impulse sequences in mathematical models of single neurons. Japan J. Med. Electron. Biol. Erg. 15, 171–178 (1977)
Usami, H., Masaki, S., Sato, R.: The stochastic properties of the basic neuron populations as information processing system. Biol. Cybern. 29, 167–173 (1978)
Werner, G., Mountcastle, V.B.: Neural activity in mechanoreceptive cutaneous afferents-stimulus response relations, Weber functions and information transfer. J. Neurophysiol. 28, 359–397 (1965)
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Tsukada, M., Aihara, T. & Hauske, G. Redundancy reducing processes in single neurons. Biol. Cybern. 50, 157–165 (1984). https://doi.org/10.1007/BF00340023
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF00340023