Abstract
In this paper we consider a formulation of neural computation in terms of multilayer co-operative processes between local inference units. Each neuron is described in terms of a local computation frame with slots and semantic tables to represent the meaning of the input and output representation spaces. After some methodological remarks on the distinction between processors and processes in the auditor paradigm, we introduce the computational model of co-operativity where global computations are divided into a large number of dinamically reconfigurable sub-computations. Some theoretical requirements are considered and the lack of developments on concurrent programming is pointed out. Then, the frame neuron is introduced and the meaning of the different slots is stablished. Linear and algorithmic formulation appears as a particular case of the frame to which we can reduce all previous connectionistic formulations. This computational model is used to “revisit” the analogical level where neuronal function is formulated in terms of linear spatio-temporal filters followed by a threshold function.
A personal feeling underlying all the paper is the lack of appropriate tools in systems theory powerful enough to describe complex behavior such as that of neural nets where the linear and logic levels are not sufficient.
Preview
Unable to display preview. Download preview PDF.
References
AGHA, G. (1986): “ACTORS: A model of concurrent computation in distributed systems”. The MIT Press. Cambridge. Mass.
AGHA, G. (1986): “Supporting Multiparadigm Programming on Actor Architecture”. in Parallel Architectures and Languages Europe”. Ed. by E. Odijk, M. Rem and J.C. Syre, pp. 1–19. Springe-Verlag. Berlin.
AMARI S. (1982): “Competitive and Cooperative aspects in dynamics of neural excitation and self-organization” in “Competition and Cooperation in Neural Nets”. Ed. by Amari and Arbid, pp. 1–28. Springer-Verlag. Berlín.
AMARI S. and ARBIB M.A. (1982) Eds.: “Competition and cooperation in neural nets”. Springer-Verlag. Berlín.
ARBIB M.A. and HANSON A.R. (Eds.) (1987): “Vision, brain and cooperative computation”. The MIT Press. Cambridge, Mass.
BEURLE R.L. (1956): “Properties of a mass of cells capable of regenerating pulses”. Phil. Trans. 240, pp. 55–94.
BRAITENBERG V. (1977): “On the texture of brains: An introduction to neuroanatomy for the cybernetically minded”. Springer Verlag. New York.
CAJAL S.R. (1952): “Histologie du systéme nerveux de l'homme et des vertébrés”. Vol. 1 y 2. Maloine. París.
COWAN J.D. (1965): “The problem of organismic reliability”. In: “Cybernetics of the nervous system”. Ed. by N. Wiener and J.P. Schade, pp. 9–63. Elsevier. Amsterdam.
CRAGG B.G. and TEMPERLEY H.N.V. (1954): “The organization of neurones: a co-operative analogy”. Electroencephalography and Clinical Neurophysiology, 6, pp. 85–92.
DELGADO A.E. (1978): “Modelos neurocibernéticos de dinámica cerebral”. Doctoral Dissertation. ETSIT. Madrid.
DELGADO A.E. and MIRA J. (1979): “Residual function after the lesion in formal neural nets”. In: “Applications of Information and Control Systems”, pp. 209–216. Lainiotis and Tzannes (eds.). Reidel Pub. Comp. Holland.
ECCLES J.C. (1984). “The cerebral neocortex: A theory of its operation”. In: “Cerebral Cortex”, Vol. 2. Ed. by E.G. Jones and A. Peters, pp. 1–36. Plenum Press. New York.
EDELMAN G.M. (1981). “Group selection as the basis for higher brain function”. In: “The Organization of the Cerebral Cortex”. A Neuroscience Research Program Colloquiun. Ed. by F.O. Scmitt et al., pp. 533–563. The MIT Press, Cambridge, Mass.
FAHLMAN S.E. and HINTON G.E. (1978). “Connectionistic architectures for artificial intelligence”. Computer. Vol. 20, No. 1, pp. 100–109.
FELDMAN J.A. et al. (1988): “Computing with structured connectionist networks”. Communications of the ACM, Vol. 31, No. 2, pp. 170–187.
FREEMAN W.J. (1975). “Mass action in the nervous system”. Academic Press. New York.
GONZALO J. (1952): “Las funciones cerebrales humanas según nuevos datos y bases fisiológicas”. Trabajos del Instituto Cajal de Inv. Biol., Vol. XLIV. Madrid.
GONZALO J. (1977): “Personal Communication”.
HECHT-NIELSEN R. (1988): “Neurocomputing: picking the human brain”. IEEE Spectrum, March 1988, pp. 36–41.
HINTON G.E. and ANDERSON J.A. (eds.) (1981): “Parallel models of associative memory”. Lawrence Erlbaun Associates Inc. New Jersey.
HOPFIELD J.J. and TANK D.W. (1986): “Computing with neural circuits: a model”. Science, Vol. 233, pp. 625–633.
KILMER W. and McCULLOCH W.S. (1969): “The reticular formation command and control system”. In: “Information Processing in The Nervous System”. Ed. by K.N. Leibovic. Springer-Verlag. Berlín.
KOHONEN T. (1988): “The’ neural’ phonetic typewriter”. Computer, Vol. 2, No. 3, pp. 11–22.
LASHLEY K.S. (1929): “Brain mechanisms and intelligence”. University of Chicago Press. Chicago.
LASHLEY K.S. (1939): “The mechanisms of vision: XVI. The functioning of small remnants of the visual cortex”. J. Comp. Neural 70, pp. 45–67.
LASHLEY K.S. (1950): “In search of the engram”. In: “Society for Experimental Biology”. Symposium No. 4: Physiological Mechanims in Animal Behavior. Cambridge Univ. Press.
LIPMANN R.P. (1987): “An introduction to computing with neural nets”. IEEE-ASSP Magazine. April, pp. 4–22.
LORENTE DE NO M.D. (1933): “J. fr Psychol. un Neurol.”, 45, 6, pp, 381–438.
LURIA A.R. (1974 a): “El cerebro en acción”. Ed. Fontanella. Barcelona.
LURIA A.R. (1974 b): “Cerebro y lenguaje”. Ed. Fontanella. Barcelona.
MATURANA H.R. (1975): “The organization of the living: A theory of the living organization”. Int. J. Man-Machine Studies, 7, pp. 313–332.
McCULLOCH W.S. (1965): “Embodiments of mind”. The MIT Press. Mass.
MIRA J., DELGADO A.E. and MORENO-DIAZ R. (1980): “Cooperative processes in cerebral dynamic”. Applications of Information and Control Systems. In D.G. Lainiotis and N.S. Tzannes eds. D. Reidel Pub. Co. Dordrecht, pp. 273–280.
MIRA J. and DELGADO A.E. (1981): “A model of low level co-operativity in cerebral dynamics”. Proceedings Fifth International Congress of Cybernetics and Systems. Mexico D.F. (Agosto).
MIRA J. et al. (1981): “On the lesion tolerance problem for co-operative processes”. In Implementing Funtions: “Microprocessors and Firmware”. Ed. by L. Richter. North-Holland, pp. 71–80.
MIRA J. y MORENO-DIAZ R. (1982): “Un marco teórico para interpretar la función neuronal a altos niveles”. Actas de la I Reunion Nacional de Biocibernética, pp. 151–157. Real Academia de Ciencias. Madrid.
MIRA J. et al. (1983): “A theoretical proposal to embody co-operative decision in the nervous system”. International Conference on World Problems and Systems Learning, pp. 23–27. Detroit. Michigan.
MIRA J. et al (1987): “The fuzzy paradigm for knowledge representation in cerebral dynamics”. Fuzzy Sets and Systems, 23, pp. 315–330.
MIRA J. and DELGADO A.E. (1987): “A logical model of co-operative processes in cerebral dynamics”. Cybernetics and Systems: An International Journal, 18, pp. 319–349.
MIRA, J. (1989): “System behaviour and computing structure”. In Lecture Notes in Computer Science: Computer Aided Systems Theory-EUROCAST'89. Ed. by F. Pichler and R. Moreno-Diaz. pp. 267–283. Springer-Verlag. Berlin.
MIRA, J. et al (1989): “Towards a computational theory of systems. Some cases study”. In Lecture Notes in Computer Science: Computer Aided Systems Theory-EUROCAST'89. Ed. by F. Pichler and R. Moreno-Diaz. pp. 284–300. Springer-Verlag. Berlin.
MIRA, J. (1990): “Signification and Intention in Neural Nets, Revisited”. Proc. Fourth International Symposium on Knowledge Engineering, pp. 1–20. Barcelona.
MOUNTCASTLE V.B. (1979): “An organizing principle for cerebral function: the unit module and the distributed system”, in F.O. Schmitt and F.G. Worden (Eds.): The Neuroscience Fourth Study Program, pp. 21–42. The MIT Press, Cambridge. Mass.
PERKEL D.H. and BULLOCK T.H. (1968): “Neural coding. A report based on an NRP work session”. Neurociences Research Program Bulletin, Vol. 6, No. 3. Brookline, Mass.
RUMELHART D.E. and McCLELLAND J.L. eds. (1987): “Parallel distributed processing”. Vol. 1: Foundations. The MIT Press. Mass.
SZENTAGOTHAI J. (1975): “The module concept in cerebral cortex architecture”. Brain Research, 95. pp. 475–496.
SZENTAGOTHAI J. (1979): “Local neuron circuits of the neocortex”. In F.O. Schmitt and F.G. Worden (Eds.): “The Neuroscience Fourth Study Program”, pp. 394–415. The MIT Press, Cambridge. Mass.
VARELA F. (1977): “The nervous system as a closed network”. Brain Theory Newsletter. Vol. 2, No 4, pp. 66–67.
VARELA F.J. (1979): “Principles of biological autonomy”. North-Holland. N. York.
VON NEUMANN J. (1956): “Probabilistic logics and the synthesis of reliable organisms from unreliable components”. In: “Automata Studies”. Ed. by C.E. Shannon and J. McCarthy. Princenton University Press. Princenton, New York.
Author information
Authors and Affiliations
Editor information
Rights and permissions
Copyright information
© 1992 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Mira, J., Delgado, A.E. (1992). Linear and algorithmic formulation of co-operative computation in neural nets. In: Pichler, F., Díaz, R.M. (eds) Computer Aided Systems Theory — EUROCAST '91. EUROCAST 1991. Lecture Notes in Computer Science, vol 585. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0021001
Download citation
DOI: https://doi.org/10.1007/BFb0021001
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-55354-0
Online ISBN: 978-3-540-47034-2
eBook Packages: Springer Book Archive