Skip to main content

Linear and algorithmic formulation of co-operative computation in neural nets

  • Conference paper
  • First Online:
Computer Aided Systems Theory — EUROCAST '91 (EUROCAST 1991)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 585))

Included in the following conference series:

  • 117 Accesses

Abstract

In this paper we consider a formulation of neural computation in terms of multilayer co-operative processes between local inference units. Each neuron is described in terms of a local computation frame with slots and semantic tables to represent the meaning of the input and output representation spaces. After some methodological remarks on the distinction between processors and processes in the auditor paradigm, we introduce the computational model of co-operativity where global computations are divided into a large number of dinamically reconfigurable sub-computations. Some theoretical requirements are considered and the lack of developments on concurrent programming is pointed out. Then, the frame neuron is introduced and the meaning of the different slots is stablished. Linear and algorithmic formulation appears as a particular case of the frame to which we can reduce all previous connectionistic formulations. This computational model is used to “revisit” the analogical level where neuronal function is formulated in terms of linear spatio-temporal filters followed by a threshold function.

A personal feeling underlying all the paper is the lack of appropriate tools in systems theory powerful enough to describe complex behavior such as that of neural nets where the linear and logic levels are not sufficient.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • AGHA, G. (1986): “ACTORS: A model of concurrent computation in distributed systems”. The MIT Press. Cambridge. Mass.

    Google Scholar 

  • AGHA, G. (1986): “Supporting Multiparadigm Programming on Actor Architecture”. in Parallel Architectures and Languages Europe”. Ed. by E. Odijk, M. Rem and J.C. Syre, pp. 1–19. Springe-Verlag. Berlin.

    Google Scholar 

  • AMARI S. (1982): “Competitive and Cooperative aspects in dynamics of neural excitation and self-organization” in “Competition and Cooperation in Neural Nets”. Ed. by Amari and Arbid, pp. 1–28. Springer-Verlag. Berlín.

    Google Scholar 

  • AMARI S. and ARBIB M.A. (1982) Eds.: “Competition and cooperation in neural nets”. Springer-Verlag. Berlín.

    Google Scholar 

  • ARBIB M.A. and HANSON A.R. (Eds.) (1987): “Vision, brain and cooperative computation”. The MIT Press. Cambridge, Mass.

    Google Scholar 

  • BEURLE R.L. (1956): “Properties of a mass of cells capable of regenerating pulses”. Phil. Trans. 240, pp. 55–94.

    Google Scholar 

  • BRAITENBERG V. (1977): “On the texture of brains: An introduction to neuroanatomy for the cybernetically minded”. Springer Verlag. New York.

    Google Scholar 

  • CAJAL S.R. (1952): “Histologie du systéme nerveux de l'homme et des vertébrés”. Vol. 1 y 2. Maloine. París.

    Google Scholar 

  • COWAN J.D. (1965): “The problem of organismic reliability”. In: “Cybernetics of the nervous system”. Ed. by N. Wiener and J.P. Schade, pp. 9–63. Elsevier. Amsterdam.

    Google Scholar 

  • CRAGG B.G. and TEMPERLEY H.N.V. (1954): “The organization of neurones: a co-operative analogy”. Electroencephalography and Clinical Neurophysiology, 6, pp. 85–92.

    Google Scholar 

  • DELGADO A.E. (1978): “Modelos neurocibernéticos de dinámica cerebral”. Doctoral Dissertation. ETSIT. Madrid.

    Google Scholar 

  • DELGADO A.E. and MIRA J. (1979): “Residual function after the lesion in formal neural nets”. In: “Applications of Information and Control Systems”, pp. 209–216. Lainiotis and Tzannes (eds.). Reidel Pub. Comp. Holland.

    Google Scholar 

  • ECCLES J.C. (1984). “The cerebral neocortex: A theory of its operation”. In: “Cerebral Cortex”, Vol. 2. Ed. by E.G. Jones and A. Peters, pp. 1–36. Plenum Press. New York.

    Google Scholar 

  • EDELMAN G.M. (1981). “Group selection as the basis for higher brain function”. In: “The Organization of the Cerebral Cortex”. A Neuroscience Research Program Colloquiun. Ed. by F.O. Scmitt et al., pp. 533–563. The MIT Press, Cambridge, Mass.

    Google Scholar 

  • FAHLMAN S.E. and HINTON G.E. (1978). “Connectionistic architectures for artificial intelligence”. Computer. Vol. 20, No. 1, pp. 100–109.

    Google Scholar 

  • FELDMAN J.A. et al. (1988): “Computing with structured connectionist networks”. Communications of the ACM, Vol. 31, No. 2, pp. 170–187.

    Google Scholar 

  • FREEMAN W.J. (1975). “Mass action in the nervous system”. Academic Press. New York.

    Google Scholar 

  • GONZALO J. (1952): “Las funciones cerebrales humanas según nuevos datos y bases fisiológicas”. Trabajos del Instituto Cajal de Inv. Biol., Vol. XLIV. Madrid.

    Google Scholar 

  • GONZALO J. (1977): “Personal Communication”.

    Google Scholar 

  • HECHT-NIELSEN R. (1988): “Neurocomputing: picking the human brain”. IEEE Spectrum, March 1988, pp. 36–41.

    Google Scholar 

  • HINTON G.E. and ANDERSON J.A. (eds.) (1981): “Parallel models of associative memory”. Lawrence Erlbaun Associates Inc. New Jersey.

    Google Scholar 

  • HOPFIELD J.J. and TANK D.W. (1986): “Computing with neural circuits: a model”. Science, Vol. 233, pp. 625–633.

    Google Scholar 

  • KILMER W. and McCULLOCH W.S. (1969): “The reticular formation command and control system”. In: “Information Processing in The Nervous System”. Ed. by K.N. Leibovic. Springer-Verlag. Berlín.

    Google Scholar 

  • KOHONEN T. (1988): “The’ neural’ phonetic typewriter”. Computer, Vol. 2, No. 3, pp. 11–22.

    Google Scholar 

  • LASHLEY K.S. (1929): “Brain mechanisms and intelligence”. University of Chicago Press. Chicago.

    Google Scholar 

  • LASHLEY K.S. (1939): “The mechanisms of vision: XVI. The functioning of small remnants of the visual cortex”. J. Comp. Neural 70, pp. 45–67.

    Google Scholar 

  • LASHLEY K.S. (1950): “In search of the engram”. In: “Society for Experimental Biology”. Symposium No. 4: Physiological Mechanims in Animal Behavior. Cambridge Univ. Press.

    Google Scholar 

  • LIPMANN R.P. (1987): “An introduction to computing with neural nets”. IEEE-ASSP Magazine. April, pp. 4–22.

    Google Scholar 

  • LORENTE DE NO M.D. (1933): “J. fr Psychol. un Neurol.”, 45, 6, pp, 381–438.

    Google Scholar 

  • LURIA A.R. (1974 a): “El cerebro en acción”. Ed. Fontanella. Barcelona.

    Google Scholar 

  • LURIA A.R. (1974 b): “Cerebro y lenguaje”. Ed. Fontanella. Barcelona.

    Google Scholar 

  • MATURANA H.R. (1975): “The organization of the living: A theory of the living organization”. Int. J. Man-Machine Studies, 7, pp. 313–332.

    Google Scholar 

  • McCULLOCH W.S. (1965): “Embodiments of mind”. The MIT Press. Mass.

    Google Scholar 

  • MIRA J., DELGADO A.E. and MORENO-DIAZ R. (1980): “Cooperative processes in cerebral dynamic”. Applications of Information and Control Systems. In D.G. Lainiotis and N.S. Tzannes eds. D. Reidel Pub. Co. Dordrecht, pp. 273–280.

    Google Scholar 

  • MIRA J. and DELGADO A.E. (1981): “A model of low level co-operativity in cerebral dynamics”. Proceedings Fifth International Congress of Cybernetics and Systems. Mexico D.F. (Agosto).

    Google Scholar 

  • MIRA J. et al. (1981): “On the lesion tolerance problem for co-operative processes”. In Implementing Funtions: “Microprocessors and Firmware”. Ed. by L. Richter. North-Holland, pp. 71–80.

    Google Scholar 

  • MIRA J. y MORENO-DIAZ R. (1982): “Un marco teórico para interpretar la función neuronal a altos niveles”. Actas de la I Reunion Nacional de Biocibernética, pp. 151–157. Real Academia de Ciencias. Madrid.

    Google Scholar 

  • MIRA J. et al. (1983): “A theoretical proposal to embody co-operative decision in the nervous system”. International Conference on World Problems and Systems Learning, pp. 23–27. Detroit. Michigan.

    Google Scholar 

  • MIRA J. et al (1987): “The fuzzy paradigm for knowledge representation in cerebral dynamics”. Fuzzy Sets and Systems, 23, pp. 315–330.

    Google Scholar 

  • MIRA J. and DELGADO A.E. (1987): “A logical model of co-operative processes in cerebral dynamics”. Cybernetics and Systems: An International Journal, 18, pp. 319–349.

    Google Scholar 

  • MIRA, J. (1989): “System behaviour and computing structure”. In Lecture Notes in Computer Science: Computer Aided Systems Theory-EUROCAST'89. Ed. by F. Pichler and R. Moreno-Diaz. pp. 267–283. Springer-Verlag. Berlin.

    Google Scholar 

  • MIRA, J. et al (1989): “Towards a computational theory of systems. Some cases study”. In Lecture Notes in Computer Science: Computer Aided Systems Theory-EUROCAST'89. Ed. by F. Pichler and R. Moreno-Diaz. pp. 284–300. Springer-Verlag. Berlin.

    Google Scholar 

  • MIRA, J. (1990): “Signification and Intention in Neural Nets, Revisited”. Proc. Fourth International Symposium on Knowledge Engineering, pp. 1–20. Barcelona.

    Google Scholar 

  • MOUNTCASTLE V.B. (1979): “An organizing principle for cerebral function: the unit module and the distributed system”, in F.O. Schmitt and F.G. Worden (Eds.): The Neuroscience Fourth Study Program, pp. 21–42. The MIT Press, Cambridge. Mass.

    Google Scholar 

  • PERKEL D.H. and BULLOCK T.H. (1968): “Neural coding. A report based on an NRP work session”. Neurociences Research Program Bulletin, Vol. 6, No. 3. Brookline, Mass.

    Google Scholar 

  • RUMELHART D.E. and McCLELLAND J.L. eds. (1987): “Parallel distributed processing”. Vol. 1: Foundations. The MIT Press. Mass.

    Google Scholar 

  • SZENTAGOTHAI J. (1975): “The module concept in cerebral cortex architecture”. Brain Research, 95. pp. 475–496.

    Google Scholar 

  • SZENTAGOTHAI J. (1979): “Local neuron circuits of the neocortex”. In F.O. Schmitt and F.G. Worden (Eds.): “The Neuroscience Fourth Study Program”, pp. 394–415. The MIT Press, Cambridge. Mass.

    Google Scholar 

  • VARELA F. (1977): “The nervous system as a closed network”. Brain Theory Newsletter. Vol. 2, No 4, pp. 66–67.

    Google Scholar 

  • VARELA F.J. (1979): “Principles of biological autonomy”. North-Holland. N. York.

    Google Scholar 

  • VON NEUMANN J. (1956): “Probabilistic logics and the synthesis of reliable organisms from unreliable components”. In: “Automata Studies”. Ed. by C.E. Shannon and J. McCarthy. Princenton University Press. Princenton, New York.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Franz Pichler Roberto Moreno Díaz

Rights and permissions

Reprints and permissions

Copyright information

© 1992 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Mira, J., Delgado, A.E. (1992). Linear and algorithmic formulation of co-operative computation in neural nets. In: Pichler, F., Díaz, R.M. (eds) Computer Aided Systems Theory — EUROCAST '91. EUROCAST 1991. Lecture Notes in Computer Science, vol 585. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0021001

Download citation

  • DOI: https://doi.org/10.1007/BFb0021001

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-55354-0

  • Online ISBN: 978-3-540-47034-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics