Succinct Representation in Neural Nets and General Systems

  • Alex M. Andrew
Part of the NATO Conference Series book series (NATOCS, volume 5)


Most large systems can be described in terms which imply that their viability is due to their ability to adapt to environmental changes. It is probably impossible to define adaptation in a way which is both rigorous and consistent with intuition. The same is true for other terms referring to the autonomous self-modification of systems, such as learning, self-optimization and self-organization.


Inductive Inference Learning Automaton Redundancy Reduction Succinct Representation Association Unit 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    V. M. Glushkov, Introduction to Cybernetics, Academic Press, New York, 1966.Google Scholar
  2. 2.
    H. Maturana, “Neurophysiology of Cognition,” In: Cognition, A Multiple View, edited by P. L. Garvin, Spartan, New York, pp. 3–23, 1970.Google Scholar
  3. 3.
    R. B. Banerji, Theory of Problem Solving, Elsevier, New York, 1969.Google Scholar
  4. 4.
    A. M. Andrew, “To Model or Not to Model,” Kybernetik 3, pp. 272–275, 1967.CrossRefGoogle Scholar
  5. 5.
    B. R. Gaines, “System Identification, Approximation and Complexity,” International Journal of General Systems, 3, pp. 145–174, 1977.CrossRefGoogle Scholar
  6. 6.
    D. Hume, A Treatise of Human Nature, J. M. Dent and Sons (Everyman’s Library), London, 1911.Google Scholar
  7. 7.
    W. S. McCulloch, “What is a Number, That a Man May Know It, and a Man, That He May Know a Number?” General Semantics Bulletin, Nos. 26 and 27, pp. 7–18, 1960.Google Scholar
  8. 8.
    S. Amarel, “On the Automatic Formation of a Computer Program Which Represents a Theory,” In: Self-Organizing Systems 1962, edited by M. C. Yovits, G. T. Jacobi and G. D. Goldstein, Spartan, Washington, pp. 107–175, 1962.Google Scholar
  9. 9.
    L. Lofgren, “Recognition of Order and Evolutionary Systems,” In: Computer and Information Sciences 2, edited by J. T. Tou, Academic Press, New York, 1967.Google Scholar
  10. 10.
    D. Rothenberg, “Predicate Calculus Feature Generation,” In: Formal Aspects of Cognitive Processes, edited by T. Storer and D. Winter, Springer, Berlin, pp. 72–125, 1975.Google Scholar
  11. 11.
    R. J. Solomonoff, “A Formal Theory of Inductive Inference,” Information and Control, 7, pp. 1–22 and 224–254, 1964.CrossRefGoogle Scholar
  12. 12.
    G. Pask, “The Logical Type of Illogical Evolution,” In: Information Processing 1962 (IFIP), North-Hoiland, Amsterdam, pp. 482–483.Google Scholar
  13. 13.
    M. A. Arbib, “Cognition--A Cybernetics Approach,” In: Cognition, A Multiple View, edited by P. L. Garvin, Spartn, New York, pp. 331–348, 1970.Google Scholar
  14. 14.
    M. Minsky and O. G. Selfridge, “Learning in Random Nets,” In: Information Theory, edited by E. C. Cherry, Butterworth, London, pp. 335–347, 1961.Google Scholar
  15. 15.
    M. Minsky, “Steps Toward Artificial Intelligence,” In: Computers and Thought, edited by E. A. Feigenbaum and J. Feldman, McGraw-Hill, New York, pp. 406–450, 1963.Google Scholar
  16. 16.
    O. G. Selfridge, “Pandemonium: A Paradigm for Learning,” In: Mechanisation of Thought Processes, H.M.S.O. London, pp. 511–531, 1959.Google Scholar
  17. 17.
    M. Minsky and S. Papert, Perceptrons, MIT Press, Cambridge, Mass., 1969.Google Scholar
  18. 18.
    A. M. Andrew, “Significance Feedback and Redundancy Reduction in Self-Organizing Networks,” In: Advances in Cybernetics and Systems Research, Vol. 1, edited by F. Pichler and R. Trappl, Transcripta, London, 1973.Google Scholar
  19. 19.
    A. M. Andrew, “Learning in Networks with Minimal Disruption,” Proceedings of Third European Meeting on Cybernetics and Systems Research, Vienna 1976. To be published by Hemisphere, Washington, 1977.Google Scholar
  20. 20.
    H. B. Barlow, “Possible Principles Underlying the Transformation of Sensory Messages,” In: Sensory Communication, ed. W. A. Rosenblith, MIT Press, pp. 217–234, 1961.Google Scholar
  21. 21.
    A. M. Uttley, “The Informon: A Network for Adaptive Pattern Recognition,” J. Theor. Biol. 27, pp. 31–67, 1970.CrossRefGoogle Scholar
  22. 22.
    P. D. Wall and M. D. Egger, “Formation of New Connexions in Adult Rat Brains After Partial Deafferentation,” Nature 232, pp. 542–545, 1971.CrossRefGoogle Scholar
  23. 23.
    S-H. Chung, “Ineffective Nerve Terminals,” Nature 261, pp. 190–191, 1976.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 1978

Authors and Affiliations

  • Alex M. Andrew
    • 1
  1. 1.Dept. of CyberneticsUniversity of ReadingEngland

Personalised recommendations