How Local Cortical Processors that Maximize Coherent Variation could lay Foundations for Representation Proper

  • W. A. Phillips
  • Jim Kay
  • D. M. Smyth
Part of the Workshops in Computing book series (WORKSHOPS COMP.)


This paper discusses computational capabilities that might be common to local processors in many different cortical regions. It examines the possibility that cortical processors may perform a kind of statistical latent structure analysis that discovers predictive relationships between large and diverse data sets. Information theory is used to show that this goal is formally coherent, and its computational feasibility is investigated by simulating multi-stream networks built from local processors with properties that this goal requires. The hypotheses developed emphasize cooperative population codes and the contextual guidance of learning and processing. Neurobiological and neuropsychological evidence for contextual guidance and cooperative population codes is outlined. The possible relevance of these ideas to the concept of representation proper is discussed.


Mutual Information Receptive Field Neural Computation Population Code Luminance Difference 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Artola, A., Brocher, S. & Singer, W. (1990) Different voltage-dependent thresholds for the induction of long-term depression and long-term potentiation in slices of the rat visual cortex. Nature 347, 69–72.CrossRefGoogle Scholar
  2. Atick, J. J. & Redlich, A. N. (1993) Convergent algorithm for sensory receptive field development. Neural Computation 5, 45–60CrossRefGoogle Scholar
  3. Baddeley, R. J. & Hancock P. J. B. (1991) A statistical analysis of natural images matches psychophysicaly derived orientation tuning curves. Proceedings of the Royal Society of London B246, 219–223.CrossRefGoogle Scholar
  4. Baldi, В. & Hornik, K. (1989). Neural networks and principal component analysis: learning from examples without local minima. Neural Networks 2, 53–58.CrossRefGoogle Scholar
  5. Barlow H. B. (1961) Possible principles underlying the transformations of sensory messages. In Rosenblith, W. A. (ed.) Sensory Communication Boston: MIT Press.Google Scholar
  6. Barlow, H. B. (1989) Unsupervised learning. Neural Computation 1, 295–311.CrossRefGoogle Scholar
  7. Barlow, H. B.& Foldiak, P. (1989) Adaptation and decorrelation in the cortex. In Durbin, R. & Miall, С (eds.,) The Computing Neuron Wokingham: Addison-Wesley.Google Scholar
  8. Becker S. & Hinton G. E. (1992). Self-organizing neural network that discovers surfaces in random-dot stereograms. Nature 355, 161–163.CrossRefGoogle Scholar
  9. Biederman, I. (1972) Perceiving real-world scenes. Science 111, 77–80.CrossRefGoogle Scholar
  10. Bienenstock E. L., Cooper L. N., & Munro P. W. (1982). Theory for the development of neuron selectivity: Orientation specificity and binocular interaction in visual cortex. Journal of Neuroscience 2, 32–48.Google Scholar
  11. Brousse, O. & Smolensky, P. (1989) Virtual memories and massive generalization in connectionist combinatorial learning. In Proceedings of the 11th Annual Conference of the Cognitive Science Society. Hillside, NJ: Lawrence Erlbaum.Google Scholar
  12. Byrne, R. W. & Whiten, A. (1992) Cognitive evolution in primates: evidence from tactical deception. Man 27, 609–627.CrossRefGoogle Scholar
  13. Campbell, R. N. & Olson, D. R. (1990) Children’s thinking. In R. Grieve & M. Hughes (eds.) Understanding Children: Essays in honour of Margaret Donaldson. Oxford: Blackwell.Google Scholar
  14. Chevalier-Skolinkoff, S. (1983) Sensori-motor development in orang-utans and other primates. Journal of Human Evolution 12, 545–546.CrossRefGoogle Scholar
  15. Cohen J. D. & Servan-Schreiber D. (1992) Context, cortex, and Dopamine: A connectionist approach to behaviour and biology in schizophrenia. Psychological Review 99, 45–77.CrossRefGoogle Scholar
  16. Craver-Lemley, С & Reeves, A. (1987) Visual imagery selectively reduces vernier acuity. Perception, 16, 599–614.CrossRefGoogle Scholar
  17. De Sa, V. (1994) Unsupervised Classification Learning from Cross-Modal Environmental Structure PhD Thesis, University of Rochester, NY.Google Scholar
  18. De Loach, J. (1987) Rapid change in the symbolic functioning of very young children. Science 238, 1556–1557.CrossRefGoogle Scholar
  19. Foldiak, P. (1990) Forming sparse representations by local anti-Hebbian learning. Biological Cybernetics 64, 165–170.CrossRefGoogle Scholar
  20. Fox K., Sato H. & Daw N. (1990) The effect of varying stimulus intensity on NMDA-receptor activity in cat visual cortex. Journal of Neurophysiology 64, 1413–1428.Google Scholar
  21. Gibson, J. J. & Radner, M. (1937) Adaptation, after-effect and contrast in the perception of tilted lines. Journal of Experimental Psychology 20, 453–467.CrossRefGoogle Scholar
  22. Gilbert, C. D. (1992) Horizontal integration and cortical dynamics. Neuron 9, 1–13.CrossRefGoogle Scholar
  23. Gilbert, C. D., & Wiesel, T. N. (1990) The influence of contextual stimuli on the orientation selectivity of cells in primary visual cortex of the cat. Vision Research 11, 1689–1701.CrossRefGoogle Scholar
  24. Giffins, R. (1985) Canonical Analysis: A Review with Applications in Ecology Biomathematics 12. Berlin: Springer-Verlag.Google Scholar
  25. Goodall, W. С (1995) Neuropsychological studies of Reading and Writing. PhD Thesis, University of Stirling, Scotland, UK.Google Scholar
  26. Goodall, W. C. & Phillips, W. A. (1995) Three routes from print to sound: Evidence from a case of acquired dyslexia. Cognitive Neuropsychology, in press.Google Scholar
  27. Hancock P. J. В., L. S. Smith, & Phillips W. A. (1991). A biologically supported error-correcting learning rule. Neural Computation 3, 201–212.CrossRefGoogle Scholar
  28. Hirsch J. A. & Gilbert C. D. (1991) Synaptic physiology of horizontal connections in cat’s visual cortex. Journal of Neuroscience 11, 1800–1809.Google Scholar
  29. Hirsch J. A. & Gilbert C. D. (1993) Long-term changes in synaptic strength along specific intrinsic pathways in the cat visual cortex. Journal of Physiology 461, 247–262.Google Scholar
  30. Hobson J. A. (1990) Activation, input source, and modulation: A neurocognitive model of the state of the brain-mind. In Bootzin R. R., Kihlstrom J. F. & Schacter D. L.Sleep & Cognition. 2: 25–40.Google Scholar
  31. Hotelling, H. (1936) Relations between two sets of variables. Biometrika 28, 321–77.zbMATHGoogle Scholar
  32. Humphreys, G. W. & Riddoch, M. J. (1987) To see but not to see: A case study of visual agnosia. London: Lawrence Erlbaum.Google Scholar
  33. Kay J. (1992) Feature discovery under contextual supervision using mutual information. International Joint Conference on Neural Networks, 4, 79–84. Google Scholar
  34. Kay, J. & Phillips, W. A. (1994) Activation functions, computational goals and learning rules for local processors with contextual guidance. Technical Report CCCN-15, University of Stirling, Centre for Cognitive and Computational Neuroscience.Google Scholar
  35. Kay, J. & Phillips, W. A. (1995) Activation functions, computational goals and learning rules for local processors with contextual guidance. Manuscript submitted, & available from authors.Google Scholar
  36. Li, Z. & Atick, J. J. (1994) Efficient stereocoding in the multiscale representation. Network 5, 157–174.zbMATHCrossRefGoogle Scholar
  37. Linsker, R. (1988). Self-organization in a perceptual network. Computer 21, 105–117.CrossRefGoogle Scholar
  38. Lowel, S., & Singer, W. (1992) Selection of intrinsic horizontal connections in the visual cortex by correlated neuronal activity. Science 255, 209–212.CrossRefGoogle Scholar
  39. Marr, D. (1982) Vision. San Francisco: Freeman.Google Scholar
  40. McClelland, J. L. (1978) Perception and masking of wholes and parts. Journal of Experimental psychology: Human Perception and Performance 4, 210–223.CrossRefGoogle Scholar
  41. Moran, J. & Desimone, R. (1985) Selective attention gates visual processing in the extrastriate cortex. Science, 229, 782–784.CrossRefGoogle Scholar
  42. Phillips, W. A. (1971) Does familiarity affect transfer from an iconic to a short-term memory? Perception and Psychophysics 10, 153–157.CrossRefGoogle Scholar
  43. Phillips, W. A. & Goodall, W. C. (1995) Lexical writing can be non-semantic and fluent without practice. Cognitive Neuropsychology (in press).Google Scholar
  44. Phillips, W. A., Hay, I. M., & Smith, L. S. (1993) Lexicality and pronunciation in a simulated neural net. British Journal of Mathematical and Statistical Psychology 46, 193–205.CrossRefGoogle Scholar
  45. Phillips, W. A., Kay, J., & Smyth, D. (1995) The discovery of structure by multi-stream networks of local processors with contextual guidance. Manuscript submitted, & available from authors.Google Scholar
  46. Piaget, J (1954) The Construction of Reality by the Child New York: Basic Books.CrossRefGoogle Scholar
  47. Plaut, D. С & McClelland, J. L. (1993) Generalization with componential attractors: Word and nonword reading in an attractor network. In Proceedings of the 15th Annual Conference of the Cognitive Science Society. Hillside, NJ: Lawrence Erlbaum.Google Scholar
  48. Redlich, A. N. (1993) Redundancy reduction as a strategy for unsupervised learning. Neural Computation 5, 289–304.CrossRefGoogle Scholar
  49. Sagi, D & Julesz, B. (1986) Enhanced detection in the aperture of focal attention during simple discrimination tasks. Nature 321, 693–695.CrossRefGoogle Scholar
  50. Singer, W. (1990) Search for coherence: A basic principle of cortical self-organization. Concepts in Neuroscience 1, 1–26.Google Scholar
  51. Singer, W. (1993) Synchronization of cortical activity and its putative role in information processing and learning. Annual Review of Physiology, 55, 349–374.CrossRefGoogle Scholar
  52. Smyth, D. (1994) Simulations of networks of local processors with contextual guidance. Master’s Thesis, CCCN, University of Stirling.Google Scholar
  53. Troscianko T. Landis, T. & Phillips W. A., (1993). Chromatic discrimination in cerebral achromotopsia: Additional evidence favouring magno-based perception, and a neural-net model. Perception 22 supplement, 8–9.Google Scholar
  54. von der Malsburg, С & Schneider, W. (1986) A neural cocktail-party processor. Biological Cybernetics 54, 29–40.CrossRefGoogle Scholar
  55. Wang, D., Buhmann, J, & von der Malsburg, С. (1990) Pattern segmentation in associative memory. Neural Computation 2, 94–106.CrossRefGoogle Scholar
  56. Weisstein, N. & Harris, С S. (1974) Visual detection of line segments: An object-superiority effect. Science 186, 752–755.CrossRefGoogle Scholar
  57. Wimmer, H. & Perner, J. (1983) Beliefs about beliefs: representing and constraining function of wrong beliefs in children’s understanding of deception. Cognition 13, 103–128.CrossRefGoogle Scholar
  58. Zaitchik, D. (1990) When representations conflict with reality. Cognition 35 41–68.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag London 1995

Authors and Affiliations

  • W. A. Phillips
    • 1
  • Jim Kay
    • 2
  • D. M. Smyth
    • 3
  1. 1.Centre for Cognitive and Computational NeuroscienceUniversity of StirlingStirlingUK
  2. 2.Scottish Agricultural Statistics ServiceMacaulay Land Use Research InstituteCraigiebuckler, AberdeenUK
  3. 3.Institute for InformaticsUniversity of LeipzigLeipzigGermany

Personalised recommendations