A Neural Theory of Preattentive Visual Information Processing: Emergent Segmentation, Cooperative-Competitive Computation, and Parallel Memory Storage

  • Steven Grossberg
  • Enrico Mingolla


A real-time neural theory of preattentive visual information processing is described. The theory employs specialized neural networks expressed by systems of nonlinear ordinary differential equations. These dynamical systems describe hierarchies of nonlinear filters and cooperative-competitive feedback processes which generate coherent emergent segmentations that are sensitive to a scene’s global statistical properties. The emergent segmentations are controlled automatically by internal feedback loops rather than by external parameters. The theory shows how these circuits contextually resolve several basic uncertainties of local visual information processing. Historical antecedents of this theory within the recent decades of work on neural modelling are described, including the role of Liapunov functions in the analysis of memory storage.


Receptive Field Illusory Contour Neural Theory Subjective Contour Visual Information Processing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    E. Mach, The analysis of sensation and the relation of the physical to the psychical, C.M. Williams (Trans.), revised by S. Waterlow, Open Court Publishing Co., London (1914).Google Scholar
  2. 2.
    J. Beck, Perceptual grouping produced by changes in orientation and shape, Science, 154, 538 (1966).PubMedCrossRefGoogle Scholar
  3. 3.
    J. Beck, K. Prazdny and A. Rosenfeld, A theory of textural segmentation, in “Human and machine vision,” J. Beck, B. Hope and A. Rosenfeld (eds.), Academic Press, New York (1983).Google Scholar
  4. 4.
    B. Julesz, Binocular depth perception of computer-generated patterns, Bell System Technical Journal, 39, 1125 (1960).Google Scholar
  5. 5.
    G.A. Kaplan, Kinetic disruption of optical texture: The perception of depth at an edge, Perception and Psychophysics, 6, 193 (1969).CrossRefGoogle Scholar
  6. 6.
    G. Kanizsa, Margini quasi-percettivi in campi con stimolazione omegenea, Revista di Psicologia, 49, 7 (1955).Google Scholar
  7. 7.
    S. Grossberg, Studies of mind and brain: Neural principles of learning, perception, development, cognition, and motor control, Reidel Press, Boston (1982).Google Scholar
  8. 8.
    S. Amari and M.A. Arbib (eds.), Competition and cooperation in neural networks, Springer-Verlag, New York (1982).Google Scholar
  9. 9.
    E. Basar, H. Flohr, H. Haken and A.J. Mandell (eds.), Synergetics of the brain, Springer-Verlag, New York (1983).Google Scholar
  10. 10.
    G.A. Carpenter and S. Grossberg, Associative learning, adaptive pattern recognition, and cooperative-competitive decision making by neural networks, in “Hybrid and optical computing,” H. Szu (ed.), SPIE, in press (1985).Google Scholar
  11. 11.
    S. Grossberg, Adaptive resonance in development, perception, and cognition, in “Mathematical psychology and psychophysiology,” S. Grossberg (ed.), American Mathematical Society, Providence, RI (1981).Google Scholar
  12. 12.
    S. Grossberg (ed.), The adaptive brain, I: Cognition, learning, reinforcement, and rhythm, Elsevier/North-Holland, Amsterdam (1986).Google Scholar
  13. 13.
    S. Grossberg, (ed.), The adaptive brain, II: Vision, speech, language, and motor control, Elsevier/North-Holland, Amsterdam (1986).Google Scholar
  14. 14.
    S. Grossberg and M. Kuperstein, Neural dynamics of adaptive sensory-motor control: Ballistic eye movements, Elsevier/North-Holland, Amsterdam (1986).Google Scholar
  15. 15.
    R. Hecht-Nielsen, Nearest matched filter classification of spatiotemporal patterns, in “Hybrid and optical computing,” H. Szu (ed.), SPIE, in press (1986).Google Scholar
  16. 16.
    D. Hestenes, Maximum entropy and Bayesian spectral analysis and estimation problems, C.R. Smith (ed.), Reidel Press, Boston (1986).Google Scholar
  17. 17.
    J.P.E. Hodgson (ed.), Oscillations in mathematical biology, Springer-Verlag, New York (1983).Google Scholar
  18. 18.
    T. Kohonen, Self-organization and associative memory, Springer-Verlag, New York (1984).Google Scholar
  19. 19.
    D.S. Levine, Neural population modelling and psychology: A review, Mathematical Biosciences, 66, 1 (1983).CrossRefGoogle Scholar
  20. 20.
    J.J. Hopfield, Neural networks and physical systems with emergent collective computational abilities, Proceedings of the Naitonal Academy of Sciences USA, 79, 2554 (1982).CrossRefGoogle Scholar
  21. 21.
    J.J. Hopfield, Neurons with graded response have collective computational properties like those of two-state neurons, Proceedings of the National Academy of Sciences USA, 81, 3088 (1984).CrossRefGoogle Scholar
  22. 22.
    J.J. Hopfield and D.W. Tank, Computing with neural circuits: A model, Science, 233, 625 (1986).PubMedCrossRefGoogle Scholar
  23. 23.
    S. Grossberg, Nonlinear difference-differential equations in prediciton and learning theory, Proceedings of the National Academy of Sciences USA, 58, 1329 (1967).CrossRefGoogle Scholar
  24. 24.
    S. Grossberg, Some nonlinear networks capable of learning a spatial pattern of arbitrary complexity, Proceedings of the National Academy of Sciences, 59, 368 (1968).CrossRefGoogle Scholar
  25. 25.
    S. Grossberg, On learning and energy-entropy dependence in recurrent and nonrecurrent signed networks, Journal of Statistical Physics, 1, 319 (1969).CrossRefGoogle Scholar
  26. 26.
    S. Grossberg, Some networks that can learn, remember, and reproduce any number of complicated space-time patterns II, Studies in Applied Mathematics, 49, 135 (1970).Google Scholar
  27. 27.
    S. Grossberg, Pavlovian pattern learning by nonlinear neural networks, Proceedings of the National Academy of Sciences USA, 68, 828 (1971).CrossRefGoogle Scholar
  28. 28.
    S. Grossberg, Pattern learning by functional-differential neural networks with arbitrary path weights, in “Delay and functional-differential equations and their applications,” K. Schmitt (ed.), Academic Press, New York (1972).Google Scholar
  29. 29.
    S. Grossberg, Classical and instrumental learning by neural networks, in “Progress in theoretical biology,” Vol. 3, R. Rosen and F. Snell (eds.), Academic Press, New York (1974).Google Scholar
  30. 30.
    S. Grossberg and J. Pepe, Spiking threshold and overarousal effects in serial learning, Journal of Statistical Physics, 3, 95 (1971).CrossRefGoogle Scholar
  31. 31.
    M.A. Cohen and S. Grossberg, Absolute stability of global pattern formation and parallel memory storage by competitive neural networks, IEEE Transactions on Systems, Man, and Cybernetics, SMC-13, 815 (1983).Google Scholar
  32. 32.
    S.A. Ellias and S. Grossberg, Pattern formation, contrast control, and oscillations in the short term memory of shunting on-center off-surround networks, Biological Cybernetics, 20, 69 (1975).CrossRefGoogle Scholar
  33. 33.
    S. Grossberg, Contour enhancement, short-term memory, and constancies in reverberating neural networks, Studies in Applied Mathematics, 52, 217 (1973).Google Scholar
  34. 34.
    S. Grossberg, Pattern formation by the global limits of a nonlinear competitive interaction in n dimensions, Journal of Mathematical biology, 4, 237 (1977).PubMedCrossRefGoogle Scholar
  35. 35.
    S. Grossberg, Competition, decision, and consensus, Journal of Mathematical Analysis and Applications, 66, 470 (1978).CrossRefGoogle Scholar
  36. 36.
    S. Grossberg, Decisions, patterns, and oscillations in the dynamics of competitive systems with applications to Volterra-Lotka systems, Journal of Theoretical Biology, 73, 101 (1978).PubMedCrossRefGoogle Scholar
  37. 37.
    S. Grossberg, Biological competition: Decision rules, pattern formation, and oscillations, Proceedings of the National Academy of Sciences USA, 77, 2338 (1980).CrossRefGoogle Scholar
  38. 38.
    S. Grossberg and D. Levine, Some developmental and attentional biases in the contrast enhancement and short term memory of recurrent neural networks, Journal of Theoretical Biology, 53, 341 (1975).PubMedCrossRefGoogle Scholar
  39. 39.
    S. Amari, Competitive and cooperative aspects in dynamics of neural excitation and self-organization, in “Competition and cooperation in neural networks,” S.I. Amari and M. Arbib (eds.), Springer-Verlag, New York (1982).CrossRefGoogle Scholar
  40. 40.
    S. Geman, The law of large numbers in neural modelling, in “Mathematical psychology and psychophysiology,” S. Grossberg (ed.), American Mathematical Society, Providence, RI (1981).Google Scholar
  41. 41.
    T. Kohonen, Associative memory — A system-theoretical approach, Springer-Verlag, New York (1977).Google Scholar
  42. 42.
    T.R. Dixon and D.L. Horton, Verbal behavior and general behavior theory, Prentice-Hall, Englewood Cliffs, NJ (1968).Google Scholar
  43. 43.
    J. Jung, Verbal learning, Holt, Rinehart and Winston, New York (1968).Google Scholar
  44. 44.
    J.A. McGeogh and A.L. Irion, The psychology of human learning, second edition, Longmans and Green, New York (1952).Google Scholar
  45. 45.
    C.E. Osgood, Method and theory in experimental psychology, Oxford, New York (1953).Google Scholar
  46. 46.
    B.J. Underwood, Experimental psychology, second edition, Appleton-Century-Crofts, New York (1966).Google Scholar
  47. 47.
    S. Grossberg, On the serial learning of lists, Mathematical Biosciences, 4, 201 (1969).CrossRefGoogle Scholar
  48. 48.
    G.A. Carpenter and S. Grossberg, Neural dynamics of category learning and recognition: Attention, memory consolidation, and amnesia, in “Brain structure, learning, and memory,” J. Davis, R. Newburgh and E. Wegman (eds.), AAAS Symposium Series, in press (1986).Google Scholar
  49. 49.
    G.A. Carpenter and S. Grossberg, A massively parallel architecture for a self-organizing neural pattern recognition machine, Computer Vision, Graphics, and Image Processing, in press (1986).Google Scholar
  50. 50.
    G.A. Carpenter, A geometric approach to singular perturbation problems with applications to nerve impulse equations, Journal of Differential Equations, 23, 335 (1977).CrossRefGoogle Scholar
  51. 51.
    G.A. Carpenter, Periodic solutions of nerve impulse equations, Journal of Mathematical Analysis and Applications, 58, 152 (1977).CrossRefGoogle Scholar
  52. 52.
    G.A. Carpenter, Bursting phenomena in excitable membranes, SIAM Journal on Applied Mathematics, 36, 334 (1979).CrossRefGoogle Scholar
  53. 53.
    G.A. Carpenter, Normal and abnormal signal patterns in nerve cells, in “Mathematical psychology and psychophysiology,” S. Grossberg (ed.), American Mathematical Society, Providence, RI, pp. 49–90 (1981).Google Scholar
  54. 54.
    G.B. Ermentrout and J.D. Cowan, A mathematical theory of visual hallucination patterns, Biological Cybernetics, 34, 137 (1979).PubMedCrossRefGoogle Scholar
  55. 55.
    G.B. Ermentrout and J.D. Cowan, Temporal oscillations in neuronal nets, Journal of Mathematical Biology, 7, 265 (1979).PubMedCrossRefGoogle Scholar
  56. 56.
    W.J. Freeman, Nonlinear dynamics of paleocortex manifested in the olfactory EEG, Biological Cybernetics, 35, 21 (1979).PubMedCrossRefGoogle Scholar
  57. 57.
    H.R. Wilson and J.D. Cowan, Excitatory and inhibitory interactions in localized populations of model neurons, Biophysical Journal, 12(1), 1 (1972).PubMedCrossRefGoogle Scholar
  58. 58.
    W.S. McCulloch and W. Pitts, A logical calculus of the ideas imminent in nervous activity, Bulletin of Mathematical Biophysics, 5, 115 (1943).CrossRefGoogle Scholar
  59. 59.
    E.R. Caianiello, Outline of a theory of thought and thinking machines, Journal of Theoretical Biology, 1, 204 (1961).PubMedCrossRefGoogle Scholar
  60. 60.
    F. Rosenblatt, Principles of neurodynamics, Spartan Books, Washington, DC (1962).Google Scholar
  61. 61.
    J. Beck, Effect of orientation and of shape similarity on perceptual grouping, Perception and Psychophysics, 1, 300 (1966).Google Scholar
  62. 62.
    J. Beck, Textural segmentation, in “Organization and representation in perception,” J. Beck (ed.), Erlbaum, Hillsdale, NJ (1982).Google Scholar
  63. 63.
    J. Beck, Textural segmentation, second order statistics, and textural elements, Biological Cybernetics, 48, 125 (1983).PubMedCrossRefGoogle Scholar
  64. 64.
    T. Caelli, On discriminating visual textures and images, Perception and Psychophysics, 31, 149 (1982).PubMedCrossRefGoogle Scholar
  65. 65.
    T. Caelli, Energy processing and coding factors in texture discrimination and image processing, Perception and Psychophysics, 34, 349 (1983).PubMedCrossRefGoogle Scholar
  66. 66.
    T. Caelli and B. Julesz, Psychophysical evidence for global feature processing in visual texture discrimination, Journal of the Optical Society of America, 69, 675 (1979).PubMedCrossRefGoogle Scholar
  67. 67.
    W.R. Garner, The processing of information and structure, Erlbaum, Hillsdale, NJ (1974).Google Scholar
  68. 68.
    J.R. Pomerantz, Perceptual organization in information processing, in “Perceptual organization,” M. Kubovy and J.R. Pomerants (eds.), Erlbaum, Hillsdale, NJ (1981).Google Scholar
  69. 69.
    J.R. Pomerantz, Global and local precedence: Selective attention in form and motion perception, Journal of Experimental Psychology: General, 112, 516 (1983).CrossRefGoogle Scholar
  70. 70.
    J.R. Pomerantz and S.D. Schwaitzberg, Grouping by proximity: Selective attention measures, Perception and Psychophysics, 18, 355 (1975).CrossRefGoogle Scholar
  71. 71.
    D.L. Stefurak and R.M. Boynton, Independence of memory for categorically different colors and shapes, Perception and Psychophysics, 39, 164 (1986).PubMedCrossRefGoogle Scholar
  72. 72.
    A. Treisman, Perceptual grouping and attention in visual search for features and for objects, Journal of Experimental Psychology: Human Perception and Performance, 8, 194 (1982).PubMedCrossRefGoogle Scholar
  73. 73.
    A. Treisman and G. Gelade, A feature-integration theory of attention, Cognitive Psychology, 12, 97 (1980).PubMedCrossRefGoogle Scholar
  74. 74.
    A. Treisman and H. Schmidt, Illusory conjunctions in the perception of objects, Cognitive Psychology, 14, 107 (1982).PubMedCrossRefGoogle Scholar
  75. 75.
    A. Treisman, M. Sykes and G. Gelade, Selective attention and stimulus integration, in “Attention and performance VI,” S. Dornic (ed.), Erlbaum, Hillsdale, NJ, pp. 333–361 (1977).Google Scholar
  76. 76.
    H.L.F. von Helmholtz, Treatise on physiological optics, J.P.C. Southall (Trans.), Dover, New York (1962).Google Scholar
  77. 77.
    E.H. Land, The retinex theory of color vision, Scientific American, 237, 108 (1977).PubMedCrossRefGoogle Scholar
  78. 78.
    M.A. Cohen and S. Grossberg, Neural dynamics of brightness perception: Features, boundaries, diffusion, and resonance, Perception and Psychophysics, 36, 428 (1984).PubMedCrossRefGoogle Scholar
  79. 79.
    A.L. Yarbus, Eye movements and vision, Plenum Press, New York (1967).Google Scholar
  80. 80.
    J. Krauskopf, Effect of retinal image stabilization on the appearance of heterochromatic targets, Journal of the Optical Society of America, 53, 741 (1963).PubMedCrossRefGoogle Scholar
  81. 81.
    R.M. Pritchard, Stabilized images on the retina, Scientific American, 204, 72 (1961).PubMedCrossRefGoogle Scholar
  82. 82.
    R.M. Pritchard, W. Heron and D.O. Hebb, Visual perception approached by the method of stabilized images, Canadian Journal of Psychology, 14, 67 (1960).PubMedCrossRefGoogle Scholar
  83. 83.
    L.A. Riggs, F. Ratliff, J.C. Cornsweet and T.N. Cornsweet, The disappearance of steadily fixated visual test objects, Journal of the Optical Society of America, 43, 495 (1953).PubMedCrossRefGoogle Scholar
  84. 84.
    S. Grossberg, Outline of a theory of brightness, color, and form perception, in “Trends in mathematical psychology,” E. Degreef and J. van Buggenhaut (eds.), North-Holland, Amsterdam (1984).Google Scholar
  85. 85.
    S. Grossberg and E. Mingolla, Neural dynamics of form perception: Boundary completion, illusory figures, and neon color spreading, Psychological Review, 92, 173 (1985).PubMedCrossRefGoogle Scholar
  86. 86.
    H.J.M. Gerrits, B. de Haan and A.J.H. Vendrick, Experiments with retinal stabilized images: Relations between the observations and neural data, Vision Research, 6, 427 (1966).PubMedCrossRefGoogle Scholar
  87. 87.
    H.J.M. Gerrits and J.G.M.E.N. Timmerman, The filling-in process in patients with retinal scotomata, Vision Research, 9, 439 (1969).PubMedCrossRefGoogle Scholar
  88. 88.
    H.J.M. Gerrits and A.J.H. Vendrick, Simultaneous contrast, filling-in process and information processing in man’s visual system, Experimental Brain Research, 11, 411 (1970).CrossRefGoogle Scholar
  89. 89.
    N. Kawabata, Perception of the blind spot and similarity grouping, Perception and Psychophysics, 36, 151 (1984).PubMedCrossRefGoogle Scholar
  90. 90.
    L.E. Arend, J.N. Buehler and G.R. Lockhead, Difference information in brightness perception, Perception and Psychophysics, 9, 367 (1971).CrossRefGoogle Scholar
  91. 91.
    R.H. Day, Neon color spreading, partially delineated borders, and the formation of illusory contours, Perception and Psychophysics, 34, 488 (1983).PubMedCrossRefGoogle Scholar
  92. 92.
    A.R.H. Gellatly, Perception of an illusory triangle with masked inducing figure, Perception, 9, 599 (1980).PubMedCrossRefGoogle Scholar
  93. 93.
    G. Kanizsa, Contours without gradients or cognitive contours? Italian Journal of Psychology, 1, 93 (1974).Google Scholar
  94. 94.
    J.M. Kennedy, Illusory contours and the ends of lines, Perception, 7, 605 (1978).PubMedCrossRefGoogle Scholar
  95. 95.
    J.M. Kennedy, Subjective contours, contrast, and assimilation, in “Perception and pictorial representation,” C.F. Nodine and D.F. Fisher (eds.), Praeger, New York (1979).Google Scholar
  96. 96.
    J.M. Kennedy, Illusory brightness and the ends of petals: Change in brightness without aid of stratification or assimilation effects, Perception, 10, 583 (1981).PubMedCrossRefGoogle Scholar
  97. 97.
    T.E. Parks, Subjective figures: Some unusual concomitant brightness effects, Perception, 9, 239 (1980).PubMedCrossRefGoogle Scholar
  98. 98.
    T.E. Parks and W. Marks, Sharp-edged versus diffuse illusory circles: The effects of varying luminance, Perception and Psychophysics, 33, 172 (1983).PubMedCrossRefGoogle Scholar
  99. 99.
    S. Petry, A. Harbeck, J. Conway and J. Levey, Stimulus determinants of brightness and distinctness of subjective contours, Perception and Psychophysics, 34, 169 (1983).PubMedCrossRefGoogle Scholar
  100. 100.
    C. Redies and L. Spillmann, The neon color effect in the Ehrenstein illusion, Perception, 10, 667 (1981).CrossRefGoogle Scholar
  101. 101.
    H.F.J.M. van Tuijl, A new visual illusion: Neonlike color spreading and complementary color induction between subjective contours, Acta Psychologica, 39, 441 (1975).PubMedCrossRefGoogle Scholar
  102. 102.
    H.F.J.M. van Tuijl and C.M.M. de Weert, Sensory conditions for the occurrence of the neon spreading illusion, Perception, 8, 211 (1979).PubMedCrossRefGoogle Scholar
  103. 103.
    D.H. Hubel and T.N. Wiesel, Functional architecture of macaque monkey visual cortex, Proceedings of the Royal Society of London (B), 198, 1 (1977).CrossRefGoogle Scholar
  104. 104.
    S. Grossberg and E. Mingolla, Neural dynamics of perceptual grouping: Textures, boundaries, and emergent segmentations, Perception and Psychophysics, 38, 141 (1985).PubMedCrossRefGoogle Scholar
  105. 105.
    S. Grossberg, On the development of feature detectors in the visual cortex with applications to learning and reaction-diffusion systems, Biological Cybernetics, 21, 145 (1976).PubMedCrossRefGoogle Scholar
  106. 106.
    S. Grossberg, Neural substrates of binocular form perception: Filtering, matching, diffusion, and resonance, in “Synergetics of the brain,” E. Basar, H. Flohr, H. Haken and A.J. Mandell (eds.), Springer-Verlag, New York (1983).Google Scholar
  107. 107.
    M. Wertheimer, Untersuchungen zur Lehre von der Gestalt, II, Psychologische Forschung, 4, 301 (1923).CrossRefGoogle Scholar
  108. 108.
    U. Neisser, Cognitive psychology, Appleton-Century-Crofts, New York (1967).Google Scholar
  109. 109.
    B.K.P. Horn, Understanding image intensities, Artificial Intelligence, 8, 201 (1977).CrossRefGoogle Scholar
  110. 110.
    D. Marr and E. Hildreth, Theory of edge detection, Proceedings of the Royal Society of London (B), 207, 187 (1980).CrossRefGoogle Scholar
  111. 111.
    F. Ratliff, Mach bands: Quantitative studies on neural networks in the retina, Holden-Day, New York (1965).Google Scholar
  112. 112.
    L. Glass and E. Switkes, Pattern recognition in humans: Correlations which cannot be perceived, Perception, 5, 67 (1976).PubMedCrossRefGoogle Scholar
  113. 113.
    C.F. Nodine and D.F. Fisher (eds.), Perception and pictorial representation, Praeger, New York (1979).Google Scholar
  114. 114.
    S. Grossberg and E. Mingolla, The role of illusory contours in visual segmentation, in “Proceedings of the international conference on illusory contours,” G. Meyer and S. Petry (eds.), Pergamon Press (1986).Google Scholar

Copyright information

© Plenum Press, New York 1986

Authors and Affiliations

  • Steven Grossberg
    • 1
  • Enrico Mingolla
    • 1
  1. 1.Center for Adaptive SystemsBoston UniversityBostonUSA

Personalised recommendations